SwAV, SEER-Unsupervised Learning by Contrasting Cluster Assignments
Paper Arxiv 링크 저자 github Contribution simultaneously clusters the data "swapped" prediction memory efficient multi-crop Loss $$L(\boldsymbol{z}_{t},\boldsymbol{z}_{s})=\mathit{l}(\boldsymbol{z}_{t},\boldsymbol{q}_{s})+\mathit{l}(\boldsymbol{z}_{s},\boldsymbol{q}_{t})$$ Online clustering $\boldsymbol{z}_{t}$가 $C$를 지남. (fc layer랑 하는 역할이 비슷, but 훈련이 $f_{\theta}$와 다르게 됨.) 그다음 $\boldsymbol{q}_{s}$를 예..
2021.03.23