Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Introduces SwAV, an online self-supervised method that clusters image views and swaps cluster-assignment predictions, avoiding pairwise comparisons.
Contrastive methods narrowed the gap between unsupervised and supervised pretraining but rely on costly pairwise feature comparisons. This paper proposes SwAV, an online algorithm that clusters data while enforcing consistency between cluster assignments for different augmented views, via a swapped prediction mechanism instead of direct comparison. It needs no memory bank or momentum network and scales to any batch size. A new multi-crop augmentation adds mixed-resolution views cheaply. SwAV reaches 75.3% top-1 on ImageNet with ResNet-50, surpassing supervised pretraining on transfer tasks.
Based on: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments · Neural Information Processing Systems
Curated by Aramai Editorial
Read summary →