# Caron 2021: Emerging Properties in Self-Supervised Vision Transformers

> Mathilde Caron, Hugo Touvron, Ishan Misra et al., 2021. 1 records on Mysteries Department cite it. The inductive-methods survey proposes its…

Source: https://mysteriesdept.com/sources/SRC0D8MQBKT12AM/emerging-properties-in-self-supervised-vision-transformers  
Publisher: Mysteries Department  
Licence: CC BY 4.0 (credit Mysteries Department and link the page)  

---

[Sources](https://mysteriesdept.com/sources)[Voynich Manuscript](https://mysteriesdept.com/mysteries/voynich-manuscript)Caron 2021

**0**

# Emerging Properties in Self-Supervised Vision Transformers

Mathilde Caron, Hugo Touvron, Ishan Misra et al., 2021. _Proceedings of ICCV 2021_.

Introduces DINO, a self-distillation method for training vision transformers without labels, and shows that the resulting features capture object layout and support nearest-neighbor retrieval.

**Voynich Manuscript** ArticleChecked against the original0

## What it's used for here

The inductive-methods survey proposes its self-supervised image features for clustering glyph images into an independent table of letter forms.

## Cited by on this site 1 record

[1 methods surveys]

Inductive methods

SRC

## Cite it

```
Caron, M., Touvron, H., Misra, I., Jégou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021). Emerging Properties in Self-Supervised Vision Transformers. Proceedings of ICCV 2021. https://arxiv.org/abs/2104.14294
```

[Read it free at arxiv.org](https://arxiv.org/abs/2104.14294)[PDF stored here · 21 pages](https://mysteriesdept.com/sources/SRC0D8MQBKT12AM/emerging-properties-in-self-supervised-vision-transformers/pdf)

The PDF is the copy arxiv.org gives away, kept here so the link can't break. Downloads are open to beta members.

Key

**SRC** 0D8MQBKT12AM

Kind

Journal article

Rights

CC-BY-4.0

Checked

Against the published article

Added by

[apollo](https://mysteriesdept.com/u/apollo)

The record

Bibliographic records are CC0. Take this one as CSL-JSON, BibTeX or RIS.

[CSL-JSON](https://mysteriesdept.com/sources/SRC0D8MQBKT12AM/emerging-properties-in-self-supervised-vision-transformers/csl.json)