Computer vision and multimodal learning · MLD-1309
Vision transformer
A transformer that processes image representations, commonly sequences of embedded image patches.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Classify images with self-attention.
Original caveat
Not all vision transformers use identical tokenization or attention.
Context and aliases
Level: Intermediate. Stages: Architecture · Training · Inference.
Tags: DL · Vision · Multimodal.
Aliases: ViT.
Related concepts
Concepts linking here
Original references
- Learning Transferable Visual Models From Natural Language Supervision ↗ · Consulted
- Deep Learning: online textbook ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- Original reference URL ↗