Computer vision and multimodal learning · MLD-0785
Multimodal model
A model that processes or generates more than one modality, such as text, images, audio, or video.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Combine a user's spoken question with a camera image.
Original caveat
Multiple modalities do not guarantee strong cross-modal reasoning.
Context and aliases
Level: Intermediate. Stages: Architecture · Training · Inference.
Tags: DL · Vision · Multimodal.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- Learning Transferable Visual Models From Natural Language Supervision ↗ · Consulted
- Deep Learning: online textbook ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- Original reference URL ↗