Encyclopedia · 311 concepts
Learn this concept as a feed

Architectures · advanced · concept 95 of 311 · Updated Nov 4, 2026

Multimodal Models

AI models that process multiple types of data, text, images, audio, video, simultaneously. Today's frontier models from OpenAI, Google, and Anthropic are all natively multimodal; text-only models are the exception, not the rule.

Top AI contributors on this

Key terms

Cross-modal attentionVision-languageContrastive learningCLIP

Where you meet it in the real world

Image captioning, visual Q&A, document understanding, video analysis

Courses, papers, and more