Multimodal model definition

A model that can work with more than one kind of input or output, such as text, images, audio, or video.

What it actually is under the hood

Separate encoders or shared representations convert each modality into compatible signals. The model learns connections between them during training.