Models that read and write more than text: images, audio and video in the same model. Named by Radford et al., OpenAI: CLIP: Connecting text and images (Jan 5, 2021). Also called Multimodal models, Vision language models, VLM, Multimodal LLMs.
Index 0 to 100, monthly
Signals
Signal
Value
Reads as
Hacker News stories, last 12 months284 stories, -9% on the 12 months before
284 stories, -9% on the 12 months before
Adoption
arXiv papers, last 12 months4,122 papers, +58% on the 12 months before
huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, · Oct 29, 2018 7y7 years ago
Oct 29, 20187y7 years ago
166,616
Mintplex-Labs/anything-llmStop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience · Jun 4, 2023 3y3 years ago
Jun 4, 20233y3 years ago
66,428
bojieli/ai-agent-book《深入理解 AI Agent：设计原理与工程实践》（李博杰 著）开源主仓库：全书正文、编译版 PDF 与按章配套代码 · Sep 9, 2025 1y1 year ago
Sep 9, 20251y1 year ago
50,784
bytedance/UI-TARS-desktopThe Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra · Jan 19, 2025 1y1 year ago
Jan 19, 20251y1 year ago
39,109
sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models. · Jan 8, 2024 2y2 years ago
Jan 8, 20242y2 years ago
36,408
deepset-ai/haystackOpen-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agen · Nov 14, 2019 6y6 years ago
Nov 14, 20196y6 years ago
26,591
Related movements
Movement
Stage
Physical AIModels that perceive and act in the physical world: robots, self-driving and the simulators that train them.
Rising
World modelsModels that learn how an environment behaves and can simulate it, for games, video and training robots.
Rising
Reasoning modelsModels trained with reinforcement learning to think step by step, spending more compute at answer time.
Plateau
History
Date
What changed
Sep 24, 2026
Tracking started: emerged January 2021, peak, 4 other names recorded
Sources: Curve: Hacker News story titles, Wikipedia pageviews and arXiv papers by month, refreshed Sep 24, 2026. Related entities from the fru.dev sites' public APIs, matched by name. How stages work.
Trending terms by email
Monday mornings: the week's top trending terms in data, tech and AI.
Amazon Bedrock Managed Knowledge Base now supports multimodal embeddings for video, audio, and image content with TwelveLabs Marengo 3.0AWS · Sep 11, 2026 2 weeks ago