Multimodal AI
Peak · emerged January 2021 · high June 2026 · -1% on the month before · 193 mentions on Trending in 14 days
Models that read and write more than text: images, audio and video in the same model. Named by Radford et al., OpenAI: CLIP: Connecting text and images (Jan 5, 2021). Also called Multimodal models, Vision language models, VLM, Multimodal LLMs.
Index 0 to 100, monthly
Signals
Hacker News stories, last 12 months296 stories, +2% on the 12 months before
arXiv papers, last 12 months4,166 papers, +40% on the 12 months before
Wikipedia views, October 20266,150, +57% on a year beforeProduct releases naming it59 since Feb 19, 2026GitHub repositories68,363Funding rounds naming it5, $3.3B in allConferences about it1| Signal | Reads as | |
|---|---|---|
| Hacker News stories, last 12 months296 stories, +2% on the 12 months before | 296 stories, +2% on the 12 months before | Adoption |
| arXiv papers, last 12 months4,166 papers, +40% on the 12 months before | 4,166 papers, +40% on the 12 months before | Adoption |
| Wikipedia views, October 20266,150, +57% on a year before | 6,150, +57% on a year before | Adoption |
| Product releases naming it59 since Feb 19, 2026 | 59 since Feb 19, 2026 | Adoption |
| GitHub repositories68,363 | 68,363 | Adoption |
| Funding rounds naming it5, $3.3B in all | 5, $3.3B in all | Adoption |
| Conferences about it1 | 1 | Adoption |
Companies
| Name | Mentions |
|---|---|
| 9 | |
| 8 | |
| 7 | |
| 5 | |
| 5 | |
| 4 | |
| 4 | |
| 4 |
Releases
59 releases since Feb 19, 2026| Name | |
|---|---|
| Oct 29, 202611 days ago | |
| Oct 29, 202611 days ago | |
| Oct 28, 202612 days ago | |
| Oct 27, 202613 days ago | |
| Oct 23, 20262 weeks ago | |
| Oct 22, 20262 weeks ago | |
| Oct 20, 20262 weeks ago | |
| Oct 19, 20263 weeks ago |
Models
| Name |
|---|
| Qwen3 VL 235b A22BAlibaba |
| GeminiGoogle |
| Gemini 4 ArgonGoogle |
Papers
GitHub projects
68,363 repositorieshuggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, Mintplex-Labs/anything-llmStop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience bojieli/ai-agent-book《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码bytedance/UI-TARS-desktopThe Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infrasgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.deepset-ai/haystackOpen-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agen
| Name | Stars | |
|---|---|---|
| huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, · Oct 29, 2018 8 years ago | Oct 29, 20188 years ago | 166,906 |
| Mintplex-Labs/anything-llmStop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience · Jun 4, 2023 3 years ago | Jun 4, 20233 years ago | 66,667 |
| bojieli/ai-agent-book《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码 · Sep 9, 2025 1 year ago | Sep 9, 20251 year ago | 52,076 |
| bytedance/UI-TARS-desktopThe Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra · Jan 19, 2025 1 year ago | Jan 19, 20251 year ago | 39,184 |
| sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models. · Jan 8, 2024 2 years ago | Jan 8, 20242 years ago | 36,717 |
| deepset-ai/haystackOpen-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agen · Nov 14, 2019 6 years ago | Nov 14, 20196 years ago | 26,640 |
Funding
5 rounds| Name | Amount | |
|---|---|---|
| May 9, 20266 months ago | $2,500M | |
| Jan 26, 20269 months ago | $718M | |
| Jun 5, 20242 years ago | $50M | |
| Dec 12, 20241 year ago | $30M | |
| BioStackSeed · Oct 22, 2026 2 weeks ago | Oct 22, 20262 weeks ago | $10M |
Conferences
1 conference| Name | |
|---|---|
| 2027 ITS America Conference & ExpoSalt Lake City, UT · Apr 12, 2027 in 5 months | Apr 12, 2027in 5 months |
Related movements
Physical AIModels that perceive and act in the physical world: robots, self-driving and the simulators that train them.World modelsModels that learn how an environment behaves and can simulate it, for games, video and training robots.Reasoning modelsModels trained with reinforcement learning to think step by step, spending more compute at answer time.
| Movement | Stage |
|---|---|
| Physical AIModels that perceive and act in the physical world: robots, self-driving and the simulators that train them. | Rising |
| World modelsModels that learn how an environment behaves and can simulate it, for games, video and training robots. | Peak |
| Reasoning modelsModels trained with reinforcement learning to think step by step, spending more compute at answer time. | Peak |
History
Tracking started: emerged January 2021, peak, 4 other names recorded
| Date | What changed |
|---|---|
| Sep 24, 2026 | Tracking started: emerged January 2021, peak, 4 other names recorded |
Sources: Curve: Hacker News story titles, Wikipedia pageviews and arXiv papers by month, refreshed Nov 1, 2026. Related entities from the other Glyph Ibis sources' public APIs, matched by name. How stages work.