Trending in data, tech and AI

210 terms · 72 days

Mixture of experts

Peak · emerged January 2017 · high July 2026 · +10% on the month before · 72 mentions on Trending in 14 days

Models split into many expert blocks with only a few active per token, so they grow in size without growing in cost. Named by Shazeer et al., Google Brain: Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer (Jan 23, 2017). Also called MoE, Sparse models, Sparse mixture of experts.

Index 0 to 100, monthly
038762017201820192020202120222023202420252026Origin

Signals

AdoptionHacker News stories, last 12 months110 stories, +244% on the 12 months before
AdoptionarXiv papers, last 12 months1,998 papers, +84% on the 12 months before
AdoptionWikipedia views, October 20268,611, +4% on a year beforeAdoptionProduct releases naming it17 since Feb 19, 2026AdoptionGitHub repositories2,012
SignalReads as
Hacker News stories, last 12 months110 stories, +244% on the 12 months beforeAdoption
arXiv papers, last 12 months1,998 papers, +84% on the 12 months beforeAdoption
Wikipedia views, October 20268,611, +4% on a year beforeAdoption
Product releases naming it17 since Feb 19, 2026Adoption
GitHub repositories2,012Adoption

Companies

Releases

17 releases since Feb 19, 2026
Name
Transformers 5.22.0: Mistral Large 4 (Le Chonk)Hugging Face · Oct 29, 2026 11 days ago
Workers AI - DeepSeek V4.1 Flash 1017 now available on Workers AICloudflare · Oct 19, 2026 3 weeks ago
Transformers Release v5.20.0Hugging Face · Oct 15, 2026 3 weeks ago
Ollama 0.40.5Ollama · Oct 14, 2026 3 weeks ago
Transformers Release 5.17.0Hugging Face · Sep 10, 2026 2 months ago
Announcing Cohere's North Small TranslateCohere · Sep 9, 2026 2 months ago
Zhipu AI GLM 5.3 now available as a Databricks-hosted modelDatabricks · Aug 29, 2026 2 months ago
Hy4 Preview now available on AI GatewayVercel · Aug 28, 2026 2 months ago

Models

Papers

Name
TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language ModelsAlibaba (Qwen) · Oct 6, 2026 4 weeks ago
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache CompressionDeepSeek · Sep 17, 2026 7 weeks ago
Flattening Every Memory Peak in Long-Context Mixture-of-Experts TrainingSalesforce · Sep 13, 2026 8 weeks ago
Instella-MoE Technical ReportAMD · Sep 1, 2026 2 months ago
On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training StabilityAlibaba (Qwen) · Aug 31, 2026 2 months ago
FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive ExecutionUC Berkeley · Aug 17, 2026 2 months ago
DiffusionGemma Technical ReportGoogle DeepMind · Jul 31, 2026 3 months ago
Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement LearningNVIDIA · Jul 22, 2026 3 months ago

GitHub projects

2,012 repositories
NameStars
deepseek-ai/DeepSeek-VL2DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding · Dec 13, 2024 1 year ago5,375
deepseek-ai/DeepSeek-V2DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model · Apr 22, 2024 2 years ago5,041
PKU-YuanGroup/MoE-LLaVA【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models · Dec 14, 2023 2 years ago2,324
deepseek-ai/DeepSeek-MoEDeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models · Jan 2, 2024 2 years ago1,976
XueFuzhao/OpenMoEA family of open-sourced Mixture-of-Experts (MoE) Large Language Models · Aug 8, 2023 3 years ago1,699
XueFuzhao/awesome-mixture-of-expertsA collection of AWESOME things about mixture-of-experts · Mar 30, 2022 4 years ago1,287
MovementStage
Open-weight modelsModels whose trained weights anyone can download, run and fine-tune: Llama, Qwen, DeepSeek, Mistral and more.Rising
Inference chipsAccelerators built to serve models cheaply and fast rather than to train them: TPUs, LPUs, wafer-scale and custom silicon.Peak
Reasoning modelsModels trained with reinforcement learning to think step by step, spending more compute at answer time.Peak

History

ChangeSep 24, 2026Tracking started: emerged January 2017, peak, 3 other names recorded
DateWhat changed
Sep 24, 2026Tracking started: emerged January 2017, peak, 3 other names recorded

Sources: Curve: Hacker News story titles, Wikipedia pageviews and arXiv papers by month, refreshed Nov 1, 2026. Related entities from the other Glyph Ibis sources' public APIs, matched by name. How stages work.