Tag
#mixture of experts
3 articles
AI & Technology
DeepSeek's V4.1-Flash, an Open-Weight 552-Billion-Parameter Model Released on 10 September 2026, Cuts Its Per-Token Memory Cache to 890 Bytes, About a Quarter of Its Predecessor's
Nov 12, 2026
AI & Technology
Sarvam's 105-Billion-Parameter Model Computes With 10.3 Billion of Them for Each Token, Using the Mixture-of-Experts Design That Runs From a 1991 Paper to Mixtral and DeepSeek
Nov 12, 2026
AI & Technology
Mistral's 1-Trillion-Parameter Le Chonk Scored 38 on an Independent AI Index, Eighth Among Open Models, Before Its Weights Have Even Shipped
Oct 8, 2026