Tag
#scaling laws
2 articles
AI & Technology
OpenAI's 2020 Scaling Laws Paper Found Model Loss Falls as a Power Law Over More Than Seven Orders of Magnitude, and DeepMind's 2022 Chinchilla Paper Showed a 70 Billion Parameter Model Could Beat a 280 Billion One on the Same Compute
Nov 12, 2026
AI & Technology
Meta Trained Llama 3 405B on 15.6 Trillion Tokens and 30.84 Million GPU Hours, and OpenAI's Human Raters Preferred a 1.3 Billion Parameter Tuned Model to the 175 Billion Parameter GPT-3
Oct 15, 2026