Andrew Fairless, Ph.D.
blue-green banner
What I Read: Scaling Laws.
Posted on :: Tags: machine learning, neural network, transformer, natural language processing, large language model, scalability, training, loss, manifold, regression, generalization, parameter

https://lilianweng.github.io/posts/2026-06-24-scaling-laws/
Scaling Laws, Carefully
Lilian Weng
June 24, 2026
"This predictability makes scaling laws highly valuable in practice. A common workflow is to fit scaling laws on a handful of small runs and then extrapolate..."