https://ngrok.com/blog/quantization
Quantization from the ground up
Sam Rose
Mar 25, 2026
"But what if I told you we can make LLMs 4x smaller and 2x faster, enough to run very capable models on your laptop, all while losing only 5-10% accuracy."