https://www.tensoreconomics.com/p/why-are-embeddings-so-cheap
Why are embeddings so cheap?
Piotr Mazurek
Sep 24, 2025
"...modern embedding models are primarily compute-bound, not memory-bound, meaning they largely don't benefit from batching. We show that FLOPS/dollar is the key hardware parameter for optimizing cost..."