What I Watch: How LLMs store facts

Posted on 2024-12-16 :: Tags: machine learning, natural language processing, large language model, transformer, neural network, linear algebra, attention

https://www.youtube.com/watch?v=9-Jl0dxWQs8
How might LLMs store facts | Chapter 7, Deep Learning
3Blue1Brown
Aug 31, 2024
“Unpacking the multilayer perceptrons in a transformer, and how they may store facts”