What I Read: Attention, transformers

Posted on 2024-06-18 :: Tags: machine learning, natural language processing, large language model, neural network, linear algebra, matrix, attention, transformer

https://www.youtube.com/watch?v=eMlx5fFNoYc
Attention in transformers, visually explained | Chapter 6, Deep Learning
3Blue1Brown
“Demystifying attention, the key mechanism inside transformers and LLMs.”