Andrew Fairless, Ph.D.
blue-green banner
What I Read: Continual Learning.
Posted on :: Tags: machine learning, neural network, transformer, attention, natural language processing, continual learning, memory, optimization, generalization, tuning, retrieval augmented generation, replay, mixture of experts, sparse

https://jessylin.com/2025/10/20/continual-learning/
The Continual Learning Problem
Jessy Lin
20 Oct 2025
"If we want to move towards a world where models are... continually learning from experience over time, we need to address a basic challenge: how do we keep updating the parameters of a model without breaking it?"