What I Read: Bonsai Networks, RNNs.
https://cprimozic.net/blog/growing-sparse-computational-graphs-with-rnns/
Growing Bonsai Networks with RNNs
Casey Primozic
“This writeup introduces what I’m calling Bonsai Networks - extremely sparse computational graphs produced by training and pruning RNNs. They provide an interpretable view into the solutions learned by networks for simple logic problems…”