What are the real problems to be solved in continual learning? In my latest post, I tackle this question — reviewing where I think the field went astray in the past, how language models changed things, and where the real challenges remain.
infinitefaculty.substack.com/p/what-are-t...
infinitefaculty.substack.com
Reflections on catastrophic interference, plasticity, and learning for the future in the era of large language models