Interested in cognition and artificial intelligence. Researcher at Anthropic; previously DeepMind, cognitive science at Stanford. Posts are mine.
lampinen.github.io
Andrew Lampinen
Loading...
Pleased to share that this work is now published in TMLR!
openreview.net/forum?id=RuW...
In short, I think the field focused too much on interference and negative effects of other tasks, and didn't focus enough on how learning could positively transfer in the future. Check out the post for the full perspective!
What are the real problems to be solved in continual learning? In my latest post, I tackle this question — reviewing where I think the field went astray in the past, how language models changed things, and where the real challenges remain.
infinitefaculty.substack.com/p/what-are-t...
Now published in open access! Your one-stop shop for the philosophy of language models. It's the spiritual descendant of our two-part preprint from 2024, fully updated. This should be particularly useful for anyone looking for an entry point into this rapidly growing field.
Check out the updated version if you're interested! arxiv.org/abs/2502.20349
There's also a slightly fuller summary here from when we first shared the work bsky.app/profile/lamp...
Thanks to @cogscikid.bsky.social for the fun collaboration! 5/5
Do LLMs *understand* language? Do educational AI agents *understand* the material they teach (or their students)? Claims about what AI systems do or don't understand are pervasive, but assessing them requires an account of MACHINE UNDERSTANDING
