This is an essential question right now, and @tanialombrozo.bsky.social et al. do a great job of addressing it!
Russ Poldrack
Do LLMs *understand* language? Do educational AI agents *understand* the material they teach (or their students)? Claims about what AI systems do or don't understand are pervasive, but assessing them requires an account of MACHINE UNDERSTANDING