1. Even though we understand LLMs' goals at the top level, and their math at the bottom, we don't understand the *algorithms* in the middle.
(I'm not saying anything really new here - these are Marr's levels of analysis.)
en.wikipedia.org/wiki/Level_o...