They've been an ongoing challenge in our work for a long time. In fact, our recent work on attribution graphs (transformer-circuits.pub/2025/attribu...) was partly designed as a method to side step them as a challenge!
We describe an approach to tracing the “step-by-step” computation involved when a model responds to a single prompt.
