New preprint: arxiv.org/abs/2603.20133
Does performance on reasoning benchmarks transfer to real-world settings such as task-oriented dialogue?
Not necessarily: our new benchmark tests LLMs on problems framed in both standalone and dialogue settings, and shows that dialogue makes reasoning harder.
