In olmo-eval, every component is swappable: the model being evaluated, its tools, LLM-as-a-judge graders, & more. You can change one without touching the rest.
Benchmark results land in a uniform schema, so checkpoints stay comparable across a long project.