Enjoyed working w/ Stephen & Agnes on this!
Gave me a chance to think systematically about where AI 🤖 can backstop human 🧑🏼🔬 fallibilities in peer review (fatigue, ordering effects, bias) vs. where human judgment remains essential (novelty, feasibility, creative leaps) while grappling w/ the risks.
Arjun Krishnan
Peer review reliability is shockingly low. Meta-analyses show reviewer agreement barely above chance, and grant outcomes often depend more on who reviews than what's proposed. Our new preprint with Agnes Urban and Arjun Krishnan @compbiologist.bsky.social : papers.ssrn.com/sol3/papers.... 🧵 1/
