Research Scientist at the University of Washington based in Brooklyn. Also: SFI External Applied Fellow, Harvard BKC affiliate. Collective Behavior, Statistics, etc..
Joe Bak-Coleman
Loading...
Spoke too soon, going back in for round two of treatment.
We're excited to launch J·ROR, the Journal of Research on Research.
A new open-access home for research on how research is funded, organised, conducted, communicated, and evaluated.
Our first editorial: www.tandfonline.com/doi/full/10....
#ResearchOnResearch #MetaScience #OpenScience #STS
Still alive, still in hospital y’all. Lots of twists and turns but getting through it.
Right in the abstract, "replications were high powered to detect the original effect size"
Haven't we discussed this one to death! Power is a function not a property, the original effect size is inflated, point-estimating power based on the original effect size is whack.
Look, I've lost some of my snark but hope for a full recovery. I'll just end this thread with the conclusion. This is where we're at after 12 years of replicating thousands of social science studies.
I do like that they started putting confidence intervals on estimates of replicability. That said, "Thirteen methods for evaluating replication success provided estimates ranging from 28.6% to 74.8% (median of 49.3%)"
Wide range y'all. And what's a median of metrics mean?
After a month, I was discharged. The final week was unexplained (and still unexplained) fevers that *seem* to have come down in intensity enough to let me go home. I'm adjusting to being back but please be patient if I've failed to respond to your emails or messages. There's just so much backlog.
Twist: Neurosarcoidosis. truly a doctor House experience, but had a great team at NYU Langone Neuro.
Steroid time!
I missed a lot of #metascience discourse in hospital, and am mostly sad I didn't get a chance to wade in on the absurdity of this being a paper in Nature in 2026; ignoring a decade of commentary from statisticians on OSC 2015 paper.
www.nature.com/articles/s41...
📣 The difference between replicable and not replicable is not itself scientifically replicable. 📣
New work with Erkan Buzbas, showing that verdicts such as "X% of results replicated" are based on an inferential machinery that doesn't work.
arxiv.org/abs/2604.26268
Joe Bak-Coleman
Published in Journal of Research on Research (Vol. 1, No. 1, 2026)
