How complete are preregistrations?
Short answer: 53% include all 6 procedural specifications
Medium answer: 🧵
Long answer: check out my publication with A. Glöckner @mariogollwitzer.bsky.social J. Hellmann, J. Lange, S. Schindler & @kaisassenberg.bsky.social
doi.org/10.1177/2515...
My new piece "Reproducibility: how to strengthen a weak foundation" is out today @nature.com! 🎉 How reproducible is research in the social & behavioural sciences? A new study by Miske et al. assessed 600 papers across 62 journals: the results are sobering.
📄 doi.org/10.1038/d415...
📄 rdcu.be/fbcq5
Preregistering confirmatory research aims at reducing researchers’ degrees of freedom and increasing transparency to ultimately increase replicability. Yet the ...doi.org
Do researchers share their code upon request? Does running their orginal code on the original data produce the original results? We provide evidence in a new Royal Society Open Science publication. Studying more than 1,000 articles which use data from the European Social Survey, we find that... 🧵
📄Published Today in Nature:
500 researchers reproduced 100 studies across the social & behavioral sciences to assess their analytical robustness (led by @balazsaczel.bsky.social & @szaszibarnabas.bsky.social).
Article: www.nature.com/articles/s41...
Preprint: osf.io/preprints/me...
TLDR: 1/11
Can published findings be reproduced from the same data + same analysis? As part of SCORE, Miske and 127 co-authors tested this across social and behavioral science papers from 2009–2018.
www.nature.com/articles/s41...
OA: osf.io/preprints/me...
1/
A guide to reanalyzing data from psychology articles for verification, meta-analysis, and reuse
dx.doi.org/10.1111/spc3...
📣New Preprint Alert!
Esther Maassen meticulously simulated the effect of p-hacking and publication bias on effect size & heterogeneity estimates.
💡bad: selective outcome reporting & optional dropping
💡bad: publication bias
💡not so bad: optional stopping/outlier removal
osf.io/preprints/ps...
A study of reproducibility in a stratified random sample of 600 papers published from 2009 to 2018 in 62 journals spanning the social and behavioural sciences finds higher reproducibility among more&n...
www.nature.com
The quality of qualitative research
royalsocietypublishing.org/doi/10.1098/...
We present a scoping review of methodological papers in the social science literature
covered in Scopus from 2017 to 2022. In this review, we document the shared norms,
ideals and practices regarding ...
Commentaries on SCORE papers from @asanchez-tojar.bsky.social, Jelte Wicherts, and @robbwiller.bsky.social
www.nature.com/articles/d41...
Three experts discuss lessons learnt from a large-scale dissection of the reproducibility, analytical robustness and replicability of published results.
