What it takes to tutor—A preregistered direct replication of the scaffolding experimental study by D. Wood et al. (1978).
psycnet.apa.org/fulltext/202...
📣New Preprint Alert!
Esther Maassen meticulously simulated the effect of p-hacking and publication bias on effect size & heterogeneity estimates.
💡bad: selective outcome reporting & optional dropping
💡bad: publication bias
💡not so bad: optional stopping/outlier removal
osf.io/preprints/ps...
The quality of qualitative research
royalsocietypublishing.org/doi/10.1098/...
wicherts.bsky.social
Do researchers share their code upon request? Does running their orginal code on the original data produce the original results? We provide evidence in a new Royal Society Open Science publication. Studying more than 1,000 articles which use data from the European Social Survey, we find that... 🧵
How complete are preregistrations?
Short answer: 53% include all 6 procedural specifications
Medium answer: 🧵
Long answer: check out my publication with A. Glöckner @mariogollwitzer.bsky.social J. Hellmann, J. Lange, S. Schindler & @kaisassenberg.bsky.social
doi.org/10.1177/2515...
wicherts.bsky.social
Michèle Nuijten
Can published findings be reproduced from the same data + same analysis? As part of SCORE, Miske and 127 co-authors tested this across social and behavioral science papers from 2009–2018.
www.nature.com/articles/s41...
OA: osf.io/preprints/me...
1/
Commentaries on SCORE papers from @asanchez-tojar.bsky.social, Jelte Wicherts, and @robbwiller.bsky.social
www.nature.com/articles/d41...
A guide to reanalyzing data from psychology articles for verification, meta-analysis, and reuse
dx.doi.org/10.1111/spc3...
Lena Hahn
📄Published Today in Nature:
500 researchers reproduced 100 studies across the social & behavioral sciences to assess their analytical robustness (led by @balazsaczel.bsky.social & @szaszibarnabas.bsky.social).
Article: www.nature.com/articles/s41...
Preprint: osf.io/preprints/me...
TLDR: 1/11
My new piece "Reproducibility: how to strengthen a weak foundation" is out today @nature.com! 🎉 How reproducible is research in the social & behavioural sciences? A new study by Miske et al. assessed 600 papers across 62 journals: the results are sobering.
📄 doi.org/10.1038/d415...
📄 rdcu.be/fbcq5
Brian Nosek
Brian Nosek
We present a scoping review of methodological papers in the social science literature
covered in Scopus from 2017 to 2022. In this review, we document the shared norms,
ideals and practices regarding ...
A study of reproducibility in a stratified random sample of 600 papers published from 2009 to 2018 in 62 journals spanning the social and behavioural sciences finds higher reproducibility among more&n...
Three experts discuss lessons learnt from a large-scale dissection of the reproducibility, analytical robustness and replicability of published results.
Preregistering confirmatory research aims at reducing researchers’ degrees of freedom and increasing transparency to ultimately increase replicability. Yet the ...
