This looks interesting, social science studies with LLMs are more replicable and robust, but different from results from human studies. I still need to properly read it though...
www.nature.com/articles/s43...
Researchers replicated 156 psychological experiments using three large language models (LLMs) instead of human participants. LLMs achieved 73–81% replication rates but showed amplified effect sizes an...