Thrilled to talk about how seemingly small decisions in silicon sampling can have a large impact on simulated survey responses 👀 Join us on Oct 29th! 👈
Are you using survey-style questionnaires designed for humans to measure characteristics of LLMs?
In our #EACL2026 paper, we evaluate both the reliability and validity of such tests and found that their scores do not reflect real-world model behavior. In fact, they can be deceptive!
🧵1/3
🚨 Upcoming #CS3Meeting 🚨
@wanlo.bsky.social talks about analytic flexibility in silicon samples on October 29, 3:15 to 4:00 PM CET).
Great opportunity to gain novel insights into how survey responses can be generated with #LLMs.
Sign up now: ww3.unipark.de/uc/cs3_meeti...
Thrilled to share that our paper with @carohaensch.bsky.social, @barbaraplank.bsky.social & @mstrohm.bsky.social has been accepted to #ACL2026 Main!
How to generate closed-ended survey responses 📊 with LLMs trained to produce open-ended text? 📝 We show results from 32 mio. simulated responses… 🧵
🚨New paper alert🚨
🤔 Ever wondered how the way you write a persona prompt affects how well an LLM simulates people?
In our #EMNLP2025 paper, we find that using interview-style persona prompts makes LLM social simulations less biased and more aligned with human opinions.
🧵1/7
Come join next Wednesday if you want to rant about society's love-hate relationship with LLMs!
🚀 New postdoc position for Platform Data & Computational Social Science
Join us to drive @gesis.org' efforts around the Digital Services Act (DSA) and conduct research with online platform data
💼 TV-L EG 14 | Location: Cologne
📌 Apply now: www.gesis.org/en/institute...
#DSA #CSS #DataScience
Please vote for the best poster #ic2s2
👋 #ACL2025NLP 🇦🇹 @marlutz.bsky.social and I are presenting our poster on demographic representativeness of LLMs today!
🕦 10:30-12:00
📍 Hall X5 (board 1 or 14 according to different sources 🧐)
Here’s the paper on ACL anthology: aclanthology.org/2025.finding...
Drop by!
🚨 New publication 🚨
Excited to see this published in Findings of #ACL2025, led by @zakashussain.bsky.social.
We critically evaluate claims that #LLMs are "just next token predictors" or "just machines" and call for a more measured discussion on LLM cognition.
aclanthology.org/2025.finding...
🚨 Upcoming #CS3Meeting 🚨
@wanlo.bsky.social talks about analytic flexibility in silicon samples on October 29, 3:15 to 4:00 PM CET).
Great opportunity to gain novel insights into how survey responses can be generated with #LLMs.
Sign up now: ww3.unipark.de/uc/cs3_meeti...
Indira Sen
Sebastian Stier
Indira Sen
Indira Sen, Marlene Lutz, Elisa Rogers, David Garcia, Markus Strohmaier. Findings of the Association for Computational Linguistics: ACL 2025. 2025.
🚨 Upcoming: "Large Language Models for Social Research: Potentials and Challenges"
👤 Indira Sen (University of Mannheim)
🗓️ Wed, October 22, 13:45-15:15 CET
📺 Register for the live stream: us02web.zoom.us/meeting/regi...
🔗 socialsciencedatalab.mzes.uni-mannheim.de/page/events/
Do LLMs represent the people they're supposed simulate or provide personalized assistance to?
We review the current literature in our #ACL2025 Findings paper and investigating what researchers conclude about the demographic representativeness of LLMs:
osf.io/preprints/so...
1/
