New preprint together with @timangelike.bsky.social:
Evaluating Large Language Models for Feature Extraction from Verbal Stimuli: A Simulation-Based Workflow
We draw on generalizability theory and the ADEMP-template for simulation studies to assess the multiverse of prompt decisions.
osf.io/xphm9
Daniel Heck
In a new preprint with @danielheck.bsky.social, we adapted the ADEMP framework to provide a structured workflow for evaluating LLM feature extraction from verbal stimuli. Link: doi.org/10.31234/osf.... Figure 1 from the paper shows the proposed workflow:
