Our analysis is based on this article by @lakens.bsky.social: online.ucpress.edu/collabra/art...
The original article discusses arguments that are used in empirical research to justify the choice of sample size. We translated those justification strategies to the domain of LLMs.
An important step when designing an empirical study is to justify the sample size that will be collected. The key aim of a sample size justification for such studies is to explain how the collected da...