web surveys

Position: Insights from Survey Methodology can Improve Training Data

AI models are only as good as their training data. This paper shows how 50+ years of survey science can help ML researchers collect better data - leading to fairer, more accurate models.

Stephanie Eckman, Barbara Plank, Frauke Kreuter

Annotation Sensitivity: Training Data Collection Methods Affect Model Performance

Small changes in how you ask annotators to label data can dramatically change your model’s behavior. We tested 5 versions of a hate speech labeling task and found significant differences in model performance.

Christoph Kern, Stephanie Eckman, Jacob Beck, Rob Chew, Bolei Ma, Frauke Kreuter

Underreporting of Purchases in the U.S. Consumer Expenditure Survey

Motivated misreporting occurs when respondents give incorrect responses to survey questions to shorten the interview; studies have …

Stephanie Eckman

Motivated Misreporting in Smartphone Surveys

Filter questions are used to administer follow-up questions to eligible respondents while allowing respondents who are not eligible to …

Jessica Daikeler, Ruben Bach, Henning Silber, Stephanie Eckman

Misreporting to Looping Questions in Surveys: Recall, Motivation and Burden

Looping questions are used to collect data about several similar events, such as employment spells, retirement accounts, or marriages. …

Stephanie Eckman, Frauke Kreuter

Does the Inclusion of Non-Internet Households in a Web Panel Reduce Coverage Bias?

Web panels miss people without internet access. The LISS panel provided devices to non-internet households. We tested whether this extra effort actually reduced bias in research findings.

Stephanie Eckman