measurement error

Use of Synthetic Data in Social Science
May 6, 2025 9:00 AM New York City, NY
Stephanie Eckman
Project Slides
Use of Synthetic Data in Social Science
Keynote: High Quality Training Data for AI Models: Lessons from 20 Years in Surveys
Whether future AI models are fair, trustworthy, and aligned with the public’s interests rests in part on our ability to collect …
Apr 1, 2025 12:00 AM Berlin, Germany
Stephanie Eckman
Project Slides
Keynote: High Quality Training Data for AI Models: Lessons from 20 Years in Surveys
Position: Insights from Survey Methodology can Improve Training Data
Whether future AI models are fair, trustworthy, and aligned with the public’s interests rests in part on our ability to collect …
Stephanie Eckman, Barbara Plank, Frauke Kreuter
PDF Project DOI
Position: Insights from Survey Methodology can Improve Training Data
Annotation Sensitivity: Training Data Collection Methods Affect Model Performance
5 minute lightening talk on methods to collect annotations for NLP models
Aug 22, 2023 6:30 PM Arlington, VA
Stephanie Eckman
Project Slides Video
Annotation Sensitivity: Training Data Collection Methods Affect Model Performance
Improving Label Collection Through Social Science Insights
As many in the AI field transition from a model-centric to a data-centric approach, the quality of training data is receiving increased …
May 11, 2022 8:30 AM
Stephanie Eckman
Project Slides Video stephnie
Improving Label Collection Through Social Science Insights
Using Passive Data to Supplement or Replace Survey Data
Dec 1, 2021 10:00 AM
Stephanie Eckman
Project Slides stephnie
Using Passive Data to Supplement or Replace Survey Data
Comparing Estimates of News Consumption from Survey and Passively Collected Behavioral Data
Surveys are a vital tool for understanding public opinion and knowledge, but they can also yield biased estimates of behavior. Here we …
Tobias Konitzer, Jennifer Allen, Stephanie Eckman, Baird Howland, Markus Mobius, David Rothschild, Duncan Watts
PDF Project DOI
Data Quality in Data Science
Data scientists are increasingly turning their attention to the collection of high quality training data. Those of us with expertise in data collection can apply lessons in web survey design to them.
Aug 5, 2021 10:00 AM
Stephanie Eckman
Project Slides Video stephnie
Data Quality in Data Science
Annotation Sensitivity: Training Data Collection Methods Affect Model Performance
When training data are collected from human annotators, the design of the annotation instrument, the instructions given to annotators, …
Christoph Kern, Stephanie Eckman, Jacob Beck, Rob Chew, Bolei Ma, Frauke Kreuter
PDF Project DOI
Annotation Sensitivity: Training Data Collection Methods Affect Model Performance
Underreporting of Purchases in the U.S. Consumer Expenditure Survey
Motivated misreporting occurs when respondents give incorrect responses to survey questions to shorten the interview; studies have …
Stephanie Eckman
PDF Project DOI
Underreporting of Purchases in the U.S. Consumer Expenditure Survey