measurement error

Whether future AI models are fair, trustworthy, and aligned with the public’s interests rests in part on our ability to collect …

5 minute lightening talk on methods to collect annotations for NLP models

As many in the AI field transition from a model-centric to a data-centric approach, the quality of training data is receiving increased …

Surveys are a vital tool for understanding public opinion and knowledge, but they can also yield biased estimates of behavior. Here we …

Data scientists are increasingly turning their attention to the collection of high quality training data. Those of us with expertise in data collection can apply lessons in web survey design to them.

When training data are collected from human annotators, the design of the annotation instrument, the instructions given to annotators, …

Motivated misreporting occurs when respondents give incorrect responses to survey questions to shorten the interview; studies have …

The U.S. Consumer Expenditure Interview Survey asks many filter questions to identify the items that households purchase. Each reported …

Many large-scale government surveys do not have the budget or time to conduct experiments to assess the effects of questionnaire …