1

Position: Insights from Survey Methodology can Improve Training Data
Whether future AI models are fair, trustworthy, and aligned with the public’s interests rests in part on our ability to collect …
Stephanie Eckman, Barbara Plank, Frauke Kreuter
PDF Project DOI
Position: Insights from Survey Methodology can Improve Training Data
Annotation Sensitivity: Training Data Collection Methods Affect Model Performance
When training data are collected from human annotators, the design of the annotation instrument, the instructions given to annotators, …
Christoph Kern, Stephanie Eckman, Jacob Beck, Rob Chew, Bolei Ma, Frauke Kreuter
PDF Project DOI
Annotation Sensitivity: Training Data Collection Methods Affect Model Performance
Improving Labeling Through Social Science Insights: Preliminary Results and Research Agenda
Although often seen as a gold-standard, human labeled training data is not error free. Decisions in the design of labeling tasks can …
Jacob Beck, Stephanie Eckman, Rob Chew, Frauke Kreuter
PDF Project DOI
Improving Labeling Through Social Science Insights: Preliminary Results and Research Agenda