data quality

Whether future AI models are fair, trustworthy, and aligned with the public’s interests rests in part on our ability to collect …

Whether future AI models are fair, trustworthy, and aligned with the public’s interests rests in part on our ability to collect …

Whether future AI models make the world safer or less safe for humans rests in part on our ability to efficiently collect accurate data …

5 minute lightening talk on methods to collect annotations for NLP models

As many in the AI field transition from a model-centric to a data-centric approach, the quality of training data is receiving increased …

Data scientists are increasingly turning their attention to the collection of high quality training data. Those of us with expertise in data collection can apply lessons in web survey design to them.

When training data are collected from human annotators, the design of the annotation instrument, the instructions given to annotators, …

Although often seen as a gold-standard, human labeled training data is not error free. Decisions in the design of labeling tasks can …