Tragedy of the Commons - A Critical Study of Data Quality and Validity Issues in Crowd Work-Based Research

Simple item page
dc.contributor.authorXia, Huichuan
dc.date.accessioned2021-12-24T17:59:48Z
dc.date.available2021-12-24T17:59:48Z
dc.date.issued2022-01-04
dc.description.abstractCrowd work platforms such as MTurk have been leveraged by academic scholars to conduct research and collect data. Though prior studies have discussed data quality and validity issues in crowd work via surveys and experiments, they kind of neglected to explore the scholars’ and particularly the IRB’s ethical concerns in these respects. In this study, we interviewed 17 scholars in six different disciplines and 15 IRB directors/analysts in the U.S. to fill this research gap. We identified common themes among our respondents but also discovered distinctive and even opposing views regarding the approval rate, rejection, internal and external research validity. Based on the findings, we discussed a potential Tragedy of the Commons regarding the data quality deterioration and the disciplinary differences regarding validity in crowd work-based research. Finally, we advocated that the IRB’s ethical concerns should be heard and respected.
dc.format.extent10 pages
dc.identifier.doi10.24251/HICSS.2022.548
dc.identifier.isbn978-0-9981331-5-7
dc.identifier.urihttp://hdl.handle.net/10125/79885
dc.language.isoeng
dc.relation.ispartofProceedings of the 55th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectCrowdsourcing and Digital Workforce in the Gig Economy
dc.subjectethics； crowd work
dc.subjectcrowd work-based research
dc.subjectdata quality
dc.subjectresearch validity
dc.titleTragedy of the Commons - A Critical Study of Data Quality and Validity Issues in Crowd Work-Based Research
dc.type.dcmitext

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
0443.pdf
Size:
507.61 KB
Format:
Adobe Portable Document Format
Download

Collections

Crowdsourcing and Digital Workforce in the Gig Economy