"We Care About the Internet; We Care About Everything" Understanding Social Media Content Moderators' Mental Models and Support Needs

dc.contributor.author Roberts, Sarah
dc.contributor.author Wood, Stacy
dc.contributor.author Eadon, Yvonne
dc.date.accessioned 2022-12-27T19:02:16Z
dc.date.available 2022-12-27T19:02:16Z
dc.date.issued 2023-01-03
dc.description.abstract Despite the growing prevalence of ML algorithms, NLP, algorithmically-driven content recommender systems and other computational mechanisms on social media platforms, some of their core and mission-critical gatekeeping functions are nonetheless deeply reliant on the persistence of humans-in-the-loop to both validate computational models in use, and to intervene when those models fail. Perhaps nowhere is this human interaction with/on behalf of computation more key than in social media content moderation, where human capacities for discretion, discernment and the holding of complex mental models of decision-trees and changing policy are called upon hundreds, if not thousands, of times per day. This paper presents the results of a qualitative, interview-based study of an in-house content moderation team (Trust & Safety, or T&S) at a mid-size, erstwhile niche social platform we call FanClique. Findings indicate that while the FanClique T&S team is treated well in terms of support from managers, respect and support from the wider company, and mental health services provided (particularly in comparison to other social media companies), the work of content moderation remains an extremely taxing form of labor that is not adequately compensated or supported.
dc.format.extent 10
dc.identifier.doi 10.24251/HICSS.2023.252
dc.identifier.isbn 978-0-9981331-6-4
dc.identifier.uri https://hdl.handle.net/10125/102883
dc.language.iso eng
dc.relation.ispartof Proceedings of the 56th Hawaii International Conference on System Sciences
dc.rights Attribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.uri https://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subject Critical and Ethical Studies of Digital and Social Media
dc.subject content moderation
dc.subject human-in-the-loop
dc.subject platforms
dc.subject social media
dc.title "We Care About the Internet; We Care About Everything" Understanding Social Media Content Moderators' Mental Models and Support Needs
dc.type.dcmi text
prism.startingpage 2017
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
0197.pdf
Size:
219.21 KB
Format:
Adobe Portable Document Format
Description: