Designing Gamification Concepts for Expert Explainable Artificial Intelligence Evaluation Tasks: A Problem Space Exploration

dc.contributor.authorToussaint, Philipp
dc.contributor.authorWarsinsky, Simon
dc.contributor.authorSchmidt-Kraepelin, Manuel
dc.contributor.authorThiebes, Scott
dc.contributor.authorSunyaev, Ali
dc.date.accessioned2023-12-26T18:37:01Z
dc.date.available2023-12-26T18:37:01Z
dc.date.issued2024-01-03
dc.identifier.isbn978-0-9981331-7-1
dc.identifier.otherfa61278d-91ad-49be-bdfc-3a16b77ab510
dc.identifier.urihttps://hdl.handle.net/10125/106542
dc.language.isoeng
dc.relation.ispartofProceedings of the 57th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectGamification
dc.subjectevaluation
dc.subjectexplainable artificial intelligence
dc.subjectgamification
dc.subjectproblem space
dc.titleDesigning Gamification Concepts for Expert Explainable Artificial Intelligence Evaluation Tasks: A Problem Space Exploration
dc.typeConference Paper
dc.type.dcmiText
dcterms.abstractArtificial intelligence (AI) models are often complex and require additional explanations for use in high-stakes decision-making contexts like healthcare. To this end, explainable AI (XAI) developers must evaluate their explanations with domain experts to ensure understandability. As these evaluations are tedious and repetitive, we look at gamification as a means to motivate and engage experts in XAI evaluation tasks. We explore the problem space associated with gamified expert XAI evaluation. Based on a literature review of 22 relevant studies and seven interviews with experts in XAI evaluation, we elicit knowledge about affected stakeholders, eight needs, eight goals, and seven requirements. Our results help us understand better the problems associated with expert XAI evaluation and paint a broad application potential for gamification to improve XAI expert evaluations. In doing so, we lay the foundation for the design of successful gamification concepts for expert XAI evaluation.
dcterms.extent10 pages
prism.startingpage1338

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
0130.pdf
Size:
494.21 KB
Format:
Adobe Portable Document Format

Collections