The Effect of AI Advice on Human Confidence in Decision-Making

Simple item page
dc.contributor.authorTaudien, Anna
dc.contributor.authorFügener, Andreas
dc.contributor.authorGupta, Alok
dc.contributor.authorKetter, Wolfgang
dc.date.accessioned2021-12-24T17:17:46Z
dc.date.available2021-12-24T17:17:46Z
dc.date.issued2022-01-04
dc.description.abstractAs artificial intelligence advances, it can increasingly be applied in collaborative decision-making contexts with humans. However, questions on the design of different collaborative environments remain open. In the context of AI-assisted human decision-making processes, we analyze the influence of AI advice on human confidence in the final decision. In a laboratory experiment, 458 subjects performed an image classification task. We compare their confidence over three treatments: i) a baseline case where subjects do not receive any AI advice; ii) where subjects receive AI advice; and iii) in addition to AI advice subjects also see the certainty of AI for its choice. Our results suggest that while AI advice can increase human overconfidence, this effect can be mitigated by augmenting the AI advice with its certainty. Our result not only contributes to the growing literature of human-AI collaboration, but also bears important practical implications for the design of collaborative systems.
dc.format.extent9 pages
dc.identifier.doi10.24251/HICSS.2022.029
dc.identifier.isbn978-0-9981331-5-7
dc.identifier.urihttp://hdl.handle.net/10125/79359
dc.language.isoeng
dc.relation.ispartofProceedings of the 55th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectApplications of Human-AI Collaboration: Insights from Theory and Practice
dc.subjectai advice
dc.subjectgroup decisions
dc.subjecthuman-ai collaboration
dc.subjecthuman confidence
dc.titleThe Effect of AI Advice on Human Confidence in Decision-Making
dc.type.dcmitext

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
0025.pdf
Size:
1.21 MB
Format:
Adobe Portable Document Format
Download

Collections

Applications of Human-AI Collaboration: Insights from Theory and Practice