The Effect of AI Advice on Human Confidence in Decision-Making

Date

2022-01-04

Contributor

Advisor

Department

Instructor

Depositor

Speaker

Researcher

Consultant

Interviewer

Narrator

Transcriber

Annotator

Journal Title

Journal ISSN

Volume Title

Publisher

Volume

Number/Issue

Starting Page

Ending Page

Alternative Title

Abstract

As artificial intelligence advances, it can increasingly be applied in collaborative decision-making contexts with humans. However, questions on the design of different collaborative environments remain open. In the context of AI-assisted human decision-making processes, we analyze the influence of AI advice on human confidence in the final decision. In a laboratory experiment, 458 subjects performed an image classification task. We compare their confidence over three treatments: i) a baseline case where subjects do not receive any AI advice; ii) where subjects receive AI advice; and iii) in addition to AI advice subjects also see the certainty of AI for its choice. Our results suggest that while AI advice can increase human overconfidence, this effect can be mitigated by augmenting the AI advice with its certainty. Our result not only contributes to the growing literature of human-AI collaboration, but also bears important practical implications for the design of collaborative systems.

Description

Keywords

Applications of Human-AI Collaboration: Insights from Theory and Practice, ai advice, group decisions, human-ai collaboration, human confidence

Citation

Extent

9 pages

Format

Geographic Location

Time Period

Related To

Proceedings of the 55th Hawaii International Conference on System Sciences

Related To (URI)

Table of Contents

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International

Rights Holder

Local Contexts

Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.