The Impact of Empathy Display in Language of Conversational AI: A Controlled Experiment with a Legal Chatbo

Simple item page
dc.contributor.authorBrunswicker, Sabine
dc.contributor.authorZhang, Yifan
dc.contributor.authorRashidian, Christopher
dc.contributor.authorLinna Jr., Dan W.
dc.date.accessioned2023-12-26T18:36:09Z
dc.date.available2023-12-26T18:36:09Z
dc.date.issued2024-01-03
dc.identifier.doi10.24251/HICSS.2024.055
dc.identifier.isbn978-0-9981331-7-1
dc.identifier.other33a02d42-0cd0-4b6a-b4f1-d2bdc94a820b
dc.identifier.urihttps://hdl.handle.net/10125/106430
dc.language.isoeng
dc.relation.ispartofProceedings of the 57th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectConversational AI and Ethical Issues
dc.subjectconversational ai
dc.subjectempathy in dialogue
dc.subjecthuman-ai teaming
dc.subjectlinguistics
dc.subjectsocial intelligence
dc.titleThe Impact of Empathy Display in Language of Conversational AI: A Controlled Experiment with a Legal Chatbo
dc.typeConference Paper
dc.type.dcmiText
dcterms.abstractThe rise of ChatGPT has revealed the potential of chatbots and other conversational AI tools to assist humans in fields such as law and healthcare, where the best human experts can engage in empathetic conversations. The belief is that if chatbots can connect with humans on a social and emotional level, they can reduce the cognitive effort required by humans to solve their problems, while increasing user satisfaction and trust. Although existing research has shown that empathy is crucial for designing human-AI conversations and their outcomes (effort, helpfulness, trust), it fails to separate the impact of empathy in language display from the AI’s underlying ”cognitive” abilities, like logical reasoning. To address this gap, this research aims to develop and empirically test a theory of empathy in the language displayed by conversational AI, explaining the relational outcomes of human-AI conversations in terms of cognitive effort, helpfulness, and trustworthiness. Using this theory, a chatbot is designed using syntactic and rhetorical linguistic elements that evoke empathy when providing legal services to tenants renting property. Through a randomized controlled experiment with a 2 by 3 factorial design, the effects of this empathetic chatbot on three relational outcomes in human-AI conversations are examined and compared to a non-empathetic chatbot that maintains the same logic. A baseline model utilizing non-conversational access to legal services via frequently asked questions (”FAQs”) is also implemented, and the subjects’ emotional state (anger) is manipulated as a moderating factor. The study involves 277 participants randomly assigned to one of six groups. The findings demonstrate the significance of both main and interaction effects on trustworthiness, usefulness, and cognitive effort. The results indicate that subtle changes in language syntax and style can have substantial implications for the outcomes of human-AI conversations. These findings contribute to the growing literature on conversational AI and have practical implications for the design of conversational and generative AI.
dcterms.extent12 pages
prism.startingpage455

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
0045.pdf
Size:
1.35 MB
Format:
Adobe Portable Document Format
Download

Collections

Conversational AI and Ethical Issues