The Impact of Empathy Display in Language of Conversational AI: A Controlled Experiment with a Legal Chatbo

dc.contributor.author Brunswicker, Sabine
dc.contributor.author Zhang, Yifan
dc.contributor.author Rashidian, Christopher
dc.contributor.author Linna Jr., Dan W.
dc.date.accessioned 2023-12-26T18:36:09Z
dc.date.available 2023-12-26T18:36:09Z
dc.date.issued 2024-01-03
dc.identifier.isbn 978-0-9981331-7-1
dc.identifier.other 33a02d42-0cd0-4b6a-b4f1-d2bdc94a820b
dc.identifier.uri https://hdl.handle.net/10125/106430
dc.language.iso eng
dc.relation.ispartof Proceedings of the 57th Hawaii International Conference on System Sciences
dc.rights Attribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.uri https://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subject Conversational AI and Ethical Issues
dc.subject conversational ai
dc.subject empathy in dialogue
dc.subject human-ai teaming
dc.subject linguistics
dc.subject social intelligence
dc.title The Impact of Empathy Display in Language of Conversational AI: A Controlled Experiment with a Legal Chatbo
dc.type Conference Paper
dc.type.dcmi Text
dcterms.abstract The rise of ChatGPT has revealed the potential of chatbots and other conversational AI tools to assist humans in fields such as law and healthcare, where the best human experts can engage in empathetic conversations. The belief is that if chatbots can connect with humans on a social and emotional level, they can reduce the cognitive effort required by humans to solve their problems, while increasing user satisfaction and trust. Although existing research has shown that empathy is crucial for designing human-AI conversations and their outcomes (effort, helpfulness, trust), it fails to separate the impact of empathy in language display from the AI’s underlying ”cognitive” abilities, like logical reasoning. To address this gap, this research aims to develop and empirically test a theory of empathy in the language displayed by conversational AI, explaining the relational outcomes of human-AI conversations in terms of cognitive effort, helpfulness, and trustworthiness. Using this theory, a chatbot is designed using syntactic and rhetorical linguistic elements that evoke empathy when providing legal services to tenants renting property. Through a randomized controlled experiment with a 2 by 3 factorial design, the effects of this empathetic chatbot on three relational outcomes in human-AI conversations are examined and compared to a non-empathetic chatbot that maintains the same logic. A baseline model utilizing non-conversational access to legal services via frequently asked questions (”FAQs”) is also implemented, and the subjects’ emotional state (anger) is manipulated as a moderating factor. The study involves 277 participants randomly assigned to one of six groups. The findings demonstrate the significance of both main and interaction effects on trustworthiness, usefulness, and cognitive effort. The results indicate that subtle changes in language syntax and style can have substantial implications for the outcomes of human-AI conversations. These findings contribute to the growing literature on conversational AI and have practical implications for the design of conversational and generative AI.
dcterms.extent 12 pages
prism.startingpage 455
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
0045.pdf
Size:
1.35 MB
Format:
Adobe Portable Document Format
Description: