Generative AI or Real Users? Investigating the Relative Impact of Generative AI vs. Humans on Online Review Quality
Files
Date
2024-01-03
Authors
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
4046
Ending Page
Alternative Title
Abstract
Online reviews matter for customers, firms, and platforms increasingly. The recent advancement of generative Artificial Intelligence (AI) techniques makes it possible to generate online reviews automatically. However, the relative impact of generative AI vs. humans on online review generation is unknown. On the one hand, generative AI can generate high quality reviews because they are trained on diverse and high-quality data. On the other hand, generative AI hallucinates and may generate fabricated content, threatening the quality of the generated reviews. Using data from one of the biggest online review platforms, Yelp.com, we apply fixed effect models to understand the relative impact of generative AI vs. humans on the quality of generated reviews. We find that reviews from generative AI averagely have bigger ratings, a higher level of inconsistency between rating and sentiment, shorter, harder to read, and more positive and subjective content. Our study has both theoretical and practical implications.
Description
Keywords
Crowd-based Platforms, fixed effects., generative ai vs. humans, online reviews, rating, review quality
Citation
Extent
10 pages
Format
Geographic Location
Time Period
Related To
Proceedings of the 57th Hawaii International Conference on System Sciences
Related To (URI)
Table of Contents
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Rights Holder
Local Contexts
Collections
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.