Investigating the Relative Impact of Generative AI vs. Humans on Voluntary Knowledge Contributions

Date
2024-01-03
Authors
Shan, Guohou
Pienta, Dan
Thatcher, Jason Bennet
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
7490
Ending Page
Alternative Title
Abstract
Voluntary knowledge contributions on question and answer (Q&A) platforms are important for users, platforms and organizations. Generative Artificial Intelligence (GAI) techniques have made it possible to automatically generate voluntary knowledge on Q&A platforms. The relative impact of GAI vs. humans on users' voluntary contribution of knowledge to Q&A platforms has yet to be explored. On the one hand, GAI can generate highly accurate answers because it is trained on large volumes of diverse, high-quality data. On the other hand, GAI can produce incorrect answers and fabricated facts. Using data from one of the largest Q&A platforms, Stack Overflow, we apply fixed effects models to understand the relative impact of GAI vs. human contributors on answer quality. We find that, on average, GAI answers receive lower scores and are shorter, but they can also be easier to read, more positive, and more objective. Our study has both theoretical and practical implications.
Description
Keywords
Generative and Conversational AI in Information Systems Research and Education: Opportunities and Challenges, answer quality, fixed effects., generative ai vs. human, knowledge contribution, reputation
Citation
Extent
10 pages
Format
Geographic Location
Time Period
Related To
Proceedings of the 57th Hawaii International Conference on System Sciences
Table of Contents
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Rights Holder
Local Contexts
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.