GPT in the Loop: Evidence from the Field.

Date

2024-01-03

Contributor

Advisor

Department

Instructor

Depositor

Speaker

Researcher

Consultant

Interviewer

Narrator

Transcriber

Annotator

Journal Title

Journal ISSN

Volume Title

Publisher

Volume

Number/Issue

Starting Page

4343

Ending Page

Alternative Title

Abstract

Generative Pre-trained Transformers (GPTs) are highly effective in generating content and increasing productivity, but companies have reservations about their use in a professional setting. OpenAI and policymakers suggest that disclosing the use of GPT is necessary, but there is little empirical evidence to understand its consequence. Our experiment found that managers from a leading consulting firm were unable to distinguish Human-GPT generated content when the content generation source was not disclosed and disclosing the use of GPT improved the content's evaluation. We explored the effects of applying the GPT disclosure policy in the workplace. Managers prefer analysts to disclose their use of GPT, but their preferences regarding how junior analysts should use GPT may differ from that of the analysts, leading to potential conflicts over disclosure.

Description

Keywords

Economic and Societal Impacts of Technology, Data, and Algorithms, content evaluation, experiment, gpt disclosure, human-gpt collaboration

Citation

Extent

10 pages

Format

Geographic Location

Time Period

Related To

Proceedings of the 57th Hawaii International Conference on System Sciences

Related To (URI)

Table of Contents

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International

Rights Holder

Local Contexts

Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.