Is the Larger the Better? An Exploratory Study into Human-Large Language Model Collaboration

Date

2025-01-07

Contributor

Advisor

Department

Instructor

Depositor

Speaker

Researcher

Consultant

Interviewer

Narrator

Transcriber

Annotator

Journal Title

Journal ISSN

Volume Title

Publisher

Volume

Number/Issue

Starting Page

694

Ending Page

Alternative Title

Abstract

Large language models (LLMs) have garnered considerable attention in both academics and industry. Given an array of LLMs available, one of the primary challenges lies in their selection and adaptation strategies. Although LLMs are generally large, they still vary significantly in size and larger LLMs consume significantly more computing resources. This prompts the inquiry into whether larger models perform better. In addition, there is a widespread recognition of the power of LLMs in performing open-ended or generative tasks. However, how to use LLMs to address a closed-ended problem remains under explored. The exploration of human-LLM collaboration on close-ended problem has been even more sparse. This research aims to address the above limitations by comparing different types of state-of-the-art adaptation strategies for LLMs, including in-context learning and fine-tuning. Moreover, it employs multi-class multi-label classification - a close-ended problem to empirically evaluate those adaptation strategies. The research findings provide valuable insights and recommendations for human users considering deploying LLMs for close-ended problems.

Description

Keywords

Technological Advancements in Digital Collaboration with Generative AI and Large Language Models, adaptation strategies, aspect based sentiment analysis, generative ai, large language models

Citation

Extent

10

Format

Geographic Location

Time Period

Related To

Proceedings of the 58th Hawaii International Conference on System Sciences

Related To (URI)

Table of Contents

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International

Rights Holder

Local Contexts

Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.