AI Code Generation Tools - Experience and Perspectives of Computer Science Students
Date
2024
Authors
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
Ending Page
Alternative Title
Abstract
Recent advancements in large language models (LLMs) and generative artificial intelligence (GenAI) have made significant impacts globally. These AI tools have simplified traditionally strenuous and time-consuming tasks, fostering both optimism and concern regarding their use by students in educational settings. This thesis investigates the usage and perceptions of AI code generation tools, particularly ChatGPT, among computer science (CS) students. We conducted a study involving seventy students from varied academic levels who participated in a 45-minute programming activity with the optional use of ChatGPT assistance. This was followed by an extensive online questionnaire designed to explore the AI code generation tools students use, the frequency of their use, the specific tasks for which they employ these tools, and their underlying motivations.
Through comprehensive qualitative and quantitative analysis, we discovered that an overwhelming majority of students are not only familiar with ChatGPT, but also use it for over half their academic work. Students expressed a strong interest in leveraging AI tools to enhance their learning experience, citing benefits such as increased efficiency and deeper understanding of complex concepts. However, they also shared concerns similar to those of their instructors, particularly regarding over-reliance on these tools, difficulty comprehending generated code, and lacking the skills necessary for their future careers. Additionally, we observed a wide range of behaviors in how students use ChatGPT, with most not employing advanced techniques like model priming and prompt engineering strategies.
Our findings highlight the need for greater awareness and training in the design and behavior of these tools to maximize the benefits of AI assistance. We discuss the implications of our findings for students, educators, and the industry, suggesting strategies to ensure that the integration of AI code generation tools in educational contexts results in a net positive impact for all stakeholders.
Description
Keywords
Computer science, AI, Computer science, education, LLM, students, survey
Citation
Extent
66 pages
Format
Geographic Location
Time Period
Related To
Related To (URI)
Table of Contents
Rights
All UHM dissertations and theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission from the copyright owner.
Rights Holder
Local Contexts
Collections
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.