Utilizing Convolutional Neural Networks and Eye-Tracking Data for Classroom Attention Tracking

Date

2024-01-03

Contributor

Advisor

Department

Instructor

Depositor

Speaker

Researcher

Consultant

Interviewer

Narrator

Transcriber

Annotator

Journal Title

Journal ISSN

Volume Title

Publisher

Volume

Number/Issue

Starting Page

5298

Ending Page

Alternative Title

Abstract

Instructors often use facial cues of their students as key indicators of student attention levels. However, this method can pose a problem in online and computer-based learning environments. While other research has shown computer vision and eye-tracking could be used with machine learning techniques to predict attentiveness, they have shown only moderate success in terms of accuracy. In this work, we improve upon existing techniques for student attention tracking. We employed our previously developed Non-Intrusive Classroom Attention Tracking System (NiCATS) to collect facial images and eye-tracking data of students during three controlled experiments that represent common academic scenarios. Our first contribution is using convolutional neural networks to predict student attentiveness with an F1-Score of 0.91. Our second contribution is the validation of using eye-tracking metrics in conjunction with machine learning models to predict the attentiveness of students with up to 0.78 F1-Score, which could be useful when webcam privacy is a concern.

Description

Keywords

EdTech and Emerging Technologies, attention, computer vision, education technology, eye-tracking, machine learning

Citation

Extent

9 pages

Format

Geographic Location

Time Period

Related To

Proceedings of the 57th Hawaii International Conference on System Sciences

Related To (URI)

Table of Contents

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International

Rights Holder

Local Contexts

Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.