Personalized Mobile Sensing for Predicting Recurrent Stress Events using Self-Supervised Pre-Training
Date
2024
Authors
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
Ending Page
Alternative Title
Abstract
Stress is widely recognized as a major contributor to a variety of health issues. Stress prediction using biosignal data recorded by wearables is a key area of study in mobile sensing research because real-time stress prediction can enable digital interventions to immediately react at the onset of stress, helping to avoid many psychological and physiological symptoms such as heart rhythm irregularities. Electrodermal activity (EDA) is often used to measure stress. However, major challenges with the prediction of stress using machine learning include the subjectivity and sparseness of the labels, a large feature space, relatively few labels, and a complex nonlinear and subjective relationship between the features andoutcomes. To tackle these issues, I examine the use of model personalization: training a separate stress prediction model for each user. To allow the neural network to learn the temporal dynamics of each individual’s baseline biosignal patterns, thus enabling personalization with very few labels, I pre-train a 1-dimensional convolutional neural network (1D CNN)
using self-supervised learning (SSL). I evaluate my method using the Wearable Stress and Affect Detection (WESAD) dataset. I fine-tune the pre-trained networks to the stress prediction task and compare against equivalent models without any self-supervised pre-training.
Embeddings learned using pre-training method outperform supervised baselines with signif-
icantly fewer labeled data points: the models trained with SSL require less than 30% of
the labels to reach equivalent performance without personalized SSL. Apart from this single
modality, to make a comparison, I have developed a multi-modal personalized stress predic-
tion system using wearable biosignals (EDA), electrocardiogram (ECG), electromyography
(EMG), respiration (RESP), core body temperature (TEMP), and three-axis acceleration
(ACC) data using the same dataset. This study demonstrates that SSL models outperform
non-SSL models while utilizing less than 5% of the annotations while using multi-modal
biosignals. This personalized learning method can enable precision health systems which
are tailored to each subject and require few annotations by the end user, thus allowing for
the mobile sensing of increasingly complex, heterogeneous, and subjective outcomes such as
stress.
Description
Keywords
Computer science
Citation
Extent
40 pages
Format
Geographic Location
Time Period
Related To
Related To (URI)
Table of Contents
Rights
All UHM dissertations and theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission from the copyright owner.
Rights Holder
Local Contexts
Collections
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.