Automated Affect and Emotion Recognition from Cardiovascular Signals - A Systematic Overview Of The Field

Date

2022-01-04

Contributor

Advisor

Department

Instructor

Depositor

Speaker

Researcher

Consultant

Interviewer

Narrator

Transcriber

Annotator

Journal Title

Journal ISSN

Volume Title

Publisher

Volume

Number/Issue

Starting Page

Ending Page

Alternative Title

Abstract

Currently, artificial intelligence is increasingly used to recognize and differentiate emotions. Through the action of the nervous system, the heart and vascular system can respond differently depending on the type of arousal. With the growing popularity of wearable devices able to measure such signals, people may monitor their states and manage their wellness. Our goal was to explore and summarize the field of automated emotion and affect recognition from cardiovascular signals. According to our protocol, we searched electronic sources (MEDLINE, EMBASE, Web of Science, Scopus, dblp, Cochrane Library, IEEE Explore, arXiv and medRxiv) up to 31 August 2020. In the case of all identified studies, two independent reviewers were involved at each stage: screening, full-text assessment, data extraction, and quality evaluation. All conflicts were resolved during the discussion. The credibility of included studies was evaluated using a proprietary tool based on QUADAS, PROBAST. After screening 4649 references, we identified 195 eligible studies. From artificial intelligence most used methods in emotion or affect recognition were Support Vector Machines (42.86%), Neural Network (21.43%), and k-Nearest Neighbors (11.67%). Among the most explored datasets were DEAP (10.26%), MAHNOB-HCI (10.26%), AMIGOS (6.67%) and DREAMER (2.56%). The most frequent cardiovascular signals involved electrocardiogram (63.16%), photoplethysmogram (15.79%), blood volume pressure (13.16%) and heart rate (6.58%). Sadness, fear, and anger were the most examined emotions. However, there is no standard set of investigated internal feelings. On average, authors explore 4.50 states (range from 4 to 24 feelings). Research using artificial intelligence in recognizing emotions or affect using cardiovascular signals shows an upward trend. There are significant variations in the quality of the datasets, the choice of states to detect, and the classifiers used for analysis. Research project supported by program Excellence initiative - research university for the University of Science and Technology. The authors declare that they have no conflict of interest.

Description

Keywords

Personal Health and Wellness Management with Technologies, assisted living, automated affect and emotion recognition, health monitioring, systematic review, wellness management

Citation

Extent

10 pages

Format

Geographic Location

Time Period

Related To

Proceedings of the 55th Hawaii International Conference on System Sciences

Related To (URI)

Table of Contents

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International

Rights Holder

Local Contexts

Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.