Please use this identifier to cite or link to this item: http://hdl.handle.net/10125/59641

Emoty: an Emotionally Sensitive Conversational Agent for People with Neurodevelopmental Disorders

File Size Format  
0201.pdf 745.77 kB Adobe PDF View/Open

Item Summary

Title:Emoty: an Emotionally Sensitive Conversational Agent for People with Neurodevelopmental Disorders
Authors:Catania, Fabio
Di Nardo, Nicola
Garzotto, Franca
Occhiuto, Daniele
Keywords:Smart Service Systems: Analytics, Artificial Intelligence and Cognitive Applications
Decision Analytics, Mobile Services, and Service Science
Conversational Agent, Neurodevelopmental Disorder, Alexithymia, Machine Learning, Natural Language Processing
Date Issued:08 Jan 2019
Abstract:Our research aims at exploiting the advances in conversational technology to support people with Neurodevelopmental Disorder (NDD). NDD is a group of conditions that are characterized by severe deficits in the cognitive, emotional and motor areas and produce severe impairments in communication and social functioning. This paper presents the design, technology and exploratory evaluation of Emoty, a spoken Conversational Agent (CA) created specifically for individuals with NDD. The goal of Emoty is to help these persons enhancing communication abilities related to emotional recognition and expression, which are fundamental in any form of human relationship. The system exploits emotion detection capabilities based on the semantics of the speech by calling the IBM Watson Tone Analyzer API and from the harmonic features of the audio thanks to an “all-of-us” Deep Learning model. The design and evaluation of Emoty are based on the close collaboration among computer engineers and specialists in NDD (psychologists, neurological doctors, educators).
Pages/Duration:10 pages
URI/DOI:http://hdl.handle.net/10125/59641
ISBN:978-0-9981331-2-6
Rights:Attribution-NonCommercial-NoDerivatives 4.0 International
https://creativecommons.org/licenses/by-nc-nd/4.0/
Appears in Collections: Smart Service Systems: Analytics, Artificial Intelligence and Cognitive Applications


Please email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.

This item is licensed under a Creative Commons License Creative Commons