Towards Trustworthy AI: Evaluating SHAP and LIME for Facial Emotion Recognition
Files
Date
2025-01-07
Authors
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
7532
Ending Page
Alternative Title
Abstract
Explainable Artificial Intelligence (XAI) plays a crucial role in enhancing the transparency and interpretability of Machine Learning (ML) models, especially in sensitive domains like Facial Emotion Recognition (FER). This paper evaluates the effectiveness of the model-agnostic methods SHAP (Shapley Additive Explanations) and LIME (Local Interpretable Model-agnostic Explanations) in explaining ML decision-making for FER. Leveraging two established facial emotion databases, FER 2013 and RAF-DB, our research identifies key facial features of ML model predictions. Our results indicate that SHAP offers more consistent and reliable visualizations than LIME, effectively emphasizing critical regions such as the mouth, eyes, and cheeks, which align with the facial Action Units outlined by the Facial Action Coding System (FACS). This alignment enhances model interpretability, demonstrating how XAI can reconcile accuracy with transparency to foster the development of trustworthy AI systems in FER. Our study also shows that in complex domains like FER, XAI methods alone are insufficient; expert interpretation is crucial for applying insights from XAI visualizations, underscoring the need for interdisciplinary research to advance future studies in complex domains.
Description
Keywords
Trustworthy Artificial Intelligence and Machine Learning, explainable ai, facial emotion recognition, lime, model interpretability, shap
Citation
Extent
10
Format
Geographic Location
Time Period
Related To
Proceedings of the 58th Hawaii International Conference on System Sciences
Related To (URI)
Table of Contents
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Rights Holder
Local Contexts
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.