Classifying Imbalanced Data: The Relevance of Accuracy and Feature Importance
Files
Date
2024-01-03
Authors
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
1190
Ending Page
Alternative Title
Abstract
The use of AI and ML algorithms can only contribute successfully to data-driven decision making if the underlying data is of sufficiently good quality. However, the effort of ensuring good data quality (DQ) must be proportionate to the potential impact of poor DQ. In this work, we therefore investigate the impact of DQ defects on the common and challenging task of classifying imbalanced data. We contribute to theory and practice by being the first to investigate the impact of DQ according to the particular DQ dimension accuracy and by examining the relevance of the importance of attributes with respect to the classification. Underpinning the significance of DQ, our experiments show that already few inaccuracies can lead to a considerably worse classification, that efficient data cleaning can be limited to a few attributes, and that distance-based algorithms are more affected by defects in less important attributes.
Description
Keywords
Decision Making with Sustainable, Fair and Trustworthy AI, accuracy, data quality, feature importance, imbalanced data classification
Citation
Extent
10 pages
Format
Geographic Location
Time Period
Related To
Proceedings of the 57th Hawaii International Conference on System Sciences
Related To (URI)
Table of Contents
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Rights Holder
Local Contexts
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.