Location
Hilton Hawaiian Village, Honolulu, Hawaii
Event Website
https://hicss.hawaii.edu/
Start Date
3-1-2024 12:00 AM
End Date
6-1-2024 12:00 AM
Description
The use of AI and ML algorithms can only contribute successfully to data-driven decision making if the underlying data is of sufficiently good quality. However, the effort of ensuring good data quality (DQ) must be proportionate to the potential impact of poor DQ. In this work, we therefore investigate the impact of DQ defects on the common and challenging task of classifying imbalanced data. We contribute to theory and practice by being the first to investigate the impact of DQ according to the particular DQ dimension accuracy and by examining the relevance of the importance of attributes with respect to the classification. Underpinning the significance of DQ, our experiments show that already few inaccuracies can lead to a considerably worse classification, that efficient data cleaning can be limited to a few attributes, and that distance-based algorithms are more affected by defects in less important attributes.
Recommended Citation
Widmann, Torben, "Classifying Imbalanced Data: The Relevance of Accuracy and Feature Importance" (2024). Hawaii International Conference on System Sciences 2024 (HICSS-57). 3.
https://aisel.aisnet.org/hicss-57/da/trustworthy_ai/3
Classifying Imbalanced Data: The Relevance of Accuracy and Feature Importance
Hilton Hawaiian Village, Honolulu, Hawaii
The use of AI and ML algorithms can only contribute successfully to data-driven decision making if the underlying data is of sufficiently good quality. However, the effort of ensuring good data quality (DQ) must be proportionate to the potential impact of poor DQ. In this work, we therefore investigate the impact of DQ defects on the common and challenging task of classifying imbalanced data. We contribute to theory and practice by being the first to investigate the impact of DQ according to the particular DQ dimension accuracy and by examining the relevance of the importance of attributes with respect to the classification. Underpinning the significance of DQ, our experiments show that already few inaccuracies can lead to a considerably worse classification, that efficient data cleaning can be limited to a few attributes, and that distance-based algorithms are more affected by defects in less important attributes.
https://aisel.aisnet.org/hicss-57/da/trustworthy_ai/3