Location
Hilton Waikoloa Village, Hawaii
Event Website
https://hicss.hawaii.edu/
Start Date
7-1-2025 12:00 AM
End Date
10-1-2025 12:00 AM
Description
Machine learning models have been critiqued for their opaqueness, so recent work has created models to accurately convey model confidence. High performance is the most important aspect of trust in the model. However, when performance drops, accurate decision confidence leads to higher trust outcomes. The current research expands upon this work investigating how incorrect, low confidence decisions differentially impact the trust process. Incorrect decisions were either made on stimuli the model was trained to classify or stimuli outside those classification categories. In a between-subjects design, participants monitored low performing models of varying low confidence error type in an online image classification task. Results demonstrated when the model flagged incorrect stimuli it was not trained to classify with low confidence, process perceptions increased, while decision time and task performance decreased. Our results extend the current framework regarding how model confidence influences the trust process. Implications, limitations, and future research are discussed.
Recommended Citation
Harris, Krista; Capiola, August; Johnson, Dexter; Alarcon, Gene; Jessup, Sarah; Willis, Sasha; and Bennette, Walter, "Investigating the Effects of Classification Model Error Type on Trust-relevant Criteria in a Human-Machine Learning Interaction Task" (2025). Hawaii International Conference on System Sciences 2025 (HICSS-58). 2.
https://aisel.aisnet.org/hicss-58/cl/machines_as_teammates/2
Investigating the Effects of Classification Model Error Type on Trust-relevant Criteria in a Human-Machine Learning Interaction Task
Hilton Waikoloa Village, Hawaii
Machine learning models have been critiqued for their opaqueness, so recent work has created models to accurately convey model confidence. High performance is the most important aspect of trust in the model. However, when performance drops, accurate decision confidence leads to higher trust outcomes. The current research expands upon this work investigating how incorrect, low confidence decisions differentially impact the trust process. Incorrect decisions were either made on stimuli the model was trained to classify or stimuli outside those classification categories. In a between-subjects design, participants monitored low performing models of varying low confidence error type in an online image classification task. Results demonstrated when the model flagged incorrect stimuli it was not trained to classify with low confidence, process perceptions increased, while decision time and task performance decreased. Our results extend the current framework regarding how model confidence influences the trust process. Implications, limitations, and future research are discussed.
https://aisel.aisnet.org/hicss-58/cl/machines_as_teammates/2