Loading...
Paper Number
1943
Paper Type
Completed
Description
Recent developments in generative artificial intelligence show how quickly users carelessly adhere to intelligent systems, ignoring systems' vulnerabilities and focusing on their superior capabilities. This is detrimental when system failures are ignored. This paper investigates this mindless overreliance on systems, defined as automation bias (AB), in human-robot interaction. We conducted two experimental studies (N1 = 210, N2 = 438) with social robots in a corporate setting to investigate psychological mechanisms and influencing factors of AB. Particularly, users experience perceptual and behavioral AB with the robot that is enhanced by robot competence depending on task complexity and is even stronger for emotional than analytical tasks. Surprisingly, robot reliability negatively affected AB. We also found a negative indirect-only mediation of AB on robot satisfaction. Finally, we provide implications for the appropriate use of robots to prevent employees from using them as a self-sufficient system instead of a supporting system.
Recommended Citation
Stock-Homburg, Ruth and Nguyen, Mai Anh, "See No Evil, Hear No Evil: How Users Blindly Overrely on Robots with Automation Bias" (2023). ICIS 2023 Proceedings. 15.
https://aisel.aisnet.org/icis2023/hti/hti/15
See No Evil, Hear No Evil: How Users Blindly Overrely on Robots with Automation Bias
Recent developments in generative artificial intelligence show how quickly users carelessly adhere to intelligent systems, ignoring systems' vulnerabilities and focusing on their superior capabilities. This is detrimental when system failures are ignored. This paper investigates this mindless overreliance on systems, defined as automation bias (AB), in human-robot interaction. We conducted two experimental studies (N1 = 210, N2 = 438) with social robots in a corporate setting to investigate psychological mechanisms and influencing factors of AB. Particularly, users experience perceptual and behavioral AB with the robot that is enhanced by robot competence depending on task complexity and is even stronger for emotional than analytical tasks. Surprisingly, robot reliability negatively affected AB. We also found a negative indirect-only mediation of AB on robot satisfaction. Finally, we provide implications for the appropriate use of robots to prevent employees from using them as a self-sufficient system instead of a supporting system.
When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.
Comments
09-HCI