SIG Health - Healthcare Informatics and Health Info Technology
Paper Type
Complete
Paper Number
1410
Description
Artificial intelligence (AI) is commonly applied to the diagnostic process, thus developing a treatment protocol, personalized medicine, and patient care. Second-order cognitive processes are utilized by physicians to control their reasoning while evaluating AI advice. Inadequate diagnostic decisions often result from deficiencies in the use of metacognitions both related to decision-makers' reasoning (self-monitoring) and the AI-based system (system monitoring). Physicians will then fall for decisions based on beliefs as opposed to real data or seek out inappropriate superficial information. Inappropriate diagnostic decisions are, therefore, linked to a lack of trust in AI. This article aims to understand how trust in AI is built among hospital practitioners. A 20-month ethnographic study was conducted in a medical research center wherein hospital practitioners daily apply AI for their medical processes. This research work demonstrates that trust around AI is built through cognition and emotion. Factors like peer validation or social imagination play an important role in AI for creating trust.
Recommended Citation
Rey, Amayelle and Bouaynaya, Wafa, "Building Trust in Artificial Intelligence: Findings from Healthcare Organization" (2022). AMCIS 2022 Proceedings. 2.
https://aisel.aisnet.org/amcis2022/sig_health/sig_health/2
Building Trust in Artificial Intelligence: Findings from Healthcare Organization
Artificial intelligence (AI) is commonly applied to the diagnostic process, thus developing a treatment protocol, personalized medicine, and patient care. Second-order cognitive processes are utilized by physicians to control their reasoning while evaluating AI advice. Inadequate diagnostic decisions often result from deficiencies in the use of metacognitions both related to decision-makers' reasoning (self-monitoring) and the AI-based system (system monitoring). Physicians will then fall for decisions based on beliefs as opposed to real data or seek out inappropriate superficial information. Inappropriate diagnostic decisions are, therefore, linked to a lack of trust in AI. This article aims to understand how trust in AI is built among hospital practitioners. A 20-month ethnographic study was conducted in a medical research center wherein hospital practitioners daily apply AI for their medical processes. This research work demonstrates that trust around AI is built through cognition and emotion. Factors like peer validation or social imagination play an important role in AI for creating trust.
When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.
Comments
SIG Health