Paper Type
ERF
Abstract
The fast development of telemedicine has shown the value of medical chatbots in facilitating interaction between patients and doctors. This study examines ChatDoctor, a health chatbot optimized with LLaMA, to determine the medical diagnosis suggested by Artificial intelligence compared to a physician’s diagnosis. We employ 100,000+ user reviews and health chatbot conversations, applying Natural Language Processing (NLP) and Large Language Models (LLMs), to investigate patient interactions. Findings indicate that although chatbots improve access, patient engagement, and convenience, they also have accuracy and trust issues. Topic modeling identifies a contradiction in user experience, where positive comments highlight chatbot support and negative comments refer to response reliability problems. This research contributes to the Information Systems literature by demonstrating how LLMs enhance telehealth and provide valuable insights for improving chatbot design and patient-centered AI solutions. The results emphasize the need for sophisticated AI models that balance efficiency, clinical accuracy, and user demands.
Paper Number
2259
Recommended Citation
Koohikamali, Mehrdad; Luiten, Lisa; Hasan, Md Mahmoudul; Kao, Chenwei; Yang, Yuan Jr; Chou, Yuhsi; Aji, Rishabh; and Roldan, Rose, "AI-Driven Improvements in Patient-Doctor Communication for Remote Consultations" (2025). AMCIS 2025 Proceedings. 18.
https://aisel.aisnet.org/amcis2025/health_it/sig_health/18
AI-Driven Improvements in Patient-Doctor Communication for Remote Consultations
The fast development of telemedicine has shown the value of medical chatbots in facilitating interaction between patients and doctors. This study examines ChatDoctor, a health chatbot optimized with LLaMA, to determine the medical diagnosis suggested by Artificial intelligence compared to a physician’s diagnosis. We employ 100,000+ user reviews and health chatbot conversations, applying Natural Language Processing (NLP) and Large Language Models (LLMs), to investigate patient interactions. Findings indicate that although chatbots improve access, patient engagement, and convenience, they also have accuracy and trust issues. Topic modeling identifies a contradiction in user experience, where positive comments highlight chatbot support and negative comments refer to response reliability problems. This research contributes to the Information Systems literature by demonstrating how LLMs enhance telehealth and provide valuable insights for improving chatbot design and patient-centered AI solutions. The results emphasize the need for sophisticated AI models that balance efficiency, clinical accuracy, and user demands.
When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.
Comments
SIGHEALTH