Abstract
In online health communities, users can post questions to seek health-related advice from healthcare professionals. However, the titles they formulate often lack key information. Given that many people only scan titles, users may not get their questions answered. Large language models (LLM) offer a potential solution by generating titles that better align with the information needs of healthcare professionals. In this study, we fine-tuned an LLM using over 330.000 posts from the subreddit r/askdocs. Subsequently, we conducted a survey with 70 healthcare professionals to evaluate their preference between user- and LLM-generated titles. Our findings indicate that healthcare professionals perceive LLM-generated titles as better suited to the corresponding posts, more informative, and conveying a greater sense of urgency. With our work, we contribute to research on online health communities and large language models by demonstrating that LLMs can improve the titles of user-generated posts compared to those generated by users themselves.
Recommended Citation
Chen, Johannes, "“Please help me!” Using large language models to improve titles of user-generated posts in online health communities" (2024). Wirtschaftsinformatik 2024 Proceedings. 29.
https://aisel.aisnet.org/wi2024/29