Location
Hilton Waikoloa Village, Hawaii
Event Website
https://hicss.hawaii.edu/
Start Date
7-1-2025 12:00 AM
End Date
10-1-2025 12:00 AM
Description
With the advancement of large language models (LLMs) such as ChatGPT, students increasingly employ LLMs during university courses to improve their coding skills. However, it is still unclear what using these systems means for student learning. In our study, we explore how students employ a LLM when solving a realistic coding challenge over the course of a semester in small groups. We analyze students’ LLM chat log data through the framework of Bloom’s taxonomy, a well-established education framework, to understand their problem-solving and learning behavior. We enrich our analysis with students’ responses to weekly survey questions, contextualizing our findings with subjective experiences. We find that students primarily use LLMs for lower-order thinking skills like remembering, understanding, and applying procedural knowledge. With our study, we contribute to the growing literature on understanding the effects of working and learning with LLMs and offer practical suggestions for teachers and students.
Recommended Citation
Memmert, Lucas; Borchers, Marten; Plückhahn, Juliane; and Bittner, Eva, "Solving Coding Challenges Jointly with a Large Language Model: Understanding Student Journeys Through Bloom’s Taxonomy" (2025). Hawaii International Conference on System Sciences 2025 (HICSS-58). 4.
https://aisel.aisnet.org/hicss-58/st/genai_in_research_and_education/4
Solving Coding Challenges Jointly with a Large Language Model: Understanding Student Journeys Through Bloom’s Taxonomy
Hilton Waikoloa Village, Hawaii
With the advancement of large language models (LLMs) such as ChatGPT, students increasingly employ LLMs during university courses to improve their coding skills. However, it is still unclear what using these systems means for student learning. In our study, we explore how students employ a LLM when solving a realistic coding challenge over the course of a semester in small groups. We analyze students’ LLM chat log data through the framework of Bloom’s taxonomy, a well-established education framework, to understand their problem-solving and learning behavior. We enrich our analysis with students’ responses to weekly survey questions, contextualizing our findings with subjective experiences. We find that students primarily use LLMs for lower-order thinking skills like remembering, understanding, and applying procedural knowledge. With our study, we contribute to the growing literature on understanding the effects of working and learning with LLMs and offer practical suggestions for teachers and students.
https://aisel.aisnet.org/hicss-58/st/genai_in_research_and_education/4