Paper Number
1719
Paper Type
Complete
Description
Artificial intelligence systems, particularly those based on large language models, are increasingly prevalent in personal and professional settings, making the skill of prompt engineering—formulating effective AI inputs—vital. This paper explores the effects and how to enhance students' prompt engineering skills based on a multi-study design. Our first study confirmed the baseline hypothesis that prompt engineering can predict AI output quality, framing it as a critical skill. We then investigated whether instructional designs (worked examples & instructions), could develop prompting skills. Using worked examples, the second study tested the effectiveness of instructional materials on enhancing prompting skills. The experiment involved 245 students who demonstrated that a brief exposure to a worked example-based prompting guide significantly improved their ability to deploy targeted prompting strategies. These findings suggest that integrating worked examples into curricula could effectively equip students with essential prompting skills, offering both theoretical and practical implications for AI education.
Recommended Citation
Tolzin, Antonia; Knoth, Nils; and Janson, Andreas, "Leveraging Prompting Guides as Worked Examples for Advanced Prompt Engineering Strategies" (2024). ICIS 2024 Proceedings. 1.
https://aisel.aisnet.org/icis2024/learnandiscurricula/learnandiscurricula/1
Leveraging Prompting Guides as Worked Examples for Advanced Prompt Engineering Strategies
Artificial intelligence systems, particularly those based on large language models, are increasingly prevalent in personal and professional settings, making the skill of prompt engineering—formulating effective AI inputs—vital. This paper explores the effects and how to enhance students' prompt engineering skills based on a multi-study design. Our first study confirmed the baseline hypothesis that prompt engineering can predict AI output quality, framing it as a critical skill. We then investigated whether instructional designs (worked examples & instructions), could develop prompting skills. Using worked examples, the second study tested the effectiveness of instructional materials on enhancing prompting skills. The experiment involved 245 students who demonstrated that a brief exposure to a worked example-based prompting guide significantly improved their ability to deploy targeted prompting strategies. These findings suggest that integrating worked examples into curricula could effectively equip students with essential prompting skills, offering both theoretical and practical implications for AI education.
Comments
03-Learning