Paper Number

1719

Paper Type

Complete

Description

Artificial intelligence systems, particularly those based on large language models, are increasingly prevalent in personal and professional settings, making the skill of prompt engineering—formulating effective AI inputs—vital. This paper explores the effects and how to enhance students' prompt engineering skills based on a multi-study design. Our first study confirmed the baseline hypothesis that prompt engineering can predict AI output quality, framing it as a critical skill. We then investigated whether instructional designs (worked examples & instructions), could develop prompting skills. Using worked examples, the second study tested the effectiveness of instructional materials on enhancing prompting skills. The experiment involved 245 students who demonstrated that a brief exposure to a worked example-based prompting guide significantly improved their ability to deploy targeted prompting strategies. These findings suggest that integrating worked examples into curricula could effectively equip students with essential prompting skills, offering both theoretical and practical implications for AI education.

Comments

03-Learning

Share

COinS
 
Dec 15th, 12:00 AM

Leveraging Prompting Guides as Worked Examples for Advanced Prompt Engineering Strategies

Artificial intelligence systems, particularly those based on large language models, are increasingly prevalent in personal and professional settings, making the skill of prompt engineering—formulating effective AI inputs—vital. This paper explores the effects and how to enhance students' prompt engineering skills based on a multi-study design. Our first study confirmed the baseline hypothesis that prompt engineering can predict AI output quality, framing it as a critical skill. We then investigated whether instructional designs (worked examples & instructions), could develop prompting skills. Using worked examples, the second study tested the effectiveness of instructional materials on enhancing prompting skills. The experiment involved 245 students who demonstrated that a brief exposure to a worked example-based prompting guide significantly improved their ability to deploy targeted prompting strategies. These findings suggest that integrating worked examples into curricula could effectively equip students with essential prompting skills, offering both theoretical and practical implications for AI education.