Paper Number
2876
Paper Type
Complete
Abstract
While the diffusion of generative AI in educational contexts has the potential to transform learning, empirical examinations of its effectiveness are lacking. Our field experiment compared learning outcomes of English speaking between participants engaging with generative AI and those interacting with human conversational agents. We discovered that generative AI significantly enhances the complexity of spoken content, with its impact on learning outcomes comparable to that of human agents. Notably, we observed that generative AI is particularly effective in promoting attentive learning among individuals with lower proficiency in English. We further examined the role of evaluation apprehension in driving these differential effects. Our findings suggest that generative AI can serve as an effective standalone learning tool and potentially mitigate disparities in educational background proficiency.
Recommended Citation
Cheon, Gyeombi; Choi, Yunmin; Lee, Dongwon; and Baek, Jiye, "Unveiling the Impact of Generative AI on Language Learning: A Field Experiment" (2024). ICIS 2024 Proceedings. 21.
https://aisel.aisnet.org/icis2024/learnandiscurricula/learnandiscurricula/21
Unveiling the Impact of Generative AI on Language Learning: A Field Experiment
While the diffusion of generative AI in educational contexts has the potential to transform learning, empirical examinations of its effectiveness are lacking. Our field experiment compared learning outcomes of English speaking between participants engaging with generative AI and those interacting with human conversational agents. We discovered that generative AI significantly enhances the complexity of spoken content, with its impact on learning outcomes comparable to that of human agents. Notably, we observed that generative AI is particularly effective in promoting attentive learning among individuals with lower proficiency in English. We further examined the role of evaluation apprehension in driving these differential effects. Our findings suggest that generative AI can serve as an effective standalone learning tool and potentially mitigate disparities in educational background proficiency.
When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.
Comments
03-Learning