Loading...
Paper Type
ERF
Description
The public availability of sophisticated AI content generators based on large-scale language models achieved enormous media attention in recent months. AI content generators are expected to have a major impact on future information systems developments as well as private and business life. Particularly in the field of education, the question arises as to how these innovations in AI technology will impact teaching, learning, and examination. With a specific focus on examinations in the information systems discipline, we show in this research-in-progress paper, based on an experimental field study, how a today’s AI content generator performs in solving a fundamental information systems exam. Based on our preliminary results, we found that the quality varies across different exam question types. With this research project, we offer start points and initial guidance on how educators can deal with the availability of AI content generators.
Paper Number
1364
Recommended Citation
Hobert, Sebastian; Groth, Michael; Nießner, Tobias; and Wilhelmi, Lars, "How Today’s AI Content Generators Outperform Average Novice Students in Information Systems Exams" (2023). AMCIS 2023 Proceedings. 12.
https://aisel.aisnet.org/amcis2023/sig_ed/sig_ed/12
How Today’s AI Content Generators Outperform Average Novice Students in Information Systems Exams
The public availability of sophisticated AI content generators based on large-scale language models achieved enormous media attention in recent months. AI content generators are expected to have a major impact on future information systems developments as well as private and business life. Particularly in the field of education, the question arises as to how these innovations in AI technology will impact teaching, learning, and examination. With a specific focus on examinations in the information systems discipline, we show in this research-in-progress paper, based on an experimental field study, how a today’s AI content generator performs in solving a fundamental information systems exam. Based on our preliminary results, we found that the quality varies across different exam question types. With this research project, we offer start points and initial guidance on how educators can deal with the availability of AI content generators.
When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.
Comments
SIG ED