Loading...

Media is loading
 

Paper Type

Complete

Description

This study evaluated the capabilities of ChatGPT, a conversational artificial intelligence (AI) agent, to generate quality answers to exam questions that are indistinguishable from human-generated text, normally requiring high-level cognitive abilities. This potential capacity is a major threat to academic integrity since ChatGPT may be used for academic misconduct. To determine its capabilities, we asked 15 faculty members to assess a total of ten answers (two each) to an actual IS exam question, of which students wrote five, and ChatGPT generated five. The study found that ChatGPT can generate answers of generally good quality that may pass as human-written text by examiners. The contributions of the study lay in providing empirical results in a novel research area, providing recommendations for teachers, and suggesting ways forward for research.

Paper Number

1829

Comments

SIG ODIS

COinS
Top 25 Paper Badge
 
Aug 10th, 12:00 AM

Too Good to Be True? An Empirical Study of ChatGPT Capabilities for Academic Writing and Implications for Academic Misconduct

This study evaluated the capabilities of ChatGPT, a conversational artificial intelligence (AI) agent, to generate quality answers to exam questions that are indistinguishable from human-generated text, normally requiring high-level cognitive abilities. This potential capacity is a major threat to academic integrity since ChatGPT may be used for academic misconduct. To determine its capabilities, we asked 15 faculty members to assess a total of ten answers (two each) to an actual IS exam question, of which students wrote five, and ChatGPT generated five. The study found that ChatGPT can generate answers of generally good quality that may pass as human-written text by examiners. The contributions of the study lay in providing empirical results in a novel research area, providing recommendations for teachers, and suggesting ways forward for research.

When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.