Paper Number

1138

Paper Type

CRP

Abstract

Generative Artificial Intelligence (GenAI) has become widespread in daily work but present novel challenges for users as previously meaningful tasks can now be completed by GenAI. This study examines the impact of ChatGPT on task performance and perceived meaningfulness in two programming tasks. In an online experiment (n=161) assigning participants to coding or debugging tasks, with and without ChatGPT assistance, we found that using ChatGPT improved task performance, partially because the supported tasks are less difficult. However, using ChatGPT resulted in lower perceived meaningfulness, partly because participants considered the tasks less effortful. Notably, both tasks exhibited slightly different results, indicating that contextual factors may amplify or mitigate the effects. This study emphasizes the dual nature of GenAI integration, balancing enhanced performance with psychological impacts on users. Our findings offer insights for organizations and developers on integrating GenAI, highlighting the importance of incorporating efficiency gains with the meaningfulness of human work.

Share

COinS
 
Jun 14th, 12:00 AM

PERFORMANCE VS. PURPOSE: GENERATIVE AI ENHANCES TASK PERFORMANCE BUT REDUCES MEANINGFULNESS IN PROGRAMMING

Generative Artificial Intelligence (GenAI) has become widespread in daily work but present novel challenges for users as previously meaningful tasks can now be completed by GenAI. This study examines the impact of ChatGPT on task performance and perceived meaningfulness in two programming tasks. In an online experiment (n=161) assigning participants to coding or debugging tasks, with and without ChatGPT assistance, we found that using ChatGPT improved task performance, partially because the supported tasks are less difficult. However, using ChatGPT resulted in lower perceived meaningfulness, partly because participants considered the tasks less effortful. Notably, both tasks exhibited slightly different results, indicating that contextual factors may amplify or mitigate the effects. This study emphasizes the dual nature of GenAI integration, balancing enhanced performance with psychological impacts on users. Our findings offer insights for organizations and developers on integrating GenAI, highlighting the importance of incorporating efficiency gains with the meaningfulness of human work.

When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.