Exploring Failure and Engagement in a Complex Digital Training Game: A Multi-method Examination

Authors

Matthew L. Jensen, University of OklahomaFollow
Yu-Hao Lee, University of Florida
Cameron W. Piercy, University of Oklahoma
Norah E. Dunbar, University of California, Santa Barbara
Javier Elizondo, University of Oklahoma
Elena Bessarabova, University of Oklahoma
Nathan W. Twyman, Missouri University of Science and Technology
Judee K. Burgoon, University of Arizona
Joseph S. Valacich, University of Arizona
Bradley Adame, Arizona State University
Claude Miller, University of Oklahoma
Scott Wilson, University of Oklahoma

Abstract

Digital games are ideal for training complex decision making skills because they allow players to experience decision making processes and consequences. However, training complex skills often results in failure, which may undermine learning engagement. Traditional training methods employing observational learning (e.g., training videos) do not cause learners to fail but forfeit experiential learning that makes training games so engaging. Our exploratory work addresses the trade-off between experiencing and observing failure and explores their effect on the level of training engagement. Building on past engagement research, we argue that learning engagement contains both cognitive and affective facets and that these facets may diverge, especially when individuals experience failure. To test these ideas, we conducted an experiment (N = 156) comparing engagement in game-based training, in which participants experienced failure, and video-based training, in which participants observed failure. We collected cognitive and affective indicators of engagement using physiological and self-report measures. We found game-based experiential learning increased such indicators of engagement as attention and temporal disassociation even though players widely failed to meet game objectives. Players also experienced elevated arousal and decreased positive affect. In addition, we compared physiological measures of engagement with self-reported measures and discuss their merits and limitations.

Recommended Citation

Jensen, M. L., Lee, Y., Piercy, C. W., Dunbar, N. E., Elizondo, J., Bessarabova, E., Twyman, N. W., Burgoon, J. K., Valacich, J. S., Adame, B., Miller, C., & Wilson, S. (2016). Exploring Failure and Engagement in a Complex Digital Training Game: A Multi-method Examination. AIS Transactions on Human-Computer Interaction, 8(1), 1-20. Retrieved from https://aisel.aisnet.org/thci/vol8/iss1/2
DOI: