Paper Type
ERF
Abstract
Deepfake disinformation is a growing trend in electoral campaigns. However, deepfakes' potentially more pervasive impact is their influence on how we perceive and engage with authentic political audio-visual content. In this study, we examine cognitive functions that may lead to the state of skepticism and even misidentification of authentic political videos upon exposure to deepfakes. To do so, we explore Arnold Zwicky's three cognitive illusions: frequency, in-group, and out-group, that are likely to underlie the individuals' state of skepticism. Preliminary results from the survey of 400 US voters show that voters frequently misjudge authentic political audio-visuals as deepfakes, highlighting a pervasive problem. We also find early evidence supporting the role of both bottom-up and top-down selective attention in frequency illusion but not for group-based illusions.
Paper Number
1651
Recommended Citation
Kumar, Animesh; Burtscher, Christoph; and Eckhardt, Andreas, "The Deepfake Effect: Drivers of Misjudgment of Authentic Political Audio-Visual Content" (2025). AMCIS 2025 Proceedings. 5.
https://aisel.aisnet.org/amcis2025/social_comput/social_comput/5
The Deepfake Effect: Drivers of Misjudgment of Authentic Political Audio-Visual Content
Deepfake disinformation is a growing trend in electoral campaigns. However, deepfakes' potentially more pervasive impact is their influence on how we perceive and engage with authentic political audio-visual content. In this study, we examine cognitive functions that may lead to the state of skepticism and even misidentification of authentic political videos upon exposure to deepfakes. To do so, we explore Arnold Zwicky's three cognitive illusions: frequency, in-group, and out-group, that are likely to underlie the individuals' state of skepticism. Preliminary results from the survey of 400 US voters show that voters frequently misjudge authentic political audio-visuals as deepfakes, highlighting a pervasive problem. We also find early evidence supporting the role of both bottom-up and top-down selective attention in frequency illusion but not for group-based illusions.
When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.
Comments
SOCCOMP