Location
Hilton Waikoloa Village, Hawaii
Event Website
https://hicss.hawaii.edu/
Start Date
7-1-2025 12:00 AM
End Date
10-1-2025 12:00 AM
Description
In today's digital world, online propaganda poses a growing threat to society. To address this challenge, we explored the potential of a real-time training intervention. This intervention exposes people to manipulative text identified by AI and provides cognitive guidance to help them recognize and critically analyze similar cases. To examine whether people trust AI technology enough to read the annotations and follow them, we conducted a one-factor experiment. Our findings show no difference in training performance whether the annotations are claimed to be provided by domain experts or by AI. The intervention is effective in improving people’s ability to identify propagandistic texts and persuasion techniques, and performance varies by technique. We also found that people judge the texts based on one or more of three aspects: the content of the material, the author’s intention inferred from the material, and their personal ideology related to the topic of the material.
Recommended Citation
Xiao, Lu; Xiao, Yimin; Da San Martino, Giovanni; Nakov, Preslav; and Zheng, Changzhou, "Detecting Persuasion Techniques in Online Propaganda: An AI-annotation Intervention" (2025). Hawaii International Conference on System Sciences 2025 (HICSS-58). 3.
https://aisel.aisnet.org/hicss-58/da/neuroscience_research/3
Detecting Persuasion Techniques in Online Propaganda: An AI-annotation Intervention
Hilton Waikoloa Village, Hawaii
In today's digital world, online propaganda poses a growing threat to society. To address this challenge, we explored the potential of a real-time training intervention. This intervention exposes people to manipulative text identified by AI and provides cognitive guidance to help them recognize and critically analyze similar cases. To examine whether people trust AI technology enough to read the annotations and follow them, we conducted a one-factor experiment. Our findings show no difference in training performance whether the annotations are claimed to be provided by domain experts or by AI. The intervention is effective in improving people’s ability to identify propagandistic texts and persuasion techniques, and performance varies by technique. We also found that people judge the texts based on one or more of three aspects: the content of the material, the author’s intention inferred from the material, and their personal ideology related to the topic of the material.
https://aisel.aisnet.org/hicss-58/da/neuroscience_research/3