Location
Hilton Hawaiian Village, Honolulu, Hawaii
Event Website
https://hicss.hawaii.edu/
Start Date
3-1-2024 12:00 AM
End Date
6-1-2024 12:00 AM
Description
This paper problematizes the literature on the non-use of algorithmic decision-making systems (ADMS), commonly examined as algorithm aversion. Whilst prior literature attributes algorithm aversion primarily to human bias and irrationality, assuming utility-based evaluations, we argue that it may also stem from values-based evaluations of technology, which are overlooked. Through an integrated ethical analysis, drawing upon the “big three” ethical theories of consequentialism, deontology, and virtue ethics, we examine implicit normative judgments within the algorithm aversion literature. Consequently, we positively reframe algorithm aversion as a potentially principled resistance to ADMS, expanding prior views of the phenomenon. We argue that such resistance may be constructive and lead to a better alignment of ADMS with societal needs and values. Thus, we call on IS scholars to explore this phenomenon as an ethical and sociotechnical issue, rather than as a costly problem to be mitigated, as prior literature might suggest.
Recommended Citation
Hannon, Oliver; Ciriello, Raffaele; and Gal, Uri, "Just Because We Can, Doesn’t Mean We Should: Algorithm Aversion as a Principled Resistance" (2024). Hawaii International Conference on System Sciences 2024 (HICSS-57). 5.
https://aisel.aisnet.org/hicss-57/os/dark_side/5
Just Because We Can, Doesn’t Mean We Should: Algorithm Aversion as a Principled Resistance
Hilton Hawaiian Village, Honolulu, Hawaii
This paper problematizes the literature on the non-use of algorithmic decision-making systems (ADMS), commonly examined as algorithm aversion. Whilst prior literature attributes algorithm aversion primarily to human bias and irrationality, assuming utility-based evaluations, we argue that it may also stem from values-based evaluations of technology, which are overlooked. Through an integrated ethical analysis, drawing upon the “big three” ethical theories of consequentialism, deontology, and virtue ethics, we examine implicit normative judgments within the algorithm aversion literature. Consequently, we positively reframe algorithm aversion as a potentially principled resistance to ADMS, expanding prior views of the phenomenon. We argue that such resistance may be constructive and lead to a better alignment of ADMS with societal needs and values. Thus, we call on IS scholars to explore this phenomenon as an ethical and sociotechnical issue, rather than as a costly problem to be mitigated, as prior literature might suggest.
https://aisel.aisnet.org/hicss-57/os/dark_side/5