Highly Accurate, But Still Discriminatory

Authors

Alina Köchling, Heinrich-Heine-UniversityFollow
Shirin Riazy, HTW BerlinFollow
Marius Claus Wehner, Heinrich-Heine-UniversityFollow
Katharina Simbeck, HTW BerlinFollow

Document Type

Research Paper

Abstract

The study aims to identify whether algorithmic decision making leads to unfair (i.e., unequal) treatment of certain protected groups in the recruitment context. Firms increasingly implement algorithmic decision making to save costs and increase efficiency. Moreover, algorithmic decision making is considered to be fairer than human decisions due to social prejudices. Recent publications, however, imply that the fairness of algorithmic decision making is not necessarily given. Therefore, to investigate this further, highly accurate algorithms were used to analyze a pre-existing data set of 10,000 video clips of individuals in self-presentation settings. The analysis shows that the under-representation concerning gender and ethnicity in the training data set leads to an unpredictable overestimation and/or underestimation of the likelihood of inviting representatives of these groups to a job interview. Furthermore, algorithms replicate the existing inequalities in the data set. Firms have to be careful when implementing algorithmic video analysis during recruitment as biases occur if the underlying training data set is unbalanced.

Recommended Citation

Köchling, Alina; Riazy, Shirin; Wehner, Marius Claus; and Simbeck, Katharina (2021) "Highly Accurate, But Still Discriminatory," Business & Information Systems Engineering: Vol. 63: Iss. 1, 39-54.
Available at: https://aisel.aisnet.org/bise/vol63/iss1/4