Abstract
Qualitative researchers in business and management information systems fields often need to employ a method of inter-coder reliability to test the trustworthiness of the findings of their content analysis. A suitable method for checking the inter-coder reliability enables researchers to rigorously assess the degree of agreement among two or more independent qualitative coders. By employing this method, researchers can identify mistakes in the content analysis before the codes are used in developing and testing a theory or a measurement model and avoid any associated time, effort and financial cost. However, little guidance is available on what method of inter-coder reliability check should be used. In this paper, we present a critical analysis of these methods that are suitable for qualitative business and management IS research, and provide an example of how we employed the most rigorous method among these methods for a qualitative behavioural IS study.
Recommended Citation
Nili, Alireza; Tate, Mary; and Barros, Alistair, "A Critical Analysis of Inter-Coder Reliability Methods in Information Systems Research" (2017). ACIS 2017 Proceedings. 99.
https://aisel.aisnet.org/acis2017/99