Inconsistencies in judgement during a manual ranking task can prevent the clear identification of underlying (ranking) policy. AHP (analytical hierarchy process) provides an alternative to overcoming this problem. This study examines these methods in the context of IS curriculum development for their ability to accurately capture the policies of twenty-eight judges. A cluster analysis based on the rankings identifies their underlying policies, and thereby suggests the core courses for the curriculum. The results demonstrate the AHP’s ability to capture more consistent ranking policies, and thereby produce clusters of higher predictive quality.
Ching, Russell; Glorfeld, Louis; and Lam, Monica, "A Comparative Analysis of Manual and Computer-Aided Ranking Tasks for Curriculum Development" (1998). AMCIS 1998 Proceedings. 218.