Assessing Scholarly Influence: Using the Hirsch Indices to Reframe the Discourse

Authors

Duane Truex, Georgia State UniversityFollow
Michael Cuellar, North Carolina Central UniversityFollow
Hirotoshi Takeda, Paris Dauphine UniversityFollow

Abstract

This study is part of a program aimed at creating measures enabling a fairer and more complete assessment of a scholar’s contribution to a field, thus bringing greater rationality and transparency to the promotion and tenure process. It finds current approaches toward the evaluation of research productivity to be simplistic, atheoretic, and biased toward reinforcing existing reputation and power structures. This study examines the use of the Hirsch family of indices, a robust and theoretically informed metric, as an addition to prior approaches to assessing the scholarly influence of IS researchers. It finds that while the top tier journals are important indications of a scholar’s impact, they are neither the only nor, indeed, the most important sources of scholarly influence. Other ranking studies, by narrowly bounding the venues included in those studies, distort the discourse and effectively privilege certain venues by declaring them to be more highly influential than warranted. The study identifies three different categories of scholars: those who publish primarily in North American journals, those who publish primarily in European journals, and a transnational set of authors who publish in both geographies. Excluding the transnational scholars, for the scholars who published in these journal sets during the period of this analysis, we find that North American scholars tend to be more influential than European scholars, on average. We attribute this difference to a difference in the publication culture of the different geographies. This study also suggests that the influence of authors who publish in the European journal set is concentrated at a moderate level of influence, while the influence of those who publish in the North American journal set is dispersed between those with high influence and those with relatively low influence. Therefore, to be a part of the top European scholar list requires a higher level of influence than to be a part of the top North American scholar list.

Recommended Citation

Truex, Duane; Cuellar, Michael; and Takeda, Hirotoshi (2009) "Assessing Scholarly Influence: Using the Hirsch Indices to Reframe the Discourse," Journal of the Association for Information Systems, 10(7), .
DOI: 10.17705/1jais.00203
Available at: https://aisel.aisnet.org/jais/vol10/iss7/1

DOI

10.17705/1jais.00203