The integrated impact indicator revisited\xa0(I3*): a non-parametric alternative to the journal impact factor

Loet Leydesdorff,Jonathan Adams,Lutz Bornmann

doi:10.1007/s11192-019-03099-8

Abstract

We propose the I3* indicator as a non-parametric alternative to the journal impact factor (JIF) and h-index. We apply I3* to more than 10,000 journals. The results can be compared with other journal metrics. I3* is a promising variant within the general scheme of non-parametric I3 indicators introduced previously: I3* provides a single metric which correlates with both impact in terms of citations (c) and output in terms of publications (p). We argue for weighting using four percentile classes: the top-1% and top-10% as excellence indicators; the top-50% and bottom-50% as output indicators. Like the h-index, which also incorporates both c and p, I3*-values are size-dependent; however, division of I3* by the number of publications (I3*/N) provides a size-independent indicator which correlates strongly with the 2- and 5-year journal impact factors (JIF2 and JIF5). Unlike the h-index, I3* correlates significantly with both the total number of citations and publications. The values of I3* and I3*/N can be statistically tested against the expectation or against one another using chi-squared tests or effect sizes. A template (in Excel) is provided online for relevant tests.

Highlights

Citations create links between publications; but to relate citations to publications as two different things, one needs a model
We introduce I3*—a variant within the general I3 scheme—by proposing a weighting scheme of percentile classes
We argue in this paper that an indicator can be developed that reflects both impact and output, and that combines the two dimensions of publications and citations into a single measure by using non-parametric statistics

Summary

Introduction

Citations create links between publications; but to relate citations to publications as two different things, one needs a model (for example, an equation). Using the h-index, papers with at least h citations are counted. This paper is based on a different and, in our opinion, more informative model: the Integrated Impact Indicator I3. The 2-year JIF was outlined by Garfield and Sher (1963; cf Garfield 1955; Sher and Garfield 1965) at the time of establishing the Institute for Scientific Information (ISI). JIF2 is defined as the number of citations in the current year (t) to any of a journal’s publications of the two previous years (t − 1 and t − 2), divided by the number of citable items (substantive articles, reviews, and proceedings) in the same journal in these two previous years. A JIF2 of 2.5 implies that, on average, the citable items published 1 or 2 years ago were cited two and a half times. Other JIF variants are available; for example, JIF5 covers a 5-year window.

Methods

Results

Conclusion