Computing and Library Services - delivering an inspiring information environment

Profiling citation impact: A new methodology

Adams, Jonathan, Gurney, Karen and Marshall, Stuart (2007) Profiling citation impact: A new methodology. Scientometrics, 72 (2). pp. 325-344. ISSN 0138-9130

[img] PDF (A methodology for creating bibliometric impact profiles is described. ) - Published Version
Restricted to Repository staff only

Download (326kB)


A methodology for creating bibliometric impact profiles is described. The advantages of such profiles as a management tool to supplement the reporting power of traditional average impact metrics are discussed. The impact profile for the UK as a whole reveals the extent to which the median and modal UK impact values differ from and are significantly below average impact. Only one-third of UK output for 1995-2004 is above world average impact although the UK’s average world-normalised impact is 1.24.
Time-categorised impact profiles are used to test hypotheses about changing impact and confirm that the increase in average UK impact is due to real improvement rather than a reduction in low impact outputs.
The impact profile methodology has been applied across disciplines as well as years and is shown to work well in all subject categories. It reveals substantial variations in performance between disciplines. The value of calculating the profile median and mode as well as the average impact are demonstrated. Finally, the methodology is applied to a specific data-set to compare the impact profile of the elite Laboratory of Molecular Biology (Cambridge) with the relevant UK average. This demonstrates an application of the methodology by identifying where the institute’s exceptional performance is located.
The value of impact profiles lies in their role as an interpretive aid for non-specialists, not as a technical transformation of the data for scientometricians.

Item Type: Article
Subjects: Z Bibliography. Library Science. Information Resources > Z665 Library Science. Information Science
Schools: Planning and Information Services
References: Adams, J. (1998), Benchmarking international research. Nature, 396: 615–618.» CrossRef 2.Ehrenberg, A. (1988), Repeat-buying: Facts, Theory and Applications. New York: Oxford University Press. 3.European Commission (2003), Third European Report on Science and Technology Indicators. D G Research, Brussels. ISBN 92 894 1795 1. 4.Evidence (2005), PSA Target Metrics for the UK Research Base. A report by Evidence Ltd for the Office of Science and Innovation. » 5.Feller, W. (1943), On a general class of ‘contagious’ distributions. Annals of Mathematical Statistics, 14: 389–400. 6.Garfield, E. (1955), Citation indexes for science: a new dimension in documentation through association of ideas. Science, 122: 108–111.» CrossRef 7.King, D. A. (2004), The scientific impact of nations. Nature, 430: 311–316.» CrossRef 8.Leydesdorff, L., Bensman, S. (2006), Classification and powerlaws: the logarithmic transformation. Journal of the American Society for Information Science and Technology, 57 1470–1486.» CrossRef 9.May, R. M. (1997), The scientific wealth of nations. Science, 275: 793–796.» CrossRef 10.Michelson, E. S. (2006), Approaches to research and development performance assessment in the United States. Science and Public Policy, 33: 546–560. 11.Moed, H. F. (2005), Citation Analysis in Research Evaluation. Springer, Dordrecht. ISBN 4020 3713 9. 12.Moed, H. F., Glänzel, W., Schmoch, U. (2004), Handbook of Quantitative Science and Technology Research. Springer, Dordrecht. 13.Price, D. de Solla (1965), The scientific foundations of science policy. Nature, 206: 233–238.» CrossRef 14.Savani, V., Zhigljavsky, A. (2006), Efficient estimation of parameters of the negative binomial distribution. Communications in Statistics: Theory and Methods, 35: 1–17.» CrossRef 15.Savani, V., Zhigljavsky, A., Efficient parameter estimation for independent and INAR(1) negative binomial samples. Metrika (in press a). 16.Savani, V., Zhigljavsky, A., Asymptotic distributions of statistics and parameter estimates for mixed Poisson processes. (in press b). 17.Small, H., Why authors think their papers are highly cited. Scientometrics, 60 (2004) 305–316.» CrossRef 18.Weingart, P. Impact of bibliometrics upon the science system: inadvertent consequences? Scientometrics, 62 (2005) 117–131.» CrossRef 19.Zitt, M., Ramanana-Rahary, S., Bassecoulard, E., Relativity of citation performance and excellence measures: from cross-field to cross-scale effects of field normalisation. Scientometrics, 63 (2005) 373–201.» CrossRef
Depositing User: Stuart Marshall
Date Deposited: 27 Mar 2014 12:09
Last Modified: 06 Apr 2018 17:01


Downloads per month over past year

Repository Staff Only: item control page

View Item View Item

University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©