The Evaluation of Citation Distributions
AbstractThis paper reviews a number of recent contributions that demonstrate that a blend of welfare economics and statistical analysis is useful in the evaluation of the citations received by scientific papers in the periodical literature. The paper begins by clarifying the role of citation analysis in the evaluation of research. Next, a summary of results about the citation distributions’ basic features at different aggregation levels is offered. These results indicate that citation distributions share the same broad shape, are highly skewed, and are often crowned by a power law. In light of this evidence, a novel methodology for the evaluation of research units is illustrated by comparing the high- and low-citation impact achieved by the U.S., the European Union, and the rest of the world in 22 scientific fields. However, contrary to recent claims, it is shown that mean normalization at the sub-field level does not lead to a universal distribution. Nevertheless, among other topics subject to ongoing research, it appears that this lack of universality does not preclude sensible normalization procedures to compare the citation impact of articles in different scientific fields.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by C.E.P.R. Discussion Papers in its series CEPR Discussion Papers with number 8681.
Date of creation: Dec 2011
Date of revision:
Contact details of provider:
Postal: Centre for Economic Policy Research, 77 Bastwick Street, London EC1V 3PZ
Phone: 44 - 20 - 7183 8801
Fax: 44 - 20 - 7183 8820
Other versions of this item:
- A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
- A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines
- D60 - Microeconomics - - Welfare Economics - - - General
- I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Pedro Albarran & Ignacio Ortuno & Javier Ruiz-Castillo, 2009. "The measurement of low- and high-impact in citation distributions: technical results," Economics Working Papers we095735, Universidad Carlos III, Departamento de Economía.
- Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
- Giovanni Dosi & Patrick Llerena & Mauro Sylos Labin, 2005.
"Science-Technology-Industry Links and the ”European Paradox”: Some Notes on the Dynamics of Scientific and Technological Research in Europe,"
Working Papers of BETA
2005-11, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
- Giovanni Dosi & Patrick Llerena & Mauro Sylos Labini, 2005. "Science-Technology-Industry Links and the ”European Paradox”: Some Notes on the Dynamics of Scientific and Technological Research in Europe," LEM Papers Series 2005/02, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2011.
"The skewness of science in 219 sub-fields and a number of aggregates,"
Economics Working Papers
we1109, Universidad Carlos III, Departamento de Economía.
- Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2010. "The skewness of science in 219 sub-fields and a number of aggregates," Economics Working Papers we1038, Universidad Carlos III, Departamento de Economía.
- Albarrán, Pedro & Crespo, Juan A. & Ortuño-Ortín, Ignacio & Ruiz-Castillo, Javier, 2010. "The Skewness of Science in 219 Sub-Fields and a Number of Aggregates," CEPR Discussion Papers 8126, C.E.P.R. Discussion Papers.
- Matthew O. Jackson & Brian W. Rogers, 2007. "Meeting Strangers and Friends of Friends: How Random Are Social Networks?," American Economic Review, American Economic Association, vol. 97(3), pages 890-915, June.
- Sen, Amartya K, 1976. "Poverty: An Ordinal Approach to Measurement," Econometrica, Econometric Society, vol. 44(2), pages 219-31, March.
- Foster, James & Greer, Joel & Thorbecke, Erik, 1984. "A Class of Decomposable Poverty Measures," Econometrica, Econometric Society, vol. 52(3), pages 761-66, May.
- Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
- Herranz, Neus & Ruiz-Castillo, Javier, 2011.
"The end of the European Paradox,"
CEPR Discussion Papers
8674, C.E.P.R. Discussion Papers.
- Neus Herranz & Javier Ruiz-Castillo, 2011.
"Multiplicative and fractional strategies when journals are assigned to several sub-fields,"
Economics Working Papers
we1120, Universidad Carlos III, Departamento de Economía.
- Herranz, Neus & Ruiz-Castillo, Javier, 2011. "Multiplicative and fractional strategies when journals are assigned to several sub-fields," CEPR Discussion Papers 8673, C.E.P.R. Discussion Papers.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.