The evaluation of citation distributions
AbstractThis paper reviews a number of recent contributions that demonstrate that a blend of welfare economics and statistical analysis is useful in the evaluation of the citations received by scientific papers in the periodical literature. The paper begins by clarifying the role of citation analysis in the evaluation of research. Next, a summary of results about the citation distributionsâ basic features at different aggregation levels is offered. These results indicate that citation distributions share the same broad shape, are highly skewed, and are often crowned by a power law. In light of this evidence, a novel methodology for the evaluation of research units is illustrated by comparing the high- and low-citation impact achieved by the U.S., the European Union, and the rest of the world in 22 scientific fields. However, contrary to recent claims, it is shown that mean normalization at the sub-field level does not lead to a universal distribution. Nevertheless, among other topics subject to ongoing research, it appears that this lack of universality does not preclude sensible normalization procedures to compare the citation impact of articles in different scientific fields.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Spanish Economic Association in its journal SERIEs.
Volume (Year): 3 (2012)
Issue (Month): 1 (March)
Contact details of provider:
Postal: Universidad del País Vasco; DFAE II; Avenida Lehendakari Aguirre, 83; 48015 Bilbao; Spain
Phone: +34 94 6013783
Fax: + 34 94 6013774
Web page: http://www.springer.com/economics/journal/13209
More information through EDIRC
Other versions of this item:
- A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
- A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines
- D60 - Microeconomics - - Welfare Economics - - - General
- I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
- Albarrán, Pedro & Crespo, Juan A. & Ortuño-Ortín, Ignacio & Ruiz-Castillo, Javier, 2010.
"The Skewness of Science in 219 Sub-Fields and a Number of Aggregates,"
CEPR Discussion Papers
8126, C.E.P.R. Discussion Papers.
- Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "The skewness of science in 219 sub-fields and a number of aggregates," Economics Working Papers we1109, Universidad Carlos III, Departamento de Economía.
- Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2010. "The skewness of science in 219 sub-fields and a number of aggregates," Economics Working Papers we1038, Universidad Carlos III, Departamento de Economía.
- Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
- Foster, James & Greer, Joel & Thorbecke, Erik, 1984. "A Class of Decomposable Poverty Measures," Econometrica, Econometric Society, vol. 52(3), pages 761-66, May.
- Giovanni Dosi & Patrick Llerena & Mauro Sylos Labini, 2005.
"Science-Technology-Industry Links and the ”European Paradox”: Some Notes on the Dynamics of Scientific and Technological Research in Europe,"
LEM Papers Series
2005/02, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Giovanni Dosi & Patrick Llerena & Mauro Sylos Labin, 2005. "Science-Technology-Industry Links and the ”European Paradox”: Some Notes on the Dynamics of Scientific and Technological Research in Europe," Working Papers of BETA 2005-11, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
- Pedro Albarran & Ignacio Ortuno & Javier Ruiz-Castillo, 2009. "The measurement of low- and high-impact in citation distributions: technical results," Economics Working Papers we095735, Universidad Carlos III, Departamento de Economía.
- Sen, Amartya K, 1976. "Poverty: An Ordinal Approach to Measurement," Econometrica, Econometric Society, vol. 44(2), pages 219-31, March.
- Matthew O. Jackson & Brian W. Rogers, 2007. "Meeting Strangers and Friends of Friends: How Random Are Social Networks?," American Economic Review, American Economic Association, vol. 97(3), pages 890-915, June.
- Herranz, Neus & Ruiz-Castillo, Javier, 2011.
"Multiplicative and fractional strategies when journals are assigned to several sub-fields,"
CEPR Discussion Papers
8673, C.E.P.R. Discussion Papers.
- Neus Herranz & Javier Ruiz-Castillo, 2011. "Multiplicative and fractional strategies when journals are assigned to several sub-fields," Economics Working Papers we1120, Universidad Carlos III, Departamento de Economía.
- Neus Herranz & Javier Ruiz-Castillo, 2011.
"The end of the "European paradox","
Economics Working Papers
we1127, Universidad Carlos III, Departamento de Economía.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Guenther Eichhorn) or (Christopher F Baum).
If references are entirely missing, you can add them using this form.