Peer review for the evaluation of the academic research: the Italian experience
AbstractPeer review, that is the evaluation process based on judgments formulated by independent experts, is generally used for different goals: the allocation of research funding, the review of the research results submitted for publication in scientific journals, and the assessment of the quality of research conducted by Universities and university-related Institutes. The paper deals with the latter type of peer review. The aim is to understand how the characteristics of the Italian experience provide useful lessons for improving peer review effectiveness for evaluating the academic research. More specifically, the paper investigates the peer review process developed within the Three-Year Research Assessment Exercise (VTR) in Italy. Our analysis covers four disciplinary sectors: chemistry, biology, humanities and economics. Thus, the choice includes two “hard science” sectors, which have similar type of research output submitted for the three-year evaluation process, and two sectors with different types of output. The results provide evidences, which highlight the important role played by peer review for judging the quality of the academic research in different fields of science, and for comparing different institutions’ performance. Moreover, some basic features of the evaluation process are discussed, in order to understand their usefulness for reinforcing the effectiveness of the peers’ final outcome.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Institute for Economic Research on Firms and Growth - Moncalieri (TO) in its series CERIS Working Paper with number 200615.
Length: 29 pages
Date of creation: Dec 2006
Date of revision:
Scientific research; Evaluation; Peer review; University; Academic institutions;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Per O Seglen, 1992. "How representative is the journal impact factor?," Research Evaluation, Oxford University Press, vol. 2(3), pages 143-149, December.
- Rinia, E. J. & van Leeuwen, Th. N. & van Vuren, H. G. & van Raan, A. F. J., 2001. "Influence of interdisciplinarity on peer-review and bibliometric evaluations in physics research," Research Policy, Elsevier, vol. 30(3), pages 357-361, March.
- Martin, Ben R. & Irvine, John, 1993.
"Assessing basic research : Some partial indicators of scientific progress in radio astronomy,"
Elsevier, vol. 22(2), pages 106-106, April.
- Martin, Ben R. & Irvine, John, 1983. "Assessing basic research : Some partial indicators of scientific progress in radio astronomy," Research Policy, Elsevier, vol. 12(2), pages 61-90, April.
- Rinia, E. J. & van Leeuwen, Th. N. & van Vuren, H. G. & van Raan, A. F. J., 1998. "Comparative analysis of a set of bibliometric indicators and central peer review criteria: Evaluation of condensed matter physics in the Netherlands," Research Policy, Elsevier, vol. 27(1), pages 95-107, May.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Enrico Viarisio) or (Anna Perin) or (Giancarlo Birello).
If references are entirely missing, you can add them using this form.