On the Evaluation of Economic Research: The Case of Italy
AbstractThe Italian case can be considered as an internationally relevant example to suggest a critical reflection on the evaluation criteria adopted in research assessment exercises, pointing at the need of clear and shared guidelines based on transparency and accountability and aiming at preserving (or even encouraging) the pluralism of ideas. Our findings support the view that if research institutions are encouraged to engage only in those lines of research that are likely to receive the highest rating according to the adopted evaluation criteria, a convergence process is to be expected within Economics, resulting in a disregard of heterodox schools and historical methods in favour of mainstream approaches and quantitative methods. In our view, a proper fine-tuning of the assessment methodology is needed, before subsequent rankings can be used as a guide for the allocation of public financing among research institutions. In the case of Economics, this means overcoming the limits of commonly adopted peer review approaches, through the development of proper evaluation designs and the integration of qualitative appraisals with quantitative indicators. In order to preserve pluralism and originality of research, we propose a simple quantitative index based on field-normalization.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Società editrice il Mulino in its journal Economia politica.
Volume (Year): (2011)
Issue (Month): 3 ()
Contact details of provider:
A11; A14; B20; B40; B50;
Other versions of this item:
- Marcella Corsi & Carlo D'Ippoliti & Federico Lucidi, 2011. "On the Evaluation of Economic Research: the Case of Italy," DULBEA Working Papers 11-04, ULB -- Universite Libre de Bruxelles.
- A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
- A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
- B20 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - General
- B40 - Schools of Economic Thought and Methodology - - Economic Methodology - - - General
- B50 - Schools of Economic Thought and Methodology - - Current Heterodox Approaches - - - General
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- repec:rie:review:v:12:y:2007:i:2:n:9 is not listed on IDEAS
- Oswald, Andrew J., 2006.
"An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers,"
IZA Discussion Papers
2070, Institute for the Study of Labor (IZA).
- Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, 02.
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," The Warwick Economics Research Paper Series (TWERPS) 744, University of Warwick, Department of Economics.
- Bruno S. Frey & Margit Osterloh, 2006.
"Evaluations: Hidden Costs, Questionable Benefits, and Superior Alternatives,"
CREMA Working Paper Series
2006-23, Center for Research in Economics, Management and the Arts (CREMA), revised Oct 2006.
- Bruno S. Frey & Margit Osterloh, 2006. "Evaluations: Hidden Costs, Questionable Benefits, and Superior Alternatives," IEW - Working Papers 302, Institute for Empirical Research in Economics - University of Zurich.
- Marcella Corsi & Carlo D'Ippoliti & Federico Lucidi, 2010. "Pluralism at Risk?," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1495-1529, November.
- BAUWENS, Luc & KIRMAN, Alan & LUBRANO, Michel & PROTOPOPESCU, Camelia, .
"Ranking economics departments in Europe: a statistical approach,"
CORE Discussion Papers RP
-1694, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Michel Lubrano & Luc Bauwens & Alan Kirman & Camelia Protopopescu, 2003. "Ranking Economics Departments in Europe: A Statistical Approach," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1367-1401, December.
- BAUWENS, Luc & KIRMAN, Alan & LUBRANO, Michel & PROTOPOPESCU, Camelia, 2003. "Ranking economics departments in Europe: a statistical approach," CORE Discussion Papers 2003050, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- David Colander, 2010.
"Can European Economics Compete with U.S. Economics? And Should It?,"
Middlebury College Working Paper Series
1039, Middlebury College, Department of Economics.
- David Colander, 2009. "Can European Economics Compete with U.S. Economics? And Should It"," Middlebury College Working Paper Series 0902, Middlebury College, Department of Economics.
- S. Redner, 1998. "How popular is your paper? An empirical study of the citation distribution," The European Physical Journal B - Condensed Matter and Complex Systems, Springer, vol. 4(2), pages 131-134, July.
- repec:rie:review:v:11:y:2006:i:3:n:5 is not listed on IDEAS
- Frederic S. Lee, 2007. "The Research Assessment Exercise, the state and the dominance of mainstream economics in British universities," Cambridge Journal of Economics, Oxford University Press, vol. 31(2), pages 309-325, March.
- Kalaitzidakis, Pantelis & Mamuneas, Theofanis P. & Stengos, Thanasis, 1999. "European economics: An analysis based on publications in the core journals," European Economic Review, Elsevier, vol. 43(4-6), pages 1150-1168, April.
- Hodgson, Geoffrey M & Rothman, Harry, 1999. "The Editors and Authors of Economics Journals: A Case of Institutional Oligopoly?," Economic Journal, Royal Economic Society, vol. 109(453), pages F165-86, February.
- Silvia Ferrini, 2007. "L’Impact Factor: luci e ombre," Department of Economic Policy, Finance and Development (DEPFID) University of Siena 002, Department of Economic Policy, Finance and Development (DEPFID), University of Siena.
- Anania, Giovanni & Caruso, Annarosa, 2012. "Two New Simple Bibliometric Indexes to Better Evaluate Research in Economics," Congress Papers 124116, Italian Association of Agricultural and Applied Economics (AIEAA).
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.