Ranking Scientific Journals via Latent Class Models for Polytomous Item Response
AbstractWe propose a strategy for ranking scientific journals starting from a set of available quantitative indicators that represent imperfect measures of the unobservable "value" of the journals of interest. After discretizing the available indicators, we estimate a latent class model for polytomous item response data and use the estimated model to classify each journal. We apply the proposed approach to data from the Research Evaluation Exercise (VQR) carried out in Italy with reference to the period 2004-2010, focusing on the sub-area consisting of Statistics and Financial Mathematics. Using four quantitative indicators of the journals' scientific value (IF, IF5, AIS, h-index), some of which not available for all journals, we derive a complete ordering of the journals according to their latent value. We show that the proposed methodology is relatively simple to implement, even when the aim is to classify journals into finite ordered groups of a fixed size. Finally, we analyze the robustness of the obtained ranking with respect to different discretization rules.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Einaudi Institute for Economics and Finance (EIEF) in its series EIEF Working Papers Series with number 1313.
Length: 26 pages
Date of creation: 2013
Date of revision: May 2013
This paper has been announced in the following NEP Reports:
- NEP-ALL-2013-06-09 (All new papers)
- NEP-DCM-2013-06-09 (Discrete Choice Models)
- NEP-SOG-2013-06-09 (Sociology of Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Chang, C-L. & McAleer, M.J. & Oxley, L., 2010.
"Journal Impect Factor Versus Eigenfactor and Article Influence,"
Econometric Institute Report
EI 2010-67, Erasmus University Rotterdam, Econometric Institute.
- Chia-Lin Chang & Michael McAleer & Les Oxley, 2010. "Journal Impact Factor Versus Eigenfactor and Article Influence," Working Papers in Economics 10/67, University of Canterbury, Department of Economics and Finance.
- Chia-Lin Chang & Michael McAleer & Les Oxley, 2010. "Journal Impact Factor Versus Eigenfactor and Article Influence," KIER Working Papers 737, Kyoto University, Institute of Economic Research.
- Christian Zimmermann, 2012.
"Academic rankings with RePEc,"
2012-023, Federal Reserve Bank of St. Louis.
- Francesco Bartolucci, 2007. "A class of multidimensional IRT models for testing unidimensionality and clustering items," Psychometrika, Springer, vol. 72(2), pages 141-157, June.
RePEc Biblio mentionsAs found on the RePEc Biblio, the curated bibliography for Economics:CitEc Project, subscribe to its RSS feed for this item.
- Graziella Bertocchi & Alfonso Gambardella & Tullio Jappelli & Carmela A. Nappi & Franco Peracchi, 2013.
"Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy,"
CSEF Working Papers
344, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
- Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," IZA Discussion Papers 7739, Institute for the Study of Labor (IZA).
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Facundo Piguillem).
If references are entirely missing, you can add them using this form.