Ranking Scientific Journals via Latent Class Models for Polytomous Item Response
We propose a strategy for ranking scientific journals starting from a set of available quantitative indicators that represent imperfect measures of the unobservable "value" of the journals of interest. After discretizing the available indicators, we estimate a latent class model for polytomous item response data and use the estimated model to classify each journal. We apply the proposed approach to data from the Research Evaluation Exercise (VQR) carried out in Italy with reference to the period 2004-2010, focusing on the sub-area consisting of Statistics and Financial Mathematics. Using four quantitative indicators of the journals' scientific value (IF, IF5, AIS, h-index), some of which not available for all journals, we derive a complete ordering of the journals according to their latent value. We show that the proposed methodology is relatively simple to implement, even when the aim is to classify journals into finite ordered groups of a fixed size. Finally, we analyze the robustness of the obtained ranking with respect to different discretization rules.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
| Length: | 26 pages |
| Date of creation: | 2013 |
| Date of revision: | May 2013 |
| Handle: | RePEc:eie:wpaper:1313 |
| Contact details of provider: | Postal: Via Sallustiana, 62 - 00187 Roma Phone: +39 066790013 Fax: +39 0647924872 Web page: http://www.eief.it/repec Email: More information through EDIRC
|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Christian Zimmermann, 2013.
"Academic Rankings with RePEc,"
Econometrics,
MDPI, Open Access Journal, vol. 1(3), pages 1-32, December.
- Christian Zimmermann, 2007. "Academic Rankings with RePEc," Working papers 2007-36, University of Connecticut, Department of Economics, revised Mar 2009.
- Christian Zimmermann, 2012. "Academic rankings with RePEc," Working Papers 2012-023, Federal Reserve Bank of St. Louis.
- Bartolucci, Francesco & Bacci, Silvia & Gnaldi, Michela, 2014. "MultiLCIRT: An R package for multidimensional latent class item response models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 971-985.
- Chang, C-L. & McAleer, M.J. & Oxley, L., 2010. "Journal Impect Factor Versus Eigenfactor and Article Influence," Econometric Institute Research Papers EI 2010-67, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
- Chia-Lin Chang & Michael McAleer & Les Oxley, 2010. "Journal Impact Factor Versus Eigenfactor and Article Influence," KIER Working Papers 737, Kyoto University, Institute of Economic Research.
- Chia-Lin Chang & Michael McAleer & Les Oxley, 2010. "Journal Impact Factor Versus Eigenfactor and Article Influence," Working Papers in Economics 10/67, University of Canterbury, Department of Economics and Finance.
- Francesco Bartolucci, 2007. "A class of multidimensional IRT models for testing unidimensionality and clustering items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 141-157, June.
- Althouse, Benjamin M. & West, Jevin D. & Bergstrom, Ted C & Bergstrom, Carl T., 2008. "Differences in Impact Factor Across Fields and Over Time," University of California at Santa Barbara, Economics Working Paper Series qt76h442pg, Department of Economics, UC Santa Barbara. Full references (including those not matched with items on IDEAS)