IDEAS home Printed from https://ideas.repec.org/p/hum/wpaper/sfb649dp2016-020.html
   My bibliography  Save this paper

Academic Ranking Scales in Economics: Prediction and Imputation

Author

Listed:
  • Alona Zharova
  • Andrija Mihoci
  • Wolfgang Karl Härdle

Abstract

Publications are a vital element of any scientist’s career. It is not only the number of media outlets but aslo the quality of published research that enters decisions on jobs, salary, tenure, etc. Academic ranking scales in economics and other disciplines are, therefore, widely used in classification, judgment and scientific depth of individual research. These ranking systems are competing, allow for different disciplinary gravity and sometimes give orthogonal results. Here a statistical analysis of the interconnection between Handelsblatt (HB), Research Papers in Economics (RePEc, here RP) and Google Scholar (GS) systems is presented. Quantile regression allows us to successfully predict missing ranking data and to obtain a so-called HB Common Score and to carry out a cross-rankings analysis. Based on the merged ranking data from different data providers, we discuss the ranking systems dependence, analyze the age effect and study the relationship between the research expertise areas and the ranking performance.

Suggested Citation

  • Alona Zharova & Andrija Mihoci & Wolfgang Karl Härdle, 2016. "Academic Ranking Scales in Economics: Prediction and Imputation," SFB 649 Discussion Papers SFB649DP2016-020, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    • Handle: RePEc:hum:wpaper:sfb649dp2016-020
    as

    Download full text from publisher

    File URL: http://sfb649.wiwi.hu-berlin.de/papers/pdf/SFB649DP2016-020.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Klaus Wohlrabe, 2013. "A Few Comments on the Handelsblatt Ranking 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 66(23), pages 79-83, December.
    2. Mengmeng Guo & Lhan Zhou & Jianhua Z. Huang & Wolfgang Karl Härdle, 2013. "Functional Data Analysis of Generalized Quantile Regressions," SFB 649 Discussion Papers SFB649DP2013-001, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    3. Dilger, Alexander & Müller, Harry, 2011. "Ein Forschungsleistungsranking auf der Grundlage von Google Scholar," Discussion Papers of the Institute for Organisational Economics 12/2011, University of Münster, Institute for Organisational Economics.
    4. Klaus Wohlrabe, 2011. "Handelsblatt and RePEc rankings in comparison," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 64(17), pages 66-71, September.
    5. Bernd Fitzenberger & Ralf Wilke, 2006. "Using quantile regression for duration analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(1), pages 105-120, March.
    6. Härdle, Wolfgang K. & Song, Song, 2010. "Confidence Bands In Quantile Regression," Econometric Theory, Cambridge University Press, vol. 26(4), pages 1180-1200, August.
    7. Felix Schläpfer & Friedrich Schneider, 2010. "Messung der akademischen Forschungsleistung in den Wirtschaftswissenschaften: Reputation vs. Zitierhäufigkeiten," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 11(4), pages 325-339, November.
    8. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    9. Roger Koenker & Kevin F. Hallock, 2001. "Quantile Regression," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 143-156, Fall.
    10. Pierre-Philippe Combes & Laurent Linnemer, 2010. "Inferring Missing Citations: A Quantitative Multi-Criteria Ranking of all Journals in Economics," Working Papers halshs-00520325, HAL.
    11. Wolfgang Karl Härdle & Vladimir Spokoiny & Weining Wang, 2011. "Local Quantile Regression," SFB 649 Discussion Papers SFB649DP2011-005, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. KRAPF, Matthias & SCHLÄPFER, Jörg, 2012. "How Nobel Laureates Would Perform In The Handelsblatt Ranking," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 12(3).
    2. Klaus Wohlrabe, 2013. "A Few Comments on the Handelsblatt Ranking 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 66(23), pages 79-83, December.
    3. Klaus Wohlrabe, 2011. "Handelsblatt and RePEc rankings in comparison," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 64(17), pages 66-71, September.
    4. Xavier D’Haultfoeuille & Pauline Givord, 2014. "La régression quantile en pratique," Économie et Statistique, Programme National Persée, vol. 471(1), pages 85-111.
    5. Ulrich Rendtel, 2019. "Journal-Rankings und Karriere im Fach Statistik an wirtschaftwissenschaftlichen Fakultäten [Journal rankings and career in statistics at economic departments]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 13(2), pages 125-142, September.
    6. Haucap, Justus & Thomas, Tobias & Wohlrabe, Klaus, 2017. "Publication performance vs. influence: On the questionable value of quality weighted publication rankings," DICE Discussion Papers 277, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    7. Joseph Gerald Hirschberg & Jeanette Ngaire Lye, 2020. "Grading Journals In Economics: The Abcs Of The Abdc," Journal of Economic Surveys, Wiley Blackwell, vol. 34(4), pages 876-921, September.
    8. Püttmann, Vitus & Thomsen, Stephan L. & Trunzer, Johannes, 2020. "Zur Relevanz von Ausstattungsunterschieden für Forschungsleistungsvergleiche: Ein Diskussionsbeitrag für die Wirtschaftswissenschaften in Deutschland," Hannover Economic Papers (HEP) dp-679, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät, revised Mar 2021.
    9. Andrei Dubovik & Clemens Fiedler & Alexei Parakhonyak, 2022. "Temporal Patterns in Economics Research," CPB Discussion Paper 440, CPB Netherlands Bureau for Economic Policy Analysis.
    10. repec:jns:jbstat:v:227:y:2007:i:1:p:65-86 is not listed on IDEAS
    11. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    12. Alexander Butz & Klaus Wohlrabe, 2016. "Die Ökonomen-Rankings 2015 von Handelsblatt, FAZ und RePEc: Methodik, Ergebnisse, Kritik und Vergleich," ifo Working Paper Series 212, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    13. Song, Song & Ritov, Ya’acov & Härdle, Wolfgang K., 2012. "Bootstrap confidence bands and partial linear quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 107(C), pages 244-262.
    14. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).
    15. Lutz Bornmann & Klaus Wohlrabe, 2019. "Normalisation of citation impact in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 841-884, August.
    16. Marco Pleßner, 2017. "The disposition effect: a survey," Management Review Quarterly, Springer, vol. 67(1), pages 1-30, February.
    17. Chen, Songnian, 2010. "An integrated maximum score estimator for a generalized censored quantile regression model," Journal of Econometrics, Elsevier, vol. 155(1), pages 90-98, March.
    18. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.
    19. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    20. Akosah, Nana Kwame & Alagidede, Imhotep Paul & Schaling, Eric, 2020. "Testing for asymmetry in monetary policy rule for small-open developing economies: Multiscale Bayesian quantile evidence from Ghana," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    21. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.

    More about this item

    Keywords

    scientometrics; ranking; quantile regression; Handelsblatt; RePEc; Google Scholar;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • M10 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hum:wpaper:sfb649dp2016-020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RDC-Team (email available below). General contact details of provider: https://edirc.repec.org/data/sohubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.