IDEAS home Printed from https://ideas.repec.org/p/zbw/sfb649/sfb649dp2016-020.html

Academic ranking scales in economics: Prediction and imputation

Author

Listed:
  • Zharova, Alona
  • Mihoci, Andrija
  • Härdle, Wolfgang Karl

Abstract

Publications are a vital element of any scientist's career. It is not only the number of media outlets but aslo the quality of published research that enters decisions on jobs, salary, tenure, etc. Academic ranking scales in economics and other disciplines are, therefore, widely used in classification, judgment and scientific depth of individual research. These ranking systems are competing, allow for different disciplinary gravity and sometimes give orthogonal results. Here a statistical analysis of the interconnection between Handelsblatt (HB), Research Papers in Economics (RePEc, here RP) and Google Scholar (GS) systems is presented. Quantile regression allows us to successfully predict missing ranking data and to obtain a so-called HB Common Score and to carry out a cross-rankings analysis. Based on the merged ranking data from different data providers, we discuss the ranking systems dependence, analyze the age effect and study the relationship between the research expertise areas and the ranking performance.

Suggested Citation

  • Zharova, Alona & Mihoci, Andrija & Härdle, Wolfgang Karl, 2016. "Academic ranking scales in economics: Prediction and imputation," SFB 649 Discussion Papers 2016-020, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    • Handle: RePEc:zbw:sfb649:sfb649dp2016-020
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/146189/1/858809346.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Klaus Wohlrabe, 2013. "Einige Anmerkungen zum Handelsblatt-Ranking 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 66(23), pages 79-83, December.
    2. repec:hum:wpaper:sfb649dp2013-001 is not listed on IDEAS
    3. Klaus Wohlrabe, 2011. "Das Handelsblatt- und das RePEc-Ranking im Vergleich," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 64(17), pages 66-71, September.
    4. Bernd Fitzenberger & Ralf Wilke, 2006. "Using quantile regression for duration analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(1), pages 105-120, March.
    5. Härdle, Wolfgang K. & Song, Song, 2012. "CONFIDENCE BANDS IN QUANTILE REGRESSION–Corrigendum," Econometric Theory, Cambridge University Press, vol. 28(2), pages 483-484, April.
    6. Felix Schläpfer & Friedrich Schneider, 2010. "Messung der akademischen Forschungsleistung in den Wirtschaftswissenschaften: Reputation vs. Zitierhäufigkeiten," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 11(4), pages 325-339, November.
    7. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:hum:wpaper:sfb649dp2016-020 is not listed on IDEAS
    2. Püttmann, Vitus & Thomsen, Stephan L. & Trunzer, Johannes, 2020. "Zur Relevanz von Ausstattungsunterschieden für Forschungsleistungsvergleiche: Ein Diskussionsbeitrag für die Wirtschaftswissenschaften in Deutschland," Hannover Economic Papers (HEP) dp-679, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät, revised Mar 2021.
    3. Klaus Wohlrabe, 2013. "Einige Anmerkungen zum Handelsblatt-Ranking 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 66(23), pages 79-83, December.
    4. KRAPF, Matthias & SCHLÄPFER, Jörg, 2012. "How Nobel Laureates Would Perform In The Handelsblatt Ranking," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 12(3).
    5. Härdle, Wolfgang Karl & Spokoiny, Vladimir & Wang, Weining, 2010. "Local quantile regression," SFB 649 Discussion Papers 2011-005, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    6. repec:iab:iabfme:200709(en is not listed on IDEAS
    7. Michael E. Rose, 2022. "Small world: Narrow, wide, and long replication of Goyal, van der Leij and Moraga‐Gonzélez (JPE 2006) and a comparison of EconLit and Scopus," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 820-828, June.
    8. Kim, Kun Ho & Chao, Shih-Kang & Härdle, Wolfgang Karl, 2020. "Simultaneous Inference of the Partially Linear Model with a Multivariate Unknown Function," IRTG 1792 Discussion Papers 2020-008, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    9. Curcio, Domenico & Gianfrancesco, Igor & Onorato, Grazia & Vioto, Davide, 2024. "Do ESG scores affect financial systemic risk? Evidence from European banks and insurers," Research in International Business and Finance, Elsevier, vol. 69(C).
    10. Klaus Wohlrabe, 2011. "Das Handelsblatt- und das RePEc-Ranking im Vergleich," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 64(17), pages 66-71, September.
    11. Paulo Guimarães & Mariana Barbosa, 2022. "The state of Portuguese research in economics: 20 years after," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 21(3), pages 283-309, September.
    12. Daniel S. Hamermesh & Lea‐Rachel Kosnik, 2024. "Why do older scholars slow down?," Economic Inquiry, Western Economic Association International, vol. 62(1), pages 488-499, January.
    13. Matthias Aistleitner & Jakob Kapeller & Stefan Steinerberger, 2018. "Citation Patterns in Economics and Beyond," Working Papers Series 85, Institute for New Economic Thinking.
    14. Syed Hasan & Robert Breunig, 2021. "Article length and citation outcomes," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7583-7608, September.
    15. Meyer, Matthias & Waldkirch, Rüdiger W. & Duscher, Irina & Just, Alexander, 2018. "Drivers of citations: An analysis of publications in “top” accounting journals," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 51(C), pages 24-46.
    16. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    17. Wilke, Ralf A. & Wichert, Laura, 2005. "Application of a simple nonparametric conditional quantile function estimator in unemployment duration analysis," ZEW Discussion Papers 05-67 [rev.], ZEW - Leibniz Centre for European Economic Research.
    18. Carlo D'Ippoliti, 2021. "“Many‐Citedness”: Citations Measure More Than Just Scientific Quality," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1271-1301, December.
    19. Rolf Ketzler & Klaus F. Zimmermann, 2013. "A citation-analysis of economic research institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1095-1112, June.
    20. Ulrich Rendtel, 2019. "Journal-Rankings und Karriere im Fach Statistik an wirtschaftwissenschaftlichen Fakultäten [Journal rankings and career in statistics at economic departments]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 13(2), pages 125-142, September.
    21. Shih-Kang Chao & Katharina Proksch & Holger Dette & Wolfgang Karl Härdle, 2017. "Confidence Corridors for Multivariate Generalized Quantile Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 70-85, January.
    22. Shoshana Grossbard & Tansel Yilmazer & Lingrui Zhang, 2018. "The Gender Gap in Citations: Lessons from Demographic Economics Journals," Working Papers 2018-078, Human Capital and Economic Opportunity Working Group.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • M10 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - General

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Papers using RePEc data

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:sfb649:sfb649dp2016-020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/sohubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.