IDEAS home Printed from https://ideas.repec.org/p/rza/wpaper/300.html
   My bibliography  Save this paper

The Objectivity of National Research Foundation Peer Review Based Ratings in South Africa

Author

Listed:
  • Johannes W. Fedderke

Abstract

This paper examines the strength of association between the outcomes of National Research Foundation (NRF) peer review based rating mechanisms, and a range of objective measures of performance of researchers. The analysis is conducted on 1932 scholars that have received an NRF rating or an NRF research chair. We find that scholars with higher NRF […]

Suggested Citation

  • Johannes W. Fedderke, 2012. "The Objectivity of National Research Foundation Peer Review Based Ratings in South Africa," Working Papers 300, Economic Research Southern Africa.
    • Handle: RePEc:rza:wpaper:300
    as

    Download full text from publisher

    File URL: https://econrsa.org/wp-content/uploads/2022/06/wp300.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Aparna Basu & Ritu Aggarwal, 2001. "International Collaboration in Science in India and its Impact on Institutional Performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 52(3), pages 379-394, November.
    2. Stefan Hornbostel, 2001. "Third party funding of German universities. An indicator of research activity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(3), pages 523-537, March.
    3. Aldo Geuna, 2001. "The Changing Rationale for European University Research Funding: Are There Negative Unintended Consequences?," Journal of Economic Issues, Taylor & Francis Journals, vol. 35(3), pages 607-632, September.
    4. Cliff Frohlich & Lynn Resler, 2001. "Analysis of publications and citations from a geophysics research institute," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 52(9), pages 701-713.
    5. Judit Bar-Ilan, 2008. "Which h-index? — A comparison of WoS, Scopus and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 257-271, February.
    6. Adler, Niclas & Elmquist, Maria & Norrgren, Flemming, 2009. "The challenge of managing boundary-spanning research activities: Experiences from the Swedish context," Research Policy, Elsevier, vol. 38(7), pages 1136-1149, September.
    7. Leo Egghe & Ronald Rousseau, 2006. "An informetric model for the Hirsch-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 121-129, October.
    8. Benner, Mats & Sandstrom, Ulf, 2000. "Institutionalizing the triple helix: research funding and norms in the academic system," Research Policy, Elsevier, vol. 29(2), pages 291-301, February.
    9. Adela García-Aracil & Antonio Gutiérrez Gracia & Marián Pérez-Marín, 2006. "Analysis of the evaluation process of the research performance: An empirical case," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(2), pages 213-230, May.
    10. Hare, Paul G & Wyatt, Geoffrey, 1992. "Economics of Academic Research and Its Implications for Higher Education," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 8(2), pages 48-66, Summer.
    11. Y. S. Ho & C. H. Chiu & T. M. Tseng & W. T. Chiu, 2003. "Assessing stem cell research productivity," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(3), pages 369-376, July.
    12. Lutz Bornmann & Hans-Dieter Daniel, 2005. "Does the h-index for ranking of scientists really work?," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(3), pages 391-392, December.
    13. Maria Bordons & M. T. Fernández & Isabel Gómez, 2002. "Advantages and limitations in the use of impact factor measures for the assessment of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 195-206, February.
    14. Kayvan Kousha & Mike Thelwall, 2008. "Sources of Google Scholar citations outside the Science Citation Index: A comparison between four science disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 273-294, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fedderke, J.W. & Goldschmidt, M., 2015. "Does massive funding support of researchers work?: Evaluating the impact of the South African research chair funding initiative," Research Policy, Elsevier, vol. 44(2), pages 467-482.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. W. Fedderke, 2013. "The objectivity of national research foundation peer review in South Africa assessed against bibliometric indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 177-206, November.
    2. Zhang, Lin & Thijs, Bart & Glänzel, Wolfgang, 2011. "The diffusion of H-related literature," Journal of Informetrics, Elsevier, vol. 5(4), pages 583-593.
    3. Fedderke, J.W. & Goldschmidt, M., 2015. "Does massive funding support of researchers work?: Evaluating the impact of the South African research chair funding initiative," Research Policy, Elsevier, vol. 44(2), pages 467-482.
    4. Anne-Wil Harzing, 2013. "A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1057-1075, March.
    5. Judit Bar-Ilan, 2008. "The h-index of h-index and of other informetric topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(3), pages 591-605, June.
    6. Judit Bar-Ilan, 2008. "Which h-index? — A comparison of WoS, Scopus and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 257-271, February.
    7. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    8. Parul Khurana & Kiran Sharma, 2022. "Impact of h-index on author’s rankings: an improvement to the h-index for lower-ranked authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4483-4498, August.
    9. Bornmann, Lutz & Marx, Werner, 2012. "HistCite analysis of papers constituting the h index research front," Journal of Informetrics, Elsevier, vol. 6(2), pages 285-288.
    10. Jiancheng Guan & Yan Yan & Jingjing Zhang, 2015. "How do collaborative features affect scientific output? Evidences from wind power field," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 333-355, January.
    11. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    12. Sergio Copiello, 2019. "The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lie," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 995-1018, November.
    13. Andereggen, Stefan & Vischer, Moritz & Boutellier, Roman, 2012. "Honest but broke: The dilemma of universities acting as honest brokers," Technology in Society, Elsevier, vol. 34(2), pages 118-126.
    14. Peder Olesen Larsen & Markus Ins, 2010. "The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 575-603, September.
    15. Ian Coelho de Souza Almeida & Rafael Galvão de Almeida & Lucas Resende de Carvalho, 2017. "Academic rankings and pluralism : the case of Brazil and the new version of Qualis," Textos para Discussão Cedeplar-UFMG 569, Cedeplar, Universidade Federal de Minas Gerais.
    16. Migheli, Matteo & Zotti, Roberto, 2020. "The strange case of the Matthew effect and beauty contests: Research evaluation and specialisation in Italian universities," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    17. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    18. Antonis Sidiropoulos & Dimitrios Katsaros & Yannis Manolopoulos, 2007. "Generalized Hirsch h-index for disclosing latent facts in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(2), pages 253-280, August.
    19. R. Núñez-Sánchez & A. Barge-Gil & A. Modrego-Rico, 2012. "Performance of knowledge interactions between public research centres and industrial firms in Spain: a project-level analysis," The Journal of Technology Transfer, Springer, vol. 37(3), pages 330-354, June.
    20. Yuxian Liu & Ronald Rousseau, 2009. "Properties of Hirsch-type indices: the case of library classification categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(2), pages 235-248, May.

    More about this item

    Keywords

    Education; Other Macroeconomic Variables; Research Methods;
    All these keywords.

    JEL classification:

    • H83 - Public Economics - - Miscellaneous Issues - - - Public Administration
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rza:wpaper:300. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Maggi Sigg (email available below). General contact details of provider: https://edirc.repec.org/data/ersacza.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.