The Objectivity of National Research Foundation Peer Review Based Ratings in South Africa
AbstractThis paper examines the strength of association between the outcomes of National Research Foundation (NRF) peer review based rating mechanisms, and a range of objective measures of performance of researchers. The analysis is conducted on 1932 scholars that have received an NRF rating or an NRF research chair. We find that scholars with higher NRF ratings record higher performance on average against the objective measures of absolute output and the impact of their research, than scholars at lower ratings. In addition, the higher the performance of scholars against all objective measures of absolute output and impact, increases the probability of higher rating. However, we also find that the probability of achieving a B-rating remains higher than that of acheiving an A-rating even at the very highest levels of recorded performance for South African scholars. In addition, scholars who have received the highest ratings record objective levels of research output and impact of their research that are no different from the minimum levels of objective performance at much lower NRF ratings. Moreover, we find strong cross-disciplinary differences in terms of the impact that objective levels of performance have on the probability of achieving different NRF ratings. Finally, we report evidence that NRF peer review is less likely to reward multiauthored research output than single-authored output.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Economic Research Southern Africa in its series Working Papers with number 300.
Length: 41 pages
Date of creation: 2012
Date of revision:
Contact details of provider:
Postal: Newlands on Main, F0301 3rd Floor Mariendahl House, cnr Campground and Main Rds, Claremont, 7700 Cape Town
Phone: 021 671-3980
Fax: +27 21 671 3912
Web page: http://www.econrsa.org/
More information through EDIRC
Subjective research ratings; objective research ratings; research funding;
Find related papers by JEL classification:
- H83 - Public Economics - - Miscellaneous Issues - - - Public Administration
- I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
- I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
This paper has been announced in the following NEP Reports:
- NEP-AFR-2012-08-23 (Africa)
- NEP-ALL-2012-08-23 (All new papers)
- NEP-SOG-2012-08-23 (Sociology of Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Adler, Niclas & Elmquist, Maria & Norrgren, Flemming, 2009. "The challenge of managing boundary-spanning research activities: Experiences from the Swedish context," Research Policy, Elsevier, vol. 38(7), pages 1136-1149, September.
- Hare, Paul G & Wyatt, Geoffrey, 1992. "Economics of Academic Research and Its Implications for Higher Education," Oxford Review of Economic Policy, Oxford University Press, vol. 8(2), pages 48-66, Summer.
- Benner, Mats & Sandstrom, Ulf, 2000. "Institutionalizing the triple helix: research funding and norms in the academic system," Research Policy, Elsevier, vol. 29(2), pages 291-301, February.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Yoemna Mosaval).
If references are entirely missing, you can add them using this form.