IDEAS home Printed from https://ideas.repec.org/a/bla/buecrs/v74y2022i2p386-404.html
   My bibliography  Save this article

Measuring research excellence amongst economics lecturers in the UK

Author

Listed:
  • Richard McManus
  • Karen Mumford
  • Cristina Sechel

Abstract

Using a rich new data source, we explore the selection of economics lecturers into the last UK Research Excellence Framework (REF) exercise. Only some one‐in‐two (54%) of these lecturers were submitted to REF2014; 57% of men and 46% of women. The decision making of institutions is found to be well approximated by a simplified selection approach; focusing on working papers and higher quality journal publications. Our results also reveal sizeable conditional differences in the probability of selection, especially so in departments with higher research rankings. More than half of the variance in selection probability remains unexplained, revealing considerable idiosyncrasies in the management of submissions and uncertainty across the discipline in this research assessment process.

Suggested Citation

  • Richard McManus & Karen Mumford & Cristina Sechel, 2022. "Measuring research excellence amongst economics lecturers in the UK," Bulletin of Economic Research, Wiley Blackwell, vol. 74(2), pages 386-404, April.
    • Handle: RePEc:bla:buecrs:v:74:y:2022:i:2:p:386-404
    DOI: 10.1111/boer.12299
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/boer.12299
    Download Restriction: no
    File URL: https://libkey.io/10.1111/boer.12299?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Smith, Simon & Ward, Vicky & House, Allan, 2011. "‘Impact’ in the proposals for the UK's Research Excellence Framework: Shifting the boundaries of academic autonomy," Research Policy, Elsevier, vol. 40(10), pages 1369-1379.
    2. Arne Risa Hole, 2017. "Ranking Economics Journals Using Data From a National Research Evaluation Exercise," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(5), pages 621-636, October.
    3. Ben R Martin, 2011. "The Research Excellence Framework and the ‘impact agenda’: are we creating a Frankenstein monster?," Research Evaluation, Oxford University Press, vol. 20(3), pages 247-254, September.
    4. M. Mitka & K. Mumford & C. Sechel, 2015. "The 10th Royal Economic Society Women’s Committee Survey: The Gender Balance of Academic Economics in the UK," Discussion Papers 15/10, Department of Economics, University of York.
    5. Hengel, E., 2017. "Publishing while Female. Are women held to higher standards? Evidence from peer review," Cambridge Working Papers in Economics 1753, Faculty of Economics, University of Cambridge.
    6. Friederike Mengel & Jan Sauermann & Ulf Zölitz, 2019. "Gender Bias in Teaching Evaluations," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 535-566.
    7. Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2015. "Bibliometric evaluation vs. informed peer review: Evidence from Italy," Research Policy, Elsevier, vol. 44(2), pages 451-466.
    8. Brown, Alasdair & Yang, Fuyu, 2015. "Does society underestimate women? Evidence from the performance of female jockeys in horse racing," Journal of Economic Behavior & Organization, Elsevier, vol. 111(C), pages 106-118.
    9. Pierre Régibeau & Katharine E. Rockett, 2016. "Research assessment and recognized excellence: simple bibliometrics for more efficient academic research evaluations," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 31(88), pages 611-652.
    10. Geuna, Aldo & Piolatto, Matteo, 2016. "Research assessment in the UK and Italy: Costly and difficult, but probably worth it (at least for a while)," Research Policy, Elsevier, vol. 45(1), pages 260-271.
    11. Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-132, March.
    12. Amanda Bayer & Cecilia Elena Rouse, 2016. "Diversity in the Economics Profession: A New Attack on an Old Problem," Journal of Economic Perspectives, American Economic Association, vol. 30(4), pages 221-242, Fall.
    13. Sofronis Clerides & Panos Pashardes & Alexandros Polycarpou, 2011. "Peer Review vs Metric‐based Assessment: Testing for Bias in the RAE Ratings of UK Economics Departments," Economica, London School of Economics and Political Science, vol. 78(311), pages 565-583, July.
    14. Mumford, Karen & Sechel, Cristina, 2019. "Job satisfaction amongst academic economists in the UK," Economics Letters, Elsevier, vol. 182(C), pages 55-58.
    15. Boring, Anne, 2017. "Gender biases in student evaluations of teaching," Journal of Public Economics, Elsevier, vol. 145(C), pages 27-41.
    16. Karen Mumford & Cristina Sechel, 2020. "Pay and Job Rank among Academic Economists in the UK: Is Gender Relevant?," British Journal of Industrial Relations, London School of Economics, vol. 58(1), pages 82-113, March.
    17. Daniel S. Hamermesh, 2015. "Age, Cohort and Co-Authorship," NBER Working Papers 20938, National Bureau of Economic Research, Inc.
    18. Shelly Lundberg & Jenna Stearns, 2019. "Women in Economics: Stalled Progress," Journal of Economic Perspectives, American Economic Association, vol. 33(1), pages 3-22, Winter.
    19. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    20. Heather Sarsons, 2017. "Recognition for Group Work: Gender Differences in Academia," American Economic Review, American Economic Association, vol. 107(5), pages 141-145, May.
    21. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard McManus & Karen Mumford & Cristina Sechel, 2017. "The Selection of Economics Lecturers into the 2014 UK Research Excellence Framework Exercise: Outputs and Gender," Discussion Papers 17/16, Department of Economics, University of York.
    2. Laura Hospido & Carlos Sanz, 2021. "Gender Gaps in the Evaluation of Research: Evidence from Submissions to Economics Conferences," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 590-618, June.
    3. Valentina A. Paredes & M. Daniele Paserman & Francisco Pino, 2020. "Does Economics Make You Sexist?," NBER Working Papers 27070, National Bureau of Economic Research, Inc.
    4. Lena Janys, 2021. "Testing the Presence of Implicit Hiring Quotas with Application to German Universities," Papers 2109.14343, arXiv.org, revised Nov 2021.
    5. Laura Hospido & Carlos Sanz, 2019. "Gender gaps in the evaluation of research: evidence from submissions to economics conferences (Updated March 2020)," Working Papers 1918, Banco de España, revised Mar 2020.
    6. Iriberri, Nagore & Funk, Patricia & Savio, Giulia, 2022. "Does Scarcity of Female Instructors Create Demand for Diversity among Students? Evidence from an M-Turk Experiment," CEPR Discussion Papers 14190, C.E.P.R. Discussion Papers.
    7. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    8. Valerie K. Bostwick & Bruce A. Weinberg, 2022. "Nevertheless She Persisted? Gender Peer Effects in Doctoral STEM Programs," Journal of Labor Economics, University of Chicago Press, vol. 40(2), pages 397-436.
    9. Battistin, Erich & Ovidi, Marco, 2017. "Rising Stars," IZA Discussion Papers 11198, Institute of Labor Economics (IZA).
    10. Martina Viarengo & Ugo Panizza & Enrico Nano, 2021. "A Generation of Italian Economists," CID Working Papers 400, Center for International Development at Harvard University.
    11. Priyanka Chakraborty & Danila Serra, 2021. "Gender and leadership in organizations: Promotions, demotions and angry workers," Working Papers 20210104-001, Texas A&M University, Department of Economics.
    12. Arceo-Gomez, Eva O. & Campos-Vazquez, Raymundo M., 2019. "Gender stereotypes: The case of MisProfesores.com in Mexico," Economics of Education Review, Elsevier, vol. 72(C), pages 55-65.
    13. Smith, Sarah & Sevilla, Almudena, 2020. "Women in economics: A UK Perspective," CEPR Discussion Papers 15034, C.E.P.R. Discussion Papers.
    14. Chinetti Simone, 2023. "The gender gap in academic productivity during the pandemic: Is childcare responsible?," IZA Journal of Labor Economics, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 12(1), pages 1-35, January.
    15. Emily C. Marshall & Brian O’Roark, 2023. "Journal Authorship by Gender: A Comparison of Economic Education, General Interest, and Fields From 2009 to 2019," The American Economist, Sage Publications, vol. 68(1), pages 100-109, March.
    16. Fabiana Rocha, Paula Pereda, & Liz Matsunaga & Maria Dolores Montoya Diaz & Renata Narita, & Bruna Borges, 2021. "Gender differences in the academic career of economics in Brazil," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 815-892, October.
    17. Lena Janys, 2022. "Testing the Presence of Implicit Hiring Quotas with Application to German Universities," ECONtribute Discussion Papers Series 165, University of Bonn and University of Cologne, Germany.
    18. Rebecca Cassells & Leonora Risse & Danielle Wood & Duygu Yengin, 2023. "Lifting Diversity and Inclusion in Economics: How the Australian Women in Economics Network Put the Evidence into Action," Economic Papers, The Economic Society of Australia, vol. 42(1), pages 1-29, March.
    19. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).
    20. Verónica Amarante & Marisa Bucheli & María Inés Moraes & Tatiana Pérez, 2021. "Women in Research in Economics in Uruguay," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 763-790, October.

    More about this item

    JEL classification:

    • J00 - Labor and Demographic Economics - - General - - - General
    • J44 - Labor and Demographic Economics - - Particular Labor Markets - - - Professional Labor Markets and Occupations
    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:buecrs:v:74:y:2022:i:2:p:386-404. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0307-3378 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.