IDEAS home Printed from https://ideas.repec.org/p/cra/wpaper/2009-17.html
   My bibliography  Save this paper

Research Governance in Academia: Are there Alternatives to Academic Rankings?

Author

Listed:
  • Margit Osterloh
  • Bruno S. Frey

Abstract

Peer reviews and rankings today are the backbone of research governance, but recently came under scrutiny. They take explicitly or implicitly agency theory as a theoretical basis. The emerging psychological economics opens a new perspective. As scholarly research is a mainly curiosity driven endeavor, we include intrinsic motivation and supportive feedback by the peers as important determinants of scholarly behavior. We discuss whether a stronger emphasis on selection and socialization offers an alternative to the present regime of academic rankings.

Suggested Citation

  • Margit Osterloh & Bruno S. Frey, 2009. "Research Governance in Academia: Are there Alternatives to Academic Rankings?," CREMA Working Paper Series 2009-17, Center for Research in Economics, Management and the Arts (CREMA).
  • Handle: RePEc:cra:wpaper:2009-17
    as

    Download full text from publisher

    File URL: http://www.crema-research.ch/papers/2009-17.pdf
    File Function: Full Text
    Download Restriction: no

    File URL: http://www.crema-research.ch/abstracts/2009-17.htm
    File Function: Abstract
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Etzkowitz, Henry & Leydesdorff, Loet, 2000. "The dynamics of innovation: from National Systems and "Mode 2" to a Triple Helix of university-industry-government relations," Research Policy, Elsevier, vol. 29(2), pages 109-123, February.
    2. Bruno S. Frey & Susanne Neckermann, 2008. "Awards: A view from psychological economics," IEW - Working Papers 357, Institute for Empirical Research in Economics - University of Zurich.
    3. Fehr, Ernst & Falk, Armin, 2002. "Psychological foundations of incentives," European Economic Review, Elsevier, vol. 46(4-5), pages 687-724, May.
    4. Viner, Neil & Powell, Philip & Green, Rod, 2004. "Institutionalized biases in the award of research grants: a preliminary analysis revisiting the principle of accumulative advantage," Research Policy, Elsevier, vol. 33(3), pages 443-454, April.
    5. Giovanni Dosi & Luigi Marengo & Corrado Pasquali, 2010. "How Much Should Society Fuel the Greed of Innovators? On the Relations between Appropriability, Opportunities and Rates of Innovation," Chapters, in: Riccardo Viale & Henry Etzkowitz (ed.), The Capitalization of Knowledge, chapter 4, Edward Elgar Publishing.
    6. Frey, Bruno S, 1992. "Tertium Datur: Pricing, Regulating and Intrinsic Motivation," Kyklos, Wiley Blackwell, vol. 45(2), pages 161-184.
    7. Bruno S. Frey & Alois Stutzer, 2002. "What Can Economists Learn from Happiness Research?," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 402-435, June.
    8. Uri Gneezy & Aldo Rustichini, 2000. "Pay Enough or Don't Pay at All," The Quarterly Journal of Economics, Oxford University Press, vol. 115(3), pages 791-810.
    9. Sönke Albers, 2009. "Misleading Rankings of Research in Business," German Economic Review, Verein für Socialpolitik, vol. 10(3), pages 352-363, August.
    10. Simon Burgess & Marisa Ratto, 2003. "The Role of Incentives in the Public Sector: Issues and Evidence," Oxford Review of Economic Policy, Oxford University Press, vol. 19(2), pages 285-300, Summer.
    11. David N. Laband & Robert D. Tollison, 2003. "Dry Holes in Economic Research," Kyklos, Wiley Blackwell, vol. 56(2), pages 161-173, May.
    12. JS Armstrong, 2004. "Peer Review for Journals: Evidence on Quality Control, Fairness, and Innovation," General Economics and Teaching 0412027, University Library of Munich, Germany.
    13. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    14. Ernst Fehr & Klaus M. Schmidt, 2004. "Fairness and Incentives in a Multi‐task Principal–Agent Model," Scandinavian Journal of Economics, Wiley Blackwell, vol. 106(3), pages 453-474, October.
    15. Edward P. Lazear & Kathryn L. Shaw, 2007. "Personnel Economics: The Economist's View of Human Resources," Journal of Economic Perspectives, American Economic Association, vol. 21(4), pages 91-114, Fall.
    16. Robert Gibbons, 1998. "Incentives in Organizations," Journal of Economic Perspectives, American Economic Association, vol. 12(4), pages 115-132, Fall.
    17. Claire Donovan, 2007. "Introduction: Future pathways for science policy and research assessment: Metrics vs peer review, quality vs impact," Science and Public Policy, Oxford University Press, vol. 34(8), pages 538-542, October.
    18. Simon, Herbert A., 1985. "Human Nature in Politics: The Dialogue of Psychology with Political Science," American Political Science Review, Cambridge University Press, vol. 79(2), pages 293-304, June.
    19. Frederic S. Lee, 2007. "The Research Assessment Exercise, the state and the dominance of mainstream economics in British universities," Cambridge Journal of Economics, Oxford University Press, vol. 31(2), pages 309-325, March.
    20. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    21. Scott Stern, 2004. "Do Scientists Pay to Be Scientists?," Management Science, INFORMS, vol. 50(6), pages 835-853, June.
    22. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    23. Luigino Bruni & Robert Sugden, 2007. "The road not taken: how psychology was removed from economics, and how it might be brought back," Economic Journal, Royal Economic Society, vol. 117(516), pages 146-173, January.
    24. Bruno S. Frey & Reto Jegen, 2001. "Motivation Crowding Theory," Journal of Economic Surveys, Wiley Blackwell, vol. 15(5), pages 589-611, December.
    25. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Caprasecca, Alessandro, 2009. "Allocative efficiency in public research funding: Can bibliometrics help?," Research Policy, Elsevier, vol. 38(1), pages 206-215, February.
    26. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    27. Sönke Albers, 2009. "Misleading Rankings of Research in Business," German Economic Review, Verein für Socialpolitik, vol. 10(3), pages 352-363, August.
    28. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    29. Bruno S. Frey & Matthias Benz, 2004. "From Imperialism to Inspiration: A Survey of Economics and Psychology," Chapters, in: John B. Davis & Alain Marciano & Jochen Runde (ed.), The Elgar Companion To Economics and Philosophy, chapter 4, Edward Elgar Publishing.
    30. Stephan, Paula E., 2010. "The Economics of Science," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 217-273, Elsevier.
    31. Michelle Gittelman & Bruce Kogut, 2003. "Does Good Science Lead to Valuable Knowledge? Biotechnology Firms and the Evolutionary Logic of Citation Patterns," Management Science, INFORMS, vol. 49(4), pages 366-382, April.
    32. Michael C. Jensen & Kevin J. Murphy, 2010. "CEO Incentives—It's Not How Much You Pay, But How," Journal of Applied Corporate Finance, Morgan Stanley, vol. 22(1), pages 64-76, January.
    33. Henk F Moed, 2007. "The future of research evaluation rests with an intelligent combination of advanced metrics and transparent peer review," Science and Public Policy, Oxford University Press, vol. 34(8), pages 575-583, October.
    34. Michael Kosfeld & Armin Falk, 2006. "The Hidden Costs of Control," American Economic Review, American Economic Association, vol. 96(5), pages 1611-1630, December.
    35. Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    36. Matthew Rabin, 1998. "Psychology and Economics," Journal of Economic Literature, American Economic Association, vol. 36(1), pages 11-46, March.
    37. Randall G. Holcombe, 2004. "The National Research Council Ranking of Research Universities: Its Impact on Research in Economics," Econ Journal Watch, Econ Journal Watch, vol. 1(3), pages 498-514, December.
    38. Kathleen M. Eisenhardt, 1985. "Control: Organizational and Economic Approaches," Management Science, INFORMS, vol. 31(2), pages 134-149, February.
    39. Rakesh Khurana, 2007. "Introduction to From Higher Aims to Hired Hands The Social Transformation of American Business Schools and the Unfulfilled Promise of Management as a Profession," Introductory Chapters, in: From Higher Aims to Hired Hands The Social Transformation of American Business Schools and the Unfulfilled Promise of Management as a Profession, Princeton University Press.
    40. Joshua S. Gans & George B. Shepherd, 1994. "How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 165-179, Winter.
    41. Simon Burgess & Marisa Ratto, 2003. "The Role of Incentives in the Public Sector: Issues and Evidence," The Centre for Market and Public Organisation 03/071, The Centre for Market and Public Organisation, University of Bristol, UK.
    42. Richard R. Nelson, 1959. "The Simple Economics of Basic Scientific Research," Journal of Political Economy, University of Chicago Press, vol. 67, pages 297-297.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Torgler, Benno & Piatti, Marco, 2011. "A Century of American Economic Review," Sustainable Development Papers 102501, Fondazione Eni Enrico Mattei (FEEM).
    2. Marc Deschamps & Julien Pénin, 2014. "La construction d’une sanction. Le cas des pénalités de retard dans les centres de loisirs de la commune d’Asnières-sur-Seine," Working Papers of BETA 2014-20, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    3. Gebhard Kirchgässner, 2011. "Kaderschmieden der Wirtschaft und/oder Universitäten? Der Auftrag der Wirtschaftsuniversitäten und –fakultäten im 21. Jahrhundert," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(3), pages 317-337, August.
    4. Gebhard Kirchgässner, 2011. "Kaderschmieden der Wirtschaft und/oder Universitäten? Der Auftrag der Wirtschaftsuniversitäten und -fakultäten im 21. Jahrhundert," CREMA Working Paper Series 2011-05, Center for Research in Economics, Management and the Arts (CREMA).
    5. Bouyssou, D. & Marchant, T., 2010. "Consistent bibliometric rankings of authors and of journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 365-378.
    6. Jenny M. Lewis, 2014. "Research productivity and research system attitudes," Public Money & Management, Taylor & Francis Journals, vol. 34(6), pages 417-424, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Margit Osterloh & Bruno S. Frey, 2010. "Academic rankings and research governance," IEW - Working Papers 482, Institute for Empirical Research in Economics - University of Zurich.
    2. Kirsten Bregn, 2013. "Detrimental Effects of Performance-Related Pay in the Public Sector? On the Need for a Broader Theoretical Perspective," Public Organization Review, Springer, vol. 13(1), pages 21-35, March.
    3. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    4. Pierre Koning & J. Vyrastekova & S. Onderstal, 2006. "Team incentives in public organisations; an experimental study," CPB Discussion Paper 60, CPB Netherlands Bureau for Economic Policy Analysis.
    5. Konstantinos Pouliakas, 2010. "Pay Enough, Don't Pay Too Much or Don't Pay at All? The Impact of Bonus Intensity on Job Satisfaction," Kyklos, Wiley Blackwell, vol. 63(4), pages 597-626, November.
    6. Bruno S. Frey & Margit Osterloh, 2011. "Rankings games," ECON - Working Papers 039, Department of Economics - University of Zurich.
    7. Simeth, Markus & Lhuillery, Stephane, 2015. "How do firms develop capabilities for scientific disclosure?," Research Policy, Elsevier, vol. 44(7), pages 1283-1295.
    8. Agnès Festré & Pierre Garrouste, 2015. "Theory And Evidence In Psychology And Economics About Motivation Crowding Out: A Possible Convergence?," Journal of Economic Surveys, Wiley Blackwell, vol. 29(2), pages 339-356, April.
    9. Squazzoni, Flaminio & Bravo, Giangiacomo & Takács, Károly, 2013. "Does incentive provision increase the quality of peer review? An experimental study," Research Policy, Elsevier, vol. 42(1), pages 287-294.
    10. Simeth, Markus & Raffo, Julio D., 2013. "What makes companies pursue an Open Science strategy?," Research Policy, Elsevier, vol. 42(9), pages 1531-1543.
    11. Jana Vyrastekova & Sander Onderstal & Pierre Koning, 2012. "Self-selection and the power of incentive schemes: an experimental study," Applied Economics, Taylor & Francis Journals, vol. 44(32), pages 4211-4219, November.
    12. Lacetera, Nicola & Zirulia, Lorenzo, 2012. "Individual preferences, organization, and competition in a model of R&D incentive provision," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 550-570.
    13. Anell, Anders, 2019. "Performance management and audit & feedback to support learning and innovation – Theoretical review and implications for Swedish primary care," Papers in Innovation Studies 2019/11, Lund University, CIRCLE - Centre for Innovation Research.
    14. McCausland, David & Pouliakas, Konstantinos & Theodossiou, Ioannis, 2005. "Some are Punished and Some are Rewarded: A Study of the Impact of Performance Pay on Job Satisfaction," MPRA Paper 14243, University Library of Munich, Germany.
    15. Andrei Bremzen & Elena Khokhlova & Anton Suvorov & Jeroen van de Ven, 2015. "Bad News: An Experimental Study on the Informational Effects Of Rewards," The Review of Economics and Statistics, MIT Press, vol. 97(1), pages 55-70, March.
    16. Paul H. Jensen & Robin E. Stonecash, 2004. "The Efficiency of Public Sector Outsourcing Contracts: A Literature Review," Melbourne Institute Working Paper Series wp2004n29, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    17. Gans, Joshua S. & Murray, Fiona E. & Stern, Scott, 2017. "Contracting over the disclosure of scientific knowledge: Intellectual property and academic publication," Research Policy, Elsevier, vol. 46(4), pages 820-835.
    18. Pouliakas, Konstantinos, 2008. "Pay enough, don’t pay too much or don’t pay at all? An empirical study of the non-monotonic impact of incentives on job satisfaction," MPRA Paper 10031, University Library of Munich, Germany.
    19. Brice Corgnet & Brian Gunia & Roberto Hernán González, 2021. "Harnessing the power of social incentives to curb shirking in teams," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 30(1), pages 139-167, February.
    20. Henry Sauermann & Wesley M. Cohen, 2008. "What Makes Them Tick? Employee Motives and Firm Innovation," NBER Working Papers 14443, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    peer reviews; rankings; research governance; agency theory; psychological economics; new public management; economics of science; control theory;
    All these keywords.

    JEL classification:

    • O30 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - General
    • O39 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Other

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cra:wpaper:2009-17. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/cremach.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anna-Lea Werlen The email address of this maintainer does not seem to be valid anymore. Please ask Anna-Lea Werlen to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/cremach.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.