IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_2797.html
   My bibliography  Save this paper

Research Governance in Academia: Are there Alternatives to Academic Rankings?

Author

Listed:
  • Margit Osterloh
  • Bruno S. Frey

Abstract

Peer reviews and rankings today are the backbone of research governance, but recently came under scrutiny. They take explicitly or implicitly agency theory as a theoretical basis. The emerging psychological economics opens a new perspective. As scholarly research is a mainly curiosity driven endeavor, we include intrinsic motivation and supportive feedback by the peers as important determinants of scholarly behavior. We discuss whether a stronger emphasis on selection and socialization offers an alternative to the present regime of academic rankings.

Suggested Citation

  • Margit Osterloh & Bruno S. Frey, 2009. "Research Governance in Academia: Are there Alternatives to Academic Rankings?," CESifo Working Paper Series 2797, CESifo.
    • Handle: RePEc:ces:ceswps:_2797
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp2797.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Etzkowitz, Henry & Leydesdorff, Loet, 2000. "The dynamics of innovation: from National Systems and "Mode 2" to a Triple Helix of university-industry-government relations," Research Policy, Elsevier, vol. 29(2), pages 109-123, February.
    2. Bruno S. Frey & Susanne Neckermann, 2008. "Awards: A view from psychological economics," IEW - Working Papers 357, Institute for Empirical Research in Economics - University of Zurich.
    3. Fehr, Ernst & Falk, Armin, 2002. "Psychological foundations of incentives," European Economic Review, Elsevier, vol. 46(4-5), pages 687-724, May.
    4. Viner, Neil & Powell, Philip & Green, Rod, 2004. "Institutionalized biases in the award of research grants: a preliminary analysis revisiting the principle of accumulative advantage," Research Policy, Elsevier, vol. 33(3), pages 443-454, April.
    5. Giovanni Dosi & Luigi Marengo & Corrado Pasquali, 2010. "How Much Should Society Fuel the Greed of Innovators? On the Relations between Appropriability, Opportunities and Rates of Innovation," Chapters, in: Riccardo Viale & Henry Etzkowitz (ed.), The Capitalization of Knowledge, chapter 4, Edward Elgar Publishing.
    6. Frey, Bruno S, 1992. "Tertium Datur: Pricing, Regulating and Intrinsic Motivation," Kyklos, Wiley Blackwell, vol. 45(2), pages 161-184.
    7. Bruno S. Frey & Alois Stutzer, 2002. "What Can Economists Learn from Happiness Research?," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 402-435, June.
    8. Uri Gneezy & Aldo Rustichini, 2000. "Pay Enough or Don't Pay at All," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 791-810.
    9. Bruno S. Frey, 1992. "Tertium Datur: Pricing, Regulating and Intrinsic Motivation," Kyklos, Wiley Blackwell, vol. 45(2), pages 161-184, May.
    10. Sönke Albers, 2009. "Misleading Rankings of Research in Business," German Economic Review, Verein für Socialpolitik, vol. 10(3), pages 352-363, August.
    11. Simon Burgess & Marisa Ratto, 2003. "The Role of Incentives in the Public Sector: Issues and Evidence," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 19(2), pages 285-300, Summer.
    12. Frey, Bruno S & Stutzer, Alois, 2000. "Happiness, Economy and Institutions," Economic Journal, Royal Economic Society, vol. 110(466), pages 918-938, October.
    13. David N. Laband & Robert D. Tollison, 2003. "Dry Holes in Economic Research," Kyklos, Wiley Blackwell, vol. 56(2), pages 161-173, May.
    14. JS Armstrong, 2004. "Peer Review for Journals: Evidence on Quality Control, Fairness, and Innovation," General Economics and Teaching 0412027, University Library of Munich, Germany.
    15. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    16. Matthias Benz & Bruno S. Frey, "undated". "Corporate Governance: What can we Learn from Public Governance?," IEW - Working Papers 166, Institute for Empirical Research in Economics - University of Zurich.
    17. Ernst Fehr & Klaus M. Schmidt, 2004. "Fairness and Incentives in a Multi‐task Principal–Agent Model," Scandinavian Journal of Economics, Wiley Blackwell, vol. 106(3), pages 453-474, October.
    18. Edward P. Lazear & Kathryn L. Shaw, 2007. "Personnel Economics: The Economist's View of Human Resources," Journal of Economic Perspectives, American Economic Association, vol. 21(4), pages 91-114, Fall.
    19. Edward P. Swanson, 2004. "Publishing in the Majors: A Comparison of Accounting, Finance, Management, and Marketing," Contemporary Accounting Research, John Wiley & Sons, vol. 21(1), pages 223-255, March.
    20. Robert Gibbons, 1998. "Incentives in Organizations," Journal of Economic Perspectives, American Economic Association, vol. 12(4), pages 115-132, Fall.
    21. Margit Osterloh & Bruno S. Frey, 2000. "Motivation, Knowledge Transfer, and Organizational Forms," Organization Science, INFORMS, vol. 11(5), pages 538-550, October.
    22. Simon, Herbert A., 1985. "Human Nature in Politics: The Dialogue of Psychology with Political Science," American Political Science Review, Cambridge University Press, vol. 79(2), pages 293-304, June.
    23. Claire Donovan, 2007. "Introduction: Future pathways for science policy and research assessment: Metrics vs peer review, quality vs impact," Science and Public Policy, Oxford University Press, vol. 34(8), pages 538-542, October.
    24. Frederic S. Lee, 2007. "The Research Assessment Exercise, the state and the dominance of mainstream economics in British universities," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 31(2), pages 309-325, March.
    25. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    26. Scott Stern, 2004. "Do Scientists Pay to Be Scientists?," Management Science, INFORMS, vol. 50(6), pages 835-853, June.
    27. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    28. Luigino Bruni & Robert Sugden, 2007. "The road not taken: how psychology was removed from economics, and how it might be brought back," Economic Journal, Royal Economic Society, vol. 117(516), pages 146-173, January.
    29. Bruno S. Frey & Reto Jegen, 2001. "Motivation Crowding Theory," Journal of Economic Surveys, Wiley Blackwell, vol. 15(5), pages 589-611, December.
    30. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Caprasecca, Alessandro, 2009. "Allocative efficiency in public research funding: Can bibliometrics help?," Research Policy, Elsevier, vol. 38(1), pages 206-215, February.
    31. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    32. Sönke Albers, 2009. "Misleading Rankings of Research in Business," German Economic Review, Verein für Socialpolitik, vol. 10(3), pages 352-363, August.
    33. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    34. William H. Starbuck, 2005. "How Much Better Are the Most-Prestigious Journals? The Statistics of Academic Publication," Organization Science, INFORMS, vol. 16(2), pages 180-200, April.
    35. Sendil K. Ethiraj & Daniel Levinthal, 2009. "Hoping for A to Z While Rewarding Only A: Complex Organizations and Multiple Goals," Organization Science, INFORMS, vol. 20(1), pages 4-21, February.
    36. Bruno S. Frey & Matthias Benz, 2004. "From Imperialism to Inspiration: A Survey of Economics and Psychology," Chapters, in: John B. Davis & Alain Marciano & Jochen Runde (ed.), The Elgar Companion To Economics and Philosophy, chapter 4, Edward Elgar Publishing.
    37. Stephan, Paula E., 2010. "The Economics of Science," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 217-273, Elsevier.
    38. Bruce Kogut & Udo Zander, 1996. "What Firms Do? Coordination, Identity, and Learning," Organization Science, INFORMS, vol. 7(5), pages 502-518, October.
    39. Michelle Gittelman & Bruce Kogut, 2003. "Does Good Science Lead to Valuable Knowledge? Biotechnology Firms and the Evolutionary Logic of Citation Patterns," Management Science, INFORMS, vol. 49(4), pages 366-382, April.
    40. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, Institute of Labor Economics (IZA).
    41. Michael C. Jensen & Kevin J. Murphy, 2010. "CEO Incentives—It's Not How Much You Pay, But How," Journal of Applied Corporate Finance, Morgan Stanley, vol. 22(1), pages 64-76, January.
    42. Henk F Moed, 2007. "The future of research evaluation rests with an intelligent combination of advanced metrics and transparent peer review," Science and Public Policy, Oxford University Press, vol. 34(8), pages 575-583, October.
    43. Michael Kosfeld & Armin Falk, 2006. "The Hidden Costs of Control," American Economic Review, American Economic Association, vol. 96(5), pages 1611-1630, December.
    44. Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    45. Matthew Rabin, 1998. "Psychology and Economics," Journal of Economic Literature, American Economic Association, vol. 36(1), pages 11-46, March.
    46. Randall G. Holcombe, 2004. "The National Research Council Ranking of Research Universities: Its Impact on Research in Economics," Econ Journal Watch, Econ Journal Watch, vol. 1(3), pages 498-514, December.
    47. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    48. Kathleen M. Eisenhardt, 1985. "Control: Organizational and Economic Approaches," Management Science, INFORMS, vol. 31(2), pages 134-149, February.
    49. Rakesh Khurana, 2007. "Introduction to From Higher Aims to Hired Hands The Social Transformation of American Business Schools and the Unfulfilled Promise of Management as a Profession," Introductory Chapters, in: From Higher Aims to Hired Hands The Social Transformation of American Business Schools and the Unfulfilled Promise of Management as a Profession, Princeton University Press.
    50. Joshua S. Gans & George B. Shepherd, 1994. "How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 165-179, Winter.
    51. Simon Burgess & Marisa Ratto, 2003. "The Role of Incentives in the Public Sector: Issues and Evidence," The Centre for Market and Public Organisation 03/071, The Centre for Market and Public Organisation, University of Bristol, UK.
    52. Richard R. Nelson, 1959. "The Simple Economics of Basic Scientific Research," Journal of Political Economy, University of Chicago Press, vol. 67, pages 297-297.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gebhard Kirchgässner, 2011. "Kaderschmieden der Wirtschaft und/oder Universitäten? Der Auftrag der Wirtschaftsuniversitäten und –fakultäten im 21. Jahrhundert," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(3), pages 317-337, August.
    2. Marc Deschamps & Julien Pénin, 2014. "La construction d’une sanction. Le cas des pénalités de retard dans les centres de loisirs de la commune d’Asnières-sur-Seine," Working Papers of BETA 2014-20, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    3. Julien Pénin, 2012. "Motivation crowding-out: Is there a risk for science?," Working Papers of BETA 2012-13, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    4. Gebhard Kirchgässner, 2011. "Kaderschmieden der Wirtschaft und/oder Universitäten? Der Auftrag der Wirtschaftsuniversitäten und -fakultäten im 21. Jahrhundert," CREMA Working Paper Series 2011-05, Center for Research in Economics, Management and the Arts (CREMA).
    5. Bouyssou, D. & Marchant, T., 2010. "Consistent bibliometric rankings of authors and of journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 365-378.
    6. Jenny M. Lewis, 2014. "Research productivity and research system attitudes," Public Money & Management, Taylor & Francis Journals, vol. 34(6), pages 417-424, November.
    7. Benno Torgler & Marco Piatti, 2011. "A Century of American Economic Review," Working Papers 2011.27, Fondazione Eni Enrico Mattei.
    8. Torgler, Benno & Piatti, Marco, 2011. "A Century of American Economic Review," Berkeley Olin Program in Law & Economics, Working Paper Series qt6h59v4m6, Berkeley Olin Program in Law & Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Margit Osterloh & Bruno S. Frey, 2010. "Academic rankings and research governance," IEW - Working Papers 482, Institute for Empirical Research in Economics - University of Zurich.
    2. Margit Osterloh & Bruno S. Frey, 2015. "Ranking Games," Evaluation Review, , vol. 39(1), pages 102-129, February.
    3. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    4. Pierre Koning & J. Vyrastekova & S. Onderstal, 2006. "Team incentives in public organisations; an experimental study," CPB Discussion Paper 60, CPB Netherlands Bureau for Economic Policy Analysis.
    5. Kirsten Bregn, 2013. "Detrimental Effects of Performance-Related Pay in the Public Sector? On the Need for a Broader Theoretical Perspective," Public Organization Review, Springer, vol. 13(1), pages 21-35, March.
    6. Konstantinos Pouliakas, 2010. "Pay Enough, Don't Pay Too Much or Don't Pay at All? The Impact of Bonus Intensity on Job Satisfaction," Kyklos, Wiley Blackwell, vol. 63(4), pages 597-626, November.
    7. Bruno S. Frey & Margit Osterloh, "undated". "Yes, Managers Should be Paid Like Bureaucrats," IEW - Working Papers 187, Institute for Empirical Research in Economics - University of Zurich.
    8. Emil Inauen & Margit Osterloh & Bruno Frey & Fabian Homberg, 2015. "How a multiple orientation of control reduces governance failures: a focus on monastic auditing," Journal of Management & Governance, Springer;Accademia Italiana di Economia Aziendale (AIDEA), vol. 19(4), pages 763-796, November.
    9. McCausland, David & Pouliakas, Konstantinos & Theodossiou, Ioannis, 2005. "Some are Punished and Some are Rewarded: A Study of the Impact of Performance Pay on Job Satisfaction," MPRA Paper 14243, University Library of Munich, Germany.
    10. Emil Inauen & Katja Rost & Margit Osterloh & Bruno S. Frey, 2010. "Back to the Future –A Monastic Perspective on Corporate Governance," management revue - Socio-Economic Studies, Nomos Verlagsgesellschaft mbH & Co. KG, vol. 21(1), pages 38-59.
    11. Charles Ayoubi & Boris Thurm, 2023. "Knowledge diffusion and morality: Why do we freely share valuable information with Strangers?," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 32(1), pages 75-99, January.
    12. Paul H. Jensen & Robin E. Stonecash, 2004. "The Efficiency of Public Sector Outsourcing Contracts: A Literature Review," Melbourne Institute Working Paper Series wp2004n29, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    13. Masella, Paolo & Meier, Stephan & Zahn, Philipp, 2014. "Incentives and group identity," Games and Economic Behavior, Elsevier, vol. 86(C), pages 12-25.
    14. Agnès Festré & Pierre Garrouste, 2015. "Theory And Evidence In Psychology And Economics About Motivation Crowding Out: A Possible Convergence?," Journal of Economic Surveys, Wiley Blackwell, vol. 29(2), pages 339-356, April.
    15. Bruno Frey, 2017. "Policy consequences of pay-for-performance and crowding-out," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 1(1), pages 55-59, February.
    16. Jana Vyrastekova & Sander Onderstal & Pierre Koning, 2012. "Self-selection and the power of incentive schemes: an experimental study," Applied Economics, Taylor & Francis Journals, vol. 44(32), pages 4211-4219, November.
    17. Lacetera, Nicola & Zirulia, Lorenzo, 2012. "Individual preferences, organization, and competition in a model of R&D incentive provision," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 550-570.
    18. Simeth, Markus & Raffo, Julio D., 2013. "What makes companies pursue an Open Science strategy?," Research Policy, Elsevier, vol. 42(9), pages 1531-1543.
    19. Mudambi, Ram & Swift, Tim, 2009. "Professional guilds, tension and knowledge management," Research Policy, Elsevier, vol. 38(5), pages 736-745, June.
    20. Simeth, Markus & Lhuillery, Stephane, 2015. "How do firms develop capabilities for scientific disclosure?," Research Policy, Elsevier, vol. 44(7), pages 1283-1295.

    More about this item

    Keywords

    peer reviews; rankings; research governance; agency theory; psychological economics; new public management; economics of science; control theory;
    All these keywords.

    JEL classification:

    • O00 - Economic Development, Innovation, Technological Change, and Growth - - General - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_2797. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.