IDEAS home Printed from https://ideas.repec.org/a/nos/voprob/2019i1p44-86.html
   My bibliography  Save this article

Publication Metrics as a Tool for Measuring Research Productivity and Their Relation to Motivation

Author

Abstract

Alexander Kalgin - PhD, Associate Professor, School of Public Administration, Faculty of Social Sciences, National Research University Higher School of Economics. Address: 20 Myasnitskaya Str., 101000 Moscow, Russian Federation. E-mail: akalgin@hse.ruOlga Kalgina - Junior Researcher, Laboratory for Political Studies, Faculty of Social Sciences, National Research University Higher School of Economics. Address: 3 Krivokolenny Lane, 101000 Moscow, Russian Federation. E-mail: omiakinkova@hse.ruAnna Lebedeva - Candidate of Sciences in Psychology, Senior Researcher, International Laboratory of Positive Psychology of Personality and Motivation, National Research University Higher School of Economics. Address: Bld. 2, 4 Slavyanskaya Sq., 109074 Moscow, Russian Federation. E-mail: aalebedeva@hse.ruThe article presents an analytical review of literature on publication metrics as a tool of performance management in academia. Issues of quantitative research assessment are investigated in the light of modern views of motivation, in particular through the lens of self-determination theory. The article provides an insight into empirical studies on the effects of intrinsic and extrinsic motivation on publication productivity, research quality and subjective wellbeing. Accumulated international experience in performance management is used as a basis for developing recommendations on how to improve academic governance.

Suggested Citation

  • Alexander Kalgin & Olga Kalgina & Anna Lebedeva, 2019. "Publication Metrics as a Tool for Measuring Research Productivity and Their Relation to Motivation," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 44-86.
    • Handle: RePEc:nos:voprob:2019:i:1:p:44-86
    as

    Download full text from publisher

    File URL: https://vo.hse.ru/data/2019/04/09/1176078823/02%20Kalgin.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Frey, Bruno S & Oberholzer-Gee, Felix, 1997. "The Cost of Price Incentives: An Empirical Analysis of Motivation Crowding-Out," American Economic Review, American Economic Association, vol. 87(4), pages 746-755, September.
    2. Jean Tirole & Roland Bénabou, 2006. "Incentives and Prosocial Behavior," American Economic Review, American Economic Association, vol. 96(5), pages 1652-1678, December.
    3. Uri Gneezy & Stephan Meier & Pedro Rey-Biel, 2011. "When and Why Incentives (Don't) Work to Modify Behavior," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 191-210, Fall.
    4. Romaniuc, Rustam, 2017. "Intrinsic motivation in economics: A history," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 67(C), pages 56-64.
    5. Alexander Kalgin, 2012. "Performance management at the regional level: control and efficiency," Public administration issues, Higher School of Economics, issue 3, pages 35-60.
    6. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    7. Alexander Kalgin, 2012. "Performance management at the regional level: control and efficiency," Public Administration, National Research University Higher School of Economics, vol. 6(3), pages 35-60.
    8. James, Harvey Jr., 2005. "Why did you do that? An economic examination of the effect of extrinsic compensation on intrinsic motivation and performance," Journal of Economic Psychology, Elsevier, vol. 26(4), pages 549-566, August.
    9. Henk J. ter Bogt & Robert W. Scapens, 2012. "Performance Management in Universities: Effects of the Transition to More Quantitative Measurement Systems," European Accounting Review, Taylor & Francis Journals, vol. 21(3), pages 451-497, February.
    10. Peter A. Lawrence, 2003. "The politics of publication," Nature, Nature, vol. 422(6929), pages 259-261, March.
    11. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    12. Falk, Armin & Gachter, Simon & Kovacs, Judit, 1999. "Intrinsic motivation and extrinsic incentives in a repeated game with incomplete contracts," Journal of Economic Psychology, Elsevier, vol. 20(3), pages 251-284, June.
    13. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    14. Andrey Lovakov, 2015. "Commitment of Russian University Teachers To University and Profession," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 2, pages 109-128.
    15. Isak Froumin & Jamil Salmi, 2007. "Russian Colleges in the Competition of leading World Universities," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 5-45.
    16. Jim Barry & John Chandler & Heather Clark, 2001. "Between the Ivory Tower and the Academic Assembly Line," Journal of Management Studies, Wiley Blackwell, vol. 38(1), pages 88-101, January.
    17. Roland Bénabou & Jean Tirole, 2003. "Intrinsic and Extrinsic Motivation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(3), pages 489-520.
    18. Daniele Fanelli & Rodrigo Costas & Vincent Larivière, 2015. "Misconduct Policies, Academic Culture and Career Stage, Not Gender or Pressures to Publish, Affect Scientific Integrity," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-18, June.
    19. Kunz, Alexis H. & Pfaff, Dieter, 2002. "Agency theory, performance evaluation, and the hypothetical construct of intrinsic motivation," Accounting, Organizations and Society, Elsevier, vol. 27(3), pages 275-295, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Malin Lohela-Karlsson & Irene Jensen & Christina Björklund, 2022. "Do Attitudes towards Work or Work Motivation Affect Productivity Loss among Academic Employees?," IJERPH, MDPI, vol. 19(2), pages 1-14, January.
    2. Dmitriy Sergeevich Tereshchenko, 2020. "Empirical Analysis of Publication Activity: Is There à Convergence of Russian Regions?," Spatial Economics=Prostranstvennaya Ekonomika, Economic Research Institute, Far Eastern Branch, Russian Academy of Sciences (Khabarovsk, Russia), issue 3, pages 109-138.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Калгин А. С. & Калгина О. В. & Лебедева А. А., 2019. "Оценка Публикационной Активности Как Способ Измерения Результативности Труда Ученых И Ее Связь С Мотивацией," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 44-86.
    2. Christine Exley, 2013. "Incentives for Prosocial Behavior: The Role of Reputations," Discussion Papers 12-022, Stanford Institute for Economic Policy Research.
    3. Elliott Ash & W. Bentley MacLeod, 2015. "Intrinsic Motivation in Public Service: Theory and Evidence from State Supreme Courts," Journal of Law and Economics, University of Chicago Press, vol. 58(4).
    4. Lanz, Bruno & Wurlod, Jules-Daniel & Panzone, Luca & Swanson, Timothy, 2018. "The behavioral effect of Pigovian regulation: Evidence from a field experiment," Journal of Environmental Economics and Management, Elsevier, vol. 87(C), pages 190-205.
    5. Agnès Festré & Pierre Garrouste, 2015. "Theory And Evidence In Psychology And Economics About Motivation Crowding Out: A Possible Convergence?," Journal of Economic Surveys, Wiley Blackwell, vol. 29(2), pages 339-356, April.
    6. Timothy Gubler & Ian Larkin & Lamar Pierce, 2016. "Motivational Spillovers from Awards: Crowding Out in a Multitasking Environment," Organization Science, INFORMS, vol. 27(2), pages 286-303, April.
    7. Kirsten Bregn, 2013. "Detrimental Effects of Performance-Related Pay in the Public Sector? On the Need for a Broader Theoretical Perspective," Public Organization Review, Springer, vol. 13(1), pages 21-35, March.
    8. Bruno Frey, 2017. "Policy consequences of pay-for-performance and crowding-out," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 1(1), pages 55-59, February.
    9. Chen, Josie I. & Foster, Andrew & Putterman, Louis, 2019. "Identity, trust and altruism: An experiment on preferences and microfinance lending," European Economic Review, Elsevier, vol. 120(C).
    10. David Huffman & Michael Bognanno, 2018. "High-Powered Performance Pay and Crowding Out of Nonmonetary Motives," Management Science, INFORMS, vol. 64(10), pages 4669-4680, October.
    11. Antoine Beretti & Charles Figuières & Gilles Grolleau, 2019. "How to turn crowding-out into crowding-in? An innovative instrument and some law-related examples," European Journal of Law and Economics, Springer, vol. 48(3), pages 417-438, December.
    12. Luigino Bruni & Vittorio Pelligra & Tommaso Reggiani & Matteo Rizzolli, 2020. "The Pied Piper: Prizes, Incentives, and Motivation Crowding-in," Journal of Business Ethics, Springer, vol. 166(3), pages 643-658, October.
    13. Jean-Pierre Dubé & Xueming Luo & Zheng Fang, 2017. "Self-Signaling and Prosocial Behavior: A Cause Marketing Experiment," Marketing Science, INFORMS, vol. 36(2), pages 140-156, March.
    14. Boyer, Pierre C. & Dwenger, Nadja & Rincke, Johannes, 2016. "Do norms on contribution behavior affect intrinsic motivation? Field-experimental evidence from Germany," Journal of Public Economics, Elsevier, vol. 144(C), pages 140-153.
    15. Zack Dorner & Emily Lancsar, 2017. "Intrinsic motivation, health outcomes and the crowding out effect of temporary extrinsic incentives: A lab-in-the-field experiment," Monash Economics Working Papers 18-17, Monash University, Department of Economics.
    16. Ismaël Rafaï & Mira Toumi, 2017. "Pay Attention or Be Paid for Attention? Impact of Incentives on Allocation of Attention," GREDEG Working Papers 2017-11, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    17. Samuel Bowles & Sandra Polania-Reyes, 2011. "Economic incentives and social preferences: substitutes or complements?," Department of Economics University of Siena 617, Department of Economics, University of Siena.
    18. Kajackaite, Agne & Werner, Peter, 2015. "The incentive effects of performance requirements – A real effort experiment," Journal of Economic Psychology, Elsevier, vol. 49(C), pages 84-94.
    19. Kvaløy, Ola & Nieken, Petra & Schöttner, Anja, 2015. "Hidden benefits of reward: A field experiment on motivation and monetary incentives," European Economic Review, Elsevier, vol. 76(C), pages 188-199.
    20. Christine L. Exley & Stephen J. Terry, 2019. "Wage Elasticities in Working and Volunteering: The Role of Reference Points in a Laboratory Study," Management Science, INFORMS, vol. 65(1), pages 413-425, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nos:voprob:2019:i:1:p:44-86. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marta Morozova (email available below). General contact details of provider: http://vo.hse.ru/en/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.