IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v116y2018i3d10.1007_s11192-018-2793-8.html
   My bibliography  Save this article

Researchers’ risk-smoothing publication strategies: Is productivity the enemy of impact?

Author

Listed:
  • Sergey Kolesnikov

    (Arizona State University)

  • Eriko Fukumoto

    (Arizona State University)

  • Barry Bozeman

    (Arizona State University)

Abstract

In the quest for balance between research productivity and impact, researchers in science and engineering are often encouraged to adopt a play-it-safe research and publication strategy that allows them to maintain high publication productivity and accelerate their career advancement but may reduce the likelihood of high impact or breakthrough research outcomes. In this paper, we analyze bibliometric data from Scopus and present results for the relationship between publication strategies, publishing productivity and citation-based publication impact for 227 full professors of chemistry and 148 professors of mechanical engineering at ten research-intensive universities in the United States. The results indicate some evidence for the “productivity as the enemy of impact” hypothesis in chemistry, where publishing at the higher margin of productivity leads to a stagnant or declining publication impact. Findings differ for mechanical engineering, where higher publishing productivity consistently leads to higher publication impact. We attribute the differences in findings between the disciplines to a higher propensity for productivity-focused publication strategies in chemistry than in mechanical engineering.

Suggested Citation

  • Sergey Kolesnikov & Eriko Fukumoto & Barry Bozeman, 2018. "Researchers’ risk-smoothing publication strategies: Is productivity the enemy of impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1995-2017, September.
  • Handle: RePEc:spr:scient:v:116:y:2018:i:3:d:10.1007_s11192-018-2793-8
    DOI: 10.1007/s11192-018-2793-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-018-2793-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-018-2793-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Igor Podlubny, 2005. "Comparison of scientific impact expressed by the number of citations in different fields of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 95-99, July.
    2. Alison Abbott & David Cyranoski & Nicola Jones & Brendan Maher & Quirin Schiermeier & Richard Van Noorden, 2010. "Metrics: Do metrics matter?," Nature, Nature, vol. 465(7300), pages 860-862, June.
    3. Martin Meyer, 2006. "Are Co-Active Researchers on Top of their Class? An Exploratory Comparison of Inventor-Authors with their Non-Inventing Peers in Nano-Science and Technology," SPRU Working Paper Series 144, SPRU - Science Policy Research Unit, University of Sussex Business School.
    4. Eva Lillquist & Sheldon Green, 2010. "The discipline dependence of citation statistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 749-762, September.
    5. Vahid Garousi & João M. Fernandes, 2017. "Quantity versus impact of software engineering papers: a quantitative study," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 963-1006, August.
    6. Meyer, Martin, 2006. "Are patenting scientists the better scholars?: An exploratory comparison of inventor-authors with their non-inventing peers in nano-science and technology," Research Policy, Elsevier, vol. 35(10), pages 1646-1662, December.
    7. Clément Bosquet & Pierre-Philippe Combes, 2013. "Are academics who publish more also more cited? Individual determinants of publication and citation records," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 831-857, December.
    8. Vincent Larivière & Rodrigo Costas, 2016. "How Many Is Too Many? On the Relationship between Research Productivity and Impact," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-10, September.
    9. Lutz Bornmann, 2011. "Mimicry in science?," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 173-177, January.
    10. Rodrigo Costas & María Bordons, 2011. "Do age and professional rank influence the order of authorship in scientific publications? Some evidence from a micro-level perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 145-161, July.
    11. Walsh, John P. & Lee, You-Na, 2015. "The bureaucratization of science," Research Policy, Elsevier, vol. 44(8), pages 1584-1600.
    12. Magerman, Tom & Looy, Bart Van & Debackere, Koenraad, 2015. "Does involvement in patenting jeopardize one’s academic footprint? An analysis of patent-paper pairs in biotechnology," Research Policy, Elsevier, vol. 44(9), pages 1702-1713.
    13. Lutz Bornmann & Rüdiger Mutz, 2015. "Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2215-2222, November.
    14. Erjia Yan, 2016. "Disciplinary knowledge production and diffusion in science," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(9), pages 2223-2245, September.
    15. Glenna, Leland L. & Welsh, Rick & Ervin, David & Lacy, William B. & Biscotti, Dina, 2011. "Commercial science, scientists' values, and university biotechnology research agendas," Research Policy, Elsevier, vol. 40(7), pages 957-968, September.
    16. John P A Ioannidis & Kevin W Boyack & Richard Klavans, 2014. "Estimates of the Continuously Publishing Core in the Scientific Workforce," PLOS ONE, Public Library of Science, vol. 9(7), pages 1-10, July.
    17. Hanna Hottenrott & Cornelia Lawson, 2014. "Research grants, sources of ideas and the effects on academic research," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 23(2), pages 109-133, March.
    18. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2014. "Are the authors of highly cited articles also the most productive ones?," Journal of Informetrics, Elsevier, vol. 8(1), pages 89-97.
    19. Katz, J. Sylvan & Martin, Ben R., 1997. "What is research collaboration?," Research Policy, Elsevier, vol. 26(1), pages 1-18, March.
    20. Anthony F. J. Raan, 2006. "Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(3), pages 491-502, June.
    21. Barry Bozeman & Daniel Fay & Catherine Slade, 2013. "Research collaboration in universities and academic entrepreneurship: the-state-of-the-art," The Journal of Technology Transfer, Springer, vol. 38(1), pages 1-67, February.
    22. Bozeman, Barry & Rogers, Juan D., 2002. "A churn model of scientific knowledge value: Internet researchers as a knowledge value collective," Research Policy, Elsevier, vol. 31(5), pages 769-794, July.
    23. He, Zi-Lin & Geng, Xue-Song & Campbell-Hunt, Colin, 2009. "Research collaboration and research output: A longitudinal study of 65 biomedical scientists in a New Zealand university," Research Policy, Elsevier, vol. 38(2), pages 306-317, March.
    24. Clément Bosquet & Pierre-Philippe Combes, 2013. "Are academics who publish more also more cited? Individual determinants of publication and citation records," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 831-857, December.
    25. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    26. Lutz Bornmann & Hans‐Dieter Daniel, 2007. "Multiple publication on a single research study: Does it pay? The influence of number of research articles on total citation counts in biomedicine," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(8), pages 1100-1107, June.
    27. Lorenzo Ductor, 2015. "Does Co-authorship Lead to Higher Academic Productivity?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(3), pages 385-407, June.
    28. Santiago Salinas & Stephan B Munch, 2015. "Where Should I Send It? Optimizing the Submission Decision Process," PLOS ONE, Public Library of Science, vol. 10(1), pages 1-11, January.
    29. Bozeman, Barry & Gaughan, Monica, 2007. "Impacts of grants and contracts on academic researchers' interactions with industry," Research Policy, Elsevier, vol. 36(5), pages 694-707, June.
    30. Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-132, March.
    31. Gonzalez-Brambila, Claudia & Veloso, Francisco M., 2007. "The determinants of research output and impact: A study of Mexican researchers," Research Policy, Elsevier, vol. 36(7), pages 1035-1051, September.
    32. Etzkowitz, Henry, 1998. "The norms of entrepreneurial science: cognitive effects of the new university-industry linkages," Research Policy, Elsevier, vol. 27(8), pages 823-833, December.
    33. Tolu Oni & Fabio Sciarrino & Gerardo Adesso & Rob Knight, 2016. "Let researchers try new paths," Nature, Nature, vol. 538(7626), pages 451-453, October.
    34. Fabrizio, Kira R. & Di Minin, Alberto, 2008. "Commercializing the laboratory: Faculty patenting and the open science environment," Research Policy, Elsevier, vol. 37(5), pages 914-931, June.
    35. Heinze, Thomas & Shapira, Philip & Rogers, Juan D. & Senker, Jacqueline M., 2009. "Organizational and institutional influences on creativity in scientific research," Research Policy, Elsevier, vol. 38(4), pages 610-623, May.
    36. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    37. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    38. van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
    39. Debackere, Koenraad & Rappa, Michael A., 1994. "Institutional variations in problem choice and persistence among scientists in an emerging field," Research Policy, Elsevier, vol. 23(4), pages 425-441, July.
    40. Alexander Kaufmann & Andrea Kasztler, 2009. "Differences in publication and dissemination practices between disciplinary and transdisciplinary science and the consequences for research evaluation," Science and Public Policy, Oxford University Press, vol. 36(3), pages 215-227, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yajie Zhang & Qiang Yu, 2020. "What is the best article publishing strategy for early career scientists?," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 397-408, January.
    2. Tove Faber Frandsen & Rasmus Højbjerg Jacobsen & Jakob Ousager, 2020. "Gender gaps in scientific performance: a longitudinal matching study of health sciences researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1511-1527, August.
    3. Мarina V. Vasiljeva & Gennady V. Osipov & Vadim V. Ponkratov & Vitali Ju. Ivlev & Marina I. Ivleva & Svetlana G. Karepova & Zhanna R. Gardanova & Olesya V. Dudnik, 2021. "Factors to Improve Publication Productivity in Russian Universities," Publications, MDPI, vol. 9(2), pages 1-22, May.
    4. Timur Gareev & Irina Peker, 2023. "Quantity versus quality in publication activity: knowledge production at the regional level," Papers 2311.08830, arXiv.org.
    5. Saarela, Mirka & Kärkkäinen, Tommi, 2020. "Can we automate expert-based journal rankings? Analysis of the Finnish publication indicator," Journal of Informetrics, Elsevier, vol. 14(2).
    6. Tove Faber Frandsen & Mette Brandt Eriksen & David Mortan Grøne Hammer & Janne Buck Christensen, 2019. "Fragmented publishing: a large-scale study of health science," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1729-1743, June.
    7. Yu, Xiaoyao & Szymanski, Boleslaw K. & Jia, Tao, 2021. "Become a better you: Correlation between the change of research direction and the change of scientific performance," Journal of Informetrics, Elsevier, vol. 15(3).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maaike Verbree & Edwin Horlings & Peter Groenewegen & Inge Weijden & Peter Besselaar, 2015. "Organizational factors influencing scholarly performance: a multivariate study of biomedical research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 25-49, January.
    2. Shen, Hongquan & Xie, Juan & Ao, Weiyi & Cheng, Ying, 2022. "The continuity and citation impact of scientific collaboration with different gender composition," Journal of Informetrics, Elsevier, vol. 16(1).
    3. He, Zi-Lin & Geng, Xue-Song & Campbell-Hunt, Colin, 2009. "Research collaboration and research output: A longitudinal study of 65 biomedical scientists in a New Zealand university," Research Policy, Elsevier, vol. 38(2), pages 306-317, March.
    4. Christopher McCarty & James W. Jawitz & Allison Hopkins & Alex Goldman, 2013. "Predicting author h-index using characteristics of the co-author network," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 467-483, August.
    5. Malwina Mejer, 2011. "Entrepreneurial Scientists and their Publication Performance. An Insight from Belgium," Working Papers ECARES ECARES 2011-017, ULB -- Universite Libre de Bruxelles.
    6. Gibson, Elizabeth & Daim, Tugrul U. & Dabic, Marina, 2019. "Evaluating university industry collaborative research centers," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 181-202.
    7. Gita Ghiasi & Matthew Harsh & Andrea Schiffauerova, 2018. "Inequality and collaboration patterns in Canadian nanotechnology: implications for pro-poor and gender-inclusive policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 785-815, May.
    8. Buenstorf, Guido, 2009. "Is commercialization good or bad for science? Individual-level evidence from the Max Planck Society," Research Policy, Elsevier, vol. 38(2), pages 281-292, March.
    9. Carolina Cañibano & Richard Woolley & Eric J. Iversen & Sybille Hinze & Stefan Hornbostel & Jakob Tesch, 2019. "A conceptual framework for studying science research careers," The Journal of Technology Transfer, Springer, vol. 44(6), pages 1964-1992, December.
    10. Lin, Jun-You, 2017. "Balancing industry collaboration and academic innovation: The contingent role of collaboration-specific attributes," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 216-228.
    11. Gonzalez-Brambila, Claudia N. & Veloso, Francisco M. & Krackhardt, David, 2013. "The impact of network embeddedness on research output," Research Policy, Elsevier, vol. 42(9), pages 1555-1567.
    12. Banal-Estañol, Albert & Jofre-Bonet, Mireia & Lawson, Cornelia, 2015. "The double-edged sword of industry collaboration: Evidence from engineering academics in the UK," Research Policy, Elsevier, vol. 44(6), pages 1160-1175.
    13. Shibayama, Sotaro & Lawson, Cornelia, 2021. "The use of rewards in the sharing of research resources," Research Policy, Elsevier, vol. 50(7).
    14. Jinseok Kim, 2018. "Evaluating author name disambiguation for digital libraries: a case of DBLP," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1867-1886, September.
    15. Seeber, Marco & Cattaneo, Mattia & Meoli, Michele & Malighetti, Paolo, 2019. "Self-citations as strategic response to the use of metrics for career decisions," Research Policy, Elsevier, vol. 48(2), pages 478-491.
    16. Wang, Jian, 2016. "Knowledge creation in collaboration networks: Effects of tie configuration," Research Policy, Elsevier, vol. 45(1), pages 68-80.
    17. Czarnitzki, Dirk & Glänzel, Wolfgang & Hussinger, Katrin, 2009. "Heterogeneity of patenting activity and its implications for scientific research," Research Policy, Elsevier, vol. 38(1), pages 26-34, February.
    18. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Di Costa, Flavia, 2019. "When research assessment exercises leave room for opportunistic behavior by the subjects under evaluation," Journal of Informetrics, Elsevier, vol. 13(3), pages 830-840.
    19. Besancenot, Damien & Huynh, Kim & Serranito, Francisco, 2017. "Co-authorship and research productivity in economics: Assessing the assortative matching hypothesis," Economic Modelling, Elsevier, vol. 66(C), pages 61-80.
    20. Hongquan Shen & Juan Xie & Jiang Li & Ying Cheng, 2021. "The correlation between scientific collaboration and citation count at the paper level: a meta-analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3443-3470, April.

    More about this item

    Keywords

    Risk aversion; Publication strategy; Publication productivity; Research strategy; Citation impact;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:116:y:2018:i:3:d:10.1007_s11192-018-2793-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.