IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2311.08830.html
   My bibliography  Save this paper

Quantity versus quality in publication activity: knowledge production at the regional level

Author

Listed:
  • Timur Gareev
  • Irina Peker

Abstract

This study contributes to the ongoing debate regarding the balance between quality and quantity in research productivity and publication activity. Using empirical regional knowledge production functions, we establish a significant correlation between R&D spending and research output, specifically publication productivity, while controlling for patenting activity and socioeconomic factors. Our focus is on the dilemma of research quantity versus quality, which is analysed in the context of regional thematic specialization using spatial lags. When designing policies and making forecasts, it is important to consider the quality of research measured by established indicators. In this study, we examine the dual effect of research quality on publication activity. We identify two groups of quality factors: those related to the quality of journals and those related to the impact of publications. On average, these factors have different influences on quantitative measures. The quality of journals shows a negative relationship with quantity, indicating that as journal quality increases, the number of publications decreases. On the other hand, the impact of publications can be approximated by an inverse parabolic shape, with a positive decreasing slope within a common range of values. This duality in the relationship between quality factors and quantitative measures may explain some of the significant variations in conclusions found in the literature. We compare several models that explore factors influencing publication activity using a balanced panel dataset of Russian regions from 2009 to 2021. Additionally, we propose a novel approach using thematic scientometric parameters as a special type of proximity measure between regions in thematic space. Incorporating spatial spillovers in thematic space allows us to account for potential cross-sectional dependence in regional data.

Suggested Citation

  • Timur Gareev & Irina Peker, 2023. "Quantity versus quality in publication activity: knowledge production at the regional level," Papers 2311.08830, arXiv.org.
  • Handle: RePEc:arx:papers:2311.08830
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2311.08830
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Miguélez, Ernest & Moreno, Rosina, 2015. "Knowledge flows and the absorptive capacity of regions," Research Policy, Elsevier, vol. 44(4), pages 833-848.
    2. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    3. Núria Bautista-Puig & Luis Moreno Lorente & Elías Sanz-Casado, 2021. "Proposed methodology for measuring the effectiveness of policies designed to further research," Research Evaluation, Oxford University Press, vol. 30(2), pages 215-229.
    4. Riccardo Crescenzi & Alexander Jaax, 2017. "Innovation in Russia: The Territorial Dimension," Economic Geography, Taylor & Francis Journals, vol. 93(1), pages 66-88, January.
    5. Vincent Larivière & Rodrigo Costas, 2016. "How Many Is Too Many? On the Relationship between Research Productivity and Impact," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-10, September.
    6. Mario Biagioli, 2016. "Watch out for cheats in citation game," Nature, Nature, vol. 535(7611), pages 201-201, July.
    7. Rucha Vadia & Katharina Blankart, 2021. "Regional Innovation Systems of Medical Technology: A knowledge production function of cardiovascular research and funding in Europe," REGION, European Regional Science Association, vol. 8, pages 57-81.
    8. Hausman, Jerry & Hall, Bronwyn H & Griliches, Zvi, 1984. "Econometric Models for Count Data with an Application to the Patents-R&D Relationship," Econometrica, Econometric Society, vol. 52(4), pages 909-938, July.
    9. Ping Zhou & Bart Thijs & Wolfgang Glänzel, 2009. "Regional analysis on Chinese scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 839-857, December.
    10. Mathias Binswanger, 2015. "How Nonsense Became Excellence: Forcing Professors to Publish," Springer Books, in: Isabell M. Welpe & Jutta Wollersheim & Stefanie Ringelhan & Margit Osterloh (ed.), Incentives and Performance, edition 127, pages 19-32, Springer.
    11. Cheng-Chung Cho & Ming-Wen Hu & Meng-Chun Liu, 2010. "Improvements in productivity based on co-authorship: a case study of published articles in China," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 463-470, November.
    12. Zvi Griliches, 1998. "Issues in Assessing the Contribution of Research and Development to Productivity Growth," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 17-45, National Bureau of Economic Research, Inc.
    13. Michael Fritsch, 2002. "Measuring the Quality of Regional Innovation Systems: A Knowledge Production Function Approach," International Regional Science Review, , vol. 25(1), pages 86-101, January.
    14. Michael Fritsch & Viktor Slavtchev, 2007. "Universities and Innovation in Space," Industry and Innovation, Taylor & Francis Journals, vol. 14(2), pages 201-218.
    15. Tamás Sebestyén & Attila Varga, 2013. "Research productivity and the quality of interregional knowledge networks," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 51(1), pages 155-189, August.
    16. Sivertsen, Gunnar & Rousseau, Ronald & Zhang, Lin, 2019. "Measuring scientific contributions with modified fractional counting," Journal of Informetrics, Elsevier, vol. 13(2), pages 679-694.
    17. Sylvie Charlot & Riccardo Crescenzi & Antonio Musolesi, 2015. "Econometric modelling of the regional knowledge production function in Europe," Journal of Economic Geography, Oxford University Press, vol. 15(6), pages 1227-1259.
    18. James Levinsohn & Amil Petrin, 2003. "Estimating Production Functions Using Inputs to Control for Unobservables," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(2), pages 317-341.
    19. Pakes, Ariel & Griliches, Zvi, 1980. "Patents and R&D at the firm level: A first report," Economics Letters, Elsevier, vol. 5(4), pages 377-381.
    20. Shyama V. Ramani & Mhamed-Ali El-Aroui & Myriam Carrère, 2008. "On estimating a knowledge production function at the firm and sectoral level using patent statistics," Post-Print hal-00365396, HAL.
    21. S. Varun Shrivats & Sujit Bhattacharya, 2014. "Forecasting the trend of international scientific collaboration," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1941-1954, December.
    22. Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Di Costa, 2010. "Testing the trade-off between productivity and quality in research activities," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(1), pages 132-140, January.
    23. Croissant, Yves & Millo, Giovanni, 2008. "Panel Data Econometrics in R: The plm Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i02).
    24. Breandán Ó hUallacháin & Timothy F. Leslie, 2007. "Rethinking the regional knowledge production function," Journal of Economic Geography, Oxford University Press, vol. 7(6), pages 737-752, November.
    25. Luís M. A. Bettencourt & David I. Kaiser & Jasleen Kaur & Carlos Castillo-Chávez & David E. Wojick, 2008. "Population modeling of the emergence and development of scientific fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(3), pages 495-518, June.
    26. Cristian Candia & C. Jara-Figueroa & Carlos Rodriguez-Sickert & Albert-László Barabási & César A. Hidalgo, 2019. "The universal decay of collective memory and attention," Nature Human Behaviour, Nature, vol. 3(1), pages 82-91, January.
    27. Michael Fritsch & Viktor Slavtchev, 2010. "How does industry specialization affect the efficiency of regional innovation systems?," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 45(1), pages 87-108, August.
    28. Jens K. Perret, 2019. "Re-Evaluating the Knowledge Production Function for the Regions of the Russian Federation," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 10(2), pages 670-694, June.
    29. Sergey Kolesnikov & Eriko Fukumoto & Barry Bozeman, 2018. "Researchers’ risk-smoothing publication strategies: Is productivity the enemy of impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1995-2017, September.
    30. Cirlene Maria de Matos & Eduardo Gonçalves & Ricardo da Silva Freguglia, 2021. "Knowledge diffusion channels in Brazil: The effect of inventor mobility and inventive collaboration on regional invention," Growth and Change, Wiley Blackwell, vol. 52(2), pages 909-932, June.
    31. Baltagi, Badi H., 2015. "The Oxford Handbook of Panel Data," OUP Catalogue, Oxford University Press, number 9780199940042.
    32. Stepan Zemtsov & Maxim Kotsemir, 2019. "An assessment of regional innovation system efficiency in Russia: the application of the DEA approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 375-404, August.
    33. Bornmann, Lutz, 2019. "Does the normalized citation impact of universities profit from certain properties of their published documents – such as the number of authors and the impact factor of the publishing journals? A mult," Journal of Informetrics, Elsevier, vol. 13(1), pages 170-184.
    34. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    35. Yee Kyoung Kim & Keun Lee, 2015. "Different Impacts of Scientific and Technological Knowledge on Economic Growth: Contrasting Science and Technology Policy in East Asia and Latin America," Asian Economic Policy Review, Japan Center for Economic Research, vol. 10(1), pages 43-66, January.
    36. Timothy J. Coelli & D.S. Prasada Rao & Christopher J. O’Donnell & George E. Battese, 2005. "An Introduction to Efficiency and Productivity Analysis," Springer Books, Springer, edition 0, number 978-0-387-25895-9, December.
    37. Ramani, Shyama V. & El-Aroui, Mhamed-Ali & Carrère, Myriam, 2008. "On estimating a knowledge production function at the firm and sector level using patent statistics," Research Policy, Elsevier, vol. 37(9), pages 1568-1578, October.
    38. Matthew J Michalska-Smith & Stefano Allesina, 2017. "And, not or: Quality, quantity in scientific publishing," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-12, June.
    39. van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
    40. Alberto Baccini & Giuseppe De Nicolao & Eugenio Petrovich, 2019. "Citation gaming induced by bibliometric evaluation: A country-level comparative analysis," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-16, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chatterjee, Diti & Dinar, Ariel & González-Rivera, Gloria, 2018. "An empirical knowledge production function of agricultural research and extension: The case of the University of California Cooperative Extension," Technological Forecasting and Social Change, Elsevier, vol. 134(C), pages 290-297.
    2. Jens K. Perret, 2019. "Re-Evaluating the Knowledge Production Function for the Regions of the Russian Federation," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 10(2), pages 670-694, June.
    3. Candelaria Barrios & Esther Flores & M. Ángeles Martínez & Marta Ruiz-Martínez, 2023. "Are the Major Knowledge-producing Countries Converging in Science and Technology Capabilities?," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 14(4), pages 4534-4560, December.
    4. Jens K. Perret, 2016. "A Spatial Knowledge Production Function Approach for the Regions of the Russian Federation," EIIW Discussion paper disbei217, Universitätsbibliothek Wuppertal, University Library.
    5. de Rassenfosse, Gaétan & Schoen, Anja & Wastyn, Annelies, 2014. "Selection bias in innovation studies: A simple test," Technological Forecasting and Social Change, Elsevier, vol. 81(C), pages 287-299.
    6. Andrea, Bastianin & Paolo, Castelnuovo & Massimo, Florio & Anna, Giunta, 2019. "Technological Learning and Innovation Gestation Lags at the Frontier of Science: from CERN Procurement to Patents," Working Papers 405, University of Milano-Bicocca, Department of Economics, revised Apr 2019.
    7. Grafström, Jonas & Poudineh, Rahmat, 2023. "No evidence of counteracting policy effects on European solar power invention and diffusion," Energy Policy, Elsevier, vol. 172(C).
    8. Stepan Zemtsov & Alexander Muradov & Imogen Wade & Vera Barinova, 2016. "Determinants of Regional Innovation in Russia: Are People or Capital More Important?," Foresight and STI Governance (Foresight-Russia till No. 3/2015), National Research University Higher School of Economics, vol. 10(2), pages 29-42.
    9. Cristian Barra & Nazzareno Ruggiero, 2022. "How do dimensions of institutional quality improve Italian regional innovation system efficiency? The Knowledge production function using SFA," Journal of Evolutionary Economics, Springer, vol. 32(2), pages 591-642, April.
    10. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    11. Yu, Xiaoyao & Szymanski, Boleslaw K. & Jia, Tao, 2021. "Become a better you: Correlation between the change of research direction and the change of scientific performance," Journal of Informetrics, Elsevier, vol. 15(3).
    12. Christ, Julian P., 2009. "The geography and co-location of European technology-specific co-inventorship networks," Violette Reihe: Schriftenreihe des Promotionsschwerpunkts "Globalisierung und Beschäftigung" 31/2010, University of Hohenheim, Carl von Ossietzky University Oldenburg, Evangelisches Studienwerk.
    13. Roberta Piergiovanni & Enrico Santarelli, 2013. "The more you spend, the more you get? The effects of R&D and capital expenditures on the patenting activities of biotechnology firms," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 497-521, February.
    14. Riccardo Crescenzi & Alexander Jaax, 2017. "Innovation in Russia: The Territorial Dimension," Economic Geography, Taylor & Francis Journals, vol. 93(1), pages 66-88, January.
    15. Antonelli Cristiano & Colombelli Alessandra, 2013. "Knowledge cumulability and complementarity in the knowledge generation function," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201305, University of Turin.
    16. Antonelli, Cristiano & David, Paul, 2015. "The Generation of Knowledge as an Emergent System Property: An Introduction," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201540, University of Turin.
    17. Andre Jungmittag & Paul J.J. Welfens, 2016. "Beyond EU-US Trade Dynamics: TTIP Effects Related to Foreign Direct Investment and Innovation," EIIW Discussion paper disbei212, Universitätsbibliothek Wuppertal, University Library.
    18. Burcu Fazlıoğlu & Başak Dalgıç & Ahmet Burçin Yereli, 2019. "The effect of innovation on productivity: evidence from Turkish manufacturing firms," Industry and Innovation, Taylor & Francis Journals, vol. 26(4), pages 439-460, April.
    19. Chen, Kaihua & Guan, Jiancheng, 2011. "Mapping the functionality of China's regional innovation systems: A structural approach," China Economic Review, Elsevier, vol. 22(1), pages 11-27, March.
    20. Frauke G. Braun & Jens Schmidt-Ehmcke & Petra Zloczysti, 2010. "Innovative Activity in Wind and Solar Technology: Empirical Evidence on Knowledge Spillovers Using Patent Data," Discussion Papers of DIW Berlin 993, DIW Berlin, German Institute for Economic Research.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2311.08830. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.