IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v109y2016i2d10.1007_s11192-016-2084-1.html
   My bibliography  Save this article

Accurate forecast of countries’ research output by macro-level indicators

Author

Listed:
  • Christoph Emanuel Mueller

    (Saarland University)

Abstract

There is a great variation of research output across countries in terms of differences in the amount of published peer-reviewed literature. Besides determining the causal determinants of these differences, an important task of scientometric research is to make accurate predictions of countries’ future research output. Building on previous research on the key drivers of differences in countries’ research outputs, this study develops a model which includes sixteen macro-level predictors representing aspects of the research and economic system, of the political conditions, and of structural and cultural attributes of countries. In applying a machine learning procedure called boosted regression trees, the study demonstrates these predictors are sufficient for making highly accurate forecasts of countries’ research output across scientific disciplines. The study also shows that using a functionally flexible procedure like boosted regression trees can substantially increase the predictive power of the model when compared to traditional regression. Finally, the results obtained allow a different perspective on the functional forms of the relations between the predictors and the response variable.

Suggested Citation

  • Christoph Emanuel Mueller, 2016. "Accurate forecast of countries’ research output by macro-level indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1307-1328, November.
  • Handle: RePEc:spr:scient:v:109:y:2016:i:2:d:10.1007_s11192-016-2084-1
    DOI: 10.1007/s11192-016-2084-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2084-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-016-2084-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sultan Ayoub Meo & Abeer A Al Masri & Adnan Mahmood Usmani & Almas Naeem Memon & Syed Ziauddin Zaidi, 2013. "Impact of GDP, Spending on R&D, Number of Universities and Scientific Journals on Research Publications among Asian Countries," PLOS ONE, Public Library of Science, vol. 8(6), pages 1-8, June.
    2. Thelwall, Mike & Wilson, Paul, 2014. "Regression for citation data: An evaluation of different methods," Journal of Informetrics, Elsevier, vol. 8(4), pages 963-971.
    3. Ling-Chu Lee & Pin-Hua Lin & Yun-Wen Chuang & Yi-Yang Lee, 2011. "Research output and economic productivity: a Granger causality test," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(2), pages 465-478, November.
    4. Sumeer Gul & Nahida Tun Nisa & Tariq Ahmad Shah & Sangita Gupta & Asifa Jan & Suhail Ahmad, 2015. "Middle East: research productivity and performance across nations," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 1157-1166, November.
    5. Trivedi, Pravin K, 1993. "An Analysis of Publication Lags in Econometrics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(1), pages 93-100, Jan.-Marc.
    6. Ernesto R. Gantman, 2009. "International differences of productivity in scholarly management knowledge," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 153-165, July.
    7. Friedman, Jerome H., 2002. "Stochastic gradient boosting," Computational Statistics & Data Analysis, Elsevier, vol. 38(4), pages 367-378, February.
    8. V. Rodriguez & A. Soeparwata, 2012. "ASEAN benchmarking in terms of science, technology, and innovation from 1999 to 2009," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 549-573, September.
    9. Raheem Sarwar & Saeed-UI Hassan, 2015. "A bibliometric assessment of scientific productivity and international collaboration of the Islamic World in science and technology (S&T) areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 1059-1077, November.
    10. Hamilton Ntuli & Roula Inglesi-Lotz & Tsangyao Chang & Anastassios Pouris, 2015. "Does research output cause economic growth or vice versa? Evidence from 34 OECD countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(8), pages 1709-1716, August.
    11. Peter Vinkler, 2008. "Correlation between the structure of scientific research, scientometric indicators and GDP in EU and non-EU countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 237-254, February.
    12. Lorelei R. Vinluan, 2012. "Research productivity in education and psychology in the Philippines and comparison with ASEAN countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 277-294, April.
    13. Matthias Schonlau, 2005. "Boosted regression (boosting): An introductory tutorial and a Stata plugin," Stata Journal, StataCorp LP, vol. 5(3), pages 330-354, September.
    14. Hsieh, Pao-Nuan & Chang, Pao-Long, 2009. "An assessment of world-wide research productivity in production and operations management," International Journal of Production Economics, Elsevier, vol. 120(2), pages 540-551, August.
    15. Mladen M. Koljatic & Mónica R. Silva, 2001. "The international publication productivity of Latin American countries in the economics and business administration fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(2), pages 381-394, June.
    16. Ernesto R. Gantman, 2012. "Economic, linguistic, and political factors in the scientific productivity of countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 967-985, December.
    17. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Domingo Docampo & Jean-Jacques Bessoule, 2019. "A new approach to the analysis and evaluation of the research output of countries and institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1207-1225, May.
    2. Xu, Xu & Reed, Markum, 2021. "The impact of internet access on research output - a cross-country study," Information Economics and Policy, Elsevier, vol. 56(C).
    3. Khosrowjerdi, Mahmood & Bornmann, Lutz, 2021. "Is culture related to strong science? An empirical investigation," Journal of Informetrics, Elsevier, vol. 15(4).
    4. Alonso Rodríguez-Navarro & Ricardo Brito, 2022. "The link between countries’ economic and scientific wealth has a complex dependence on technological activity and research policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2871-2896, May.
    5. Elham Erfanian & Amir B. Ferreira Neto, 2017. "Scientific output: labor or capital intensive? An analysis for selected countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 461-482, July.
    6. Vivek Kumar Singh & Prashasti Singh & Ashraf Uddin & Parveen Arora & Sujit Bhattacharya, 2022. "Exploring the relationship between journals indexed from a country and its research output: an empirical investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 2933-2966, June.
    7. Mehmet Pinar, 2023. "Do research performances of universities and disciplines in England converge or diverge? An assessment of the progress between research excellence frameworks in 2014 and 2021," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5731-5766, October.
    8. Bárbara S. Lancho-Barrantes & Francisco J. Cantú-Ortiz, 2019. "Science in Mexico: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 499-517, February.
    9. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    10. Li, Shiyuan & Li, Yumin, 2021. "The Impact of Mobile Phone Adoption on Income Inequality," MPRA Paper 110969, University Library of Munich, Germany.
    11. Mahmood Khosrowjerdi & Lutz Bornmann, 2019. "Is culture related to strong science? An empirical investigation," Papers 1909.04521, arXiv.org, revised Apr 2021.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barbara S. Lancho-Barrantes & Hector G. Ceballos-Cancino & Francisco J. Cantu-Ortiz, 2021. "Comparing the efficiency of countries to assimilate and apply research investment," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1347-1369, August.
    2. Chadi Azmeh, 2022. "Quantity and quality of research output and economic growth: empirical investigation for all research areas in the MENA countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6147-6163, November.
    3. Elham Erfanian & Amir B. Ferreira Neto, 2017. "Scientific output: labor or capital intensive? An analysis for selected countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 461-482, July.
    4. M. Gouveia & R. Inglesi-Lotz, 2021. "Examining the relationship between climate change-related research output and CO2 emissions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9069-9111, November.
    5. Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    6. Roula Inglesi-Lotz & Mehmet Balcilar & Rangan Gupta, 2014. "Time-varying causality between research output and economic growth in US," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 203-216, July.
    7. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    8. Yong Yi & Wei Qi & Dandan Wu, 2013. "Are CIVETS the next BRICs? A comparative analysis from scientometrics perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 615-628, February.
    9. Sakiru Adebola Solarin & Yuen Yee Yen, 2016. "A global analysis of the impact of research output on economic growth," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 855-874, August.
    10. Omwoyo Bosire Onyancha, 2020. "A meta-analysis study of the relationship between research and economic development in selected countries in sub-Saharan Africa," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 655-675, May.
    11. Pablo Jack & Jeremias Lachman & Andrés López, 2021. "Scientific knowledge production and economic catching-up: an empirical analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4565-4587, June.
    12. Inglesi-Lotz, R., 2019. "Energy research and R&D indicators: An LMDI decomposition analysis for the IEA Big 5 in energy research," Energy Policy, Elsevier, vol. 133(C).
    13. R. Inglesi-Lotz & A. Pouris, 2013. "The influence of scientific research output of academics on economic growth in South Africa: an autoregressive distributed lag (ARDL) application," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 129-139, April.
    14. Alonso Rodríguez-Navarro & Ricardo Brito, 2022. "The link between countries’ economic and scientific wealth has a complex dependence on technological activity and research policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2871-2896, May.
    15. Arman Pourghaz & Ehsan Bahrami Samani & Babak Shokri, 2023. "Analysis of the impact of research output on economic growth with using a multivariate random effects model," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2259-2282, April.
    16. Tânia Pinto & Aurora A. C. Teixeira, 2020. "The impact of research output on economic growth by fields of science: a dynamic panel data analysis, 1980–2016," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 945-978, May.
    17. Yusuf Ikbal Oldac, 2022. "Global science and the muslim world: overview of muslim-majority country contributions to global science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6231-6255, November.
    18. Tânia Pinto & Aurora Teixeira, 2023. "Does scientific research output matter for Portugal’s economic growth?," GEE Papers 0174, Gabinete de Estratégia e Estudos, Ministério da Economia, revised Jul 2023.
    19. Ricardo Arencibia-Jorge & Felix Moya-Anegón, 2010. "Challenges in the study of Cuban scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(3), pages 723-737, June.
    20. Hyeonchae Yang & Woo-Sung Jung, 2015. "A strategic management approach for Korean public research institutes based on bibliometric investigation," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(4), pages 1437-1464, July.

    More about this item

    Keywords

    Research productivity; Research output; Scientific publishing; Boosted regression trees;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • O30 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:109:y:2016:i:2:d:10.1007_s11192-016-2084-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.