IDEAS home Printed from https://ideas.repec.org/p/hum/wpaper/sfb649dp2017-028.html
   My bibliography  Save this paper

Is Scientific Performance a Function of Funds?

Author

Listed:
  • Alona Zharova
  • Wolfgang K. Härdle
  • Stefan Lessmann

Abstract

The management of universities demands data on teaching and research performance. While teaching parameters can be measured via student performance and teacher evaluation programs, the connection of research outputs and their grant antecedents is much harder to check, test and understand. This paper elicits the interdependence structure between third-party expenses (TPE), publications, citations and academic age. To describe the relationship, we analyze individual level data from a sample of professorships from a leading research university and a Scopus database for the period 2001 to 2015. Using estimates from a PVARX model, impulse response functions and a forecast error variance decomposition, we show that analyzing on the high aggregation level of universities does not reflect the behavior of its faculties. We explain the differences in relationship structure between indicators for social sciences and humanities, life sciences and mathematical and natural sciences. For instance, for mathematics and some fields of social sciences and humanities the relationship between the TPE and the number of publications is insignificant, however, the influence of the TPE on the number of citation is significant and positive that indicates the difference between quality and quantity of research outputs. The paper also proposes a visualization of the cooperation between faculties and research interdisciplinarity via the co-authorship structure among publications. We discuss the implications for policy and decision making and suggest recommendations for research management of universities.

Suggested Citation

  • Alona Zharova & Wolfgang K. Härdle & Stefan Lessmann, 2017. "Is Scientific Performance a Function of Funds?," SFB 649 Discussion Papers SFB649DP2017-028, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
  • Handle: RePEc:hum:wpaper:sfb649dp2017-028
    as

    Download full text from publisher

    File URL: http://sfb649.wiwi.hu-berlin.de/papers/pdf/SFB649DP2017-028.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. repec:wsi:jikmxx:v:12:y:2013:i:04:n:s0219649213500378 is not listed on IDEAS
    2. repec:spr:scient:v:102:y:2015:i:3:d:10.1007_s11192-014-1509-y is not listed on IDEAS
    3. Payne A. Abigail & Siow Aloysius, 2003. "Does Federal Research Funding Increase University Research Output?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 3(1), pages 1-24, May.
    4. Beaudry, Catherine & Allaoui, Sedki, 2012. "Impact of public and private research funding on scientific production: The case of nanotechnology," Research Policy, Elsevier, vol. 41(9), pages 1589-1606.
    5. Thomas Fomby & Yuki Ikeda & Norman V. Loayza, 2013. "The Growth Aftermath Of Natural Disasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(3), pages 412-434, April.
    6. Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-132, March.
    7. Holtz-Eakin, Douglas & Newey, Whitney & Rosen, Harvey S, 1989. "The Revenues-Expenditures Nexus: Evidence from Local Government Data," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 30(2), pages 415-429, May.
    8. repec:spr:scient:v:50:y:2001:i:3:d:10.1023_a:1010566916697 is not listed on IDEAS
    9. Canova, Fabio & Ciccarelli, Matteo, 2013. "Panel Vector Autoregressive Models: A Survey," CEPR Discussion Papers 9380, C.E.P.R. Discussion Papers.
    10. Ashkan Ebadi & Andrea Schiffauerova, 2016. "How to boost scientific production? A statistical analysis of research funding and other influencing factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1093-1116, March.
    11. Arturas Juodis, 2013. "First Difference Transformation in Panel VAR models: Robustness, Estimation and Inference," UvA-Econometrics Working Papers 13-06, Universiteit van Amsterdam, Dept. of Econometrics.
    12. Koop, Gary & Korobilis, Dimitris, 2010. "Bayesian Multivariate Time Series Methods for Empirical Macroeconomics," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(4), pages 267-358, July.
    13. DJIGBENOU-KRE, Marie-Louise & Park, Hail, 2016. "The effects of global liquidity on global imbalances," International Review of Economics & Finance, Elsevier, vol. 42(C), pages 1-12.
    14. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    15. Michael R. M. Abrigo & Inessa Love, 2016. "Estimation of panel vector autoregression in Stata," Stata Journal, StataCorp LP, vol. 16(3), pages 778-804, September.
    16. Moed, Henk F. & de Moya-Anegón, Félix & López-Illescas, Carmen & Visser, Martijn, 2011. "Is concentration of university research associated with better research performance?," Journal of Informetrics, Elsevier, vol. 5(4), pages 649-658.
    17. Carayol, Nicolas & Matt, Mireille, 2004. "Does research organization influence academic production?: Laboratory level evidence from a large European university," Research Policy, Elsevier, vol. 33(8), pages 1081-1102, October.
    18. repec:spr:scient:v:88:y:2011:i:2:d:10.1007_s11192-011-0382-1 is not listed on IDEAS
    19. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9-10), pages 1168-1177, October.
    20. Bolli, Thomas & Somogyi, Frank, 2011. "Do competitively acquired funds induce universities to increase productivity?," Research Policy, Elsevier, vol. 40(1), pages 136-147, February.
    21. repec:spr:scient:v:56:y:2003:i:3:d:10.1023_a:1022378804087 is not listed on IDEAS
    22. repec:spr:scient:v:86:y:2011:i:2:d:10.1007_s11192-010-0297-2 is not listed on IDEAS
    23. Rodrigo Costas & Thed N. van Leeuwen & María Bordons, 2010. "A bibliometric classificatory approach for the study and assessment of research performance at the individual level: The effects of age on productivity and impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(8), pages 1564-1581, August.
    24. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    25. repec:spr:scient:v:51:y:2001:i:1:d:10.1023_a:1010549719484 is not listed on IDEAS
    26. Giovanni Abramo & Ciriaco Andrea D’Angelo & Gianluca Murgia, 2016. "The combined effects of age and seniority on research performance of full professors," Science and Public Policy, Oxford University Press, vol. 43(3), pages 301-319.
    27. Michael R.M. Abrigo & Inessa Love, 2016. "Estimation of Panel Vector Autoregression in Stata: a Package of Programs," Working Papers 201602, University of Hawaii at Manoa, Department of Economics.
    28. Sharmistha Nag & Hui Yang & Steven Buccola & David Ervin, 2013. "Productivity and financial support in academic bioscience," Applied Economics, Taylor & Francis Journals, vol. 45(19), pages 2817-2826, July.
    29. Pfaff, Bernhard, 2008. "VAR, SVAR and SVEC Models: Implementation Within R Package vars," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i04).
    30. repec:spr:scient:v:58:y:2003:i:1:d:10.1023_a:1025427507552 is not listed on IDEAS
    31. Andrea Diem & Stefan C. Wolter, 2011. "The Use of Bibliometrics to Measure Research Performance in Education Sciences," Economics of Education Working Paper Series 0066, University of Zurich, Department of Business Administration (IBW), revised May 2013.
    32. Waltman, Ludo & van Eck, Nees Jan, 2015. "Field-normalized citation impact indicators and the choice of an appropriate counting method," Journal of Informetrics, Elsevier, vol. 9(4), pages 872-894.
    33. Lilia Cavallari & Stefano D’Addona, 2014. "Trade Margins And Exchange Rate Regimes: New Evidence From A Panel Varx Model," Working Papers 0514, CREI Università degli Studi Roma Tre, revised 2014.
    34. repec:spr:scient:v:98:y:2014:i:2:d:10.1007_s11192-013-1148-8 is not listed on IDEAS
    35. Vincent Larivière & Benoit Macaluso & Éric Archambault & Yves Gingras, 2010. "Which scientific elites? On the concentration of research funds, publications and citations," Research Evaluation, Oxford University Press, vol. 19(1), pages 45-53, March.
    36. James H. Stock & Mark W. Watson, 2001. "Vector Autoregressions," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 101-115, Fall.
    37. Wolfgang Karl Härdle & Lukas Borke, 2017. "GitHub API based QuantNet Mining infrastructure in R," SFB 649 Discussion Papers SFB649DP2017-008, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    38. Grit Laudel, 2005. "Is external research funding a valid indicator for research performance?," Research Evaluation, Oxford University Press, vol. 14(1), pages 27-34, April.
    39. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    40. repec:spr:scient:v:94:y:2013:i:3:d:10.1007_s11192-012-0775-9 is not listed on IDEAS
    41. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2011. "Assessing the varying level of impact measurement accuracy as a function of the citation window length," Journal of Informetrics, Elsevier, vol. 5(4), pages 659-667.
    42. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2013. "Individual research performance: A proposal for comparing apples to oranges," Journal of Informetrics, Elsevier, vol. 7(2), pages 528-539.
    43. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    research performance; decision making; third-party funds; publications; citations; PVARX model;

    JEL classification:

    • M10 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hum:wpaper:sfb649dp2017-028. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (RDC-Team). General contact details of provider: http://edirc.repec.org/data/sohubde.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.