IDEAS home Printed from https://ideas.repec.org/p/zbw/irtgdp/2018011.html
   My bibliography  Save this paper

How to Measure a Performance of a Collaborative Research Centre

Author

Listed:
  • Zharova, Alona
  • Tellinger-Rice, Janine
  • Härdle, Wolfgang Karl

Abstract

New Public Management helps universities and research institutions to perform in a highly competitive research environment. Evaluating publicly financed research results improves transparency, helps in reflection and self-assessment, and provides information for strategic decision making. In this paper we provide empirical evidence using data from a Collaborative Research Centre (CRC) on financial inputs and research output from 2005 to 2016. After selecting performance indicators suitable for a CRC, we describe main properties of the data using visualization techniques. To study the relationship between the dimensions of research performance, we use a time fixed effects panel data model and fixed effects Poisson model. With the help of year dummy variables, we show how the pattern of research productivity changed over time after controlling for staff and travel costs. The joint depiction of the time fixed effects and the research project's life cycle allows a better understanding of the development of the number of discussion papers over time.

Suggested Citation

  • Zharova, Alona & Tellinger-Rice, Janine & Härdle, Wolfgang Karl, 2018. "How to Measure a Performance of a Collaborative Research Centre," IRTG 1792 Discussion Papers 2018-011, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    • Handle: RePEc:zbw:irtgdp:2018011
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/230722/1/irtg1792dp2018-011.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. José Manuel Pastor & Lorenzo Serrano & Irene Zaera, 2015. "The research output of European higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 1867-1893, March.
    2. Cristian Barra & Roberto Zotti, 2016. "Measuring Efficiency in Higher Education: An Empirical Study Using a Bootstrapped Data Envelopment Analysis," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 22(1), pages 11-33, February.
    3. Carayol, Nicolas & Matt, Mireille, 2004. "Does research organization influence academic production?: Laboratory level evidence from a large European university," Research Policy, Elsevier, vol. 33(8), pages 1081-1102, October.
    4. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    5. Hausman, Jerry & Hall, Bronwyn H & Griliches, Zvi, 1984. "Econometric Models for Count Data with an Application to the Patents-R&D Relationship," Econometrica, Econometric Society, vol. 52(4), pages 909-938, July.
    6. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2011. "National-scale research performance assessment at the individual level," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 347-364, February.
    7. Lutz Bornmann, 2013. "How to analyze percentile citation impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes, and top-cited papers," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(3), pages 587-595, March.
    8. Wooldridge, Jeffrey M., 1999. "Distribution-free estimation of some nonlinear panel data models," Journal of Econometrics, Elsevier, vol. 90(1), pages 77-97, May.
    9. Stefan Schröder & Florian Welter & Ingo Leisten & Anja Richert & Sabina Jeschke, 2014. "Research performance and evaluation—Empirical results from collaborative research centers and clusters of excellence in Germany," Research Evaluation, Oxford University Press, vol. 23(3), pages 221-232.
    10. Herman Van den Berghe & Josee A. Houben & Renger E. de Bruin & Henk F. Moed & André Kint & Marc Luwel & Eric H. J. Spruyt, 1998. "Bibliometric indicators of university research performance in Flanders," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 49(1), pages 59-67.
    11. Alona Zharova & Wolfgang K. Härdle & Stefan Lessmann, 2017. "Is Scientific Performance a Function of Funds?," SFB 649 Discussion Papers SFB649DP2017-028, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    12. Moed, Henk F. & de Moya-Anegón, Félix & López-Illescas, Carmen & Visser, Martijn, 2011. "Is concentration of university research associated with better research performance?," Journal of Informetrics, Elsevier, vol. 5(4), pages 649-658.
    13. Bolli, Thomas & Somogyi, Frank, 2011. "Do competitively acquired funds induce universities to increase productivity?," Research Policy, Elsevier, vol. 40(1), pages 136-147, February.
    14. Moed, Henk F., 2010. "Measuring contextual citation impact of scientific journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 265-277.
    15. Ulrich Schmoch & Torben Schubert, 2009. "Sustainability of incentives for excellent research — The German case," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 195-218, October.
    16. Nicolas Carayol & Mireille Matt, 2004. "Does research organization influence academic production ?," Post-Print hal-00279014, HAL.
    17. Gregory John Lee, 2010. "Assessing publication performance of research units: extensions through operational research and economic techniques," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 717-734, September.
    18. Andrea Diem & Stefan C. Wolter, 2011. "The Use of Bibliometrics to Measure Research Performance in Education Sciences," Economics of Education Working Paper Series 0066, University of Zurich, Department of Business Administration (IBW), revised May 2013.
    19. José Manuel Pastor & Lorenzo Serrano, 2016. "The determinants of the research output of universities: specialization, quality and inefficiencies," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1255-1281, November.
    20. Juntao Zheng & Niancai Liu, 2015. "Mapping of important international academic awards," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 763-791, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to Measure a Performance of a Collaborative Research Centre," SFB 649 Discussion Papers SFB649DP2018-001, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    2. Alona Zharova & Wolfgang K. Härdle & Stefan Lessmann, 2017. "Is Scientific Performance a Function of Funds?," SFB 649 Discussion Papers SFB649DP2017-028, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    3. Wang, Gangbo & Guan, Jiancheng, 2010. "The role of patenting activity for scientific research: A study of academic inventors from China's nanotechnology," Journal of Informetrics, Elsevier, vol. 4(3), pages 338-350.
    4. Tasso Brandt & Torben Schubert, 2013. "Is the university model an organizational necessity? Scale and agglomeration effects in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 541-565, February.
    5. Cowan, Robin & Zinovyeva, Natalia, 2013. "University effects on regional innovation," Research Policy, Elsevier, vol. 42(3), pages 788-800.
    6. Walter, Sascha G. & Schmidt, Arne & Walter, Achim, 2016. "Patenting rationales of academic entrepreneurs in weak and strong organizational regimes," Research Policy, Elsevier, vol. 45(2), pages 533-545.
    7. Zhang, Xuan & Nie, Huihua, 2021. "Public health insurance and pharmaceutical innovation: Evidence from China," Journal of Development Economics, Elsevier, vol. 148(C).
    8. Torben Schubert, 2014. "Are there scale economies in scientific production? On the topic of locally increasing returns to scale," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 393-408, May.
    9. Brandt, Tasso & Schubert, Torben, 2012. "Is the University Model an Organizational Necessity? Scale and Agglomeration Effects in Science," Papers in Innovation Studies 2012/1, Lund University, CIRCLE - Centre for Innovation Research.
    10. Baldini, Nicola & Grimaldi, Rosa & Sobrero, Maurizio, 2006. "Institutional changes and the commercialization of academic knowledge: A study of Italian universities' patenting activities between 1965 and 2002," Research Policy, Elsevier, vol. 35(4), pages 518-532, May.
    11. Leila Tahmooresnejad & Catherine Beaudry & Andrea Schiffauerova, 2015. "The role of public funding in nanotechnology scientific production: Where Canada stands in comparison to the United States," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 753-787, January.
    12. Kremena Slavova & Andrea Fosfuri & Julio O. De Castro, 2016. "Learning by Hiring: The Effects of Scientists’ Inbound Mobility on Research Performance in Academia," Organization Science, INFORMS, vol. 27(1), pages 72-89, February.
    13. Andrea Bonaccorsi & Brigida Blasi & Carmela Anna Nappi & Sandra Romagnosi, 2022. "Quality of research as source and signal: revisiting the valorization process beyond substitution vs complementarity," The Journal of Technology Transfer, Springer, vol. 47(2), pages 407-434, April.
    14. Zharova, Alona & Härdle, Wolfgang Karl & Lessmann, Stefan, 2023. "Data-driven support for policy and decision-making in university research management: A case study from Germany," European Journal of Operational Research, Elsevier, vol. 308(1), pages 353-368.
    15. Nabil Amara & Réjean Landry & Norrin Halilem, 2015. "What can university administrators do to increase the publication and citation scores of their faculty members?," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 489-530, May.
    16. M. Teresa Antonio-García & Irene López-Navarro & Jesús Rey-Rocha, 2014. "Determinants of success for biomedical researchers: a perception-based study in a health science research environment," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1747-1779, December.
    17. Yann Kossi & Jean-Yves Lesueur & Mareva Sabatier, 2016. "Publish or teach? The role of the scientific environment on academics’ multitasking," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 25(3), pages 487-506.
    18. Jonathan Colmer, 2013. "Climate Variability, Child Labour and Schooling: Evidence on the Intensive and Extensive Margin," GRI Working Papers 132, Grantham Research Institute on Climate Change and the Environment.
    19. Branstetter, Lee & Chatterjee, Chirantan & Higgins, Matthew J., 2022. "Generic competition and the incentives for early-stage pharmaceutical innovation," Research Policy, Elsevier, vol. 51(10).
    20. Benjamin A. Olken & Monica Singhal, 2011. "Informal Taxation," American Economic Journal: Applied Economics, American Economic Association, vol. 3(4), pages 1-28, October.

    More about this item

    Keywords

    Research Performance; Time Fixed Effects Panel Data Model; Fixed Effects Poisson Model; Network; Collaborative Research Centre;
    All these keywords.

    JEL classification:

    • C00 - Mathematical and Quantitative Methods - - General - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:irtgdp:2018011. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/wfhubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.