IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v49y2020i1s0048733319301921.html
   My bibliography  Save this article

Know when to fold ‘em: An empirical description of risk management in public research funding

Author

Listed:
  • Goldstein, Anna P.
  • Kearney, Michael

Abstract

Public research funding programs typically make grants with minimal intervention by program staff, rather than using a hands-on approach to project management, which is more common in the private sector. In contrast, program staff at the US Department of Energy's Advanced Research Projects Agency – Energy (ARPA-E) are given a set of real options with which to manage funded projects: abandon, contract or expand project budgets or timelines. Using internal data from ARPA-E, we show that active project management enables risk mitigation across a portfolio of research projects. We find that program staff modify projects frequently, especially project timelines, and these changes are more sensitive to poor performance than to strong performance. We also find that projects with a shortened timeline or reduced budget are less likely to generate short-term research outputs, compared to those of ultimately similar size. This evidence suggests that the practice of active project management, when combined with high upfront risk tolerance, can be used to enhance the productivity of mission-oriented public research funding.

Suggested Citation

  • Goldstein, Anna P. & Kearney, Michael, 2020. "Know when to fold ‘em: An empirical description of risk management in public research funding," Research Policy, Elsevier, vol. 49(1).
  • Handle: RePEc:eee:respol:v:49:y:2020:i:1:s0048733319301921
    DOI: 10.1016/j.respol.2019.103873
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733319301921
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2019.103873?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Natee Amornsiripanitch & Paul A Gompers & Yuhai Xuan, 2019. "More than Money: Venture Capitalists on Boards," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 35(3), pages 513-543.
    2. Gustavo Manso, 2011. "Motivating Innovation," Journal of Finance, American Finance Association, vol. 66(5), pages 1823-1860, October.
    3. Roberts, Kevin & Weitzman, Martin L, 1981. "Funding Criteria for Research, Development, and Exploration Projects," Econometrica, Econometric Society, vol. 49(5), pages 1261-1288, September.
    4. Leonardo P. Santiago & Pirooz Vakili, 2005. "On the Value of Flexibility in R&D Projects," Management Science, INFORMS, vol. 51(8), pages 1206-1218, August.
    5. Xuan Tian & Tracy Yue Wang, 2014. "Tolerance for Failure and Corporate Innovation," Review of Financial Studies, Society for Financial Studies, vol. 27(1), pages 211-255, January.
    6. Svenja C. Sommer & Christoph H. Loch, 2004. "Selectionism and Learning in Projects with Complexity and Unforeseeable Uncertainty," Management Science, INFORMS, vol. 50(10), pages 1334-1347, October.
    7. Fuchs, Erica R.H., 2010. "Rethinking the role of the state in technology development: DARPA and the case for embedded network governance," Research Policy, Elsevier, vol. 39(9), pages 1133-1147, November.
    8. Nathan Rosenberg, 2009. "Uncertainty and Technological Change," World Scientific Book Chapters, in: Nathan Rosenberg (ed.), Studies On Science And The Innovation Process Selected Works of Nathan Rosenberg, chapter 8, pages 153-172, World Scientific Publishing Co. Pte. Ltd..
    9. Avinash K. Dixit & Robert S. Pindyck, 1994. "Investment under Uncertainty," Economics Books, Princeton University Press, edition 1, number 5474.
    10. Gompers, Paul A, 1995. "Optimal Investment, Monitoring, and the Staging of Venture Capital," Journal of Finance, American Finance Association, vol. 50(5), pages 1461-1489, December.
    11. Edward H. Bowman & Gary T. Moskowitz, 2001. "Real Options Analysis and Strategic Decision Making," Organization Science, INFORMS, vol. 12(6), pages 772-777, December.
    12. William B Bonvillian, 2018. "DARPA and its ARPA-E and IARPA clones: a unique innovation organization model," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(5), pages 897-914.
    13. Lerner, Josh, 1999. "The Government as Venture Capitalist: The Long-Run Impact of the SBIR Program," The Journal of Business, University of Chicago Press, vol. 72(3), pages 285-318, July.
    14. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    15. Scherer, F. M. & Harhoff, Dietmar, 2000. "Technology policy for a world of skew-distributed outcomes," Research Policy, Elsevier, vol. 29(4-5), pages 559-566, April.
    16. William Bonvillian & Richard Atta, 2011. "ARPA-E and DARPA: Applying the DARPA model to energy innovation," The Journal of Technology Transfer, Springer, vol. 36(5), pages 469-513, October.
    17. Arnd Huchzermeier & Christoph H. Loch, 2001. "Project Management Under Risk: Using the Real Options Approach to Evaluate Flexibility in R...D," Management Science, INFORMS, vol. 47(1), pages 85-101, January.
    18. Richard Nelson, 1962. "The Link Between Science and Invention: The Case of the Transistor," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 549-584, National Bureau of Economic Research, Inc.
    19. Raffaele Oriani & Maurizio Sobrero, 2008. "Uncertainty and the market valuation of R&D within a real options logic," Strategic Management Journal, Wiley Blackwell, vol. 29(4), pages 343-361, April.
    20. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    21. Goldstein, Anna P. & Narayanamurti, Venkatesh, 2018. "Simultaneous pursuit of discovery and invention in the US Department of Energy," Research Policy, Elsevier, vol. 47(8), pages 1505-1512.
    22. Richard R. Nelson, 1959. "The Simple Economics of Basic Scientific Research," Journal of Political Economy, University of Chicago Press, vol. 67, pages 297-297.
    23. Michael T. Pich & Christoph H. Loch & Arnoud De Meyer, 2002. "On Uncertainty, Ambiguity, and Complexity in Project Management," Management Science, INFORMS, vol. 48(8), pages 1008-1023, August.
    24. Paul D. Childs & Alexander J. Triantis, 1999. "Dynamic R&D Investment Policies," Management Science, INFORMS, vol. 45(10), pages 1359-1377, October.
    25. Ramana Nanda & Matthew Rhodes-Kropf, 2017. "Financing Risk and Innovation," Management Science, INFORMS, vol. 63(4), pages 901-918, April.
    26. Pierre Azoulay & Erica Fuchs & Anna P. Goldstein & Michael Kearney, 2019. "Funding Breakthrough Research: Promises and Challenges of the “ARPA Model”," Innovation Policy and the Economy, University of Chicago Press, vol. 19(1), pages 69-96.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kok, Holmer & Faems, Dries & de Faria, Pedro, 2022. "Pork Barrel or Barrel of Gold? Examining the performance implications of earmarking in public R&D grants," Research Policy, Elsevier, vol. 51(7).
    2. David Audretsch & Christian Fisch & Chiara Franzoni & Paul P. Momtaz & Silvio Vismara, 2023. "Academic Freedom and Innovation: A Research Note," Papers 2303.06097, arXiv.org.
    3. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Working Papers 26889, National Bureau of Economic Research, Inc.
    4. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Chapters, in: Innovation and Public Policy, pages 117-150, National Bureau of Economic Research, Inc.
    5. Yu, Xiaoyao & Szymanski, Boleslaw K. & Jia, Tao, 2021. "Become a better you: Correlation between the change of research direction and the change of scientific performance," Journal of Informetrics, Elsevier, vol. 15(3).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pierre Azoulay & Erica Fuchs & Anna P. Goldstein & Michael Kearney, 2018. "Funding Breakthrough Research: Promises and Challenges of the "ARPA Model"," NBER Chapters, in: Innovation Policy and the Economy, Volume 19, pages 69-96, National Bureau of Economic Research, Inc.
    2. Joshua S. Gans & Michael Kearney & Erin L. Scott & Scott Stern, 2021. "Choosing Technology: An Entrepreneurial Strategy Approach," Strategy Science, INFORMS, vol. 6(1), pages 39-53, March.
    3. Sabrina T. Howell, 2017. "Reducing Information Frictions in Venture Capital: The Role of New Venture Competitions," NBER Working Papers 23874, National Bureau of Economic Research, Inc.
    4. Ramana Nanda & William R. Kerr, 2015. "Financing Innovation," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 445-462, December.
    5. Kyle Myers & Wei Yang Tham, 2023. "Money, Time, and Grant Design," Papers 2312.06479, arXiv.org.
    6. Cuypers, I.R.P., 2009. "Essays on equity joint ventures, uncertainty and experience," Other publications TiSEM 8dc79e86-c625-467f-a450-8, Tilburg University, School of Economics and Management.
    7. Dirk Czarnitzki & Julie Delanote, 2015. "R&D policies for young SMEs: input and output effects," Small Business Economics, Springer, vol. 45(3), pages 465-485, October.
    8. Hall, Bronwyn H. & Lerner, Josh, 2010. "The Financing of R&D and Innovation," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 609-639, Elsevier.
    9. Colatat, Phech, 2015. "An organizational perspective to funding science: Collaborator novelty at DARPA," Research Policy, Elsevier, vol. 44(4), pages 874-887.
    10. Ramana Nanda & William R. Kerr, 2015. "Financing Innovation," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 445-462, December.
    11. Richard T. Carson & Joshua Graff Zivin & Jordan J. Louviere & Sally Sadoff & Jeffrey G. Shrader, 2022. "The Risk of Caution: Evidence from an Experiment," Management Science, INFORMS, vol. 68(12), pages 9042-9060, December.
    12. Ewens, Michael & Nanda, Ramana & Rhodes-Kropf, Matthew, 2018. "Cost of experimentation and the evolution of venture capital," Journal of Financial Economics, Elsevier, vol. 128(3), pages 422-442.
    13. repec:zbw:bofrdp:2015_028 is not listed on IDEAS
    14. Onur Bayar & Thomas J. Chemmanur & Mark H. Liu, "undated". "How to Motivate Fundamental Innovation: Subsidies versus Prizes and the Role of Venture Capital," Working Papers 0175fin, College of Business, University of Texas at San Antonio, revised 06 Jan 2016.
    15. Watson, Anna, 2022. "Designing publicly funded organisations for accelerated low carbon innovation: A case study of the ETI, UK and ARPA-E, US," Energy Policy, Elsevier, vol. 168(C).
    16. Lin, Yongjia & Fu, Xiaoqing & Fu, Xiaolan, 2021. "Varieties in state capitalism and corporate innovation: Evidence from an emerging economy," Journal of Corporate Finance, Elsevier, vol. 67(C).
    17. Goerke, Björn & Albers, Sönke, 2016. "Long-term effects of subsidies on firm growth: introducing the concept of outcome additionality," EconStor Preprints 142164, ZBW - Leibniz Information Centre for Economics.
    18. repec:zbw:bofrdp:urn:nbn:fi:bof-201512141480 is not listed on IDEAS
    19. Helen Simpson, 1998. "Biotechnology and the Economics of Discovery in the Pharmaceutical Industry," Monograph 000432, Office of Health Economics.
    20. Plank, Josef & Doblinger, Claudia, 2018. "The firm-level innovation impact of public R&D funding: Evidence from the German renewable energy sector," Energy Policy, Elsevier, vol. 113(C), pages 430-438.
    21. repec:bof:bofrdp:urn:nbn:fi:bof-201512141480 is not listed on IDEAS
    22. Erin L. Scott & Pian Shu & Roman M. Lubynsky, 2015. "Are “Better” Ideas More Likely to Succeed? An Empirical Analysis of Startup Evaluation," Harvard Business School Working Papers 16-013, Harvard Business School.
    23. Plantec, Quentin & Cabanes, Benjamin & le Masson, Pascal & Weil, Benoit, 2023. "Early-career academic engagement in university–industry collaborative PhDs: Research orientation and project performance," Research Policy, Elsevier, vol. 52(9).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:49:y:2020:i:1:s0048733319301921. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.