IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v77y2019ics0149718918303987.html
   My bibliography  Save this article

Using database linkages to measure innovation, commercialization, and survival of small businesses

Author

Listed:
  • Onken, James
  • Miklos, Andrew C.
  • Dorsey, Travis F.
  • Aragon, Richard
  • Calcagno, Anna Maria

Abstract

Here, we report the results of an outcomes evaluation of the Small Business Innovation Research (SBIR) and Small Business Technology Transfer (STTR) Programs at the National Institute of General Medical Sciences (NIGMS). Since the programs’ inception, assessments of the SBIR/STTR programs at several federal agencies have utilized surveys of former grantees as the primary source of data. Response rates have typically been low, making non-response bias a potential threat to the validity of some of these studies’ results. Meanwhile, the availability of large publicly-available datasets continues to grow and methods of text mining and linking databases continue to improve. By linking NIGMS grant funding records, U.S. Patent and Trademark Office data, and business intelligence databases, we explored innovation, commercialization and survival for recipients of NIGMS SBIR/STTR funding. In doing so, we were able to more completely assess several key outcomes of the NIGMS SBIR/STTR program. Our evaluation demonstrated that the NIGMS program performed above baseline expectations along all dimensions, and comparably to other federal agency SBIR/STTR grant programs. In addition, we show that the use of extant data increasingly is a viable, less expensive, and more reliable approach to gathering data for evaluation studies.

Suggested Citation

  • Onken, James & Miklos, Andrew C. & Dorsey, Travis F. & Aragon, Richard & Calcagno, Anna Maria, 2019. "Using database linkages to measure innovation, commercialization, and survival of small businesses," Evaluation and Program Planning, Elsevier, vol. 77(C).
  • Handle: RePEc:eee:epplan:v:77:y:2019:i:c:s0149718918303987
    DOI: 10.1016/j.evalprogplan.2019.101710
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718918303987
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2019.101710?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    2. Bronwyn H. Hall & Adam Jaffe & Manuel Trajtenberg, 2005. "Market Value and Patent Citations," RAND Journal of Economics, The RAND Corporation, vol. 36(1), pages 16-38, Spring.
    3. Hagedoorn, John & Cloodt, Myriam, 2003. "Measuring innovative performance: is there an advantage in using multiple indicators?," Research Policy, Elsevier, vol. 32(8), pages 1365-1379, September.
    4. Dornbusch, Friedrich & Schmoch, Ulrich & Schulze, Nicole & Bethke, Nadine, 2012. "Identification of university-based patents: A new large-scale approach," Discussion Papers "Innovation Systems and Policy Analysis" 32, Fraunhofer Institute for Systems and Innovation Research (ISI).
    5. Zoltan J. Acs & David B. Audretsch, 1989. "Patents' Innovative Activity," Eastern Economic Journal, Eastern Economic Association, vol. 15(4), pages 373-376, Oct-Dec.
    6. de Rassenfosse, Gaetan & van Pottelsberghe de la Potterie, Bruno, 2009. "A policy insight into the R&D-patent relationship," Research Policy, Elsevier, vol. 38(5), pages 779-792, June.
    7. Gautam Ahuja & Curba Morris Lampert, 2001. "Entrepreneurship in the large corporation: a longitudinal study of how established firms create breakthrough inventions," Strategic Management Journal, Wiley Blackwell, vol. 22(6‐7), pages 521-543, June.
    8. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    9. Zoltan J. Acs & David B. Audretsch, 1989. "Patents as a Measure of Innovative Activity," Kyklos, Wiley Blackwell, vol. 42(2), pages 171-180, August.
    10. Harhoff, Dietmar & Gambardella, Alfonso & Verspagen, Bart, 2008. "The Value of European Patents," CEPR Discussion Papers 6848, C.E.P.R. Discussion Papers.
    11. Peter Neuhäusler & Rainer Frietsch & Carolin Mund & Verena Eckl, 2017. "Identifying the Technology Profiles of R&D Performing Firms — A Matching of R&D and Patent Data," International Journal of Innovation and Technology Management (IJITM), World Scientific Publishing Co. Pte. Ltd., vol. 14(01), pages 1-30, February.
    12. Stéphane Maraut & Catalina Martínez, 2014. "Identifying author–inventors from Spain: methods and a first insight into results," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 445-476, October.
    13. Zvi Griliches, 1998. "Patent Statistics as Economic Indicators: A Survey," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 287-343, National Bureau of Economic Research, Inc.
    14. Friedrich Dornbusch & Ulrich Schmoch & Nicole Schulze & Nadine Bethke, 2012. "Identification of university-based patents: A new large-scale approach," Research Evaluation, Oxford University Press, vol. 22(1), pages 52-63, November.
    15. Onken, James & Aragon, Richard & Calcagno, Anna Maria, 2019. "Geographically-related outcomes of U.S. funding for small business research and development: Results of the research grant programs of a component of the National Institutes of Health," Evaluation and Program Planning, Elsevier, vol. 77(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sandro Mendonca & Hugo Confraria & Manuel Mira Godinho, 2021. "Appropriating the returns of patent statistics: Take-up and development in the wake of Zvi Griliches," SPRU Working Paper Series 2021-07, SPRU - Science Policy Research Unit, University of Sussex Business School.
    2. Zhang, Feng & Jiang, Guohua & Cantwell, John A., 2019. "Geographically Dispersed Technological Capability Building and MNC Innovative Performance: The Role of Intra-firm Flows of Newly Absorbed Knowledge," Journal of International Management, Elsevier, vol. 25(3), pages 1-1.
    3. Nelson, Andrew J., 2009. "Measuring knowledge spillovers: What patents, licenses and publications reveal about innovation diffusion," Research Policy, Elsevier, vol. 38(6), pages 994-1005, July.
    4. Gamba, Simona, 2017. "The Effect of Intellectual Property Rights on Domestic Innovation in the Pharmaceutical Sector," World Development, Elsevier, vol. 99(C), pages 15-27.
    5. Albino, Vito & Ardito, Lorenzo & Dangelico, Rosa Maria & Messeni Petruzzelli, Antonio, 2014. "Understanding the development trends of low-carbon energy technologies: A patent analysis," Applied Energy, Elsevier, vol. 135(C), pages 836-854.
    6. Onken, James & Aragon, Richard & Calcagno, Anna Maria, 2019. "Geographically-related outcomes of U.S. funding for small business research and development: Results of the research grant programs of a component of the National Institutes of Health," Evaluation and Program Planning, Elsevier, vol. 77(C).
    7. Dziallas, Marisa & Blind, Knut, 2019. "Innovation indicators throughout the innovation process: An extensive literature analysis," Technovation, Elsevier, vol. 80, pages 3-29.
    8. Landon Kleis & Paul Chwelos & Ronald V. Ramirez & Iain Cockburn, 2012. "Information Technology and Intangible Output: The Impact of IT Investment on Innovation Productivity," Information Systems Research, INFORMS, vol. 23(1), pages 42-59, March.
    9. Jaimin Goh & Jaehong Lee & Wonchang Hur & Yunchang Ju, 2019. "Do Analysts Fully Reflect Information in Patents about Future Earnings?," Sustainability, MDPI, vol. 11(10), pages 1-17, May.
    10. Triulzi, Giorgio & Alstott, Jeff & Magee, Christopher L., 2020. "Estimating technology performance improvement rates by mining patent data," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    11. Wadhwa, Anu & Phelps, Corey & Kotha, Suresh, 2016. "Corporate venture capital portfolios and firm innovation," Journal of Business Venturing, Elsevier, vol. 31(1), pages 95-112.
    12. Jurriën Bakker & Dennis Verhoeven & Lin Zhang & Bart Van Looy, 2016. "Patent citation indicators: One size fits all?," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 187-211, January.
    13. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    14. Mafini Dosso & Didier Lebert, 2019. "A geography of corporate knowledge flows across world regions: evidence from patent citations of top R&D-investing firms," JRC Working Papers on Corporate R&D and Innovation 2019-03, Joint Research Centre.
    15. Rong, Zhao & Wu, Xiaokai & Boeing, Philipp, 2017. "The effect of institutional ownership on firm innovation: Evidence from Chinese listed firms," Research Policy, Elsevier, vol. 46(9), pages 1533-1551.
    16. Yamashita, Nobuaki, 2021. "Economic crisis and innovation capacity of Japan: Evidence from cross-country patent citations," Technovation, Elsevier, vol. 101(C).
    17. Keijl, S. & Gilsing, V.A. & Knoben, J. & Duysters, G., 2016. "The two faces of inventions: The relationship between recombination and impact in pharmaceutical biotechnology," Research Policy, Elsevier, vol. 45(5), pages 1061-1074.
    18. Laursen, Keld & Leten, Bart & Nguyen, Ngoc Han & Vancauteren, Mark, 2020. "Mounting corporate innovation performance: The effects of high-skilled migrant hires and integration capacity," Research Policy, Elsevier, vol. 49(9).
    19. Burhan, Muqbil & Singh, Anil K. & Jain, Sudhir K., 2017. "Patents as proxy for measuring innovations: A case of changing patent filing behavior in Indian public funded research organizations," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 181-190.
    20. Hagedoorn, John & Wang, Ning, 2012. "Is there complementarity or substitutability between internal and external R&D strategies?," Research Policy, Elsevier, vol. 41(6), pages 1072-1083.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:77:y:2019:i:c:s0149718918303987. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.