IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v59y2013i2p504-525.html
   My bibliography  Save this article

Lens or Prism? Patent Citations as a Measure of Knowledge Flows from Public Research

Author

Listed:
  • Michael Roach

    (Fuqua School of Business, Duke University, Durham, North Carolina 27708)

  • Wesley M. Cohen

    (Fuqua School of Business, Duke University, Durham, North Carolina 27708; and National Bureau of Economic Research, Cambridge, Massachusetts 02138)

Abstract

This paper assesses the validity and accuracy of firms' backward patent citations as a measure of knowledge flows from public research by employing a newly constructed data set that matches patents to survey data at the level of the research and development lab. Using survey-based measures of the dimensions of knowledge flows, we identify sources of systematic measurement error associated with backward citations to both patent and nonpatent references. We find that patent citations reflect the codified knowledge flows from public research, but they appear to miss knowledge flows that are more private and contract based in nature, as well as those used in firm basic research. We also find that firms' patenting and citing strategies affect patent citations, making citations less indicative of knowledge flows. In addition, an illustrative analysis examining the magnitude and direction of measurement error bias suggests that measuring knowledge flows with patent citations can lead to substantial underestimation of the effect of public research on firms' innovative performance. Throughout our analyses we find that nonpatent references (e.g., journals, conferences, etc.), not the more commonly used patent references, are a better measure of knowledge originating from public research. This paper was accepted by Lee Fleming, entrepreneurship and innovation.

Suggested Citation

  • Michael Roach & Wesley M. Cohen, 2013. "Lens or Prism? Patent Citations as a Measure of Knowledge Flows from Public Research," Management Science, INFORMS, vol. 59(2), pages 504-525, October.
    • Handle: RePEc:inm:ormnsc:v:59:y:2013:i:2:p:504-525
    DOI: 10.1287/mnsc.1120.1644
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.1120.1644
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.1120.1644?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Juan Alcácer & Michelle Gittelman, 2006. "Patent Citations as a Measure of Knowledge Flows: The Influence of Examiner Citations," The Review of Economics and Statistics, MIT Press, vol. 88(4), pages 774-779, November.
    2. Adam B. Jaffe & Michael S. Fogarty & Bruce A. Banks, 1998. "Evidence from Patents and Patent Citations on the Impact of NASA and Other Federal Labs on Commercial Innovation," Journal of Industrial Economics, Wiley Blackwell, vol. 46(2), pages 183-205, June.
    3. Iain M. Cockburn & Rebecca M. Henderson, 1998. "Absorptive Capacity, Coauthoring Behavior, and the Organization of Research in Drug Discovery," Journal of Industrial Economics, Wiley Blackwell, vol. 46(2), pages 157-182, June.
    4. David C. Mowery & Bhaven N. Sampat & Arvids A. Ziedonis, 2002. "Learning to Patent: Institutional Experience, Learning, and the Characteristics of U.S. University Patents After the Bayh-Dole Act, 1981-1992," Management Science, INFORMS, vol. 48(1), pages 73-89, January.
    5. Arora, Ashish & Ceccagnoli, Marco & Cohen, Wesley M., 2008. "R&D and the patent premium," International Journal of Industrial Organization, Elsevier, vol. 26(5), pages 1153-1179, September.
    6. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    7. Adam B. Jaffe & Manuel Trajtenberg & Rebecca Henderson, 1993. "Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 577-598.
    8. David D. Friedman & William M. Landes & Richard A. Posner, 1991. "Some Economics of Trade Secret Law," Journal of Economic Perspectives, American Economic Association, vol. 5(1), pages 61-72, Winter.
    9. Jasjit Singh & Ajay Agrawal, 2011. "Recruiting for Ideas: How Firms Exploit the Prior Inventions of New Hires," Management Science, INFORMS, vol. 57(1), pages 129-150, January.
    10. Rebecca Henderson & Adam B. Jaffe & Manuel Trajtenberg, 1998. "Universities As A Source Of Commercial Technology: A Detailed Analysis Of University Patenting, 1965-1988," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 119-127, February.
    11. Hall, B. & Jaffe, A. & Trajtenberg, M., 2001. "The NBER Patent Citations Data File: Lessons, Insights and Methodological Tools," Papers 2001-29, Tel Aviv.
    12. Ryan Lampe, 2012. "Strategic Citation," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 320-333, February.
    13. repec:fth:harver:1473 is not listed on IDEAS
    14. J.J. Heckman & E.E. Leamer (ed.), 2001. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 5, number 5.
    15. Mowery, David C. & Ziedonis, Arvids A., 2002. "Academic patent quality and quantity before and after the Bayh-Dole act in the United States," Research Policy, Elsevier, vol. 31(3), pages 399-418, March.
    16. Zvi Griliches, 1998. "Patent Statistics as Economic Indicators: A Survey," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 287-343, National Bureau of Economic Research, Inc.
    17. Jasjit Singh, 2005. "Collaborative Networks as Determinants of Knowledge Diffusion Patterns," Management Science, INFORMS, vol. 51(5), pages 756-770, May.
    18. Megan MacGarvie, 2006. "Do Firms Learn from International Trade?," The Review of Economics and Statistics, MIT Press, vol. 88(1), pages 46-60, February.
    19. Wesley M. Cohen & Richard R. Nelson & John P. Walsh, 2000. "Protecting Their Intellectual Assets: Appropriability Conditions and Why U.S. Manufacturing Firms Patent (or Not)," NBER Working Papers 7552, National Bureau of Economic Research, Inc.
    20. Mark A. Lemley & Bhaven Sampat, 2012. "Examiner Characteristics and Patent Office Outcomes," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 817-827, August.
    21. Lee Branstetter & Yoshiaki Ogura, 2005. "Is Academic Science Driving a Surge in Industrial Innovation? Evidence from Patent Citations," NBER Working Papers 11561, National Bureau of Economic Research, Inc.
    22. Hicks, Diana, 1995. "Published Papers, Tacit Competencies and Corporate Management of the Public/Private Character of Knowledge," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 4(2), pages 401-424.
    23. Cockburn, Iain M & Henderson, Rebecca M, 1998. "Absorptive Capacity, Coauthoring Behavior, and the Organization of Research in Drug Discovery," Journal of Industrial Economics, Wiley Blackwell, vol. 46(2), pages 157-182, June.
    24. Sorenson, Olav & Fleming, Lee, 2004. "Science and the diffusion of knowledge," Research Policy, Elsevier, vol. 33(10), pages 1615-1634, December.
    25. Wesley M. Cohen & Richard R. Nelson & John P. Walsh, 2003. "Links and Impacts: The Influence of Public Research on Industrial R&D," Chapters, in: Aldo Geuna & Ammon J. Salter & W. Edward Steinmueller (ed.), Science and Innovation, chapter 4, Edward Elgar Publishing.
    26. Giovanni Peri, 2005. "Determinants of Knowledge Flows and Their Effect on Innovation," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 308-322, May.
    27. Lori Rosenkopf & Paul Almeida, 2003. "Overcoming Local Search Through Alliances and Mobility," Management Science, INFORMS, vol. 49(6), pages 751-766, June.
    28. Lori Rosenkopf & Atul Nerkar, 2001. "Beyond local search: boundary‐spanning, exploration, and impact in the optical disk industry," Strategic Management Journal, Wiley Blackwell, vol. 22(4), pages 287-306, April.
    29. Paul Almeida & Bruce Kogut, 1999. "Localization of Knowledge and the Mobility of Engineers in Regional Networks," Management Science, INFORMS, vol. 45(7), pages 905-917, July.
    30. Emmanuel Duguet & Megan MacGarvie, 2005. "How well do patent citations measure flows of technology? Evidence from French innovation surveys," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 14(5), pages 375-393.
    31. Jerry G. Thursby & Marie C. Thursby, 2002. "Who Is Selling the Ivory Tower? Sources of Growth in University Licensing," Management Science, INFORMS, vol. 48(1), pages 90-104, January.
    32. Scherer, F. M., 1983. "The propensity to patent," International Journal of Industrial Organization, Elsevier, vol. 1(1), pages 107-128, March.
    33. Pavitt, Keith, 1991. "What makes basic research economically useful?," Research Policy, Elsevier, vol. 20(2), pages 109-119, April.
    34. Lee Fleming & Olav Sorenson, 2004. "Science as a map in technological search," Strategic Management Journal, Wiley Blackwell, vol. 25(8‐9), pages 909-928, August.
    35. Dietmar Harhoff & Francis Narin & F. M. Scherer & Katrin Vopel, 1999. "Citation Frequency And The Value Of Patented Inventions," The Review of Economics and Statistics, MIT Press, vol. 81(3), pages 511-515, August.
    36. Nathan ROSENBERG, 2009. "Why do firms do basic research (with their own money)?," World Scientific Book Chapters, in: Nathan Rosenberg (ed.), Studies On Science And The Innovation Process Selected Works of Nathan Rosenberg, chapter 11, pages 225-234, World Scientific Publishing Co. Pte. Ltd..
    37. Michelle Gittelman & Bruce Kogut, 2003. "Does Good Science Lead to Valuable Knowledge? Biotechnology Firms and the Evolutionary Logic of Citation Patterns," Management Science, INFORMS, vol. 49(4), pages 366-382, April.
    38. Horstmann, Ignatius & MacDonald, Glenn M & Slivinski, Alan, 1985. "Patents as Information Transfer Mechanisms: To Patent or (Maybe) Not to Patent," Journal of Political Economy, University of Chicago Press, vol. 93(5), pages 837-858, October.
    39. Ajay Agrawal & Rebecca Henderson, 2002. "Putting Patents in Context: Exploring Knowledge Transfer from MIT," Management Science, INFORMS, vol. 48(1), pages 44-60, January.
    40. Narin, Francis & Hamilton, Kimberly S. & Olivastro, Dominic, 1997. "The increasing linkage between U.S. technology and public science," Research Policy, Elsevier, vol. 26(3), pages 317-330, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Roach & Wesley M. Cohen, 2012. "Lens or Prism? Patent Citations as a Measure of Knowledge Flows from Public Research," NBER Working Papers 18292, National Bureau of Economic Research, Inc.
    2. Alessandra Scandura, 2019. "The role of scientific and market knowledge in the inventive process: evidence from a survey of industrial inventors," The Journal of Technology Transfer, Springer, vol. 44(4), pages 1029-1069, August.
    3. Nelson, Andrew J., 2009. "Measuring knowledge spillovers: What patents, licenses and publications reveal about innovation diffusion," Research Policy, Elsevier, vol. 38(6), pages 994-1005, July.
    4. Hohberger, Jan, 2016. "Diffusion of science-based inventions," Technological Forecasting and Social Change, Elsevier, vol. 104(C), pages 66-77.
    5. Leten, Bart & Kelchtermans, Stijn & Belderbos, Ren, 2010. "Internal Basic Research, External Basic Research and the Technological Performance of Pharmaceutical Firms," Working Papers 2010/12, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    6. Sarah Kaplan & Keyvan Vakili, 2015. "The double-edged sword of recombination in breakthrough innovation," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1435-1457, October.
    7. Simeth, Markus & Raffo, Julio D., 2013. "What makes companies pursue an Open Science strategy?," Research Policy, Elsevier, vol. 42(9), pages 1531-1543.
    8. Leten, Bart & Landoni, Paolo & Van Looy, Bart, 2014. "Science or graduates: How do firms benefit from the proximity of universities?," Research Policy, Elsevier, vol. 43(8), pages 1398-1412.
    9. Kenneth Zahringer & Christos Kolympiris & Nicholas Kalaitzandonakes, 2017. "Academic knowledge quality differentials and the quality of firm innovation," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 26(5), pages 821-844.
    10. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    11. Veugelers, Reinhilde & Cassiman, Bruno & Arts, Sam, 2012. "Mind the gap: capturing value from basic research: boundary crossing inventors and partnerships," CEPR Discussion Papers 9215, C.E.P.R. Discussion Papers.
    12. Breschi, Stefano & Catalini, Christian, 2010. "Tracing the links between science and technology: An exploratory analysis of scientists' and inventors' networks," Research Policy, Elsevier, vol. 39(1), pages 14-26, February.
    13. Singh, Jasjit, 2008. "Distributed R&D, cross-regional knowledge integration and quality of innovative output," Research Policy, Elsevier, vol. 37(1), pages 77-96, February.
    14. repec:wip:wpaper:6 is not listed on IDEAS
    15. Cohen, Wesley M., 2010. "Fifty Years of Empirical Studies of Innovative Activity and Performance," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 129-213, Elsevier.
    16. Cassiman, Bruno & Veugelers, Reinhilde & Zuniga, Pluvia, 2009. "Diversity of science linkages and innovation performance: some empirical evidence from Flemish firms," Economics Discussion Papers 2009-30, Kiel Institute for the World Economy (IfW Kiel).
    17. Cassiman, Bruno & Veugelers, Reinhilde & Arts, Sam, 2018. "Mind the gap: Capturing value from basic research through combining mobile inventors and partnerships," Research Policy, Elsevier, vol. 47(9), pages 1811-1824.
    18. Markus Simeth & Michele Cincera, 2016. "Corporate Science, Innovation, and Firm Value," Management Science, INFORMS, vol. 62(7), pages 1970-1981, July.
    19. Stefan Wagner & Karin Hoisl & Grid Thoma, 2014. "Overcoming localization of knowledge — the role of professional service firms," Strategic Management Journal, Wiley Blackwell, vol. 35(11), pages 1671-1688, November.
    20. Bryan, Kevin A. & Ozcan, Yasin & Sampat, Bhaven, 2020. "In-text patent citations: A user's guide," Research Policy, Elsevier, vol. 49(4).
    21. Popp, David, 2017. "From science to technology: The value of knowledge from different energy research institutions," Research Policy, Elsevier, vol. 46(9), pages 1580-1594.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:59:y:2013:i:2:p:504-525. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.