IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v41y2012i4p678-691.html
   My bibliography  Save this article

Putting university research in context: Assessing alternative measures of production and diffusion at Stanford

Author

Listed:
  • Nelson, Andrew J.

Abstract

Scholars widely acknowledge that university research is critical to innovation and entrepreneurship. Much of the literature on university research, however, evokes a linear model from “science to products” and focuses, therefore, upon a limited set of indicators such as patents and licenses. Such a perspective runs the danger of missing the myriad ways in which science and commerce are intertwined and the myriad ways in which these activities might be assessed. In this paper, I address the question of how different measures reflect different perspectives and biases by investigating the production and diffusion of research associated with one of Stanford University's most prolific interdisciplinary centers, the Center for Computer Research in Music and Acoustics (CCRMA). I draw upon a unique data set that captures activities and engagement surrounding CCRMA for its 30-year history through a wide variety of measures, ranging from publication citations to industrial affiliates to personnel mobility. Employing the analytic categories of “description” and “enactment,” and distinguishing between “indicators” and “pathways,” I show how different measures reflect different activities and learning processes, and how they dramatically alter perceptions of active individuals, organizational reach, and timing and sequencing of activities. Building on these findings, I present a more complete model of university research production and diffusion, I discuss how alternative measures challenge certain assumptions in the literature, and I suggest concrete policy initiatives to improve our measurement and assessment of university research.

Suggested Citation

  • Nelson, Andrew J., 2012. "Putting university research in context: Assessing alternative measures of production and diffusion at Stanford," Research Policy, Elsevier, vol. 41(4), pages 678-691.
  • Handle: RePEc:eee:respol:v:41:y:2012:i:4:p:678-691
    DOI: 10.1016/j.respol.2011.11.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733311002204
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2011.11.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    2. Salter, Ammon J. & Martin, Ben R., 2001. "The economic benefits of publicly funded basic research: a critical review," Research Policy, Elsevier, vol. 30(3), pages 509-532, March.
    3. Mowery, David C. & Nelson, Richard R. & Sampat, Bhaven N. & Ziedonis, Arvids A., 2001. "The growth of patenting and licensing by U.S. universities: an assessment of the effects of the Bayh-Dole act of 1980," Research Policy, Elsevier, vol. 30(1), pages 99-119, January.
    4. Mansfield, Edwin, 1991. "Academic research and industrial innovation," Research Policy, Elsevier, vol. 20(1), pages 1-12, February.
    5. Bronwyn H. Hall & Adam Jaffe & Manuel Trajtenberg, 2005. "Market Value and Patent Citations," RAND Journal of Economics, The RAND Corporation, vol. 36(1), pages 16-38, Spring.
    6. Murray, Fiona, 2002. "Innovation as co-evolution of scientific and technological networks: exploring tissue engineering," Research Policy, Elsevier, vol. 31(8-9), pages 1389-1403, December.
    7. Julia Lane, 2010. "Let's make science metrics more scientific," Nature, Nature, vol. 464(7288), pages 488-489, March.
    8. Hagedoorn, John & Cloodt, Myriam, 2003. "Measuring innovative performance: is there an advantage in using multiple indicators?," Research Policy, Elsevier, vol. 32(8), pages 1365-1379, September.
    9. Jaffe, Adam B, 1989. "Real Effects of Academic Research," American Economic Review, American Economic Association, vol. 79(5), pages 957-970, December.
    10. D. Schartinger & C. Rammer & J. Fröhlich, 2006. "Knowledge Interactions between Universities and Industry in Austria: Sectoral Patterns and Determinants," Springer Books, in: Innovation, Networks, and Knowledge Spillovers, chapter 7, pages 135-166, Springer.
    11. Hicks, Diana, 1995. "Published Papers, Tacit Competencies and Corporate Management of the Public/Private Character of Knowledge," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 4(2), pages 401-424.
    12. Thursby, Jerry G. & Kemp, Sukanya, 2002. "Growth and productive efficiency of university intellectual property licensing," Research Policy, Elsevier, vol. 31(1), pages 109-124, January.
    13. Wesley M. Cohen & Richard R. Nelson & John P. Walsh, 2003. "Links and Impacts: The Influence of Public Research on Industrial R&D," Chapters, in: Aldo Geuna & Ammon J. Salter & W. Edward Steinmueller (ed.), Science and Innovation, chapter 4, Edward Elgar Publishing.
    14. Freeman, Christopher & Soete, Luc, 2009. "Developing science, technology and innovation indicators: What we can learn from the past," Research Policy, Elsevier, vol. 38(4), pages 583-589, May.
    15. S. Breschi & F. Lissoni & F. Montobbio, 2007. "The Scientific Productivity Of Academic Inventors: New Evidence From Italian Data," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 16(2), pages 101-118.
    16. Meyer-Krahmer, Frieder & Schmoch, Ulrich, 1998. "Science-based technologies: university-industry interactions in four fields," Research Policy, Elsevier, vol. 27(8), pages 835-851, December.
    17. Thursby, Jerry & Fuller, Anne W. & Thursby, Marie, 2009. "US faculty patenting: Inside and outside the university," Research Policy, Elsevier, vol. 38(1), pages 14-25, February.
    18. Pierre Azoulay & Waverly Ding & Toby Stuart, 2007. "The Determinants of Faculty Patenting Behavior: Demographics or Opportunities?," NBER Chapters, in: Academic Science and Entrepreneurship: Dual Engines of Growth, National Bureau of Economic Research, Inc.
    19. K. J. Arrow, 1971. "The Economic Implications of Learning by Doing," Palgrave Macmillan Books, in: F. H. Hahn (ed.), Readings in the Theory of Growth, chapter 11, pages 131-149, Palgrave Macmillan.
    20. Cowan, Robin & David, Paul A & Foray, Dominique, 2000. "The Explicit Economics of Knowledge Codification and Tacitness," Industrial and Corporate Change, Oxford University Press, vol. 9(2), pages 211-253, June.
    21. Bekkers, Rudi & Bodas Freitas, Isabel Maria, 2008. "Analysing knowledge transfer channels between universities and industry: To what degree do sectors also matter?," Research Policy, Elsevier, vol. 37(10), pages 1837-1853, December.
    22. Adams, James D, 1990. "Fundamental Stocks of Knowledge and Productivity Growth," Journal of Political Economy, University of Chicago Press, vol. 98(4), pages 673-702, August.
    23. Wright, Mike & Clarysse, Bart & Lockett, Andy & Knockaert, Mirjam, 2008. "Mid-range universities' linkages with industry: Knowledge types and the role of intermediaries," Research Policy, Elsevier, vol. 37(8), pages 1205-1223, September.
    24. Foray, Dominique & Lissoni, Francesco, 2010. "University Research and Public–Private Interaction," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 275-314, Elsevier.
    25. Ajay Agrawal & Rebecca Henderson, 2002. "Putting Patents in Context: Exploring Knowledge Transfer from MIT," Management Science, INFORMS, vol. 48(1), pages 44-60, January.
    26. Marie Thursby & Richard Jensen, 2001. "Proofs and Prototypes for Sale: The Licensing of University Inventions," American Economic Review, American Economic Association, vol. 91(1), pages 240-259, March.
    27. Bozeman, Barry & Laredo, Philippe & Mangematin, Vincent, 2007. "Understanding the emergence and deployment of "nano" S&T," Research Policy, Elsevier, vol. 36(6), pages 807-812, July.
    28. Narin, Francis & Hamilton, Kimberly S. & Olivastro, Dominic, 1997. "The increasing linkage between U.S. technology and public science," Research Policy, Elsevier, vol. 26(3), pages 317-330, October.
    29. Colyvas, Jeannette A., 2007. "From divergent meanings to common practices: The early institutionalization of technology transfer in the life sciences at Stanford University," Research Policy, Elsevier, vol. 36(4), pages 456-476, May.
    30. Coupe, Tom, 2003. "Science Is Golden: Academic R&D and University Patents," The Journal of Technology Transfer, Springer, vol. 28(1), pages 31-46, January.
    31. Wesley David Sine & Scott Shane & Dante Di Gregorio, 2003. "The Halo Effect and Technology Licensing: The Influence of Institutional Prestige on the Licensing of University Inventions," Management Science, INFORMS, vol. 49(4), pages 478-496, April.
    32. Michael H. MacRoberts & Barbara R. MacRoberts, 1989. "Problems of citation analysis: A critical review," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 40(5), pages 342-349, September.
    33. Beise, Marian & Stahl, Harald, 1999. "Public research and industrial innovations in Germany," Research Policy, Elsevier, vol. 28(4), pages 397-422, April.
    34. Michelle Gittelman, 2007. "Does Geography Matter for Science-Based Firms? Epistemic Communities and the Geography of Research and Patenting in Biotechnology," Organization Science, INFORMS, vol. 18(4), pages 724-741, August.
    35. Andrew J. Nelson, 2005. "Cacophony or harmony? Multivocal logics and technology licensing by the Stanford University Department of Music," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 14(1), pages 93-118, February.
    36. Azoulay, Pierre & Ding, Waverly & Stuart, Toby, 2007. "The determinants of faculty patenting behavior: Demographics or opportunities?," Journal of Economic Behavior & Organization, Elsevier, vol. 63(4), pages 599-623, August.
    37. Mowery, David C. & Ziedonis, Arvids A., 2002. "Academic patent quality and quantity before and after the Bayh-Dole act in the United States," Research Policy, Elsevier, vol. 31(3), pages 399-418, March.
    38. Fabrizio, Kira R. & Di Minin, Alberto, 2008. "Commercializing the laboratory: Faculty patenting and the open science environment," Research Policy, Elsevier, vol. 37(5), pages 914-931, June.
    39. Nelson, Andrew J., 2009. "Measuring knowledge spillovers: What patents, licenses and publications reveal about innovation diffusion," Research Policy, Elsevier, vol. 38(6), pages 994-1005, July.
    40. Lee Branstetter & Yoshiaki Ogura, 2005. "Is Academic Science Driving a Surge in Industrial Innovation? Evidence from Patent Citations," NBER Working Papers 11561, National Bureau of Economic Research, Inc.
    41. Emmanuel Dechenaux & Brent Goldfarb & Scott Shane & Marie Thursby, 2008. "Appropriability and Commercialization: Evidence from MIT Inventions," Management Science, INFORMS, vol. 54(5), pages 893-906, May.
    42. Rosenberg, Nathan, 1974. "Science, Invention and Economic Growth," Economic Journal, Royal Economic Society, vol. 84(333), pages 90-108, March.
    43. Dietz, James S. & Bozeman, Barry, 2005. "Academic careers, patents, and productivity: industry experience as scientific and technical human capital," Research Policy, Elsevier, vol. 34(3), pages 349-367, April.
    44. Nelson, Richard R, 1986. "Institutions Supporting Technical Advance in Industry," American Economic Review, American Economic Association, vol. 76(2), pages 186-189, May.
    45. Berman, Evan M., 1990. "The economic impact of industry-funded university R&D," Research Policy, Elsevier, vol. 19(4), pages 349-355, August.
    46. Mansfield, Edwin, 1995. "Academic Research Underlying Industrial Innovations:," The Review of Economics and Statistics, MIT Press, vol. 77(1), pages 55-65, February.
    47. Gerard George, 2005. "Learning to be capable: patenting and licensing at the Wisconsin Alumni Research Foundation 1925--2002," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 14(1), pages 119-151, February.
    48. Thursby, Jerry G & Jensen, Richard & Thursby, Marie C, 2001. "Objectives, Characteristics and Outcomes of University Licensing: A Survey of Major U.S. Universities," The Journal of Technology Transfer, Springer, vol. 26(1-2), pages 59-72, January.
    49. Janet Bercovitz & Maryann Feldman, 2006. "Entpreprenerial Universities and Technology Transfer: A Conceptual Framework for Understanding Knowledge-Based Economic Development," The Journal of Technology Transfer, Springer, vol. 31(1), pages 175-188, January.
    50. Rudi Bekkers & Bodas Freitas, 2008. "Analysing preferences for knowledge transfer channels between universities and industry: To what degree do sectors also matter?," Grenoble Ecole de Management (Post-Print) hal-01487467, HAL.
    51. Jason Owen-Smith & Walter W. Powell, 2004. "Knowledge Networks as Channels and Conduits: The Effects of Spillovers in the Boston Biotechnology Community," Organization Science, INFORMS, vol. 15(1), pages 5-21, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Aihua Chen & Donald Patton & Martin Kenney, 2016. "University technology transfer in China: a literature review and taxonomy," The Journal of Technology Transfer, Springer, vol. 41(5), pages 891-929, October.
    2. Andrew J. Nelson, 2016. "How to Share “A Really Good Secret”: Managing Sharing/Secrecy Tensions Around Scientific Knowledge Disclosure," Organization Science, INFORMS, vol. 27(2), pages 265-285, April.
    3. Irene Sala & Maurizio Sobrero, 2021. "Games of policy and practice: multi-level dynamics and the role of universities in knowledge transfer processes," The Journal of Technology Transfer, Springer, vol. 46(4), pages 866-906, August.
    4. Vestal, Alex & Danneels, Erwin, 2018. "Knowledge exchange in clusters: The contingent role of regional inventive concentration," Research Policy, Elsevier, vol. 47(10), pages 1887-1903.
    5. Soo Jeung Lee, 2019. "Academic entrepreneurship: exploring the effects of academic patenting activity on publication and collaboration among heterogeneous researchers in South Korea," The Journal of Technology Transfer, Springer, vol. 44(6), pages 1993-2013, December.
    6. Margit Kirs & Veiko Lember & Erkki Karo, 2021. "Technology transfer in economic periphery: Emerging patterns and policy challenges," Review of Policy Research, Policy Studies Organization, vol. 38(6), pages 677-706, November.
    7. Daniel Ratzinger & Kevin Amess & Andrew Greenman & Simon Mosey, 2018. "The impact of digital start-up founders’ higher education on reaching equity investment milestones," The Journal of Technology Transfer, Springer, vol. 43(3), pages 760-778, June.
    8. Wen Chi Hung, 2012. "Measuring the use of public research in firm R&D in the Hsinchu Science Park," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 63-73, July.
    9. Nelson, Andrew & Earle, Andrew & Howard-Grenville, Jennifer & Haack, Julie & Young, Doug, 2014. "Do innovation measures actually measure innovation? Obliteration, symbolic adoption, and other finicky challenges in tracking innovation diffusion," Research Policy, Elsevier, vol. 43(6), pages 927-940.
    10. Bianchini, Stefano & Llerena, Patrick & Patsali, Sofia, 2019. "Demand-pull innovation in science: Empirical evidence from a research university’s suppliers," Research Policy, Elsevier, vol. 48(S).
    11. Stephan Bieri & Franz Lehner, 2014. "The US Research University – Systemic Limits of a Model," CREMA Working Paper Series 2014-15, Center for Research in Economics, Management and the Arts (CREMA).
    12. Hua Cheng & Shiqian Huang & Yinhong Yu & Zhiying Zhang & Meifen Jiang, 2023. "The 2011 Collaborative Innovation Plan, University-Industry Collaboration and Achievement Transformation of Universities: Evidence from China," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 14(2), pages 1249-1274, June.
    13. Sonali Shah & Emily Pahnke, 2014. "Parting the ivory curtain: understanding how universities support a diverse set of startups," The Journal of Technology Transfer, Springer, vol. 39(5), pages 780-792, October.
    14. Enas Alhassan & R. Sandra Schillo & Margaret A. Lemay & Fred Pries, 2019. "Research Outputs as Vehicles of Knowledge Exchange in a Quintuple Helix Context: The Case of Biofuels Research Outputs," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 10(3), pages 958-973, September.
    15. Hsu, David W.L. & Shen, Yung-Chi & Yuan, Benjamin J.C. & Chou, Chiyan James, 2015. "Toward successful commercialization of university technology: Performance drivers of university technology transfer in Taiwan," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 25-39.
    16. Motoyama, Yasuyuki, 2014. "Long-term collaboration between university and industry: A case study of nanotechnology development in Japan," Technology in Society, Elsevier, vol. 36(C), pages 39-51.
    17. Nelson, Andrew J., 2014. "From the ivory tower to the startup garage: Organizational context and commercialization processes," Research Policy, Elsevier, vol. 43(7), pages 1144-1156.
    18. Claudia Werker & Christian Hopp, 2020. "Balancing act between research and application: how research orientation and networks affect scholars’ academic and commercial output," Journal of Business Economics, Springer, vol. 90(8), pages 1171-1197, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perkmann, Markus & Tartari, Valentina & McKelvey, Maureen & Autio, Erkko & Broström, Anders & D’Este, Pablo & Fini, Riccardo & Geuna, Aldo & Grimaldi, Rosa & Hughes, Alan & Krabel, Stefan & Kitson, Mi, 2013. "Academic engagement and commercialisation: A review of the literature on university–industry relations," Research Policy, Elsevier, vol. 42(2), pages 423-442.
    2. Foray, Dominique & Lissoni, Francesco, 2010. "University Research and Public–Private Interaction," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 275-314, Elsevier.
    3. Nelson, Andrew J., 2009. "Measuring knowledge spillovers: What patents, licenses and publications reveal about innovation diffusion," Research Policy, Elsevier, vol. 38(6), pages 994-1005, July.
    4. Larsen, Maria Theresa, 2011. "The implications of academic enterprise for public science: An overview of the empirical evidence," Research Policy, Elsevier, vol. 40(1), pages 6-19, February.
    5. Beck, Mathias & Junge, Martin & Kaiser, Ulrich, 2017. "Public Funding and Corporate Innovation," IZA Discussion Papers 11196, Institute of Labor Economics (IZA).
    6. Pluvia Zuniga, 2011. "The State of Patenting at Research Institutions in Developing Countries: Policy Approaches and Practices," WIPO Economic Research Working Papers 04, World Intellectual Property Organization - Economics and Statistics Division, revised Dec 2011.
    7. Soo Jeung Lee, 2019. "Academic entrepreneurship: exploring the effects of academic patenting activity on publication and collaboration among heterogeneous researchers in South Korea," The Journal of Technology Transfer, Springer, vol. 44(6), pages 1993-2013, December.
    8. Tartari, Valentina & Perkmann, Markus & Salter, Ammon, 2014. "In good company: The influence of peers on industry engagement by academic scientists," Research Policy, Elsevier, vol. 43(7), pages 1189-1203.
    9. repec:wip:wpaper:4 is not listed on IDEAS
    10. Crespi, Gustavo & D'Este, Pablo & Fontana, Roberto & Geuna, Aldo, 2011. "The impact of academic patenting on university research and its transfer," Research Policy, Elsevier, vol. 40(1), pages 55-68, February.
    11. Dirk Czarnitzki & Katrin Hussinger & Cédric Schneider, 2012. "The nexus between science and industry: evidence from faculty inventions," The Journal of Technology Transfer, Springer, vol. 37(5), pages 755-776, October.
    12. Perkmann, Markus & Walsh, Kathryn, 2008. "Engaging the scholar: Three types of academic consulting and their impact on universities and industry," Research Policy, Elsevier, vol. 37(10), pages 1884-1891, December.
    13. Cornelia Lawson, 2013. "Academic patenting: the importance of industry support," The Journal of Technology Transfer, Springer, vol. 38(4), pages 509-535, August.
    14. Ani Gerbin & Mateja Drnovsek, 2016. "Determinants and public policy implications of academic-industry knowledge transfer in life sciences: a review and a conceptual framework," The Journal of Technology Transfer, Springer, vol. 41(5), pages 979-1076, October.
    15. Gersbach, Hans & Sorger, Gerhard & Amon, Christian, 2018. "Hierarchical growth: Basic and applied research," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 434-459.
    16. Aurora A. C. Teixeira & Luisa Mota, 2012. "A bibliometric portrait of the evolution, scientific roots and influence of the literature on university–industry links," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 719-743, December.
    17. Perkmann, Markus & King, Zella & Pavelin, Stephen, 2011. "Engaging excellence? Effects of faculty quality on university engagement with industry," Research Policy, Elsevier, vol. 40(4), pages 539-552, May.
    18. Andrea Bonaccorsi & Daniele Biancardi & Mabel Sanchez Barrioluengo & Federico Biagi, 2019. "Study on Higher Education Institutions and Local Development," JRC Research Reports JRC117272, Joint Research Centre.
    19. Ugo Rizzo & Nicolò Barbieri & Laura Ramaciotti & Demian Iannantuono, 2020. "The division of labour between academia and industry for the generation of radical inventions," The Journal of Technology Transfer, Springer, vol. 45(2), pages 393-413, April.
    20. Breschi, Stefano & Catalini, Christian, 2010. "Tracing the links between science and technology: An exploratory analysis of scientists' and inventors' networks," Research Policy, Elsevier, vol. 39(1), pages 14-26, February.
    21. Bianchini, Stefano & Llerena, Patrick & Patsali, Sofia, 2019. "Demand-pull innovation in science: Empirical evidence from a research university’s suppliers," Research Policy, Elsevier, vol. 48(S).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:41:y:2012:i:4:p:678-691. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.