IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v18y1994i1p11-19.html
   My bibliography  Save this article

Assessing Research Impact

Author

Listed:
  • Ronald N. Kostoff

    (Office of Naval Research)

Abstract

Three types of semiquantitative methods used by the federal government in research impact assessment are presented. These include the classic retrospective method (Project Hindsight), another retrospective approach (Project TRACES andfollow-ons), and accomplishments books used by selected research-sponsoring organizations (Office of Naval Research, Air Force Office of Scientific Research, Department of Energy Office of Health and Environmental Research, Department of Energy High Energy Physics Program, Defense Advanced Research Projects Agency). The strengths and weaknesses of each approach are discussed. One goal of all the studies presented was to identify the products of research and some of their impacts. In addition, the Hindsight, the technology in retrospect and critical events in science (TRACES), and the Defense Advanced Research Projects Agency (DARPA) studies tried to identify factors that influenced the productivity and impact of research. The following general conclusions about the role and impact of basic research were reached: (1) the majority of basic research events that directly affected technologies or systems were nonmission oriented and occurred many decades before the technology or the system emerged; (2) the cumulative indirect impacts of basic research were not accounted for by any of the retrospective approaches published; (3) an advanced pool of knowledge must be developed in many fields before synthesis leading to an innovation can occur; and (4) allocation of benefits among researchers, organizations, and funding agencies to determine economic returns from basic research is very difficult and arbitrary, especially at the microlevel.

Suggested Citation

  • Ronald N. Kostoff, 1994. "Assessing Research Impact," Evaluation Review, , vol. 18(1), pages 11-19, February.
    • Handle: RePEc:sae:evarev:v:18:y:1994:i:1:p:11-19
    DOI: 10.1177/0193841X9401800102
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X9401800102
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X9401800102?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mansfield, Edwin, 1991. "Academic research and industrial innovation," Research Policy, Elsevier, vol. 20(1), pages 1-12, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wipo, 2011. "World Intellectual Property Report 2011- The Changing Face of Innovation," WIPO Economics & Statistics Series, World Intellectual Property Organization - Economics and Statistics Division, number 2011:944, April.
    2. Subhra Saha & Joseph Staudt & Bruce Weinbergx, 2017. "Estimating the Local Productivity Spillovers from Science," Working Papers 17-56, Center for Economic Studies, U.S. Census Bureau.
    3. Thomas Ã…stebro, 1998. "Basic Statistics on the Success Rate and Profits for Independent Inventors," Entrepreneurship Theory and Practice, , vol. 23(2), pages 41-48, December.
    4. Mohammadi, Ali & Broström, Anders & Franzoni, Chiara, 2015. "Work Force Composition and Innovation: How Diversity in Employees’ Ethnical and Disciplinary Backgrounds Facilitates Knowledge Re-combination," Working Paper Series in Economics and Institutions of Innovation 413, Royal Institute of Technology, CESIS - Centre of Excellence for Science and Innovation Studies.
    5. Yi-Min Chen, 2008. "How Much Does Country Matter?," International Regional Science Review, , vol. 31(4), pages 404-435, October.
    6. David Grosse Kathoefer & Jens Leker, 2012. "Knowledge transfer in academia: an exploratory study on the Not-Invented-Here Syndrome," The Journal of Technology Transfer, Springer, vol. 37(5), pages 658-675, October.
    7. Andrea, Bastianin & Paolo, Castelnuovo & Massimo, Florio & Anna, Giunta, 2019. "Technological Learning and Innovation Gestation Lags at the Frontier of Science: from CERN Procurement to Patents," Working Papers 405, University of Milano-Bicocca, Department of Economics, revised Apr 2019.
    8. Federico Caviggioli & Alessandra Colombelli & Antonio De Marco & Giuseppe Scellato & Elisa Ughetto, 2023. "Co-evolution patterns of university patenting and technological specialization in European regions," The Journal of Technology Transfer, Springer, vol. 48(1), pages 216-239, February.
    9. Grandi, Alessandro & Grimaldi, Rosa, 2005. "Academics' organizational characteristics and the generation of successful business ideas," Journal of Business Venturing, Elsevier, vol. 20(6), pages 821-845, November.
    10. Cassiman, Bruno & Veugelers, Reinhilde & Zuniga, Pluvia, 2009. "Diversity of science linkages and innovation performance: some empirical evidence from Flemish firms," Economics Discussion Papers 2009-30, Kiel Institute for the World Economy (IfW Kiel).
    11. Aschhoff, Birgit & Sofka, Wolfgang, 2008. "Successful Patterns of Scientific Knowledge Sourcing: Mix and Match," ZEW Discussion Papers 08-033 [rev.], ZEW - Leibniz Centre for European Economic Research.
    12. R. J. W. Tussen & R. K. Buter & Th. N. van Leeuwen, 2000. "Technological Relevance of Science: An Assessment of Citation Linkages between Patents and Research Papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 389-412, February.
    13. Maria Rosaria Carillo & Erasmo Papagni, 2004. "Incentive Structure In Basic Research And Economic Growth," Working Papers 9_2004, D.E.S. (Department of Economic Studies), University of Naples "Parthenope", Italy.
    14. Blind, Knut & Grupp, Hariolf, 1999. "Interdependencies between the science and technology infrastructure and innovation activities in German regions: empirical findings and policy consequences," Research Policy, Elsevier, vol. 28(5), pages 451-468, June.
    15. Varga, Attila, 2004. "Az egyetemi kutatások regionális gazdasági hatásai a nemzetközi szakirodalom tükrében [Regional economic effects of university researches in the light of international literature]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(3), pages 259-275.
    16. Alberto Marzucchi & Davide Antonioli & Sandro Montresor, 2012. "Research cooperation within and across regional boundaries. Does innovation policy add anything?," JRC Research Reports JRC76320, Joint Research Centre.
    17. Watzinger, Martin & Schnitzer, Monika, 2019. "Standing on the Shoulders of Science," Rationality and Competition Discussion Paper Series 215, CRC TRR 190 Rationality and Competition.
    18. Bronwyn H. Hall & Albert N. Link & John T. Scott, 2003. "Universities as Research Partners," The Review of Economics and Statistics, MIT Press, vol. 85(2), pages 485-491, May.
    19. Martina Kauffeld-Monz, 2005. "Knowledge spillovers within regional networks of innovation and the contribution made by public research," ERSA conference papers ersa05p440, European Regional Science Association.
    20. Manuela Gussoni, 2009. "The determinants of inter-firms R&D cooperation and partner selection. A literature overview," Discussion Papers 2009/86, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:18:y:1994:i:1:p:11-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.