IDEAS home Printed from https://ideas.repec.org/a/eee/teinso/v66y2021ics0160791x2100049x.html
   My bibliography  Save this article

A methodology for identifying results and impacts in technological innovation projects

Author

Listed:
  • de Almeida, Liliane
  • Augusto de Jesus Pacheco, Diego
  • Caten, Carla Schwengber ten
  • Jung, Carlos Fernando

Abstract

As investments in policies and projects in science, technology, and innovation (STI) grow, it becomes increasingly important to determine the benefits society receives in return for the public resources thus invested. However, existing methodologies are somewhat limited in scope as they do not possess mechanisms for correctly identifying non-measurable, indirect results and impacts. This study addresses these knowledge shortcomings, and it proposes and validates an alternative method to identify the social, environmental, and economic outcomes and indirect impacts of STI projects. Findings indicate that the proposed method helps fills the gaps in knowledge about ex-post methodologies used to evaluate indirect results and impacts in STI projects. One aspect that sets the proposed method apart from the existing approaches is that it contemplates a wide range of analytical categories of indirect impacts for assessing the effects of STI projects. The principal academic and practical contribution of this study is the development of an accessible artifact that can identify the results and indirect impacts of projects in diverse areas of STI. The study extends the understanding on the methodologies to identifying results and indirect impacts of STI projects.

Suggested Citation

  • de Almeida, Liliane & Augusto de Jesus Pacheco, Diego & Caten, Carla Schwengber ten & Jung, Carlos Fernando, 2021. "A methodology for identifying results and impacts in technological innovation projects," Technology in Society, Elsevier, vol. 66(C).
    • Handle: RePEc:eee:teinso:v:66:y:2021:i:c:s0160791x2100049x
    DOI: 10.1016/j.techsoc.2021.101574
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160791X2100049X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techsoc.2021.101574?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Salter, Ammon J. & Martin, Ben R., 2001. "The economic benefits of publicly funded basic research: a critical review," Research Policy, Elsevier, vol. 30(3), pages 509-532, March.
    2. David Güemes‐Castorena & Idalia E. Ponce‐Jaramillo, 2019. "University–Industry Linkage Framework to Identify Opportunity Areas," Review of Policy Research, Policy Studies Organization, vol. 36(5), pages 660-682, September.
    3. Gretchen B Jordan, 2010. "A theory-based logic model for innovation policy and evaluation," Research Evaluation, Oxford University Press, vol. 19(4), pages 263-273, October.
    4. Channing Arndt & Karl Pauw & James Thurlow, 2016. "The Economy-wide Impacts and Risks of Malawi's Farm Input Subsidy Program," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(3), pages 962-980.
    5. Kwayu, Emmanuel J. & Paavola, Jouni & Sallu, Susannah M., 2017. "The livelihood impacts of the Equitable Payments for Watershed Services (EPWS) Program in Morogoro, Tanzania," Environment and Development Economics, Cambridge University Press, vol. 22(3), pages 328-349, June.
    6. André Tosi Furtado & Edmilson Jesus Costa Filho, 2003. "Assessing the economic impacts of the China-Brazil resources satellite program," Science and Public Policy, Oxford University Press, vol. 30(1), pages 25-39, February.
    7. Martin Ravallion, 2009. "Evaluation in the Practice of Development," The World Bank Research Observer, World Bank, vol. 24(1), pages 29-53, March.
    8. Montmartin, Benjamin & Herrera, Marcos, 2015. "Internal and external effects of R&D subsidies and fiscal incentives: Empirical evidence using spatial dynamic panel models," Research Policy, Elsevier, vol. 44(5), pages 1065-1079.
    9. Freeman, Chris, 1995. "The 'National System of Innovation' in Historical Perspective," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 19(1), pages 5-24, February.
    10. Rau, Henrike & Goggins, Gary & Fahy, Frances, 2018. "From invisibility to impact: Recognising the scientific and societal relevance of interdisciplinary sustainability research," Research Policy, Elsevier, vol. 47(1), pages 266-276.
    11. De Moortel, Kevin & Crispeels, Thomas, 2018. "International university-university technology transfer: Strategic management framework," Technological Forecasting and Social Change, Elsevier, vol. 135(C), pages 145-155.
    12. Graeme Auld, 2018. "Over a Decade of Scholarship on the Politics and Policy of Science and Technology," Review of Policy Research, Policy Studies Organization, vol. 35(1), pages 4-11, January.
    13. Mario Coccia, 2008. "Spatial mobility of knowledge transfer and absorptive capacity: analysis and measurement of the impact within the geoeconomic space," The Journal of Technology Transfer, Springer, vol. 33(1), pages 105-122, February.
    14. Huergo, Elena & Moreno, Lourdes, 2014. "National or international public funding? Subsidies or loans? Evaluating the innovation impact of R&D support programmes," MPRA Paper 54218, University Library of Munich, Germany.
    15. Chen, Zhenhua & Daito, Nobuhiko & Gifford, Jonathan L., 2017. "Socioeconomic impacts of transportation public-private partnerships: A dynamic CGE assessment," Transport Policy, Elsevier, vol. 58(C), pages 80-87.
    16. Coccia, Mario, 2019. "Why do nations produce science advances and new technology?," Technology in Society, Elsevier, vol. 59(C).
    17. Bozeman, Barry & Youtie, Jan, 2017. "Socio-economic impacts and public value of government-funded research: Lessons from four US National Science Foundation initiatives," Research Policy, Elsevier, vol. 46(8), pages 1387-1398.
    18. Youwen Zhong & Xiaoling Wu, 2020. "Effects of cost-benefit analysis under back propagation neural network on financial benefit evaluation of investment projects," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-15, March.
    19. Junichi Nishimura & Hiroyuki Okamuro, 2016. "Knowledge and rent spillovers through government-sponsored R&D consortia," Science and Public Policy, Oxford University Press, vol. 43(2), pages 207-225.
    20. Ivanova, Inga & Strand, Øivind & Kushnir, Duncan & Leydesdorff, Loet, 2017. "Economic and technological complexity: A model study of indicators of knowledge-based innovation systems," Technological Forecasting and Social Change, Elsevier, vol. 120(C), pages 77-89.
    21. Ernst, Anna & Biß, Klaus H. & Shamon, Hawal & Schumann, Diana & Heinrichs, Heidi U., 2018. "Benefits and challenges of participatory methods in qualitative energy scenario development," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 245-257.
    22. Fox, Stephen & Griffy-Brown, Charla & Dabic, Marina, 2020. "From socio-technical systems to biosocial technical systems: New themes and new guidance for the field of technology in society," Technology in Society, Elsevier, vol. 62(C).
    23. Davoudabadi, Reza & Mousavi, Seyed Meysam & Mohagheghi, Vahid, 2021. "A new decision model based on DEA and simulation to evaluate renewable energy projects under interval-valued intuitionistic fuzzy uncertainty," Renewable Energy, Elsevier, vol. 164(C), pages 1588-1601.
    24. Beegle, Kathleen & Galasso, Emanuela & Goldberg, Jessica, 2017. "Direct and indirect effects of Malawi's public works program on food security," Journal of Development Economics, Elsevier, vol. 128(C), pages 1-23.
    25. Ma, Ding & Yu, Qian & Li, Jing & Ge, Mengni, 2021. "Innovation diffusion enabler or barrier: An investigation of international patenting based on temporal exponential random graph models," Technology in Society, Elsevier, vol. 64(C).
    26. Bozeman, Barry & Rimes, Heather & Youtie, Jan, 2015. "The evolving state-of-the-art in technology transfer research: Revisiting the contingent effectiveness model," Research Policy, Elsevier, vol. 44(1), pages 34-49.
    27. Federico Stezano, 2018. "The Role of Technology Centers as Intermediary Organizations Facilitating Links for Innovation: Four Cases of Federal Technology Centers in Mexico," Review of Policy Research, Policy Studies Organization, vol. 35(4), pages 642-666, July.
    28. Laurie E. Adkin, 2019. "Technology Innovation as a Response to Climate Change: The Case of the Climate Change Emissions Management Corporation of Alberta," Review of Policy Research, Policy Studies Organization, vol. 36(5), pages 603-634, September.
    29. Huergo, Elena & Moreno, Lourdes, 2017. "Subsidies or loans? Evaluating the impact of R&D support programmes," Research Policy, Elsevier, vol. 46(7), pages 1198-1214.
    30. Gordon Kingsley & Julia Melkers, 1999. "Value mapping social capital outcomes in state research and development programs," Research Evaluation, Oxford University Press, vol. 8(3), pages 165-175, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ferreira, Paula & Rocha, Ana & Araujo, Madalena & Afonso, Joao L. & Antunes, Carlos Henggeler & Lopes, Marta A.R. & Osório, Gerardo J. & Catalão, João P.S. & Lopes, João Peças, 2023. "Assessing the societal impact of smart grids: Outcomes of a collaborative research project," Technology in Society, Elsevier, vol. 72(C).
    2. Wang, Lei & Chen, Yangyang & Ramsey, Thomas Stephen & Hewings, Geoffrey J.D., 2021. "Will researching digital technology really empower green development?," Technology in Society, Elsevier, vol. 66(C).
    3. Allers, Sanne & Eijkenaar, Frank & van Raaij, Erik M. & Schut, Frederik T., 2023. "The long and winding road towards payment for healthcare innovation with high societal value but limited commercial value: A comparative case study of devices and health information technologies," Technology in Society, Elsevier, vol. 75(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    2. Montmartin, Benjamin & Herrera, Marcos & Massard, Nadine, 2018. "The impact of the French policy mix on business R&D: How geography matters," Research Policy, Elsevier, vol. 47(10), pages 2010-2027.
    3. Gao, Kang & Yuan, Yijun, 2022. "Government intervention, spillover effect and urban innovation performance: Empirical evidence from national innovative city pilot policy in China," Technology in Society, Elsevier, vol. 70(C).
    4. repec:hal:spmain:info:hdl:2441/7rrsl07p559bjr85tr7hsft1o9 is not listed on IDEAS
    5. Huseyin Emre Sayici & Mehmet Fatih Ulu, 2023. "Economic Effects of R&D Supports," Koç University-TUSIAD Economic Research Forum Working Papers 2308, Koc University-TUSIAD Economic Research Forum.
    6. Benjamin Montmartin & Marcos Herrera & Nadine Massard, 2017. "R&D Policy regimes in France: New Evidence from a spatio-temporal Analysis," GREDEG Working Papers 2017-22, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    7. repec:spo:wpmain:info:hdl:2441/7rrsl07p559bjr85tr7hsft1o9 is not listed on IDEAS
    8. Viktorie Klímová & Vladimír Žítek & Maria Králová, 2020. "How Public R&D Support Affects Research Activity of Enterprises: Evidence from the Czech Republic," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 11(3), pages 888-907, September.
    9. Qinghua Xia & Qinwei Cao & Manqing Tan, 2020. "Basic research intensity and diversified performance: the moderating role of government support intensity," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 577-605, October.
    10. Weidong Meng & Ye Wang & Yuyu Li & Bo Huang, 2020. "Impact of product subsidies on R&D investment for new energy vehicle firms: Considering quality preference of the early adopter group," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-14, July.
    11. Hongchen Li & Huijun Qi & Hongjian Cao & Li Yuan, 2022. "Industrial Policy and Technological Innovation of New Energy Vehicle Industry in China," Energies, MDPI, vol. 15(24), pages 1-17, December.
    12. Kou, Mingting & Yang, Yuanqi & Chen, Kaihua, 2020. "The impact of external R&D financing on innovation process from a supply-demand perspective," Economic Modelling, Elsevier, vol. 92(C), pages 375-387.
    13. Caloffi, Annalisa & Freo, Marzia & Ghinoi, Stefano & Mariani, Marco & Rossi, Federica, 2022. "Assessing the effects of a deliberate policy mix: The case of technology and innovation advisory services and innovation vouchers," Research Policy, Elsevier, vol. 51(6).
    14. Hoppmann, Joern, 2021. "Hand in hand to Nowhereland? How the resource dependence of research institutes influences their co-evolution with industry," Research Policy, Elsevier, vol. 50(2).
    15. Zhang, Hongyan & Zhang, Lin, 2023. "Public support and energy innovation: Why do firms react differently?," Energy Economics, Elsevier, vol. 119(C).
    16. Michel Dumont, 2015. "Working Paper 05-15 - Evaluation of federal tax incentives for private R&D in Belgium: An update," Working Papers 1505, Federal Planning Bureau, Belgium.
    17. Hailin Yao & Wei Huang, 2022. "Effect of R&D Subsidies on External Collaborative Networks and the Sustainable Innovation Performance of Strategic Emerging Enterprises: Evidence from China," Sustainability, MDPI, vol. 14(8), pages 1-19, April.
    18. Liliana Gelabert & Martín Pereyra & Flavia Roldán, 2021. "Public support prevalence and innovation behavior. Uruguay 2007-2015," Documentos de Investigación 127, Universidad ORT Uruguay. Facultad de Administración y Ciencias Sociales.
    19. Fanbo Li & Hongfeng Zhang, 2022. "How the “Absorption Processes” of Urban Innovation Contribute to Sustainable Development—A Fussy Set Qualitative Comparative Analysis Based on Seventy-Two Cities in China," Sustainability, MDPI, vol. 14(23), pages 1-22, November.
    20. TIAN, Xiaoli & KOU, Gang & ZHANG, Weike, 2020. "Geographic distance, venture capital and technological performance: Evidence from Chinese enterprises," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    21. Michel Dumont & André Spithoven & Peter Teirlinck, 2016. "Public Support for R&D and the Educational Mix of R&D Employees," CESifo Economic Studies, CESifo Group, vol. 62(3), pages 426-452.
    22. Mar�a Garc�a-Vega & Elena Huergo, 2019. "Asymmetric additionalities between R&D outsourcing locations," Discussion Papers 2019-08, University of Nottingham, GEP.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:teinso:v:66:y:2021:i:c:s0160791x2100049x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/technology-in-society .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.