IDEAS home Printed from https://ideas.repec.org/a/eee/techno/v72-73y2018ip1-12.html
   My bibliography  Save this article

How to improve a technology evaluation model: A data-driven approach

Author

Listed:
  • Noh, Heeyong
  • Seo, Ju-Hwan
  • Sun Yoo, Hyoung
  • Lee, Sungjoo

Abstract

Academic research suggests a number of technology evaluation models. To ensure effective use, models need to be improved in accordance with changing internal and external environments. However, a majority of previous studies focus on model development, while a few emphasize their implementation or improvement. To fill this research gap, this study suggests a systematic approach to examining the validity of technology evaluation models and improving them. We consider three propositions as criteria for improvement: 1) the coherence of the evaluation results with the evaluation purpose, 2) the appropriateness of the evaluation methods, and 3) the concreteness of the evaluation model. Rather than using expert opinions, this study takes a data-driven approach, wherein we analyze actual evaluation results and determine whether the model produces the intended results. A case study of 291 technology evaluation results, all made by the South Korean government in support of technology-based small and medium-sized enterprises, is conducted to verify the suggested approach's applicability. This is one of the few studies to address issues regarding improvements to a technology evaluation model. Its approach can help to develop and continuously improve a valid technology evaluation model, thus leading to more effective practice.

Suggested Citation

  • Noh, Heeyong & Seo, Ju-Hwan & Sun Yoo, Hyoung & Lee, Sungjoo, 2018. "How to improve a technology evaluation model: A data-driven approach," Technovation, Elsevier, vol. 72, pages 1-12.
    • Handle: RePEc:eee:techno:v:72-73:y:2018:i::p:1-12
    DOI: 10.1016/j.technovation.2017.10.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0166497217307824
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.technovation.2017.10.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Santiago, Leonardo P. & Martinelli, Marcela & Eloi-Santos, Daniel T. & Hortac, Luciana Hashiba, 2015. "A framework for assessing a portfolio of technologies for licensing out," Technological Forecasting and Social Change, Elsevier, vol. 99(C), pages 242-251.
    2. Mehdi Mohammadi & Mahdi Elyasi & Mostafa Mohseni Kiasari, 2017. "Technology Assessment: Technological Capability Assessment for Automotive Parts Manufacturers," World Scientific Book Chapters, in: Tugrul U Daim (ed.), MANAGING TECHNOLOGICAL INNOVATION Tools and Methods, chapter 5, pages 103-127, World Scientific Publishing Co. Pte. Ltd..
    3. Lee, Mushin & Son, Byoungho & Om, Kiyong, 1996. "Evaluation of national R&D projects in Korea," Research Policy, Elsevier, vol. 25(5), pages 805-818, August.
    4. Gruber, Marc, 2007. "Uncovering the value of planning in new venture creation: A process and contingency perspective," Journal of Business Venturing, Elsevier, vol. 22(6), pages 782-807, November.
    5. Hsu, David W.L. & Shen, Yung-Chi & Yuan, Benjamin J.C. & Chou, Chiyan James, 2015. "Toward successful commercialization of university technology: Performance drivers of university technology transfer in Taiwan," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 25-39.
    6. Daim, Tugrul & Yates, Diane & Peng, Yicheng & Jimenez, Bertha, 2009. "Technology assessment for clean energy technologies: The case of the Pacific Northwest," Technology in Society, Elsevier, vol. 31(3), pages 232-243.
    7. Roure, Juan B. & Keeley, Robert H., 1990. "Predictors of success in new technology based ventures," Journal of Business Venturing, Elsevier, vol. 5(4), pages 201-220, July.
    8. William E. Souder, 1972. "A Scoring Methodology for Assessing the Suitability of Management Science Models," Management Science, INFORMS, vol. 18(10), pages 526-543, June.
    9. Lee, Sangjae & Kim, Wanki & Kim, Young Min & Lee, Hyoung Yong & Oh, Kyong Joo, 2014. "The prioritization and verification of IT emerging technologies using an analytic hierarchy process and cluster analysis," Technological Forecasting and Social Change, Elsevier, vol. 87(C), pages 292-304.
    10. Lee Cronbach, 1988. "Internal consistency of tests: Analyses old and new," Psychometrika, Springer;The Psychometric Society, vol. 53(1), pages 63-70, March.
    11. Kim, Linsu & Dahlman, Carl J., 1992. "Technology policy for industrialization: An integrative framework and Korea's experience," Research Policy, Elsevier, vol. 21(5), pages 437-452, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Eungchan Kim & Young Seok Ock & Seung-Jun Shin & Wonchul Seo, 2018. "An Approach to Generating Reference Information for Technology Evaluation," Sustainability, MDPI, vol. 10(9), pages 1-19, September.
    2. Song, Kisik & Yun, Siyeong & Kim, Leehee & Lee, Sungjoo, 2022. "Investigating new design concepts based on customer value and patent data: The case of a future mobility door," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    3. Katarína Stachová & Ján Papula & Zdenko Stacho & Lucia Kohnová, 2019. "External Partnerships in Employee Education and Development as the Key to Facing Industry 4.0 Challenges," Sustainability, MDPI, vol. 11(2), pages 1-19, January.
    4. Burmaoglu, Serhat & Sartenaer, Olivier & Porter, Alan, 2019. "Conceptual definition of technology emergence: A long journey from philosophy of science to science policy," Technology in Society, Elsevier, vol. 59(C).
    5. Juhyun Lee & Jiho Kang & Sangsung Park & Dongsik Jang & Junseok Lee, 2020. "A Multi-Class Classification Model for Technology Evaluation," Sustainability, MDPI, vol. 12(15), pages 1-16, July.
    6. Yun, Siyeong & Song, Kisik & Kim, Chulhyun & Lee, Sungjoo, 2021. "From stones to jewellery: Investigating technology opportunities from expired patents," Technovation, Elsevier, vol. 103(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eungchan Kim & Young Seok Ock & Seung-Jun Shin & Wonchul Seo, 2018. "An Approach to Generating Reference Information for Technology Evaluation," Sustainability, MDPI, vol. 10(9), pages 1-19, September.
    2. Jeong, Yujin & Park, Inchae & Yoon, Byungun, 2019. "Identifying emerging Research and Business Development (R&BD) areas based on topic modeling and visualization with intellectual property right data," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 655-672.
    3. M. Lee & K. Om & J. Koh, 1999. "Blind review of research proposals in Korea: Its effectiveness and factors affecting applicant detection," Scientometrics, Springer;Akadémiai Kiadó, vol. 45(1), pages 17-31, May.
    4. Esteban Lafuente & Jasmina Berbegal-Mirabent, 2019. "Assessing the productivity of technology transfer offices: an analysis of the relevance of aspiration performance and portfolio complexity," The Journal of Technology Transfer, Springer, vol. 44(3), pages 778-801, June.
    5. Battaglia, Daniele & Landoni, Paolo & Rizzitelli, Francesco, 2017. "Organizational structures for external growth of University Technology Transfer Offices: An explorative analysis," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 45-56.
    6. Dutrénit, Gabriela & Natera, José Miguel & Puchet Anyul, Martín & Vera-Cruz, Alexandre O., 2019. "Development profiles and accumulation of technological capabilities in Latin America," Technological Forecasting and Social Change, Elsevier, vol. 145(C), pages 396-412.
    7. Tarighi, Sina & Shavvalpour, Saeed, 2021. "Technological development of E&P companies in developing countries: An integrative approach to define and prioritize customized elements of technological capability in EOR," Resources Policy, Elsevier, vol. 72(C).
    8. Jeffery S. McMullen & Dimo Dimov, 2013. "Time and the Entrepreneurial Journey: The Problems and Promise of Studying Entrepreneurship as a Process," Journal of Management Studies, Wiley Blackwell, vol. 50(8), pages 1481-1512, December.
    9. Chi-Yo Huang & Min-Jen Yang & Jeen-Fong Li & Hueiling Chen, 2021. "A DANP-Based NDEA-MOP Approach to Evaluating the Patent Commercialization Performance of Industry–Academic Collaborations," Mathematics, MDPI, vol. 9(18), pages 1-26, September.
    10. Taghizadeh-Hesary, Farhad & Rasoulinezhad, Ehsan & Shahbaz, Muhammad & Vinh Vo, Xuan, 2021. "How energy transition and power consumption are related in Asian economies with different income levels?," Energy, Elsevier, vol. 237(C).
    11. Mohan Babu, G.N., 1999. "The Determinants of Firm-level Technological Performances - A Study on the Indian Capital Goods Sector," UNU-INTECH Discussion Paper Series 1999-01, United Nations University - INTECH.
    12. Grandi, Alessandro & Grimaldi, Rosa, 2005. "Academics' organizational characteristics and the generation of successful business ideas," Journal of Business Venturing, Elsevier, vol. 20(6), pages 821-845, November.
    13. Marco Caliendo & Alexander S. Kritikos & Claudia Stier, 2023. "The influence of start-up motivation on entrepreneurial performance," Small Business Economics, Springer, vol. 61(3), pages 869-889, October.
    14. Sabiiti Mulema, 2019. "Long term Financing and Development of Small and Medium Enterprises in Uganda: A case study of MPK GRAPHICS," International Journal of Science and Business, IJSAB International, vol. 3(3), pages 310-325.
    15. Chen, Cheng-Fen & Sewell, Graham, 1996. "Strategies for technological development in South Korea and Taiwan: the case of semiconductors," Research Policy, Elsevier, vol. 25(5), pages 759-783, August.
    16. Eric L. Hansen & Barbara J. Bird, 1998. "The Stages Model of High-Tech Venture Founding: Tried but True?," Entrepreneurship Theory and Practice, , vol. 22(2), pages 111-122, January.
    17. Matthew A. Shapiro & Han Woo Park, 2012. "Regional development in South Korea: accounting for research area in centrality and networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(1), pages 271-287, January.
    18. Cristina Páez-Avilés & Esteve Juanola-Feliu & Islam Bogachan-Tahirbegi & Mónica Mir & Manel González-Piñero & Josep Samitier, 2015. "Innovation And Technology Transfer Of Medical Devices Fostered By Cross-Disciplinary Communities Of Practitioners," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 19(06), pages 1-27, December.
    19. Tarek Miloud & Arild Aspelund & Mathieu Cabrol, 2012. "Startup valuation by venture capitalists: an empirical study," Post-Print hal-00951664, HAL.
    20. repec:eco:journ2:2017-04-06 is not listed on IDEAS
    21. Diana Hechavarria & Maija Renko & Charles Matthews, 2012. "The nascent entrepreneurship hub: goals, entrepreneurial self-efficacy and start-up outcomes," Small Business Economics, Springer, vol. 39(3), pages 685-701, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:techno:v:72-73:y:2018:i::p:1-12. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/01664972 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.