IDEAS home Printed from https://ideas.repec.org/a/ers/journl/vxxivy2021i3p402-409.html
   My bibliography  Save this article

Improving the Discovery of Technological Opportunities Using Patent Classification Based on Explainable Neural Networks

Author

Listed:
  • Tadeusz A. Grzeszczyk
  • Michal K. Grzeszczyk

Abstract

Purpose: The paper aims to present an approach supporting the improvement of technological opportunities discovery using patent classification based on explainable neural networks. Design/Methodology/Approach: Empirical research was conducted applying a dataset containing U.S. patent documents. Firstly, this dataset was checked for the correctness of the saved patent data to be further analyzed. Then, a custom Bidirectional Encoder Representations from Transformers (BERT) Neural Network was developed and trained. Finally, the Local Interpretable Model-agnostic Explanations (LIME) method was applied for interpreting the results achieved with the BERT classifier. Findings: The studied classifier achieved high quality (precision of 80.6%), allowing correct classification of the technologies described in the patents. Such neural classifiers are easy to use in practice and highly versatile; however, there is an insufficient trust of managers in the decisions suggested by that black-box method. The proposed new approach may help overcome the lack of trust of the users of neural models towards the technological opportunities suggested by them. Practical Implications: Various patent databases are often used to discover innovative solutions, as well as economic and technological opportunities, because they contain vast resources of prosperous and extensive information recorded in patent documentation. Such analyzes are critical to businesses and public organizations as they help them make decisions about carrying out strategic investment projects. The presented approach, which supports the improvement of automated processes of technological opportunities discovery, may increase confidence in the results obtained using neural classifiers. Originality/Value: Earlier studies focused mainly on using more effective classifiers and better learning algorithms. Progress in this type of research did not help solve the problem of the lack of reliable justification for individual decisions indicated by machine learning models. In this study, a proposal for an approach enables the discovery of technological opportunities using patent classification based on explainable neural networks.

Suggested Citation

  • Tadeusz A. Grzeszczyk & Michal K. Grzeszczyk, 2021. "Improving the Discovery of Technological Opportunities Using Patent Classification Based on Explainable Neural Networks," European Research Studies Journal, European Research Studies Journal, vol. 0(3), pages 402-409.
    • Handle: RePEc:ers:journl:v:xxiv:y:2021:i:3:p:402-409
    as

    Download full text from publisher

    File URL: https://www.ersj.eu/journal/2361/download
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lee, Jeongjin & Kim, Changseok & Shin, Juneseuk, 2017. "Technology opportunity discovery to R&D planning: Key technological performance analysis," Technological Forecasting and Social Change, Elsevier, vol. 119(C), pages 53-63.
    2. A.A. Chursin & V.V. Strenalyuk, 2018. "Synergy Effect in Innovative Activities and its Accounting in the Technological Competencies of an Enterprise," European Research Studies Journal, European Research Studies Journal, vol. 0(4), pages 151-161.
    3. repec:ers:journl:v:volumexxi:y:2018:i:issue4:p:151-161 is not listed on IDEAS
    4. Yoon, Janghyeok & Park, Hyunseok & Seo, Wonchul & Lee, Jae-Min & Coh, Byoung-youl & Kim, Jonghwa, 2015. "Technology opportunity discovery (TOD) from existing technologies and products: A function-based TOD framework," Technological Forecasting and Social Change, Elsevier, vol. 100(C), pages 153-167.
    5. Park, Youngjin & Yoon, Janghyeok, 2017. "Application technology opportunity discovery from technology portfolios: Use of patent classification and collaborative filtering," Technological Forecasting and Social Change, Elsevier, vol. 118(C), pages 170-183.
    6. Lee, Changyong & Kang, Bokyoung & Shin, Juneseuk, 2015. "Novelty-focused patent mapping for technology opportunity analysis," Technological Forecasting and Social Change, Elsevier, vol. 90(PB), pages 355-365.
    7. Shaobo Li & Jie Hu & Yuxin Cui & Jianjun Hu, 2018. "DeepPatent: patent classification with convolutional neural networks and word embedding," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 721-744, November.
    8. Yuan Zhou & Fang Dong & Yufei Liu & Liang Ran, 2021. "A deep learning framework to early identify emerging technologies in large-scale outlier patents: an empirical study of CNC machine tool," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 969-994, February.
    9. Song, Kisik & Kim, Karp Soo & Lee, Sungjoo, 2017. "Discovering new technology opportunities based on patents: Text-mining and F-term analysis," Technovation, Elsevier, vol. 60, pages 1-14.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jeon, Eunji & Yoon, Naeun & Sohn, So Young, 2023. "Exploring new digital therapeutics technologies for psychiatric disorders using BERTopic and PatentSBERTa," Technological Forecasting and Social Change, Elsevier, vol. 186(PA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jinzhu Zhang & Wenqian Yu, 2020. "Early detection of technology opportunity based on analogy design and phrase semantic representation," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 551-576, October.
    2. Ren, Haiying & Zhao, Yuhui, 2021. "Technology opportunity discovery based on constructing, evaluating, and searching knowledge networks," Technovation, Elsevier, vol. 101(C).
    3. Lee, Jiho & Ko, Namuk & Yoon, Janghyeok & Son, Changho, 2021. "An approach for discovering firm-specific technology opportunities: Application of link prediction to F-term networks," Technological Forecasting and Social Change, Elsevier, vol. 168(C).
    4. Lijie Feng & Yuxiang Niu & Zhenfeng Liu & Jinfeng Wang & Ke Zhang, 2019. "Discovering Technology Opportunity by Keyword-Based Patent Analysis: A Hybrid Approach of Morphology Analysis and USIT," Sustainability, MDPI, vol. 12(1), pages 1-35, December.
    5. Han, Xiaotong & Zhu, Donghua & Lei, Ming & Daim, Tugrul, 2021. "R&D trend analysis based on patent mining: An integrated use of patent applications and invalidation data," Technological Forecasting and Social Change, Elsevier, vol. 167(C).
    6. Choi, Jaewoong & Lee, Changyong & Yoon, Janghyeok, 2023. "Exploring a technology ecology for technology opportunity discovery: A link prediction approach using heterogeneous knowledge graphs," Technological Forecasting and Social Change, Elsevier, vol. 186(PB).
    7. Xuan Shi & Lingfei Cai & Hongfang Song, 2019. "Discovering Potential Technology Opportunities for Fuel Cell Vehicle Firms: A Multi-Level Patent Portfolio-Based Approach," Sustainability, MDPI, vol. 11(22), pages 1-22, November.
    8. Kyuwoong Kim & Kyeongmin Park & Sungjoo Lee, 2019. "Investigating technology opportunities: the use of SAOx analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 45-70, January.
    9. Jeon, Eunji & Yoon, Naeun & Sohn, So Young, 2023. "Exploring new digital therapeutics technologies for psychiatric disorders using BERTopic and PatentSBERTa," Technological Forecasting and Social Change, Elsevier, vol. 186(PA).
    10. Seunghyun Oh & Jaewoong Choi & Namuk Ko & Janghyeok Yoon, 2020. "Predicting product development directions for new product planning using patent classification-based link prediction," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 1833-1876, December.
    11. Lee, MyoungHoon & Kim, Suhyeon & Kim, Hangyeol & Lee, Junghye, 2022. "Technology Opportunity Discovery using Deep Learning-based Text Mining and a Knowledge Graph," Technological Forecasting and Social Change, Elsevier, vol. 180(C).
    12. Jumi Hwang & Kyung Hee Kim & Jong Gyu Hwang & Sungchan Jun & Jiwon Yu & Chulung Lee, 2020. "Technological Opportunity Analysis: Assistive Technology for Blind and Visually Impaired People," Sustainability, MDPI, vol. 12(20), pages 1-17, October.
    13. Choi, Jaewoong & Jeong, Byeongki & Yoon, Janghyeok, 2019. "Technology opportunity discovery under the dynamic change of focus technology fields: Application of sequential pattern mining to patent classifications," Technological Forecasting and Social Change, Elsevier, vol. 148(C).
    14. Xuefeng Wang & Shuo Zhang & Yuqin liu, 2022. "ITGInsight–discovering and visualizing research fronts in the scientific literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6509-6531, November.
    15. Wu, Yingwen & Ji, Yangjian, 2023. "Identifying firm-specific technology opportunities from the perspective of competitors by using association rule mining," Journal of Informetrics, Elsevier, vol. 17(2).
    16. Park, Mingyu & Geum, Youngjung, 2022. "Two-stage technology opportunity discovery for firm-level decision making: GCN-based link-prediction approach," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    17. Liu, Zhenfeng & Feng, Jian & Uden, Lorna, 2023. "Technology opportunity analysis using hierarchical semantic networks and dual link prediction," Technovation, Elsevier, vol. 128(C).
    18. Zhou, Xiao & Huang, Lu & Porter, Alan & Vicente-Gomila, Jose M., 2019. "Tracing the system transformations and innovation pathways of an emerging technology: Solid lipid nanoparticles," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 785-794.
    19. Choi, Seokkyu & Lee, Hyeonju & Park, Eunjeong & Choi, Sungchul, 2022. "Deep learning for patent landscaping using transformer and graph embedding," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    20. An, Jaehyeong & Kim, Kyuwoong & Mortara, Letizia & Lee, Sungjoo, 2018. "Deriving technology intelligence from patents: Preposition-based semantic analysis," Journal of Informetrics, Elsevier, vol. 12(1), pages 217-236.

    More about this item

    Keywords

    Patent analysis; artificial neural networks; BERT; explainable classification.;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • O14 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Industrialization; Manufacturing and Service Industries; Choice of Technology
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ers:journl:v:xxiv:y:2021:i:3:p:402-409. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marios Agiomavritis (email available below). General contact details of provider: https://ersj.eu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.