IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v35y2024i7d10.1007_s10845-023-02232-y.html
   My bibliography  Save this article

A novel image feature based self-supervised learning model for effective quality inspection in additive manufacturing

Author

Listed:
  • Chun Fai Lui

    (City University of Hong Kong)

  • Ahmed Maged

    (Benha University)

  • Min Xie

    (City University of Hong Kong
    City University of Hong Kong Shenzhen Research Institute)

Abstract

With the rapid development of additive manufacturing (AM) technology, quality inspection has become one of the most crucial research topics in additive manufacturing. Although numerous image-based deep learning methods have been successfully developed to monitor and inspect AM product quality effectively, many require substantial labels in order to achieve satisfactory training, which is often impractical in real-life AM processes. In this article, a novel image feature-based self-supervised learning (IFSSL) model is proposed for effective quality inspection in AM. Through a feature-based image fusion approach based on defect-relevant feature extraction, the IFSSL model is able to guide machine vision to focus on highlighted defect-relevant regions in the AM product image. In addition, the defect-relevant features are used to generate pseudo-labels for self-supervised learning. With self-supervision, the IFSSL model leverages the advantages of supervised learning and unsupervised learning by requiring no sample label while retaining defect-relevant information. The effectiveness of the proposed IFSSL method is demonstrated through a real case study of fused deposition modeling product image dataset. Results show that the IFSSL model can guide machine vision to pay more attention to potential defective regions, enabling it to detect and locate faults effectively and automatically for machine vision guided quality inspection.

Suggested Citation

  • Chun Fai Lui & Ahmed Maged & Min Xie, 2024. "A novel image feature based self-supervised learning model for effective quality inspection in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3543-3558, October.
  • Handle: RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02232-y
    DOI: 10.1007/s10845-023-02232-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-023-02232-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10845-023-02232-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jingchang Li & Qi Zhou & Xufeng Huang & Menglei Li & Longchao Cao, 2023. "In situ quality inspection with layer-wise visual images based on deep transfer learning during selective laser melting," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 853-867, February.
    2. Felix W. Baumann & Julian R. Eichhoff & Dieter Roller, 2017. "Scanned Image Data from 3D-Printed Specimens Using Fused Deposition Modeling," Data, MDPI, vol. 2(1), pages 1-24, January.
    3. Zhenyu Liu & Yiguo Song & Ruining Tang & Guifang Duan & Jianrong Tan, 2023. "Few-shot defect recognition of metal surfaces via attention-embedding and self-supervised learning," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3507-3521, December.
    4. Matteo Bugatti & Bianca Maria Colosimo, 2022. "Towards real-time in-situ monitoring of hot-spot defects in L-PBF: a new classification-based method for fast video-imaging data analysis," Journal of Intelligent Manufacturing, Springer, vol. 33(1), pages 293-309, January.
    5. Sachin Kumar & T. Gopi & N. Harikeerthana & Munish Kumar Gupta & Vidit Gaur & Grzegorz M. Krolczyk & ChuanSong Wu, 2023. "Machine learning techniques in additive manufacturing: a state of the art review on design, processes and production control," Journal of Intelligent Manufacturing, Springer, vol. 34(1), pages 21-55, January.
    6. Xiang Li & Xiaodong Jia & Qibo Yang & Jay Lee, 2020. "Quality analysis in metal additive manufacturing with deep learning," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 2003-2017, December.
    7. Domen Tabernik & Samo Šela & Jure Skvarč & Danijel Skočaj, 2020. "Segmentation-based deep-learning approach for surface-defect detection," Journal of Intelligent Manufacturing, Springer, vol. 31(3), pages 759-776, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bianca Maria Colosimo & Luca Pagani & Marco Grasso, 2024. "Modeling spatial point processes in video-imaging via Ripley’s K-function: an application to spatter analysis in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 429-447, January.
    2. Nannan Xu & Xinze Cui & Xin Wang & Wei Zhang & Tianyu Zhao, 2022. "An Intelligent Athlete Signal Processing Methodology for Balance Control Ability Assessment with Multi-Headed Self-Attention Mechanism," Mathematics, MDPI, vol. 10(15), pages 1-16, August.
    3. José M. Navarro-Jiménez & José V. Aguado & Grégoire Bazin & Vicente Albero & Domenico Borzacchiello, 2023. "Reconstruction of 3D surfaces from incomplete digitisations using statistical shape models for manufacturing processes," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2345-2358, June.
    4. Shuo Meng & Ruru Pan & Weidong Gao & Jian Zhou & Jingan Wang & Wentao He, 2021. "A multi-task and multi-scale convolutional neural network for automatic recognition of woven fabric pattern," Journal of Intelligent Manufacturing, Springer, vol. 32(4), pages 1147-1161, April.
    5. Nazanin Hosseini Arian & Alireza Pooya & Fariborz Rahimnia & Ali Sibevei, 2021. "Assessment the effect of rapid prototyping implementation on supply chain sustainability: a system dynamics approach," Operations Management Research, Springer, vol. 14(3), pages 467-493, December.
    6. Abtin Djavadifar & John Brandon Graham-Knight & Marian Kӧrber & Patricia Lasserre & Homayoun Najjaran, 2022. "Automated visual detection of geometrical defects in composite manufacturing processes using deep convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 33(8), pages 2257-2275, December.
    7. Li Wei & Mahmud Iwan Solihin & Sarah ‘Atifah Saruchi & Winda Astuti & Lim Wei Hong & Ang Chun Kit, 2024. "Surface Defects Detection of Cylindrical High-Precision Industrial Parts Based on Deep Learning Algorithms: A Review," SN Operations Research Forum, Springer, vol. 5(3), pages 1-71, September.
    8. Zichen Bai & Junfeng Jing, 2024. "Mobile-Deeplab: a lightweight pixel segmentation-based method for fabric defect detection," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3315-3330, October.
    9. Yuwei Mao & Hui Lin & Christina Xuan Yu & Roger Frye & Darren Beckett & Kevin Anderson & Lars Jacquemetton & Fred Carter & Zhangyuan Gao & Wei-keng Liao & Alok N. Choudhary & Kornel Ehmann & Ankit Agr, 2023. "A deep learning framework for layer-wise porosity prediction in metal powder bed fusion using thermal signatures," Journal of Intelligent Manufacturing, Springer, vol. 34(1), pages 315-329, January.
    10. Zeqing Yang & Mingxuan Zhang & Yingshu Chen & Ning Hu & Lingxiao Gao & Libing Liu & Enxu Ping & Jung Il Song, 2024. "Surface defect detection method for air rudder based on positive samples," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 95-113, January.
    11. Matteo Bugatti & Bianca Maria Colosimo, 2022. "Towards real-time in-situ monitoring of hot-spot defects in L-PBF: a new classification-based method for fast video-imaging data analysis," Journal of Intelligent Manufacturing, Springer, vol. 33(1), pages 293-309, January.
    12. Yuanyuan Wang & Ling Ma & Lihua Jian & Huiqin Jiang, 2023. "Conductive particle detection via efficient encoder–decoder network," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3563-3577, December.
    13. Swarit Anand Singh & K. A. Desai, 2023. "Automated surface defect detection framework using machine vision and convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 34(4), pages 1995-2011, April.
    14. Yanan Pan & Renke Kang & Zhigang Dong & Wenhao Du & Sen Yin & Yan Bao, 2022. "On-line prediction of ultrasonic elliptical vibration cutting surface roughness of tungsten heavy alloy based on deep learning," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 675-685, March.
    15. Ruiyang Hao & Bingyu Lu & Ying Cheng & Xiu Li & Biqing Huang, 2021. "A steel surface defect inspection approach towards smart industrial monitoring," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1833-1843, October.
    16. Minyoung Lee & Joohyoung Jeon & Hongchul Lee, 2022. "Explainable AI for domain experts: a post Hoc analysis of deep learning for defect classification of TFT–LCD panels," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1747-1759, August.
    17. Feiyang Li & Nian Cai & Xueliang Deng & Jiahao Li & Jianfa Lin & Han Wang, 2022. "Serial number inspection for ceramic membranes via an end-to-end photometric-induced convolutional neural network framework," Journal of Intelligent Manufacturing, Springer, vol. 33(5), pages 1373-1392, June.
    18. Ying Zhang & Mutahar Safdar & Jiarui Xie & Jinghao Li & Manuel Sage & Yaoyao Fiona Zhao, 2023. "A systematic review on data of additive manufacturing for machine learning applications: the data quality, type, preprocessing, and management," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3305-3340, December.
    19. Yunhan Kim & Taekyum Kim & Byeng D. Youn & Sung-Hoon Ahn, 2022. "Machining quality monitoring (MQM) in laser-assisted micro-milling of glass using cutting force signals: an image-based deep transfer learning," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1813-1828, August.
    20. Jun-Qiang Wang & Yun-Lei Song & Peng-Hao Cui & Yang Li, 2023. "A data-driven method for performance analysis and improvement in production systems with quality inspection," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 455-469, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02232-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.