IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v32y2021i7d10.1007_s10845-020-01670-2.html
   My bibliography  Save this article

A steel surface defect inspection approach towards smart industrial monitoring

Author

Listed:
  • Ruiyang Hao

    (Tsinghua University)

  • Bingyu Lu

    (Tsinghua University)

  • Ying Cheng

    (Beihang University)

  • Xiu Li

    (Tsinghua University)

  • Biqing Huang

    (Tsinghua University)

Abstract

With the advance in Industry 4.0, smart industrial monitoring has been proposed to timely discover faults and defects in industrial processes. Steel is widely used in manufacturing equipment, and steel surface defect inspection is of great significance to the normal operation of steel equipment in manufacturing workshops. In steel defect inspection systems, industrial inspection robots generate images via scanning steel surface, and processors perform surface defect inspection algorithms on images. We focus on applying advanced object detection techniques to surface defect inspection algorithm for sheet steel. In the proposed steel surface defect inspection model, a deformable convolution enhanced backbone network firstly extracts complex features from multi-shape steel surface defects. Then the feature fusion network with balanced feature pyramid generates high-quality multi-resolution feature maps for the inspection of multi-size defects. Finally, detector network achieves the localization and classification of steel surface defects. The proposed model is evaluated on a typical steel surface defect dataset. Our model achieves 0.805 mAP, 0.144 higher than baseline models, and our model shows high efficiency in inference. Experiments are performed to reveal the effect of employed approaches, and results also show our model achieves a balance between inspection performance and inference efficiency.

Suggested Citation

  • Ruiyang Hao & Bingyu Lu & Ying Cheng & Xiu Li & Biqing Huang, 2021. "A steel surface defect inspection approach towards smart industrial monitoring," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1833-1843, October.
    • Handle: RePEc:spr:joinma:v:32:y:2021:i:7:d:10.1007_s10845-020-01670-2
    DOI: 10.1007/s10845-020-01670-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-020-01670-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10845-020-01670-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. D. Yu. Pimenov & A. Bustillo & T. Mikolajczyk, 2018. "Artificial intelligence for automatic prediction of required surface roughness by monitoring wear on face mill teeth," Journal of Intelligent Manufacturing, Springer, vol. 29(5), pages 1045-1061, June.
    2. Olatomiwa Badmos & Andreas Kopp & Timo Bernthaler & Gerhard Schneider, 2020. "Image-based defect detection in lithium-ion battery electrode using convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 31(4), pages 885-897, April.
    3. Domen Tabernik & Samo Šela & Jure Skvarč & Danijel Skočaj, 2020. "Segmentation-based deep-learning approach for surface-defect detection," Journal of Intelligent Manufacturing, Springer, vol. 31(3), pages 759-776, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. José M. Navarro-Jiménez & José V. Aguado & Grégoire Bazin & Vicente Albero & Domenico Borzacchiello, 2023. "Reconstruction of 3D surfaces from incomplete digitisations using statistical shape models for manufacturing processes," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2345-2358, June.
    2. Zhuxi Ma & Yibo Li & Minghui Huang & Qianbin Huang & Jie Cheng & Si Tang, 2023. "Automated real-time detection of surface defects in manufacturing processes of aluminum alloy strip using a lightweight network architecture," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2431-2447, June.
    3. Shuai Ma & Kechen Song & Menghui Niu & Hongkun Tian & Yunhui Yan, 2024. "Cross-scale fusion and domain adversarial network for generalizable rail surface defect segmentation on unseen datasets," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 367-386, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuanyuan Wang & Ling Ma & Lihua Jian & Huiqin Jiang, 2023. "Conductive particle detection via efficient encoder–decoder network," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3563-3577, December.
    2. Swarit Anand Singh & K. A. Desai, 2023. "Automated surface defect detection framework using machine vision and convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 34(4), pages 1995-2011, April.
    3. Saksham Jain & Gautam Seth & Arpit Paruthi & Umang Soni & Girish Kumar, 2022. "Synthetic data augmentation for surface defect detection and classification using deep learning," Journal of Intelligent Manufacturing, Springer, vol. 33(4), pages 1007-1020, April.
    4. Zeqing Yang & Mingxuan Zhang & Yingshu Chen & Ning Hu & Lingxiao Gao & Libing Liu & Enxu Ping & Jung Il Song, 2024. "Surface defect detection method for air rudder based on positive samples," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 95-113, January.
    5. Feiyang Li & Nian Cai & Xueliang Deng & Jiahao Li & Jianfa Lin & Han Wang, 2022. "Serial number inspection for ceramic membranes via an end-to-end photometric-induced convolutional neural network framework," Journal of Intelligent Manufacturing, Springer, vol. 33(5), pages 1373-1392, June.
    6. Nhat-To Huynh & Duong-Dong Ho & Hong-Nguyen Nguyen, 2023. "An Approach for Designing an Optimal CNN Model Based on Auto-Tuning GA with 2D Chromosome for Defect Detection and Classification," Sustainability, MDPI, vol. 15(6), pages 1-14, March.
    7. Andres Bustillo & Roberto Reis & Alisson R. Machado & Danil Yu. Pimenov, 2022. "Improving the accuracy of machine-learning models with data from machine test repetitions," Journal of Intelligent Manufacturing, Springer, vol. 33(1), pages 203-221, January.
    8. Abtin Djavadifar & John Brandon Graham-Knight & Marian Kӧrber & Patricia Lasserre & Homayoun Najjaran, 2022. "Automated visual detection of geometrical defects in composite manufacturing processes using deep convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 33(8), pages 2257-2275, December.
    9. Dragan Rodić & Milenko Sekulić & Marin Gostimirović & Vladimir Pucovsky & Davorin Kramar, 2021. "Fuzzy logic and sub-clustering approaches to predict main cutting force in high-pressure jet assisted turning," Journal of Intelligent Manufacturing, Springer, vol. 32(1), pages 21-36, January.
    10. Shuai Ma & Kechen Song & Menghui Niu & Hongkun Tian & Yunhui Yan, 2024. "Cross-scale fusion and domain adversarial network for generalizable rail surface defect segmentation on unseen datasets," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 367-386, January.
    11. Ardamanbir Singh Sidhu & Sehijpal Singh & Raman Kumar & Danil Yurievich Pimenov & Khaled Giasin, 2021. "Prioritizing Energy-Intensive Machining Operations and Gauging the Influence of Electric Parameters: An Industrial Case Study," Energies, MDPI, vol. 14(16), pages 1-39, August.
    12. Andres Bustillo & Danil Yu. Pimenov & Mozammel Mia & Wojciech Kapłonek, 2021. "Machine-learning for automatic prediction of flatness deviation considering the wear of the face mill teeth," Journal of Intelligent Manufacturing, Springer, vol. 32(3), pages 895-912, March.
    13. Omojola Awogbemi & Daramy Vandi Von Kallon & Kazeem Aderemi Bello, 2022. "Resource Recycling with the Aim of Achieving Zero-Waste Manufacturing," Sustainability, MDPI, vol. 14(8), pages 1-18, April.
    14. Yanxi Zhang & Deyong You & Xiangdong Gao & Congyi Wang & Yangjin Li & Perry P. Gao, 2020. "Real-time monitoring of high-power disk laser welding statuses based on deep learning framework," Journal of Intelligent Manufacturing, Springer, vol. 31(4), pages 799-814, April.
    15. Ahmed Elsheikh & Soumaya Yacout & Mohamed-Salah Ouali & Yasser Shaban, 2020. "Failure time prediction using adaptive logical analysis of survival curves and multiple machining signals," Journal of Intelligent Manufacturing, Springer, vol. 31(2), pages 403-415, February.
    16. Omid Davtalab & Ali Kazemian & Xiao Yuan & Behrokh Khoshnevis, 2022. "Automated inspection in robotic additive manufacturing using deep learning for layer deformation detection," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 771-784, March.
    17. Danqing Kang & Jianhuang Lai & Junyong Zhu & Yu Han, 2023. "An adaptive feature reconstruction network for the precise segmentation of surface defects on printed circuit boards," Journal of Intelligent Manufacturing, Springer, vol. 34(7), pages 3197-3214, October.
    18. Ki Bum Lee & Chang Ouk Kim, 2020. "Recurrent feature-incorporated convolutional neural network for virtual metrology of the chemical mechanical planarization process," Journal of Intelligent Manufacturing, Springer, vol. 31(1), pages 73-86, January.
    19. Changqing Wang & Maoxuan Sun & Yuan Cao & Kunyu He & Bei Zhang & Zhonghao Cao & Meng Wang, 2023. "Lightweight Network-Based Surface Defect Detection Method for Steel Plates," Sustainability, MDPI, vol. 15(4), pages 1-12, February.
    20. Rong Luo & Ruihu Chen & Fengting Jia & Biru Lin & Jie Liu & Yafei Sun & Xinbo Yang & Weikuan Jia, 2023. "RBD-Net: robust breakage detection algorithm for industrial leather," Journal of Intelligent Manufacturing, Springer, vol. 34(6), pages 2783-2796, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:32:y:2021:i:7:d:10.1007_s10845-020-01670-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.