IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v36y2025i5d10.1007_s10845-024-02378-3.html
   My bibliography  Save this article

An automatic inspection system for the detection of tire surface defects and their severity classification through a two-stage multimodal deep learning approach

Author

Listed:
  • Thomas Mignot

    (Univ Lyon, INSA Lyon, CNRS, UCBL, LIRIS, UMR5205
    Manufacture française des pneumatiques Michelin)

  • François Ponchon

    (Manufacture française des pneumatiques Michelin)

  • Alexandre Derville

    (Manufacture française des pneumatiques Michelin)

  • Stefan Duffner

    (Univ Lyon, INSA Lyon, CNRS, UCBL, LIRIS, UMR5205)

  • Christophe Garcia

    (Univ Lyon, INSA Lyon, CNRS, UCBL, LIRIS, UMR5205)

Abstract

In the tire manufacturing field, the pursuit of uncompromised product quality stands as a cornerstone. This paper introduces an innovative multimodal approach aimed at automating the tire quality control process through the use of deep learning on data obtained from stereo-photometric cameras meticulously integrated into a purpose-built, sophisticated tire acquisition system capable of comprehensive data capture across all tire zones. The defects sought exhibit significant variations in size (ranging from a few millimeters to several tens of centimeters) and type (including abnormal stains during processing, marks resulting from demolding issues, foreign particles, air bubbles, deformations, etc.). Our proposed methodology comprises two distinct stages: an initial instance segmentation phase for defect detection and localization, followed by a classification stage based on severity levels, integrating features extracted from the detection network of the first stage alongside tire metadata. Experimental validation demonstrates that the proposed approach achieves automation objectives, attaining satisfactory results in terms of defect detection and classification according to severity, with a F1 score between 0.7 and 0.89 depending on the tire zone. In addition, this study presents a novel method applicable to all tire areas, addressing a wide variety of defects within the domain.

Suggested Citation

  • Thomas Mignot & François Ponchon & Alexandre Derville & Stefan Duffner & Christophe Garcia, 2025. "An automatic inspection system for the detection of tire surface defects and their severity classification through a two-stage multimodal deep learning approach," Journal of Intelligent Manufacturing, Springer, vol. 36(5), pages 3427-3445, June.
    • Handle: RePEc:spr:joinma:v:36:y:2025:i:5:d:10.1007_s10845-024-02378-3
    DOI: 10.1007/s10845-024-02378-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-024-02378-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10845-024-02378-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chung-Feng Jeffrey Kuo & Chun-Ping Tung & Wei-Han Weng, 2019. "Applying the support vector machine with optimal parameter design into an automatic inspection system for classifying micro-defects on surfaces of light-emitting diode chips," Journal of Intelligent Manufacturing, Springer, vol. 30(2), pages 727-741, February.
    2. Masoumeh Aminzadeh & Thomas R. Kurfess, 2019. "Online quality inspection using Bayesian classification in powder-bed additive manufacturing from high-resolution visual camera images," Journal of Intelligent Manufacturing, Springer, vol. 30(6), pages 2505-2523, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ibrahim Yousif & Liam Burns & Fadi El Kalach & Ramy Harik, 2025. "Leveraging computer vision towards high-efficiency autonomous industrial facilities," Journal of Intelligent Manufacturing, Springer, vol. 36(5), pages 2983-3008, June.
    2. Yong Ren & Qian Wang, 2022. "Gaussian-process based modeling and optimal control of melt-pool geometry in laser powder bed fusion," Journal of Intelligent Manufacturing, Springer, vol. 33(8), pages 2239-2256, December.
    3. T. Herzog & M. Brandt & A. Trinchi & A. Sola & A. Molotnikov, 2024. "Process monitoring and machine learning for defect detection in laser-based metal additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(4), pages 1407-1437, April.
    4. Jože M. Rožanec & Luka Bizjak & Elena Trajkova & Patrik Zajec & Jelle Keizer & Blaž Fortuna & Dunja Mladenić, 2024. "Active learning and novel model calibration measurements for automated visual inspection in manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(5), pages 1963-1984, June.
    5. Chen-Fu Chien & Jia-Yu Peng, 2025. "Bayesian inference for multi-label classification for root cause analysis and probe card maintenance decision support and an empirical study," Journal of Intelligent Manufacturing, Springer, vol. 36(3), pages 1943-1958, March.
    6. Diyi Zhou & Shihua Gong & Ziyue Wang & Delong Li & Huaiqing Lu, 2021. "Error analysis based on error transfer theory and compensation strategy for LED chip visual localization systems," Journal of Intelligent Manufacturing, Springer, vol. 32(5), pages 1345-1359, June.
    7. Chunyang Xia & Zengxi Pan & Joseph Polden & Huijun Li & Yanling Xu & Shanben Chen, 2022. "Modelling and prediction of surface roughness in wire arc additive manufacturing using machine learning," Journal of Intelligent Manufacturing, Springer, vol. 33(5), pages 1467-1482, June.
    8. Yilin Guo & Wen Feng Lu & Jerry Ying Hsi Fuh, 2021. "Semi-supervised deep learning based framework for assessing manufacturability of cellular structures in direct metal laser sintering process," Journal of Intelligent Manufacturing, Springer, vol. 32(2), pages 347-359, February.
    9. Jingchang Li & Qi Zhou & Xufeng Huang & Menglei Li & Longchao Cao, 2023. "In situ quality inspection with layer-wise visual images based on deep transfer learning during selective laser melting," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 853-867, February.
    10. Roham Sadeghi Tabar & Kristina Wärmefjord & Rikard Söderberg & Lars Lindkvist, 2021. "Critical joint identification for efficient sequencing," Journal of Intelligent Manufacturing, Springer, vol. 32(3), pages 769-780, March.
    11. Mohammad Borumand & Saideep Nannapaneni & Gurucharan Madiraddy & Michael P. Sealy & Sima Esfandiarpour Borujeni & Gisuk Hwang, 2025. "Smart process mapping of powder bed fusion additively manufactured metallic wicks using surrogate modeling," Journal of Intelligent Manufacturing, Springer, vol. 36(3), pages 1819-1833, March.
    12. Ying Zhang & Mutahar Safdar & Jiarui Xie & Jinghao Li & Manuel Sage & Yaoyao Fiona Zhao, 2023. "A systematic review on data of additive manufacturing for machine learning applications: the data quality, type, preprocessing, and management," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3305-3340, December.
    13. Tamie Takeda Yokoyama & Satie Ledoux Takeda-Berger & Marco Aurélio Oliveira & Andre Hideto Futami & Luiz Veriano Oliveira Dalla Valentina & Enzo Morosini Frazzon, 2023. "Bayesian networks as a guide to value stream mapping for lean office implementation: a proposed framework," Operations Management Research, Springer, vol. 16(1), pages 49-79, March.
    14. Yanxi Zhang & Deyong You & Xiangdong Gao & Congyi Wang & Yangjin Li & Perry P. Gao, 2020. "Real-time monitoring of high-power disk laser welding statuses based on deep learning framework," Journal of Intelligent Manufacturing, Springer, vol. 31(4), pages 799-814, April.
    15. Jingchang Li & Longchao Cao & Jiexiang Hu & Minhua Sheng & Qi Zhou & Peng Jin, 2022. "A prediction approach of SLM based on the ensemble of metamodels considering material efficiency, energy consumption, and tensile strength," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 687-702, March.
    16. Haijie Wang & Bo Li & Saifan Zhang & Fuzhen Xuan, 2025. "Traditional machine learning and deep learning for predicting melt-pool cross-sectional morphology of laser powder bed fusion additive manufacturing with thermographic monitoring," Journal of Intelligent Manufacturing, Springer, vol. 36(3), pages 2079-2104, March.
    17. Paromita Nath & Sankaran Mahadevan, 2023. "Probabilistic predictive control of porosity in laser powder bed fusion," Journal of Intelligent Manufacturing, Springer, vol. 34(3), pages 1085-1103, March.
    18. Vivek Mahato & Muhannad Ahmed Obeidi & Dermot Brabazon & Pádraig Cunningham, 2022. "Detecting voids in 3D printing using melt pool time series data," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 845-852, March.
    19. Osama Aljarrah & Jun Li & Alfa Heryudono & Wenzhen Huang & Jing Bi, 2023. "Predicting part distortion field in additive manufacturing: a data-driven framework," Journal of Intelligent Manufacturing, Springer, vol. 34(4), pages 1975-1993, April.
    20. Nicholas Satterlee & Elisa Torresani & Eugene Olevsky & John S. Kang, 2024. "Automatic detection and characterization of porosities in cross-section images of metal parts produced by binder jetting using machine learning and image augmentation," Journal of Intelligent Manufacturing, Springer, vol. 35(3), pages 1281-1303, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:36:y:2025:i:5:d:10.1007_s10845-024-02378-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.