IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v20y2023i7p5351-d1112771.html
   My bibliography  Save this article

Visual Diagnostics of Dental Caries through Deep Learning of Non-Standardised Photographs Using a Hybrid YOLO Ensemble and Transfer Learning Model

Author

Listed:
  • Abu Tareq

    (Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh)

  • Mohammad Imtiaz Faisal

    (Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh)

  • Md. Shahidul Islam

    (Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh)

  • Nafisa Shamim Rafa

    (Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh)

  • Tashin Chowdhury

    (Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh)

  • Saif Ahmed

    (Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh)

  • Taseef Hasan Farook

    (Adelaide Dental School, The University of Adelaide, Adelaide, SA 5005, Australia)

  • Nabeel Mohammed

    (Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh)

  • James Dudley

    (Adelaide Dental School, The University of Adelaide, Adelaide, SA 5005, Australia)

Abstract

Background: Access to oral healthcare is not uniform globally, particularly in rural areas with limited resources, which limits the potential of automated diagnostics and advanced tele-dentistry applications. The use of digital caries detection and progression monitoring through photographic communication, is influenced by multiple variables that are difficult to standardize in such settings. The objective of this study was to develop a novel and cost-effective virtual computer vision AI system to predict dental cavitations from non-standardised photographs with reasonable clinical accuracy. Methods: A set of 1703 augmented images was obtained from 233 de-identified teeth specimens. Images were acquired using a consumer smartphone, without any standardised apparatus applied. The study utilised state-of-the-art ensemble modeling, test-time augmentation, and transfer learning processes. The “you only look once” algorithm (YOLO) derivatives, v5s, v5m, v5l, and v5x, were independently evaluated, and an ensemble of the best results was augmented, and transfer learned with ResNet50, ResNet101, VGG16, AlexNet, and DenseNet. The outcomes were evaluated using precision, recall, and mean average precision ( mAP ). Results: The YOLO model ensemble achieved a mean average precision ( mAP ) of 0.732, an accuracy of 0.789, and a recall of 0.701. When transferred to VGG16, the final model demonstrated a diagnostic accuracy of 86.96%, precision of 0.89, and recall of 0.88. This surpassed all other base methods of object detection from free-hand non-standardised smartphone photographs. Conclusion: A virtual computer vision AI system, blending a model ensemble, test-time augmentation, and transferred deep learning processes, was developed to predict dental cavitations from non-standardised photographs with reasonable clinical accuracy. This model can improve access to oral healthcare in rural areas with limited resources, and has the potential to aid in automated diagnostics and advanced tele-dentistry applications.

Suggested Citation

  • Abu Tareq & Mohammad Imtiaz Faisal & Md. Shahidul Islam & Nafisa Shamim Rafa & Tashin Chowdhury & Saif Ahmed & Taseef Hasan Farook & Nabeel Mohammed & James Dudley, 2023. "Visual Diagnostics of Dental Caries through Deep Learning of Non-Standardised Photographs Using a Hybrid YOLO Ensemble and Transfer Learning Model," IJERPH, MDPI, vol. 20(7), pages 1-13, March.
    • Handle: RePEc:gam:jijerp:v:20:y:2023:i:7:p:5351-:d:1112771
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/20/7/5351/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/20/7/5351/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Venkatesh Shankar & Unnati Narang, 2020. "Emerging market innovations: unique and differential drivers, practitioner implications, and research agenda," Journal of the Academy of Marketing Science, Springer, vol. 48(5), pages 1030-1052, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hossain, Mokter, 2022. "The Shenzhen ecosystem: What it means for the western world," Technology in Society, Elsevier, vol. 68(C).
    2. Piotr F. Borowski, 2021. "Innovation strategy on the example of companies using bamboo," Journal of Innovation and Entrepreneurship, Springer, vol. 10(1), pages 1-17, December.
    3. Sharmelly, Rifat & Ray, Pradeep Kanta, 2021. "Managing resource-constrained innovation in emerging markets: Perspectives from a business model," Technology in Society, Elsevier, vol. 65(C).
    4. Mavroudi, Eva & Kafouros, Mario & Jia, Fei & Hong, Junjie, 2023. "How can MNEs benefit from internationalizing their R&D across countries with both weak and strong IPR protection?," Journal of International Management, Elsevier, vol. 29(1).
    5. Saleh Md Arman & Cecilia Mark-Herbert, 2022. "Ethical Pro-Environmental Self-Identity Practice: The Case of Second-Hand Products," Sustainability, MDPI, vol. 14(4), pages 1-18, February.
    6. Yi Feng & Ya Liu, 2023. "Industry Life Cycle, CEO Functional Background and Corporate Sustainable Development: Evidence from Listed Companies in China," Sustainability, MDPI, vol. 15(3), pages 1-31, January.
    7. Panda, Madhusmita & Pradhan, Rabindra Kumar & Singh, Sanjay Kumar, 2022. "What makes organization-assigned expatriates perform in the host country? A moderated mediation analysis in the India-China context," Journal of Business Research, Elsevier, vol. 142(C), pages 663-673.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:20:y:2023:i:7:p:5351-:d:1112771. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.