IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v16y2025i1d10.1038_s41467-025-65051-0.html
   My bibliography  Save this article

Multimodal AI and tumour microenvironment integration predicts metastasis in cutaneous melanoma

Author

Listed:
  • Tom W. Andrew

    (Newcastle University)

  • Marc Combalia

    (AMLo Biosciences)

  • Carlos Hernandez

    (AMLo Biosciences)

  • Sydney Grant

    (AMLo Biosciences)

  • Gyorgy Paragh

    (Roswell Park Comprehensive Cancer Center)

  • Susanna Puig

    (Instituto de Salud Carlos III)

  • Grant Mc Arthur

    (Melbourne)

  • Grant Richardson

    (Newcastle University
    AMLo Biosciences)

  • Phil Sloan

    (Newcastle University
    AMLo Biosciences)

  • Sophia Z. Shalhout

    (Mass Eye and Ear
    Harvard Medical School)

  • Ruth Plummer

    (Newcastle University
    Newcastle Hospitals NHS Foundation Trust)

  • Penny E. Lovat

    (Newcastle University
    AMLo Biosciences)

Abstract

Accurate prognostication is essential to guide clinical management in localised cutaneous melanoma (CM), the form of skin cancer with the highest mortality. While the tumour microenvironment (TME) plays a key role in disease progression, current staging systems rely on limited tumour features and exclude key clinicopathological prognostic features. Here we show that MelanoMAP, a multimodal AI model integrating TME-derived digital biomarkers and clinicopathological features from over 3,500 histology slides, improves prognostication of localised CM. MelanoMAP achieved a C-index of 0.82, a 24% improvement over traditional AJCC staging (0.66) and consistently outperformed clinicopathological-only models across six international patient cohorts. SHAP analysis identified TME-derived digital biomarkers, alongside traditional clinicopathological factors including age, mitotic count, and Breslow depth, were critical determinants of metastatic risk. MelanoMAP establishes a potential foundation for precision oncology in CM, demonstrating how AI-driven digital biomarkers can advance personalised prognostication and inform clinical-decision making.

Suggested Citation

  • Tom W. Andrew & Marc Combalia & Carlos Hernandez & Sydney Grant & Gyorgy Paragh & Susanna Puig & Grant Mc Arthur & Grant Richardson & Phil Sloan & Sophia Z. Shalhout & Ruth Plummer & Penny E. Lovat, 2025. "Multimodal AI and tumour microenvironment integration predicts metastasis in cutaneous melanoma," Nature Communications, Nature, vol. 16(1), pages 1-10, December.
    • Handle: RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-65051-0
    DOI: 10.1038/s41467-025-65051-0
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-025-65051-0
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-025-65051-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. James A. Diao & Jason K. Wang & Wan Fung Chui & Victoria Mountain & Sai Chowdary Gullapally & Ramprakash Srinivasan & Richard N. Mitchell & Benjamin Glass & Sara Hoffman & Sudha K. Rao & Chirag Mahesh, 2021. "Human-interpretable image features derived from densely mapped cancer pathology slides predict diverse molecular phenotypes," Nature Communications, Nature, vol. 12(1), pages 1-15, December.
    2. Gian Maria Fimia & Anastassia Stoykova & Alessandra Romagnoli & Luigi Giunta & Sabrina Di Bartolomeo & Roberta Nardacci & Marco Corazzari & Claudia Fuoco & Ahmet Ucar & Peter Schwartz & Peter Gruss & , 2007. "Ambra1 regulates autophagy and development of the nervous system," Nature, Nature, vol. 447(7148), pages 1121-1125, June.
    3. Anahita Fathi Kazerooni & Adam Kraya & Komal S. Rathi & Meen Chul Kim & Arastoo Vossough & Nastaran Khalili & Ariana M. Familiar & Deep Gandhi & Neda Khalili & Varun Kesherwani & Debanjan Haldar & Han, 2025. "Multiparametric MRI along with machine learning predicts prognosis and treatment response in pediatric low-grade glioma," Nature Communications, Nature, vol. 16(1), pages 1-16, December.
    4. Benoît Schmauch & Alberto Romagnoni & Elodie Pronier & Charlie Saillard & Pascale Maillé & Julien Calderaro & Aurélie Kamoun & Meriem Sefta & Sylvain Toldo & Mikhail Zaslavskiy & Thomas Clozel & Matah, 2020. "A deep learning model to predict RNA-Seq expression of tumours from whole slide images," Nature Communications, Nature, vol. 11(1), pages 1-15, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chuhan Wang & Adam S. Chan & Xiaohang Fu & Shila Ghazanfar & Jinman Kim & Ellis Patrick & Jean Y. H. Yang, 2025. "Benchmarking the translational potential of spatial gene expression prediction from histology," Nature Communications, Nature, vol. 16(1), pages 1-17, December.
    2. Zhe Li & Seyed Hossein Mirjahanmardi & Rasoul Sali & Feyisope Eweje & Matthew Gopaulchan & Leon Kloker & Xiaoming Zhang & Guoxin Li & Yuming Jiang & Ruijiang Li, 2025. "Automated cell annotation and classification on histopathology for spatial biomarker discovery," Nature Communications, Nature, vol. 16(1), pages 1-15, December.
    3. Omar S. M. El Nahhas & Chiara M. L. Loeffler & Zunamys I. Carrero & Marko Treeck & Fiona R. Kolbinger & Katherine J. Hewitt & Hannah S. Muti & Mara Graziani & Qinghe Zeng & Julien Calderaro & Nadina O, 2024. "Regression-based Deep-Learning predicts molecular biomarkers from pathology slides," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    4. Duy Pham & Xiao Tan & Brad Balderson & Jun Xu & Laura F. Grice & Sohye Yoon & Emily F. Willis & Minh Tran & Pui Yeng Lam & Arti Raghubar & Priyakshi Kalita-de Croft & Sunil Lakhani & Jana Vukovic & Ma, 2023. "Robust mapping of spatiotemporal trajectories and cell–cell interactions in healthy and diseased tissues," Nature Communications, Nature, vol. 14(1), pages 1-25, December.
    5. Marija Pizurica & Yuanning Zheng & Francisco Carrillo-Perez & Humaira Noor & Wei Yao & Christian Wohlfart & Antoaneta Vladimirova & Kathleen Marchal & Olivier Gevaert, 2024. "Digital profiling of gene expression from histology images with linearized attention," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    6. Peng Zhang & Chaofei Gao & Zhuoyu Zhang & Zhiyuan Yuan & Qian Zhang & Ping Zhang & Shiyu Du & Weixun Zhou & Yan Li & Shao Li, 2025. "Systematic inference of super-resolution cell spatial profiles from histology images," Nature Communications, Nature, vol. 16(1), pages 1-21, December.
    7. Francesco Cisternino & Sara Ometto & Soumick Chatterjee & Edoardo Giacopuzzi & Adam P. Levine & Craig A. Glastonbury, 2024. "Self-supervised learning for characterising histomorphological diversity and spatial RNA expression prediction across 23 human tissue types," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    8. Petr Holub & Heimo Müller & Tomáš Bíl & Luca Pireddu & Markus Plass & Fabian Prasser & Irene Schlünder & Kurt Zatloukal & Rudolf Nenutil & Tomáš Brázdil, 2023. "Privacy risks of whole-slide image sharing in digital pathology," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    9. Bao Feng & Jiangfeng Shi & Liebin Huang & Zhiqi Yang & Shi-Ting Feng & Jianpeng Li & Qinxian Chen & Huimin Xue & Xiangguang Chen & Cuixia Wan & Qinghui Hu & Enming Cui & Yehang Chen & Wansheng Long, 2024. "Robustly federated learning model for identifying high-risk patients with postoperative gastric cancer recurrence," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    10. Liisa Petäinen & Juha P Väyrynen & Pekka Ruusuvuori & Ilkka Pölönen & Sami Äyrämö & Teijo Kuopio, 2023. "Domain-specific transfer learning in the automated scoring of tumor-stroma ratio from histopathological images of colorectal cancer," PLOS ONE, Public Library of Science, vol. 18(5), pages 1-13, May.
    11. Zaoqu Liu & Yushuai Wu & Hui Xu & Minkai Wang & Siyuan Weng & Dongling Pei & Shuang Chen & WeiWei Wang & Jing Yan & Li Cui & Jingxian Duan & Yuanshen Zhao & Zilong Wang & Zeyu Ma & Ran Li & Wenchao Du, 2025. "Multimodal fusion of radio-pathology and proteogenomics identify integrated glioma subtypes with prognostic and therapeutic opportunities," Nature Communications, Nature, vol. 16(1), pages 1-18, December.
    12. repec:plo:pone00:0060516 is not listed on IDEAS
    13. Darui Jin & Shangying Liang & Artem Shmatko & Alexander Arnold & David Horst & Thomas G. P. Grünewald & Moritz Gerstung & Xiangzhi Bai, 2024. "Teacher-student collaborated multiple instance learning for pan-cancer PDL1 expression prediction from histopathology slides," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    14. Weiwei Wang & Yuanshen Zhao & Lianghong Teng & Jing Yan & Yang Guo & Yuning Qiu & Yuchen Ji & Bin Yu & Dongling Pei & Wenchao Duan & Minkai Wang & Li Wang & Jingxian Duan & Qiuchang Sun & Shengnan Wan, 2023. "Neuropathologist-level integrated classification of adult-type diffuse gliomas using deep learning from whole-slide pathological images," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    15. Ming Liu & Yang Wang & Fei Teng & Xinyi Mai & Xi Wang & Ming-Yuan Su & Goran Stjepanovic, 2023. "Structure of the DDB1-AMBRA1 E3 ligase receptor complex linked to cell cycle regulation," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    16. Yuanning Zheng & Francisco Carrillo-Perez & Marija Pizurica & Dieter Henrik Heiland & Olivier Gevaert, 2023. "Spatial cellular architecture predicts prognosis in glioblastoma," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    17. Jay Jasti & Hua Zhong & Vandana Panwar & Vipul Jarmale & Jeffrey Miyata & Deyssy Carrillo & Alana Christie & Dinesh Rakheja & Zora Modrusan & Edward Ernest Kadel & Niha Beig & Mahrukh Huseni & James B, 2025. "Histopathology based AI model predicts anti-angiogenic therapy response in renal cancer clinical trial," Nature Communications, Nature, vol. 16(1), pages 1-13, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-65051-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.