Author
Listed:
- M Rifqi Rafsanjani
- Alison Dooney
- Rahul Suresh
- Alice C O’Farrell
- Monika A Jarzabek
- Liam Shiels
- Annette T Byrne
- Jochen H M Prehn
- Aidan D Meade
Abstract
Identifying image features that associate strongly with diagnostic or prognostic classes in large-scale, multi-channel spatial imaging is challenging without pixel-level annotations. We present DREAMER-S, an attention-based multiple-instance learning (MIL) framework that, using only image- or slide-level labels, learns spatial features within 3D imaging hypercubes that are most informative for downstream classification. We demonstrate DREAMER-S on Quantum Cascade Laser infrared (QCL-IR) tissue imaging, where attention weights are rendered spatially to highlight class-relevant spectral instances without manual annotation. Because the MIL attention layer assigns interpretable importances to spatial instances, the method is broadly transferable to spatial-biology applications that require instance-level filtering to focus towards salient regions of interest in high-content datasets. We further evaluate DREAMER-S on a chemotherapy-response task in a colorectal cancer patient-derived xenograft (PDX) model. After tuning, DREAMER-S separated spectral instances from a chemo-sensitive PDX (CRC0344) and a less responsive PDX (CRC0076) with an F1 score of ~0.95. To validate explainability, we linked model saliency to cellular physiology, observing that, (i) unsupervised UMAP embeddings of high-attention spectra stratified samples by treatment (chemotherapy, apoptosis sensitizer, combination, vehicle), and (ii) selected spectral markers correlated with pro-apoptotic proteins measured independently in the same PDX system. Together, these results support a mechanistic link between spectral signals and apoptosis pathways and position DREAMER-S as an efficient, interpretable approach for analysing high-content spatial-biology imaging datasets.
Suggested Citation
M Rifqi Rafsanjani & Alison Dooney & Rahul Suresh & Alice C O’Farrell & Monika A Jarzabek & Liam Shiels & Annette T Byrne & Jochen H M Prehn & Aidan D Meade, 2026.
"DREAMER-S: Deep leaRning-Enabled Attention-based Multiple-instance approaches with Explainable Representations for Spatial biology,"
PLOS Computational Biology, Public Library of Science, vol. 22(5), pages 1-23, May.
Handle:
RePEc:plo:pcbi00:1013581
DOI: 10.1371/journal.pcbi.1013581
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1013581. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.