IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v16y2025i1d10.1038_s41467-025-56280-4.html
   My bibliography  Save this article

Statistical identification of cell type-specific spatially variable genes in spatial transcriptomics

Author

Listed:
  • Lulu Shang

    (The University of Texas MD Anderson Cancer Center)

  • Peijun Wu

    (University of Michigan
    University of Michigan)

  • Xiang Zhou

    (University of Michigan
    University of Michigan)

Abstract

An essential task in spatial transcriptomics is identifying spatially variable genes (SVGs). Here, we present Celina, a statistical method for systematically detecting cell type-specific SVGs (ct-SVGs)—a subset of SVGs exhibiting distinct spatial expression patterns within specific cell types. Celina utilizes a spatially varying coefficient model to accurately capture each gene’s spatial expression pattern in relation to the distribution of cell types across tissue locations, ensuring effective type I error control and high power. Celina proves powerful compared to existing methods in single-cell resolution spatial transcriptomics and stands as the only effective solution for spot-resolution spatial transcriptomics. Applied to five real datasets, Celina uncovers ct-SVGs associated with tumor progression and patient survival in lung cancer, identifies metagenes with unique spatial patterns linked to cell proliferation and immune response in kidney cancer, and detects genes preferentially expressed near amyloid-β plaques in an Alzheimer’s model.

Suggested Citation

  • Lulu Shang & Peijun Wu & Xiang Zhou, 2025. "Statistical identification of cell type-specific spatially variable genes in spatial transcriptomics," Nature Communications, Nature, vol. 16(1), pages 1-20, December.
    • Handle: RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-56280-4
    DOI: 10.1038/s41467-025-56280-4
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-025-56280-4
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-025-56280-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yaowu Liu & Jun Xie, 2020. "Cauchy Combination Test: A Powerful Test With Analytic p-Value Calculation Under Arbitrary Dependency Structures," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 393-402, January.
    2. Miranda V. Hunter & Reuben Moncada & Joshua M. Weiss & Itai Yanai & Richard M. White, 2021. "Spatially resolved transcriptomics reveals the architecture of the tumor-microenvironment interface," Nature Communications, Nature, vol. 12(1), pages 1-16, December.
    3. Velina Kozareva & Caroline Martin & Tomas Osorno & Stephanie Rudolph & Chong Guo & Charles Vanderburg & Naeem Nadaf & Aviv Regev & Wade G. Regehr & Evan Macosko, 2021. "A transcriptomic atlas of mouse cerebellar cortex comprehensively defines cell types," Nature, Nature, vol. 598(7879), pages 214-219, October.
    4. Lulu Shang & Xiang Zhou, 2022. "Spatially aware dimension reduction for spatial transcriptomics," Nature Communications, Nature, vol. 13(1), pages 1-22, December.
    5. Simon N. Wood, 2003. "Thin plate regression splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 95-114, February.
    6. Simon N. Wood, 2011. "Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 3-36, January.
    7. Ed S. Lein & Michael J. Hawrylycz & Nancy Ao & Mikael Ayres & Amy Bensinger & Amy Bernard & Andrew F. Boe & Mark S. Boguski & Kevin S. Brockway & Emi J. Byrnes & Lin Chen & Li Chen & Tsuey-Ming Chen &, 2007. "Genome-wide atlas of gene expression in the adult mouse brain," Nature, Nature, vol. 445(7124), pages 168-176, January.
    8. Simon N. Wood, 2004. "Stable and Efficient Multiple Smoothing Parameter Estimation for Generalized Additive Models," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 673-686, January.
    9. SeungHye Han & Minho Lee & Youngjin Shin & Regina Giovanni & Ram P. Chakrabarty & Mariana M. Herrerias & Laura A. Dada & Annette S. Flozak & Paul A. Reyfman & Basil Khuder & Colleen R. Reczek & Lin Ga, 2023. "Mitochondrial integrated stress response controls lung epithelial cell fate," Nature, Nature, vol. 620(7975), pages 890-897, August.
    10. Yi Zhang & Guanjue Xiang & Alva Yijia Jiang & Allen Lynch & Zexian Zeng & Chenfei Wang & Wubing Zhang & Jingyu Fan & Jiajinlong Kang & Shengqing Stan Gu & Changxin Wan & Boning Zhang & X. Shirley Liu , 2023. "MetaTiME integrates single-cell gene expression to characterize the meta-components of the tumor immune microenvironment," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    11. Nayoung Kim & Hong Kwan Kim & Kyungjong Lee & Yourae Hong & Jong Ho Cho & Jung Won Choi & Jung-Il Lee & Yeon-Lim Suh & Bo Mi Ku & Hye Hyeon Eum & Soyean Choi & Yoon-La Choi & Je-Gun Joung & Woong-Yang, 2020. "Single-cell RNA sequencing demonstrates the molecular and cellular reprogramming of metastatic lung adenocarcinoma," Nature Communications, Nature, vol. 11(1), pages 1-15, December.
    12. Fenghua Bian & Ying-Wei Lan & Shuyang Zhao & Zicheng Deng & Samriddhi Shukla & Anusha Acharya & Johnny Donovan & Tien Le & David Milewski & Matthew Bacchetta & Ahmed Emad Hozain & Yuliya Tipograf & Ya, 2023. "Lung endothelial cells regulate pulmonary fibrosis through FOXF1/R-Ras signaling," Nature Communications, Nature, vol. 14(1), pages 1-20, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Longhi, Christian & Musolesi, Antonio & Baumont, Catherine, 2014. "Modeling structural change in the European metropolitan areas during the process of economic integration," Economic Modelling, Elsevier, vol. 37(C), pages 395-407.
    2. Scott Tainsky & Brian M. Mills & Jason A. Winfree, 2015. "Further Examination of Potential Discrimination Among MLB Umpires," Journal of Sports Economics, , vol. 16(4), pages 353-374, May.
    3. Giampiero Marra & Rosalba Radice & Till Bärnighausen & Simon N. Wood & Mark E. McGovern, 2017. "A Simultaneous Equation Approach to Estimating HIV Prevalence With Nonignorable Missing Responses," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 484-496, April.
    4. Longhi, C. & Musolesi, A. & Baumont, C., 2013. "Modeling the industrial dynamics of the European metropolitan areas during the process of economic integration: a semiparametric approach," Working Papers 2013-10, Grenoble Applied Economics Laboratory (GAEL).
    5. Paul Ghelasi & Florian Ziel, 2024. "From day-ahead to mid and long-term horizons with econometric electricity price forecasting models," Papers 2406.00326, arXiv.org, revised Aug 2024.
    6. Bo Sun & Derek T. Robinson, 2018. "Comparison of Statistical Approaches for Modelling Land-Use Change," Land, MDPI, vol. 7(4), pages 1-33, November.
    7. Musolesi Antonio & Mazzanti Massimiliano, 2014. "Nonlinearity, heterogeneity and unobserved effects in the carbon dioxide emissions-economic development relation for advanced countries," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 18(5), pages 521-541, December.
    8. Brian M. Mills & Mark S. Rosentraub, 2014. "The National Hockey League and Cross-Border Fandom," Journal of Sports Economics, , vol. 15(5), pages 497-518, October.
    9. Massimiliano Mazzanti & Antonio Musolesi, 2013. "Nonlinearity, Heterogeneity and Unobserved Effects in the CO2-income Relation for Advanced Countries," Working Papers 2013.91, Fondazione Eni Enrico Mattei.
    10. E. Zanini & E. Eastoe & M. J. Jones & D. Randell & P. Jonathan, 2020. "Flexible covariate representations for extremes," Environmetrics, John Wiley & Sons, Ltd., vol. 31(5), August.
    11. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    12. Stefan Sperlich & Raoul Theler, 2015. "Modeling heterogeneity: a praise for varying-coefficient models in causal analysis," Computational Statistics, Springer, vol. 30(3), pages 693-718, September.
    13. Emma M. V. Blomgren & Mohsen Banaei & Razgar Ebrahimy & Olof Samuelsson & Francesco D’Ettorre & Henrik Madsen, 2023. "Intensive Data-Driven Model for Real-Time Observability in Low-Voltage Radial DSO Grids," Energies, MDPI, vol. 16(11), pages 1-22, May.
    14. Brian M. Mills, 2017. "Policy Changes In Major League Baseball: Improved Agent Behavior And Ancillary Productivity Outcomes," Economic Inquiry, Western Economic Association International, vol. 55(2), pages 1104-1118, April.
    15. Valtiala, Juho & Niskanen, Olli & Torvinen, Mikael & Riekkinen, Kirsikka & Suokannas, Antti, 2023. "The relationship between agricultural land parcel size and cultivation costs," Land Use Policy, Elsevier, vol. 131(C).
    16. Audrey C. Luo & Valerie J. Sydnor & Adam Pines & Bart Larsen & Aaron F. Alexander-Bloch & Matthew Cieslak & Sydney Covitz & Andrew A. Chen & Nathalia Bianchini Esper & Eric Feczko & Alexandre R. Franc, 2024. "Functional connectivity development along the sensorimotor-association axis enhances the cortical hierarchy," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    17. Rodríguez-Álvarez, María Xosé & Lee, Dae-Jin & Kneib, Thomas & Durbán, María & Eilers, Paul, 2013. "Fast algorithm for smoothing parameter selection in multidimensional generalized P-splines," DES - Working Papers. Statistics and Econometrics. WS ws133026, Universidad Carlos III de Madrid. Departamento de Estadística.
    18. Strasak, Alexander M. & Umlauf, Nikolaus & Pfeiffer, Ruth M. & Lang, Stefan, 2011. "Comparing penalized splines and fractional polynomials for flexible modelling of the effects of continuous predictor variables," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1540-1551, April.
    19. Daniel Melser & Robert J. Hill, 2019. "Residential Real Estate, Risk, Return and Diversification: Some Empirical Evidence," The Journal of Real Estate Finance and Economics, Springer, vol. 59(1), pages 111-146, July.
    20. Ronald E. Gangnon & Natasha K. Stout & Oguzhan Alagoz & John M. Hampton & Brian L. Sprague & Amy Trentham-Dietz, 2018. "Contribution of Breast Cancer to Overall Mortality for US Women," Medical Decision Making, , vol. 38(1_suppl), pages 24-31, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-56280-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.