IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v148y2020ics0167947320300451.html
   My bibliography  Save this article

Posterior inference for sparse hierarchical non-stationary models

Author

Listed:
  • Monterrubio-Gómez, Karla
  • Roininen, Lassi
  • Wade, Sara
  • Damoulas, Theodoros
  • Girolami, Mark

Abstract

Gaussian processes are valuable tools for non-parametric modelling, where typically an assumption of stationarity is employed. While removing this assumption can improve prediction, fitting such models is challenging. Hierarchical models are constructed based on Gaussian Markov random fields with stochastic spatially varying parameters. Importantly, this allows for non-stationarity while also addressing the computational burden through a sparse banded representation of the precision matrix. In this setting, efficient Markov chain Monte Carlo (MCMC) sampling is challenging due to the strong coupling a posteriori of the parameters and hyperparameters. Three adaptive MCMC schemes are developed and compared making use of banded matrix operations for faster inference. Furthermore, a novel extension to higher dimensional input spaces is proposed through an additive structure that retains the flexibility and scalability of the model, while also inheriting interpretability from the additive approach. A thorough assessment of the efficiency and accuracy of the methods in nonstationary settings is presented for both simulated experiments and a computer emulation problem.

Suggested Citation

  • Monterrubio-Gómez, Karla & Roininen, Lassi & Wade, Sara & Damoulas, Theodoros & Girolami, Mark, 2020. "Posterior inference for sparse hierarchical non-stationary models," Computational Statistics & Data Analysis, Elsevier, vol. 148(C).
    • Handle: RePEc:eee:csdana:v:148:y:2020:i:c:s0167947320300451
    DOI: 10.1016/j.csda.2020.106954
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947320300451
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2020.106954?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michalis K. Titsias & Omiros Papaspiliopoulos, 2018. "Auxiliary gradient‐based sampling algorithms," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(4), pages 749-767, September.
    2. Gramacy, Robert B., 2016. "laGP: Large-Scale Spatial Modeling via Local Approximate Gaussian Processes in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 72(i01).
    3. Joaquim Henriques Vianna Neto & Alexandra M. Schmidt & Peter Guttorp, 2014. "Accounting for spatially varying directional effects in spatial covariance structures," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(1), pages 103-122, January.
    4. Gramacy, Robert B & Lee, Herbert K. H, 2008. "Bayesian Treed Gaussian Process Models With an Application to Computer Modeling," Journal of the American Statistical Association, American Statistical Association, vol. 103(483), pages 1119-1130.
    5. Gramacy, Robert B., 2007. "tgp: An R Package for Bayesian Nonstationary, Semiparametric Nonlinear Regression and Design by Treed Gaussian Process Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 19(i09).
    6. Matthias Katzfuss, 2013. "Bayesian nonstationary spatial modeling for very large datasets," Environmetrics, John Wiley & Sons, Ltd., vol. 24(3), pages 189-200, May.
    7. Mary C. Seiler & Fritz A. Seiler, 1989. "Numerical Recipes in C: The Art of Scientific Computing," Risk Analysis, John Wiley & Sons, vol. 9(3), pages 415-416, September.
    8. Zhang, Hao, 2004. "Inconsistent Estimation and Asymptotically Equal Interpolations in Model-Based Geostatistics," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 250-261, January.
    9. M. Vannucci & F. Corradi, 1999. "Covariance structure of wavelet coefficients: theory and models in a Bayesian perspective," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(4), pages 971-986.
    10. Finn Lindgren & Håvard Rue & Johan Lindström, 2011. "An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(4), pages 423-498, September.
    11. Kim, Hyoung-Moon & Mallick, Bani K. & Holmes, C.C., 2005. "Analyzing Nonstationary Spatial Data Using Piecewise Gaussian Processes," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 653-668, June.
    12. Berrocal, Veronica J. & Raftery, Adrian E. & Gneiting, Tilmann & Steed, Richard C., 2010. "Probabilistic Weather Forecasting for Winter Road Maintenance," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 522-537.
    13. Lu Cheng & Siddharth Ramchandran & Tommi Vatanen & Niina Lietzén & Riitta Lahesmaa & Aki Vehtari & Harri Lähdesmäki, 2019. "An additive Gaussian process regression model for interpretable non-parametric analysis of longitudinal data," Nature Communications, Nature, vol. 10(1), pages 1-11, December.
    14. Kleiber, William & Nychka, Douglas, 2012. "Nonstationary modeling for multivariate spatial processes," Journal of Multivariate Analysis, Elsevier, vol. 112(C), pages 76-91.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Waley W. J. Liang & Herbert K. H. Lee, 2019. "Bayesian nonstationary Gaussian process models via treed process convolutions," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(3), pages 797-818, September.
    2. Marcelo Cunha & Dani Gamerman & Montserrat Fuentes & Marina Paez, 2017. "A non-stationary spatial model for temperature interpolation applied to the state of Rio de Janeiro," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(5), pages 919-939, November.
    3. Matthew J. Heaton & Abhirup Datta & Andrew O. Finley & Reinhard Furrer & Joseph Guinness & Rajarshi Guhaniyogi & Florian Gerber & Robert B. Gramacy & Dorit Hammerling & Matthias Katzfuss & Finn Lindgr, 2019. "A Case Study Competition Among Methods for Analyzing Large Spatial Data," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(3), pages 398-425, September.
    4. Kleiber, William, 2016. "High resolution simulation of nonstationary Gaussian random fields," Computational Statistics & Data Analysis, Elsevier, vol. 101(C), pages 277-288.
    5. Daniel W. Gladish & Daniel E. Pagendam & Luk J. M. Peeters & Petra M. Kuhnert & Jai Vaze, 2018. "Emulation Engines: Choice and Quantification of Uncertainty for Complex Hydrological Models," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 23(1), pages 39-62, March.
    6. Philip A. White & Durban G. Keeler & Daniel Sheanshang & Summer Rupper, 2022. "Improving piecewise linear snow density models through hierarchical spatial and orthogonal functional smoothing," Environmetrics, John Wiley & Sons, Ltd., vol. 33(5), August.
    7. Cole, D. Austin & Gramacy, Robert B. & Ludkovski, Mike, 2022. "Large-scale local surrogate modeling of stochastic simulation experiments," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    8. Bolin, David & Wallin, Jonas & Lindgren, Finn, 2019. "Latent Gaussian random field mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 130(C), pages 80-93.
    9. Esmail Yarali & Firoozeh Rivaz, 2020. "Incorporating covariate information in the covariance structure of misaligned spatial data," Environmetrics, John Wiley & Sons, Ltd., vol. 31(6), September.
    10. Matthias Katzfuss, 2017. "A Multi-Resolution Approximation for Massive Spatial Datasets," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 201-214, January.
    11. Rajala, T. & Penttinen, A., 2014. "Bayesian analysis of a Gibbs hard-core point pattern model with varying repulsion range," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 530-541.
    12. K. Shuvo Bakar & Nicholas Biddle & Philip Kokic & Huidong Jin, 2020. "A Bayesian spatial categorical model for prediction to overlapping geographical areas in sample surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(2), pages 535-563, February.
    13. Matthew W. Wheeler, 2019. "Bayesian additive adaptive basis tensor product models for modeling high dimensional surfaces: an application to high‐throughput toxicity testing," Biometrics, The International Biometric Society, vol. 75(1), pages 193-201, March.
    14. Erickson, Collin B. & Ankenman, Bruce E. & Sanchez, Susan M., 2018. "Comparison of Gaussian process modeling software," European Journal of Operational Research, Elsevier, vol. 266(1), pages 179-192.
    15. Marco H. Benedetti & Veronica J. Berrocal & Naveen N. Narisetty, 2022. "Identifying regions of inhomogeneities in spatial processes via an M‐RA and mixture priors," Biometrics, The International Biometric Society, vol. 78(2), pages 798-811, June.
    16. Maria Masotti & Lin Zhang & Ethan Leng & Gregory J. Metzger & Joseph S. Koopmeiners, 2023. "A novel Bayesian functional spatial partitioning method with application to prostate cancer lesion detection using MRI," Biometrics, The International Biometric Society, vol. 79(2), pages 604-615, June.
    17. David L. Miller & Richard Glennie & Andrew E. Seaton, 2020. "Understanding the Stochastic Partial Differential Equation Approach to Smoothing," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 25(1), pages 1-16, March.
    18. Horiguchi, Akira & Pratola, Matthew T. & Santner, Thomas J., 2021. "Assessing variable activity for Bayesian regression trees," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    19. MacDonald, Blake & Ranjan, Pritam & Chipman, Hugh, 2015. "GPfit: An R Package for Fitting a Gaussian Process Model to Deterministic Simulator Outputs," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 64(i12).
    20. Giovanna Jona Lasinio & Gianluca Mastrantonio & Alessio Pollice, 2013. "Discussing the “big n problem”," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 22(1), pages 97-112, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:148:y:2020:i:c:s0167947320300451. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.