IDEAS home Printed from https://ideas.repec.org/a/bla/jtsera/v43y2022i2p157-177.html
   My bibliography  Save this article

Autoregressive density modeling with the Gaussian process mixture transition distribution

Author

Listed:
  • Matthew Heiner
  • Athanasios Kottas

Abstract

We develop a mixture model for transition density approximation, together with soft model selection, in the presence of noisy and heterogeneous nonlinear dynamics. Our model builds on the Gaussian mixture transition distribution (MTD) model for continuous state spaces, extending component means with nonlinear functions that are modeled using Gaussian process (GP) priors. The resulting model flexibly captures nonlinear and heterogeneous lag dependence when several mixture components are active, identifies low‐order nonlinear dependence while inferring relevant lags when few components are active, and averages over multiple and competing single‐lag models to quantify/propagate uncertainty. Sparsity‐inducing priors on the mixture weights aid in selecting a subset of active lags. The hierarchical model specification follows conventions for both GP regression and MTD models, admitting a convenient Gibbs sampling scheme for posterior inference. We demonstrate properties of the proposed model with two simulated and two real time series, emphasizing approximation of lag‐dependent transition densities and model selection. In most cases, the model decisively recovers important features. The proposed model provides a simple, yet flexible framework that preserves useful and distinguishing characteristics of the MTD model class.

Suggested Citation

  • Matthew Heiner & Athanasios Kottas, 2022. "Autoregressive density modeling with the Gaussian process mixture transition distribution," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(2), pages 157-177, March.
  • Handle: RePEc:bla:jtsera:v:43:y:2022:i:2:p:157-177
    DOI: 10.1111/jtsa.12603
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/jtsa.12603
    Download Restriction: no

    File URL: https://libkey.io/10.1111/jtsa.12603?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Isadora Antoniano-Villalobos & Stephen G. Walker, 2016. "A Nonparametric Model for Stationary Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 37(1), pages 126-142, January.
    2. Zhang, Hao, 2004. "Inconsistent Estimation and Asymptotically Equal Interpolations in Model-Based Geostatistics," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 250-261, January.
    3. Kalli, Maria & Griffin, Jim E., 2018. "Bayesian nonparametric vector autoregressive models," Journal of Econometrics, Elsevier, vol. 203(2), pages 267-282.
    4. Cancho, Vicente G. & Dey, Dipak K. & Lachos, Victor H. & Andrade, Marinho G., 2011. "Bayesian nonlinear regression models with scale mixtures of skew-normal distributions: Estimation and case influence diagnostics," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 588-602, January.
    5. Hassan, Mohamed Yusuf & Lii, Keh-Shin, 2006. "Modeling Marked Point Processes via Bivariate Mixture Transition Distribution Models," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1241-1252, September.
    6. A. Azzalini & A.W. Bowman, 1990. "A Look at Some Data on the Old Faithful Geyser," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 39(3), pages 357-365, November.
    7. Chi‐ming Wong & Robert Kohn, 1996. "A Bayesian Approach To Estimating And Forecasting Additive Nonparametric Autoregressive Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 17(2), pages 203-220, March.
    8. Alexandre X. Carvalho & Martin A. Tanner, 2006. "Modeling nonlinearities with mixtures-of-experts of time series models," International Journal of Mathematics and Mathematical Sciences, Hindawi, vol. 2006, pages 1-22, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rajala, T. & Penttinen, A., 2014. "Bayesian analysis of a Gibbs hard-core point pattern model with varying repulsion range," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 530-541.
    2. Zhang, Tonglin, 2017. "An example of inconsistent MLE of spatial covariance parameters under increasing domain asymptotics," Statistics & Probability Letters, Elsevier, vol. 120(C), pages 108-113.
    3. Girard, Didier A., 2016. "Asymptotic near-efficiency of the “Gibbs-energy and empirical-variance” estimating functions for fitting Matérn models — I: Densely sampled processes," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 191-197.
    4. Hirukawa, Masayuki, 2010. "Nonparametric multiplicative bias correction for kernel-type density estimation on the unit interval," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 473-495, February.
    5. Mark S. Handcock & Adrian E. Raftery & Jeremy M. Tantrum, 2007. "Model‐based clustering for social networks," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(2), pages 301-354, March.
    6. Lu, Zudi & Tjostheim, Dag & Yao, Qiwei, 2008. "Spatial smoothing, Nugget effect and infill asymptotics," LSE Research Online Documents on Economics 24133, London School of Economics and Political Science, LSE Library.
    7. Fred Huffer & Cheolyong Park, 2000. "A test for multivariate structure," Journal of Applied Statistics, Taylor & Francis Journals, vol. 27(5), pages 633-650.
    8. Todd E. Clark & Florian Huber & Gary Koop & Massimiliano Marcellino & Michael Pfarrhofer, 2023. "Tail Forecasting With Multivariate Bayesian Additive Regression Trees," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 979-1022, August.
    9. Eric Yanchenko & Howard D. Bondell & Brian J. Reich, 2024. "Spatial regression modeling via the R2D2 framework," Environmetrics, John Wiley & Sons, Ltd., vol. 35(2), March.
    10. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    11. Florian Huber & Luca Rossini, 2020. "Inference in Bayesian Additive Vector Autoregressive Tree Models," Papers 2006.16333, arXiv.org, revised Mar 2021.
    12. Branislav Panić & Marko Nagode & Jernej Klemenc & Simon Oman, 2022. "On Methods for Merging Mixture Model Components Suitable for Unsupervised Image Segmentation Tasks," Mathematics, MDPI, vol. 10(22), pages 1-22, November.
    13. Sierra Pugh & Matthew J. Heaton & Jeff Svedin & Neil Hansen, 2019. "Spatiotemporal Lagged Models for Variable Rate Irrigation in Agriculture," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(4), pages 634-650, December.
    14. Niko Hauzenberger & Florian Huber & Gary Koop & James Mitchell, 2020. "Bayesian Modelling of TVP-VARs Using Regression Trees," Working Papers 2308, University of Strathclyde Business School, Department of Economics, revised Aug 2023.
    15. Victor De Oliveira & Zifei Han, 2022. "On Information About Covariance Parameters in Gaussian Matérn Random Fields," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(4), pages 690-712, December.
    16. Monterrubio-Gómez, Karla & Roininen, Lassi & Wade, Sara & Damoulas, Theodoros & Girolami, Mark, 2020. "Posterior inference for sparse hierarchical non-stationary models," Computational Statistics & Data Analysis, Elsevier, vol. 148(C).
    17. Yana Melnykov & Xuwen Zhu & Volodymyr Melnykov, 2021. "Transformation mixture modeling for skewed data groups with heavy tails and scatter," Computational Statistics, Springer, vol. 36(1), pages 61-78, March.
    18. Billio, Monica & Casarin, Roberto & Rossini, Luca, 2019. "Bayesian nonparametric sparse VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 97-115.
    19. Denis Allard & Lucia Clarotto & Thomas Opitz & Thomas Romary, 2021. "Discussion on “Competition on Spatial Statistics for Large Datasets”," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 26(4), pages 604-611, December.
    20. Gelfand, Alan E. & Banerjee, Sudipto & Sirmans, C.F. & Tu, Yong & Eng Ong, Seow, 2007. "Multilevel modeling using spatial processes: Application to the Singapore housing market," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3567-3579, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jtsera:v:43:y:2022:i:2:p:157-177. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0143-9782 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.