IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1504.05723.html
   My bibliography  Save this paper

Noise Robust Online Inference for Linear Dynamic Systems

Author

Listed:
  • Saikat Saha

Abstract

We revisit the Bayesian online inference problems for the linear dynamic systems (LDS) under non- Gaussian environment. The noises can naturally be non-Gaussian (skewed and/or heavy tailed) or to accommodate spurious observations, noises can be modeled as heavy tailed. However, at the cost of such noise robustness, the performance may degrade when such spurious observations are absent. Therefore, any inference engine should not only be robust to noise outlier, but also be adaptive to potentially unknown and time varying noise parameters; yet it should be scalable and easy to implement. To address them, we envisage here a new noise adaptive Rao-Blackwellized particle filter (RBPF), by leveraging a hierarchically Gaussian model as a proxy for any non-Gaussian (process or measurement) noise density. This leads to a conditionally linear Gaussian model (CLGM), that is tractable. However, this framework requires a valid transition kernel for the intractable state, targeted by the particle filter (PF). This is typically unknown. We outline how such kernel can be constructed provably, at least for certain classes encompassing many commonly occurring non-Gaussian noises, using auxiliary latent variable approach. The efficacy of this RBPF algorithm is demonstrated through numerical studies.

Suggested Citation

  • Saikat Saha, 2015. "Noise Robust Online Inference for Linear Dynamic Systems," Papers 1504.05723, arXiv.org.
  • Handle: RePEc:arx:papers:1504.05723
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1504.05723
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    2. Nicolas Chopin, 2002. "Central Limit Theorem for Sequential Monte Carlo Methods and its Applications to Bayesian Inference," Working Papers 2002-44, Center for Research in Economics and Statistics.
    3. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    4. Nakajima, Jouchi & Omori, Yasuhiro, 2012. "Stochastic volatility model with leverage and asymmetrically heavy-tailed error using GH skew Student’s t-distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3690-3704.
    5. Rong Chen & Jun S. Liu, 2000. "Mixture Kalman filters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(3), pages 493-508.
    6. Marco J. Lombardi & Simon J. Godsill, 2004. "On-line Bayesian estimation of AR signals in symmetric alpha-stable noise," Econometrics Working Papers Archive wp2004_05, Universita' degli Studi di Firenze, Dipartimento di Statistica, Informatica, Applicazioni "G. Parenti".
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    2. Loaiza-Maya, Rubén & Smith, Michael Stanley & Nott, David J. & Danaher, Peter J., 2022. "Fast and accurate variational inference for models with many latent variables," Journal of Econometrics, Elsevier, vol. 230(2), pages 339-362.
    3. Chan, Joshua C.C., 2021. "Minnesota-type adaptive hierarchical priors for large Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1212-1226.
    4. Karlsson, Sune & Mazur, Stepan & Nguyen, Hoang, 2023. "Vector autoregression models with skewness and heavy tails," Journal of Economic Dynamics and Control, Elsevier, vol. 146(C).
    5. Joshua Chan, 2023. "BVARs and Stochastic Volatility," Papers 2310.14438, arXiv.org.
    6. Deschamps, Philippe J., 2012. "Bayesian estimation of generalized hyperbolic skewed student GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3035-3054.
    7. Chan, Joshua C.C., 2013. "Moving average stochastic volatility models with application to inflation forecast," Journal of Econometrics, Elsevier, vol. 176(2), pages 162-172.
    8. Siddhartha Chib & Minchul Shin & Fei Tan, 2023. "DSGE-SVt: An Econometric Toolkit for High-Dimensional DSGE Models with SV and t Errors," Computational Economics, Springer;Society for Computational Economics, vol. 61(1), pages 69-111, January.
    9. Calvet, Laurent-Emmanuel & Czellar , Veronika, 2011. "state-observation sampling and the econometrics of learning models," HEC Research Papers Series 947, HEC Paris.
    10. Yu Bai & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2022. "Macroeconomic forecasting in a multi‐country context," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1230-1255, September.
    11. Lee, Cheol Woo & Kang, Kyu Ho, 2023. "Estimating and testing skewness in a stochastic volatility model," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 445-467.
    12. Nicolas Chopin, 2007. "Dynamic Detection of Change Points in Long Time Series," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 59(2), pages 349-366, June.
    13. Benjamin K. Johannsen & Elmar Mertens, 2021. "A Time‐Series Model of Interest Rates with the Effective Lower Bound," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 53(5), pages 1005-1046, August.
    14. Gefang, Deborah & Koop, Gary & Poon, Aubrey, 2023. "Forecasting using variational Bayesian inference in large vector autoregressions with hierarchical shrinkage," International Journal of Forecasting, Elsevier, vol. 39(1), pages 346-363.
    15. Deborah Gefang & Gary Koop & Aubrey Poon, 2019. "Variational Bayesian Inference in Large Vector Autoregressions with Hierarchical Shrinkage," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2019-07, Economic Statistics Centre of Excellence (ESCoE).
    16. P. de Zea Bermudez & J. Miguel Marín & Helena Veiga, 2020. "Data cloning estimation for asymmetric stochastic volatility models," Econometric Reviews, Taylor & Francis Journals, vol. 39(10), pages 1057-1074, November.
    17. Takahashi, Makoto & Omori, Yasuhiro & Watanabe, Toshiaki, 2013. "News impact curve for stochastic volatility models," Economics Letters, Elsevier, vol. 120(1), pages 130-134.
    18. Charles Bos & Neil Shephard, 2006. "Inference for Adaptive Time Series Models: Stochastic Volatility and Conditionally Gaussian State Space Form," Econometric Reviews, Taylor & Francis Journals, vol. 25(2-3), pages 219-244.
    19. Lengua Lafosse, Patricia & Rodríguez, Gabriel, 2018. "An empirical application of a stochastic volatility model with GH skew Student's t-distribution to the volatility of Latin-American stock returns," The Quarterly Review of Economics and Finance, Elsevier, vol. 69(C), pages 155-173.
    20. Lombardi, Marco J. & Sgherri, Silvia, 2007. "(Un)naturally low? Sequential Monte Carlo tracking of the US natural interest rate," Working Paper Series 794, European Central Bank.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1504.05723. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.