IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1504.05723.html

Noise Robust Online Inference for Linear Dynamic Systems

Author

Listed:
  • Saikat Saha

Abstract

We revisit the Bayesian online inference problems for the linear dynamic systems (LDS) under non- Gaussian environment. The noises can naturally be non-Gaussian (skewed and/or heavy tailed) or to accommodate spurious observations, noises can be modeled as heavy tailed. However, at the cost of such noise robustness, the performance may degrade when such spurious observations are absent. Therefore, any inference engine should not only be robust to noise outlier, but also be adaptive to potentially unknown and time varying noise parameters; yet it should be scalable and easy to implement. To address them, we envisage here a new noise adaptive Rao-Blackwellized particle filter (RBPF), by leveraging a hierarchically Gaussian model as a proxy for any non-Gaussian (process or measurement) noise density. This leads to a conditionally linear Gaussian model (CLGM), that is tractable. However, this framework requires a valid transition kernel for the intractable state, targeted by the particle filter (PF). This is typically unknown. We outline how such kernel can be constructed provably, at least for certain classes encompassing many commonly occurring non-Gaussian noises, using auxiliary latent variable approach. The efficacy of this RBPF algorithm is demonstrated through numerical studies.

Suggested Citation

  • Saikat Saha, 2015. "Noise Robust Online Inference for Linear Dynamic Systems," Papers 1504.05723, arXiv.org.
  • Handle: RePEc:arx:papers:1504.05723
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1504.05723
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rong Chen & Jun S. Liu, 2000. "Mixture Kalman filters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(3), pages 493-508.
    2. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    3. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    4. Nicolas Chopin, 2002. "Central Limit Theorem for Sequential Monte Carlo Methods and its Applications to Bayesian Inference," Working Papers 2002-44, Center for Research in Economics and Statistics.
    5. Marco J. Lombardi & Simon J. Godsill, 2004. "On-line Bayesian estimation of AR signals in symmetric alpha-stable noise," Econometrics Working Papers Archive wp2004_05, Universita' degli Studi di Firenze, Dipartimento di Statistica, Informatica, Applicazioni "G. Parenti".
    6. Nakajima, Jouchi & Omori, Yasuhiro, 2012. "Stochastic volatility model with leverage and asymmetrically heavy-tailed error using GH skew Student’s t-distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3690-3704.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    2. Chan, Joshua C.C., 2021. "Minnesota-type adaptive hierarchical priors for large Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1212-1226.
    3. Lukas Berend & Jan Pruser, 2024. "The Transmission of Monetary Policy via Common Cycles in the Euro Area," Papers 2410.05741, arXiv.org, revised Nov 2024.
    4. Joshua C. C. Chan, 2024. "BVARs and stochastic volatility," Chapters, in: Michael P. Clements & Ana Beatriz Galvão (ed.), Handbook of Research Methods and Applications in Macroeconomic Forecasting, chapter 3, pages 43-67, Edward Elgar Publishing.
    5. Deschamps, Philippe J., 2012. "Bayesian estimation of generalized hyperbolic skewed student GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3035-3054.
    6. Chan, Joshua C.C., 2013. "Moving average stochastic volatility models with application to inflation forecast," Journal of Econometrics, Elsevier, vol. 176(2), pages 162-172.
    7. Siddhartha Chib & Minchul Shin & Fei Tan, 2023. "DSGE-SVt: An Econometric Toolkit for High-Dimensional DSGE Models with SV and t Errors," Computational Economics, Springer;Society for Computational Economics, vol. 61(1), pages 69-111, January.
    8. Loaiza-Maya, Rubén & Smith, Michael Stanley & Nott, David J. & Danaher, Peter J., 2022. "Fast and accurate variational inference for models with many latent variables," Journal of Econometrics, Elsevier, vol. 230(2), pages 339-362.
    9. Yu Bai & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2022. "Macroeconomic forecasting in a multi‐country context," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1230-1255, September.
    10. Lee, Cheol Woo & Kang, Kyu Ho, 2023. "Estimating and testing skewness in a stochastic volatility model," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 445-467.
    11. Harasheh, Murad & Bouteska, Ahmed, 2025. "Volatility estimation through stochastic processes: Evidence from cryptocurrencies," The North American Journal of Economics and Finance, Elsevier, vol. 75(PB).
    12. Nicolas Chopin, 2007. "Dynamic Detection of Change Points in Long Time Series," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 59(2), pages 349-366, June.
    13. Gefang, Deborah & Koop, Gary & Poon, Aubrey, 2023. "Forecasting using variational Bayesian inference in large vector autoregressions with hierarchical shrinkage," International Journal of Forecasting, Elsevier, vol. 39(1), pages 346-363.
    14. Takahashi, Makoto & Omori, Yasuhiro & Watanabe, Toshiaki, 2013. "News impact curve for stochastic volatility models," Economics Letters, Elsevier, vol. 120(1), pages 130-134.
    15. Charles Bos & Neil Shephard, 2006. "Inference for Adaptive Time Series Models: Stochastic Volatility and Conditionally Gaussian State Space Form," Econometric Reviews, Taylor & Francis Journals, vol. 25(2-3), pages 219-244.
    16. Lengua Lafosse, Patricia & Rodríguez, Gabriel, 2018. "An empirical application of a stochastic volatility model with GH skew Student's t-distribution to the volatility of Latin-American stock returns," The Quarterly Review of Economics and Finance, Elsevier, vol. 69(C), pages 155-173.
    17. Lombardi, Marco J. & Sgherri, Silvia, 2007. "(Un)naturally low? Sequential Monte Carlo tracking of the US natural interest rate," Working Paper Series 794, European Central Bank.
    18. Minheng Xiao, 2022. "Data-Driven Risk Measurement by SV-GARCH-EVT Model," Papers 2201.09434, arXiv.org, revised Dec 2024.
    19. Mao, Xiuping & Czellar, Veronika & Ruiz, Esther & Veiga, Helena, 2020. "Asymmetric stochastic volatility models: Properties and particle filter-based simulated maximum likelihood estimation," Econometrics and Statistics, Elsevier, vol. 13(C), pages 84-105.
    20. Deschamps, Philippe J., 2012. "Bayesian estimation of generalized hyperbolic skewed student GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3035-3054.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1504.05723. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.