IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v35y2020i3d10.1007_s00180-019-00937-4.html
   My bibliography  Save this article

Efficient inference in state-space models through adaptive learning in online Monte Carlo expectation maximization

Author

Listed:
  • Donna Henderson

    (University of Oxford)

  • Gerton Lunter

    (Unversity of Oxford)

Abstract

Expectation maximization (EM) is a technique for estimating maximum-likelihood parameters of a latent variable model given observed data by alternating between taking expectations of sufficient statistics, and maximizing the expected log likelihood. For situations where sufficient statistics are intractable, stochastic approximation EM (SAEM) is often used, which uses Monte Carlo techniques to approximate the expected log likelihood. Two common implementations of SAEM, Batch EM (BEM) and online EM (OEM), are parameterized by a “learning rate”, and their efficiency depend strongly on this parameter. We propose an extension to the OEM algorithm, termed Introspective Online Expectation Maximization (IOEM), which removes the need for specifying this parameter by adapting the learning rate to trends in the parameter updates. We show that our algorithm matches the efficiency of the optimal BEM and OEM algorithms in multiple models, and that the efficiency of IOEM can exceed that of BEM/OEM methods with optimal learning rates when the model has many parameters. Finally we use IOEM to fit two models to a financial time series. A Python implementation is available at https://github.com/luntergroup/IOEM.git .

Suggested Citation

  • Donna Henderson & Gerton Lunter, 2020. "Efficient inference in state-space models through adaptive learning in online Monte Carlo expectation maximization," Computational Statistics, Springer, vol. 35(3), pages 1319-1344, September.
    • Handle: RePEc:spr:compst:v:35:y:2020:i:3:d:10.1007_s00180-019-00937-4
    DOI: 10.1007/s00180-019-00937-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-019-00937-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00180-019-00937-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ravi Varadhan & Christophe Roland, 2008. "Simple and Globally Convergent Methods for Accelerating the Convergence of Any EM Algorithm," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 35(2), pages 335-353, June.
    2. R. H. Shumway & D. S. Stoffer, 1982. "An Approach To Time Series Smoothing And Forecasting Using The Em Algorithm," Journal of Time Series Analysis, Wiley Blackwell, vol. 3(4), pages 253-264, July.
    3. Fearnhead, Paul & Vasileiou, Despina, 2009. "Bayesian Analysis of Isochores," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 132-141.
    4. Cornett, Marcia Millon & Schwarz, Thomas V. & Szakmary, Andrew C., 1995. "Seasonalities and intraday return patterns in the foreign currency futures market," Journal of Banking & Finance, Elsevier, vol. 19(5), pages 843-869, August.
    5. repec:wyi:journl:002173 is not listed on IDEAS
    6. Olivier Cappé & Eric Moulines, 2009. "On‐line expectation–maximization algorithm for latent data models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(3), pages 593-613, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mazzocchi, Mario, 2006. "Time patterns in UK demand for alcohol and tobacco: an application of the EM algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 50(9), pages 2191-2205, May.
    2. Maire, Florian & Moulines, Eric & Lefebvre, Sidonie, 2017. "Online EM for functional data," Computational Statistics & Data Analysis, Elsevier, vol. 111(C), pages 27-47.
    3. Greg Lewis & Bora Ozaltun & Georgios Zervas, 2021. "Maximum Likelihood Estimation of Differentiated Products Demand Systems," Papers 2111.12397, arXiv.org.
    4. Zirogiannis, Nikolaos & Tripodis, Yorghos, 2013. "A Generalized Dynamic Factor Model for Panel Data: Estimation with a Two-Cycle Conditional Expectation-Maximization Algorithm," Working Paper Series 142752, University of Massachusetts, Amherst, Department of Resource Economics.
    5. Tobias Hartl & Roland Jucknewitz, 2022. "Approximate state space modelling of unobserved fractional components," Econometric Reviews, Taylor & Francis Journals, vol. 41(1), pages 75-98, January.
    6. Jurgen A. Doornik, 2018. "Accelerated Estimation of Switching Algorithms: The Cointegrated VAR Model and Other Applications," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 45(2), pages 283-300, June.
    7. Joseph Ndong & Ted Soubdhan, 2022. "Extracting Statistical Properties of Solar and Photovoltaic Power Production for the Scope of Building a Sophisticated Forecasting Framework," Forecasting, MDPI, vol. 5(1), pages 1-21, December.
    8. David de Antonio Liedo, 2014. "Nowcasting Belgium," Working Paper Research 256, National Bank of Belgium.
    9. Admin Starcevic & Timothy Rodgers, 2011. "Market Efficiency within the German Stock Market: A Comparative Study of the Relative Efficiencies of the DAX, MDAX, SDAX and ASE Indices," International Econometric Review (IER), Econometric Research Association, vol. 3(1), pages 25-37, April.
    10. Proietti, Tommaso, 2008. "Estimation of Common Factors under Cross-Sectional and Temporal Aggregation Constraints: Nowcasting Monthly GDP and its Main Components," MPRA Paper 6860, University Library of Munich, Germany.
    11. Matteo Barigozzi & Marc Hallin, 2023. "Dynamic Factor Models: a Genealogy," Papers 2310.17278, arXiv.org, revised Jan 2024.
    12. Yue, Chen & Chen, Shaojie & Sair, Haris I. & Airan, Raag & Caffo, Brian S., 2015. "Estimating a graphical intra-class correlation coefficient (GICC) using multivariate probit-linear mixed models," Computational Statistics & Data Analysis, Elsevier, vol. 89(C), pages 126-133.
    13. Alexander Tsyplakov, 2011. "An introduction to state space modeling (in Russian)," Quantile, Quantile, issue 9, pages 1-24, July.
    14. Wang, Xinya & Liu, Huifang & Huang, Shupei, 2019. "Identification of the daily seasonality in gold returns and volatilities: Evidence from Shanghai and London," Resources Policy, Elsevier, vol. 61(C), pages 522-531.
    15. Francis Breedon & Angelo Ranaldo, 2013. "Intraday Patterns in FX Returns and Order Flow," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45(5), pages 953-965, August.
    16. Brett Hollenbeck & Kosuke Uetake, 2021. "Taxation and market power in the legal marijuana industry," RAND Journal of Economics, RAND Corporation, vol. 52(3), pages 559-595, September.
    17. Ma, Tao & Zhou, Zhou & Antoniou, Constantinos, 2018. "Dynamic factor model for network traffic state forecast," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 281-317.
    18. Grassi, Stefano & Proietti, Tommaso & Frale, Cecilia & Marcellino, Massimiliano & Mazzi, Gianluigi, 2015. "EuroMInd-C: A disaggregate monthly indicator of economic activity for the Euro area and member countries," International Journal of Forecasting, Elsevier, vol. 31(3), pages 712-738.
    19. Necmettin Alpay Koçak, 2020. "The Role of Ecb Speeches in Nowcasting German Gdp," European Financial and Accounting Journal, Prague University of Economics and Business, vol. 2020(2), pages 05-20.
    20. T.P.Koirala, Ph.D., 2013. "Time-Varying Parameters of Inflation Model in Nepal: State Space Modeling," NRB Economic Review, Nepal Rastra Bank, Economic Research Department, vol. 25(2), pages 66-77, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:35:y:2020:i:3:d:10.1007_s00180-019-00937-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.