IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v65y2024i2d10.1007_s00362-023-01410-7.html
   My bibliography  Save this article

Kalman recursions Aggregated Online

Author

Listed:
  • Eric Adjakossa

    (MIA Paris-Saclay (UMR 518), Paris-Saclay University, AgroParisTech Campus)

  • Yannig Goude

    (EDF Lab)

  • Olivier Wintenberger

    (Sorbonne Université
    Universität Wien)

Abstract

In this article, we aim to improve the prediction from experts’ aggregation by using the underlying properties of the models that provide the experts involved in the aggregation procedure. We restrict ourselves to the case where experts perform their predictions by fitting state-space models to the data using Kalman recursions. Using exponential weights, we construct different Kalman recursions Aggregated Online (KAO) algorithms that compete with the best expert or the best convex combination of experts in a more or less adaptive way. When the experts are Kalman recursions, we improve the existing results on experts’ aggregation literature, taking advantage of the second-order properties of the Kalman recursions. We apply our approach to Kalman recursions and extend it to the general adversarial expert setting by state-space modeling the experts’ errors. We apply these new algorithms to a real-data set of electricity consumption and show how they can improve forecast performances compared to other exponentially weighted average procedures.

Suggested Citation

  • Eric Adjakossa & Yannig Goude & Olivier Wintenberger, 2024. "Kalman recursions Aggregated Online," Statistical Papers, Springer, vol. 65(2), pages 909-944, April.
    • Handle: RePEc:spr:stpapr:v:65:y:2024:i:2:d:10.1007_s00362-023-01410-7
    DOI: 10.1007/s00362-023-01410-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-023-01410-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00362-023-01410-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Amat, Christophe & Michalski, Tomasz & Stoltz, Gilles, 2018. "Fundamentals and exchange rate forecastability with simple machine learning methods," Journal of International Money and Finance, Elsevier, vol. 88(C), pages 1-24.
    2. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    3. Gaillard, Pierre & Goude, Yannig & Nedellec, Raphaël, 2016. "Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1038-1050.
    4. Malo Huard & Rémy Garnier & Gilles Stoltz, 2020. "Hierarchical robust aggregation of sales forecasts at aggregated levels in e-commerce, based on exponential smoothing and Holt's linear trend method," Working Papers hal-02794320, HAL.
    5. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178, Decembrie.
    6. Carmine de Franco & Christophe Geissler & Vincent Margot & Bruno Monnier, 2020. "ESG investments: Filtering versus machine learning approaches," Papers 2002.07477, arXiv.org, revised Apr 2020.
    7. Dordonnat, Virginie & Koopman, Siem Jan & Ooms, Marius, 2012. "Dynamic factors in periodic time-varying regressions with an application to hourly electricity load modelling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3134-3152.
    8. R. A. Rigby & D. M. Stasinopoulos, 2005. "Generalized additive models for location, scale and shape," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(3), pages 507-554, June.
    9. Thorey, J. & Chaussin, C. & Mallet, V., 2018. "Ensemble forecast of photovoltaic power with online CRPS learning," International Journal of Forecasting, Elsevier, vol. 34(4), pages 762-773.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    2. Christopher Kath & Florian Ziel, 2020. "Optimal Order Execution in Intraday Markets: Minimizing Costs in Trade Trajectories," Papers 2009.07892, arXiv.org, revised Oct 2020.
    3. Komi Nagbe & Jairo Cugliari & Julien Jacques, 2018. "Short-Term Electricity Demand Forecasting Using a Functional State Space Model," Energies, MDPI, vol. 11(5), pages 1-24, May.
    4. Caston Sigauke & Murendeni Maurel Nemukula & Daniel Maposa, 2018. "Probabilistic Hourly Load Forecasting Using Additive Quantile Regression Models," Energies, MDPI, vol. 11(9), pages 1-21, August.
    5. Berrisch, Jonathan & Ziel, Florian, 2024. "Multivariate probabilistic CRPS learning with an application to day-ahead electricity prices," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1568-1586.
    6. Zhang, Shu & Wang, Yi & Zhang, Yutian & Wang, Dan & Zhang, Ning, 2020. "Load probability density forecasting by transforming and combining quantile forecasts," Applied Energy, Elsevier, vol. 277(C).
    7. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    8. Paresh Date & Janeeta Maunthrooa, 2025. "Modelling and Forecasting of Exchange Rate Pairs Using the Kalman Filter," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(2), pages 606-622, March.
    9. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    10. Brégère, Margaux & Huard, Malo, 2022. "Online hierarchical forecasting for power consumption data," International Journal of Forecasting, Elsevier, vol. 38(1), pages 339-351.
    11. Victor Bystrov, 2018. "Measuring the Natural Rates of Interest in Germany and Italy," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(4), pages 333-353, December.
    12. Yukai Yang & Luc Bauwens, 2018. "State-Space Models on the Stiefel Manifold with a New Approach to Nonlinear Filtering," Econometrics, MDPI, vol. 6(4), pages 1-22, December.
    13. Fernández-Macho, Javier, 2008. "Spectral estimation of a structural thin-plate smoothing model," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 189-195, September.
    14. Drew Creal & Siem Jan Koopman & Eric Zivot, 2008. "The Effect of the Great Moderation on the U.S. Business Cycle in a Time-varying Multivariate Trend-cycle Model," Tinbergen Institute Discussion Papers 08-069/4, Tinbergen Institute.
    15. Avanzi, Benjamin & Taylor, Greg & Vu, Phuong Anh & Wong, Bernard, 2020. "A multivariate evolutionary generalised linear model framework with adaptive estimation for claims reserving," Insurance: Mathematics and Economics, Elsevier, vol. 93(C), pages 50-71.
    16. Yixuan Wang & Jianzhu Li & Ping Feng & Rong Hu, 2015. "A Time-Dependent Drought Index for Non-Stationary Precipitation Series," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 29(15), pages 5631-5647, December.
    17. François R. Velde, 2009. "Chronicle of a Deflation Unforetold," Journal of Political Economy, University of Chicago Press, vol. 117(4), pages 591-634, August.
    18. Chen, Peimin & Wu, Chunchi, 2014. "Default prediction with dynamic sectoral and macroeconomic frailties," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 211-226.
    19. repec:zbw:bofitp:2019_008 is not listed on IDEAS
    20. Yue Zhao & Difang Wan, 2018. "Institutional high frequency trading and price discovery: Evidence from an emerging commodity futures market," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 38(2), pages 243-270, February.
    21. Wen Xu, 2016. "Estimation of Dynamic Panel Data Models with Stochastic Volatility Using Particle Filters," Econometrics, MDPI, vol. 4(4), pages 1-13, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:65:y:2024:i:2:d:10.1007_s00362-023-01410-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.