IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v65y2024i2d10.1007_s00362-023-01410-7.html
   My bibliography  Save this article

Kalman recursions Aggregated Online

Author

Listed:
  • Eric Adjakossa

    (MIA Paris-Saclay (UMR 518), Paris-Saclay University, AgroParisTech Campus)

  • Yannig Goude

    (EDF Lab)

  • Olivier Wintenberger

    (Sorbonne Université
    Universität Wien)

Abstract

In this article, we aim to improve the prediction from experts’ aggregation by using the underlying properties of the models that provide the experts involved in the aggregation procedure. We restrict ourselves to the case where experts perform their predictions by fitting state-space models to the data using Kalman recursions. Using exponential weights, we construct different Kalman recursions Aggregated Online (KAO) algorithms that compete with the best expert or the best convex combination of experts in a more or less adaptive way. When the experts are Kalman recursions, we improve the existing results on experts’ aggregation literature, taking advantage of the second-order properties of the Kalman recursions. We apply our approach to Kalman recursions and extend it to the general adversarial expert setting by state-space modeling the experts’ errors. We apply these new algorithms to a real-data set of electricity consumption and show how they can improve forecast performances compared to other exponentially weighted average procedures.

Suggested Citation

  • Eric Adjakossa & Yannig Goude & Olivier Wintenberger, 2024. "Kalman recursions Aggregated Online," Statistical Papers, Springer, vol. 65(2), pages 909-944, April.
    • Handle: RePEc:spr:stpapr:v:65:y:2024:i:2:d:10.1007_s00362-023-01410-7
    DOI: 10.1007/s00362-023-01410-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-023-01410-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00362-023-01410-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Amat, Christophe & Michalski, Tomasz & Stoltz, Gilles, 2018. "Fundamentals and exchange rate forecastability with simple machine learning methods," Journal of International Money and Finance, Elsevier, vol. 88(C), pages 1-24.
    2. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    3. Gaillard, Pierre & Goude, Yannig & Nedellec, Raphaël, 2016. "Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1038-1050.
    4. Malo Huard & Rémy Garnier & Gilles Stoltz, 2020. "Hierarchical robust aggregation of sales forecasts at aggregated levels in e-commerce, based on exponential smoothing and Holt's linear trend method," Working Papers hal-02794320, HAL.
    5. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    6. Carmine de Franco & Christophe Geissler & Vincent Margot & Bruno Monnier, 2020. "ESG investments: Filtering versus machine learning approaches," Papers 2002.07477, arXiv.org, revised Apr 2020.
    7. Dordonnat, Virginie & Koopman, Siem Jan & Ooms, Marius, 2012. "Dynamic factors in periodic time-varying regressions with an application to hourly electricity load modelling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3134-3152.
    8. R. A. Rigby & D. M. Stasinopoulos, 2005. "Generalized additive models for location, scale and shape," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(3), pages 507-554, June.
    9. Thorey, J. & Chaussin, C. & Mallet, V., 2018. "Ensemble forecast of photovoltaic power with online CRPS learning," International Journal of Forecasting, Elsevier, vol. 34(4), pages 762-773.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Caston Sigauke & Murendeni Maurel Nemukula & Daniel Maposa, 2018. "Probabilistic Hourly Load Forecasting Using Additive Quantile Regression Models," Energies, MDPI, vol. 11(9), pages 1-21, August.
    2. Berrisch, Jonathan & Ziel, Florian, 2024. "Multivariate probabilistic CRPS learning with an application to day-ahead electricity prices," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1568-1586.
    3. Zhang, Shu & Wang, Yi & Zhang, Yutian & Wang, Dan & Zhang, Ning, 2020. "Load probability density forecasting by transforming and combining quantile forecasts," Applied Energy, Elsevier, vol. 277(C).
    4. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    5. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    6. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    7. Christopher Kath & Florian Ziel, 2020. "Optimal Order Execution in Intraday Markets: Minimizing Costs in Trade Trajectories," Papers 2009.07892, arXiv.org, revised Oct 2020.
    8. Komi Nagbe & Jairo Cugliari & Julien Jacques, 2018. "Short-Term Electricity Demand Forecasting Using a Functional State Space Model," Energies, MDPI, vol. 11(5), pages 1-24, May.
    9. Paresh Date & Janeeta Maunthrooa, 2025. "Modelling and Forecasting of Exchange Rate Pairs Using the Kalman Filter," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(2), pages 606-622, March.
    10. Brégère, Margaux & Huard, Malo, 2022. "Online hierarchical forecasting for power consumption data," International Journal of Forecasting, Elsevier, vol. 38(1), pages 339-351.
    11. Avanzi, Benjamin & Taylor, Greg & Vu, Phuong Anh & Wong, Bernard, 2020. "A multivariate evolutionary generalised linear model framework with adaptive estimation for claims reserving," Insurance: Mathematics and Economics, Elsevier, vol. 93(C), pages 50-71.
    12. Tomoya Mori & Daisuke Murakami, 2025. "Sustainability of cities under declining population and decreasing distance frictions: The case of Japan," KIER Working Papers 1117, Kyoto University, Institute of Economic Research.
    13. Yixuan Wang & Jianzhu Li & Ping Feng & Rong Hu, 2015. "A Time-Dependent Drought Index for Non-Stationary Precipitation Series," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 29(15), pages 5631-5647, December.
    14. François R. Velde, 2009. "Chronicle of a Deflation Unforetold," Journal of Political Economy, University of Chicago Press, vol. 117(4), pages 591-634, August.
    15. Wen Xu, 2016. "Estimation of Dynamic Panel Data Models with Stochastic Volatility Using Particle Filters," Econometrics, MDPI, vol. 4(4), pages 1-13, October.
    16. Blasques, F. & Francq, Christian & Laurent, Sébastien, 2024. "Autoregressive conditional betas," Journal of Econometrics, Elsevier, vol. 238(2).
    17. Nathaniel Geiger & Bryan McLaughlin & John Velez, 2021. "Not all boomers: temporal orientation explains inter- and intra-cultural variability in the link between age and climate engagement," Climatic Change, Springer, vol. 166(1), pages 1-20, May.
    18. Panayi, Efstathios & Peters, Gareth W. & Danielsson, Jon & Zigrand, Jean-Pierre, 2018. "Designating market maker behaviour in limit order book markets," Econometrics and Statistics, Elsevier, vol. 5(C), pages 20-44.
    19. Alejandro Rodriguez & Esther Ruiz, 2009. "Bootstrap prediction intervals in state–space models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 167-178, March.
    20. Parrini, Alessandro, 2013. "Importance Sampling for Portfolio Credit Risk in Factor Copula Models," MPRA Paper 103745, University Library of Munich, Germany.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:65:y:2024:i:2:d:10.1007_s00362-023-01410-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.