IDEAS home Printed from https://ideas.repec.org/p/hal/wpaper/hal-03262208.html
   My bibliography  Save this paper

Short-term electricity price forecastingmodels comparative analysis : Machine Learning vs. Econometrics

Author

Listed:
  • Antoine Ferré

    (IFPEN - IFP Energies nouvelles, IFP School)

  • Guillaume de Certaines

    (IFPEN - IFP Energies nouvelles, IFP School)

  • Jérôme Cazelles

    (IFPEN - IFP Energies nouvelles, IFP School)

  • Tancrède Cohet

    (IFPEN - IFP Energies nouvelles, IFP School)

  • Arash Farnoosh

    (IFPEN - IFP Energies nouvelles, IFP School)

  • Frédéric Lantz

    (IFPEN - IFP Energies nouvelles, IFP School)

Abstract

This paper gives an overview of several models applied to forecast the day-ahead prices of the German electricity market between 2014 and 2015 using hourly wind and solar productions as well as load. Four econometric models were built: SARIMA, SARIMAX, Holt-Winters and Monte Carlo Markov Chain Switching Regimes. Two machine learning approaches were also studied: a Gaussian mixture classification coupled with a random forest and finally, an LSTM algorithm. The best performances were obtained using the SARIMAX and LSTM models. The SARIMAX model makes good predictions and has the advantage through its explanatory variables to better capture the price volatility. The addition of other explanatory variables could improve the prediction of the models presented. The RF exhibits good results and allows to build a confidence interval. The LSTM model provides excellent results, but the precise understanding of the functioning of this model is much more complex.

Suggested Citation

  • Antoine Ferré & Guillaume de Certaines & Jérôme Cazelles & Tancrède Cohet & Arash Farnoosh & Frédéric Lantz, 2021. "Short-term electricity price forecastingmodels comparative analysis : Machine Learning vs. Econometrics," Working Papers hal-03262208, HAL.
    • Handle: RePEc:hal:wpaper:hal-03262208
    Note: View the original document on HAL open archive server: https://ifp.hal.science/hal-03262208
    as

    Download full text from publisher

    File URL: https://ifp.hal.science/hal-03262208/document
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cyril Martin de Lagarde & Frédéric Lantz, 2018. "How renewable production depresses electricity prices: Evidence from the German market," Post-Print hal-01985024, HAL.
    2. Elamin, Niematallah & Fukushige, Mototsugu, 2018. "Modeling and forecasting hourly electricity demand by SARIMAX with interactions," Energy, Elsevier, vol. 165(PB), pages 257-268.
    3. Mount, Timothy D. & Ning, Yumei & Cai, Xiaobin, 2006. "Predicting price spikes in electricity markets using a regime-switching model with time-varying parameters," Energy Economics, Elsevier, vol. 28(1), pages 62-80, January.
    4. Haldrup, Niels & Nielsen, Frank S. & Nielsen, Morten Ørregaard, 2010. "A vector autoregressive model for electricity prices subject to long memory and regime switching," Energy Economics, Elsevier, vol. 32(5), pages 1044-1058, September.
    5. Haldrup, Niels & Nielsen, Morten Orregaard, 2006. "A regime switching long memory model for electricity prices," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 349-376.
    6. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
    7. Martin de Lagarde, Cyril & Lantz, Frédéric, 2018. "How renewable production depresses electricity prices: Evidence from the German market," Energy Policy, Elsevier, vol. 117(C), pages 263-277.
    8. Zachmann, Georg, 2013. "A stochastic fuel switching model for electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 5-13.
    9. Cyril Martin de Lagarde & Frédéric Lantz, 2018. "How renewable production depresses electricity prices: Evidence from the German market," Post-Print hal-01986207, HAL.
    10. Haldrup Niels & Nielsen Morten Ø., 2006. "Directional Congestion and Regime Switching in a Long Memory Model for Electricity Prices," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-24, September.
    11. Goldfeld, Stephen M. & Quandt, Richard E., 1973. "A Markov model for switching regressions," Journal of Econometrics, Elsevier, vol. 1(1), pages 3-15, March.
    12. Katarzyna Maciejowska & Weronika Nitka & Tomasz Weron, 2019. "Day-Ahead vs. Intraday—Forecasting the Price Spread to Maximize Economic Benefits," Energies, MDPI, vol. 12(4), pages 1-15, February.
    13. Renn, Ortwin & Marshall, Jonathan Paul, 2016. "Coal, nuclear and renewable energy policies in Germany: From the 1950s to the “Energiewende”," Energy Policy, Elsevier, vol. 99(C), pages 224-232.
    14. Thao Pham & Killian Lemoine, 2020. "Impacts of subsidized renewable electricity generation on spot market prices in Germany : Evidence from a GARCH model with panel data," Working Papers hal-02568268, HAL.
    15. Paraschiv, Florentina & Erni, David & Pietsch, Ralf, 2014. "The impact of renewable energies on EEX day-ahead electricity prices," Energy Policy, Elsevier, vol. 73(C), pages 196-210.
    16. Huisman, Ronald, 2008. "The influence of temperature on spike probability in day-ahead power prices," Energy Economics, Elsevier, vol. 30(5), pages 2697-2704, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jun Dong & Xihao Dou & Aruhan Bao & Yaoyu Zhang & Dongran Liu, 2022. "Day-Ahead Spot Market Price Forecast Based on a Hybrid Extreme Learning Machine Technique: A Case Study in China," Sustainability, MDPI, vol. 14(13), pages 1-24, June.
    2. Diankai Wang & Inna Gryshova & Mykola Kyzym & Tetiana Salashenko & Viktoriia Khaustova & Maryna Shcherbata, 2022. "Electricity Price Instability over Time: Time Series Analysis and Forecasting," Sustainability, MDPI, vol. 14(15), pages 1-24, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin de Lagarde, Cyril & Lantz, Frédéric, 2018. "How renewable production depresses electricity prices: Evidence from the German market," Energy Policy, Elsevier, vol. 117(C), pages 263-277.
    2. Cyril Martin de Lagarde & Frédéric Lantz, 2017. "Impact of Variable Renewable Production on Electriciy Prices in Germany : A Markov Switching Model," Working Papers hal-03187020, HAL.
    3. Joanna Janczura, 2014. "Pricing electricity derivatives within a Markov regime-switching model: a risk premium approach," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 79(1), pages 1-30, February.
    4. Joanna Janczura, 2012. "Pricing electricity derivatives within a Markov regime-switching model," Papers 1203.5442, arXiv.org.
    5. Eichler, M. & Türk, D., 2013. "Fitting semiparametric Markov regime-switching models to electricity spot prices," Energy Economics, Elsevier, vol. 36(C), pages 614-624.
    6. Zachmann, Georg, 2013. "A stochastic fuel switching model for electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 5-13.
    7. Samarth Kumar & David Schönheit & Matthew Schmidt & Dominik Möst, 2019. "Parsing the Effects of Wind and Solar Generation on the German Electricity Trade Surplus," Energies, MDPI, vol. 12(18), pages 1-17, September.
    8. Woo, C.K. & Chen, Y. & Olson, A. & Moore, J. & Schlag, N. & Ong, A. & Ho, T., 2017. "Electricity price behavior and carbon trading: New evidence from California," Applied Energy, Elsevier, vol. 204(C), pages 531-543.
    9. Russo, Marianna & Kraft, Emil & Bertsch, Valentin & Keles, Dogan, 2022. "Short-term risk management of electricity retailers under rising shares of decentralized solar generation," Energy Economics, Elsevier, vol. 109(C).
    10. Angelica Gianfreda & Derek Bunn, 2018. "A Stochastic Latent Moment Model for Electricity Price Formation," BEMPS - Bozen Economics & Management Paper Series BEMPS46, Faculty of Economics and Management at the Free University of Bozen.
    11. Eichler, M. & Türk, D.D.T., 2012. "Fitting semiparametric Markov regime-switching models to electricity spot prices," Research Memorandum 035, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    12. Stephen Machin & Olivier Marie & Sunčica Vujić, 2012. "Youth Crime and Education Expansion," German Economic Review, Verein für Socialpolitik, vol. 13(4), pages 366-384, November.
    13. Woo, C.K. & Moore, J. & Schneiderman, B. & Ho, T. & Olson, A. & Alagappan, L. & Chawla, K. & Toyama, N. & Zarnikau, J., 2016. "Merit-order effects of renewable energy and price divergence in California’s day-ahead and real-time electricity markets," Energy Policy, Elsevier, vol. 92(C), pages 299-312.
    14. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601.
    15. Sapio, Alessandro & Spagnolo, Nicola, 2016. "Price regimes in an energy island: Tacit collusion vs. cost and network explanations," Energy Economics, Elsevier, vol. 55(C), pages 157-172.
    16. Zarnikau, J. & Tsai, C.H. & Woo, C.K., 2020. "Determinants of the wholesale prices of energy and ancillary services in the U.S. Midcontinent electricity market," Energy, Elsevier, vol. 195(C).
    17. Huisman, Ronald & Stet, Cristian, 2022. "The dependence of quantile power prices on supply from renewables," Energy Economics, Elsevier, vol. 105(C).
    18. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    19. Tselika, Kyriaki, 2022. "The impact of variable renewables on the distribution of hourly electricity prices and their variability: A panel approach," Energy Economics, Elsevier, vol. 113(C).
    20. Seuk Wai Phoong & Seuk Yen Phoong & Shi Ling Khek, 2022. "Systematic Literature Review With Bibliometric Analysis on Markov Switching Model: Methods and Applications," SAGE Open, , vol. 12(2), pages 21582440221, April.

    More about this item

    Keywords

    Energy Markets; Renewable Energy; Econometric modelling; Bootstrap Method; Merit-Order effect;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:wpaper:hal-03262208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.