IDEAS home Printed from https://ideas.repec.org/a/gam/jforec/v5y2022i1p3-101d1020016.html
   My bibliography  Save this article

Machine Learning Models and Intra-Daily Market Information for the Prediction of Italian Electricity Prices

Author

Listed:
  • Silvia Golia

    (Department of Economics and Management, University of Brescia, 25122 Brescia, Italy)

  • Luigi Grossi

    (Department of Statistical Sciences, University of Padova, 35121 Padova, Italy)

  • Matteo Pelagatti

    (Department of Economics, Management and Statistics, University of Milano-Bicocca, 20126 Milano, Italy)

Abstract

In this paper we assess how intra-day electricity prices can improve the prediction of zonal day-ahead wholesale electricity prices in Italy. We consider linear autoregressive models with exogenous variables (ARX) with and without interactions among predictors, and non-parametric models taken from the machine learning literature. In particular, we implement Random Forests and support vector machines, which should automatically capture the relevant interactions among predictors. Given the large number of predictors, ARX models are also estimated using LASSO regularization, which improves predictions when regressors are many and selects the important variables. In addition to zonal intra-day prices, among the predictors we include also the official demand forecasts and wind generation expectations. Our results show that the prediction performance of the simple ARX model is mostly superior to those of machine learning models. The analysis of the relevance of exogenous variables, using variable importance measures, reveals that intra-day market information successfully contributes to the forecasting performance, although the impact differs among the estimated models.

Suggested Citation

  • Silvia Golia & Luigi Grossi & Matteo Pelagatti, 2022. "Machine Learning Models and Intra-Daily Market Information for the Prediction of Italian Electricity Prices," Forecasting, MDPI, vol. 5(1), pages 1-21, December.
  • Handle: RePEc:gam:jforec:v:5:y:2022:i:1:p:3-101:d:1020016
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-9394/5/1/3/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2571-9394/5/1/3/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Simon Schnürch & Andreas Wagner, 2020. "Electricity Price Forecasting with Neural Networks on EPEX Order Books," Applied Mathematical Finance, Taylor & Francis Journals, vol. 27(3), pages 189-206, May.
    2. Grossi, Luigi & Nan, Fany, 2019. "Robust forecasting of electricity prices: Simulations, models and the impact of renewable sources," Technological Forecasting and Social Change, Elsevier, vol. 141(C), pages 305-318.
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Grzegorz Marcjasz & Bartosz Uniejewski & Rafał Weron, 2020. "Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts," Energies, MDPI, vol. 13(7), pages 1-16, April.
    5. Graf, Christoph & Quaglia, Federico & Wolak, Frank A., 2021. "(Machine) learning from the COVID-19 lockdown about electricity market performance with a large share of renewables," Journal of Environmental Economics and Management, Elsevier, vol. 105(C).
    6. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    7. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    8. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    9. Fianu, Emmanuel Senyo & Ahelegbey, Daniel Felix & Grossi, Luigi, 2022. "Modeling risk contagion in the Italian zonal electricity market," European Journal of Operational Research, Elsevier, vol. 298(2), pages 656-679.
    10. Maciejowska, Katarzyna & Nitka, Weronika & Weron, Tomasz, 2021. "Enhancing load, wind and solar generation for day-ahead forecasting of electricity prices," Energy Economics, Elsevier, vol. 99(C).
    11. Bordignon, Silvano & Bunn, Derek W. & Lisi, Francesco & Nan, Fany, 2013. "Combining day-ahead forecasts for British electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 88-103.
    12. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    13. Gianfreda, Angelica & Grossi, Luigi, 2012. "Forecasting Italian electricity zonal prices with exogenous variables," Energy Economics, Elsevier, vol. 34(6), pages 2228-2239.
    14. Beltrami, Filippo & Fontini, Fulvio & Grossi, Luigi, 2021. "The value of carbon emission reduction induced by Renewable Energy Sources in the Italian power market," Ecological Economics, Elsevier, vol. 189(C).
    15. Carlo Fezzi and Luca Mosetti, 2020. "Size Matters: Estimation Sample Length and Electricity Price Forecasting Accuracy," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 231-254.
    16. Alexandre Lucas & Konstantinos Pegios & Evangelos Kotsakis & Dan Clarke, 2020. "Price Forecasting for the Balancing Energy Market Using Machine-Learning Regression," Energies, MDPI, vol. 13(20), pages 1-16, October.
    17. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    18. Ghoddusi, Hamed & Creamer, Germán G. & Rafizadeh, Nima, 2019. "Machine learning in energy economics and finance: A review," Energy Economics, Elsevier, vol. 81(C), pages 709-727.
    19. Barrow, Devon K. & Crone, Sven F., 2016. "A comparison of AdaBoost algorithms for time series forecast combination," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1103-1119.
    20. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1520-1532.
    21. Luigi Grossi & Sven Heim & Kai Hüschelrath & Michael Waterson, 2018. "Electricity market integration and the impact of unilateral policy reforms," Oxford Economic Papers, Oxford University Press, vol. 70(3), pages 799-820.
    22. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    23. Taddy, Matthew A. & Gramacy, Robert B. & Polson, Nicholas G., 2011. "Dynamic Trees for Learning and Design," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 109-123.
    24. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    25. Ekaterina Abramova & Derek Bunn, 2020. "Forecasting the Intra-Day Spread Densities of Electricity Prices," Papers 2002.10566, arXiv.org.
    26. Petropoulos, Fotios & Hyndman, Rob J. & Bergmeir, Christoph, 2018. "Exploring the sources of uncertainty: Why does bagging for time series forecasting work?," European Journal of Operational Research, Elsevier, vol. 268(2), pages 545-554.
    27. Ekaterina Abramova & Derek Bunn, 2020. "Forecasting the Intra-Day Spread Densities of Electricity Prices," Energies, MDPI, vol. 13(3), pages 1-31, February.
    28. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    2. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    5. Billé, Anna Gloria & Gianfreda, Angelica & Del Grosso, Filippo & Ravazzolo, Francesco, 2023. "Forecasting electricity prices with expert, linear, and nonlinear models," International Journal of Forecasting, Elsevier, vol. 39(2), pages 570-586.
    6. Serafin, Tomasz & Marcjasz, Grzegorz & Weron, Rafał, 2022. "Trading on short-term path forecasts of intraday electricity prices," Energy Economics, Elsevier, vol. 112(C).
    7. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    8. Nametala, Ciniro Aparecido Leite & Faria, Wandry Rodrigues & Lage, Guilherme Guimarães & Pereira, Benvindo Rodrigues, 2023. "Analysis of hourly price granularity implementation in the Brazilian deregulated electricity contracting environment," Utilities Policy, Elsevier, vol. 81(C).
    9. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    10. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    11. Michał Narajewski, 2022. "Probabilistic Forecasting of German Electricity Imbalance Prices," Energies, MDPI, vol. 15(14), pages 1-17, July.
    12. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    13. Micha{l} Narajewski & Florian Ziel, 2021. "Optimal bidding in hourly and quarter-hourly electricity price auctions: trading large volumes of power with market impact and transaction costs," Papers 2104.14204, arXiv.org, revised Feb 2022.
    14. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    15. Wagner, Andreas & Ramentol, Enislay & Schirra, Florian & Michaeli, Hendrik, 2022. "Short- and long-term forecasting of electricity prices using embedding of calendar information in neural networks," Journal of Commodity Markets, Elsevier, vol. 28(C).
    16. Janczura, Joanna & Wójcik, Edyta, 2022. "Dynamic short-term risk management strategies for the choice of electricity market based on probabilistic forecasts of profit and risk measures. The German and the Polish market case study," Energy Economics, Elsevier, vol. 110(C).
    17. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2020. "Performance of alternative electricity price forecasting methods: Findings from the Greek and Hungarian power exchanges," Applied Energy, Elsevier, vol. 277(C).
    18. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    19. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    20. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jforec:v:5:y:2022:i:1:p:3-101:d:1020016. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.