IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v383y2025ics030626192500087x.html
   My bibliography  Save this article

Enhancing electricity price forecasting accuracy: A novel filtering strategy for improved out-of-sample predictions

Author

Listed:
  • Cerasa, Andrea
  • Zani, Alessandro

Abstract

Reliable electricity price forecasts are key for energy sector strategy. The presence of market volatility and price spikes may negatively affect the accuracy of predictions if not properly addressed. In this study, we introduced a novel filtering strategy designed to enhance the accuracy of electricity price forecasting by effectively identifying and replacing extreme price spikes. Our approach is grounded in the application of robust statistical techniques within a rolling window framework, allowing for the systematic cleansing of input data used for forecasting models. We validated the efficiency and accuracy of our method using state-of-the-art statistical and deep learning models within an open-access dataset framework encompassing six different energy markets. The comparison of accuracy metrics and the outcome of statistical tests consistently demonstrated improvements in forecast accuracy when using our filtered data, with gains of up to 4% for certain models with respect to the predictions obtained with unfiltered inputs. Finally, the proposed filtering strategy exhibits reasonable and affordable computational requirements, making it suitable for practical applications in a real-world market setting.

Suggested Citation

  • Cerasa, Andrea & Zani, Alessandro, 2025. "Enhancing electricity price forecasting accuracy: A novel filtering strategy for improved out-of-sample predictions," Applied Energy, Elsevier, vol. 383(C).
  • Handle: RePEc:eee:appene:v:383:y:2025:i:c:s030626192500087x
    DOI: 10.1016/j.apenergy.2025.125357
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626192500087X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.125357?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    2. Haldrup, Niels & Nielsen, Frank S. & Nielsen, Morten Ørregaard, 2010. "A vector autoregressive model for electricity prices subject to long memory and regime switching," Energy Economics, Elsevier, vol. 32(5), pages 1044-1058, September.
    3. Galarneau-Vincent, Rémi & Gauthier, Geneviève & Godin, Frédéric, 2023. "Foreseeing the worst: Forecasting electricity DART spikes," Energy Economics, Elsevier, vol. 119(C).
    4. Grossi, Luigi & Nan, Fany, 2019. "Robust forecasting of electricity prices: Simulations, models and the impact of renewable sources," Technological Forecasting and Social Change, Elsevier, vol. 141(C), pages 305-318.
    5. Uniejewski, Bartosz & Maciejowska, Katarzyna, 2023. "LASSO principal component averaging: A fully automated approach for point forecast pooling," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1839-1852.
    6. Helyette Geman & A. Roncoroni, 2006. "Understanding the Fine Structure of Electricity Prices," Post-Print halshs-00144198, HAL.
    7. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    8. Gianfreda, Angelica & Ravazzolo, Francesco & Rossini, Luca, 2020. "Comparing the forecasting performances of linear models for electricity prices with high RES penetration," International Journal of Forecasting, Elsevier, vol. 36(3), pages 974-986.
    9. Afanasyev, Dmitriy O. & Fedorova, Elena A., 2019. "On the impact of outlier filtering on the electricity price forecasting accuracy," Applied Energy, Elsevier, vol. 236(C), pages 196-210.
    10. Hendrik Bessembinder & Michael L. Lemmon, 2002. "Equilibrium Pricing and Optimal Hedging in Electricity Forward Markets," Journal of Finance, American Finance Association, vol. 57(3), pages 1347-1382, June.
    11. Alvaro Cartea & Marcelo Figueroa, 2005. "Pricing in Electricity Markets: A Mean Reverting Jump Diffusion Model with Seasonality," Applied Mathematical Finance, Taylor & Francis Journals, vol. 12(4), pages 313-335.
    12. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    13. Sergey Voronin & Jarmo Partanen, 2013. "Price Forecasting in the Day-Ahead Energy Market by an Iterative Method with Separate Normal Price and Price Spike Frameworks," Energies, MDPI, vol. 6(11), pages 1-24, November.
    14. Ledolter, Johannes, 1989. "The effect of additive outliers on the forecasts from ARIMA models," International Journal of Forecasting, Elsevier, vol. 5(2), pages 231-240.
    15. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    16. Stylianos Loizidis & Georgios Konstantinidis & Spyros Theocharides & Andreas Kyprianou & George E. Georghiou, 2023. "Electricity Day-Ahead Market Conditions and Their Effect on the Different Supervised Algorithms for Market Price Forecasting," Energies, MDPI, vol. 16(12), pages 1-29, June.
    17. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    18. repec:qut:auncer:2012_5 is not listed on IDEAS
    19. Katarzyna Maciejowska & Rafał Weron, 2015. "Forecasting of daily electricity prices with factor models: utilizing intra-day and inter-zone relationships," Computational Statistics, Springer, vol. 30(3), pages 805-819, September.
    20. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    21. Luigi Grossi & Fany Nan, 2018. "The influence of renewables on electricity price forecasting: a robust approach," Working Papers 2018/10, Institut d'Economia de Barcelona (IEB).
    22. Bordignon, Silvano & Bunn, Derek W. & Lisi, Francesco & Nan, Fany, 2013. "Combining day-ahead forecasts for British electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 88-103.
    23. Adam Krechowicz & Maria Krechowicz & Katarzyna Poczeta, 2022. "Machine Learning Approaches to Predict Electricity Production from Renewable Energy Sources," Energies, MDPI, vol. 15(23), pages 1-41, December.
    24. Joanna Janczura & Rafał Weron, 2012. "Efficient estimation of Markov regime-switching models: An application to electricity spot prices," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(3), pages 385-407, July.
    25. Trueck, Stefan & Weron, Rafal & Wolff, Rodney, 2007. "Outlier Treatment and Robust Approaches for Modeling Electricity Spot Prices," MPRA Paper 4711, University Library of Munich, Germany.
    26. Nowotarski, Jakub & Weron, Rafał, 2016. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 57(C), pages 228-235.
    27. Weron, Rafal & Misiorek, Adam, 2008. "Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 744-763.
    28. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    29. Gianfreda, Angelica & Grossi, Luigi, 2012. "Forecasting Italian electricity zonal prices with exogenous variables," Energy Economics, Elsevier, vol. 34(6), pages 2228-2239.
    30. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    31. Janczura, Joanna & Trück, Stefan & Weron, Rafał & Wolff, Rodney C., 2013. "Identifying spikes and seasonal components in electricity spot price data: A guide to robust modeling," Energy Economics, Elsevier, vol. 38(C), pages 96-110.
    32. Shadi Tehrani & Jesús Juan & Eduardo Caro, 2022. "Electricity Spot Price Modeling and Forecasting in European Markets," Energies, MDPI, vol. 15(16), pages 1-23, August.
    33. Koopman, Siem Jan & Ooms, Marius & Carnero, M. Angeles, 2007. "Periodic Seasonal Reg-ARFIMAGARCH Models for Daily Electricity Spot Prices," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 16-27, March.
    34. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    35. Crespo Cuaresma, Jesús & Hlouskova, Jaroslava & Kossmeier, Stephan & Obersteiner, Michael, 2004. "Forecasting electricity spot-prices using linear univariate time-series models," Applied Energy, Elsevier, vol. 77(1), pages 87-106, January.
    36. Benth, Fred Espen & Kiesel, Rüdiger & Nazarova, Anna, 2012. "A critical empirical study of three electricity spot price models," Energy Economics, Elsevier, vol. 34(5), pages 1589-1616.
    37. Maciej Kostrzewski & Jadwiga Kostrzewska, 2021. "The Impact of Forecasting Jumps on Forecasting Electricity Prices," Energies, MDPI, vol. 14(2), pages 1-17, January.
    38. Bierbrauer, Michael & Menn, Christian & Rachev, Svetlozar T. & Truck, Stefan, 2007. "Spot and derivative pricing in the EEX power market," Journal of Banking & Finance, Elsevier, vol. 31(11), pages 3462-3485, November.
    39. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    40. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    41. Christensen, T.M. & Hurn, A.S. & Lindsay, K.A., 2012. "Forecasting spikes in electricity prices," International Journal of Forecasting, Elsevier, vol. 28(2), pages 400-411.
    42. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    43. Manner, Hans & Türk, Dennis & Eichler, Michael, 2016. "Modeling and forecasting multivariate electricity price spikes," Energy Economics, Elsevier, vol. 60(C), pages 255-265.
    44. Dipeng Chen & Derek Bunn, 2014. "The Forecasting Performance of a Finite Mixture Regime‐Switching Model for Daily Electricity Prices," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(5), pages 364-375, August.
    45. Fanone, Enzo & Gamba, Andrea & Prokopczuk, Marcel, 2013. "The case of negative day-ahead electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 22-34.
    46. Bartosz Uniejewski & Rafal Weron & Florian Ziel, 2017. "Variance stabilizing transformations for electricity spot price forecasting," HSC Research Reports HSC/17/01, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    47. repec:dau:papers:123456789/1433 is not listed on IDEAS
    48. Muniain, Peru & Ziel, Florian, 2020. "Probabilistic forecasting in day-ahead electricity markets: Simulating peak and off-peak prices," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1193-1210.
    49. Hélyette Geman & Andrea Roncoroni, 2006. "Understanding the Fine Structure of Electricity Prices," The Journal of Business, University of Chicago Press, vol. 79(3), pages 1225-1262, May.
    50. Paraschiv, Florentina & Fleten, Stein-Erik & Schürle, Michael, 2015. "A spot-forward model for electricity prices with regime shifts," Energy Economics, Elsevier, vol. 47(C), pages 142-153.
    51. Stevenson Maxwell J & Moreira do Amaral Luiz Felipe & Peat Maurice, 2006. "Risk Management and the Role of Spot Price Predictions in the Australian Retail Electricity Market," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-25, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    2. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    3. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    4. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    5. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    6. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    7. Florian Ziel & Rafal Weron, 2016. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate models," HSC Research Reports HSC/16/08, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    8. Nowotarski, Jakub & Tomczyk, Jakub & Weron, Rafał, 2013. "Robust estimation and forecasting of the long-term seasonal component of electricity spot prices," Energy Economics, Elsevier, vol. 39(C), pages 13-27.
    9. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    10. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    11. Chȩć, Katarzyna & Uniejewski, Bartosz & Weron, Rafał, 2025. "Extrapolating the long-term seasonal component of electricity prices for forecasting in the day-ahead market," Journal of Commodity Markets, Elsevier, vol. 37(C).
    12. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    13. Katarzyna Chk{e}'c & Bartosz Uniejewski & Rafa{l} Weron, 2025. "Extrapolating the long-term seasonal component of electricity prices for forecasting in the day-ahead market," Papers 2503.02518, arXiv.org.
    14. Afanasyev, Dmitriy O. & Fedorova, Elena A., 2019. "On the impact of outlier filtering on the electricity price forecasting accuracy," Applied Energy, Elsevier, vol. 236(C), pages 196-210.
    15. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    16. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    17. Billé, Anna Gloria & Gianfreda, Angelica & Del Grosso, Filippo & Ravazzolo, Francesco, 2023. "Forecasting electricity prices with expert, linear, and nonlinear models," International Journal of Forecasting, Elsevier, vol. 39(2), pages 570-586.
    18. Bartosz Uniejewski, 2023. "Smoothing Quantile Regression Averaging: A new approach to probabilistic forecasting of electricity prices," Papers 2302.00411, arXiv.org, revised Nov 2024.
    19. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    20. Yan, Guan & Trück, Stefan, 2020. "A dynamic network analysis of spot electricity prices in the Australian national electricity market," Energy Economics, Elsevier, vol. 92(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:383:y:2025:i:c:s030626192500087x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.