IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2509.18887.html
   My bibliography  Save this paper

Driver Identification and PCA Augmented Selection Shrinkage Framework for Nordic System Price Forecasting

Author

Listed:
  • Yousef Adeli Sadabad
  • Mohammad Reza Hesamzadeh
  • Gyorgy Dan
  • Matin Bagherpour
  • Darryl R. Biggar

Abstract

The System Price (SP) of the Nordic electricity market serves as a key reference for financial hedge contracts such as Electricity Price Area Differentials (EPADs) and other risk management instruments. Therefore, the identification of drivers and the accurate forecasting of SP are essential for market participants to design effective hedging strategies. This paper develops a systematic framework that combines interpretable drivers analysis with robust forecasting methods. It proposes an interpretable feature engineering algorithm to identify the main drivers of the Nordic SP based on a novel combination of K-means clustering, Multiple Seasonal-Trend Decomposition (MSTD), and Seasonal Autoregressive Integrated Moving Average (SARIMA) model. Then, it applies principal component analysis (PCA) to the identified data matrix, which is adapted to the downstream task of price forecasting to mitigate the issue of imperfect multicollinearity in the data. Finally, we propose a multi-forecast selection-shrinkage algorithm for Nordic SP forecasting, which selects a subset of complementary forecast models based on their bias-variance tradeoff at the ensemble level and then computes the optimal weights for the retained forecast models to minimize the error variance of the combined forecast. Using historical data from the Nordic electricity market, we demonstrate that the proposed approach outperforms individual input models uniformly, robustly, and significantly, while maintaining a comparable computational cost. Notably, our systematic framework produces superior results using simple input models, outperforming the state-of-the-art Temporal Fusion Transformer (TFT). Furthermore, we show that our approach also exceeds the performance of several well-established practical forecast combination methods.

Suggested Citation

  • Yousef Adeli Sadabad & Mohammad Reza Hesamzadeh & Gyorgy Dan & Matin Bagherpour & Darryl R. Biggar, 2025. "Driver Identification and PCA Augmented Selection Shrinkage Framework for Nordic System Price Forecasting," Papers 2509.18887, arXiv.org.
  • Handle: RePEc:arx:papers:2509.18887
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2509.18887
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Katarzyna Hubicka & Grzegorz Marcjasz & Rafal Weron, 2018. "A note on averaging day-ahead electricity price forecasts across calibration windows," HSC Research Reports HSC/18/03, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    2. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    3. Kwiatkowski, Denis & Phillips, Peter C. B. & Schmidt, Peter & Shin, Yongcheol, 1992. "Testing the null hypothesis of stationarity against the alternative of a unit root : How sure are we that economic time series have a unit root?," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 159-178.
    4. He Jiang & Sheng Pan & Yao Dong & Jianzhou Wang, 2024. "Probabilistic electricity price forecasting based on penalized temporal fusion transformer," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1465-1491, August.
    5. Canova, Fabio & Hansen, Bruce E, 1995. "Are Seasonal Patterns Constant over Time? A Test for Seasonal Stability," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 237-252, July.
    6. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    7. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    8. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    9. Maciejowska, Katarzyna, 2020. "Assessing the impact of renewable energy sources on the electricity price level and variability – A quantile regression approach," Energy Economics, Elsevier, vol. 85(C).
    10. Rodrigo A. de Marcos & Derek W. Bunn & Antonio Bello & Javier Reneses, 2020. "Short-Term Electricity Price Forecasting with Recurrent Regimes and Structural Breaks," Energies, MDPI, vol. 13(20), pages 1-14, October.
    11. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    2. Grzegorz Marcjasz & Bartosz Uniejewski & Rafał Weron, 2020. "Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts," Energies, MDPI, vol. 13(7), pages 1-16, April.
    3. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    4. Uniejewski, Bartosz & Maciejowska, Katarzyna, 2023. "LASSO principal component averaging: A fully automated approach for point forecast pooling," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1839-1852.
    5. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    6. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    7. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    8. Madadkhani, Shiva & Ikonnikova, Svetlana, 2024. "Toward high-resolution projection of electricity prices: A machine learning approach to quantifying the effects of high fuel and CO2 prices," Energy Economics, Elsevier, vol. 129(C).
    9. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    10. Cerasa, Andrea & Zani, Alessandro, 2025. "Enhancing electricity price forecasting accuracy: A novel filtering strategy for improved out-of-sample predictions," Applied Energy, Elsevier, vol. 383(C).
    11. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    12. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    13. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    14. Grzegorz Marcjasz, 2020. "Forecasting Electricity Prices Using Deep Neural Networks: A Robust Hyper-Parameter Selection Scheme," Energies, MDPI, vol. 13(18), pages 1-18, September.
    15. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    16. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    17. Weronika Nitka & Tomasz Serafin & Dimitrios Sotiros, 2021. "Forecasting Electricity Prices: Autoregressive Hybrid Nearest Neighbors (ARHNN) method," WORking papers in Management Science (WORMS) WORMS/21/06, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    18. Grzegorz Marcjasz & Jesus Lago & Rafa{l} Weron, 2020. "Neural networks in day-ahead electricity price forecasting: Single vs. multiple outputs," Papers 2008.08006, arXiv.org.
    19. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1520-1532.
    20. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2509.18887. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.