IDEAS home Printed from https://ideas.repec.org/p/ahh/wpaper/worms2002.html
   My bibliography  Save this paper

PCA forecast averaging - predicting day-ahead and intraday electricity prices

Author

Listed:
  • Katarzyna Maciejowska
  • Bartosz Uniejewski
  • Tomasz Serafin

Abstract

Recently, the development in combining point forecasts of electricity prices obtained with different length of calibration windows have provided an extremely efficient and simple tool for improving predictive accuracy. However, the proposed methods are strongly depended on expert knowledge and may not be directly transferred from one to another model or market. Hence, we consider a novel extension and propose to use Principal Component Analysis (PCA) to automate the procedure of averaging over a rich pool of predictions. We apply PCA to a panel of over 650 point forecasts obtained for different calibration windows. The robustness of the approach is evaluated with three different forecasting tasks, i.e., forecasting day-ahead prices, forecasting intraday ID3 prices one day in advance and finally very short term forecasting of ID3 prices (i.e., six hours before delivery). The empirical results are compared using the Mean Absolute Error measure and Giacomini and White test for conditional predictive ability (CPA). The results indicate that PCA averaging not only yields significantly more accurate forecasts than individual predictions but also outperforms other forecast averaging schemes.

Suggested Citation

  • Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA forecast averaging - predicting day-ahead and intraday electricity prices," WORking papers in Management Science (WORMS) WORMS/20/02, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
  • Handle: RePEc:ahh:wpaper:worms2002
    as

    Download full text from publisher

    File URL: https://worms.pwr.edu.pl/RePEc/ahh/wpaper/WORMS_20_02.pdf
    File Function: Original version, 2020
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Katarzyna Hubicka & Grzegorz Marcjasz & Rafal Weron, 2018. "A note on averaging day-ahead electricity price forecasts across calibration windows," HSC Research Reports HSC/18/03, Hugo Steinhaus Center, Wroclaw University of Technology.
    2. Tim Janke & Florian Steinke, 2019. "Forecasting the Price Distribution of Continuous Intraday Electricity Trading," Energies, MDPI, vol. 12(22), pages 1-14, November.
    3. Banerjee, Anindya & Marcellino, Massimiliano & Masten, Igor, 2014. "Forecasting with factor-augmented error correction models," International Journal of Forecasting, Elsevier, vol. 30(3), pages 589-612.
    4. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "Understanding intraday electricity markets: Variable selection and very short-term price forecasting using LASSO," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1533-1547.
    5. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    6. Yeung Lewis Chan & James H. Stock & Mark W. Watson, 1999. "A dynamic factor model framework for forecast combination," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 91-121.
    7. Raviv, Eran & Bouwman, Kees E. & van Dijk, Dick, 2015. "Forecasting day-ahead electricity prices: Utilizing hourly prices," Energy Economics, Elsevier, vol. 50(C), pages 227-239.
    8. Jakub Nowotarski & Rafal Weron, 2016. "To combine or not to combine? Recent trends in electricity price forecasting," HSC Research Reports HSC/16/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    9. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    10. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    11. Grzegorz Marcjasz & Bartosz Uniejewski & Rafał Weron, 2020. "Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts," Energies, MDPI, vol. 13(7), pages 1-16, April.
    12. Katarzyna Maciejowska & Rafał Weron, 2015. "Forecasting of daily electricity prices with factor models: utilizing intra-day and inter-zone relationships," Computational Statistics, Springer, vol. 30(3), pages 805-819, September.
    13. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    14. Kath, Christopher & Ziel, Florian, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Energy Economics, Elsevier, vol. 76(C), pages 411-423.
    15. Dwight B. Crane & James R. Crotty, 1967. "A Two-Stage Forecasting Model: Exponential Smoothing and Multiple Regression," Management Science, INFORMS, vol. 13(8), pages 501-507, April.
    16. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    17. Maciejowska, Katarzyna & Nowotarski, Jakub & Weron, Rafał, 2016. "Probabilistic forecasting of electricity spot prices using Factor Quantile Regression Averaging," International Journal of Forecasting, Elsevier, vol. 32(3), pages 957-965.
    18. Micha{l} Narajewski & Florian Ziel, 2018. "Econometric modelling and forecasting of intraday electricity prices," Papers 1812.09081, arXiv.org, revised Sep 2019.
    19. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    20. Kenneth Wallis, 2011. "Combining forecasts - forty years later," Applied Financial Economics, Taylor & Francis Journals, vol. 21(1-2), pages 33-41.
    21. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    22. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    23. Poncela, Pilar & Rodríguez, Julio & Sánchez-Mangas, Rocío & Senra, Eva, 2011. "Forecast combination through dimension reduction techniques," International Journal of Forecasting, Elsevier, vol. 27(2), pages 224-237, April.
    24. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    25. Weron, Rafal & Misiorek, Adam, 2008. "Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 744-763.
    26. Koop, Gary & Korobilis, Dimitris, 2011. "UK macroeconomic forecasting with many predictors: Which models forecast best and when do they do so?," Economic Modelling, Elsevier, vol. 28(5), pages 2307-2318, September.
    27. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    28. Kiesel, Rüdiger & Paraschiv, Florentina, 2017. "Econometric analysis of 15-minute intraday electricity prices," Energy Economics, Elsevier, vol. 64(C), pages 77-90.
    29. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    30. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    31. Katarzyna Maciejowska & Weronika Nitka & Tomasz Weron, 2019. "Day-Ahead vs. Intraday—Forecasting the Price Spread to Maximize Economic Benefits," Energies, MDPI, vol. 12(4), pages 1-15, February.
    32. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    33. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    34. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    35. Hibon, Michele & Evgeniou, Theodoros, 2005. "To combine or not to combine: selecting among forecasts and their combinations," International Journal of Forecasting, Elsevier, vol. 21(1), pages 15-24.
    36. Ben S. Bernanke & Jean Boivin & Piotr Eliasz, 2005. "Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(1), pages 387-422.
    37. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    38. Jean Boivin & Serena Ng, 2005. "Understanding and Comparing Factor-Based Forecasts," International Journal of Central Banking, International Journal of Central Banking, vol. 1(3), December.
    39. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    40. Sandra Eickmeier & Christina Ziegler, 2008. "How successful are dynamic factor models at forecasting output and inflation? A meta-analytic approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(3), pages 237-265.
    41. Claudio Monteiro & Ignacio J. Ramirez-Rosado & L. Alfredo Fernandez-Jimenez & Pedro Conde, 2016. "Short-Term Price Forecasting Models Based on Artificial Neural Networks for Intraday Sessions in the Iberian Electricity Market," Energies, MDPI, vol. 9(9), pages 1-24, September.
    42. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    43. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    44. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    45. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    46. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    47. Goodarzi, Shadi & Perera, H. Niles & Bunn, Derek, 2019. "The impact of renewable energy forecast errors on imbalance volumes and electricity spot prices," Energy Policy, Elsevier, vol. 134(C).
    48. James H. Stock & Mark W. Watson, 2012. "Generalized Shrinkage Methods for Forecasting Using Many Predictors," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(4), pages 481-493, June.
    49. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Weronika Nitka & Tomasz Serafin & Dimitrios Sotiros, 2021. "Forecasting Electricity Prices: Autoregressive Hybrid Nearest Neighbors (ARHNN) method," WORking papers in Management Science (WORMS) WORMS/21/06, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    2. Uniejewski, Bartosz & Maciejowska, Katarzyna, 2023. "LASSO principal component averaging: A fully automated approach for point forecast pooling," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1839-1852.
    3. Jonathan Berrisch & Florian Ziel, 2021. "CRPS Learning," Papers 2102.00968, arXiv.org, revised Nov 2021.
    4. Silvia Golia & Luigi Grossi & Matteo Pelagatti, 2022. "Machine Learning Models and Intra-Daily Market Information for the Prediction of Italian Electricity Prices," Forecasting, MDPI, vol. 5(1), pages 1-21, December.
    5. Narajewski, Michał & Ziel, Florian, 2022. "Optimal bidding in hourly and quarter-hourly electricity price auctions: Trading large volumes of power with market impact and transaction costs," Energy Economics, Elsevier, vol. 110(C).
    6. Christopher Kath & Florian Ziel, 2020. "Optimal Order Execution in Intraday Markets: Minimizing Costs in Trade Trajectories," Papers 2009.07892, arXiv.org, revised Oct 2020.
    7. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    8. Micha{l} Narajewski & Florian Ziel, 2021. "Optimal bidding in hourly and quarter-hourly electricity price auctions: trading large volumes of power with market impact and transaction costs," Papers 2104.14204, arXiv.org, revised Feb 2022.
    9. Bartosz Uniejewski & Katarzyna Maciejowska, 2022. "LASSO Principal Component Averaging -- a fully automated approach for point forecast pooling," Papers 2207.04794, arXiv.org.
    10. Rainer Baule & Michael Naumann, 2021. "Volatility and Dispersion of Hourly Electricity Contracts on the German Continuous Intraday Market," Energies, MDPI, vol. 14(22), pages 1-24, November.
    11. Jonathan Berrisch & Florian Ziel, 2023. "Multivariate Probabilistic CRPS Learning with an Application to Day-Ahead Electricity Prices," Papers 2303.10019, arXiv.org, revised Feb 2024.
    12. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    13. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    14. Philip Beran & Arne Vogler, 2021. "Multi-Day-Ahead Electricity Price Forecasting: A Comparison of fundamental, econometric and hybrid Models," EWL Working Papers 2102, University of Duisburg-Essen, Chair for Management Science and Energy Economics, revised Oct 2021.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bartosz Uniejewski & Katarzyna Maciejowska, 2022. "LASSO Principal Component Averaging -- a fully automated approach for point forecast pooling," Papers 2207.04794, arXiv.org.
    2. Uniejewski, Bartosz & Maciejowska, Katarzyna, 2023. "LASSO principal component averaging: A fully automated approach for point forecast pooling," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1839-1852.
    3. Grzegorz Marcjasz & Bartosz Uniejewski & Rafał Weron, 2020. "Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts," Energies, MDPI, vol. 13(7), pages 1-16, April.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    6. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    7. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    8. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    9. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    10. Maciejowska, Katarzyna & Nitka, Weronika & Weron, Tomasz, 2021. "Enhancing load, wind and solar generation for day-ahead forecasting of electricity prices," Energy Economics, Elsevier, vol. 99(C).
    11. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    12. Katarzyna Maciejowska & Weronika Nitka & Tomasz Weron, 2019. "Enhancing load, wind and solar generation forecasts in day-ahead forecasting of spot and intraday electricity prices," HSC Research Reports HSC/19/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    13. Kadir Özen & Dilem Yıldırım, 2021. "Application of Bagging in Day-Ahead Electricity Price Forecasting and Factor Augmentation," ERC Working Papers 2101, ERC - Economic Research Center, Middle East Technical University, revised Apr 2021.
    14. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    15. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    16. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    17. Christopher Kath & Weronika Nitka & Tomasz Serafin & Tomasz Weron & Przemysław Zaleski & Rafał Weron, 2020. "Balancing Generation from Renewable Energy Sources: Profitability of an Energy Trader," Energies, MDPI, vol. 13(1), pages 1-15, January.
    18. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    19. Ilkay Oksuz & Umut Ugurlu, 2019. "Neural Network Based Model Comparison for Intraday Electricity Price Forecasting," Energies, MDPI, vol. 12(23), pages 1-14, November.
    20. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.

    More about this item

    Keywords

    Electricity price forecasting; Day-ahead market; Intraday market; Forecast averaging; Principal component analysis; Decision-making;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q41 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Demand and Supply; Prices
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ahh:wpaper:worms2002. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anna Kowalska-Pyzalska (email available below). General contact details of provider: https://edirc.repec.org/data/kbpwrpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.