IDEAS home Printed from https://ideas.repec.org/a/eee/eneeco/v103y2021ics0140988321004448.html
   My bibliography  Save this article

Application of bagging in day-ahead electricity price forecasting and factor augmentation

Author

Listed:
  • Özen, Kadir
  • Yıldırım, Dilem

Abstract

The electricity price forecasting (EPF) is a challenging task not only because of the uncommon characteristics of electricity but also because of the existence of many potential predictors with changing predictive abilities over time. In such an environment, how to account for all available factors and extract as much information as possible is the key to the production of accurate forecasts. To address this long-standing issue in a way that balances complexity and forecasting accuracy while facilitating the traceability of the predictor selection procedure, we propose the method of Bootstrap Aggregation (bagging). To forecast day-ahead electricity prices in a multivariate context for six major power markets, we construct a large-scale pure price model and apply the bagging approach in comparison with the popular Least Absolute Shrinkage and Selection Operator (LASSO) estimation method. Our forecasting study reveals that bagging provides substantial forecast improvements on daily and hourly scales in almost all markets over the popular LASSO estimation method. The differentiation in the forecast performances of the two approaches appears to arise, inter alia, from their structural differences in the explanatory variables selection process. Moreover, to account for the intraday hourly dependencies of day-ahead electricity prices, all our models are augmented with latent factors, and a substantial improvement is observed only in the forecasts from models covering a relatively limited number of predictors.

Suggested Citation

  • Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
  • Handle: RePEc:eee:eneeco:v:103:y:2021:i:c:s0140988321004448
    DOI: 10.1016/j.eneco.2021.105573
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0140988321004448
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.eneco.2021.105573?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "Understanding intraday electricity markets: Variable selection and very short-term price forecasting using LASSO," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1533-1547.
    2. Ziel, Florian & Steinert, Rick & Husmann, Sven, 2015. "Efficient modeling and forecasting of electricity spot prices," Energy Economics, Elsevier, vol. 47(C), pages 98-111.
    3. David Rapach & Jack Strauss, 2010. "Bagging or Combining (or Both)? An Analysis Based on Forecasting U.S. Employment Growth," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 511-533.
    4. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    5. Micha{l} Narajewski & Florian Ziel, 2018. "Econometric modelling and forecasting of intraday electricity prices," Papers 1812.09081, arXiv.org, revised Sep 2019.
    6. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    7. Misiorek Adam & Trueck Stefan & Weron Rafal, 2006. "Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-36, September.
    8. Raviv, Eran & Bouwman, Kees E. & van Dijk, Dick, 2015. "Forecasting day-ahead electricity prices: Utilizing hourly prices," Energy Economics, Elsevier, vol. 50(C), pages 227-239.
    9. Donald W. K. Andrews, 2004. "the Block-Block Bootstrap: Improved Asymptotic Refinements," Econometrica, Econometric Society, vol. 72(3), pages 673-700, May.
    10. Florian Ziel & Rick Steinert & Sven Husmann, 2015. "Forecasting day ahead electricity spot prices: The impact of the EXAA to other European electricity markets," Papers 1501.00818, arXiv.org, revised Dec 2015.
    11. Jordan, Steven J. & Vivian, Andrew & Wohar, Mark E., 2017. "Forecasting market returns: bagging or combining?," International Journal of Forecasting, Elsevier, vol. 33(1), pages 102-120.
    12. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2016. "Day-ahead electricity price forecasting via the application of artificial neural network based models," Applied Energy, Elsevier, vol. 172(C), pages 132-151.
    13. Grzegorz Marcjasz & Bartosz Uniejewski & Rafał Weron, 2020. "Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts," Energies, MDPI, vol. 13(7), pages 1-16, April.
    14. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    15. Hillebrand, Eric & Lukas, Manuel & Wei, Wei, 2021. "Bagging weak predictors," International Journal of Forecasting, Elsevier, vol. 37(1), pages 237-254.
    16. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    17. Gianfreda, Angelica & Ravazzolo, Francesco & Rossini, Luca, 2020. "Comparing the forecasting performances of linear models for electricity prices with high RES penetration," International Journal of Forecasting, Elsevier, vol. 36(3), pages 974-986.
    18. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    19. Rick Steinert and Florian Ziel, 2019. "Short- to Mid-term Day-Ahead Electricity Price Forecasting Using Futures," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1).
    20. Kristiansen, Tarjei, 2012. "Forecasting Nord Pool day-ahead prices with an autoregressive model," Energy Policy, Elsevier, vol. 49(C), pages 328-332.
    21. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    22. James H. Stock & Mark W. Watson, 2012. "Generalized Shrinkage Methods for Forecasting Using Many Predictors," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(4), pages 481-493, June.
    23. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    24. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    25. Katarzyna Maciejowska & Rafał Weron, 2015. "Forecasting of daily electricity prices with factor models: utilizing intra-day and inter-zone relationships," Computational Statistics, Springer, vol. 30(3), pages 805-819, September.
    26. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    27. Bergmeir, Christoph & Hyndman, Rob J. & Benítez, José M., 2016. "Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation," International Journal of Forecasting, Elsevier, vol. 32(2), pages 303-312.
    28. Maciejowska, Katarzyna, 2020. "Assessing the impact of renewable energy sources on the electricity price level and variability – A quantile regression approach," Energy Economics, Elsevier, vol. 85(C).
    29. Panagiotelis, Anastasios & Athanasopoulos, George & Hyndman, Rob J. & Jiang, Bin & Vahid, Farshid, 2019. "Macroeconomic forecasting for Australia using a large number of predictors," International Journal of Forecasting, Elsevier, vol. 35(2), pages 616-633.
    30. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    31. Bordignon, Silvano & Bunn, Derek W. & Lisi, Francesco & Nan, Fany, 2013. "Combining day-ahead forecasts for British electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 88-103.
    32. Conejo, Antonio J. & Contreras, Javier & Espinola, Rosa & Plazas, Miguel A., 2005. "Forecasting electricity prices for a day-ahead pool-based electric energy market," International Journal of Forecasting, Elsevier, vol. 21(3), pages 435-462.
    33. Maciejowska, Katarzyna & Nowotarski, Jakub & Weron, Rafał, 2016. "Probabilistic forecasting of electricity spot prices using Factor Quantile Regression Averaging," International Journal of Forecasting, Elsevier, vol. 32(3), pages 957-965.
    34. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2021. "Point and interval forecasting of electricity supply via pruned ensembles," Energy, Elsevier, vol. 232(C).
    35. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    36. Keles, Dogan & Scelle, Jonathan & Paraschiv, Florentina & Fichtner, Wolf, 2016. "Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks," Applied Energy, Elsevier, vol. 162(C), pages 218-230.
    37. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz, 2018. "Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing," International Journal of Forecasting, Elsevier, vol. 34(4), pages 748-761.
    38. Nowotarski, Jakub & Weron, Rafał, 2016. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 57(C), pages 228-235.
    39. Weron, Rafal & Misiorek, Adam, 2008. "Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 744-763.
    40. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    41. Gianfreda, Angelica & Grossi, Luigi, 2012. "Forecasting Italian electricity zonal prices with exogenous variables," Energy Economics, Elsevier, vol. 34(6), pages 2228-2239.
    42. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    43. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    44. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    45. Meira, Erick & Cyrino Oliveira, Fernando Luiz & Jeon, Jooyoung, 2021. "Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals," International Journal of Forecasting, Elsevier, vol. 37(2), pages 547-568.
    46. Florian Ziel, 2015. "Forecasting Electricity Spot Prices using Lasso: On Capturing the Autoregressive Intraday Structure," Papers 1509.01966, arXiv.org, revised Jan 2016.
    47. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    48. Adam Misiorek & Rafal Weron, 2006. "Interval forecasting of spot electricity prices," HSC Research Reports HSC/06/05, Hugo Steinhaus Center, Wroclaw University of Technology.
    49. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    50. Sainan Jin & Liangjun Su & Aman Ullah, 2014. "Robustify Financial Time Series Forecasting with Bagging," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 575-605, August.
    51. Petropoulos, Fotios & Hyndman, Rob J. & Bergmeir, Christoph, 2018. "Exploring the sources of uncertainty: Why does bagging for time series forecasting work?," European Journal of Operational Research, Elsevier, vol. 268(2), pages 545-554.
    52. Ziel, Florian & Steinert, Rick & Husmann, Sven, 2015. "Forecasting day ahead electricity spot prices: The impact of the EXAA to other European electricity markets," Energy Economics, Elsevier, vol. 51(C), pages 430-444.
    53. Claudio Monteiro & Ignacio J. Ramirez-Rosado & L. Alfredo Fernandez-Jimenez & Pedro Conde, 2016. "Short-Term Price Forecasting Models Based on Artificial Neural Networks for Intraday Sessions in the Iberian Electricity Market," Energies, MDPI, vol. 9(9), pages 1-24, September.
    54. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    55. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601.
    56. de Oliveira, Erick Meira & Cyrino Oliveira, Fernando Luiz, 2018. "Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods," Energy, Elsevier, vol. 144(C), pages 776-788.
    57. Ribeiro, Pinho J., 2017. "Selecting exchange rate fundamentals by bootstrap," International Journal of Forecasting, Elsevier, vol. 33(4), pages 894-914.
    58. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    59. Agrawal, Rahul Kumar & Muchahary, Frankle & Tripathi, Madan Mohan, 2019. "Ensemble of relevance vector machines and boosted trees for electricity price forecasting," Applied Energy, Elsevier, vol. 250(C), pages 540-548.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kitova, Olga & Savinova, Victoria, 2021. "Development of an Ensemble of Models for Predicting Socio-Economic Indicators of the Russian Federation using IRT-Theory and Bagging Methods," MPRA Paper 110824, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kadir Özen & Dilem Yıldırım, 2021. "Application of Bagging in Day-Ahead Electricity Price Forecasting and Factor Augmentation," ERC Working Papers 2101, ERC - Economic Research Center, Middle East Technical University, revised Apr 2021.
    2. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    3. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    4. Florian Ziel & Rafal Weron, 2016. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate models," HSC Research Reports HSC/16/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    5. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    6. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    7. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    8. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    9. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    10. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    11. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    12. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    13. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    14. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    15. Grzegorz Marcjasz & Bartosz Uniejewski & Rafal Weron, 2017. "Importance of the long-term seasonal component in day-ahead electricity price forecasting revisited: Neural network models," HSC Research Reports HSC/17/03, Hugo Steinhaus Center, Wroclaw University of Technology.
    16. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1520-1532.
    17. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    18. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    19. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    20. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.

    More about this item

    Keywords

    Bagging; Shrinkage methods; Electricity price forecasting; Multivariate modeling; Forecast encompassing; Factor models;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eneeco:v:103:y:2021:i:c:s0140988321004448. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eneco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.