IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v13y2020i7p1667-d340785.html
   My bibliography  Save this article

Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts

Author

Listed:
  • Grzegorz Marcjasz

    (Department of Operations Research and Business Intelligence, Wrocław University of Science and Technology, 50-370 Wrocław, Poland)

  • Bartosz Uniejewski

    (Department of Operations Research and Business Intelligence, Wrocław University of Science and Technology, 50-370 Wrocław, Poland)

  • Rafał Weron

    (Department of Operations Research and Business Intelligence, Wrocław University of Science and Technology, 50-370 Wrocław, Poland)

Abstract

In the last three decades the vast majority of electricity price forecasting (EPF) research has concerned day-ahead markets. However, the rapid expansion of renewable generation—mostly wind and solar—have shifted the focus to intraday markets, which can be used to balance the deviations between positions taken in the day-ahead market and the actual demand and renewable generation. A recent EPF study claims that the German intraday, continuous-time market for hourly products is weak-form efficient, that is, that the best predictor for the so-called ID3-Price index is the most recent transaction price. Here, we undermine this claim and show that we can beat the naïve forecast by combining it with a prediction of a parameter-rich model estimated using the least absolute shrinkage and selection operator (LASSO). We further argue, that that if augmented with timely predictions of fundamental variables for the coming hours, the LASSO-estimated model itself can significantly outperform the naïve forecast.

Suggested Citation

  • Grzegorz Marcjasz & Bartosz Uniejewski & Rafał Weron, 2020. "Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts," Energies, MDPI, vol. 13(7), pages 1-16, April.
  • Handle: RePEc:gam:jeners:v:13:y:2020:i:7:p:1667-:d:340785
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/13/7/1667/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/13/7/1667/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Katarzyna Hubicka & Grzegorz Marcjasz & Rafal Weron, 2018. "A note on averaging day-ahead electricity price forecasts across calibration windows," HSC Research Reports HSC/18/03, Hugo Steinhaus Center, Wroclaw University of Technology.
    2. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "Understanding intraday electricity markets: Variable selection and very short-term price forecasting using LASSO," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1533-1547.
    3. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    4. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    5. Micha{l} Narajewski & Florian Ziel, 2018. "Econometric modelling and forecasting of intraday electricity prices," Papers 1812.09081, arXiv.org, revised Sep 2019.
    6. Ilkay Oksuz & Umut Ugurlu, 2019. "Neural Network Based Model Comparison for Intraday Electricity Price Forecasting," Energies, MDPI, vol. 12(23), pages 1-14, November.
    7. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    8. Christopher Kath, 2019. "Modeling Intraday Markets under the New Advances of the Cross-Border Intraday Project (XBID): Evidence from the German Intraday Market," Energies, MDPI, vol. 12(22), pages 1-35, November.
    9. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    10. Derek W. Bunn & Angelica Gianfreda & Stefan Kermer, 2018. "A Trading-Based Evaluation of Density Forecasts in a Real-Time Electricity Market," Energies, MDPI, vol. 11(10), pages 1-13, October.
    11. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    12. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    13. Tim Janke & Florian Steinke, 2019. "Forecasting the Price Distribution of Continuous Intraday Electricity Trading," Energies, MDPI, vol. 12(22), pages 1-14, November.
    14. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1520-1532.
    15. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    16. Florian Ziel, 2015. "Forecasting Electricity Spot Prices using Lasso: On Capturing the Autoregressive Intraday Structure," Papers 1509.01966, arXiv.org, revised Jan 2016.
    17. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    18. Kiesel, Rüdiger & Paraschiv, Florentina, 2017. "Econometric analysis of 15-minute intraday electricity prices," Energy Economics, Elsevier, vol. 64(C), pages 77-90.
    19. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    20. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    21. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    22. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    23. Maciejowska, Katarzyna, 2020. "Assessing the impact of renewable energy sources on the electricity price level and variability – A quantile regression approach," Energy Economics, Elsevier, vol. 85(C).
    24. Katarzyna Maciejowska & Weronika Nitka & Tomasz Weron, 2019. "Day-Ahead vs. Intraday—Forecasting the Price Spread to Maximize Economic Benefits," Energies, MDPI, vol. 12(4), pages 1-15, February.
    25. Claudio Monteiro & Ignacio J. Ramirez-Rosado & L. Alfredo Fernandez-Jimenez & Pedro Conde, 2016. "Short-Term Price Forecasting Models Based on Artificial Neural Networks for Intraday Sessions in the Iberian Electricity Market," Energies, MDPI, vol. 9(9), pages 1-24, September.
    26. Goodarzi, Shadi & Perera, H. Niles & Bunn, Derek, 2019. "The impact of renewable energy forecast errors on imbalance volumes and electricity spot prices," Energy Policy, Elsevier, vol. 134(C).
    27. Micha{l} Narajewski & Florian Ziel, 2019. "Estimation and simulation of the transaction arrival process in intraday electricity markets," Papers 1901.09729, arXiv.org, revised Dec 2019.
    28. Kath, Christopher & Ziel, Florian, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Energy Economics, Elsevier, vol. 76(C), pages 411-423.
    29. Michał Narajewski & Florian Ziel, 2019. "Estimation and Simulation of the Transaction Arrival Process in Intraday Electricity Markets," Energies, MDPI, vol. 12(23), pages 1-16, November.
    30. Muniain, Peru & Ziel, Florian, 2020. "Probabilistic forecasting in day-ahead electricity markets: Simulating peak and off-peak prices," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1193-1210.
    31. Nowotarski, Jakub & Weron, Rafał, 2016. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 57(C), pages 228-235.
    32. José R. Andrade & Jorge Filipe & Marisa Reis & Ricardo J. Bessa, 2017. "Probabilistic Price Forecasting for Day-Ahead and Intraday Markets: Beyond the Statistical Model," Sustainability, MDPI, vol. 9(11), pages 1-29, October.
    33. Aitor Ciarreta & Peru Muniain & Ainhoa Zarraga, 2017. "Modeling and forecasting realized volatility in German–Austrian continuous intraday electricity prices," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(6), pages 680-690, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Kuppelwieser, Thomas & Wozabal, David, 2021. "Liquidity costs on intraday power markets: Continuous trading versus auctions," Energy Policy, Elsevier, vol. 154(C).
    4. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    5. Yuriy Bilan & Serhiy Kozmenko & Alex Plastun, 2022. "Price Forecasting in Energy Market," Energies, MDPI, vol. 15(24), pages 1-6, December.
    6. Philip Beran & Arne Vogler, 2021. "Multi-Day-Ahead Electricity Price Forecasting: A Comparison of fundamental, econometric and hybrid Models," EWL Working Papers 2102, University of Duisburg-Essen, Chair for Management Science and Energy Economics, revised Oct 2021.
    7. Hugo Siqueira & Mariana Macedo & Yara de Souza Tadano & Thiago Antonini Alves & Sergio L. Stevan & Domingos S. Oliveira & Manoel H.N. Marinho & Paulo S.G. de Mattos Neto & João F. L. de Oliveira & Ive, 2020. "Selection of Temporal Lags for Predicting Riverflow Series from Hydroelectric Plants Using Variable Selection Methods," Energies, MDPI, vol. 13(16), pages 1-35, August.
    8. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    9. Grzegorz Marcjasz, 2020. "Forecasting Electricity Prices Using Deep Neural Networks: A Robust Hyper-Parameter Selection Scheme," Energies, MDPI, vol. 13(18), pages 1-18, September.
    10. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    11. Kadir Özen & Dilem Yıldırım, 2021. "Application of Bagging in Day-Ahead Electricity Price Forecasting and Factor Augmentation," ERC Working Papers 2101, ERC - Economic Research Center, Middle East Technical University, revised Apr 2021.
    12. Silvia Golia & Luigi Grossi & Matteo Pelagatti, 2022. "Machine Learning Models and Intra-Daily Market Information for the Prediction of Italian Electricity Prices," Forecasting, MDPI, vol. 5(1), pages 1-21, December.
    13. Grzegorz Marcjasz & Jesus Lago & Rafa{l} Weron, 2020. "Neural networks in day-ahead electricity price forecasting: Single vs. multiple outputs," Papers 2008.08006, arXiv.org.
    14. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    2. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    3. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    4. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    5. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    6. Maciejowska, Katarzyna & Nitka, Weronika & Weron, Tomasz, 2021. "Enhancing load, wind and solar generation for day-ahead forecasting of electricity prices," Energy Economics, Elsevier, vol. 99(C).
    7. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    8. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    9. Ilkay Oksuz & Umut Ugurlu, 2019. "Neural Network Based Model Comparison for Intraday Electricity Price Forecasting," Energies, MDPI, vol. 12(23), pages 1-14, November.
    10. Katarzyna Maciejowska & Weronika Nitka & Tomasz Weron, 2019. "Enhancing load, wind and solar generation forecasts in day-ahead forecasting of spot and intraday electricity prices," HSC Research Reports HSC/19/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    11. Christopher Kath & Weronika Nitka & Tomasz Serafin & Tomasz Weron & Przemysław Zaleski & Rafał Weron, 2020. "Balancing Generation from Renewable Energy Sources: Profitability of an Energy Trader," Energies, MDPI, vol. 13(1), pages 1-15, January.
    12. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    13. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    14. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    15. Serafin, Tomasz & Marcjasz, Grzegorz & Weron, Rafał, 2022. "Trading on short-term path forecasts of intraday electricity prices," Energy Economics, Elsevier, vol. 112(C).
    16. Michał Narajewski, 2022. "Probabilistic Forecasting of German Electricity Imbalance Prices," Energies, MDPI, vol. 15(14), pages 1-17, July.
    17. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    18. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "Understanding intraday electricity markets: Variable selection and very short-term price forecasting using LASSO," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1533-1547.
    19. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    20. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).

    More about this item

    Keywords

    intraday electricity market; ID3-Price index; price forecasting; variable selection; fundamental variables; LASSO; averaging forecasts;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q41 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Demand and Supply; Prices
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:13:y:2020:i:7:p:1667-:d:340785. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.