IDEAS home Printed from https://ideas.repec.org/p/wuu/wpaper/hsc1607.html
   My bibliography  Save this paper

Recent advances in electricity price forecasting: A review of probabilistic forecasting

Author

Listed:
  • Jakub Nowotarski
  • Rafal Weron

Abstract

Since the inception of competitive power markets two decades ago, electricity price forecasting (EPF) has gradually become a fundamental process for energy companies' decision making mechanisms. Over the years, the bulk of research has concerned point predictions. However, the recent introduction of smart grids and renewable integration requirements has had the effect of increasing the uncertainty of future supply, demand and prices. Academics and practitioners alike have come to understand that probabilistic electricity price (and load) forecasting is now more important for energy systems planning and operations than ever before. With this paper we offer a tutorial review of probabilistic EPF and present much needed guidelines for the rigorous use of methods, measures and tests, in line with the paradigm of 'maximizing sharpness subject to reliability'. The paper can be treated as an update and a further extension of the otherwise comprehensive EPF review of Weron (2014, IJF) or as a standalone treatment of a fascinating and underdeveloped topic, that has a much broader reach than EPF itself.

Suggested Citation

  • Jakub Nowotarski & Rafal Weron, 2016. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," HSC Research Reports HSC/16/07, Hugo Steinhaus Center, Wroclaw University of Technology.
  • Handle: RePEc:wuu:wpaper:hsc1607
    as

    Download full text from publisher

    File URL: http://www.im.pwr.wroc.pl/~hugo/RePEc/wuu/wpaper/HSC_16_07.pdf
    File Function: Original version
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ying-Yi Hong & Ching-Ping Wu, 2012. "Day-Ahead Electricity Price Forecasting Using a Hybrid Principal Component Analysis Network," Energies, MDPI, Open Access Journal, vol. 5(11), pages 1-15, November.
    2. Dudek, Grzegorz, 2016. "Multilayer perceptron for GEFCom2014 probabilistic electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1057-1060.
    3. Jung, Jaesung & Broadwater, Robert P., 2014. "Current status and future advances for wind speed and power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 762-777.
    4. Araújo Santos, P. & Fraga Alves, M.I., 2012. "A new class of independence tests for interval forecasts evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3366-3380.
    5. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, Open Access Journal, vol. 9(8), pages 1-22, August.
    6. Crespo Cuaresma, Jesús & Hlouskova, Jaroslava & Kossmeier, Stephan & Obersteiner, Michael, 2004. "Forecasting electricity spot-prices using linear univariate time-series models," Applied Energy, Elsevier, vol. 77(1), pages 87-106, January.
    7. James E. Matheson & Robert L. Winkler, 1976. "Scoring Rules for Continuous Probability Distributions," Management Science, INFORMS, vol. 22(10), pages 1087-1096, June.
    8. Gianfreda, Angelica & Grossi, Luigi, 2012. "Forecasting Italian electricity zonal prices with exogenous variables," Energy Economics, Elsevier, vol. 34(6), pages 2228-2239.
    9. Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel R., 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 150-160.
    10. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    11. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    12. Misiorek Adam & Trueck Stefan & Weron Rafal, 2006. "Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-36, September.
    13. Jakub Nowotarski & Rafal Weron, 2014. "Merging quantile regression with forecast averaging to obtain more accurate interval forecasts of Nord Pool spot prices," HSC Research Reports HSC/14/03, Hugo Steinhaus Center, Wroclaw University of Technology.
    14. Florian Ziel & Rick Steinert, 2015. "Electricity Price Forecasting using Sale and Purchase Curves: The X-Model," Papers 1509.00372, arXiv.org, revised Aug 2016.
    15. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    16. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    17. Paraschiv, Florentina & Bunn, Derek & Westgaard, Sjur, 2016. "Estimation and Application of Fully Parametric Multifactor Quantile Regression with Dynamic Coefficients," Working Papers on Finance 1607, University of St. Gallen, School of Finance.
    18. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian density forecasting of intraday electricity prices using multivariate skew t distributions," International Journal of Forecasting, Elsevier, vol. 24(4), pages 710-727.
    19. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    20. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    21. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    22. Michael P. Clements & Nick Taylor, 2003. "Evaluating interval forecasts of high-frequency financial data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 445-456.
    23. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    24. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    25. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.
    26. repec:gam:jeners:v:9:y:2016:i:3:p:193:d:65782 is not listed on IDEAS
    27. Nowotarski, Jakub & Tomczyk, Jakub & Weron, Rafał, 2013. "Robust estimation and forecasting of the long-term seasonal component of electricity spot prices," Energy Economics, Elsevier, vol. 39(C), pages 13-27.
    28. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    29. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    30. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731, Fall.
    31. Bidong Liu & Jakub Nowotarski & Tao Hong & Rafal Weron, 2015. "Probabilistic load forecasting via Quantile Regression Averaging on sister forecasts," HSC Research Reports HSC/15/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    32. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(1), pages 84-108.
    33. Valentina Corradi & Norman Swanson, 2006. "Predictive Density Evaluation. Revised," Departmental Working Papers 200621, Rutgers University, Department of Economics.
    34. Florian Ziel, 2015. "Forecasting Electricity Spot Prices using Lasso: On Capturing the Autoregressive Intraday Structure," Papers 1509.01966, arXiv.org, revised Jan 2016.
    35. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    36. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    37. Adam Misiorek, 2008. "Short-term forecasting of electricity prices: Do we need a different model for each hour?," HSC Research Reports HSC/08/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    38. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    39. Tryggvi Jónsson & Pierre Pinson & Henrik Madsen & Henrik Aalborg Nielsen, 2014. "Predictive Densities for Day-Ahead Electricity Prices Using Time-Adaptive Quantile Regression," Energies, MDPI, Open Access Journal, vol. 7(9), pages 1-25, August.
    40. Serinaldi, Francesco, 2011. "Distributional modeling and short-term forecasting of electricity prices by Generalized Additive Models for Location, Scale and Shape," Energy Economics, Elsevier, vol. 33(6), pages 1216-1226.
    41. Maciejowska, Katarzyna & Nowotarski, Jakub, 2016. "A hybrid model for GEFCom2014 probabilistic electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1051-1056.
    42. Christensen, T.M. & Hurn, A.S. & Lindsay, K.A., 2012. "Forecasting spikes in electricity prices," International Journal of Forecasting, Elsevier, vol. 28(2), pages 400-411.
    43. Corradi, Valentina & Swanson, Norman R., 2006. "Predictive Density Evaluation," Handbook of Economic Forecasting, Elsevier.
    44. Kristiansen, Tarjei, 2012. "Forecasting Nord Pool day-ahead prices with an autoregressive model," Energy Policy, Elsevier, vol. 49(C), pages 328-332.
    45. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    46. repec:qut:auncer:2012_5 is not listed on IDEAS
    47. S. Baran & S. Lerch, 2016. "Mixture EMOS model for calibrating ensemble forecasts of wind speed," Environmetrics, John Wiley & Sons, Ltd., vol. 27(2), pages 116-130, March.
    48. repec:spo:wpecon:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    49. Katarzyna Maciejowska & Rafał Weron, 2015. "Forecasting of daily electricity prices with factor models: utilizing intra-day and inter-zone relationships," Computational Statistics, Springer, vol. 30(3), pages 805-819, September.
    50. Ziel, Florian & Steinert, Rick, 2016. "Electricity price forecasting using sale and purchase curves: The X-Model," Energy Economics, Elsevier, vol. 59(C), pages 435-454.
    51. Katarzyna Maciejowska & Rafal Weron, 2015. "Short- and mid-term forecasting of baseload electricity prices in the UK: The impact of intra-day price relationships and market fundamentals," HSC Research Reports HSC/15/04, Hugo Steinhaus Center, Wroclaw University of Technology.
    52. Jakub Nowotarski & Rafal Weron, 2016. "To combine or not to combine? Recent trends in electricity price forecasting," HSC Research Reports HSC/16/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    53. Karakatsani, Nektaria V. & Bunn, Derek W., 2008. "Forecasting electricity prices: The impact of fundamentals and time-varying coefficients," International Journal of Forecasting, Elsevier, vol. 24(4), pages 764-785.
    54. Maciejowska, Katarzyna & Nowotarski, Jakub & Weron, Rafał, 2016. "Probabilistic forecasting of electricity spot prices using Factor Quantile Regression Averaging," International Journal of Forecasting, Elsevier, vol. 32(3), pages 957-965.
    55. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    56. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    57. Jakub Nowotarski & Rafał Weron, 2015. "Computing electricity spot price prediction intervals using quantile regression and forecast averaging," Computational Statistics, Springer, vol. 30(3), pages 791-803, September.
    58. Bordignon, Silvano & Bunn, Derek W. & Lisi, Francesco & Nan, Fany, 2013. "Combining day-ahead forecasts for British electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 88-103.
    59. Bartosz Uniejewski & Rafal Weron & Florian Ziel, 2017. "Variance stabilizing transformations for electricity spot price forecasting," HSC Research Reports HSC/17/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    60. Conejo, Antonio J. & Contreras, Javier & Espinola, Rosa & Plazas, Miguel A., 2005. "Forecasting electricity prices for a day-ahead pool-based electric energy market," International Journal of Forecasting, Elsevier, vol. 21(3), pages 435-462.
    61. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268.
    62. Janczura, Joanna & Trück, Stefan & Weron, Rafał & Wolff, Rodney C., 2013. "Identifying spikes and seasonal components in electricity spot price data: A guide to robust modeling," Energy Economics, Elsevier, vol. 38(C), pages 96-110.
    63. Weron, Rafal & Misiorek, Adam, 2008. "Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 744-763.
    64. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    65. Yan, Jie & Liu, Yongqian & Han, Shuang & Wang, Yimei & Feng, Shuanglei, 2015. "Reviews on uncertainty analysis of wind power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 1322-1330.
    66. Bello, Antonio & Reneses, Javier & Muñoz, Antonio & Delgadillo, Andrés, 2016. "Probabilistic forecasting of hourly electricity prices in the medium-term using spatial interpolation techniques," International Journal of Forecasting, Elsevier, vol. 32(3), pages 966-980.
    67. Raza, Muhammad Qamar & Khosravi, Abbas, 2015. "A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 50(C), pages 1352-1372.
    68. Gaillard, Pierre & Goude, Yannig & Nedellec, Raphaël, 2016. "Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1038-1050.
    69. Khosravi, Abbas & Nahavandi, Saeid & Creighton, Doug, 2013. "Quantifying uncertainties of neural network-based electricity price forecasts," Applied Energy, Elsevier, vol. 112(C), pages 120-129.
    70. Keles, Dogan & Scelle, Jonathan & Paraschiv, Florentina & Fichtner, Wolf, 2016. "Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks," Applied Energy, Elsevier, vol. 162(C), pages 218-230.
    71. Moghimi Ghadikolaei, Hadi & Ahmadi, Abdollah & Aghaei, Jamshid & Najafi, Meysam, 2012. "Risk constrained self-scheduling of hydro/wind units for short term electricity markets considering intermittency and uncertainty," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(7), pages 4734-4743.
    72. Clements, Michael P. & Kim, Jae H., 2007. "Bootstrap prediction intervals for autoregressive time series," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3580-3594, April.
    73. Hong, Tao & Fan, Shu, 2016. "Probabilistic electric load forecasting: A tutorial review," International Journal of Forecasting, Elsevier, vol. 32(3), pages 914-938.
    74. Janczura, Joanna & Weron, Rafal, 2010. "An empirical comparison of alternate regime-switching models for electricity spot prices," Energy Economics, Elsevier, vol. 32(5), pages 1059-1073, September.
    75. N/A, 2016. "The World Economy: Forecast Summary," National Institute Economic Review, National Institute of Economic and Social Research, vol. 238(1), pages 2-2, November.
    76. repec:gam:jeners:v:9:y:2016:i:3:p:-:d:65782 is not listed on IDEAS
    77. Huurman, Christian & Ravazzolo, Francesco & Zhou, Chen, 2012. "The power of weather," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3793-3807.
    78. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601, June.
    79. Nowotarski, Jakub & Weron, Rafał, 2016. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 57(C), pages 228-235.
    80. Antonio Bello & Javier Reneses & Antonio Muñoz, 2016. "Medium-Term Probabilistic Forecasting of Extremely Low Prices in Electricity Markets: Application to the Spanish Case," Energies, MDPI, Open Access Journal, vol. 9(3), pages 1-27, March.
    81. Juban, Romain & Ohlsson, Henrik & Maasoumy, Mehdi & Poirier, Louis & Kolter, J. Zico, 2016. "A multiple quantile regression approach to the wind, solar, and price tracks of GEFCom2014," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1094-1102.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christian Pape & Arne Vogler & Oliver Woll & Christoph Weber, 2017. "Forecasting the distributions of hourly electricity spot prices," EWL Working Papers 1705, University of Duisburg-Essen, Chair for Management Science and Energy Economics, revised May 2017.
    2. Grzegorz Marcjasz & Bartosz Uniejewski & Rafal Weron, 2017. "Importance of the long-term seasonal component in day-ahead electricity price forecasting revisited: Neural network models," HSC Research Reports HSC/17/03, Hugo Steinhaus Center, Wroclaw University of Technology.
    3. Angelica Gianfreda & Francesco Ravazzolo & Luca Rossini, 2018. "Comparing the Forecasting Performances of Linear Models for Electricity Prices with High RES Penetration," Papers 1801.01093, arXiv.org.
    4. Bartosz Uniejewski & Grzegorz Marcjasz & Rafal Weron, 2017. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting. Part II – Probabilistic forecasting," HSC Research Reports HSC/17/02, Hugo Steinhaus Center, Wroclaw University of Technology.
    5. repec:gam:jeners:v:11:y:2018:i:5:p:1074-:d:143481 is not listed on IDEAS
    6. repec:eee:eneeco:v:70:y:2018:i:c:p:396-420 is not listed on IDEAS
    7. repec:gam:jeners:v:11:y:2018:i:6:p:1345-:d:148973 is not listed on IDEAS
    8. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    9. repec:gam:jsusta:v:10:y:2018:i:4:p:1280-:d:142436 is not listed on IDEAS

    More about this item

    Keywords

    Electricity price forecasting; Probabilistic forecast; Reliability; Sharpness; Day-ahead market; Autoregression; Neural network;

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wuu:wpaper:hsc1607. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Rafal Weron) or (Christopher F. Baum). General contact details of provider: http://edirc.repec.org/data/hspwrpl.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.