IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v160y2018icp810-819.html
   My bibliography  Save this article

Parallel and reliable probabilistic load forecasting via quantile regression forest and quantile determination

Author

Listed:
  • Zhang, Wenjie
  • Quan, Hao
  • Srinivasan, Dipti

Abstract

With the rapidly increasing complexity of operational challenges in smart grid environment, the traditional load point forecasting methods are no longer adequate. Probabilistic load forecasting has been proven to be more suitable in these environments due to their superior ability to provide more advanced uncertainty quantification. Most of the probabilistic forecasting methods, however are either insufficiently accurate or take very long training time. While probabilistic forecasting using quantile forecasts has been popular in research, the industry has been adopting another form of probabilistic forecasts, namely prediction intervals (PIs). The direct PI construction (DPIC) method typically employed for deciding the corresponding upper and lower quantile pair in PIs, however cannot guarantee the reliability of constructed PIs. This paper not only proposes a parallel and improved load quantile forecasting method but also solves the reliability issue of DPIC by proposing an alternative quantile determination (QD) method. Case studies show that the proposed load quantile forecasting method is both more accurate and more computationally efficient than the state-of-the-art methods and the reliability issue of DPIC is considerably alleviated by QD.

Suggested Citation

  • Zhang, Wenjie & Quan, Hao & Srinivasan, Dipti, 2018. "Parallel and reliable probabilistic load forecasting via quantile regression forest and quantile determination," Energy, Elsevier, vol. 160(C), pages 810-819.
  • Handle: RePEc:eee:energy:v:160:y:2018:i:c:p:810-819
    DOI: 10.1016/j.energy.2018.07.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544218313148
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2018.07.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Yao & Wang, Jianxue & Wang, Xifan, 2014. "Review on probabilistic forecasting of wind power generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 255-270.
    2. Gallego-Castillo, Cristobal & Bessa, Ricardo & Cavalcante, Laura & Lopez-Garcia, Oscar, 2016. "On-line quantile regression in the RKHS (Reproducing Kernel Hilbert Space) for operational probabilistic forecasting of wind power," Energy, Elsevier, vol. 113(C), pages 355-365.
    3. Bidong Liu & Jakub Nowotarski & Tao Hong & Rafal Weron, 2015. "Probabilistic load forecasting via Quantile Regression Averaging on sister forecasts," HSC Research Reports HSC/15/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    4. Nedellec, Raphael & Cugliari, Jairo & Goude, Yannig, 2014. "GEFCom2012: Electric load forecasting and backcasting with semi-parametric models," International Journal of Forecasting, Elsevier, vol. 30(2), pages 375-381.
    5. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    6. Maciejowska, Katarzyna & Nowotarski, Jakub & Weron, Rafał, 2016. "Probabilistic forecasting of electricity spot prices using Factor Quantile Regression Averaging," International Journal of Forecasting, Elsevier, vol. 32(3), pages 957-965.
    7. Yu, Ping & Phillips, Peter C.B., 2018. "Threshold regression with endogeneity," Journal of Econometrics, Elsevier, vol. 203(1), pages 50-68.
    8. Gaillard, Pierre & Goude, Yannig & Nedellec, Raphaël, 2016. "Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1038-1050.
    9. Takeda, Hisashi & Tamura, Yoshiyasu & Sato, Seisho, 2016. "Using the ensemble Kalman filter for electricity load forecasting and analysis," Energy, Elsevier, vol. 104(C), pages 184-198.
    10. Hong, Tao & Fan, Shu, 2016. "Probabilistic electric load forecasting: A tutorial review," International Journal of Forecasting, Elsevier, vol. 32(3), pages 914-938.
    11. Zhu, Qianqian & Zheng, Yao & Li, Guodong, 2018. "Linear double autoregression," Journal of Econometrics, Elsevier, vol. 207(1), pages 162-174.
    12. He, Yaoyao & Liu, Rui & Li, Haiyan & Wang, Shuo & Lu, Xiaofen, 2017. "Short-term power load probability density forecasting method using kernel-based support vector quantile regression and Copula theory," Applied Energy, Elsevier, vol. 185(P1), pages 254-266.
    13. Kaboli, S. Hr. Aghay & Selvaraj, J. & Rahim, N.A., 2016. "Long-term electric energy consumption forecasting via artificial cooperative search algorithm," Energy, Elsevier, vol. 115(P1), pages 857-871.
    14. Landry, Mark & Erlinger, Thomas P. & Patschke, David & Varrichio, Craig, 2016. "Probabilistic gradient boosting machines for GEFCom2014 wind forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1061-1066.
    15. Phillips, Peter C.B. & Shi, Shu-Ping, 2018. "Financial Bubble Implosion And Reverse Regression," Econometric Theory, Cambridge University Press, vol. 34(4), pages 705-753, August.
    16. He, Yaoyao & Xu, Qifa & Wan, Jinhong & Yang, Shanlin, 2016. "Short-term power load probability density forecasting based on quantile regression neural network and triangle kernel function," Energy, Elsevier, vol. 114(C), pages 498-512.
    17. Kaboli, S. Hr. Aghay & Fallahpour, A. & Selvaraj, J. & Rahim, N.A., 2017. "Long-term electrical energy consumption formulating and forecasting via optimized gene expression programming," Energy, Elsevier, vol. 126(C), pages 144-164.
    18. Süleyman Taşpınar & Osman Doğan & Wim P. M. Vijverberg, 2018. "GMM inference in spatial autoregressive models," Econometric Reviews, Taylor & Francis Journals, vol. 37(9), pages 931-954, October.
    19. Jakub Nowotarski & Rafał Weron, 2015. "Computing electricity spot price prediction intervals using quantile regression and forecast averaging," Computational Statistics, Springer, vol. 30(3), pages 791-803, September.
    20. ., 2017. "Multinationals: in theory and practice," Chapters, in: The Development of International Business, chapter 1, pages 1-12, Edward Elgar Publishing.
    21. Nagy, Gábor I. & Barta, Gergő & Kazi, Sándor & Borbély, Gyula & Simon, Gábor, 2016. "GEFCom2014: Probabilistic solar and wind power forecasting using a generalized additive tree ensemble approach," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1087-1093.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ulrich, Matthias & Jahnke, Hermann & Langrock, Roland & Pesch, Robert & Senge, Robin, 2022. "Classification-based model selection in retail demand forecasting," International Journal of Forecasting, Elsevier, vol. 38(1), pages 209-223.
    2. Bartosz Uniejewski, 2023. "Electricity price forecasting with Smoothing Quantile Regression Averaging: Quantifying economic benefits of probabilistic forecasts," Papers 2302.00411, arXiv.org, revised Jan 2024.
    3. Jihoon Moon & Junhong Kim & Pilsung Kang & Eenjun Hwang, 2020. "Solving the Cold-Start Problem in Short-Term Load Forecasting Using Tree-Based Methods," Energies, MDPI, vol. 13(4), pages 1-37, February.
    4. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    5. Liu, Luyao & Bai, Feifei & Su, Chenyu & Ma, Cuiping & Yan, Ruifeng & Li, Hailong & Sun, Qie & Wennersten, Ronald, 2022. "Forecasting the occurrence of extreme electricity prices using a multivariate logistic regression model," Energy, Elsevier, vol. 247(C).
    6. Huang, Qian & Li, Jinghua & Zhu, Mengshu, 2020. "An improved convolutional neural network with load range discretization for probabilistic load forecasting," Energy, Elsevier, vol. 203(C).
    7. Imani, Maryam, 2021. "Electrical load-temperature CNN for residential load forecasting," Energy, Elsevier, vol. 227(C).
    8. He, Feifei & Zhou, Jianzhong & Mo, Li & Feng, Kuaile & Liu, Guangbiao & He, Zhongzheng, 2020. "Day-ahead short-term load probability density forecasting method with a decomposition-based quantile regression forest," Applied Energy, Elsevier, vol. 262(C).
    9. He, Yaoyao & Wang, Yun & Wang, Shuo & Yao, Xin, 2022. "A cooperative ensemble method for multistep wind speed probabilistic forecasting," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    10. Yiqi Lu & Yongpan Li & Da Xie & Enwei Wei & Xianlu Bao & Huafeng Chen & Xiancheng Zhong, 2018. "The Application of Improved Random Forest Algorithm on the Prediction of Electric Vehicle Charging Load," Energies, MDPI, vol. 11(11), pages 1-16, November.
    11. Lu, Shixiang & Xu, Qifa & Jiang, Cuixia & Liu, Yezheng & Kusiak, Andrew, 2022. "Probabilistic load forecasting with a non-crossing sparse-group Lasso-quantile regression deep neural network," Energy, Elsevier, vol. 242(C).
    12. Sunghyeon Choi & Jin Hur, 2020. "An Ensemble Learner-Based Bagging Model Using Past Output Data for Photovoltaic Forecasting," Energies, MDPI, vol. 13(6), pages 1-16, March.
    13. Serrano-Guerrero, Xavier & Briceño-León, Marco & Clairand, Jean-Michel & Escrivá-Escrivá, Guillermo, 2021. "A new interval prediction methodology for short-term electric load forecasting based on pattern recognition," Applied Energy, Elsevier, vol. 297(C).
    14. Fan, Junliang & Ma, Xin & Wu, Lifeng & Zhang, Fucang & Yu, Xiang & Zeng, Wenzhi, 2019. "Light Gradient Boosting Machine: An efficient soft computing model for estimating daily reference evapotranspiration with local and external meteorological data," Agricultural Water Management, Elsevier, vol. 225(C).
    15. Niu, Dongxiao & Ji, Zhengsen & Li, Wanying & Xu, Xiaomin & Liu, Da, 2021. "Research and application of a hybrid model for mid-term power demand forecasting based on secondary decomposition and interval optimization," Energy, Elsevier, vol. 234(C).
    16. Xu Ran & Chang Xu & Lei Ma & Feifei Xue, 2022. "Wind Power Interval Prediction with Adaptive Rolling Error Correction Based on PSR-BLS-QR," Energies, MDPI, vol. 15(11), pages 1-22, June.
    17. Wang, Xinlin & Yao, Zhihao & Papaefthymiou, Marios, 2023. "A real-time electrical load forecasting and unsupervised anomaly detection framework," Applied Energy, Elsevier, vol. 330(PA).
    18. Pedro Cadahia & Antonio A. Golpe & Juan M. Mart'in 'Alvarez & E. Asensio, 2022. "Measuring anomalies in cigarette sales by using official data from Spanish provinces: Are there only the anomalies detected by the Empty Pack Surveys (EPS) used by Transnational Tobacco Companies (TTC," Papers 2203.06640, arXiv.org.
    19. Ruijin Zhu & Weilin Guo & Xuejiao Gong, 2019. "Short-Term Photovoltaic Power Output Prediction Based on k -Fold Cross-Validation and an Ensemble Model," Energies, MDPI, vol. 12(7), pages 1-15, March.
    20. Che, Jinxing & Yuan, Fang & Deng, Dewen & Jiang, Zheyong, 2023. "Ultra-short-term probabilistic wind power forecasting with spatial-temporal multi-scale features and K-FSDW based weight," Applied Energy, Elsevier, vol. 331(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    2. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    3. van der Meer, D.W. & Widén, J. & Munkhammar, J., 2018. "Review on probabilistic forecasting of photovoltaic power production and electricity consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1484-1512.
    4. González Ordiano, Jorge Ángel & Gröll, Lutz & Mikut, Ralf & Hagenmeyer, Veit, 2020. "Probabilistic energy forecasting using the nearest neighbors quantile filter and quantile regression," International Journal of Forecasting, Elsevier, vol. 36(2), pages 310-323.
    5. Zhang, Shu & Wang, Yi & Zhang, Yutian & Wang, Dan & Zhang, Ning, 2020. "Load probability density forecasting by transforming and combining quantile forecasts," Applied Energy, Elsevier, vol. 277(C).
    6. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    7. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    8. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    9. van der Meer, D.W. & Shepero, M. & Svensson, A. & Widén, J. & Munkhammar, J., 2018. "Probabilistic forecasting of electricity consumption, photovoltaic power generation and net demand of an individual building using Gaussian Processes," Applied Energy, Elsevier, vol. 213(C), pages 195-207.
    10. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    11. He, Yaoyao & Cao, Chaojin & Wang, Shuo & Fu, Hong, 2022. "Nonparametric probabilistic load forecasting based on quantile combination in electrical power systems," Applied Energy, Elsevier, vol. 322(C).
    12. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," Applied Energy, Elsevier, vol. 301(C).
    13. Maciejowska, Katarzyna & Nowotarski, Jakub, 2016. "A hybrid model for GEFCom2014 probabilistic electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1051-1056.
    14. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    15. Moreno-Carbonell, Santiago & Sánchez-Úbeda, Eugenio F. & Muñoz, Antonio, 2020. "Rethinking weather station selection for electric load forecasting using genetic algorithms," International Journal of Forecasting, Elsevier, vol. 36(2), pages 695-712.
    16. Nowotarski, Jakub & Weron, Rafał, 2016. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 57(C), pages 228-235.
    17. Bartosz Uniejewski, 2023. "Electricity price forecasting with Smoothing Quantile Regression Averaging: Quantifying economic benefits of probabilistic forecasts," Papers 2302.00411, arXiv.org, revised Jan 2024.
    18. Yang, Yandong & Li, Shufang & Li, Wenqi & Qu, Meijun, 2018. "Power load probability density forecasting using Gaussian process quantile regression," Applied Energy, Elsevier, vol. 213(C), pages 499-509.
    19. Claudio Monteiro & Ignacio J. Ramirez-Rosado & L. Alfredo Fernandez-Jimenez, 2018. "Probabilistic Electricity Price Forecasting Models by Aggregation of Competitive Predictors," Energies, MDPI, vol. 11(5), pages 1-25, April.
    20. Stephen Haben & Julien Caudron & Jake Verma, 2021. "Probabilistic Day-Ahead Wholesale Price Forecast: A Case Study in Great Britain," Forecasting, MDPI, vol. 3(3), pages 1-37, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:160:y:2018:i:c:p:810-819. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.