IDEAS home Printed from https://ideas.repec.org/p/wuu/wpaper/hsc1508.html
   My bibliography  Save this paper

Electric load forecasting with recency effect: A big data approach

Author

Listed:
  • Pu Wang
  • Bidong Liu
  • Tao Hong

Abstract

Temperature plays a key role in driving electricity demand. We adopt "recency effect", a term originated from psychology, to denote the fact that electricity demand is affected by the temperatures of preceding hours. In the load forecasting literature, the temperature variables are often constructed in the form of lagged hourly temperatures and moving average temperatures. Over the past decades, computing power has been limiting the amount of temperature variables that can be used in a load forecasting model. In this paper, we present a comprehensive study on modeling recency effect through a big data approach. We take advantage of the modern computing power to answer a fundamental question: how many lagged hourly temperatures and/or moving average temperatures are needed in a regression model to fully capture recency effect without compromising the forecasting accuracy? Using the case study based on data from the load forecasting track of the Global Energy Forecasting Competition 2012, we first demonstrate that a model with recency effect outperforms its counterpart (a.k.a., Tao’s Vanilla Benchmark Model) in forecasting the load series at the top (aggregated) level by 18% to 21%. We then apply recency effect modeling to customize load forecasting models at low level of a geographic hierarchy, again showing the superiority over the benchmark model by 12% to 15% on average. Finally, we discuss four different implementations of the recency effect modeling by hour of a day.

Suggested Citation

  • Pu Wang & Bidong Liu & Tao Hong, 2015. "Electric load forecasting with recency effect: A big data approach," HSC Research Reports HSC/15/08, Hugo Steinhaus Center, Wroclaw University of Technology.
  • Handle: RePEc:wuu:wpaper:hsc1508
    as

    Download full text from publisher

    File URL: http://www.im.pwr.wroc.pl/~hugo/RePEc/wuu/wpaper/HSC_15_08.pdf
    File Function: Final version, 2015
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Tao Hong, 2014. "Energy Forecasting: Past, Present, and Future," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 32, pages 43-48, Winter.
    2. Hong, Tao & Wang, Pu & White, Laura, 2015. "Weather station selection for electric load forecasting," International Journal of Forecasting, Elsevier, vol. 31(2), pages 286-295.
    3. Nedellec, Raphael & Cugliari, Jairo & Goude, Yannig, 2014. "GEFCom2012: Electric load forecasting and backcasting with semi-parametric models," International Journal of Forecasting, Elsevier, vol. 30(2), pages 375-381.
    4. Hong, Tao & Pinson, Pierre & Fan, Shu, 2014. "Global Energy Forecasting Competition 2012," International Journal of Forecasting, Elsevier, vol. 30(2), pages 357-363.
    5. Ramanathan, Ramu & Engle, Robert & Granger, Clive W. J. & Vahid-Araghi, Farshid & Brace, Casey, 1997. "Shorte-run forecasts of electricity loads and peaks," International Journal of Forecasting, Elsevier, vol. 13(2), pages 161-174, June.
    6. Ben Taieb, Souhaib & Hyndman, Rob J., 2014. "A gradient boosting approach to the Kaggle load forecasting competition," International Journal of Forecasting, Elsevier, vol. 30(2), pages 382-394.
    7. Tao Hong & Jason Wilson & Jingrui Xie, 2013. "Long term probabilistic load forecasting and normalization with hourly information," HSC Research Reports HSC/13/13, Hugo Steinhaus Center, Wroclaw University of Technology.
    8. Hong, Tao & Fan, Shu, 2016. "Probabilistic electric load forecasting: A tutorial review," International Journal of Forecasting, Elsevier, vol. 32(3), pages 914-938.
    9. Bidong Liu & Jakub Nowotarski & Tao Hong & Rafal Weron, 2015. "Probabilistic load forecasting via Quantile Regression Averaging on sister forecasts," HSC Research Reports HSC/15/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    10. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601.
    11. Tao Hong & Pu Wang, 2013. "Fuzzy interaction regression for short term load forecasting," HSC Research Reports HSC/13/14, Hugo Steinhaus Center, Wroclaw University of Technology.
    12. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Purva Grover & Arpan Kumar Kar, 2017. "Big Data Analytics: A Review on Theoretical Contributions and Tools Used in Literature," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 18(3), pages 203-229, September.
    2. Luo, Jian & Hong, Tao & Fang, Shu-Cherng, 2018. "Benchmarking robustness of load forecasting models under data integrity attacks," International Journal of Forecasting, Elsevier, vol. 34(1), pages 89-104.
    3. Jihoon Moon & Sungwoo Park & Seungmin Rho & Eenjun Hwang, 2019. "A comparative analysis of artificial neural network architectures for building energy consumption forecasting," International Journal of Distributed Sensor Networks, , vol. 15(9), pages 15501477198, September.
    4. Dimoulkas, I. & Mazidi, P. & Herre, L., 2019. "Neural networks for GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1409-1423.
    5. Haben, Stephen & Giasemidis, Georgios & Ziel, Florian & Arora, Siddharth, 2019. "Short term load forecasting and the effect of temperature at the low voltage level," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1469-1484.
    6. Sana Mujeeb & Nadeem Javaid & Manzoor Ilahi & Zahid Wadud & Farruh Ishmanov & Muhammad Khalil Afzal, 2019. "Deep Long Short-Term Memory: A New Price and Load Forecasting Scheme for Big Data in Smart Cities," Sustainability, MDPI, Open Access Journal, vol. 11(4), pages 1-29, February.
    7. Khoshrou, Abdolrahman & Pauwels, Eric J., 2019. "Short-term scenario-based probabilistic load forecasting: A data-driven approach," Applied Energy, Elsevier, vol. 238(C), pages 1258-1268.
    8. Nowotarski, Jakub & Weron, Rafał, 2016. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 57(C), pages 228-235.
    9. Alexis Gerossier & Robin Girard & Alexis Bocquet & George Kariniotakis, 2018. "Robust Day-Ahead Forecasting of Household Electricity Demand and Operational Challenges," Energies, MDPI, Open Access Journal, vol. 11(12), pages 1-18, December.
    10. Hong, Tao & Xie, Jingrui & Black, Jonathan, 2019. "Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1389-1399.
    11. Ziel, Florian & Liu, Bidong, 2016. "Lasso estimation for GEFCom2014 probabilistic electric load forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1029-1037.
    12. Masoud Sobhani & Allison Campbell & Saurabh Sangamwar & Changlin Li & Tao Hong, 2019. "Combining Weather Stations for Electric Load Forecasting," Energies, MDPI, Open Access Journal, vol. 12(8), pages 1-11, April.
    13. George P. Papaioannou & Christos Dikaiakos & Anargyros Dramountanis & Panagiotis G. Papaioannou, 2016. "Analysis and Modeling for Short- to Medium-Term Load Forecasting Using a Hybrid Manifold Learning Principal Component Model and Comparison with Classical Statistical Models (SARIMAX, Exponential Smoot," Energies, MDPI, Open Access Journal, vol. 9(8), pages 1-40, August.
    14. Bidong Liu & Jiali Liu & Tao Hong, 2015. "Sister models for load forecast combination," HSC Research Reports HSC/15/02, Hugo Steinhaus Center, Wroclaw University of Technology.
    15. Miguel López & Sergio Valero & Carlos Sans & Carolina Senabre, 2020. "Use of Available Daylight to Improve Short-Term Load Forecasting Accuracy," Energies, MDPI, Open Access Journal, vol. 14(1), pages 1-14, December.
    16. Sobhani, Masoud & Hong, Tao & Martin, Claude, 2020. "Temperature anomaly detection for electric load forecasting," International Journal of Forecasting, Elsevier, vol. 36(2), pages 324-333.
    17. Hong, Tao & Fan, Shu, 2016. "Probabilistic electric load forecasting: A tutorial review," International Journal of Forecasting, Elsevier, vol. 32(3), pages 914-938.
    18. Jingrui Xie & Tao Hong, 2017. "Wind Speed for Load Forecasting Models," Sustainability, MDPI, Open Access Journal, vol. 9(5), pages 1-12, May.
    19. Miguel López & Carlos Sans & Sergio Valero & Carolina Senabre, 2018. "Empirical Comparison of Neural Network and Auto-Regressive Models in Short-Term Load Forecasting," Energies, MDPI, Open Access Journal, vol. 11(8), pages 1-19, August.
    20. Seung-Min Jung & Sungwoo Park & Seung-Won Jung & Eenjun Hwang, 2020. "Monthly Electric Load Forecasting Using Transfer Learning for Smart Cities," Sustainability, MDPI, Open Access Journal, vol. 12(16), pages 1-20, August.
    21. Smyl, Slawek & Hua, N. Grace, 2019. "Machine learning methods for GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1424-1431.
    22. Guo-Feng Fan & Yan-Hui Guo & Jia-Mei Zheng & Wei-Chiang Hong, 2019. "Application of the Weighted K-Nearest Neighbor Algorithm for Short-Term Load Forecasting," Energies, MDPI, Open Access Journal, vol. 12(5), pages 1-19, March.
    23. Hafeez, Ghulam & Alimgeer, Khurram Saleem & Khan, Imran, 2020. "Electric load forecasting based on deep learning and optimized by heuristic algorithm in smart grid," Applied Energy, Elsevier, vol. 269(C).
    24. Nowotarski, Jakub & Liu, Bidong & Weron, Rafał & Hong, Tao, 2016. "Improving short term load forecast accuracy via combining sister forecasts," Energy, Elsevier, vol. 98(C), pages 40-49.
    25. Sungwoo Park & Jihoon Moon & Seungwon Jung & Seungmin Rho & Sung Wook Baik & Eenjun Hwang, 2020. "A Two-Stage Industrial Load Forecasting Scheme for Day-Ahead Combined Cooling, Heating and Power Scheduling," Energies, MDPI, Open Access Journal, vol. 13(2), pages 1-23, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hong, Tao & Fan, Shu, 2016. "Probabilistic electric load forecasting: A tutorial review," International Journal of Forecasting, Elsevier, vol. 32(3), pages 914-938.
    2. Bidong Liu & Jakub Nowotarski & Tao Hong & Rafal Weron, 2015. "Probabilistic load forecasting via Quantile Regression Averaging on sister forecasts," HSC Research Reports HSC/15/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    3. Hong, Tao & Wang, Pu & White, Laura, 2015. "Weather station selection for electric load forecasting," International Journal of Forecasting, Elsevier, vol. 31(2), pages 286-295.
    4. Luo, Jian & Hong, Tao & Fang, Shu-Cherng, 2018. "Benchmarking robustness of load forecasting models under data integrity attacks," International Journal of Forecasting, Elsevier, vol. 34(1), pages 89-104.
    5. Moreno-Carbonell, Santiago & Sánchez-Úbeda, Eugenio F. & Muñoz, Antonio, 2020. "Rethinking weather station selection for electric load forecasting using genetic algorithms," International Journal of Forecasting, Elsevier, vol. 36(2), pages 695-712.
    6. Tao Hong & Katarzyna Maciejowska & Jakub Nowotarski & Rafal Weron, 2014. "Probabilistic load forecasting via Quantile Regression Averaging of independent expert forecasts," HSC Research Reports HSC/14/10, Hugo Steinhaus Center, Wroclaw University of Technology.
    7. Nowotarski, Jakub & Liu, Bidong & Weron, Rafał & Hong, Tao, 2016. "Improving short term load forecast accuracy via combining sister forecasts," Energy, Elsevier, vol. 98(C), pages 40-49.
    8. Jingrui Xie & Tao Hong, 2017. "Wind Speed for Load Forecasting Models," Sustainability, MDPI, Open Access Journal, vol. 9(5), pages 1-12, May.
    9. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    10. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    11. Nowotarski, Jakub & Weron, Rafał, 2016. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 57(C), pages 228-235.
    12. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    13. Maciejowska, Katarzyna & Nowotarski, Jakub, 2016. "A hybrid model for GEFCom2014 probabilistic electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1051-1056.
    14. Xie, Jingrui & Hong, Tao, 2016. "GEFCom2014 probabilistic electric load forecasting: An integrated solution with forecast combination and residual simulation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1012-1016.
    15. Kamal Chapagain & Somsak Kittipiyakul, 2018. "Performance Analysis of Short-Term Electricity Demand with Atmospheric Variables," Energies, MDPI, Open Access Journal, vol. 11(4), pages 1-34, April.
    16. Lavička, Hynek & Kracík, Jiří, 2020. "Fluctuation analysis of electric power loads in Europe: Correlation multifractality vs. Distribution function multifractality," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    17. Niematallah Elamin & Mototsugu Fukushige, 2016. "A Quantile Regression Model for Electricity Peak Demand Forecasting: An Approach to Avoiding Power Blackouts," Discussion Papers in Economics and Business 16-22, Osaka University, Graduate School of Economics.
    18. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, Open Access Journal, vol. 11(9), pages 1-20, September.
    19. Avci, Ezgi & Ketter, Wolfgang & van Heck, Eric, 2018. "Managing electricity price modeling risk via ensemble forecasting: The case of Turkey," Energy Policy, Elsevier, vol. 123(C), pages 390-403.
    20. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.

    More about this item

    Keywords

    Electric load forecasting; Regression; Recency effect; Big data approach; Global Energy Forecasting Competition;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wuu:wpaper:hsc1508. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/hspwrpl.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rafal Weron (email available below). General contact details of provider: https://edirc.repec.org/data/hspwrpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.