IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v56y2020i2d10.1007_s10614-019-09960-5.html
   My bibliography  Save this article

Machine learning with parallel neural networks for analyzing and forecasting electricity demand

Author

Listed:
  • Yi-Ting Chen

    (National Chiao Tung University)

  • Edward W. Sun

    (KEDGE Business School)

  • Yi-Bing Lin

    (National Chiao Tung University)

Abstract

Traditional methods applied in electricity demand forecasting have been challenged by the course of dimensionality arisen with a growing number of distributed or decentralized energy systems are employing. Without manually operated data preprocessing, classic models are not well-calibrated for their robustness when dealing with the disruptive elements (e.g., demand changes in holidays and extreme weather). Based on the application of big data driven analytics, we propose a novel machine learning method originating from the parallel neural networks for robust monitoring and forecasting power demand to enhance supervisory control and data acquisition for new industrial tendency such as Industry 4.0 and Energy IoT. Through our approach, we generalize the implementation of machine learning by using classic feed-forward neural networks, for parallelization in order to let the proposed method achieve superior performance when dealing with high dimensionality and disruptiveness. With the high-frequency data of consumption in Australia from January 2009 to December 2015, the overall empirical results confirm that our proposed method performs significantly better for dynamic monitoring and forecasting of power demand comparing with the classic methods.

Suggested Citation

  • Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2020. "Machine learning with parallel neural networks for analyzing and forecasting electricity demand," Computational Economics, Springer;Society for Computational Economics, vol. 56(2), pages 569-597, August.
  • Handle: RePEc:kap:compec:v:56:y:2020:i:2:d:10.1007_s10614-019-09960-5
    DOI: 10.1007/s10614-019-09960-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-019-09960-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-019-09960-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yongyang Cai & Kenneth Judd & Greg Thain & Stephen Wright, 2015. "Solving Dynamic Programming Problems on a Computational Grid," Computational Economics, Springer;Society for Computational Economics, vol. 45(2), pages 261-284, February.
    2. YongSeog Kim & W. Nick Street & Gary J. Russell & Filippo Menczer, 2005. "Customer Targeting: A Neural Network Approach Guided by Genetic Algorithms," Management Science, INFORMS, vol. 51(2), pages 264-276, February.
    3. Wong, W.K. & Xia, Min & Chu, W.C., 2010. "Adaptive neural network model for time-series forecasting," European Journal of Operational Research, Elsevier, vol. 207(2), pages 807-816, December.
    4. Michael Creel, 2016. "A Note on Julia and MPI, with Code Examples," Computational Economics, Springer;Society for Computational Economics, vol. 48(3), pages 535-546, October.
    5. Kar Yan Tam & Melody Y. Kiang, 1992. "Managerial Applications of Neural Networks: The Case of Bank Failure Predictions," Management Science, INFORMS, vol. 38(7), pages 926-947, July.
    6. Swann, Christopher A, 2002. "Maximum Likelihood Estimation Using Parallel Computing: An Introduction to MPI," Computational Economics, Springer;Society for Computational Economics, vol. 19(2), pages 145-178, April.
    7. Tim Hill & Marcus O'Connor & William Remus, 1996. "Neural Network Models for Time Series Forecasts," Management Science, INFORMS, vol. 42(7), pages 1082-1092, July.
    8. Ronal Muresano & Andrea Pagano, 2016. "Adapting and Optimizing the Systemic Model of Banking Originated Losses (SYMBOL) Tool to the Multi-core Architecture," Computational Economics, Springer;Society for Computational Economics, vol. 48(2), pages 253-280, August.
    9. Selwyn Piramuthu & Harish Ragavan & Michael J. Shaw, 1998. "Using Feature Construction to Improve the Performance of Neural Networks," Management Science, INFORMS, vol. 44(3), pages 416-430, March.
    10. Michael Creel, 2008. "Using Parallelization to Solve a Macroeconomic Model: A Parallel Parameterized Expectations Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 343-352, November.
    11. Yi-Ting Chen & Edward W. Sun & Min-Teh Yu, 2018. "Risk Assessment with Wavelet Feature Engineering for High-Frequency Portfolio Trading," Computational Economics, Springer;Society for Computational Economics, vol. 52(2), pages 653-684, August.
    12. Charalampos Stasinakis & Georgios Sermpinis & Konstantinos Theofilatos & Andreas Karathanasopoulos, 2016. "Forecasting US Unemployment with Radial Basis Neural Networks, Kalman Filters and Support Vector Regressions," Computational Economics, Springer;Society for Computational Economics, vol. 47(4), pages 569-587, April.
    13. Sun, Edward W. & Meinl, Thomas, 2012. "A new wavelet-based denoising algorithm for high-frequency financial data mining," European Journal of Operational Research, Elsevier, vol. 217(3), pages 589-599.
    14. Bart Baesens & Rudy Setiono & Christophe Mues & Jan Vanthienen, 2003. "Using Neural Network Rule Extraction and Decision Tables for Credit-Risk Evaluation," Management Science, INFORMS, vol. 49(3), pages 312-329, March.
    15. Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2019. "Coherent quality management for big data systems: a dynamic approach for stochastic time consistency," Annals of Operations Research, Springer, vol. 277(1), pages 3-32, June.
    16. Manel Baucells & Emanuele Borgonovo, 2013. "Invariant Probabilistic Sensitivity Analysis," Management Science, INFORMS, vol. 59(11), pages 2536-2549, November.
    17. Arora, Siddharth & Taylor, James W., 2018. "Rule-based autoregressive moving average models for forecasting load on special days: A case study for France," European Journal of Operational Research, Elsevier, vol. 266(1), pages 259-268.
    18. Ghadimi, Noradin & Akbarimajd, Adel & Shayeghi, Hossein & Abedinia, Oveis, 2018. "Two stage forecast engine with feature selection technique and improved meta-heuristic algorithm for electricity load forecasting," Energy, Elsevier, vol. 161(C), pages 130-142.
    19. Sun, Edward W. & Chen, Yi-Ting & Yu, Min-Teh, 2015. "Generalized optimal wavelet decomposing algorithm for big financial data," International Journal of Production Economics, Elsevier, vol. 165(C), pages 194-214.
    20. Shouhong Wang, 1995. "The Unpredictability of Standard Back Propagation Neural Networks in Classification Applications," Management Science, INFORMS, vol. 41(3), pages 555-559, March.
    21. Venkatesh, Kamini & Ravi, Vadlamani & Prinzie, Anita & Poel, Dirk Van den, 2014. "Cash demand forecasting in ATMs by clustering and neural networks," European Journal of Operational Research, Elsevier, vol. 232(2), pages 383-392.
    22. Khurshid Kiani, 2011. "Fluctuations in Economic and Activity and Stabilization Policies in the CIS," Computational Economics, Springer;Society for Computational Economics, vol. 37(2), pages 193-220, February.
    23. Hossein Etemadi & Ahmad Ahmadpour & Seyed Moshashaei, 2015. "Earnings Per Share Forecast Using Extracted Rules from Trained Neural Network by Genetic Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 46(1), pages 55-63, June.
    24. Sepehr Ramyar & Farhad Kianfar, 2019. "Forecasting Crude Oil Prices: A Comparison Between Artificial Neural Networks and Vector Autoregressive Models," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 743-761, February.
    25. J. Levendovszky & I. Reguly & A. Olah & A. Ceffer, 2019. "Low Complexity Algorithmic Trading by Feedforward Neural Networks," Computational Economics, Springer;Society for Computational Economics, vol. 54(1), pages 267-279, June.
    26. Sun, Wei & Rachev, Svetlozar & Fabozzi, Frank J., 2007. "Fractals or I.I.D.: Evidence of long-range dependence and heavy tailedness from modeling German equity market returns," Journal of Economics and Business, Elsevier, vol. 59(6), pages 575-595.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wan-Ni Lai & Claire Y. T. Chen & Edward W. Sun, 2022. "Risk factor extraction with quantile regression method," Annals of Operations Research, Springer, vol. 316(2), pages 1543-1572, September.
    2. Paul Anton Verwiebe & Stephan Seim & Simon Burges & Lennart Schulz & Joachim Müller-Kirchenbauer, 2021. "Modeling Energy Demand—A Systematic Literature Review," Energies, MDPI, vol. 14(23), pages 1-58, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2019. "Coherent quality management for big data systems: a dynamic approach for stochastic time consistency," Annals of Operations Research, Springer, vol. 277(1), pages 3-32, June.
    2. Yi-Ting Chen & Wan-Ni Lai & Edward W. Sun, 2019. "Jump Detection and Noise Separation by a Singular Wavelet Method for Predictive Analytics of High-Frequency Data," Computational Economics, Springer;Society for Computational Economics, vol. 54(2), pages 809-844, August.
    3. Chen, Yi-Ting & Sun, Edward W. & Chang, Ming-Feng & Lin, Yi-Bing, 2021. "Pragmatic real-time logistics management with traffic IoT infrastructure: Big data predictive analytics of freight travel time for Logistics 4.0," International Journal of Production Economics, Elsevier, vol. 238(C).
    4. Yi-Ting Chen & Edward W. Sun & Min-Teh Yu, 2018. "Risk Assessment with Wavelet Feature Engineering for High-Frequency Portfolio Trading," Computational Economics, Springer;Society for Computational Economics, vol. 52(2), pages 653-684, August.
    5. Kwon, He-Boong & Lee, Jooh, 2019. "Exploring the differential impact of environmental sustainability, operational efficiency, and corporate reputation on market valuation in high-tech-oriented firms," International Journal of Production Economics, Elsevier, vol. 211(C), pages 1-14.
    6. Gestel, Tony Van & Baesens, Bart & Suykens, Johan A.K. & Van den Poel, Dirk & Baestaens, Dirk-Emma & Willekens, Marleen, 2006. "Bayesian kernel based classification for financial distress detection," European Journal of Operational Research, Elsevier, vol. 172(3), pages 979-1003, August.
    7. Boylu, Fidan & Aytug, Haldun & Koehler, Gary J., 2010. "Induction over constrained strategic agents," European Journal of Operational Research, Elsevier, vol. 203(3), pages 698-705, June.
    8. Óscar Trull & J. Carlos García-Díaz & Alicia Troncoso, 2019. "Application of Discrete-Interval Moving Seasonalities to Spanish Electricity Demand Forecasting during Easter," Energies, MDPI, vol. 12(6), pages 1-16, March.
    9. Xing, Jieli & Zhang, Yongjie & Chu, Gang & Pan, Qi & Zhang, Xiaotao, 2021. "Detection and reconstruction of catastrophic breaks of high-frequency financial data with local linear scaling approximation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 561(C).
    10. R Setiono & S-L Pan & M-H Hsieh & A Azcarraga, 2006. "Knowledge acquisition and revision using neural networks: an application to a cross-national study of brand image perception," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(3), pages 231-240, March.
    11. Meinl Thomas & Sun Edward W., 2012. "A Nonlinear Filtering Algorithm based on Wavelet Transforms for High-Frequency Financial Data Analysis," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(3), pages 1-24, September.
    12. Lessmann, Stefan & Voß, Stefan, 2009. "A reference model for customer-centric data mining with support vector machines," European Journal of Operational Research, Elsevier, vol. 199(2), pages 520-530, December.
    13. Rua-Haun Tsaih & Hsiou-Wei Lin & Wen-Chyan Ke, 2014. "An Abductive-Reasoning Guide for Finance Practitioners," Computational Economics, Springer;Society for Computational Economics, vol. 43(4), pages 411-431, April.
    14. J V Hansen & R D Nelson, 2003. "Forecasting and recombining time-series components by using neural networks," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(3), pages 307-317, March.
    15. Lean Yu & Xinxie Li & Ling Tang & Zongyi Zhang & Gang Kou, 2015. "Social credit: a comprehensive literature review," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 1(1), pages 1-18, December.
    16. Gradojevic, Nikola & Erdemlioglu, Deniz & Gençay, Ramazan, 2020. "A new wavelet-based ultra-high-frequency analysis of triangular currency arbitrage," Economic Modelling, Elsevier, vol. 85(C), pages 57-73.
    17. Lin, Edward M.H. & Sun, Edward W. & Yu, Min-Teh, 2020. "Behavioral data-driven analysis with Bayesian method for risk management of financial services," International Journal of Production Economics, Elsevier, vol. 228(C).
    18. du Jardin, Philippe & Séverin, Eric, 2011. "Predicting corporate bankruptcy using a self-organizing map: An empirical study to improve the forecasting horizon of a financial failure model," MPRA Paper 44262, University Library of Munich, Germany.
    19. Pendharkar, Parag C., 2002. "A computational study on the performance of artificial neural networks under changing structural design and data distribution," European Journal of Operational Research, Elsevier, vol. 138(1), pages 155-177, April.
    20. R Fildes & K Nikolopoulos & S F Crone & A A Syntetos, 2008. "Forecasting and operational research: a review," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(9), pages 1150-1172, September.

    More about this item

    Keywords

    Big data; Energy; Forecasting; Machine learning; Neural networks (PNNs);
    All these keywords.

    JEL classification:

    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:56:y:2020:i:2:d:10.1007_s10614-019-09960-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.