IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v56y2020i2d10.1007_s10614-019-09960-5.html
   My bibliography  Save this article

Machine learning with parallel neural networks for analyzing and forecasting electricity demand

Author

Listed:
  • Yi-Ting Chen

    (National Chiao Tung University)

  • Edward W. Sun

    (KEDGE Business School)

  • Yi-Bing Lin

    (National Chiao Tung University)

Abstract

Traditional methods applied in electricity demand forecasting have been challenged by the course of dimensionality arisen with a growing number of distributed or decentralized energy systems are employing. Without manually operated data preprocessing, classic models are not well-calibrated for their robustness when dealing with the disruptive elements (e.g., demand changes in holidays and extreme weather). Based on the application of big data driven analytics, we propose a novel machine learning method originating from the parallel neural networks for robust monitoring and forecasting power demand to enhance supervisory control and data acquisition for new industrial tendency such as Industry 4.0 and Energy IoT. Through our approach, we generalize the implementation of machine learning by using classic feed-forward neural networks, for parallelization in order to let the proposed method achieve superior performance when dealing with high dimensionality and disruptiveness. With the high-frequency data of consumption in Australia from January 2009 to December 2015, the overall empirical results confirm that our proposed method performs significantly better for dynamic monitoring and forecasting of power demand comparing with the classic methods.

Suggested Citation

  • Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2020. "Machine learning with parallel neural networks for analyzing and forecasting electricity demand," Computational Economics, Springer;Society for Computational Economics, vol. 56(2), pages 569-597, August.
  • Handle: RePEc:kap:compec:v:56:y:2020:i:2:d:10.1007_s10614-019-09960-5
    DOI: 10.1007/s10614-019-09960-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-019-09960-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-019-09960-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yongyang Cai & Kenneth Judd & Greg Thain & Stephen Wright, 2015. "Solving Dynamic Programming Problems on a Computational Grid," Computational Economics, Springer;Society for Computational Economics, vol. 45(2), pages 261-284, February.
    2. Charalampos Stasinakis & Georgios Sermpinis & Konstantinos Theofilatos & Andreas Karathanasopoulos, 2016. "Forecasting US Unemployment with Radial Basis Neural Networks, Kalman Filters and Support Vector Regressions," Computational Economics, Springer;Society for Computational Economics, vol. 47(4), pages 569-587, April.
    3. YongSeog Kim & W. Nick Street & Gary J. Russell & Filippo Menczer, 2005. "Customer Targeting: A Neural Network Approach Guided by Genetic Algorithms," Management Science, INFORMS, vol. 51(2), pages 264-276, February.
    4. Sun, Edward W. & Meinl, Thomas, 2012. "A new wavelet-based denoising algorithm for high-frequency financial data mining," European Journal of Operational Research, Elsevier, vol. 217(3), pages 589-599.
    5. Wong, W.K. & Xia, Min & Chu, W.C., 2010. "Adaptive neural network model for time-series forecasting," European Journal of Operational Research, Elsevier, vol. 207(2), pages 807-816, December.
    6. Bart Baesens & Rudy Setiono & Christophe Mues & Jan Vanthienen, 2003. "Using Neural Network Rule Extraction and Decision Tables for Credit-Risk Evaluation," Management Science, INFORMS, vol. 49(3), pages 312-329, March.
    7. Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2019. "Coherent quality management for big data systems: a dynamic approach for stochastic time consistency," Annals of Operations Research, Springer, vol. 277(1), pages 3-32, June.
    8. Manel Baucells & Emanuele Borgonovo, 2013. "Invariant Probabilistic Sensitivity Analysis," Management Science, INFORMS, vol. 59(11), pages 2536-2549, November.
    9. Arora, Siddharth & Taylor, James W., 2018. "Rule-based autoregressive moving average models for forecasting load on special days: A case study for France," European Journal of Operational Research, Elsevier, vol. 266(1), pages 259-268.
    10. Ghadimi, Noradin & Akbarimajd, Adel & Shayeghi, Hossein & Abedinia, Oveis, 2018. "Two stage forecast engine with feature selection technique and improved meta-heuristic algorithm for electricity load forecasting," Energy, Elsevier, vol. 161(C), pages 130-142.
    11. Michael Creel, 2016. "A Note on Julia and MPI, with Code Examples," Computational Economics, Springer;Society for Computational Economics, vol. 48(3), pages 535-546, October.
    12. Sun, Edward W. & Chen, Yi-Ting & Yu, Min-Teh, 2015. "Generalized optimal wavelet decomposing algorithm for big financial data," International Journal of Production Economics, Elsevier, vol. 165(C), pages 194-214.
    13. Shouhong Wang, 1995. "The Unpredictability of Standard Back Propagation Neural Networks in Classification Applications," Management Science, INFORMS, vol. 41(3), pages 555-559, March.
    14. Venkatesh, Kamini & Ravi, Vadlamani & Prinzie, Anita & Poel, Dirk Van den, 2014. "Cash demand forecasting in ATMs by clustering and neural networks," European Journal of Operational Research, Elsevier, vol. 232(2), pages 383-392.
    15. Kar Yan Tam & Melody Y. Kiang, 1992. "Managerial Applications of Neural Networks: The Case of Bank Failure Predictions," Management Science, INFORMS, vol. 38(7), pages 926-947, July.
    16. Swann, Christopher A, 2002. "Maximum Likelihood Estimation Using Parallel Computing: An Introduction to MPI," Computational Economics, Springer;Society for Computational Economics, vol. 19(2), pages 145-178, April.
    17. Khurshid Kiani, 2011. "Fluctuations in Economic and Activity and Stabilization Policies in the CIS," Computational Economics, Springer;Society for Computational Economics, vol. 37(2), pages 193-220, February.
    18. Hossein Etemadi & Ahmad Ahmadpour & Seyed Moshashaei, 2015. "Earnings Per Share Forecast Using Extracted Rules from Trained Neural Network by Genetic Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 46(1), pages 55-63, June.
    19. Tim Hill & Marcus O'Connor & William Remus, 1996. "Neural Network Models for Time Series Forecasts," Management Science, INFORMS, vol. 42(7), pages 1082-1092, July.
    20. Sepehr Ramyar & Farhad Kianfar, 2019. "Forecasting Crude Oil Prices: A Comparison Between Artificial Neural Networks and Vector Autoregressive Models," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 743-761, February.
    21. J. Levendovszky & I. Reguly & A. Olah & A. Ceffer, 2019. "Low Complexity Algorithmic Trading by Feedforward Neural Networks," Computational Economics, Springer;Society for Computational Economics, vol. 54(1), pages 267-279, June.
    22. Ronal Muresano & Andrea Pagano, 2016. "Adapting and Optimizing the Systemic Model of Banking Originated Losses (SYMBOL) Tool to the Multi-core Architecture," Computational Economics, Springer;Society for Computational Economics, vol. 48(2), pages 253-280, August.
    23. Selwyn Piramuthu & Harish Ragavan & Michael J. Shaw, 1998. "Using Feature Construction to Improve the Performance of Neural Networks," Management Science, INFORMS, vol. 44(3), pages 416-430, March.
    24. Sun, Wei & Rachev, Svetlozar & Fabozzi, Frank J., 2007. "Fractals or I.I.D.: Evidence of long-range dependence and heavy tailedness from modeling German equity market returns," Journal of Economics and Business, Elsevier, vol. 59(6), pages 575-595.
    25. Michael Creel, 2008. "Using Parallelization to Solve a Macroeconomic Model: A Parallel Parameterized Expectations Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 343-352, November.
    26. Yi-Ting Chen & Edward W. Sun & Min-Teh Yu, 2018. "Risk Assessment with Wavelet Feature Engineering for High-Frequency Portfolio Trading," Computational Economics, Springer;Society for Computational Economics, vol. 52(2), pages 653-684, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wan-Ni Lai & Claire Y. T. Chen & Edward W. Sun, 2022. "Risk factor extraction with quantile regression method," Annals of Operations Research, Springer, vol. 316(2), pages 1543-1572, September.
    2. Paul Anton Verwiebe & Stephan Seim & Simon Burges & Lennart Schulz & Joachim Müller-Kirchenbauer, 2021. "Modeling Energy Demand—A Systematic Literature Review," Energies, MDPI, vol. 14(23), pages 1-58, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yi-Ting Chen & Wan-Ni Lai & Edward W. Sun, 2019. "Jump Detection and Noise Separation by a Singular Wavelet Method for Predictive Analytics of High-Frequency Data," Computational Economics, Springer;Society for Computational Economics, vol. 54(2), pages 809-844, August.
    2. Chen, Yi-Ting & Sun, Edward W. & Chang, Ming-Feng & Lin, Yi-Bing, 2021. "Pragmatic real-time logistics management with traffic IoT infrastructure: Big data predictive analytics of freight travel time for Logistics 4.0," International Journal of Production Economics, Elsevier, vol. 238(C).
    3. Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2019. "Coherent quality management for big data systems: a dynamic approach for stochastic time consistency," Annals of Operations Research, Springer, vol. 277(1), pages 3-32, June.
    4. Yi-Ting Chen & Edward W. Sun & Min-Teh Yu, 2018. "Risk Assessment with Wavelet Feature Engineering for High-Frequency Portfolio Trading," Computational Economics, Springer;Society for Computational Economics, vol. 52(2), pages 653-684, August.
    5. Gradojevic, Nikola & Erdemlioglu, Deniz & Gençay, Ramazan, 2020. "A new wavelet-based ultra-high-frequency analysis of triangular currency arbitrage," Economic Modelling, Elsevier, vol. 85(C), pages 57-73.
    6. Kwon, He-Boong & Lee, Jooh, 2019. "Exploring the differential impact of environmental sustainability, operational efficiency, and corporate reputation on market valuation in high-tech-oriented firms," International Journal of Production Economics, Elsevier, vol. 211(C), pages 1-14.
    7. Lin, Edward M.H. & Sun, Edward W. & Yu, Min-Teh, 2020. "Behavioral data-driven analysis with Bayesian method for risk management of financial services," International Journal of Production Economics, Elsevier, vol. 228(C).
    8. du Jardin, Philippe & Séverin, Eric, 2011. "Predicting corporate bankruptcy using a self-organizing map: An empirical study to improve the forecasting horizon of a financial failure model," MPRA Paper 44262, University Library of Munich, Germany.
    9. Pendharkar, Parag C., 2002. "A computational study on the performance of artificial neural networks under changing structural design and data distribution," European Journal of Operational Research, Elsevier, vol. 138(1), pages 155-177, April.
    10. R Fildes & K Nikolopoulos & S F Crone & A A Syntetos, 2008. "Forecasting and operational research: a review," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(9), pages 1150-1172, September.
    11. Lilia Maliar, 2015. "Assessing gains from parallel computation on a supercomputer," Economics Bulletin, AccessEcon, vol. 35(1), pages 159-167.
    12. du Jardin, Philippe, 2010. "Predicting bankruptcy using neural networks and other classification methods: the influence of variable selection techniques on model accuracy," MPRA Paper 44375, University Library of Munich, Germany.
    13. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    14. Virág, Miklós & Kristóf, Tamás, 2005. "Az első hazai csődmodell újraszámítása neurális hálók segítségével [Recalculation of the first Hungarian bankruptcy-prediction model using neural networks]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(2), pages 144-162.
    15. Gestel, Tony Van & Baesens, Bart & Suykens, Johan A.K. & Van den Poel, Dirk & Baestaens, Dirk-Emma & Willekens, Marleen, 2006. "Bayesian kernel based classification for financial distress detection," European Journal of Operational Research, Elsevier, vol. 172(3), pages 979-1003, August.
    16. Fan He & Xuansen He, 2019. "A Continuous Differentiable Wavelet Shrinkage Function for Economic Data Denoising," Computational Economics, Springer;Society for Computational Economics, vol. 54(2), pages 729-761, August.
    17. Boylu, Fidan & Aytug, Haldun & Koehler, Gary J., 2010. "Induction over constrained strategic agents," European Journal of Operational Research, Elsevier, vol. 203(3), pages 698-705, June.
    18. fernández, María t. Tascón & gutiérrez, Francisco J. Castaño, 2012. "Variables y Modelos Para La Identificación y Predicción Del Fracaso Empresarial: Revisión de La Investigación Empírica Reciente," Revista de Contabilidad - Spanish Accounting Review, Elsevier, vol. 15(1), pages 7-58.
    19. Óscar Trull & J. Carlos García-Díaz & Alicia Troncoso, 2019. "Application of Discrete-Interval Moving Seasonalities to Spanish Electricity Demand Forecasting during Easter," Energies, MDPI, vol. 12(6), pages 1-16, March.
    20. Mustafa Ozguven & Chong Yan Gao & Mohamed Yacine Si Tayeb, 2021. "The Utilization of Autoregressive Forecasting Models in Strategic Management," International Journal of Science and Business, IJSAB International, vol. 5(7), pages 170-185.

    More about this item

    Keywords

    Big data; Energy; Forecasting; Machine learning; Neural networks (PNNs);
    All these keywords.

    JEL classification:

    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:56:y:2020:i:2:d:10.1007_s10614-019-09960-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.