Energy demand forecasting using adaptive ARFIMA based on a novel dynamic structural break detection framework

Forecasting energy demand has become increasingly important due to technological advances, especially new power systems and population growth. Accurate predictions of energy demand and supply are crucial for academics and policymakers. Also, energy consumption is non-stationary and dynamic in time, requiring an adaptive forecasting algorithm. This paper presents a new adaptive hybrid approach for energy time series forecasting using statistical methods. Some of the most popular energy demand time series applications are used to demonstrate the superiority of the proposed algorithm, which covers a wide range of critical energy demand forecasting situations at various scales. The paper's objectives are presented in three phases. In Phase I, ARFIMA is used to forecast the entire original time series as a statistical inspector and later for comparison. Although ARFIMA's fractionality feature helps to capture long and short-term memory behavior in time series, to be more adaptive and become close to a nonlinear algorithm that can handle non-stationarity, and Gaussian and non-Gaussian time series closely, a novel dynamic statistical structural break detection framework is developed, and used in phase II to identify the time series' change points and associated time indexes. Since time series are partitioned based on structural change detections, they approach one in terms of the Hurst exponent and exhibit pure long memory, which is ideal for ARFIMA modeling. Phase III captures non-stationary statistical properties and memory characteristics by applying adaptive ARFIMA modeling to segmented time series. Finally, the predicted partitions are concatenated. Various performance assessment metrics, e.g., Mean Absolute Percentage Error (MAPE), tested on the final achieved results show that the proposed adaptive algorithm outperforms the forecasting capabilities of the existing algorithms on the same energy demand time series used in the current paper. MAPE of the proposed approach for the four utilized real-life cases are 1.72%, 1.35%, 0.22%, and 4.4%, respectively. Therefore, the proposed model is a satisfactory method for energy demand forecasting due to its high accuracy.