IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v401y2025ipas0306261925013480.html

TCN-BiLSTM-CE: An interdisciplinary approach for missing energy data imputation by contextual inference

Author

Listed:
  • Yu, Mengbo
  • Neubauer, Alexander
  • Brandt, Stefan
  • Kriegel, Martin

Abstract

Energy data frequently contain missing values, which complicate accurate analysis and informed decision-making. Since energy load data are generally in the form of time series, the problem of reconstructing missing data in energy load data can also be translated into the problem of reconstructing missing data in time series data. Inspired by image-based techniques, this study introduces a novel approach for imputing missing energy data using a Context Encoder (CE), in order to translate the original network from the task of reconstructing the missing parts in image data to the task of reconstructing missing data in time series data, using the complete data before and after the time period in which the missing data appears as the contextual reference to infer the missing data in the missing time period. Two structures commonly used in time series data processing, TCN and Bi-LSTM, were introduced to learn the latent representation in latent space, in order to extract the features of bidirectional contextual information, causal relationships and long-term dependency in time series data. After conducting separate experiments for electrical load data and heat load data, we demonstrate the effectiveness of our proposed method on energy data for different energy types. Compared to other baseline methods, the Normalized Root Mean Squared Error (NRMSE) between original and reconstructed electric load data and heat load data reduced from 7.58 %–81.20 % and 4.26%–65.74%, respectively, fully demonstrating the potential of using the proposed method for reconstructing the missing energy load data.

Suggested Citation

  • Yu, Mengbo & Neubauer, Alexander & Brandt, Stefan & Kriegel, Martin, 2025. "TCN-BiLSTM-CE: An interdisciplinary approach for missing energy data imputation by contextual inference," Applied Energy, Elsevier, vol. 401(PA).
  • Handle: RePEc:eee:appene:v:401:y:2025:i:pa:s0306261925013480
    DOI: 10.1016/j.apenergy.2025.126618
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925013480
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.126618?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Enrica De Cian & Elisa Lanzi & Roberto Roson, 2013. "Seasonal temperature variations and energy demand," Climatic Change, Springer, vol. 116(3), pages 805-825, February.
    2. Cancelo, José Ramón & Espasa, Antoni & Grafe, Rosmarie, 2008. "Forecasting the electricity load from one day to one week ahead for the Spanish system operator," International Journal of Forecasting, Elsevier, vol. 24(4), pages 588-602.
    3. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2023. "A novel short-term multi-energy load forecasting method for integrated energy system based on feature separation-fusion technology and improved CNN," Applied Energy, Elsevier, vol. 351(C).
    4. He, Shaokun & Guo, Shenglian & Yin, Jiabo & Liao, Zhen & Li, He & Liu, Zhangjun, 2022. "A novel impoundment framework for a mega reservoir system in the upper Yangtze River basin," Applied Energy, Elsevier, vol. 305(C).
    5. Do, Linh Phuong Catherine & Lyócsa, Štefan & Molnár, Peter, 2021. "Residual electricity demand: An empirical investigation," Applied Energy, Elsevier, vol. 283(C).
    6. Demirhan, Haydar & Renwick, Zoe, 2018. "Missing value imputation for short to mid-term horizontal solar irradiance data," Applied Energy, Elsevier, vol. 225(C), pages 998-1012.
    7. Yunzhu Gao & Jun Wang & Lin Guo & Hong Peng, 2024. "Short-Term Photovoltaic Power Prediction Using Nonlinear Spiking Neural P Systems," Sustainability, MDPI, vol. 16(4), pages 1-18, February.
    8. Khan, Taimoor & Choi, Chang, 2025. "Attention enhanced dual stream network with advanced feature selection for power forecasting," Applied Energy, Elsevier, vol. 377(PC).
    9. Zhang, Mingyue & Han, Yang & Wang, Chaoyang & Yang, Ping & Wang, Congling & Zalhaf, Amr S., 2024. "Ultra-short-term photovoltaic power prediction based on similar day clustering and temporal convolutional network with bidirectional long short-term memory model: A case study using DKASC data," Applied Energy, Elsevier, vol. 375(C).
    10. Jin, Haiyan & Ru, Rui & Cai, Lei & Meng, Jinhao & Wang, Bin & Peng, Jichang & Yang, Shengxiang, 2025. "A synthetic data generation method and evolutionary transformer model for degradation trajectory prediction in lithium-ion batteries," Applied Energy, Elsevier, vol. 377(PD).
    11. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    12. Semmelmann, Leo & Hertel, Matthias & Kircher, Kevin J. & Mikut, Ralf & Hagenmeyer, Veit & Weinhardt, Christof, 2024. "The impact of heat pumps on day-ahead energy community load forecasting," Applied Energy, Elsevier, vol. 368(C).
    13. Kan, Xiaoming & Reichenberg, Lina & Hedenus, Fredrik, 2021. "The impacts of the electricity demand pattern on electricity system cost and the electricity supply mix: A comprehensive modeling analysis for Europe," Energy, Elsevier, vol. 235(C).
    14. Zhang, Tianren & Huang, Yuping & Liao, Hui & Liang, Yu, 2023. "A hybrid electric vehicle load classification and forecasting approach based on GBDT algorithm and temporal convolutional network," Applied Energy, Elsevier, vol. 351(C).
    15. Brudermueller, Tobias & Kreft, Markus & Fleisch, Elgar & Staake, Thorsten, 2023. "Large-scale monitoring of residential heat pump cycling using smart meter data," Applied Energy, Elsevier, vol. 350(C).
    16. Türkoğlu, A. Selim & Erkmen, Burcu & Eren, Yavuz & Erdinç, Ozan & Küçükdemiral, İbrahim, 2024. "Integrated Approaches in Resilient Hierarchical Load Forecasting via TCN and Optimal Valley Filling Based Demand Response Application," Applied Energy, Elsevier, vol. 360(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Tianhao & Li, Fangning & Zhang, Dongdong & Shan, Linke & Zhu, Hongyu & Du, Pengcheng & Jiang, Meihui & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Kong, Fannie, 2026. "Intelligent load forecasting technologies for diverse scenarios in the new power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PD).
    2. Huber, Jakob & Stuckenschmidt, Heiner, 2020. "Daily retail demand forecasting using machine learning with emphasis on calendric special days," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1420-1438.
    3. Verstraete, Gylian & Aghezzaf, El-Houssaine & Desmet, Bram, 2019. "A data-driven framework for predicting weather impact on high-volume low-margin retail products," Journal of Retailing and Consumer Services, Elsevier, vol. 48(C), pages 169-177.
    4. Dahiru A Bala & Mohammed Shuaibu, 2024. "Forecasting United Kingdom's energy consumption using machine learning and hybrid approaches," Energy & Environment, , vol. 35(3), pages 1493-1531, May.
    5. Guo, Xifeng & Liu, Rongqian & Wang, Yonggang & Ning, Yi & Qu, Qiuxia & Wang, Zedi & Cong, Wenzhuo, 2025. "Short-term power load forecasting for estate-level buildings considering multilevel feature extraction and adaptive fusion," Energy, Elsevier, vol. 337(C).
    6. Guo, Hongxia & Chen, Lingxuan & Wang, Zhaocai & Li, Lin, 2025. "Day-ahead prediction of electric vehicle charging demand based on quadratic decomposition and dual attention mechanisms," Applied Energy, Elsevier, vol. 381(C).
    7. Cruz E. Borges & Yoseba K. Penya & Iván Fernández & Juan Prieto & Oscar Bretos, 2013. "Assessing Tolerance-Based Robust Short-Term Load Forecasting in Buildings," Energies, MDPI, vol. 6(4), pages 1-20, April.
    8. repec:prg:jnlcfu:v:2022:y:2022:i:1:id:572 is not listed on IDEAS
    9. Potthoff, Ugne & Brudermueller, Tobias & Hopf, Konstantin & Wortmann, Felix, 2025. "Optimization of heating curves for heat pumps in operation: Outdoor temperature ranges for energy-efficient heating curve shifts," Applied Energy, Elsevier, vol. 389(C).
    10. Cheng, Fang & Liu, Hui, 2024. "Multi-step electric vehicles charging loads forecasting: An autoformer variant with feature extraction, frequency enhancement, and error correction blocks," Applied Energy, Elsevier, vol. 376(PB).
    11. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    12. Andrikopoulos, Andreas & Merika, Anna & Stoupos, Nikolaos, 2025. "The effect of oil prices on the US shipping stock prices: The mediating role of freight rates and economic indicators," Journal of Commodity Markets, Elsevier, vol. 38(C).
    13. Florian Ziel & Rick Steinert & Sven Husmann, 2014. "Efficient Modeling and Forecasting of the Electricity Spot Price," Papers 1402.7027, arXiv.org, revised Oct 2014.
    14. Dima, Bogdan & Dima, Ştefana Maria & Ioan, Roxana, 2025. "The short-run impact of investor expectations’ past volatility on current predictions: The case of VIX," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 98(C).
    15. Ling Tang & Chengyuan Zhang & Tingfei Li & Ling Li, 2021. "A novel BEMD-based method for forecasting tourist volume with search engine data," Tourism Economics, , vol. 27(5), pages 1015-1038, August.
    16. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    17. Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    18. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    19. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    20. Jeon, Yunho & Seong, Sihyeon, 2022. "Robust recurrent network model for intermittent time-series forecasting," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1415-1425.
    21. Paulo Júlio & Pedro M. Esperança, 2012. "Evaluating the forecast quality of GDP components: An application to G7," GEE Papers 0047, Gabinete de Estratégia e Estudos, Ministério da Economia, revised Apr 2012.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:401:y:2025:i:pa:s0306261925013480. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.