IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v392y2025ics0306261925007196.html

A novel encoding method for high-dimensional categorical data for electricity demand forecasting in distributed energy systems

Author

Listed:
  • Lee, HyoJae
  • Kameda, Keisuke
  • Manzhos, Sergei
  • Ihara, Manabu

Abstract

There has been a gradual shift towards distributed energy systems (DES) with variable renewable energy as the main power source. However, DES present difficulties of controlling the supply-demand balance due to frequent fluctuations in electricity demand caused by human activities in a small-scale system. While energy big data can drive accurate forecasting, it is challenging in the general case due to the increasing cost of the sensor installation and decreasing density of the data in a high-dimensional feature space. To address these problems, we have studied an accurate electricity demand forecasting method without additional sensor installation cost by proposing an encoding process named “Group Encoding” (GE). The GE process was applied to existing high-dimensional binary data of On/Off state, which is already collected in building energy management systems (BEMS). GE can also solve the problem of decreasing data density in a high-dimensional feature space by reducing the dimension without loss of critical information. The effectiveness of GE was evaluated by dealing with high time-resolution data which can be used for various forecast horizons. The forecasting performance improved by 74 % in terms of MAE when using GE, compared to a typical label encoding, for a 1-min ahead forecast. The top-level of electricity forecast accuracy, 3.27 % MAPE (mean absolute percentage error) in 60-min ahead forecasting, compared to the other forecasts for single building was achieved by using only GE processed data and electricity demand.

Suggested Citation

  • Lee, HyoJae & Kameda, Keisuke & Manzhos, Sergei & Ihara, Manabu, 2025. "A novel encoding method for high-dimensional categorical data for electricity demand forecasting in distributed energy systems," Applied Energy, Elsevier, vol. 392(C).
    • Handle: RePEc:eee:appene:v:392:y:2025:i:c:s0306261925007196
    DOI: 10.1016/j.apenergy.2025.125989
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925007196
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2025.125989?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Luis Hernandez & Carlos Baladrón & Javier M. Aguiar & Belén Carro & Antonio J. Sanchez-Esguevillas & Jaime Lloret, 2013. "Short-Term Load Forecasting for Microgrids Based on Artificial Neural Networks," Energies, MDPI, vol. 6(3), pages 1-24, March.
    2. Arash Moradzadeh & Sahar Zakeri & Maryam Shoaran & Behnam Mohammadi-Ivatloo & Fazel Mohammadi, 2020. "Short-Term Load Forecasting of Microgrid via Hybrid Support Vector Regression and Long Short-Term Memory Algorithms," Sustainability, MDPI, vol. 12(17), pages 1-17, August.
    3. Jaime Buitrago & Shihab Asfour, 2017. "Short-Term Forecasting of Electric Loads Using Nonlinear Autoregressive Artificial Neural Networks with Exogenous Vector Inputs," Energies, MDPI, vol. 10(1), pages 1-24, January.
    4. Hirth, Lion & Ueckerdt, Falko & Edenhofer, Ottmar, 2015. "Integration costs revisited – An economic framework for wind and solar variability," Renewable Energy, Elsevier, vol. 74(C), pages 925-939.
    5. Grund, B. & Hall, P., 1993. "On the Performance of Kernel Estimators for High-Dimensional, Sparse Binary Data," Journal of Multivariate Analysis, Elsevier, vol. 44(2), pages 321-344, February.
    6. Okubo, Tatsuya & Shimizu, Teruyuki & Hasegawa, Kei & Kikuchi, Yasunori & Manzhos, Sergei & Ihara, Manabu, 2023. "Factors affecting the techno-economic and environmental performance of on-grid distributed hydrogen energy storage systems with solar panels," Energy, Elsevier, vol. 269(C).
    7. Guo, Yabin & Wang, Jiangyu & Chen, Huanxin & Li, Guannan & Liu, Jiangyan & Xu, Chengliang & Huang, Ronggeng & Huang, Yao, 2018. "Machine learning-based thermal response time ahead energy demand prediction for building heating systems," Applied Energy, Elsevier, vol. 221(C), pages 16-27.
    8. Haydt, Gustavo & Leal, Vítor & Pina, André & Silva, Carlos A., 2011. "The relevance of the energy resource dynamics in the mid/long-term energy planning models," Renewable Energy, Elsevier, vol. 36(11), pages 3068-3074.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Price & Gordon Parker & Gail Vaucher & Robert Jane & Morris Berman, 2022. "Microgrid Energy Management during High-Stress Operation," Energies, MDPI, vol. 15(18), pages 1-11, September.
    2. Wei Sun & Chongchong Zhang, 2018. "A Hybrid BA-ELM Model Based on Factor Analysis and Similar-Day Approach for Short-Term Load Forecasting," Energies, MDPI, vol. 11(5), pages 1-18, May.
    3. Bojana Škrbić & Željko Đurišić, 2023. "Novel Planning Methodology for Spatially Optimized RES Development Which Minimizes Flexibility Requirements for Their Integration into the Power System," Energies, MDPI, vol. 16(7), pages 1-34, April.
    4. Østergaard, P.A. & Lund, H. & Thellufsen, J.Z. & Sorknæs, P. & Mathiesen, B.V., 2022. "Review and validation of EnergyPLAN," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    5. Sandrine Mathy & Patrick Criqui & Katharina Knoop & Manfred Fischedick & Sascha Samadi, 2016. "Uncertainty management and the dynamic adjustment of deep decarbonization pathways," Climate Policy, Taylor & Francis Journals, vol. 16(sup1), pages 47-62, June.
    6. Amal A. Al-Shargabi & Abdulbasit Almhafdy & Dina M. Ibrahim & Manal Alghieth & Francisco Chiclana, 2021. "Tuning Deep Neural Networks for Predicting Energy Consumption in Arid Climate Based on Buildings Characteristics," Sustainability, MDPI, vol. 13(22), pages 1-20, November.
    7. Alexandru Pîrjan & Simona-Vasilica Oprea & George Căruțașu & Dana-Mihaela Petroșanu & Adela Bâra & Cristina Coculescu, 2017. "Devising Hourly Forecasting Solutions Regarding Electricity Consumption in the Case of Commercial Center Type Consumers," Energies, MDPI, vol. 10(11), pages 1-36, October.
    8. Lisa Göransson & Caroline Granfeldt & Ann-Brith Strömberg, 2021. "Management of Wind Power Variations in Electricity System Investment Models," SN Operations Research Forum, Springer, vol. 2(2), pages 1-30, June.
    9. Oei, Pao-Yu & Burandt, Thorsten & Hainsch, Karlo & Löffler, Konstantin & Kemfert, Claudia, 2020. "Lessons from Modeling 100% Renewable Scenarios Using GENeSYS-MOD," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 9(1), pages 103-120.
    10. Timothy Praditia & Thilo Walser & Sergey Oladyshkin & Wolfgang Nowak, 2020. "Improving Thermochemical Energy Storage Dynamics Forecast with Physics-Inspired Neural Network Architecture," Energies, MDPI, vol. 13(15), pages 1-26, July.
    11. Alexis Tantet & Philippe Drobinski, 2021. "A Minimal System Cost Minimization Model for Variable Renewable Energy Integration: Application to France and Comparison to Mean-Variance Analysis," Energies, MDPI, vol. 14(16), pages 1-38, August.
    12. Xu, Jiuping & Wang, Fengjuan & Lv, Chengwei & Huang, Qian & Xie, Heping, 2018. "Economic-environmental equilibrium based optimal scheduling strategy towards wind-solar-thermal power generation system under limited resources," Applied Energy, Elsevier, vol. 231(C), pages 355-371.
    13. Silinto, Berino Francisco & van der Laag Yamu, Claudia & Zuidema, Christian & Faaij, André P.C., 2025. "Hybrid renewable energy systems for rural electrification in developing countries: A review on energy system models and spatial explicit modelling tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 207(C).
    14. Andrea Bonfiglio & Massimo Brignone & Marco Invernizzi & Alessandro Labella & Daniele Mestriner & Renato Procopio, 2017. "A Simplified Microgrid Model for the Validation of Islanded Control Logics," Energies, MDPI, vol. 10(8), pages 1-28, August.
    15. Salah Bouktif & Ali Fiaz & Ali Ouni & Mohamed Adel Serhani, 2018. "Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches †," Energies, MDPI, vol. 11(7), pages 1-20, June.
    16. Deetjen, Thomas A. & Martin, Henry & Rhodes, Joshua D. & Webber, Michael E., 2018. "Modeling the optimal mix and location of wind and solar with transmission and carbon pricing considerations," Renewable Energy, Elsevier, vol. 120(C), pages 35-50.
    17. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).
    18. Muideen Adegoke & Alaka Hafiz & Saheed Ajayi & Razak Olu-Ajayi, 2022. "Application of Multilayer Extreme Learning Machine for Efficient Building Energy Prediction," Energies, MDPI, vol. 15(24), pages 1-21, December.
    19. Li, Yanxue & Zhang, Xiaoyi & Gao, Weijun & Xu, Wenya & Wang, Zixuan, 2022. "Operational performance and grid-support assessment of distributed flexibility practices among residential prosumers under high PV penetration," Energy, Elsevier, vol. 238(PB).
    20. Biancardi, Andrea & Mendes, Carla & Staffell, Iain, 2024. "Battery electricity storage as both a complement and substitute for cross-border interconnection," Energy Policy, Elsevier, vol. 189(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:392:y:2025:i:c:s0306261925007196. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.