IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v327y2025ics0360544225018341.html
   My bibliography  Save this article

Dynamic fusion LSTM-Transformer for prediction in energy harvesting from human motions

Author

Listed:
  • Gong, Ying
  • Wang, Yongzheng
  • Xie, Yuanhang
  • Peng, Xuzhang
  • Peng, Yan
  • Zhang, Wenhua

Abstract

Time series forecasting is critical in many fields, especially for predicting electrical signal characteristics in power systems. Anticipating future fluctuations optimizes resource allocation, improves efficiency, ensures stability, and allows timely responses to issues. In the context of energy harvesting from human motion, forecasting time series data enables identifying movement modes and adjusting device parameters to maximize efficiency. While Long Short-Term Memory (LSTM) networks and Transformer models are effective for time series forecasting, they each have limitations: Transformer may miss local features, and LSTMs can overfit. This paper proposes a Dynamic Fusion LSTM-Transformer model, which combines LSTM’s short-term dependency capture with Transformer’s long-range modeling. The model uses a dynamic fusion mechanism to adjust the weights of LSTM and Transformer based on input data. Experimental results across five time series datasets demonstrate that our model outperforms standalone LSTM and Transformer models with improvements of 0.2-1.9% in MAE, 0.1-3.4% in MSE, and 1.0–3.2% in R2 metrics. Statistical significance tests (p<0.05) confirm the effectiveness of our dynamic fusion strategy.This study enhances time series prediction accuracy and provides new insights for improving energy conversion efficiency in wearable human motion devices.

Suggested Citation

  • Gong, Ying & Wang, Yongzheng & Xie, Yuanhang & Peng, Xuzhang & Peng, Yan & Zhang, Wenhua, 2025. "Dynamic fusion LSTM-Transformer for prediction in energy harvesting from human motions," Energy, Elsevier, vol. 327(C).
  • Handle: RePEc:eee:energy:v:327:y:2025:i:c:s0360544225018341
    DOI: 10.1016/j.energy.2025.136192
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225018341
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.136192?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Elham M. Al-Ali & Yassine Hajji & Yahia Said & Manel Hleili & Amal M. Alanzi & Ali H. Laatar & Mohamed Atri, 2023. "Solar Energy Production Forecasting Based on a Hybrid CNN-LSTM-Transformer Model," Mathematics, MDPI, vol. 11(3), pages 1-19, January.
    2. Ahmad, Tanveer & Chen, Huanxin, 2019. "Deep learning for multi-scale smart energy forecasting," Energy, Elsevier, vol. 175(C), pages 98-112.
    3. Zhou, Yanting & Ma, Zhongjing & Zhang, Jinhui & Zou, Suli, 2022. "Data-driven stochastic energy management of multi energy system using deep reinforcement learning," Energy, Elsevier, vol. 261(PA).
    4. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    5. Kaytez, Fazil, 2020. "A hybrid approach based on autoregressive integrated moving average and least-square support vector machine for long-term forecasting of net electricity consumption," Energy, Elsevier, vol. 197(C).
    6. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    7. Yao, Yuantao & Han, Te & Yu, Jie & Xie, Min, 2024. "Uncertainty-aware deep learning for reliable health monitoring in safety-critical energy systems," Energy, Elsevier, vol. 291(C).
    8. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    9. Ifaei, Pouya & Nazari-Heris, Morteza & Tayerani Charmchi, Amir Saman & Asadi, Somayeh & Yoo, ChangKyoo, 2023. "Sustainable energies and machine learning: An organized review of recent applications and challenges," Energy, Elsevier, vol. 266(C).
    10. Parbat, Debanjan & Chakraborty, Monisha, 2020. "A python based support vector regression model for prediction of COVID19 cases in India," Chaos, Solitons & Fractals, Elsevier, vol. 138(C).
    11. Vaia I. Kontopoulou & Athanasios D. Panagopoulos & Ioannis Kakkos & George K. Matsopoulos, 2023. "A Review of ARIMA vs. Machine Learning Approaches for Time Series Forecasting in Data Driven Networks," Future Internet, MDPI, vol. 15(8), pages 1-31, July.
    12. Jiang, Feifeng & Ma, Jun & Li, Zheng & Ding, Yuexiong, 2022. "Prediction of energy use intensity of urban buildings using the semi-supervised deep learning model," Energy, Elsevier, vol. 249(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moreno, Sinvaldo Rodrigues & Seman, Laio Oriel & Stefenon, Stefano Frizzo & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2024. "Enhancing wind speed forecasting through synergy of machine learning, singular spectral analysis, and variational mode decomposition," Energy, Elsevier, vol. 292(C).
    2. Lu, Yu & Xiang, Yue & Huang, Yuan & Yu, Bin & Weng, Liguo & Liu, Junyong, 2023. "Deep reinforcement learning based optimal scheduling of active distribution system considering distributed generation, energy storage and flexible load," Energy, Elsevier, vol. 271(C).
    3. Kumar, Anand & Priya, Bhawna & Srivastava, Samir K., 2021. "Response to the COVID-19: Understanding implications of government lockdown policies," Journal of Policy Modeling, Elsevier, vol. 43(1), pages 76-94.
    4. Labib Shami & Teddy Lazebnik, 2024. "Implementing Machine Learning Methods in Estimating the Size of the Non-observed Economy," Computational Economics, Springer;Society for Computational Economics, vol. 63(4), pages 1459-1476, April.
    5. Lim, Juin Yau & Safder, Usman & How, Bing Shen & Ifaei, Pouya & Yoo, Chang Kyoo, 2021. "Nationwide sustainable renewable energy and Power-to-X deployment planning in South Korea assisted with forecasting model," Applied Energy, Elsevier, vol. 283(C).
    6. Chen, Xiangmeng & Shafizadeh, Alireza & Shahbeik, Hossein & Nadian, Mohammad Hossein & Golvirdizadeh, Milad & Peng, Wanxi & Lam, Su Shiung & Tabatabaei, Meisam & Aghbashlo, Mortaza, 2025. "Enhanced bio-oil production from biomass catalytic pyrolysis using machine learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 209(C).
    7. Meixia Wang, 2024. "Predicting China’s Energy Consumption and CO 2 Emissions by Employing a Novel Grey Model," Energies, MDPI, vol. 17(21), pages 1-25, October.
    8. Waqar Muhammad Ashraf & Ghulam Moeen Uddin & Syed Muhammad Arafat & Sher Afghan & Ahmad Hassan Kamal & Muhammad Asim & Muhammad Haider Khan & Muhammad Waqas Rafique & Uwe Naumann & Sajawal Gul Niazi &, 2020. "Optimization of a 660 MW e Supercritical Power Plant Performance—A Case of Industry 4.0 in the Data-Driven Operational Management Part 1. Thermal Efficiency," Energies, MDPI, vol. 13(21), pages 1-33, October.
    9. Qu, Zhijian & Xu, Juan & Wang, Zixiao & Chi, Rui & Liu, Hanxin, 2021. "Prediction of electricity generation from a combined cycle power plant based on a stacking ensemble and its hyperparameter optimization with a grid-search method," Energy, Elsevier, vol. 227(C).
    10. Chen, Bin & Maung, Kenwin, 2023. "Time-varying forecast combination for high-dimensional data," Journal of Econometrics, Elsevier, vol. 237(2).
    11. Xiaojin Xie & Kangyang Luo & Zhixiang Yin & Guoqiang Wang, 2021. "Nonlinear Combinational Dynamic Transmission Rate Model and Its Application in Global COVID-19 Epidemic Prediction and Analysis," Mathematics, MDPI, vol. 9(18), pages 1-17, September.
    12. Lin, Zi & Liu, Xiaolei & Lao, Liyun & Liu, Hengxu, 2020. "Prediction of two-phase flow patterns in upward inclined pipes via deep learning," Energy, Elsevier, vol. 210(C).
    13. Wang, Yijun & Andreeva, Galina & Martin-Barragan, Belen, 2023. "Machine learning approaches to forecasting cryptocurrency volatility: Considering internal and external determinants," International Review of Financial Analysis, Elsevier, vol. 90(C).
    14. Ling, Jihong & Zhang, Bingyang & Dai, Na & Xing, Jincheng, 2023. "Coupling input feature construction methods and machine learning algorithms for hourly secondary supply temperature prediction," Energy, Elsevier, vol. 278(C).
    15. Xiong, Kang & Hu, Weihao & Cao, Di & Li, Sichen & Zhang, Guozhou & Liu, Wen & Huang, Qi & Chen, Zhe, 2023. "Coordinated energy management strategy for multi-energy hub with thermo-electrochemical effect based power-to-ammonia: A multi-agent deep reinforcement learning enabled approach," Renewable Energy, Elsevier, vol. 214(C), pages 216-232.
    16. Mehmet Ali Cakir & Ramazan Unlu & Sümeyra Cay Cakir & Petros Xanthopoulos, 2025. "Future of Clean Cooking Energy Access in Emerging Economies by 2030," SN Operations Research Forum, Springer, vol. 6(1), pages 1-30, March.
    17. Nazir, Kashif & Memon, Shazim Ali & Saurbayeva, Assemgul, 2024. "A novel framework for developing a machine learning-based forecasting model using multi-stage sensitivity analysis to predict the energy consumption of PCM-integrated building," Applied Energy, Elsevier, vol. 376(PA).
    18. Cardo-Miota, Javier & Trivedi, Rohit & Patra, Sandipan & Khadem, Shafi & Bahloul, Mohamed, 2024. "Data-driven approach for day-ahead System Non-Synchronous Penetration forecasting: A comprehensive framework, model development and analysis," Applied Energy, Elsevier, vol. 362(C).
    19. Rodrigo Moreira & Larissa Ferreira Rodrigues Moreira & Flávio Oliveira Silva, 2025. "Brazilian Selic Rate Forecasting with Deep Neural Networks," Computational Economics, Springer;Society for Computational Economics, vol. 65(3), pages 1319-1339, March.
    20. Rui Wang & Xiangyu Guo & Zhiqi Yan & Dongqi Chen, 2023. "Taylor DQN: An Optimization Method for Aircraft Engine Cleaning Schedule," Mathematics, MDPI, vol. 11(19), pages 1-22, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:327:y:2025:i:c:s0360544225018341. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.