IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v327y2025ics0360544225018341.html

Dynamic fusion LSTM-Transformer for prediction in energy harvesting from human motions

Author

Listed:
  • Gong, Ying
  • Wang, Yongzheng
  • Xie, Yuanhang
  • Peng, Xuzhang
  • Peng, Yan
  • Zhang, Wenhua

Abstract

Time series forecasting is critical in many fields, especially for predicting electrical signal characteristics in power systems. Anticipating future fluctuations optimizes resource allocation, improves efficiency, ensures stability, and allows timely responses to issues. In the context of energy harvesting from human motion, forecasting time series data enables identifying movement modes and adjusting device parameters to maximize efficiency. While Long Short-Term Memory (LSTM) networks and Transformer models are effective for time series forecasting, they each have limitations: Transformer may miss local features, and LSTMs can overfit. This paper proposes a Dynamic Fusion LSTM-Transformer model, which combines LSTM’s short-term dependency capture with Transformer’s long-range modeling. The model uses a dynamic fusion mechanism to adjust the weights of LSTM and Transformer based on input data. Experimental results across five time series datasets demonstrate that our model outperforms standalone LSTM and Transformer models with improvements of 0.2-1.9% in MAE, 0.1-3.4% in MSE, and 1.0–3.2% in R2 metrics. Statistical significance tests (p<0.05) confirm the effectiveness of our dynamic fusion strategy.This study enhances time series prediction accuracy and provides new insights for improving energy conversion efficiency in wearable human motion devices.

Suggested Citation

  • Gong, Ying & Wang, Yongzheng & Xie, Yuanhang & Peng, Xuzhang & Peng, Yan & Zhang, Wenhua, 2025. "Dynamic fusion LSTM-Transformer for prediction in energy harvesting from human motions," Energy, Elsevier, vol. 327(C).
  • Handle: RePEc:eee:energy:v:327:y:2025:i:c:s0360544225018341
    DOI: 10.1016/j.energy.2025.136192
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225018341
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.136192?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Ifaei, Pouya & Nazari-Heris, Morteza & Tayerani Charmchi, Amir Saman & Asadi, Somayeh & Yoo, ChangKyoo, 2023. "Sustainable energies and machine learning: An organized review of recent applications and challenges," Energy, Elsevier, vol. 266(C).
    2. Elham M. Al-Ali & Yassine Hajji & Yahia Said & Manel Hleili & Amal M. Alanzi & Ali H. Laatar & Mohamed Atri, 2023. "Solar Energy Production Forecasting Based on a Hybrid CNN-LSTM-Transformer Model," Mathematics, MDPI, vol. 11(3), pages 1-19, January.
    3. Ahmad, Tanveer & Chen, Huanxin, 2019. "Deep learning for multi-scale smart energy forecasting," Energy, Elsevier, vol. 175(C), pages 98-112.
    4. Kaytez, Fazil, 2020. "A hybrid approach based on autoregressive integrated moving average and least-square support vector machine for long-term forecasting of net electricity consumption," Energy, Elsevier, vol. 197(C).
    5. Parbat, Debanjan & Chakraborty, Monisha, 2020. "A python based support vector regression model for prediction of COVID19 cases in India," Chaos, Solitons & Fractals, Elsevier, vol. 138(C).
    6. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    7. Zhou, Yanting & Ma, Zhongjing & Zhang, Jinhui & Zou, Suli, 2022. "Data-driven stochastic energy management of multi energy system using deep reinforcement learning," Energy, Elsevier, vol. 261(PA).
    8. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    9. Vaia I. Kontopoulou & Athanasios D. Panagopoulos & Ioannis Kakkos & George K. Matsopoulos, 2023. "A Review of ARIMA vs. Machine Learning Approaches for Time Series Forecasting in Data Driven Networks," Future Internet, MDPI, vol. 15(8), pages 1-31, July.
    10. Yao, Yuantao & Han, Te & Yu, Jie & Xie, Min, 2024. "Uncertainty-aware deep learning for reliable health monitoring in safety-critical energy systems," Energy, Elsevier, vol. 291(C).
    11. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    12. Jiang, Feifeng & Ma, Jun & Li, Zheng & Ding, Yuexiong, 2022. "Prediction of energy use intensity of urban buildings using the semi-supervised deep learning model," Energy, Elsevier, vol. 249(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ren Fang-Rong & Wu Tao-Feng & Zhang Qing-Qing, 2025. "Ecological–environmental transformation efficiency in China: regional disparities, modeling challenges, and prospects for long-term sustainability governance," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-20, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moreno, Sinvaldo Rodrigues & Seman, Laio Oriel & Stefenon, Stefano Frizzo & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2024. "Enhancing wind speed forecasting through synergy of machine learning, singular spectral analysis, and variational mode decomposition," Energy, Elsevier, vol. 292(C).
    2. Lu, Yu & Xiang, Yue & Huang, Yuan & Yu, Bin & Weng, Liguo & Liu, Junyong, 2023. "Deep reinforcement learning based optimal scheduling of active distribution system considering distributed generation, energy storage and flexible load," Energy, Elsevier, vol. 271(C).
    3. Wang, Shuaibing & Lin, Haitao & Abed, Azher M. & Mahariq, Ibrahim & Ayed, Hamdi & Mouldi, Abir & Lin, Zhixiang, 2024. "Life cycle analysis of biowaste-to- biogas/biomethane processes: Cost and environmental assessment of four different biowaste scenarios organic fraction of municipal solid waste and secondary sewage sludge)," Energy, Elsevier, vol. 308(C).
    4. Kumar, Anand & Priya, Bhawna & Srivastava, Samir K., 2021. "Response to the COVID-19: Understanding implications of government lockdown policies," Journal of Policy Modeling, Elsevier, vol. 43(1), pages 76-94.
    5. Labib Shami & Teddy Lazebnik, 2024. "Implementing Machine Learning Methods in Estimating the Size of the Non-observed Economy," Computational Economics, Springer;Society for Computational Economics, vol. 63(4), pages 1459-1476, April.
    6. Lim, Juin Yau & Safder, Usman & How, Bing Shen & Ifaei, Pouya & Yoo, Chang Kyoo, 2021. "Nationwide sustainable renewable energy and Power-to-X deployment planning in South Korea assisted with forecasting model," Applied Energy, Elsevier, vol. 283(C).
    7. Todd E. Clark & Florian Huber & Gary Koop & Massimiliano Marcellino, 2022. "Forecasting US Inflation Using Bayesian Nonparametric Models," Papers 2202.13793, arXiv.org.
    8. Tostes, Bernardo & Henriques, Sofia T. & Brockway, Paul E. & Heun, Matthew Kuperus & Domingos, Tiago & Sousa, Tânia, 2024. "On the right track? Energy use, carbon emissions, and intensities of world rail transportation, 1840–2020," Applied Energy, Elsevier, vol. 367(C).
    9. Qingliang Zhao & Hongding Li & Xiao Liu & Yiduo Wang, 2025. "A Hybrid Model of Multi-Head Attention Enhanced BiLSTM, ARIMA, and XGBoost for Stock Price Forecasting Based on Wavelet Denoising," Mathematics, MDPI, vol. 13(16), pages 1-21, August.
    10. Chen, Dongyu & Lin, Xiaojie & Qiao, Yiyuan, 2025. "Perspectives for artificial intelligence in sustainable energy systems," Energy, Elsevier, vol. 318(C).
    11. Chen, Xiangmeng & Shafizadeh, Alireza & Shahbeik, Hossein & Nadian, Mohammad Hossein & Golvirdizadeh, Milad & Peng, Wanxi & Lam, Su Shiung & Tabatabaei, Meisam & Aghbashlo, Mortaza, 2025. "Enhanced bio-oil production from biomass catalytic pyrolysis using machine learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 209(C).
    12. Meixia Wang, 2024. "Predicting China’s Energy Consumption and CO 2 Emissions by Employing a Novel Grey Model," Energies, MDPI, vol. 17(21), pages 1-25, October.
    13. Todd E. Clark & Florian Huber & Gary Koop & Massimiliano Marcellino & Michael Pfarrhofer, 2023. "Tail Forecasting With Multivariate Bayesian Additive Regression Trees," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 979-1022, August.
    14. Fei Lu & Feng Ma & Elie Bouri, 2024. "Stock market volatility predictability: new evidence from energy consumption," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-17, December.
    15. Zhou, Shiqi & Lin, Meng & He, Jun & Wu, Yuzeng & Wang, Xu, 2025. "Unsupervised clustering research of nuclear power plants under unlabeled unknown fault diagnosis scenario," Energy, Elsevier, vol. 326(C).
    16. Yin, Linfei & Ge, Wei & Liu, Rongkun, 2025. "Golden eagle optimization algorithm embedded in gated Kolmogorov-Arnold network for transient stability preventive control of power systems," Energy, Elsevier, vol. 318(C).
    17. Waqar Muhammad Ashraf & Ghulam Moeen Uddin & Syed Muhammad Arafat & Sher Afghan & Ahmad Hassan Kamal & Muhammad Asim & Muhammad Haider Khan & Muhammad Waqas Rafique & Uwe Naumann & Sajawal Gul Niazi &, 2020. "Optimization of a 660 MW e Supercritical Power Plant Performance—A Case of Industry 4.0 in the Data-Driven Operational Management Part 1. Thermal Efficiency," Energies, MDPI, vol. 13(21), pages 1-33, October.
    18. Qu, Zhijian & Xu, Juan & Wang, Zixiao & Chi, Rui & Liu, Hanxin, 2021. "Prediction of electricity generation from a combined cycle power plant based on a stacking ensemble and its hyperparameter optimization with a grid-search method," Energy, Elsevier, vol. 227(C).
    19. Atif Maqbool Khan & Artur Wyrwa, 2024. "A Survey of Quantitative Techniques in Electricity Consumption—A Global Perspective," Energies, MDPI, vol. 17(19), pages 1-38, September.
    20. Md Tariqul Islam & M. J. Hossain, 2023. "Artificial Intelligence for Hosting Capacity Analysis: A Systematic Literature Review," Energies, MDPI, vol. 16(4), pages 1-33, February.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:327:y:2025:i:c:s0360544225018341. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.