IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v13y2025i16p2622-d1725443.html
   My bibliography  Save this article

A Hybrid Model of Multi-Head Attention Enhanced BiLSTM, ARIMA, and XGBoost for Stock Price Forecasting Based on Wavelet Denoising

Author

Listed:
  • Qingliang Zhao

    (College of Economics and Management, Beijing University of Chemical Technology, Beijing 100029, China)

  • Hongding Li

    (College of Economics and Management, Beijing University of Chemical Technology, Beijing 100029, China)

  • Xiao Liu

    (College of Economics and Management, Beijing University of Chemical Technology, Beijing 100029, China)

  • Yiduo Wang

    (School of Mathematics and Physics, Beijing University of Chemical Technology, Beijing 100029, China)

Abstract

The stock market plays a crucial role in the financial system, with its price movements reflecting macroeconomic trends. Due to the influence of multifaceted factors such as policy shifts and corporate performance, stock prices exhibit nonlinearity, high noise, and non-stationarity, making them difficult to model accurately using a single approach. To enhance forecasting accuracy, this study proposes a hybrid forecasting framework that integrates wavelet denoising, multi-head attention-based BiLSTM, ARIMA, and XGBoost. Wavelet transform is first employed to enhance data quality. The multi-head attention BiLSTM captures nonlinear temporal dependencies, ARIMA models linear trends in residuals, and XGBoost improves the recognition of complex patterns. The final prediction is obtained by combining the outputs of all models through an inverse-error weighted ensemble strategy. Using the CSI 300 Index as an empirical case, we construct a multidimensional feature set including both market and technical indicators. Experimental results show that the proposed model clearly outperforms individual models in terms of RMSE, MAE, MAPE, and R 2 . Ablation studies confirm the importance of each module in performance enhancement. The model also performs well on individual stock data (e.g., Fuyao Glass), demonstrating promising generalization ability. This research provides an effective solution for improving stock price forecasting accuracy and offers valuable insights for investment decision-making and market regulation.

Suggested Citation

  • Qingliang Zhao & Hongding Li & Xiao Liu & Yiduo Wang, 2025. "A Hybrid Model of Multi-Head Attention Enhanced BiLSTM, ARIMA, and XGBoost for Stock Price Forecasting Based on Wavelet Denoising," Mathematics, MDPI, vol. 13(16), pages 1-21, August.
  • Handle: RePEc:gam:jmathe:v:13:y:2025:i:16:p:2622-:d:1725443
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/13/16/2622/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/13/16/2622/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Song, Weijiang & Zhao, Mengyang & Yu, Juan, 2025. "Price distortion on market resource allocation efficiency: A DID analysis based on national-level big data comprehensive pilot zones," International Review of Economics & Finance, Elsevier, vol. 102(C).
    2. Lin, Boqiang & Bai, Rui, 2022. "Machine learning approaches for explaining determinants of the debt financing in heavy-polluting enterprises," Finance Research Letters, Elsevier, vol. 44(C).
    3. Vaia I. Kontopoulou & Athanasios D. Panagopoulos & Ioannis Kakkos & George K. Matsopoulos, 2023. "A Review of ARIMA vs. Machine Learning Approaches for Time Series Forecasting in Data Driven Networks," Future Internet, MDPI, vol. 15(8), pages 1-31, July.
    4. Lihki Rubio & Adriana Palacio Pinedo & Adriana Mejía Castaño & Filipe Ramos, 2023. "Forecasting volatility by using wavelet transform, ARIMA and GARCH models," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 13(3), pages 803-830, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gang Kou & Yang Lu, 2025. "FinTech: a literature review of emerging financial technologies and applications," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 11(1), pages 1-34, December.
    2. Gong, Ying & Wang, Yongzheng & Xie, Yuanhang & Peng, Xuzhang & Peng, Yan & Zhang, Wenhua, 2025. "Dynamic fusion LSTM-Transformer for prediction in energy harvesting from human motions," Energy, Elsevier, vol. 327(C).
    3. Reza Rezaiy & Ani Shabri, 2024. "Improving Drought Prediction Accuracy: A Hybrid EEMD and Support Vector Machine Approach with Standardized Precipitation Index," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 38(13), pages 5255-5277, October.
    4. Moreno, Sinvaldo Rodrigues & Seman, Laio Oriel & Stefenon, Stefano Frizzo & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2024. "Enhancing wind speed forecasting through synergy of machine learning, singular spectral analysis, and variational mode decomposition," Energy, Elsevier, vol. 292(C).
    5. Dimitris Kastoris & Dimitris Papadopoulos & Konstantinos Giotopoulos, 2025. "Neural Network-Informed Lotka–Volterra Dynamics for Cryptocurrency Market Analysis," Future Internet, MDPI, vol. 17(8), pages 1-22, July.
    6. Zhiyong Guo & Fangzheng Wei & Wenkai Qi & Qiaoli Han & Huiyuan Liu & Xiaomei Feng & Minghui Zhang, 2024. "A Time Series Prediction Model for Wind Power Based on the Empirical Mode Decomposition–Convolutional Neural Network–Three-Dimensional Gated Neural Network," Sustainability, MDPI, vol. 16(8), pages 1-20, April.
    7. Adel S. Aldosary & Baqer Al-Ramadan & Abdulla Al Kafy & Hamad Ahmed Altuwaijri & Zullyadini A. Rahaman, 2025. "Forecasting climate risk and heat stress hazards in arid ecosystems: Machine learning and ensemble models for specific humidity prediction in Dammam, Saudi Arabia," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 121(8), pages 9281-9309, May.
    8. Theo Berger, 2025. "On the information content of explainable artificial intelligence for quantitative approaches in finance," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 47(1), pages 177-203, March.
    9. Kovvuri, Veera Raghava Reddy & Fu, Hsuan & Fan, Xiuyi & Seisenberger, Monika, 2023. "Fund performance evaluation with explainable artificial intelligence," Finance Research Letters, Elsevier, vol. 58(PB).
    10. Ummara Razi & Calvin W. H. Cheong & Sahar Afshan & Arshian Sharif, 2025. "The ripple effects of energy price volatility on equity and debt markets: a Morlet wavelet analysis," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 15(1), pages 197-223, March.
    11. Vienna N. Katambire & Richard Musabe & Alfred Uwitonze & Didacienne Mukanyiligira, 2023. "Forecasting the Traffic Flow by Using ARIMA and LSTM Models: Case of Muhima Junction," Forecasting, MDPI, vol. 5(4), pages 1-13, November.
    12. Muhammad Ansar Majeed & Tanveer Ahsan & Ammar Ali Gull, 2024. "Does corruption sand the wheels of sustainable development? Evidence through green innovation," Business Strategy and the Environment, Wiley Blackwell, vol. 33(5), pages 4626-4651, July.
    13. Daniel Musafiri Balungu & Avinash Kumar, 2024. "Forecasting The Economic Growth of Sverdlovsk Region: A Comparative Analysis of Machine Learning, Linear Regression and Autoregressive Models," Journal of Applied Economic Research, Graduate School of Economics and Management, Ural Federal University, vol. 23(3), pages 674-695.
    14. Suryo Adi Rakhmawan & Tahir Mahmood & Nasir Abbas, 2025. "Deep learning-based mortality surveillance: implications for healthcare policy and practice," Journal of Population Research, Springer, vol. 42(1), pages 1-25, March.
    15. Gabriela Mayumi Saiki & André Luiz Marques Serrano & Gabriel Arquelau Pimenta Rodrigues & Guilherme Dantas Bispo & Vinícius Pereira Gonçalves & Clóvis Neumann & Robson de Oliveira Albuquerque & Carlos, 2024. "Application of Non-Parametric and Forecasting Models for the Sustainable Development of Energy Resources in Brazil," Resources, MDPI, vol. 13(11), pages 1-29, October.
    16. Berger, Theo, 2023. "Explainable artificial intelligence and economic panel data: A study on volatility spillover along the supply chains," Finance Research Letters, Elsevier, vol. 54(C).
    17. Chang, Annie Y.J. & Wang, Xudong & Sharafi, Mojdeh & Miranda-Moreno, Luis & Sun, Lijun, 2024. "Headwind or tailwind? The evolution of bike-sharing and ride-hailing demand during the COVID-19 pandemic," Journal of Transport Geography, Elsevier, vol. 118(C).
    18. Kamrul Hasan Tuhin & Ashadun Nobi & Mahmudul Hasan Rakib & Jae Woo Lee, 2025. "Long short-term memory autoencoder based network of financial indices," Palgrave Communications, Palgrave Macmillan, vol. 12(1), pages 1-15, December.
    19. Xiaowei Ding & Ruxu Jing & Kaikun Wu & Maria V. Petrovskaya & Zhikun Li & Alina Steblyanskaya & Lyu Ye & Xiaotong Wang & Vasiliy M. Makarov, 2022. "The Impact Mechanism of Green Credit Policy on the Sustainability Performance of Heavily Polluting Enterprises—Based on the Perspectives of Technological Innovation Level and Credit Resource Allocatio," IJERPH, MDPI, vol. 19(21), pages 1-26, November.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:16:p:2622-:d:1725443. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.