IDEAS home Printed from https://ideas.repec.org/a/wly/jforec/v44y2025i1p216-241.html

Forecasting house price index with social media sentiment: A decomposition–ensemble approach

Author

Listed:
  • Jin Shao
  • Lean Yu
  • Jingke Hong
  • Xianzhu Wang

Abstract

Social media sentiment influences housing market trading and policy‐making in China. To explore the multiscale relationship between social media sentiment and house price index (HPI) and improve prediction performance, a sentiment‐based decomposition–ensemble approach is proposed for HPI forecasting. In this approach, five steps, that is, sentiment analysis for massive Weibo textual reviews about house prices, data decomposition for bivariate time series integrated by HPI and the sentiment index (SI), data smoothing for high‐frequency components, component reconstruction for all individual modes, and all components prediction and ensemble, are involved. For verification, the National‐level and two city‐level house price indices are used as the sample data. The empirical results illustrate that the proposed approach can achieve better performance than all considered benchmark models at multi‐step‐ahead prediction horizons, indicating that it can be used as an effective tool for HPI forecasting.

Suggested Citation

  • Jin Shao & Lean Yu & Jingke Hong & Xianzhu Wang, 2025. "Forecasting house price index with social media sentiment: A decomposition–ensemble approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(1), pages 216-241, January.
    • Handle: RePEc:wly:jforec:v:44:y:2025:i:1:p:216-241
    DOI: 10.1002/for.3188
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/for.3188
    Download Restriction: no
    File URL: https://libkey.io/10.1002/for.3188?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bangzhu Zhu & Xuetao Shi & Julien Chevallier & Ping Wang & Yi‐Ming Wei, 2016. "An Adaptive Multiscale Ensemble Learning Paradigm for Nonstationary and Nonlinear Energy Price Time Series Forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(7), pages 633-651, November.
    2. Cindy K Soo, 2018. "Quantifying Sentiment with News Media across Local Housing Markets," The Review of Financial Studies, Society for Financial Studies, vol. 31(10), pages 3689-3719.
    3. Huang, Yanmei & Hasan, Najmul & Deng, Changrui & Bao, Yukun, 2022. "Multivariate empirical mode decomposition based hybrid model for day-ahead peak load forecasting," Energy, Elsevier, vol. 239(PC).
    4. Xiaolong Liu, 2013. "Spatial and Temporal Dependence in House Price Prediction," The Journal of Real Estate Finance and Economics, Springer, vol. 47(2), pages 341-369, August.
    5. Oguzhan Cepni & Rangan Gupta & Yigit Onay, 2022. "The role of investor sentiment in forecasting housing returns in China: A machine learning approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1725-1740, December.
    6. Rapach, David E. & Strauss, Jack K., 2009. "Differences in housing price forecastability across US states," International Journal of Forecasting, Elsevier, vol. 25(2), pages 351-372.
    7. David A. Mascio & Marat Molyboga & Frank J. Fabozzi, 2023. "The battle of the factors: Macroeconomic variables or investor sentiment?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(8), pages 2280-2291, December.
    8. Wei, Yu & Cao, Yang, 2017. "Forecasting house prices using dynamic model averaging approach: Evidence from China," Economic Modelling, Elsevier, vol. 61(C), pages 147-155.
    9. Zhang, Chuan & Tian, Yu-Xin & Fan, Zhi-Ping, 2022. "Forecasting sales using online review and search engine data: A method based on PCA–DSFOA–BPNN," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1005-1024.
    10. Tian, Yu-Xin & Zhang, Chuan, 2023. "An end-to-end deep learning model for solving data-driven newsvendor problem with accessibility to textual review data," International Journal of Production Economics, Elsevier, vol. 265(C).
    11. Yu, Lean & Ma, Yueming & Ma, Mengyao, 2021. "An effective rolling decomposition-ensemble model for gasoline consumption forecasting," Energy, Elsevier, vol. 222(C).
    12. repec:bla:jfinan:v:59:y:2004:i:3:p:1259-1294 is not listed on IDEAS
    13. Wang, Cong & Zhang, Hongli & Ma, Ping, 2020. "Wind power forecasting based on singular spectrum analysis and a new hybrid Laguerre neural network," Applied Energy, Elsevier, vol. 259(C).
    14. Hong, Yun & Li, Yi, 2020. "Housing prices and investor sentiment dynamics: Evidence from China using a wavelet approach," Finance Research Letters, Elsevier, vol. 35(C).
    15. Zhao, Lu-Tao & Zheng, Zhi-Yi & Wei, Yi-Ming, 2023. "Forecasting oil inventory changes with Google trends: A hybrid wavelet decomposer and ARDL-SVR ensemble model," Energy Economics, Elsevier, vol. 120(C).
    16. Yu, Lean & Wang, Shouyang & Lai, Kin Keung, 2008. "Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm," Energy Economics, Elsevier, vol. 30(5), pages 2623-2635, September.
    17. Li, Yuze & Jiang, Shangrong & Li, Xuerong & Wang, Shouyang, 2021. "The role of news sentiment in oil futures returns and volatility forecasting: Data-decomposition based deep learning approach," Energy Economics, Elsevier, vol. 95(C).
    18. Yu, Lean & Zhao, Yaqing & Tang, Ling & Yang, Zebin, 2019. "Online big data-driven oil consumption forecasting with Google trends," International Journal of Forecasting, Elsevier, vol. 35(1), pages 213-223.
    19. Shao, Jin & Hong, Jingke & Wang, Xianzhu & Yan, Xiaochen, 2023. "The relationship between social media sentiment and house prices in China: Evidence from text mining and wavelet analysis," Finance Research Letters, Elsevier, vol. 57(C).
    20. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    21. George Milunovich, 2020. "Forecasting Australia's real house price index: A comparison of time series and machine learning methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(7), pages 1098-1118, November.
    22. Wang, Jue & Athanasopoulos, George & Hyndman, Rob J. & Wang, Shouyang, 2018. "Crude oil price forecasting based on internet concern using an extreme learning machine," International Journal of Forecasting, Elsevier, vol. 34(4), pages 665-677.
    23. Xu, Kunliang & Wang, Weiqing, 2023. "Limited information limits accuracy: Whether ensemble empirical mode decomposition improves crude oil spot price prediction?," International Review of Financial Analysis, Elsevier, vol. 87(C).
    24. Yang, Xin & Pan, Bing & Evans, James A. & Lv, Benfu, 2015. "Forecasting Chinese tourist volume with search engine data," Tourism Management, Elsevier, vol. 46(C), pages 386-397.
    25. Sun, Shaolong & Sun, Yuying & Wang, Shouyang & Wei, Yunjie, 2018. "Interval decomposition ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 76(C), pages 274-287.
    26. Herrera, Gabriel Paes & Constantino, Michel & Su, Jen-Je & Naranpanawa, Athula, 2022. "Renewable energy stocks forecast using Twitter investor sentiment and deep learning," Energy Economics, Elsevier, vol. 114(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ewald, Christian Oliver & Li, Yaoyu, 2024. "The role of news sentiment in salmon price prediction using deep learning," Journal of Commodity Markets, Elsevier, vol. 36(C).
    2. Zheng, Li & Sun, Yuying & Wang, Shouyang, 2024. "A novel interval-based hybrid framework for crude oil price forecasting and trading," Energy Economics, Elsevier, vol. 130(C).
    3. Jiang, He & Hu, Weiqiang & Xiao, Ling & Dong, Yao, 2022. "A decomposition ensemble based deep learning approach for crude oil price forecasting," Resources Policy, Elsevier, vol. 78(C).
    4. Shao, Jin & Hong, Jingke & Wang, Xianzhu & Yan, Xiaochen, 2023. "The relationship between social media sentiment and house prices in China: Evidence from text mining and wavelet analysis," Finance Research Letters, Elsevier, vol. 57(C).
    5. Wang, Zicheng & Gao, Ruobin & Wang, Piao & Chen, Huayou, 2023. "A new perspective on air quality index time series forecasting: A ternary interval decomposition ensemble learning paradigm," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    6. Chuan Zhang & Ao‐Yun Hu & Yu‐Xin Tian, 2023. "Daily tourism forecasting through a novel method based on principal component analysis, grey wolf optimizer, and extreme learning machine," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(8), pages 2121-2138, December.
    7. Li, Mingchen & Cheng, Zishu & Lin, Wencan & Wei, Yunjie & Wang, Shouyang, 2023. "What can be learned from the historical trend of crude oil prices? An ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 123(C).
    8. Qin, Quande & Xie, Kangqiang & He, Huangda & Li, Li & Chu, Xianghua & Wei, Yi-Ming & Wu, Teresa, 2019. "An effective and robust decomposition-ensemble energy price forecasting paradigm with local linear prediction," Energy Economics, Elsevier, vol. 83(C), pages 402-414.
    9. Ling Tang & Chengyuan Zhang & Tingfei Li & Ling Li, 2021. "A novel BEMD-based method for forecasting tourist volume with search engine data," Tourism Economics, , vol. 27(5), pages 1015-1038, August.
    10. Quande Qin & Huangda He & Li Li & Ling-Yun He, 2020. "A Novel Decomposition-Ensemble Based Carbon Price Forecasting Model Integrated with Local Polynomial Prediction," Computational Economics, Springer;Society for Computational Economics, vol. 55(4), pages 1249-1273, April.
    11. Lin, Ling & Jiang, Yong & Xiao, Helu & Zhou, Zhongbao, 2020. "Crude oil price forecasting based on a novel hybrid long memory GARCH-M and wavelet analysis model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 543(C).
    12. Stig Vinther Møller & Thomas Pedersen & Erik Christian Montes Schütte & Allan Timmermann, 2024. "Search and Predictability of Prices in the Housing Market," Management Science, INFORMS, vol. 70(1), pages 415-438, January.
    13. Hao, Jun & Feng, Qianqian & Yuan, Jiaxin & Sun, Xiaolei & Li, Jianping, 2022. "A dynamic ensemble learning with multi-objective optimization for oil prices prediction," Resources Policy, Elsevier, vol. 79(C).
    14. Zhao, Geya & Xue, Minggao & Cheng, Li, 2023. "A new hybrid model for multi-step WTI futures price forecasting based on self-attention mechanism and spatial–temporal graph neural network," Resources Policy, Elsevier, vol. 85(PB).
    15. Taiyong Li & Yingrui Zhou & Xinsheng Li & Jiang Wu & Ting He, 2019. "Forecasting Daily Crude Oil Prices Using Improved CEEMDAN and Ridge Regression-Based Predictors," Energies, MDPI, vol. 12(19), pages 1-25, September.
    16. N. Kundan Kishor, 2025. "Forecasting House Prices: The Role of Fundamentals, Credit Conditions, and Supply Indicators," The Journal of Real Estate Finance and Economics, Springer, vol. 70(1), pages 121-143, January.
    17. David Coble & Pablo Pincheira, 2021. "Forecasting building permits with Google Trends," Empirical Economics, Springer, vol. 61(6), pages 3315-3345, December.
    18. Jiang Wu & Yu Chen & Tengfei Zhou & Taiyong Li, 2019. "An Adaptive Hybrid Learning Paradigm Integrating CEEMD, ARIMA and SBL for Crude Oil Price Forecasting," Energies, MDPI, vol. 12(7), pages 1-23, April.
    19. Khan, Faridoon & Muhammadullah, Sara & Sharif, Arshian & Lee, Chien-Chiang, 2024. "The role of green energy stock market in forecasting China's crude oil market: An application of IIS approach and sparse regression models," Energy Economics, Elsevier, vol. 130(C).
    20. Lean Yu & Yueming Ma, 2021. "A Data-Trait-Driven Rolling Decomposition-Ensemble Model for Gasoline Consumption Forecasting," Energies, MDPI, vol. 14(15), pages 1-26, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jforec:v:44:y:2025:i:1:p:216-241. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.