IDEAS home Printed from https://ideas.repec.org/a/eee/eneeco/v140y2024ics0140988324006704.html
   My bibliography  Save this article

Forecasting carbon futures returns using feature selection and Markov chain with sample distribution

Author

Listed:
  • Zhao, Yuan
  • Gong, Xue
  • Zhang, Weiguo
  • Xu, Weijun

Abstract

The accurate forecasting of carbon returns is paramount for enabling informed investment decisions, promoting emissions reduction, and effectively shaping policies to combat climate change. In this paper, we propose a novel method to improve carbon returns predictability in a data-rich environment. The innovations of the model are manifested in two key dimensions: (i) a feature selection strategy based on the minimum prediction error is introduced; (ii) a novel Markov chain with sample distribution considering both prediction and parameter estimation is proposed to quantify the error information and perfect the prediction performance by error modification. Our empirical findings demonstrate that the proposed model outperforms a comprehensive array of competing models, both in point and interval forecasting of carbon returns. The results are consistently confirmed in various robustness checks. Finally, we show that the enhanced prediction performance of the proposed model is economically significant, which can help investors make favorable decisions.

Suggested Citation

  • Zhao, Yuan & Gong, Xue & Zhang, Weiguo & Xu, Weijun, 2024. "Forecasting carbon futures returns using feature selection and Markov chain with sample distribution," Energy Economics, Elsevier, vol. 140(C).
  • Handle: RePEc:eee:eneeco:v:140:y:2024:i:c:s0140988324006704
    DOI: 10.1016/j.eneco.2024.107962
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0140988324006704
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.eneco.2024.107962?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Banerjee, Anindya & Marcellino, Massimiliano & Masten, Igor, 2014. "Forecasting with factor-augmented error correction models," International Journal of Forecasting, Elsevier, vol. 30(3), pages 589-612.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Leippold, Markus & Wang, Qian & Zhou, Wenyu, 2022. "Machine learning in the Chinese stock market," Journal of Financial Economics, Elsevier, vol. 145(2), pages 64-82.
    4. Chevallier, Julien, 2011. "Detecting instability in the volatility of carbon prices," Energy Economics, Elsevier, vol. 33(1), pages 99-110, January.
    5. Jiqian Wang & Xiaozhu Guo & Xueping Tan & Julien Chevallier & Feng Ma, 2023. "Which exogenous driver is informative in forecasting European carbon volatility: Bond, commodity, stock or uncertainty?," Post-Print halshs-04250316, HAL.
    6. Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-565, October.
    7. Xu Gong & Mengjie Li & Keqin Guan & Chuanwang Sun, 2023. "Climate change attention and carbon futures return prediction," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 43(9), pages 1261-1288, September.
    8. Degiannakis, Stavros & Filis, George, 2017. "Forecasting oil price realized volatility using information channels from other asset classes," Journal of International Money and Finance, Elsevier, vol. 76(C), pages 28-49.
    9. Asai, Manabu & McAleer, Michael & Medeiros, Marcelo C., 2012. "Modelling and forecasting noisy realized volatility," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 217-230, January.
    10. Wang, Yudong & Liu, Li & Wu, Chongfeng, 2020. "Forecasting commodity prices out-of-sample: Can technical indicators help?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 666-683.
    11. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    12. Julien Cujean & Michael Hasler, 2017. "Why Does Return Predictability Concentrate in Bad Times?," Journal of Finance, American Finance Association, vol. 72(6), pages 2717-2758, December.
    13. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    14. Elliott, Graham & Timmermann, Allan, 2004. "Optimal forecast combinations under general loss functions and forecast error distributions," Journal of Econometrics, Elsevier, vol. 122(1), pages 47-79, September.
    15. Li, Chaoshun & Tang, Geng & Xue, Xiaoming & Chen, Xinbiao & Wang, Ruoheng & Zhang, Chu, 2020. "The short-term interval prediction of wind power using the deep learning model with gradient descend optimization," Renewable Energy, Elsevier, vol. 155(C), pages 197-211.
    16. Xue Gong & Xin Ye & Weiguo Zhang & Yue Zhang, 2023. "Predicting energy futures high-frequency volatility using technical indicators: The role of interaction," Post-Print hal-04232649, HAL.
    17. Ghosh, Indranil & Chaudhuri, Tamal Datta & Alfaro-Cortés, Esteban & Gámez, Matías & García, Noelia, 2022. "A hybrid approach to forecasting futures prices with simultaneous consideration of optimality in ensemble feature selection and advanced artificial intelligence," Technological Forecasting and Social Change, Elsevier, vol. 181(C).
    18. E, Jianwei & Ye, Jimin & He, Lulu & Jin, Haihong, 2019. "Energy price prediction based on independent component analysis and gated recurrent unit neural network," Energy, Elsevier, vol. 189(C).
    19. Ma, Feng & Wang, Jiqian & Wahab, M.I.M. & Ma, Yuanhui, 2023. "Stock market volatility predictability in a data-rich world: A new insight," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1804-1819.
    20. Bollerslev, Tim & Patton, Andrew J. & Quaedvlieg, Rogier, 2016. "Exploiting the errors: A simple approach for improved volatility forecasting," Journal of Econometrics, Elsevier, vol. 192(1), pages 1-18.
    21. Suh, Jong Hwan, 2015. "Forecasting the daily outbreak of topic-level political risk from social media using hidden Markov model-based techniques," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 115-132.
    22. Risse, Marian, 2019. "Combining wavelet decomposition with machine learning to forecast gold returns," International Journal of Forecasting, Elsevier, vol. 35(2), pages 601-615.
    23. Tan, Xueping & Sirichand, Kavita & Vivian, Andrew & Wang, Xinyu, 2022. "Forecasting European carbon returns using dimension reduction techniques: Commodity versus financial fundamentals," International Journal of Forecasting, Elsevier, vol. 38(3), pages 944-969.
    24. Gong, Xue & Ye, Xin & Zhang, Weiguo & Zhang, Yue, 2023. "Predicting energy futures high-frequency volatility using technical indicators: The role of interaction," Energy Economics, Elsevier, vol. 119(C).
    25. Wang, Jiqian & Guo, Xiaozhu & Tan, Xueping & Chevallier, Julien & Ma, Feng, 2023. "Which exogenous driver is informative in forecasting European carbon volatility: Bond, commodity, stock or uncertainty?," Energy Economics, Elsevier, vol. 117(C).
    26. McQueen, Grant & Thorley, Steven, 1991. "Are Stock Returns Predictable? A Test Using Markov Chains," Journal of Finance, American Finance Association, vol. 46(1), pages 239-263, March.
    27. Zhang, Yaojie & Ma, Feng & Wang, Yudong, 2019. "Forecasting crude oil prices with a large set of predictors: Can LASSO select powerful predictors?," Journal of Empirical Finance, Elsevier, vol. 54(C), pages 97-117.
    28. Lutz, Benjamin Johannes & Pigorsch, Uta & Rotfuß, Waldemar, 2013. "Nonlinearity in cap-and-trade systems: The EUA price and its fundamentals," Energy Economics, Elsevier, vol. 40(C), pages 222-232.
    29. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    30. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    31. Li, Ranran & Hu, Yucai & Heng, Jiani & Chen, Xueli, 2021. "A novel multiscale forecasting model for crude oil price time series," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    32. Jiang, P. & Liu, X., 2016. "Hidden Markov model for municipal waste generation forecasting under uncertainties," European Journal of Operational Research, Elsevier, vol. 250(2), pages 639-651.
    33. Zhang, Ditian & Tang, Pan, 2023. "Forecasting European Union allowances futures: The role of technical indicators," Energy, Elsevier, vol. 270(C).
    34. Tan, Xueping & Sirichand, Kavita & Vivian, Andrew & Wang, Xinyu, 2020. "How connected is the carbon market to energy and financial markets? A systematic analysis of spillovers and dynamics," Energy Economics, Elsevier, vol. 90(C).
    35. Ren, Xiaohang & Li, Yiying & yan, Cheng & Wen, Fenghua & Lu, Zudi, 2022. "The interrelationship between the carbon market and the green bonds market: Evidence from wavelet quantile-on-quantile method," Technological Forecasting and Social Change, Elsevier, vol. 179(C).
    36. Michaelides, Panayotis G. & Tsionas, Efthymios G. & Vouldis, Angelos T. & Konstantakis, Konstantinos N., 2015. "Global approximation to arbitrary cost functions: A Bayesian approach with application to US banking," European Journal of Operational Research, Elsevier, vol. 241(1), pages 148-160.
    37. Wang, Yudong & Guo, Zhuangyue, 2018. "The dynamic spillover between carbon and energy markets: New evidence," Energy, Elsevier, vol. 149(C), pages 24-33.
    38. Zhao, Yuan & Zhang, Weiguo & Gong, Xue & Wang, Chao, 2021. "A novel method for online real-time forecasting of crude oil price," Applied Energy, Elsevier, vol. 303(C).
    39. Tsionas, Mike G., 2023. "Bayesian learning in performance. Is there any?," European Journal of Operational Research, Elsevier, vol. 311(1), pages 263-282.
    40. Guo, Xiaozhu & Huang, Yisu & Liang, Chao & Umar, Muhammad, 2022. "Forecasting volatility of EUA futures: New evidence," Energy Economics, Elsevier, vol. 110(C).
    41. repec:dau:papers:123456789/5110 is not listed on IDEAS
    42. Fan, Liwei & Pan, Sijia & Li, Zimin & Li, Huiping, 2016. "An ICA-based support vector regression scheme for forecasting crude oil prices," Technological Forecasting and Social Change, Elsevier, vol. 112(C), pages 245-253.
    43. Sun, Shaolong & Sun, Yuying & Wang, Shouyang & Wei, Yunjie, 2018. "Interval decomposition ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 76(C), pages 274-287.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Jiqian & Guo, Xiaozhu & Tan, Xueping & Chevallier, Julien & Ma, Feng, 2023. "Which exogenous driver is informative in forecasting European carbon volatility: Bond, commodity, stock or uncertainty?," Energy Economics, Elsevier, vol. 117(C).
    2. Wen, Danyan & Liu, Li & Wang, Yudong & Zhang, Yaojie, 2022. "Forecasting crude oil market returns: Enhanced moving average technical indicators," Resources Policy, Elsevier, vol. 76(C).
    3. Zhang, Yaojie & Wang, Yudong, 2023. "Forecasting crude oil futures market returns: A principal component analysis combination approach," International Journal of Forecasting, Elsevier, vol. 39(2), pages 659-673.
    4. Li, Zhao-Chen & Xie, Chi & Zeng, Zhi-Jian & Wang, Gang-Jin & Zhang, Ting, 2023. "Forecasting global stock market volatilities in an uncertain world," International Review of Financial Analysis, Elsevier, vol. 85(C).
    5. Zhang, Zhikai & Wang, Yudong & Zhang, Yaojie & Wang, Qunwei, 2024. "Forecasting carbon prices under diversified attention: A dynamic model averaging approach with common factors," Energy Economics, Elsevier, vol. 133(C).
    6. Gong, Xue & Ye, Xin & Zhang, Weiguo & Zhang, Yue, 2023. "Predicting energy futures high-frequency volatility using technical indicators: The role of interaction," Energy Economics, Elsevier, vol. 119(C).
    7. Li, Xiaodan & Gong, Xue & Ge, Futing & Huang, Jingjing, 2024. "Forecasting stock volatility using pseudo-out-of-sample information," International Review of Economics & Finance, Elsevier, vol. 90(C), pages 123-135.
    8. Xing, Li-Min & Zhang, Yue-Jun, 2022. "Forecasting crude oil prices with shrinkage methods: Can nonconvex penalty and Huber loss help?," Energy Economics, Elsevier, vol. 110(C).
    9. Wen, Danyan & He, Mengxi & Wang, Yudong & Zhang, Yaojie, 2024. "Forecasting crude oil market volatility: A comprehensive look at uncertainty variables," International Journal of Forecasting, Elsevier, vol. 40(3), pages 1022-1041.
    10. Danyan Wen & Mengxi He & Yaojie Zhang & Yudong Wang, 2022. "Forecasting realized volatility of Chinese stock market: A simple but efficient truncated approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 230-251, March.
    11. Gong, Xue & Lai, Ping & He, Mengxi & Wen, Danyan, 2024. "Climate risk and energy futures high frequency volatility prediction," Energy, Elsevier, vol. 307(C).
    12. Dai, Zhifeng & Kang, Jie & Hu, Yangli, 2021. "Efficient predictability of oil price: The role of number of IPOs and U.S. dollar index," Resources Policy, Elsevier, vol. 74(C).
    13. Luo, Qin & Ma, Feng & Wang, Jiqian & Wu, You, 2024. "Changing determinant driver and oil volatility forecasting: A comprehensive analysis," Energy Economics, Elsevier, vol. 129(C).
    14. Yaojie Zhang & Yudong Wang & Feng Ma, 2021. "Forecasting US stock market volatility: How to use international volatility information," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(5), pages 733-768, August.
    15. Niu, Zibo & Demirer, Riza & Suleman, Muhammad Tahir & Zhang, Hongwei & Zhu, Xuehong, 2024. "Do industries predict stock market volatility? Evidence from machine learning models," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).
    16. Wen, Chufu & Zhu, Haoyang & Dai, Zhifeng, 2023. "Forecasting commodity prices returns: The role of partial least squares approach," Energy Economics, Elsevier, vol. 125(C).
    17. Faria, Gonçalo & Verona, Fabio, 2024. "Enhancing forecast accuracy through frequencydomain combination: Applications to financial and economic indicators," Bank of Finland Research Discussion Papers 14/2024, Bank of Finland.
    18. Zhang, Zhikai & He, Mengxi & Zhang, Yaojie & Wang, Yudong, 2022. "Geopolitical risk trends and crude oil price predictability," Energy, Elsevier, vol. 258(C).
    19. Pan, Zhiyuan & Zhong, Hao & Wang, Yudong & Huang, Juan, 2024. "Forecasting oil futures returns with news," Energy Economics, Elsevier, vol. 134(C).
    20. Fu, Tong & Huang, Dasen & Feng, Lingbing & Tang, Xiaoping, 2024. "More is better? The impact of predictor choice on the INE oil futures volatility forecasting," Energy Economics, Elsevier, vol. 134(C).

    More about this item

    Keywords

    Carbon pricing; Feature selection; Error modification; Markov chain with sample distribution;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • F37 - International Economics - - International Finance - - - International Finance Forecasting and Simulation: Models and Applications
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G15 - Financial Economics - - General Financial Markets - - - International Financial Markets
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eneeco:v:140:y:2024:i:c:s0140988324006704. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eneco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.