IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v179y2019icp214-221.html
   My bibliography  Save this article

Long-term forecast of energy commodities price using machine learning

Author

Listed:
  • Herrera, Gabriel Paes
  • Constantino, Michel
  • Tabak, Benjamin Miranda
  • Pistori, Hemerson
  • Su, Jen-Je
  • Naranpanawa, Athula

Abstract

We compare the long-horizon forecast performance of traditional econometric models with machine learning methods (Neural Networks and Random Forests) for the main energy commodities in the world using monthly prices provided by the International Monetary Fund (IMF). We study the case of Oil (Brent, WTI and Dubai Fateh), Coal (AU) and Gas (US and Russia). Models accuracy are measured using RMSE and MAPE and the M-DM test is applied to evaluate whether there is a statistically significant difference between the methods. We computed thousands of tests regarding the machine learning parameters combinations as there is no method to set the optimal structure for these models. The results show that machine learning methods outperform traditional econometric methods and also that they present an additional advantage, which is the capacity to predict turning points. This study adds further evidence for the discussion on the use of machine learning algorithms for the development of more accurate forecasts to support policymakers and help the decision-making process in the international energy market.

Suggested Citation

  • Herrera, Gabriel Paes & Constantino, Michel & Tabak, Benjamin Miranda & Pistori, Hemerson & Su, Jen-Je & Naranpanawa, Athula, 2019. "Long-term forecast of energy commodities price using machine learning," Energy, Elsevier, vol. 179(C), pages 214-221.
    • Handle: RePEc:eee:energy:v:179:y:2019:i:c:p:214-221
    DOI: 10.1016/j.energy.2019.04.077
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S036054421930708X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2019.04.077?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alquist, Ron & Kilian, Lutz & Vigfusson, Robert J., 2013. "Forecasting the Price of Oil," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 427-507, Elsevier.
    2. Gianluca Bontempi & Souhaib Ben Taieb & Yann-Aël Le Borgne, 2013. "Machine learning strategies for time series forecasting," ULB Institutional Repository 2013/167761, ULB -- Universite Libre de Bruxelles.
    3. Sánchez Lasheras, Fernando & de Cos Juez, Francisco Javier & Suárez Sánchez, Ana & Krzemień, Alicja & Riesgo Fernández, Pedro, 2015. "Forecasting the COMEX copper spot price by means of neural networks and ARIMA models," Resources Policy, Elsevier, vol. 45(C), pages 37-43.
    4. Kang, Wensheng & Ratti, Ronald A. & Vespignani, Joaquin L., 2017. "Oil price shocks and policy uncertainty: New evidence on the effects of US and non-US oil production," Energy Economics, Elsevier, vol. 66(C), pages 536-546.
    5. Lahouar, A. & Ben Hadj Slama, J., 2017. "Hour-ahead wind power forecast based on random forests," Renewable Energy, Elsevier, vol. 109(C), pages 529-541.
    6. van de Ven, Dirk Jan & Fouquet, Roger, 2017. "Historical energy price shocks and their changing effects on the economy," Energy Economics, Elsevier, vol. 62(C), pages 204-216.
    7. Chai, Jian & Xing, Li-Min & Zhou, Xiao-Yang & Zhang, Zhe George & Li, Jie-Xun, 2018. "Forecasting the WTI crude oil price by a hybrid-refined method," Energy Economics, Elsevier, vol. 71(C), pages 114-127.
    8. Safari, Ali & Davallou, Maryam, 2018. "Oil price forecasting using a hybrid model," Energy, Elsevier, vol. 148(C), pages 49-58.
    9. Tang, Ling & Wu, Yao & Yu, Lean, 2018. "A randomized-algorithm-based decomposition-ensemble learning methodology for energy price forecasting," Energy, Elsevier, vol. 157(C), pages 526-538.
    10. Kim, Jae H., 2009. "Automatic variance ratio test under conditional heteroskedasticity," Finance Research Letters, Elsevier, vol. 6(3), pages 179-185, September.
    11. Ding, Yishan, 2018. "A novel decompose-ensemble methodology with AIC-ANN approach for crude oil forecasting," Energy, Elsevier, vol. 154(C), pages 328-336.
    12. Tabak, Benjamin M. & Cajueiro, Daniel O., 2007. "Are the crude oil markets becoming weakly efficient over time? A test for time-varying long-range dependence in prices and volatility," Energy Economics, Elsevier, vol. 29(1), pages 28-36, January.
    13. Wang, Ju-Jie & Wang, Jian-Zhou & Zhang, Zhe-George & Guo, Shu-Po, 2012. "Stock index forecasting based on a hybrid model," Omega, Elsevier, vol. 40(6), pages 758-766.
    14. Zhao, Yang & Li, Jianping & Yu, Lean, 2017. "A deep learning ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 9-16.
    15. Sensoy, Ahmet & Hacihasanoglu, Erk, 2014. "Time-varying long range dependence in energy futures markets," Energy Economics, Elsevier, vol. 46(C), pages 318-327.
    16. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    17. Gérard Biau & Erwan Scornet, 2016. "A random forest guided tour," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(2), pages 197-227, June.
    18. Darbellay, Georges A. & Slama, Marek, 2000. "Forecasting the short-term demand for electricity: Do neural networks stand a better chance?," International Journal of Forecasting, Elsevier, vol. 16(1), pages 71-83.
    19. Choi, In, 1999. "Testing the Random Walk Hypothesis for Real Exchange Rates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(3), pages 293-308, May-June.
    20. Cheng, Fangzheng & Fan, Tijun & Fan, Dandan & Li, Shanling, 2018. "The prediction of oil price turning points with log-periodic power law and multi-population genetic algorithm," Energy Economics, Elsevier, vol. 72(C), pages 341-355.
    21. Zhu, Suling & Wang, Jianzhou & Zhao, Weigang & Wang, Jujie, 2011. "A seasonal hybrid procedure for electricity demand forecasting in China," Applied Energy, Elsevier, vol. 88(11), pages 3807-3815.
    22. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    23. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    24. Wang, Minggang & Tian, Lixin & Zhou, Peng, 2018. "A novel approach for oil price forecasting based on data fluctuation network," Energy Economics, Elsevier, vol. 71(C), pages 201-212.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Feng, Zongbao & Wu, Xianguo & Chen, Hongyu & Qin, Yawei & Zhang, Limao & Skibniewski, Miroslaw J., 2022. "An energy performance contracting parameter optimization method based on the response surface method: A case study of a metro in China," Energy, Elsevier, vol. 248(C).
    2. Zhang, Kefei & Cao, Hua & Thé, Jesse & Yu, Hesheng, 2022. "A hybrid model for multi-step coal price forecasting using decomposition technique and deep learning algorithms," Applied Energy, Elsevier, vol. 306(PA).
    3. Fernandes, Leonardo H.S. & de Araujo, Fernando H.A. & Silva, José W.L. & Tabak, Benjamin Miranda, 2022. "Booms in commodities price: Assessing disorder and similarity over economic cycles," Resources Policy, Elsevier, vol. 79(C).
    4. Zhao, Shuchun & Guo, Junheng & Dang, Xiuhu & Ai, Bingyan & Zhang, Minqing & Li, Wei & Zhang, Jinli, 2022. "Energy consumption, flow characteristics and energy-efficient design of cup-shape blade stirred tank reactors: Computational fluid dynamics and artificial neural network investigation," Energy, Elsevier, vol. 240(C).
    5. Hajirahimi, Zahra & Khashei, Mehdi & Etemadi, Sepideh, 2022. "A novel class of reliability-based parallel hybridization (RPH) models for time series forecasting," Chaos, Solitons & Fractals, Elsevier, vol. 156(C).
    6. Abdollahi, Hooman & Ebrahimi, Seyed Babak, 2020. "A new hybrid model for forecasting Brent crude oil price," Energy, Elsevier, vol. 200(C).
    7. Dimitrios Mouchtaris & Emmanouil Sofianos & Periklis Gogas & Theophilos Papadimitriou, 2021. "Forecasting Natural Gas Spot Prices with Machine Learning," Energies, MDPI, vol. 14(18), pages 1-13, September.
    8. Olubusoye, Olusanya E & Akintande, Olalekan J. & Yaya, OlaOluwa S. & Ogbonna, Ahamuefula & Adenikinju, Adeola F., 2021. "Energy Pricing during the COVID-19 Pandemic: Predictive Information-Based Uncertainty Indexes with Machine Learning Algorithm," MPRA Paper 109838, University Library of Munich, Germany.
    9. Zhang, Tingting & Tang, Zhenpeng & Wu, Junchuan & Du, Xiaoxu & Chen, Kaijie, 2021. "Multi-step-ahead crude oil price forecasting based on two-layer decomposition technique and extreme learning machine optimized by the particle swarm optimization algorithm," Energy, Elsevier, vol. 229(C).
    10. Jonathan Berrisch & Florian Ziel, 2020. "Distributional Modeling and Forecasting of Natural Gas Prices," Papers 2010.06227, arXiv.org, revised Aug 2021.
    11. Abdollahi, Hooman, 2020. "A novel hybrid model for forecasting crude oil price based on time series decomposition," Applied Energy, Elsevier, vol. 267(C).
    12. Xie, Gang & Jiang, Fuxin & Zhang, Chengyuan, 2023. "A secondary decomposition-ensemble methodology for forecasting natural gas prices using multisource data," Resources Policy, Elsevier, vol. 85(PA).
    13. Drachal, Krzysztof, 2021. "Forecasting selected energy commodities prices with Bayesian dynamic finite mixtures," Energy Economics, Elsevier, vol. 99(C).
    14. Kuntadi, Cris, 2022. "Effective energy commodity risk management on Indonesia," Resources Policy, Elsevier, vol. 78(C).
    15. Gustavo Carvalho Santos & Flavio Barboza & Antônio Cláudio Paschoarelli Veiga & Mateus Ferreira Silva, 2021. "Forecasting Brazilian Ethanol Spot Prices Using LSTM," Energies, MDPI, vol. 14(23), pages 1-15, November.
    16. Saleh Abushamah, Hussein Abdulkareem & Skoda, Radek, 2022. "Nuclear energy for district cooling systems – Novel approach and its eco-environmental assessment method," Energy, Elsevier, vol. 250(C).
    17. Wu, Siping & Xia, Guilin & Liu, Lang, 2023. "A novel decomposition integration model for power coal price forecasting," Resources Policy, Elsevier, vol. 80(C).
    18. Alameer, Zakaria & Fathalla, Ahmed & Li, Kenli & Ye, Haiwang & Jianhua, Zhang, 2020. "Multistep-ahead forecasting of coal prices using a hybrid deep learning model," Resources Policy, Elsevier, vol. 65(C).
    19. Manickavasagam, Jeevananthan & Visalakshmi, S. & Apergis, Nicholas, 2020. "A novel hybrid approach to forecast crude oil futures using intraday data," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    20. Wang, Jun & Cao, Junxing & Yuan, Shan & Cheng, Ming, 2021. "Short-term forecasting of natural gas prices by using a novel hybrid method based on a combination of the CEEMDAN-SE-and the PSO-ALS-optimized GRU network," Energy, Elsevier, vol. 233(C).
    21. Ahmad, Tanveer & Zhang, Dongdong & Huang, Chao, 2021. "Methodological framework for short-and medium-term energy, solar and wind power forecasting with stochastic-based machine learning approach to monetary and energy policy applications," Energy, Elsevier, vol. 231(C).
    22. Kais Tissaoui & Taha Zaghdoudi & Abdelaziz Hakimi & Mariem Nsaibi, 2023. "Do Gas Price and Uncertainty Indices Forecast Crude Oil Prices? Fresh Evidence Through XGBoost Modeling," Computational Economics, Springer;Society for Computational Economics, vol. 62(2), pages 663-687, August.
    23. Wang, Hanjie & Maruejols, Lucie & Yu, Xiaohua, 2021. "Predicting energy poverty with combinations of remote-sensing and socioeconomic survey data in India: Evidence from machine learning," Energy Economics, Elsevier, vol. 102(C).
    24. Zhang, Xiaokong & Chai, Jian & Tian, Lingyue & Yang, Ying & Zhang, Zhe George & Pan, Yue, 2023. "Forecast and structural characteristics of China's oil product consumption embedded in bottom-line thinking," Energy, Elsevier, vol. 278(PA).
    25. Qin Lu & Jingwen Liao & Kechi Chen & Yanhui Liang & Yu Lin, 2024. "Predicting Natural Gas Prices Based on a Novel Hybrid Model with Variational Mode Decomposition," Computational Economics, Springer;Society for Computational Economics, vol. 63(2), pages 639-678, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Jinchao & Zhu, Shaowen & Wu, Qianqian, 2019. "Monthly crude oil spot price forecasting using variational mode decomposition," Energy Economics, Elsevier, vol. 83(C), pages 240-253.
    2. Manickavasagam, Jeevananthan & Visalakshmi, S. & Apergis, Nicholas, 2020. "A novel hybrid approach to forecast crude oil futures using intraday data," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    3. Guo, Jingjun & Zhao, Zhengling & Sun, Jingyun & Sun, Shaolong, 2022. "Multi-perspective crude oil price forecasting with a new decomposition-ensemble framework," Resources Policy, Elsevier, vol. 77(C).
    4. Nonejad, Nima, 2019. "Forecasting aggregate equity return volatility using crude oil price volatility: The role of nonlinearities and asymmetries," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    5. Czudaj, Robert L., 2022. "Heterogeneity of beliefs and information rigidity in the crude oil market: Evidence from survey data," European Economic Review, Elsevier, vol. 143(C).
    6. Abdollahi, Hooman & Ebrahimi, Seyed Babak, 2020. "A new hybrid model for forecasting Brent crude oil price," Energy, Elsevier, vol. 200(C).
    7. Butler, Sunil & Kokoszka, Piotr & Miao, Hong & Shang, Han Lin, 2021. "Neural network prediction of crude oil futures using B-splines," Energy Economics, Elsevier, vol. 94(C).
    8. Nonejad, Nima, 2020. "Crude oil price changes and the United Kingdom real gross domestic product growth rate: An out-of-sample investigation," The Journal of Economic Asymmetries, Elsevier, vol. 21(C).
    9. Liyang Tang, 2020. "Application of Nonlinear Autoregressive with Exogenous Input (NARX) neural network in macroeconomic forecasting, national goal setting and global competitiveness assessment," Papers 2005.08735, arXiv.org.
    10. Lu, Quanying & Li, Yuze & Chai, Jian & Wang, Shouyang, 2020. "Crude oil price analysis and forecasting: A perspective of “new triangle”," Energy Economics, Elsevier, vol. 87(C).
    11. Nonejad, Nima, 2020. "A comprehensive empirical analysis of the predictive impact of the price of crude oil on aggregate equity return volatility," Journal of Commodity Markets, Elsevier, vol. 20(C).
    12. Safari, Ali & Davallou, Maryam, 2018. "Oil price forecasting using a hybrid model," Energy, Elsevier, vol. 148(C), pages 49-58.
    13. Nima Nonejad, 2020. "A detailed look at crude oil price volatility prediction using macroeconomic variables," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(7), pages 1119-1141, November.
    14. Li, Jingjing & Tang, Ling & Wang, Shouyang, 2020. "Forecasting crude oil price with multilingual search engine data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 551(C).
    15. Drachal, Krzysztof, 2018. "Comparison between Bayesian and information-theoretic model averaging: Fossil fuels prices example," Energy Economics, Elsevier, vol. 74(C), pages 208-251.
    16. Qin, Quande & Xie, Kangqiang & He, Huangda & Li, Li & Chu, Xianghua & Wei, Yi-Ming & Wu, Teresa, 2019. "An effective and robust decomposition-ensemble energy price forecasting paradigm with local linear prediction," Energy Economics, Elsevier, vol. 83(C), pages 402-414.
    17. Scott Brave & R. Andrew Butters & Alejandro Justiniano, 2016. "Forecasting Economic Activity with Mixed Frequency Bayesian VARs," Working Paper Series WP-2016-5, Federal Reserve Bank of Chicago.
    18. Ling Tang & Chengyuan Zhang & Tingfei Li & Ling Li, 2021. "A novel BEMD-based method for forecasting tourist volume with search engine data," Tourism Economics, , vol. 27(5), pages 1015-1038, August.
    19. Donghua Wang & Tianhui Fang, 2022. "Forecasting Crude Oil Prices with a WT-FNN Model," Energies, MDPI, vol. 15(6), pages 1-21, March.
    20. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:179:y:2019:i:c:p:214-221. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.