IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v35y2019i1p213-223.html
   My bibliography  Save this article

Online big data-driven oil consumption forecasting with Google trends

Author

Listed:
  • Yu, Lean
  • Zhao, Yaqing
  • Tang, Ling
  • Yang, Zebin

Abstract

The rapid development of big data technologies and the Internet provides a rich mine of online big data (e.g., trend spotting) that can be helpful in predicting oil consumption — an essential but uncertain factor in the oil supply chain. An online big data-driven oil consumption forecasting model is proposed that uses Google trends, which finely reflect various related factors based on a myriad of search results. This model involves two main steps, relationship investigation and prediction improvement. First, cointegration tests and a Granger causality analysis are conducted in order to statistically test the predictive power of Google trends, in terms of having a significant relationship with oil consumption. Second, the effective Google trends are introduced into popular forecasting methods for predicting both oil consumption trends and values. The experimental study of global oil consumption prediction confirms that the proposed online big-data-driven forecasting work with Google trends improves on the traditional techniques without Google trends significantly, for both directional and level predictions.

Suggested Citation

  • Yu, Lean & Zhao, Yaqing & Tang, Ling & Yang, Zebin, 2019. "Online big data-driven oil consumption forecasting with Google trends," International Journal of Forecasting, Elsevier, vol. 35(1), pages 213-223.
    • Handle: RePEc:eee:intfor:v:35:y:2019:i:1:p:213-223
    DOI: 10.1016/j.ijforecast.2017.11.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016920701730136X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2017.11.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yu, Lean & Zhao, Yang & Tang, Ling, 2014. "A compressed sensing based AI learning paradigm for crude oil price forecasting," Energy Economics, Elsevier, vol. 46(C), pages 236-245.
    2. Atalla, Tarek & Joutz, Fred & Pierru, Axel, 2016. "Does disagreement among oil price forecasters reflect volatility? Evidence from the ECB surveys," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1178-1192.
    3. Geem, Zong Woo & Roper, William E., 2009. "Energy demand estimation of South Korea using artificial neural network," Energy Policy, Elsevier, vol. 37(10), pages 4049-4054, October.
    4. Dean Fantazzini & Nikita Fomichev, 2014. "Forecasting the real price of oil using online search data," International Journal of Computational Economics and Econometrics, Inderscience Enterprises Ltd, vol. 4(1/2), pages 4-31.
    5. Benes, Jaromir & Chauvet, Marcelle & Kamenik, Ondra & Kumhof, Michael & Laxton, Douglas & Mursula, Susanna & Selody, Jack, 2015. "The future of oil: Geology versus technology," International Journal of Forecasting, Elsevier, vol. 31(1), pages 207-221.
    6. Concha Artola & Fernando Pinto & Pablo de Pedraza García, 2015. "Can internet searches forecast tourism inflows?," International Journal of Manpower, Emerald Group Publishing Limited, vol. 36(1), pages 103-116, April.
    7. Guo, Jian-Feng & Ji, Qiang, 2013. "How does market concern derived from the Internet affect oil prices?," Applied Energy, Elsevier, vol. 112(C), pages 1536-1543.
    8. Ünler, Alper, 2008. "Improvement of energy demand forecasts using swarm intelligence: The case of Turkey with projections to 2025," Energy Policy, Elsevier, vol. 36(6), pages 1937-1944, June.
    9. Li, Xin & Ma, Jian & Wang, Shouyang & Zhang, Xun, 2015. "How does Google search affect trader positions and crude oil prices?," Economic Modelling, Elsevier, vol. 49(C), pages 162-171.
    10. Crompton, Paul & Wu, Yanrui, 2005. "Energy consumption in China: past trends and future directions," Energy Economics, Elsevier, vol. 27(1), pages 195-208, January.
    11. Assareh, E. & Behrang, M.A. & Assari, M.R. & Ghanbarzadeh, A., 2010. "Application of PSO (particle swarm optimization) and GA (genetic algorithm) techniques on demand estimation of oil in Iran," Energy, Elsevier, vol. 35(12), pages 5223-5229.
    12. Bijl, Laurens & Kringhaug, Glenn & Molnár, Peter & Sandvik, Eirik, 2016. "Google searches and stock returns," International Review of Financial Analysis, Elsevier, vol. 45(C), pages 150-156.
    13. Vozlyublennaia, Nadia, 2014. "Investor attention, index performance, and return predictability," Journal of Banking & Finance, Elsevier, vol. 41(C), pages 17-35.
    14. Wang, Shuai & Yu, Lean & Tang, Ling & Wang, Shouyang, 2011. "A novel seasonal decomposition based least squares support vector regression ensemble learning approach for hydropower consumption forecasting in China," Energy, Elsevier, vol. 36(11), pages 6542-6554.
    15. Canyurt, Olcay Ersel & Ozturk, Harun Kemal, 2008. "Application of genetic algorithm (GA) technique on demand estimation of fossil fuels in Turkey," Energy Policy, Elsevier, vol. 36(7), pages 2562-2569, July.
    16. Ye, Michael & Zyren, John & Shore, Joanne, 2006. "Forecasting short-run crude oil price using high- and low-inventory variables," Energy Policy, Elsevier, vol. 34(17), pages 2736-2743, November.
    17. Ediger, Volkan S. & Akar, Sertac, 2007. "ARIMA forecasting of primary energy demand by fuel in Turkey," Energy Policy, Elsevier, vol. 35(3), pages 1701-1708, March.
    18. Engle, Robert & Granger, Clive, 2015. "Co-integration and error correction: Representation, estimation, and testing," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 39(3), pages 106-135.
    19. Ravi Kumar, P. & Ravi, V., 2007. "Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review," European Journal of Operational Research, Elsevier, vol. 180(1), pages 1-28, July.
    20. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    21. Sanders, Nada R., 2009. "Comments on "Effective forecasting and judgmental adjustments: An empirical evaluation and strategies for improvement in supply-chain planning"," International Journal of Forecasting, Elsevier, vol. 25(1), pages 24-26.
    22. Zou, Gaolu & Chau, K.W., 2006. "Short- and long-run effects between oil consumption and economic growth in China," Energy Policy, Elsevier, vol. 34(18), pages 3644-3655, December.
    23. Lean Yu & Zebin Yang & Ling Tang, 2016. "Prediction-Based Multi-Objective Optimization for Oil Purchasing and Distribution with the NSGA-II Algorithm," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 15(02), pages 423-451, March.
    24. Tang, Ling & Yu, Lean & Wang, Shuai & Li, Jianping & Wang, Shouyang, 2012. "A novel hybrid ensemble learning paradigm for nuclear energy consumption forecasting," Applied Energy, Elsevier, vol. 93(C), pages 432-443.
    25. Ermis, K. & Midilli, A. & Dincer, I. & Rosen, M.A., 2007. "Artificial neural network analysis of world green energy use," Energy Policy, Elsevier, vol. 35(3), pages 1731-1743, March.
    26. Trimbur, Thomas M., 2010. "Stochastic level shifts and outliers and the dynamics of oil price movements," International Journal of Forecasting, Elsevier, vol. 26(1), pages 162-179, January.
    27. Nel, Willem P. & Cooper, Christopher J., 2008. "A critical review of IEA's oil demand forecast for China," Energy Policy, Elsevier, vol. 36(3), pages 1096-1106, March.
    28. Ling Tang & Shuai Wang & Kaijian He & Shouyang Wang, 2015. "A novel mode-characteristic-based decomposition ensemble model for nuclear energy consumption forecasting," Annals of Operations Research, Springer, vol. 234(1), pages 111-132, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Debnath, Kumar Biswajit & Mourshed, Monjur, 2018. "Forecasting methods in energy planning models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 88(C), pages 297-325.
    2. Suganthi, L. & Samuel, Anand A., 2012. "Energy models for demand forecasting—A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(2), pages 1223-1240.
    3. Yu, Shiwei & Wei, Yi-Ming & Wang, Ke, 2012. "A PSO–GA optimal model to estimate primary energy demand of China," Energy Policy, Elsevier, vol. 42(C), pages 329-340.
    4. Gholami, M. & Barbaresi, A. & Torreggiani, D. & Tassinari, P., 2020. "Upscaling of spatial energy planning, phases, methods, and techniques: A systematic review through meta-analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 132(C).
    5. Yu, Lean & Wang, Zishu & Tang, Ling, 2015. "A decomposition–ensemble model with data-characteristic-driven reconstruction for crude oil price forecasting," Applied Energy, Elsevier, vol. 156(C), pages 251-267.
    6. Reza Hafezi & Amir Naser Akhavan & Mazdak Zamani & Saeed Pakseresht & Shahaboddin Shamshirband, 2019. "Developing a Data Mining Based Model to Extract Predictor Factors in Energy Systems: Application of Global Natural Gas Demand," Energies, MDPI, vol. 12(21), pages 1-22, October.
    7. Zeng, Yu-Rong & Zeng, Yi & Choi, Beomjin & Wang, Lin, 2017. "Multifactor-influenced energy consumption forecasting using enhanced back-propagation neural network," Energy, Elsevier, vol. 127(C), pages 381-396.
    8. Miao, Miao & Khaskheli, Asadullah & Raza, Syed Ali & Yousufi, Sara Qamar, 2022. "Using internet search keyword data for predictability of precious metals prices: Evidence from non-parametric causality-in-quantiles approach," Resources Policy, Elsevier, vol. 75(C).
    9. Yu, Shi-wei & Zhu, Ke-jun, 2012. "A hybrid procedure for energy demand forecasting in China," Energy, Elsevier, vol. 37(1), pages 396-404.
    10. Fiszeder, Piotr & Fałdziński, Marcin & Molnár, Peter, 2023. "Attention to oil prices and its impact on the oil, gold and stock markets and their covariance," Energy Economics, Elsevier, vol. 120(C).
    11. Fan, Jie & Wang, Qiang & Sun, Wei, 2015. "The failure of China׳s Energy Development Strategy 2050 and its impact on carbon emissions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 49(C), pages 1160-1170.
    12. Khaskheli, Asadullah & Zhang, Hongyu & Raza, Syed Ali & Khan, Komal Akram, 2022. "Assessing the influence of news indicator on volatility of precious metals prices through GARCH-MIDAS model: A comparative study of pre and during COVID-19 period," Resources Policy, Elsevier, vol. 79(C).
    13. Xiao, Jihong & Wang, Yudong, 2021. "Investor attention and oil market volatility: Does economic policy uncertainty matter?," Energy Economics, Elsevier, vol. 97(C).
    14. Li, Bing-Bing & Liang, Qiao-Mei & Wang, Jin-Cheng, 2015. "A comparative study on prediction methods for China's medium- and long-term coal demand," Energy, Elsevier, vol. 93(P2), pages 1671-1683.
    15. Uzlu, Ergun & Kankal, Murat & Akpınar, Adem & Dede, Tayfun, 2014. "Estimates of energy consumption in Turkey using neural networks with the teaching–learning-based optimization algorithm," Energy, Elsevier, vol. 75(C), pages 295-303.
    16. Hafezi, Reza & Akhavan, AmirNaser & Pakseresht, Saeed & A. Wood, David, 2021. "Global natural gas demand to 2025: A learning scenario development model," Energy, Elsevier, vol. 224(C).
    17. Lean Yu & Zebin Yang & Ling Tang, 2016. "Prediction-Based Multi-Objective Optimization for Oil Purchasing and Distribution with the NSGA-II Algorithm," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 15(02), pages 423-451, March.
    18. Atul Anand & L Suganthi, 2018. "Hybrid GA-PSO Optimization of Artificial Neural Network for Forecasting Electricity Demand," Energies, MDPI, vol. 11(4), pages 1-15, March.
    19. Hervé, Fabrice & Zouaoui, Mohamed & Belvaux, Bertrand, 2019. "Noise traders and smart money: Evidence from online searches," Economic Modelling, Elsevier, vol. 83(C), pages 141-149.
    20. Zhu, Yongbin & Shi, Yajuan & Wang, Zheng, 2014. "How much CO2 emissions will be reduced through industrial structure change if China focuses on domestic rather than international welfare?," Energy, Elsevier, vol. 72(C), pages 168-179.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:35:y:2019:i:1:p:213-223. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.