IDEAS home Printed from https://ideas.repec.org/a/eee/jrpoli/v73y2021ics0301420721001768.html
   My bibliography  Save this article

Clustering commodity markets in space and time: Clarifying returns, volatility, and trading regimes through unsupervised machine learning

Author

Listed:
  • Chen, James Ming
  • Rehman, Mobeen Ur
  • Vo, Xuan Vinh

Abstract

Unsupervised machine learning can interpret logarithmic returns and conditional volatility in commodity markets. This article applies machine learning in order to visualize and interpret log returns and conditional volatility in commodities trading. We emphasize two classes of unsupervised learning methods: clustering and manifold learning for the reduction of dimensionality. We source daily prices from September 18, 2000 through July 31, 2020, for precious metals, base metals), energy commodities and agricultural commodities. Our results highlight that at the very least, returns-based clusters conform more closely to traditional boundaries between precious metals, base metals, fuels, temperate-climate agricultural commodities, and tropical agricultural commodities. On the other hand, volatility-based clustering succeeds in identifying periods of extreme market distress, such as the global financial crisis of 2008–09 and the Covid-19 pandemic.

Suggested Citation

  • Chen, James Ming & Rehman, Mobeen Ur & Vo, Xuan Vinh, 2021. "Clustering commodity markets in space and time: Clarifying returns, volatility, and trading regimes through unsupervised machine learning," Resources Policy, Elsevier, vol. 73(C).
  • Handle: RePEc:eee:jrpoli:v:73:y:2021:i:c:s0301420721001768
    DOI: 10.1016/j.resourpol.2021.102162
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0301420721001768
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.resourpol.2021.102162?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paul Cashin & C. John McCDermott, 2002. "The Long-Run Behavior of Commodity Prices: Small Trends and Big Variability," IMF Staff Papers, Palgrave Macmillan, vol. 49(2), pages 1-2.
    2. James Ming Chen, 2021. "An Introduction to Machine Learning for Panel Data," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 27(1), pages 1-16, February.
    3. Cagli, Efe Caglar & Taskin, Dilvin & Evrim Mandaci, Pınar, 2019. "The short- and long-run efficiency of energy, precious metals, and base metals markets: Evidence from the exponential smooth transition autoregressive models," Energy Economics, Elsevier, vol. 84(C).
    4. Rehman, Mobeen Ur & Apergis, Nicholas, 2019. "Determining the predictive power between cryptocurrencies and real time commodity futures: Evidence from quantile causality tests," Resources Policy, Elsevier, vol. 61(C), pages 603-616.
    5. Baur, Dirk G. & McDermott, Thomas K., 2010. "Is gold a safe haven? International evidence," Journal of Banking & Finance, Elsevier, vol. 34(8), pages 1886-1898, August.
    6. Michael C. Munnix & Takashi Shimada & Rudi Schafer & Francois Leyvraz Thomas H. Seligman & Thomas Guhr & H. E. Stanley, 2012. "Identifying States of a Financial Market," Papers 1202.1623, arXiv.org.
    7. Uddin, Gazi Salah & Shahzad, Syed Jawad Hussain & Boako, Gideon & Hernandez, Jose Areola & Lucey, Brian M., 2019. "Heterogeneous interconnections between precious metals: Evidence from asymmetric and frequency-domain spillover analysis," Resources Policy, Elsevier, vol. 64(C).
    8. Dirk G. Baur & Brian M. Lucey, 2010. "Is Gold a Hedge or a Safe Haven? An Analysis of Stocks, Bonds and Gold," The Financial Review, Eastern Finance Association, vol. 45(2), pages 217-229, May.
    9. Sensoy, Ahmet, 2013. "Dynamic relationship between precious metals," Resources Policy, Elsevier, vol. 38(4), pages 504-511.
    10. Selmi, Refk & Mensi, Walid & Hammoudeh, Shawkat & Bouoiyour, Jamal, 2018. "Is Bitcoin a hedge, a safe haven or a diversifier for oil price movements? A comparison with gold," Energy Economics, Elsevier, vol. 74(C), pages 787-801.
    11. Maurice Roux, 2018. "A Comparative Study of Divisive and Agglomerative Hierarchical Clustering Algorithms," Journal of Classification, Springer;The Classification Society, vol. 35(2), pages 345-366, July.
    12. Serra, Teresa, 2011. "Volatility spillovers between food and energy markets: A semiparametric approach," Energy Economics, Elsevier, vol. 33(6), pages 1155-1164.
    13. López Cabrera, Brenda & Schulz, Franziska, 2016. "Volatility linkages between energy and agricultural commodity prices," Energy Economics, Elsevier, vol. 54(C), pages 190-203.
    14. Ke Tang & Wei Xiong, 2010. "Index Investment and Financialization of Commodities," NBER Working Papers 16385, National Bureau of Economic Research, Inc.
    15. Musmeci, Nicoló & Aste, Tomaso & Di Matteo, T., 2015. "Relation between financial market structure and the real economy: comparison between clustering methods," LSE Research Online Documents on Economics 61644, London School of Economics and Political Science, LSE Library.
    16. Spencer, Simon & Bredin, Don & Conlon, Thomas, 2018. "Energy and agricultural commodities revealed through hedging characteristics: Evidence from developing and mature markets," Journal of Commodity Markets, Elsevier, vol. 9(C), pages 1-20.
    17. Li, Kehua & Yang, Rebecca Jing & Robinson, Duane & Ma, Jun & Ma, Zhenjun, 2019. "An agglomerative hierarchical clustering-based strategy using Shared Nearest Neighbours and multiple dissimilarity measures to identify typical daily electricity usage profiles of university library b," Energy, Elsevier, vol. 174(C), pages 735-748.
    18. Cashin, Paul & McDermott, C. John & Pattillo, Catherine, 2004. "Terms of trade shocks in Africa: are they short-lived or long-lived?," Journal of Development Economics, Elsevier, vol. 73(2), pages 727-744, April.
    19. Reboredo, Juan C. & Ugolini, Andrea, 2015. "Systemic risk in European sovereign debt markets: A CoVaR-copula approach," Journal of International Money and Finance, Elsevier, vol. 51(C), pages 214-244.
    20. Batten, Jonathan A. & Ciner, Cetin & Lucey, Brian M., 2010. "The macroeconomic determinants of volatility in precious metals markets," Resources Policy, Elsevier, vol. 35(2), pages 65-71, June.
    21. Fan Cai & Nhien-An Le-Khac & Tahar Kechadi, 2016. "Clustering Approaches for Financial Data Analysis: a Survey," Papers 1609.08520, arXiv.org.
    22. Song, Jung Yoon & Chang, Woojin & Song, Jae Wook, 2019. "Cluster analysis on the structure of the cryptocurrency market via Bitcoin–Ethereum filtering," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 527(C).
    23. Silvennoinen, Annastiina & Thorp, Susan, 2013. "Financialization, crisis and commodity correlation dynamics," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 24(C), pages 42-65.
    24. Jondeau, Eric & Rockinger, Michael, 2003. "Conditional volatility, skewness, and kurtosis: existence, persistence, and comovements," Journal of Economic Dynamics and Control, Elsevier, vol. 27(10), pages 1699-1737, August.
    25. Rehman, Mobeen Ur & Vinh Vo, Xuan, 2020. "Cryptocurrencies and precious metals: A closer look from diversification perspective," Resources Policy, Elsevier, vol. 66(C).
    26. Gautier Marti & Frank Nielsen & Miko{l}aj Bi'nkowski & Philippe Donnat, 2017. "A review of two decades of correlations, hierarchies, networks and clustering in financial markets," Papers 1703.00485, arXiv.org, revised Nov 2020.
    27. Hammoudeh, Shawkat & Araújo Santos, Paulo & Al-Hassan, Abdullah, 2013. "Downside risk management and VaR-based optimal portfolios for precious metals, oil and stocks," The North American Journal of Economics and Finance, Elsevier, vol. 25(C), pages 318-334.
    28. Alexander, Carol & Lazar, Emese & Stanescu, Silvia, 2021. "Analytic moments for GJR-GARCH (1, 1) processes," International Journal of Forecasting, Elsevier, vol. 37(1), pages 105-124.
    29. Tumminello, Michele & Lillo, Fabrizio & Mantegna, Rosario N., 2010. "Correlation, hierarchies, and networks in financial markets," Journal of Economic Behavior & Organization, Elsevier, vol. 75(1), pages 40-58, July.
    30. Zhang, Yue-Jun & Wei, Yi-Ming, 2010. "The crude oil market and the gold market: Evidence for cointegration, causality and price discovery," Resources Policy, Elsevier, vol. 35(3), pages 168-177, September.
    31. Michał Falkowski, 2011. "Financialization of commodities," Contemporary Economics, University of Economics and Human Sciences in Warsaw., vol. 5(4), December.
    32. Nicolo Musmeci & Tomaso Aste & Tiziana Di Matteo, 2014. "Relation between Financial Market Structure and the Real Economy: Comparison between Clustering Methods," Papers 1406.0496, arXiv.org, revised Jan 2015.
    33. Todorova, Neda & Worthington, Andrew & Souček, Michael, 2014. "Realized volatility spillovers in the non-ferrous metal futures market," Resources Policy, Elsevier, vol. 39(C), pages 21-31.
    34. Sunil Kumar & Nivedita Deo, 2012. "Correlation, Network and Multifractal Analysis of Global Financial Indices," Papers 1202.0409, arXiv.org.
    35. Gema Fernández-Avilés & José-María Montero & Lidia Sanchis-Marco, 2020. "Extreme downside risk co-movement in commodity markets during distress periods: a multidimensional scaling approach," The European Journal of Finance, Taylor & Francis Journals, vol. 26(12), pages 1207-1237, August.
    36. Robert Tibshirani & Guenther Walther & Trevor Hastie, 2001. "Estimating the number of clusters in a data set via the gap statistic," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 411-423.
    37. Demiralay, Sercan & Ulusoy, Veysel, 2014. "Non-linear volatility dynamics and risk management of precious metals," The North American Journal of Economics and Finance, Elsevier, vol. 30(C), pages 183-202.
    38. Chris Brooks, 2005. "Autoregressive Conditional Kurtosis," Journal of Financial Econometrics, Oxford University Press, vol. 3(3), pages 399-421.
    39. Nazlioglu, Saban & Erdem, Cumhur & Soytas, Ugur, 2013. "Volatility spillover between oil and agricultural commodity markets," Energy Economics, Elsevier, vol. 36(C), pages 658-665.
    40. William Day & Herbert Edelsbrunner, 1984. "Efficient algorithms for agglomerative hierarchical clustering methods," Journal of Classification, Springer;The Classification Society, vol. 1(1), pages 7-24, December.
    41. Conlon, Thomas & McGee, Richard, 2020. "Safe haven or risky hazard? Bitcoin during the Covid-19 bear market," Finance Research Letters, Elsevier, vol. 35(C).
    42. Broadstock, David C. & Filis, George, 2014. "Oil price shocks and stock market returns: New evidence from the United States and China," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 33(C), pages 417-433.
    43. Sakemoto, Ryuta, 2018. "Do precious and industrial metals act as hedges and safe havens for currency portfolios?," Finance Research Letters, Elsevier, vol. 24(C), pages 256-262.
    44. Charles, Amélie & Darné, Olivier & Kim, Jae H., 2015. "Will precious metals shine? A market efficiency perspective," International Review of Financial Analysis, Elsevier, vol. 41(C), pages 284-291.
    45. Du, Xiaodong & Yu, Cindy L. & Hayes, Dermot J., 2011. "Speculation and volatility spillover in the crude oil and agricultural commodity markets: A Bayesian analysis," Energy Economics, Elsevier, vol. 33(3), pages 497-503, May.
    46. Mensi, Walid & Hammoudeh, Shawkat & Reboredo, Juan C. & Nguyen, Duc Khuong, 2015. "Are Sharia stocks, gold and U.S. Treasury hedges and/or safe havens for the oil-based GCC markets?," Emerging Markets Review, Elsevier, vol. 24(C), pages 101-121.
    47. Mahfuzul Haque & Imen Kouki, 2009. "Effect of 9/11 on the conditional time-varying equity risk premium: evidence from developed markets," Journal of Risk Finance, Emerald Group Publishing, vol. 10(3), pages 261-276, May.
    48. Rehman, Mobeen Ur & Shahzad, Syed Jawad Hussain & Uddin, Gazi Salah & Hedström, Axel, 2018. "Precious metal returns and oil shocks: A time varying connectedness approach," Resources Policy, Elsevier, vol. 58(C), pages 77-89.
    49. Plourde, André & Watkins, G. C., 1998. "Crude oil prices between 1985 and 1994: how volatile in relation to other commodities?," Resource and Energy Economics, Elsevier, vol. 20(3), pages 245-262, September.
    50. Changyu Liu & Muhammad Abubakr Naeem & Mobeen Ur Rehman & Saqib Farid & Syed Jawad Hussain Shahzad, 2020. "Oil as Hedge, Safe-Haven, and Diversifier for Conventional Currencies," Energies, MDPI, vol. 13(17), pages 1-19, August.
    51. Pattarin, Francesco & Paterlini, Sandra & Minerva, Tommaso, 2004. "Clustering financial time series: an application to mutual funds style analysis," Computational Statistics & Data Analysis, Elsevier, vol. 47(2), pages 353-372, September.
    52. Nicoló Musmeci & Tomaso Aste & T Di Matteo, 2015. "Relation between Financial Market Structure and the Real Economy: Comparison between Clustering Methods," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-24, March.
    53. Glenn Milligan, 1980. "An examination of the effect of six types of error perturbation on fifteen clustering algorithms," Psychometrika, Springer;The Psychometric Society, vol. 45(3), pages 325-342, September.
    54. Naeem, Muhammad Abubakr & Balli, Faruk & Shahzad, Syed Jawad Hussain & de Bruin, Anne, 2020. "Energy commodity uncertainties and the systematic risk of US industries," Energy Economics, Elsevier, vol. 85(C).
    55. Chen, Mei-Hsiu, 2010. "Understanding world metals prices--Returns, volatility and diversification," Resources Policy, Elsevier, vol. 35(3), pages 127-140, September.
    56. Reboredo, Juan C. & Rivera-Castro, Miguel A. & Ugolini, Andrea, 2016. "Downside and upside risk spillovers between exchange rates and stock prices," Journal of Banking & Finance, Elsevier, vol. 62(C), pages 76-96.
    57. Al-Yahyaee, Khamis Hamed & Mensi, Walid & Rehman, Mobeen Ur & Vo, Xuan Vinh & Kang, Sang Hoon, 2020. "Do Islamic stocks outperform conventional stock sectors during normal and crisis periods? Extreme co-movements and portfolio management analysis," Pacific-Basin Finance Journal, Elsevier, vol. 62(C).
    58. Corbet, Shaen & Hou, Yang (Greg) & Hu, Yang & Larkin, Charles & Oxley, Les, 2020. "Any port in a storm: Cryptocurrency safe-havens during the COVID-19 pandemic," Economics Letters, Elsevier, vol. 194(C).
    59. Rehman, Mobeen Ur & Bouri, Elie & Eraslan, Veysel & Kumar, Satish, 2019. "Energy and non-energy commodities: An asymmetric approach towards portfolio diversification in the commodity market," Resources Policy, Elsevier, vol. 63(C), pages 1-1.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rehman, Mobeen Ur & Vo, Xuan Vinh & Ko, Hee-Un & Ahmad, Nasir & Kang, Sang Hoon, 2023. "Quantile connectedness between Chinese stock and commodity futures markets," Research in International Business and Finance, Elsevier, vol. 64(C).
    2. James Ming Chen & Mobeen Ur Rehman, 2021. "A Pattern New in Every Moment: The Temporal Clustering of Markets for Crude Oil, Refined Fuels, and Other Commodities," Energies, MDPI, vol. 14(19), pages 1-58, September.
    3. Bentes, Sónia R., 2022. "On the stylized facts of precious metals’ volatility: A comparative analysis of pre- and during COVID-19 crisis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 600(C).
    4. Charalampos Agiropoulos & Georgios Galanos & Thomas Poufinas, 2021. "Entrepreneurship, Income Inequality and Public Spending: A Spatial Analysis into Regional Determinants of Growing Firms in Greece," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 27(3), pages 197-218, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James Ming Chen & Mobeen Ur Rehman, 2021. "A Pattern New in Every Moment: The Temporal Clustering of Markets for Crude Oil, Refined Fuels, and Other Commodities," Energies, MDPI, vol. 14(19), pages 1-58, September.
    2. Naeem, Muhammad Abubakr & Hasan, Mudassar & Arif, Muhammad & Suleman, Muhammad Tahir & Kang, Sang Hoon, 2022. "Oil and gold as a hedge and safe-haven for metals and agricultural commodities with portfolio implications," Energy Economics, Elsevier, vol. 105(C).
    3. Mensi, Walid & Rehman, Mobeen Ur & Vo, Xuan Vinh, 2020. "Spillovers and co-movements between precious metals and energy markets: Implications on portfolio management," Resources Policy, Elsevier, vol. 69(C).
    4. Davide, Marinella & Vesco, Paola, 2016. "Alternative Approaches for Rating INDCs: a Comparative Analysis," MITP: Mitigation, Innovation and Transformation Pathways 232716, Fondazione Eni Enrico Mattei (FEEM).
    5. Reboredo, Juan C. & Ugolini, Andrea, 2015. "Downside/upside price spillovers between precious metals: A vine copula approach," The North American Journal of Economics and Finance, Elsevier, vol. 34(C), pages 84-102.
    6. Rehman, Mobeen Ur & Vo, Xuan Vinh, 2021. "Energy commodities, precious metals and industrial metal markets: A nexus across different investment horizons and market conditions," Resources Policy, Elsevier, vol. 70(C).
    7. Behmiri, Niaz Bashiri & Manera, Matteo & Nicolini, Marcella, 2016. "Understanding Dynamic Conditional Correlations between Commodities Futures Markets," ESP: Energy Scenarios and Policy 232223, Fondazione Eni Enrico Mattei (FEEM).
    8. Rehman, Mobeen Ur, 2020. "Do bitcoin and precious metals do any good together? An extreme dependence and risk spillover analysis," Resources Policy, Elsevier, vol. 68(C).
    9. Guhathakurta, Kousik & Dash, Saumya Ranjan & Maitra, Debasish, 2020. "Period specific volatility spillover based connectedness between oil and other commodity prices and their portfolio implications," Energy Economics, Elsevier, vol. 85(C).
    10. Khalfaoui, Rabeh & Tiwari, Aviral Kumar & Kablan, Sandrine & Hammoudeh, Shawkat, 2021. "Interdependence and lead-lag relationships between the oil price and metal markets: Fresh insights from the wavelet and quantile coherency approaches," Energy Economics, Elsevier, vol. 101(C).
    11. Al-Yahyaee, Khamis Hamed & Rehman, Mobeen Ur & Wanas Al-Jarrah, Idries Mohammad & Mensi, Walid & Vo, Xuan Vinh, 2020. "Co-movements and spillovers between prices of precious metals and non-ferrous metals: A multiscale analysis," Resources Policy, Elsevier, vol. 67(C).
    12. Gong, Xu & Xu, Jun & Liu, Tangyong & Zhou, Zicheng, 2022. "Dynamic volatility connectedness between industrial metal markets," The North American Journal of Economics and Finance, Elsevier, vol. 63(C).
    13. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    14. Al-Yahyaee, Khamis Hamed & Mensi, Walid & Maitra, Debasish & Al-Jarrah, Idries Mohammad Wanas, 2019. "Portfolio management and dependencies among precious metal markets: Evidence from a Copula quantile-on-quantile approach," Resources Policy, Elsevier, vol. 64(C).
    15. Antonakakis, Nikolaos & Kizys, Renatas, 2015. "Dynamic spillovers between commodity and currency markets," International Review of Financial Analysis, Elsevier, vol. 41(C), pages 303-319.
    16. Bhatia, Vaneet & Das, Debojyoti & Tiwari, Aviral Kumar & Shahbaz, Muhammad & Hasim, Haslifah M., 2018. "Do precious metal spot prices influence each other? Evidence from a nonparametric causality-in-quantiles approach," Resources Policy, Elsevier, vol. 55(C), pages 244-252.
    17. Godil, Danish Iqbal & Sarwat, Salman & Khan, Muhammad Kamran & Ashraf, Muhammad Sajjad & Sharif, Arshian & Ozturk, Ilhan, 2022. "How the price dynamics of energy resources and precious metals interact with conventional and Islamic Stocks: Fresh insight from dynamic ARDL approach," Resources Policy, Elsevier, vol. 75(C).
    18. Vigne, Samuel A. & Lucey, Brian M. & O’Connor, Fergal A. & Yarovaya, Larisa, 2017. "The financial economics of white precious metals — A survey," International Review of Financial Analysis, Elsevier, vol. 52(C), pages 292-308.
    19. Walid Mensi & Debasish Maitra & Refk Selmi & Xuan Vinh Vo, 2023. "Extreme dependencies and spillovers between gold and stock markets: evidence from MENA countries," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-27, December.
    20. Nikhil Kaushik, 2018. "Do global oil price shocks affect Indian metal market?," Energy & Environment, , vol. 29(6), pages 891-904, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jrpoli:v:73:y:2021:i:c:s0301420721001768. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/30467 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.