IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2022i1p4-d1008576.html
   My bibliography  Save this article

Forecasting the Crude Oil Spot Price with Bayesian Symbolic Regression

Author

Listed:
  • Krzysztof Drachal

    (Faculty of Economic Sciences, University of Warsaw, 00-927 Warsaw, Poland)

Abstract

In this study, the crude oil spot price is forecast using Bayesian symbolic regression (BSR). In particular, the initial parameters specification of BSR is analysed. Contrary to the conventional approach to symbolic regression, which is based on genetic programming methods, BSR applies Bayesian algorithms to evolve the set of expressions (functions). This econometric method is able to deal with variable uncertainty (feature selection) issues in oil price forecasting. Secondly, this research seems to be the first application of BSR to oil price forecasting. Monthly data between January 1986 and April 2021 are analysed. As well as BSR, several other methods (also able to deal with variable uncertainty) are used as benchmark models, such as LASSO and ridge regressions, dynamic model averaging, and Bayesian model averaging. The more common ARIMA and naïve methods are also used, together with several time-varying parameter regressions. As a result, this research not only presents a novel and original application of the BSR method but also provides a concise and uniform comparison of the application of several popular forecasting methods for the crude oil spot price. Robustness checks are also performed to strengthen the obtained conclusions. It is found that the suitable selection of functions and operators for BSR initialization is an important, but not trivial, task. Unfortunately, BSR does not result in forecasts that are statistically significantly more accurate than the benchmark models. However, BSR is computationally faster than the genetic programming-based symbolic regression.

Suggested Citation

  • Krzysztof Drachal, 2022. "Forecasting the Crude Oil Spot Price with Bayesian Symbolic Regression," Energies, MDPI, vol. 16(1), pages 1-29, December.
    • Handle: RePEc:gam:jeners:v:16:y:2022:i:1:p:4-:d:1008576
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/1/4/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/1/4/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Akram, Q. Farooq, 2020. "Oil price drivers, geopolitical uncertainty and oil exporters' currencies," Energy Economics, Elsevier, vol. 89(C).
    2. Jain, Anshul & Biswal, P.C., 2016. "Dynamic linkages among oil price, gold price, exchange rate, and stock market in India," Resources Policy, Elsevier, vol. 49(C), pages 179-185.
    3. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    4. Reboredo, Juan C., 2012. "Modelling oil price and exchange rate co-movements," Journal of Policy Modeling, Elsevier, vol. 34(3), pages 419-440.
    5. Ron Alquist & Lutz Kilian, 2010. "What do we learn from the price of crude oil futures?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 539-573.
    6. Kilian, Lutz, 2019. "Measuring global real economic activity: Do recent critiques hold up to scrutiny?," Economics Letters, Elsevier, vol. 178(C), pages 106-110.
    7. Büyükşahin, Bahattin & Robe, Michel A., 2014. "Speculators, commodities and cross-market linkages," Journal of International Money and Finance, Elsevier, vol. 42(C), pages 38-70.
    8. Elkhan Richard Sadik-Zada & Wilhelm Loewenstein & Yadulla Hasanli, 2021. "Production linkages and dynamic fiscal employment effects of the extractive industries: input-output and nonlinear ARDL analyses of Azerbaijani economy," Mineral Economics, Springer;Raw Materials Group (RMG);Luleå University of Technology, vol. 34(1), pages 3-18, April.
    9. James D. Hamilton, 2009. "Causes and Consequences of the Oil Shock of 2007-08," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 40(1 (Spring), pages 215-283.
    10. Boqiang Lin & Jianglong Li, 2015. "The Determinants of Endogenous Oil Price: Considering the Influence from China," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 51(5), pages 1034-1050, September.
    11. Alquist, Ron & Kilian, Lutz & Vigfusson, Robert J., 2013. "Forecasting the Price of Oil," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 427-507, Elsevier.
    12. Degiannakis, Stavros & Filis, George, 2018. "Forecasting oil prices: High-frequency financial data are indeed useful," Energy Economics, Elsevier, vol. 76(C), pages 388-402.
    13. Hong, Harrison & Yogo, Motohiro, 2012. "What does futures market interest tell us about the macroeconomy and asset prices?," Journal of Financial Economics, Elsevier, vol. 105(3), pages 473-490.
    14. Roubaud, David & Arouri, Mohamed, 2018. "Oil prices, exchange rates and stock markets under uncertainty and regime-switching," Finance Research Letters, Elsevier, vol. 27(C), pages 28-33.
    15. Wang, Yudong & Liu, Li & Wu, Chongfeng, 2017. "Forecasting the real prices of crude oil using forecast combinations over time-varying parameter models," Energy Economics, Elsevier, vol. 66(C), pages 337-348.
    16. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    17. Yu-Chin Chen & Kenneth S. Rogoff & Barbara Rossi, 2010. "Can Exchange Rates Forecast Commodity Prices?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(3), pages 1145-1194.
    18. Goulet Coulombe, Philippe & Leroux, Maxime & Stevanovic, Dalibor & Surprenant, Stéphane, 2021. "Macroeconomic data transformations matter," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1338-1354.
    19. Lu-Tao Zhao & Shun-Gang Wang & Zhi-Gang Zhang, 2020. "Oil Price Forecasting Using a Time-Varying Approach," Energies, MDPI, vol. 13(6), pages 1-16, March.
    20. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    21. Niftiyev, Ibrahim, 2020. "Analysis of Inflation Trends in Urban and Rural Parts of Azerbaijan: Main Drivers and Links to Oil Revenue," EconStor Preprints 226217, ZBW - Leibniz Information Centre for Economics.
    22. Geweke, John & Koop, Gary & van Dijk, Herman (ed.), 2011. "The Oxford Handbook of Bayesian Econometrics," OUP Catalogue, Oxford University Press, number 9780199559084.
    23. Donghua Wang & Tianhui Fang, 2022. "Forecasting Crude Oil Prices with a WT-FNN Model," Energies, MDPI, vol. 15(6), pages 1-21, March.
    24. Wu, Binrong & Wang, Lin & Wang, Sirui & Zeng, Yu-Rong, 2021. "Forecasting the U.S. oil markets based on social media information during the COVID-19 pandemic," Energy, Elsevier, vol. 226(C).
    25. Kleinberg, R.L. & Paltsev, S. & Ebinger, C.K.E. & Hobbs, D.A. & Boersma, T., 2018. "Tight oil market dynamics: Benchmarks, breakeven points, and inelasticities," Energy Economics, Elsevier, vol. 70(C), pages 70-83.
    26. Basher, Syed Abul & Haug, Alfred A. & Sadorsky, Perry, 2012. "Oil prices, exchange rates and emerging stock markets," Energy Economics, Elsevier, vol. 34(1), pages 227-240.
    27. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    28. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    29. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    30. Kilian, Lutz & Zhou, Xiaoqing, 2018. "Modeling fluctuations in the global demand for commodities," Journal of International Money and Finance, Elsevier, vol. 88(C), pages 54-78.
    31. Drachal, Krzysztof, 2016. "Forecasting spot oil price in a dynamic model averaging framework — Have the determinants changed over time?," Energy Economics, Elsevier, vol. 60(C), pages 35-46.
    32. John Baffes & M. Ayhan Kose & Franziska Ohnsorge & Marc Stocker, 2015. "The Great Plunge in Oil Prices: Causes, Consequences, and Policy Responses," Policy Research Notes (PRNs) 94725, The World Bank.
    33. Koop, Gary & Korobilis, Dimitris, 2013. "Large time-varying parameter VARs," Journal of Econometrics, Elsevier, vol. 177(2), pages 185-198.
    34. David J. Ramberg and John E. Parsons, 2012. "The Weak Tie Between Natural Gas and Oil Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2).
    35. Hamilton, James D., 2011. "Nonlinearities And The Macroeconomic Effects Of Oil Prices," Macroeconomic Dynamics, Cambridge University Press, vol. 15(S3), pages 364-378, November.
    36. Narjes Zamani, 2016. "The Relationship between Crude Oil and Coal Markets: A New Approach," International Journal of Energy Economics and Policy, Econjournals, vol. 6(4), pages 801-805.
    37. El Hedi Arouri, Mohamed & Huong Dinh, Thanh & Khuong Nguyen, Duc, 2010. "Time-varying predictability in crude-oil markets: the case of GCC countries," Energy Policy, Elsevier, vol. 38(8), pages 4371-4380, August.
    38. Nadal, Raquel & Szklo, Alexandre & Lucena, André, 2017. "Time-varying impacts of demand and supply oil shocks on correlations between crude oil prices and stock markets indices," Research in International Business and Finance, Elsevier, vol. 42(C), pages 1011-1020.
    39. Jiang Wu & Feng Miu & Taiyong Li, 2020. "Daily Crude Oil Price Forecasting Based on Improved CEEMDAN, SCA, and RVFL: A Case Study in WTI Oil Market," Energies, MDPI, vol. 13(7), pages 1-20, April.
    40. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    41. Witold Orzeszko, 2021. "Nonlinear Causality between Crude Oil Prices and Exchange Rates: Evidence and Forecasting," Energies, MDPI, vol. 14(19), pages 1-16, September.
    42. Wang, Qiang & Li, Shuyu & Li, Rongrong, 2018. "China's dependency on foreign oil will exceed 80% by 2030: Developing a novel NMGM-ARIMA to forecast China's foreign oil dependence from two dimensions," Energy, Elsevier, vol. 163(C), pages 151-167.
    43. Lutz Kilian, 2009. "Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market," American Economic Review, American Economic Association, vol. 99(3), pages 1053-1069, June.
    44. Sakaki, Hamid, 2019. "Oil price shocks and the equity market: Evidence for the S&P 500 sectoral indices," Research in International Business and Finance, Elsevier, vol. 49(C), pages 137-155.
    45. Yang, Guangfei & Sun, Tao & Wang, Jianliang & Li, Xianneng, 2015. "Modeling the nexus between carbon dioxide emissions and economic growth," Energy Policy, Elsevier, vol. 86(C), pages 104-117.
    46. Charles R. Harris & K. Jarrod Millman & Stéfan J. Walt & Ralf Gommers & Pauli Virtanen & David Cournapeau & Eric Wieser & Julian Taylor & Sebastian Berg & Nathaniel J. Smith & Robert Kern & Matti Picu, 2020. "Array programming with NumPy," Nature, Nature, vol. 585(7825), pages 357-362, September.
    47. Theodosios Perifanis & Athanasios Dagoumas, 2018. "Price and Volatility Spillovers Between the US Crude Oil and Natural Gas Wholesale Markets," Energies, MDPI, vol. 11(10), pages 1-25, October.
    48. Miao, Hong & Ramchander, Sanjay & Wang, Tianyang & Yang, Dongxiao, 2017. "Influential factors in crude oil price forecasting," Energy Economics, Elsevier, vol. 68(C), pages 77-88.
    49. Lance J. Bachmeier & James M. Griffin, 2006. "Testing for Market Integration: Crude Oil, Coal, and Natural Gas," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 55-72.
    50. Krzysztof Drachal, 2018. "Determining Time-Varying Drivers of Spot Oil Price in a Dynamic Model Averaging Framework," Energies, MDPI, vol. 11(5), pages 1-24, May.
    51. Elkhan Richard Sadik-Zada, 2021. "Addressing the growth and employment effects of the extractive industries: white and black box illustrations from Kazakhstan," Post-Communist Economies, Taylor & Francis Journals, vol. 33(4), pages 402-434, May.
    52. Huang, Shupei & An, Haizhong & Lucey, Brian, 2020. "How do dynamic responses of exchange rates to oil price shocks co-move? From a time-varying perspective," Energy Economics, Elsevier, vol. 86(C).
    53. Salisu, Afees A. & Isah, Kazeem O. & Raheem, Ibrahim D., 2019. "Testing the predictability of commodity prices in stock returns of G7 countries: Evidence from a new approach," Resources Policy, Elsevier, vol. 64(C).
    54. Gary Koop, 2017. "Bayesian Methods for Empirical Macroeconomics," Review of Economic Analysis, Digital Initiatives at the University of Waterloo Library, vol. 9(1), pages 33-56, June.
    55. Chatziantoniou, Ioannis & Filippidis, Michail & Filis, George & Gabauer, David, 2021. "A closer look into the global determinants of oil price volatility," Energy Economics, Elsevier, vol. 95(C).
    56. Uddin, Gazi Salah & Tiwari, Aviral Kumar & Arouri, Mohamed & Teulon, Frédéric, 2013. "On the relationship between oil price and exchange rates: A wavelet analysis," Economic Modelling, Elsevier, vol. 35(C), pages 502-507.
    57. Massimo Guidolin & Manuela Pedio, 2021. "Forecasting commodity futures returns with stepwise regressions: Do commodity-specific factors help?," Annals of Operations Research, Springer, vol. 299(1), pages 1317-1356, April.
    58. Sung Je Byun, 2017. "Speculation in Commodity Futures Markets, Inventories and the Price of Crude Oil," The Energy Journal, International Association for Energy Economics, vol. 0(Number 5).
    59. Chen, Pei-Fen & Lee, Chien-Chiang & Zeng, Jhih-Hong, 2014. "The relationship between spot and futures oil prices: Do structural breaks matter?," Energy Economics, Elsevier, vol. 43(C), pages 206-217.
    60. Mauro Bernardi & Leopoldo Catania, 2018. "The model confidence set package for R," International Journal of Computational Economics and Econometrics, Inderscience Enterprises Ltd, vol. 8(2), pages 144-158.
    61. Katarzyna Czech & Ibrahim Niftiyev, 2021. "The Impact of Oil Price Shocks on Oil-Dependent Countries’ Currencies: The Case of Azerbaijan and Kazakhstan," JRFM, MDPI, vol. 14(9), pages 1-14, September.
    62. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
    63. Luciana Juvenal & Ivan Petrella, 2015. "Speculation in the Oil Market," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 621-649, June.
    64. Working, Holbrook, 1960. "Speculation on Hedging Markets," Food Research Institute Studies, Stanford University, Food Research Institute, vol. 1(2), pages 1-36.
    65. Zhenhua Liu & Zhihua Ding & Tao Lv & Jy S. Wu & Wei Qiang, 2019. "Financial factors affecting oil price change and oil-stock interactions: a review and future perspectives," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 95(1), pages 207-225, January.
    66. Yang, Guangfei & Li, Xianneng & Wang, Jianliang & Lian, Lian & Ma, Tieju, 2015. "Modeling oil production based on symbolic regression," Energy Policy, Elsevier, vol. 82(C), pages 48-61.
    67. Soohyeon Kim & Jungho Baek & Eunnyeong Heo, 2020. "Crude oil inventories: The two faces of Janus?," Empirical Economics, Springer, vol. 59(2), pages 1003-1018, August.
    68. Yoshino, Naoyuki & Alekhina, Victoriia, 2019. "Empirical Analysis of Global Oil Price Determinants at the Disaggregated Level Over the Last Two Decades," ADBI Working Papers 982, Asian Development Bank Institute.
    69. Mostafa, Mohamed M. & El-Masry, Ahmed A., 2016. "Oil price forecasting using gene expression programming and artificial neural networks," Economic Modelling, Elsevier, vol. 54(C), pages 40-53.
    70. Beckmann, Joscha & Czudaj, Robert L. & Arora, Vipin, 2020. "The relationship between oil prices and exchange rates: Revisiting theory and evidence," Energy Economics, Elsevier, vol. 88(C).
    71. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    72. Tiwari, Aviral Kumar & Sahadudheen, I., 2015. "Understanding the nexus between oil and gold," Resources Policy, Elsevier, vol. 46(P2), pages 85-91.
    73. Yang Feng & Qingfeng Liu & Qingsong Yao & Guoqing Zhao, 2022. "Model Averaging for Nonlinear Regression Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(2), pages 785-798, April.
    74. Krzysztof Drachal, 2018. "Some Novel Bayesian Model Combination Schemes: An Application to Commodities Prices," Sustainability, MDPI, vol. 10(8), pages 1-27, August.
    75. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    76. Gargano, Antonio & Timmermann, Allan, 2014. "Forecasting commodity price indexes using macroeconomic and financial predictors," International Journal of Forecasting, Elsevier, vol. 30(3), pages 825-843.
    77. Zhang, Yue-Jun & Wei, Yi-Ming, 2010. "The crude oil market and the gold market: Evidence for cointegration, causality and price discovery," Resources Policy, Elsevier, vol. 35(3), pages 168-177, September.
    78. Jaehyung An & Alexey Mikhaylov & Nikita Moiseev, 2019. "Oil Price Predictors: Machine Learning Approach," International Journal of Energy Economics and Policy, Econjournals, vol. 9(5), pages 1-6.
    79. Amor Aniss Benmoussa & Reinhard Ellwanger & Stephen Snudden, 2020. "The New Benchmark for Forecasts of the Real Price of Crude Oil," Staff Working Papers 20-39, Bank of Canada.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    2. Drachal, Krzysztof, 2021. "Forecasting selected energy commodities prices with Bayesian dynamic finite mixtures," Energy Economics, Elsevier, vol. 99(C).
    3. Drachal, Krzysztof, 2018. "Comparison between Bayesian and information-theoretic model averaging: Fossil fuels prices example," Energy Economics, Elsevier, vol. 74(C), pages 208-251.
    4. Krzysztof Drachal, 2018. "Some Novel Bayesian Model Combination Schemes: An Application to Commodities Prices," Sustainability, MDPI, vol. 10(8), pages 1-27, August.
    5. Drachal, Krzysztof, 2021. "Forecasting crude oil real prices with averaging time-varying VAR models," Resources Policy, Elsevier, vol. 74(C).
    6. Simona Delle Chiaie & Laurent Ferrara & Domenico Giannone, 2022. "Common factors of commodity prices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 461-476, April.
    7. Nima Nonejad, 2020. "A detailed look at crude oil price volatility prediction using macroeconomic variables," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(7), pages 1119-1141, November.
    8. Cheng, Xian & Wu, Peng & Liao, Stephen Shaoyi & Wang, Xuelian, 2023. "An integrated model for crude oil forecasting: Causality assessment and technical efficiency," Energy Economics, Elsevier, vol. 117(C).
    9. Drachal, Krzysztof, 2016. "Forecasting spot oil price in a dynamic model averaging framework — Have the determinants changed over time?," Energy Economics, Elsevier, vol. 60(C), pages 35-46.
    10. Liu, Li & Wang, Yudong & Yang, Li, 2018. "Predictability of crude oil prices: An investor perspective," Energy Economics, Elsevier, vol. 75(C), pages 193-205.
    11. Wang, Yudong & Hao, Xianfeng, 2023. "Forecasting the real prices of crude oil: What is the role of parameter instability?," Energy Economics, Elsevier, vol. 117(C).
    12. Nonejad, Nima, 2021. "Predicting the return on the spot price of crude oil out-of-sample by conditioning on news-based uncertainty measures: Some new empirical results," Energy Economics, Elsevier, vol. 104(C).
    13. Dbouk, Wassim & Jamali, Ibrahim, 2018. "Predicting daily oil prices: Linear and non-linear models," Research in International Business and Finance, Elsevier, vol. 46(C), pages 149-165.
    14. Hao, Xianfeng & Zhao, Yuyang & Wang, Yudong, 2020. "Forecasting the real prices of crude oil using robust regression models with regularization constraints," Energy Economics, Elsevier, vol. 86(C).
    15. Albulescu, Claudiu Tiberiu & Ajmi, Ahdi Noomen, 2021. "Oil price and US dollar exchange rate: Change detection of bi-directional causal impact," Energy Economics, Elsevier, vol. 100(C).
    16. Cotter, John & Eyiah-Donkor, Emmanuel & Potì, Valerio, 2023. "Commodity futures return predictability and intertemporal asset pricing," Journal of Commodity Markets, Elsevier, vol. 31(C).
    17. Krzysztof Drachal, 2018. "Determining Time-Varying Drivers of Spot Oil Price in a Dynamic Model Averaging Framework," Energies, MDPI, vol. 11(5), pages 1-24, May.
    18. Nonejad, Nima, 2022. "Understanding the conditional out-of-sample predictive impact of the price of crude oil on aggregate equity return volatility," The North American Journal of Economics and Finance, Elsevier, vol. 62(C).
    19. Wang, Yudong & Liu, Li & Diao, Xundi & Wu, Chongfeng, 2015. "Forecasting the real prices of crude oil under economic and statistical constraints," Energy Economics, Elsevier, vol. 51(C), pages 599-608.
    20. Liu, Li & Ma, Feng & Wang, Yudong, 2015. "Forecasting excess stock returns with crude oil market data," Energy Economics, Elsevier, vol. 48(C), pages 316-324.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2022:i:1:p:4-:d:1008576. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.