IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/10162.html
   My bibliography  Save this paper

A General Approach to Recovering Market Expectations from Futures Prices With an Application to Crude Oil

Author

Listed:
  • Baumeister, Christiane
  • Kilian, Lutz

Abstract

Futures markets are a potentially valuable source of information about market expectations. Exploiting this information has proved difficult in practice, because the presence of a timevarying risk premium often renders the futures price a poor measure of the market expectation of the price of the underlying asset. Even though the expectation in principle may be recovered by adjusting the futures price by the estimated risk premium, a common problem in applied work is that there are as many measures of market expectations as there are estimates of the risk premium. We propose a general solution to this problem that allows us to uniquely pin down the best possible estimate of the market expectation for any set of risk premium estimates. We illustrate this approach by solving the long-standing problem of how to recover the market expectation of the price of crude oil. We provide a new measure of oil price expectations that is considerably more accurate than the alternatives and more economically plausible. We discuss implications of our analysis for the estimation of economic models of energy-intensive durables, for the debate on speculation in oil markets, and for oil price forecasting.

Suggested Citation

  • Baumeister, Christiane & Kilian, Lutz, 2014. "A General Approach to Recovering Market Expectations from Futures Prices With an Application to Crude Oil," CEPR Discussion Papers 10162, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:10162
    as

    Download full text from publisher

    File URL: http://www.cepr.org/active/publications/discussion_papers/dp.php?dpno=10162
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kilian, Lutz & Lee, Thomas K., 2014. "Quantifying the speculative component in the real price of oil: The role of global oil inventories," Journal of International Money and Finance, Elsevier, vol. 42(C), pages 71-87.
    2. Ron Alquist & Lutz Kilian, 2010. "What do we learn from the price of crude oil futures?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 539-573.
    3. Alquist, Ron & Kilian, Lutz & Vigfusson, Robert J., 2013. "Forecasting the Price of Oil," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 427-507, Elsevier.
    4. Bassam Fattouh, Lutz Kilian, and Lavan Mahadeva, 2013. "The Role of Speculation in Oil Markets: What Have We Learned So Far?," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3).
    5. Hong, Harrison & Yogo, Motohiro, 2012. "What does futures market interest tell us about the macroeconomy and asset prices?," Journal of Financial Economics, Elsevier, vol. 105(3), pages 473-490.
    6. Meghan R. Busse & Christopher R. Knittel & Florian Zettelmeyer, 2013. "Are Consumers Myopic? Evidence from New and Used Car Purchases," American Economic Review, American Economic Association, vol. 103(1), pages 220-256, February.
    7. Erkko Etula, 2013. "Broker-Dealer Risk Appetite and Commodity Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 11(3), pages 486-521, June.
    8. Christiane Baumeister & Lutz Kilian, 2015. "Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 338-351, July.
    9. Bessembinder, Hendrik & Seguin, Paul J., 1993. "Price Volatility, Trading Volume, and Market Depth: Evidence from Futures Markets," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 28(1), pages 21-39, March.
    10. Piazzesi, Monika & Swanson, Eric T., 2008. "Futures prices as risk-adjusted forecasts of monetary policy," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 677-691, May.
    11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    12. Frans A. De Roon & Theo E. Nijman & Chris Veld, 2000. "Hedging Pressure Effects in Futures Markets," Journal of Finance, American Finance Association, vol. 55(3), pages 1437-1456, June.
    13. Ryan Kellogg, 2014. "The Effect of Uncertainty on Investment: Evidence from Texas Oil Drilling," American Economic Review, American Economic Association, vol. 104(6), pages 1698-1734, June.
    14. Hunt Allcott & Nathan Wozny, 2014. "Gasoline Prices, Fuel Economy, and the Energy Paradox," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 779-795, December.
    15. Apostolos Serletis, 2007. "Rational Expectations, Risk, and Efficiency in Energy Futures Markets," World Scientific Book Chapters, in: Quantitative And Empirical Analysis Of Energy Markets, chapter 2, pages 15-22, World Scientific Publishing Co. Pte. Ltd..
    16. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521632423, August.
    17. Allan G. Timmermann, 1993. "How Learning in Financial Markets Generates Excess Volatility and Predictability in Stock Prices," The Quarterly Journal of Economics, Oxford University Press, vol. 108(4), pages 1135-1145.
    18. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    19. Sadorsky, Perry, 2002. "Time-varying risk premiums in petroleum futures prices," Energy Economics, Elsevier, vol. 24(6), pages 539-556, November.
    20. Hamilton, James D. & Wu, Jing Cynthia, 2014. "Risk premia in crude oil futures prices," Journal of International Money and Finance, Elsevier, vol. 42(C), pages 9-37.
    21. Baumeister, Christiane & Kilian, Lutz & Lee, Thomas K., 2014. "Are there gains from pooling real-time oil price forecasts?," Energy Economics, Elsevier, vol. 46(S1), pages 33-43.
    22. Pagano Patrizio & Pisani Massimiliano, 2009. "Risk-Adjusted Forecasts of Oil Prices," The B.E. Journal of Macroeconomics, De Gruyter, vol. 9(1), pages 1-28, June.
    23. Soren T. Anderson & Ryan Kellogg & James M. Sallee & Richard T. Curtin, 2011. "Forecasting Gasoline Prices Using Consumer Surveys," American Economic Review, American Economic Association, vol. 101(3), pages 110-114, May.
    24. Pesaran, M. Hashem & Timmermann, Allan, 2009. "Testing Dependence Among Serially Correlated Multicategory Variables," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 325-337.
    25. Ang, Andrew & Piazzesi, Monika, 2003. "A no-arbitrage vector autoregression of term structure dynamics with macroeconomic and latent variables," Journal of Monetary Economics, Elsevier, vol. 50(4), pages 745-787, May.
    26. Kenneth J. Singleton, 2014. "Investor Flows and the 2008 Boom/Bust in Oil Prices," Management Science, INFORMS, vol. 60(2), pages 300-318, February.
    27. Bessembinder, Hendrik & Chan, Kalok, 1992. "Time-varying risk premia and forecastable returns in futures markets," Journal of Financial Economics, Elsevier, vol. 32(2), pages 169-193, October.
    28. Acharya, Viral V. & Lochstoer, Lars A. & Ramadorai, Tarun, 2013. "Limits to arbitrage and hedging: Evidence from commodity markets," Journal of Financial Economics, Elsevier, vol. 109(2), pages 441-465.
    29. James A. Kahn, 1986. "Gasoline Prices and the Used Automobile Market: A Rational Expectations Asset Price Approach," The Quarterly Journal of Economics, Oxford University Press, vol. 101(2), pages 323-339.
    30. Granger, C. W. J. & Newbold, Paul, 1986. "Forecasting Economic Time Series," Elsevier Monographs, Elsevier, edition 2, number 9780122951831 edited by Shell, Karl, December.
    31. Lutz Kilian & Daniel P. Murphy, 2014. "The Role Of Inventories And Speculative Trading In The Global Market For Crude Oil," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(3), pages 454-478, April.
    32. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    33. Fama, Eugene F & French, Kenneth R, 1987. "Commodity Futures Prices: Some Evidence on Forecast Power, Premiums,and the Theory of Storage," The Journal of Business, University of Chicago Press, vol. 60(1), pages 55-73, January.
    34. Robert S. Pindyck, 2001. "The Dynamics of Commodity Spot and Futures Markets: A Primer," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3), pages 1-30.
    35. Bessembinder, Hendrik, 1992. "Systematic Risk, Hedging Pressure, and Risk Premiums in Futures Markets," Review of Financial Studies, Society for Financial Studies, vol. 5(4), pages 637-667.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sung Je Byun, 2017. "Speculation in Commodity Futures Markets, Inventories and the Price of Crude Oil," The Energy Journal, International Association for Energy Economics, vol. 0(Number 5).
    2. Bielen, David A. & Newell, Richard G. & Pizer, William A., 2018. "Who did the ethanol tax credit benefit? An event analysis of subsidy incidence," Journal of Public Economics, Elsevier, vol. 161(C), pages 1-14.
    3. Ms. Natasha X Che & Mr. Sebastian Acevedo Mejia & Ke Wang & Ahmed El-Ashram & Julien Reynaud & Arnold McIntyre & Marcio Ronci & Mr. Mark Scott Lutz, 2016. "Caribbean Energy: Macro-Related Challenges," IMF Working Papers 2016/053, International Monetary Fund.
    4. Huang, Shupei & An, Haizhong & Wen, Shaobo & An, Feng, 2017. "Revisiting driving factors of oil price shocks across time scales," Energy, Elsevier, vol. 139(C), pages 617-629.
    5. Brandt, Michael W. & Gao, Lin, 2019. "Macro fundamentals or geopolitical events? A textual analysis of news events for crude oil," Journal of Empirical Finance, Elsevier, vol. 51(C), pages 64-94.
    6. Valenti, Daniele & Manera, Matteo & Sbuelz, Alessandro, 2020. "Interpreting the oil risk premium: Do oil price shocks matter?," Energy Economics, Elsevier, vol. 91(C).
    7. Christiane Baumeister & Lutz Kilian, 2016. "Understanding the Decline in the Price of Oil since June 2014," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 3(1), pages 131-158.
    8. De Rezende, Rafael B., 2017. "The interest rate effects of government bond purchases away from the lower bound," Journal of International Money and Finance, Elsevier, vol. 74(C), pages 165-186.
    9. Jorge Toro & Aarón Garavito & David Camilo López & Enrique Montes, 2015. "El choque petrolero y sus implicaciones en la economía colombiana," Borradores de Economia 906, Banco de la Republica de Colombia.
    10. Richard G. Newell and Brian C. Prest, 2019. "The Unconventional Oil Supply Boom: Aggregate Price Response from Microdata," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3).
    11. Konstantinos Gkillas & Rangan Gupta & Mark E. Wohar, 2020. "Oil shocks and volatility jumps," Review of Quantitative Finance and Accounting, Springer, vol. 54(1), pages 247-272, January.
    12. Balcılar, Mehmet & Demirer, Rıza & Hammoudeh, Shawkat, 2015. "Regional and global spillovers and diversification opportunities in the GCC equity sectors," Emerging Markets Review, Elsevier, vol. 24(C), pages 160-187.
    13. Gonzalo Cortazar & Cristobal Millard & Hector Ortega & Eduardo S. Schwartz, 2019. "Commodity Price Forecasts, Futures Prices, and Pricing Models," Management Science, INFORMS, vol. 65(9), pages 4141-4155, September.
    14. Ziran Li & Dermot J. Hayes & Keri L. Jacobs, 2018. "The weather premium in the U.S. corn market," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 38(3), pages 359-372, March.
    15. Kruse, Robinson & Wegener, Christoph, 2020. "Time-varying persistence in real oil prices and its determinant," Energy Economics, Elsevier, vol. 85(C).
    16. Efthymios G. Pavlidis & Ivan Paya & David A. Peel, 2018. "Using Market Expectations to Test for Speculative Bubbles in the Crude Oil Market," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 50(5), pages 833-856, August.
    17. Adams, Zeno & Collot, Solène & Kartsakli, Maria, 2020. "Have commodities become a financial asset? Evidence from ten years of Financialization," Energy Economics, Elsevier, vol. 89(C).
    18. Gambetti, Luca & Moretti, Laura, 2017. "News, Noise and Oil Price Swings," Research Technical Papers 12/RT/17, Central Bank of Ireland.
    19. Ben Zeev, Nadav & Pappa, Evi & Vicondoa, Alejandro, 2017. "Emerging economies business cycles: The role of commodity terms of trade news," Journal of International Economics, Elsevier, vol. 108(C), pages 368-376.
    20. Reinhard Ellwanger, 2017. "On the Tail Risk Premium in the Oil Market," Staff Working Papers 17-46, Bank of Canada.
    21. Jacopo Piana & Daniele Bianchi, 2017. "Expected Spot Prices and the Dynamics of Commodity Risk Premia," 2017 Meeting Papers 1149, Society for Economic Dynamics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    2. Valenti, Daniele & Manera, Matteo & Sbuelz, Alessandro, 2020. "Interpreting the oil risk premium: Do oil price shocks matter?," Energy Economics, Elsevier, vol. 91(C).
    3. Baumeister, Christiane & Guérin, Pierre & Kilian, Lutz, 2015. "Do high-frequency financial data help forecast oil prices? The MIDAS touch at work," International Journal of Forecasting, Elsevier, vol. 31(2), pages 238-252.
    4. Yannick Le Pen & Benoît Sévi, 2013. "Futures Trading and the Excess Comovement of Commodity Prices," Working Papers halshs-00793724, HAL.
    5. Ing-Haw Cheng & Wei Xiong, 2014. "Financialization of Commodity Markets," Annual Review of Financial Economics, Annual Reviews, vol. 6(1), pages 419-441, December.
    6. Sung Je Byun, 2017. "Speculation in Commodity Futures Markets, Inventories and the Price of Crude Oil," The Energy Journal, International Association for Energy Economics, vol. 0(Number 5).
    7. John Cotter & Emmanuel Eyiah-Donkor & Valerio Potì, 2020. "Commodity Futures Return Predictability and Intertemporal Asset Pricing," Working Papers 202011, Geary Institute, University College Dublin.
    8. James D. Hamilton & Jing Cynthia Wu, 2015. "Effects Of Index‐Fund Investing On Commodity Futures Prices," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(1), pages 187-205, February.
    9. Christiane Baumeister & Lutz Kilian & Thomas K. Lee, 2017. "Inside the Crystal Ball: New Approaches to Predicting the Gasoline Price at the Pump," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 275-295, March.
    10. Degiannakis, Stavros & Filis, George, 2018. "Forecasting oil prices: High-frequency financial data are indeed useful," Energy Economics, Elsevier, vol. 76(C), pages 388-402.
    11. Wang, Yudong & Liu, Li & Wu, Chongfeng, 2017. "Forecasting the real prices of crude oil using forecast combinations over time-varying parameter models," Energy Economics, Elsevier, vol. 66(C), pages 337-348.
    12. Efthymios G. Pavlidis & Ivan Paya & David A. Peel, 2018. "Using Market Expectations to Test for Speculative Bubbles in the Crude Oil Market," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 50(5), pages 833-856, August.
    13. Ames, Matthew & Bagnarosa, Guillaume & Matsui, Tomoko & Peters, Gareth W. & Shevchenko, Pavel V., 2020. "Which risk factors drive oil futures price curves?," Energy Economics, Elsevier, vol. 87(C).
    14. Boyd, Naomi E. & Harris, Jeffrey H. & Li, Bingxin, 2018. "An update on speculation and financialization in commodity markets," Journal of Commodity Markets, Elsevier, vol. 10(C), pages 91-104.
    15. Alquist, Ron & Kilian, Lutz & Vigfusson, Robert J., 2013. "Forecasting the Price of Oil," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 427-507, Elsevier.
    16. Georges Prat & Remzi Uctum, 2021. "Modeling ex-ante risk premia in the oil market," Post-Print hal-03318785, HAL.
    17. Cifuentes, Sebastián & Cortazar, Gonzalo & Ortega, Hector & Schwartz, Eduardo S., 2020. "Expected prices, futures prices and time-varying risk premiums: The case of copper," Resources Policy, Elsevier, vol. 69(C).
    18. Mayer, Herbert & Rathgeber, Andreas & Wanner, Markus, 2017. "Financialization of metal markets: Does futures trading influence spot prices and volatility?," Resources Policy, Elsevier, vol. 53(C), pages 300-316.
    19. Dbouk, Wassim & Jamali, Ibrahim, 2018. "Predicting daily oil prices: Linear and non-linear models," Research in International Business and Finance, Elsevier, vol. 46(C), pages 149-165.
    20. Jacopo Piana & Daniele Bianchi, 2017. "Expected Spot Prices and the Dynamics of Commodity Risk Premia," 2017 Meeting Papers 1149, Society for Economic Dynamics.

    More about this item

    Keywords

    Forecast; Futures; Market expectation; Model uncertainty; Oil price; Risk premium;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • D84 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Expectations; Speculations
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading
    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:10162. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://www.cepr.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.