IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v146y2008i2p293-303.html
   My bibliography  Save this article

Efficient forecast tests for conditional policy forecasts

Author

Listed:
  • Faust, Jon
  • Wright, Jonathan H.

Abstract

Central Banks regularly make forecasts, such as the Fed's Greenbook forecast, that are conditioned on hypothetical paths for the policy interest rate. While there are good public policy reasons to evaluate the quality of such forecasts, up until now, the most common approach has been to ignore their conditional nature and apply standard forecast efficiency tests. In this paper we derive tests for the efficiency of conditional forecasts. Intuitively, these tests involve implicit estimates of the degree to which the conditioning path is counterfactual and the magnitude of the policy feedback over the forecast horizon. We apply the tests to the Greenbook forecast and the Bank of England's inflation report forecast, finding some evidence of forecast inefficiency. Nonetheless, we argue that the conditional nature of the forecasts made by central banks represents a substantial impediment to the analysis of their quality--stronger assumptions are needed and forecast inefficiency may go undetected for longer than would be the case if central banks were instead to report unconditional forecasts.

Suggested Citation

  • Faust, Jon & Wright, Jonathan H., 2008. "Efficient forecast tests for conditional policy forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 293-303, October.
  • Handle: RePEc:eee:econom:v:146:y:2008:i:2:p:293-303
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304-4076(08)00107-3
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Faust Jon & Swanson Eric T & Wright Jonathan H, 2004. "Do Federal Reserve Policy Surprises Reveal Superior Information about the Economy?," The B.E. Journal of Macroeconomics, De Gruyter, vol. 4(1), pages 1-31, October.
    2. Canzoneri, Matthew B, 1985. "Monetary Policy Games and the Role of Private Information," American Economic Review, American Economic Association, vol. 75(5), pages 1056-1070, December.
    3. Leeper, Eric M. & Zha, Tao, 2003. "Modest policy interventions," Journal of Monetary Economics, Elsevier, vol. 50(8), pages 1673-1700, November.
    4. Donald, Stephen G & Newey, Whitney K, 2001. "Choosing the Number of Instruments," Econometrica, Econometric Society, vol. 69(5), pages 1161-1191, September.
    5. Hall, Alastair R & Rudebusch, Glenn D & Wilcox, David W, 1996. "Judging Instrument Relevance in Instrumental Variables Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 37(2), pages 283-298, May.
    6. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    7. Andrews,Donald W. K. & Stock,James H. (ed.), 2005. "Identification and Inference for Econometric Models," Cambridge Books, Cambridge University Press, number 9780521844413.
    8. Malin Adolfson & Michael K. Andersson & Jesper Lindé & Mattias Villani & Anders Vredin, 2007. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 111-144, December.
    9. Jon Faust & Dale W. Henderson, 2004. "Is inflation targeting best-practice monetary policy?," Review, Federal Reserve Bank of St. Louis, vol. 86(Jul), pages 117-144.
    10. Faust, Jon & Rogers, John H. & Wang, Shing-Yi B. & Wright, Jonathan H., 2007. "The high-frequency response of exchange rates and interest rates to macroeconomic announcements," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1051-1068, May.
    11. James H. Stock & Motohiro Yogo, 2002. "Testing for Weak Instruments in Linear IV Regression," NBER Technical Working Papers 0284, National Bureau of Economic Research, Inc.
    12. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    13. Stock, James H & Wright, Jonathan H & Yogo, Motohiro, 2002. "A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 518-529, October.
    14. Faust, Jon & Rogers, John H & Wright, Jonathan H, 2005. "News and Noise in G-7 GDP Announcements," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 403-419, June.
    15. Jon Faust, 1998. "The robustness of identified VAR conclusions about money," International Finance Discussion Papers 610, Board of Governors of the Federal Reserve System (U.S.).
    16. James H. Stock & Jonathan Wright, 2000. "GMM with Weak Identification," Econometrica, Econometric Society, vol. 68(5), pages 1055-1096, September.
    17. Tetlow, Robert J. & Ironside, Brian, 2005. "Real-Time Model Uncertainty in the United States: the Fed from 1996-2003," CEPR Discussion Papers 5305, C.E.P.R. Discussion Papers.
    18. Faust, Jon, 1998. "The robustness of identified VAR conclusions about money," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 49(1), pages 207-244, December.
    19. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    20. Goodhart Charles A.E., 2005. "The Monetary Policy Committee's Reaction Function: An Exercise in Estimation," The B.E. Journal of Macroeconomics, De Gruyter, vol. 5(1), pages 1-42, August.
    21. Sergey V. Chernenko, 2004. "The information content of forward and futures prices: market expectations and the price of risk," International Finance Discussion Papers 808, Board of Governors of the Federal Reserve System (U.S.).
    22. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    23. Cragg, John G. & Donald, Stephen G., 1993. "Testing Identifiability and Specification in Instrumental Variable Models," Econometric Theory, Cambridge University Press, vol. 9(2), pages 222-240, April.
    24. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dufour, Jean-Marie & Taamouti, Mohamed, 2007. "Further results on projection-based inference in IV regressions with weak, collinear or missing instruments," Journal of Econometrics, Elsevier, vol. 139(1), pages 133-153, July.
    2. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    3. Mikusheva, Anna, 2013. "Survey on statistical inferences in weakly-identified instrumental variable models," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 29(1), pages 117-131.
    4. Richard Startz & Charles Nelson & Eric Zivot, 1999. "Improved Inference for the Instrumental Variable Estimator," Working Papers 0039, University of Washington, Department of Economics.
    5. Jean-Marie Dufour & Mohamed Taamouti, 2005. "Projection-Based Statistical Inference in Linear Structural Models with Possibly Weak Instruments," Econometrica, Econometric Society, vol. 73(4), pages 1351-1365, July.
    6. Inoue, Atsushi & Rossi, Barbara, 2011. "Testing for weak identification in possibly nonlinear models," Journal of Econometrics, Elsevier, vol. 161(2), pages 246-261, April.
    7. Vipul Bhatt & N. Kundan Kishor & Hardik Marfatia, 2020. "Estimating Excess Sensitivity and Habit Persistence in Consumption Using Greenbook Forecasts," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(2), pages 257-284, April.
    8. Christopher F Baum & Mark E. Schaffer & Steven Stillman, 2007. "Enhanced routines for instrumental variables/GMM estimation and testing," Boston College Working Papers in Economics 667, Boston College Department of Economics, revised 05 Sep 2007.
    9. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    10. Vieira, Flávio & MacDonald, Ronald & Damasceno, Aderbal, 2012. "The role of institutions in cross-section income and panel data growth models: A deeper investigation on the weakness and proliferation of instruments," Journal of Comparative Economics, Elsevier, vol. 40(1), pages 127-140.
    11. Bedri Kamil Onur Taş, 2016. "Does the Federal Reserve have Private Information about its Future Actions?," Economica, London School of Economics and Political Science, vol. 83(331), pages 498-517, July.
    12. Gergely Ganics & Atsushi Inoue & Barbara Rossi, 2021. "Confidence Intervals for Bias and Size Distortion in IV and Local Projections-IV Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 307-324, January.
    13. Donald W.K. Andrews & James H. Stock, 2005. "Inference with Weak Instruments," NBER Technical Working Papers 0313, National Bureau of Economic Research, Inc.
    14. Markus Frölich & Michael Lechner, 2004. "Regional treatment intensity as an instrument for the evaluation of labour market policies," University of St. Gallen Department of Economics working paper series 2004 2004-08, Department of Economics, University of St. Gallen.
    15. Jean-Marie Dufour, 2003. "Identification, weak instruments, and statistical inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 36(4), pages 767-808, November.
    16. Dufour, Jean-Marie & Khalaf, Lynda & Kichian, Maral, 2006. "Inflation dynamics and the New Keynesian Phillips Curve: An identification robust econometric analysis," Journal of Economic Dynamics and Control, Elsevier, vol. 30(9-10), pages 1707-1727.
    17. repec:spo:wpecon:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    18. Doko Tchatoka, Firmin, 2012. "Specification tests with weak and invalid instruments," Working Papers 15063, University of Tasmania, Tasmanian School of Business and Economics, revised 26 Jun 2012.
    19. Maurice J. G. Bun & Frank Windmeijer, 2010. "The weak instrument problem of the system GMM estimator in dynamic panel data models," Econometrics Journal, Royal Economic Society, vol. 13(1), pages 95-126, February.
    20. Russell Davidson & James G. MacKinnon, 2014. "Confidence sets based on inverting Anderson–Rubin tests," Econometrics Journal, Royal Economic Society, vol. 17(2), pages 39-58, June.
    21. Tchatoka, Firmin Doko, 2015. "Subset Hypotheses Testing And Instrument Exclusion In The Linear Iv Regression," Econometric Theory, Cambridge University Press, vol. 31(6), pages 1192-1228, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:146:y:2008:i:2:p:293-303. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.