IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Real-time datasets really do make a difference: definitional change, data release, and forecasting

  • Andres Fernandez
  • Norman R. Swanson

In this paper, the authors empirically assess the extent to which early release inefficiency and definitional change affect prediction precision. In particular, they carry out a series of ex-ante prediction experiments in order to examine: the marginal predictive content of the revision process, the trade-offs associated with predicting different releases of a variable, the importance of particular forms of definitional change, which the authors call "definitional breaks," and the rationality of early releases of economic variables. An important feature of our rationality tests is that they are based solely on the examination of ex-ante predictions, rather than being based on in-sample regression analysis, as are many tests in the extant literature. Their findings point to the importance of making real-time datasets available to forecasters, as the revision process has marginal predictive content, and because predictive accuracy increases when multiple releases of data are used when specifying and estimating prediction models. The authors also present new evidence that early releases of money are rational, whereas prices and output are irrational. Moreover, they find that regardless of which release of our price variable one specifies as the "target" variable to be predicted, using only "first release" data in model estimation and prediction construction yields mean square forecast error (MSFE) "best" predictions. On the other hand, models estimated and implemented using "latest available release" data are MSFE-best for predicting all releases of money. The authors argue that these contradictory findings are due to the relevance of definitional breaks in the data generating processes of the variables that they examine. In an empirical analysis, they examine the real-time predictive content of money for income, and they find that vector autoregressions with money do not perform significantly worse than autoregressions, when predicting output during the last 20 years.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.philadelphiafed.org/research-and-data/publications/working-papers/2009/wp09-28.pdf
Download Restriction: no

Paper provided by Federal Reserve Bank of Philadelphia in its series Working Papers with number 09-28.

as
in new window

Length:
Date of creation: 2009
Date of revision:
Handle: RePEc:fip:fedpwp:09-28
Contact details of provider: Postal: 10 Independence Mall, Philadelphia, PA 19106-1574
Web page: http://www.philadelphiafed.org/

More information through EDIRC

Order Information: Web: http://www.phil.frb.org/econ/wps/index.html Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Clark, Todd E. & McCracken, Michael W., 2009. "Tests of Equal Predictive Ability With Real-Time Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 441-454.
  2. S. Boragan Aruoba & Francis X. Diebold & Chiara Scotti, 2008. "Real-Time Measurement of Business Conditions," NBER Working Papers 14349, National Bureau of Economic Research, Inc.
  3. Ben S. Bernanke & Jean Boivin, 2001. "Monetary Policy in a Data-Rich Environment," NBER Working Papers 8379, National Bureau of Economic Research, Inc.
  4. Corradi, Valentina & Swanson, Norman R., 2002. "A consistent test for nonlinear out of sample predictive accuracy," Journal of Econometrics, Elsevier, vol. 110(2), pages 353-381, October.
  5. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
  6. Franses, Ph.H.B.F. & Segers, R., 2008. "Seasonality in revisions of macroeconomic data," Econometric Institute Research Papers EI 2008-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  7. Dean Croushore & Tom Stark, 1999. "A real-time data set for macroeconomists," Working Papers 99-4, Federal Reserve Bank of Philadelphia.
  8. Swanson, Norman R. & van Dijk, Dick, 2006. "Are Statistical Reporting Agencies Getting It Right? Data Rationality and Business Cycle Asymmetry," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 24-42, January.
  9. Corradi, Valentina & Fernandez, Andres & Swanson, Norman R., 2009. "Information in the Revision Process of Real-Time Datasets," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 455-467.
  10. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
  11. John C. Robertson & Ellis W. Tallman, 1998. "Data vintages and measuring forecast model performance," Economic Review, Federal Reserve Bank of Atlanta, issue Q 4, pages 4-20.
  12. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
  13. Anthony Garratt & Gary Koop & Emi Mise & Shaun P Vahey, 2007. "Real-time Prediction with UK Monetary Aggregates in the Presence of Model Uncertainty," Birkbeck Working Papers in Economics and Finance 0714, Birkbeck, Department of Economics, Mathematics & Statistics.
  14. Myles Callan & Eric Ghysels & Norman R. Swanson, 1998. "Monetary Policy Rules with Model and Data Uncertainty," CIRANO Working Papers 98s-40, CIRANO.
  15. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-35, September.
  16. Giampiero M. Gallo & Massimiliano Marcellino, . "Ex Post and Ex Ante Analysis of Provisional Data," Working Papers 141, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
  17. Aruoba, Boragan, 2005. "Data Revisions Are Not Well-Behaved," CEPR Discussion Papers 5271, C.E.P.R. Discussion Papers.
  18. Chao, John & Corradi, Valentina & Swanson, Norman R., 2001. "Out-Of-Sample Tests For Granger Causality," Macroeconomic Dynamics, Cambridge University Press, vol. 5(04), pages 598-620, September.
  19. Stock, James H. & Watson, Mark W., 1989. "Interpreting the evidence on money-income causality," Journal of Econometrics, Elsevier, vol. 40(1), pages 161-181, January.
  20. N. Gregory Mankiw & Matthew D. Shapiro, 1986. "News or Noise? An Analysis of GNP Revisions," NBER Working Papers 1939, National Bureau of Economic Research, Inc.
  21. S. Boragan Aruoba & Francis X. Diebold & Chiara Scotti, 2007. "Real-Time Measurement of Business Conditions, Second Version," PIER Working Paper Archive 08-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 04 Apr 2008.
  22. Hamilton, James D & Perez-Quiros, Gabriel, 1996. "What Do the Leading Indicators Lead?," The Journal of Business, University of Chicago Press, vol. 69(1), pages 27-49, January.
  23. Jon Faust & Jonathan H. Wright, 2007. "Comparing Greenbook and Reduced Form Forecasts using a Large Realtime Dataset," NBER Working Papers 13397, National Bureau of Economic Research, Inc.
  24. Francis X. Diebold & Glenn D. Rudebusch, 1989. "Forecasting output with the composite leading index: an ex ante analysis," Finance and Economics Discussion Series 90, Board of Governors of the Federal Reserve System (U.S.).
  25. Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
  26. Ashley, R & Granger, C W J & Schmalensee, R, 1980. "Advertising and Aggregate Consumption: An Analysis of Causality," Econometrica, Econometric Society, vol. 48(5), pages 1149-67, July.
  27. Rathjens, Peter & Robins, Russell P, 1995. "Do Government Agencies Use Public Data?: The Case of GNP," The Review of Economics and Statistics, MIT Press, vol. 77(1), pages 170-72, February.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:fip:fedpwp:09-28. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Beth Paul)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.