IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Real-time datasets really do make a difference: definitional change, data release, and forecasting

  • Andres Fernandez
  • Norman R. Swanson

In this paper, the authors empirically assess the extent to which early release inefficiency and definitional change affect prediction precision. In particular, they carry out a series of ex-ante prediction experiments in order to examine: the marginal predictive content of the revision process, the trade-offs associated with predicting different releases of a variable, the importance of particular forms of definitional change, which the authors call "definitional breaks," and the rationality of early releases of economic variables. An important feature of our rationality tests is that they are based solely on the examination of ex-ante predictions, rather than being based on in-sample regression analysis, as are many tests in the extant literature. Their findings point to the importance of making real-time datasets available to forecasters, as the revision process has marginal predictive content, and because predictive accuracy increases when multiple releases of data are used when specifying and estimating prediction models. The authors also present new evidence that early releases of money are rational, whereas prices and output are irrational. Moreover, they find that regardless of which release of our price variable one specifies as the "target" variable to be predicted, using only "first release" data in model estimation and prediction construction yields mean square forecast error (MSFE) "best" predictions. On the other hand, models estimated and implemented using "latest available release" data are MSFE-best for predicting all releases of money. The authors argue that these contradictory findings are due to the relevance of definitional breaks in the data generating processes of the variables that they examine. In an empirical analysis, they examine the real-time predictive content of money for income, and they find that vector autoregressions with money do not perform significantly worse than autoregressions, when predicting output during the last 20 years.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Our checks indicate that this address may not be valid because: 500 Can't connect to ( [302 Redirect]--> If this is indeed the case, please notify (Beth Paul)

Download Restriction: no

Paper provided by Federal Reserve Bank of Philadelphia in its series Working Papers with number 09-28.

in new window

Date of creation: 2009
Date of revision:
Handle: RePEc:fip:fedpwp:09-28
Contact details of provider: Postal: 10 Independence Mall, Philadelphia, PA 19106-1574
Web page:

More information through EDIRC

Order Information: Web: Email:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. S. Boragan Aruoba & Francis X. Diebold & Chiara Scotti, 2008. "Real-time measurement of business conditions," Working Papers 08-19, Federal Reserve Bank of Philadelphia.
  2. Todd E. Clark & Michael W. McCracken, 2000. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Econometric Society World Congress 2000 Contributed Papers 0319, Econometric Society.
  3. N. Gregory Mankiw & Matthew D. Shapiro, 1986. "News or Noise? An Analysis of GNP Revisions," NBER Working Papers 1939, National Bureau of Economic Research, Inc.
  4. Giampiero M. Gallo & Massimiliano Marcellino, . "Ex Post and Ex Ante Analysis of Provisional Data," Working Papers 141, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
  5. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
  6. Ashley, R & Granger, C W J & Schmalensee, R, 1980. "Advertising and Aggregate Consumption: An Analysis of Causality," Econometrica, Econometric Society, vol. 48(5), pages 1149-67, July.
  7. Aruoba, Boragan, 2005. "Data Revisions Are Not Well-Behaved," CEPR Discussion Papers 5271, C.E.P.R. Discussion Papers.
  8. Francis X. Diebold & Glenn D. Rudebusch, 1989. "Forecasting output with the composite leading index: an ex ante analysis," Finance and Economics Discussion Series 90, Board of Governors of the Federal Reserve System (U.S.).
  9. Ben S. Bernanke & Jean Boivin, 2001. "Monetary Policy in a Data-Rich Environment," NBER Working Papers 8379, National Bureau of Economic Research, Inc.
  10. Myles Callan & Eric Ghysels & Norman R. Swanson, 1998. "Monetary Policy Rules with Model and Data Uncertainty," CIRANO Working Papers 98s-40, CIRANO.
  11. Hamilton, James D & Perez-Quiros, Gabriel, 1996. "What Do the Leading Indicators Lead?," The Journal of Business, University of Chicago Press, vol. 69(1), pages 27-49, January.
  12. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
  13. Valentina Corradi & Andres Fernandez & Norman R. Swanson, 2008. "Information in the revision process of real-time datasets," Working Papers 08-27, Federal Reserve Bank of Philadelphia.
  14. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
  15. Anthony Garratt & Gary Koop & Emi Mise & Shaun P Vahey, 2007. "Real-time Prediction with UK Monetary Aggregates in the Presence of Model Uncertainty," Birkbeck Working Papers in Economics and Finance 0714, Birkbeck, Department of Economics, Mathematics & Statistics.
  16. S. Boragan Aruoba & Francis X. Diebold & Chiara Scotti, 2007. "Real-Time Measurement of Business Conditions, Second Version," PIER Working Paper Archive 08-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 04 Apr 2008.
  17. Corradi, Valentina & Swanson, Norman R., 2002. "A consistent test for nonlinear out of sample predictive accuracy," Journal of Econometrics, Elsevier, vol. 110(2), pages 353-381, October.
  18. Stock, James H. & Watson, Mark W., 1989. "Interpreting the evidence on money-income causality," Journal of Econometrics, Elsevier, vol. 40(1), pages 161-181, January.
  19. Chao, John & Corradi, Valentina & Swanson, Norman R., 2001. "Out-Of-Sample Tests For Granger Causality," Macroeconomic Dynamics, Cambridge University Press, vol. 5(04), pages 598-620, September.
  20. Todd E. Clark & Michael W. McCracken, 2008. "Tests of equal predictive ability with real-time data," Working Papers 2008-029, Federal Reserve Bank of St. Louis.
  21. Rathjens, Peter & Robins, Russell P, 1995. "Do Government Agencies Use Public Data?: The Case of GNP," The Review of Economics and Statistics, MIT Press, vol. 77(1), pages 170-72, February.
  22. Jon Faust & Jonathan H. Wright, 2007. "Comparing Greenbook and Reduced Form Forecasts using a Large Realtime Dataset," NBER Working Papers 13397, National Bureau of Economic Research, Inc.
  23. Swanson, Norman R. & van Dijk, Dick, 2006. "Are Statistical Reporting Agencies Getting It Right? Data Rationality and Business Cycle Asymmetry," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 24-42, January.
  24. John C. Robertson & Ellis W. Tallman, 1998. "Data vintages and measuring forecast model performance," Economic Review, Federal Reserve Bank of Atlanta, issue Q 4, pages 4-20.
  25. Franses, Ph.H.B.F. & Segers, R., 2008. "Seasonality in revisions of macroeconomic data," Econometric Institute Research Papers EI 2008-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  26. Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
  27. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-35, September.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:fip:fedpwp:09-28. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Beth Paul)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.