IDEAS home Printed from https://ideas.repec.org/p/fip/fedpwp/09-28.html
   My bibliography  Save this paper

Real-time datasets really do make a difference: definitional change, data release, and forecasting

Author

Listed:
  • Andres Fernandez
  • Norman R. Swanson

Abstract

In this paper, the authors empirically assess the extent to which early release inefficiency and definitional change affect prediction precision. In particular, they carry out a series of ex-ante prediction experiments in order to examine: the marginal predictive content of the revision process, the trade-offs associated with predicting different releases of a variable, the importance of particular forms of definitional change, which the authors call \"definitional breaks,\" and the rationality of early releases of economic variables. An important feature of our rationality tests is that they are based solely on the examination of ex-ante predictions, rather than being based on in-sample regression analysis, as are many tests in the extant literature. Their findings point to the importance of making real-time datasets available to forecasters, as the revision process has marginal predictive content, and because predictive accuracy increases when multiple releases of data are used when specifying and estimating prediction models. The authors also present new evidence that early releases of money are rational, whereas prices and output are irrational. Moreover, they find that regardless of which release of our price variable one specifies as the \"target\" variable to be predicted, using only \"first release\" data in model estimation and prediction construction yields mean square forecast error (MSFE) \"best\" predictions. On the other hand, models estimated and implemented using \"latest available release\" data are MSFE-best for predicting all releases of money. The authors argue that these contradictory findings are due to the relevance of definitional breaks in the data generating processes of the variables that they examine. In an empirical analysis, they examine the real-time predictive content of money for income, and they find that vector autoregressions with money do not perform significantly worse than autoregressions, when predicting output during the last 20 years.

Suggested Citation

  • Andres Fernandez & Norman R. Swanson, 2009. "Real-time datasets really do make a difference: definitional change, data release, and forecasting," Working Papers 09-28, Federal Reserve Bank of Philadelphia.
  • Handle: RePEc:fip:fedpwp:09-28
    as

    Download full text from publisher

    File URL: https://www.philadelphiafed.org/-/media/frbp/assets/working-papers/2009/wp09-28.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
    2. Rathjens, Peter & Robins, Russell P, 1995. "Do Government Agencies Use Public Data?: The Case of GNP," The Review of Economics and Statistics, MIT Press, vol. 77(1), pages 170-172, February.
    3. Clark, Todd E. & McCracken, Michael W., 2009. "Tests of Equal Predictive Ability With Real-Time Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 441-454.
    4. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    5. Croushore, Dean, 2006. "Forecasting with Real-Time Macroeconomic Data," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 17, pages 961-982, Elsevier.
    6. Swanson, Norman R. & van Dijk, Dick, 2006. "Are Statistical Reporting Agencies Getting It Right? Data Rationality and Business Cycle Asymmetry," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 24-42, January.
    7. Giampiero M. Gallo & Massimiliano Marcellino, "undated". "Ex Post and Ex Ante Analysis of Provisional Data," Working Papers 141, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    8. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    9. Aruoba, S. BoraÄŸan & Diebold, Francis X. & Scotti, Chiara, 2009. "Real-Time Measurement of Business Conditions," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 417-427.
    10. Chao, John & Corradi, Valentina & Swanson, Norman R., 2001. "Out-Of-Sample Tests For Granger Causality," Macroeconomic Dynamics, Cambridge University Press, vol. 5(4), pages 598-620, September.
    11. Corradi, Valentina & Swanson, Norman R., 2002. "A consistent test for nonlinear out of sample predictive accuracy," Journal of Econometrics, Elsevier, vol. 110(2), pages 353-381, October.
    12. Corradi, Valentina & Fernandez, Andres & Swanson, Norman R., 2009. "Information in the Revision Process of Real-Time Datasets," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 455-467.
    13. Hamilton, James D & Perez-Quiros, Gabriel, 1996. "What Do the Leading Indicators Lead?," The Journal of Business, University of Chicago Press, vol. 69(1), pages 27-49, January.
    14. John C. Robertson & Ellis W. Tallman, 1998. "Data vintages and measuring forecast model performance," Economic Review, Federal Reserve Bank of Atlanta, vol. 83(Q 4), pages 4-20.
    15. Ashley, R & Granger, C W J & Schmalensee, R, 1980. "Advertising and Aggregate Consumption: An Analysis of Causality," Econometrica, Econometric Society, vol. 48(5), pages 1149-1167, July.
    16. Bernanke, Ben S. & Boivin, Jean, 2003. "Monetary policy in a data-rich environment," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 525-546, April.
    17. Stock, James H. & Watson, Mark W., 1989. "Interpreting the evidence on money-income causality," Journal of Econometrics, Elsevier, vol. 40(1), pages 161-181, January.
    18. S. Borağan Aruoba, 2008. "Data Revisions Are Not Well Behaved," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(2‐3), pages 319-340, March.
    19. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    20. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    21. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    22. Garratt, Anthony & Koop, Gary & Mise, Emi & Vahey, Shaun P., 2009. "Real-Time Prediction With U.K. Monetary Aggregates in the Presence of Model Uncertainty," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 480-491.
    23. Corradi, Valentina & Swanson, Norman R., 2006. "Predictive Density Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 5, pages 197-284, Elsevier.
    24. Eric Ghysels & Norman R. Swanson & Myles Callan, 2002. "Monetary Policy Rules with Model and Data Uncertainty," Southern Economic Journal, John Wiley & Sons, vol. 69(2), pages 239-265, October.
    25. Franses, Ph.H.B.F. & Segers, R., 2008. "Seasonality in revisions of macroeconomic data," Econometric Institute Research Papers EI 2008-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    26. S. Boragan Aruoba & Francis X. Diebold & Chiara Scotti, 2007. "Real-Time Measurement of Business Conditions, Second Version," PIER Working Paper Archive 08-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 04 Apr 2008.
    27. N. Gregory Mankiw & Matthew D. Shapiro, 1986. "News or Noise? An Analysis of GNP Revisions," NBER Working Papers 1939, National Bureau of Economic Research, Inc.
    28. Eric Ghysels & Norman R. Swanson & Myles Callan, 2002. "Monetary Policy Rules with Model and Data Uncertainty," Southern Economic Journal, John Wiley & Sons, vol. 69(2), pages 239-265, October.
    29. Francis X. Diebold & Glenn D. Rudebusch, 1989. "Forecasting output with the composite leading index: an ex ante analysis," Finance and Economics Discussion Series 90, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Corradi, Valentina & Fernandez, Andres & Swanson, Norman R., 2009. "Information in the Revision Process of Real-Time Datasets," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 455-467.
    2. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    3. Garratt, Anthony & Koop, Gary & Mise, Emi & Vahey, Shaun P., 2009. "Real-Time Prediction With U.K. Monetary Aggregates in the Presence of Model Uncertainty," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 480-491.
    4. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    5. Clark, Todd E. & McCracken, Michael W., 2009. "Tests of Equal Predictive Ability With Real-Time Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 441-454.
    6. M. Mogliani & T. Ferrière, 2016. "Rationality of announcements, business cycle asymmetry, and predictability of revisions. The case of French GDP," Working papers 600, Banque de France.
    7. Valentina Raponi & Cecilia Frale, 2014. "Revisions in official data and forecasting," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(3), pages 451-472, August.
    8. Corradi, Valentina & Swanson, Norman R., 2004. "Some recent developments in predictive accuracy testing with nested models and (generic) nonlinear alternatives," International Journal of Forecasting, Elsevier, vol. 20(2), pages 185-199.
    9. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    10. Norman Swanson & Nii Ayi Armah, 2006. "Predictive Inference Under Model Misspecification with an Application to Assessing the Marginal Predictive Content of Money for Output," Departmental Working Papers 200619, Rutgers University, Department of Economics.
    11. Heij, Christiaan & van Dijk, Dick & Groenen, Patrick J.F., 2011. "Real-time macroeconomic forecasting with leading indicators: An empirical comparison," International Journal of Forecasting, Elsevier, vol. 27(2), pages 466-481, April.
    12. Clements, Michael P. & Beatriz Galvao, Ana, 2010. "Real-time Forecasting of Inflation and Output Growth in the Presence of Data Revisions," Economic Research Papers 270771, University of Warwick - Department of Economics.
    13. Clements, Michael P. & Beatriz Galvão, Ana, 2010. "First announcements and real economic activity," European Economic Review, Elsevier, vol. 54(6), pages 803-817, August.
    14. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    15. Michael P. Clements, 2014. "Anticipating Early Data Revisions to US GDP and the Effects of Releases on Equity Markets," ICMA Centre Discussion Papers in Finance icma-dp2014-06, Henley Business School, University of Reading.
    16. Michael Pfarrhofer, 2024. "Forecasts with Bayesian vector autoregressions under real time conditions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(3), pages 771-801, April.
    17. Clements, Michael P. & Galvao, Ana Beatriz, 2006. "Macroeconomic Forecasting with Mixed Frequency Data: Forecasting US output growth and inflation," Economic Research Papers 269743, University of Warwick - Department of Economics.
    18. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    19. Maximo Camacho & Gabriel Perez-Quiros, 2010. "Introducing the euro-sting: Short-term indicator of euro area growth," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 663-694.
    20. Adam J. Check & Anna K Nolan & Tyler C. Schipper, 2019. "Forecasting GDP Growth using Disaggregated GDP Revisions," Economics Bulletin, AccessEcon, vol. 39(4), pages 2580-2588.

    More about this item

    Keywords

    Economic forecasting; Econometrics;

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E01 - Macroeconomics and Monetary Economics - - General - - - Measurement and Data on National Income and Product Accounts and Wealth; Environmental Accounts

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedpwp:09-28. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Beth Paul (email available below). General contact details of provider: https://edirc.repec.org/data/frbphus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.