IDEAS home Printed from https://ideas.repec.org/p/fip/fedpwp/02-3.html
   My bibliography  Save this paper

Is macroeconomic research robust to alternative data sets?

Author

Listed:
  • Dean Croushore
  • Tom Stark

Abstract

This paper uses a real-time data set to analyze data revisions and to test the robustness of published econometric results. The data set consists of vintages, or snapshots, of the major macroeconomic data available at quarterly intervals in real time. The paper illustrates why such data may matter, examines the properties of several of the variables in the data set across vintages, and examines key empirical papers in macroeconomics, investigating their robustness to different vintages.

Suggested Citation

  • Dean Croushore & Tom Stark, 2002. "Is macroeconomic research robust to alternative data sets?," Working Papers 02-3, Federal Reserve Bank of Philadelphia.
  • Handle: RePEc:fip:fedpwp:02-3
    as

    Download full text from publisher

    File URL: https://www.philadelphiafed.org/-/media/frbp/assets/working-papers/2002/wp02-3.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Blanchard, Olivier Jean & Quah, Danny, 1989. "The Dynamic Effects of Aggregate Demand and Supply Disturbances," American Economic Review, American Economic Association, vol. 79(4), pages 655-673, September.
    2. Maravall, Agustin & Pierce, David A, 1986. "The Transmission of Data Noise into Policy Noise in U.S. Monetary Control," Econometrica, Econometric Society, vol. 54(4), pages 961-979, July.
    3. Hall, Robert E, 1978. "Stochastic Implications of the Life Cycle-Permanent Income Hypothesis: Theory and Evidence," Journal of Political Economy, University of Chicago Press, vol. 86(6), pages 971-987, December.
    4. Evan F. Koenig & Sheila Dolmas & Jeremy Piger, 2003. "The Use and Abuse of Real-Time Data in Economic Forecasting," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 618-628, August.
    5. David E. Runkle, 1998. "Revisionist history: how data revisions distort economic policy research," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 22(Fall), pages 3-12.
    6. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    7. Athanasios Orphanides, 2001. "Monetary Policy Rules Based on Real-Time Data," American Economic Review, American Economic Association, vol. 91(4), pages 964-985, September.
    8. Mork, Knut Anton, 1987. "Ain't Behavin': Forecast Errors and Measurement Errors in Early GNP Estimates," Journal of Business & Economic Statistics, American Statistical Association, vol. 5(2), pages 165-175, April.
    9. Bernanke, Ben S. & Boivin, Jean, 2003. "Monetary policy in a data-rich environment," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 525-546, April.
    10. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    11. Glenn D. Rudebusch, 2001. "Is The Fed Too Timid? Monetary Policy In An Uncertain World," The Review of Economics and Statistics, MIT Press, vol. 83(2), pages 203-217, May.
    12. Eric Ghysels & Norman R. Swanson & Myles Callan, 2002. "Monetary Policy Rules with Model and Data Uncertainty," Southern Economic Journal, John Wiley & Sons, vol. 69(2), pages 239-265, October.
    13. Swanson Norman, 1996. "Forecasting Using First-Available Versus Fully Revised Economic Time-Series Data," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 1(1), pages 1-20, April.
    14. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    15. N. Gregory Mankiw & Matthew D. Shapiro, 1986. "News or Noise? An Analysis of GNP Revisions," NBER Working Papers 1939, National Bureau of Economic Research, Inc.
    16. Howrey, E Philip, 1978. "The Use of Preliminary Data in Econometric Forecasting," The Review of Economics and Statistics, MIT Press, vol. 60(2), pages 193-200, May.
    17. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    18. Norman R. Swanson & Jeffery D. Amato, 2000. "The real-time predictive content of money for output," BIS Working Papers 96, Bank for International Settlements.
    19. Rosanne Cole, 1969. "Data Errors and Forecasting Accuracy," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 47-82, National Bureau of Economic Research, Inc.
    20. Finn E. Kydland & Edward C. Prescott, 1990. "Business cycles: real facts and a monetary myth," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 14(Spr), pages 3-18.
    21. Flavin, Marjorie A, 1981. "The Adjustment of Consumption to Changing Expectations about Future Income," Journal of Political Economy, University of Chicago Press, vol. 89(5), pages 974-1009, October.
    22. Francis X. Diebold & Glenn D. Rudebusch, 1989. "Forecasting output with the composite leading index: an ex ante analysis," Finance and Economics Discussion Series 90, Board of Governors of the Federal Reserve System (U.S.).
    23. Pierre-Daniel G. Sarte, 1997. "On the identification of structural vector autoregressions," Economic Quarterly, Federal Reserve Bank of Richmond, issue Sum, pages 45-68.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Döhrn, Roland, 2018. "Revisionen der Volkswirtschaftlichen Gesamtrechnungen: Revisionspraxis des Statistischen Bundesamtes und ihre Auswirkungen auf Prognosen," RWI Materialien 127, RWI - Leibniz-Institut für Wirtschaftsforschung.
    2. Liebermann, Joelle, 2012. "Real-time forecasting in a data-rich environment," MPRA Paper 39452, University Library of Munich, Germany.
    3. Fuhrer, Jeff & Tootell, Geoff, 2008. "Eyes on the prize: How did the fed respond to the stock market?," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 796-805, May.
    4. Gerberding, Christina & Worms, Andreas & Seitz, Franz, 2004. "How the Bundesbank really conducted monetary policy: An analysis based on real-time data," Discussion Paper Series 1: Economic Studies 2004,25, Deutsche Bundesbank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    2. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    3. Dean Croushore & Tom Stark, 2000. "A real-time data set for macroeconomists: does data vintage matter for forecasting?," Working Papers 00-6, Federal Reserve Bank of Philadelphia.
    4. Dean Croushore & Tom Stark, 2003. "A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter?," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 605-617, August.
    5. Croushore, Dean & Evans, Charles L., 2006. "Data revisions and the identification of monetary policy shocks," Journal of Monetary Economics, Elsevier, vol. 53(6), pages 1135-1160, September.
    6. Clements, Michael P. & Beatriz Galvão, Ana, 2010. "First announcements and real economic activity," European Economic Review, Elsevier, vol. 54(6), pages 803-817, August.
    7. Garratt, Anthony & Koop, Gary & Mise, Emi & Vahey, Shaun P., 2009. "Real-Time Prediction With U.K. Monetary Aggregates in the Presence of Model Uncertainty," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 480-491.
    8. Clements Michael P., 2012. "Forecasting U.S. Output Growth with Non-Linear Models in the Presence of Data Uncertainty," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(1), pages 1-27, January.
    9. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    10. Denis Shibitov & Mariam Mamedli, 2021. "Forecasting Russian Cpi With Data Vintages And Machine Learning Techniques," Bank of Russia Working Paper Series wps70, Bank of Russia.
    11. Christoffersen, Peter & Ghysels, Eric & Swanson, Norman R., 2002. "Let's get "real" about using economic data," Journal of Empirical Finance, Elsevier, vol. 9(3), pages 343-360, August.
    12. Clements, Michael P. & Beatriz Galvao, Ana, 2010. "Real-time Forecasting of Inflation and Output Growth in the Presence of Data Revisions," Economic Research Papers 270771, University of Warwick - Department of Economics.
    13. Faust, Jon & Rogers, John H & Wright, Jonathan H, 2005. "News and Noise in G-7 GDP Announcements," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 403-419, June.
    14. Richard G. Anderson, 2006. "Replicability, real-time data, and the science of economic research: FRED, ALFRED, and VDC," Review, Federal Reserve Bank of St. Louis, vol. 88(Jan), pages 81-93.
    15. Jacobs, Jan P.A.M. & van Norden, Simon, 2011. "Modeling data revisions: Measurement error and dynamics of "true" values," Journal of Econometrics, Elsevier, vol. 161(2), pages 101-109, April.
    16. Emilia Tomczyk, 2013. "End of sample vs. real time data: perspectives for analysis of expectations," Working Papers 68, Department of Applied Econometrics, Warsaw School of Economics.
    17. Karen E. Dynan & Douglas W. Elmendorf, 2001. "Do provisional estimates of output miss economic turning points?," Finance and Economics Discussion Series 2001-52, Board of Governors of the Federal Reserve System (U.S.).
    18. Frederick H. Wallace & Gary L. Shelley & Luis F. Cabrera Castellanos, 2004. "Pruebas de la neutralidad monetaria a largo plazo: el caso de Nicaragua," Monetaria, Centro de Estudios Monetarios Latinoamericanos, CEMLA, vol. 0(4), pages 407-418, octubre-d.
    19. Harrison, Richard & Kapetanios, George & Yates, Tony, 2005. "Forecasting with measurement errors in dynamic models," International Journal of Forecasting, Elsevier, vol. 21(3), pages 595-607.
    20. Nikolsko-Rzhevskyy, Alex, 2008. "Monetary Policy Evaluation in Real Time: Forward-Looking Taylor Rules Without Forward-Looking Data," MPRA Paper 11352, University Library of Munich, Germany.

    More about this item

    Keywords

    Macroeconomics;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedpwp:02-3. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/frbphus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/frbphus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.