IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Largescale Macroeconomic Time Series Environments

  • Norman R. Swanson


    (Rutgers University)

  • Nii Ayi Armah


    (Bank of Canada)

In economics, common factors are often assumed to underlie the co-movements of a set of macroeconomic variables. For this reason, many authors have used estimated factors in the construction of prediction models. In this paper, we begin by surveying the extant literature on diffusion indexes. We then outline a number of approaches to the selection of factor proxies (observed variables that proxy unobserved estimated factors) using the statistics developed in Bai and Ng (2006a,b). Our approach to factor proxy selection is examined via a small Monte Carlo experiment, where evidence supporting our proposed methodology is presented, and via a large set of prediction experiments using the panel dataset of Stock and Watson (2005). One of our main empirical findings is that our “smoothed” approaches to factor proxy selection appear to yield predictions that are often superior not only to a benchmark factor model, but also to simple linear time series models which are generally difficult to beat in forecasting competitions. In some sense, by using our approach to predictive factor proxy selection, one is able to open up the “black box” often associated with factor analysis, and to identify actual variables that can serve as primitive building blocks for (prediction) models of a host of macroeconomic variables, and that can also serve are policy instruments, for example. Our findings suggest that important observable variables include: various S&P500 variables, including stock price indices and dividend series; a 1-year Treasury bond rate; various housing activity variables; industrial production; and exchange rates.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Rutgers University, Department of Economics in its series Departmental Working Papers with number 201105.

in new window

Length: 20 pages
Date of creation: 14 May 2011
Date of revision:
Publication status: Published in Econometric Reviews, 29, 476-510.
Handle: RePEc:rut:rutres:201105
Contact details of provider: Postal: New Jersey Hall - 75 Hamilton Street, New Brunswick, NJ 08901-1248
Phone: (732) 932-7363
Fax: (732) 932-7416
Web page:

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Richard Clarida & Jordi Galí & Mark Gertler, 1997. "The science of monetary policy: A new Keynesian perspective," Economics Working Papers 356, Department of Economics and Business, Universitat Pompeu Fabra, revised Apr 1999.
  2. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
  3. Forni M. & Hallin M., 2003. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Computing in Economics and Finance 2003 143, Society for Computational Economics.
  4. Valentina Corradi & Norman R. Swanson, 2003. "Bootstrap Conditional Distribution Tests In the Presence of Dynamic Misspecification," Departmental Working Papers 200311, Rutgers University, Department of Economics.
  5. Ben S. Bernanke & Jean Boivin, 2001. "Monetary Policy in a Data-Rich Environment," NBER Working Papers 8379, National Bureau of Economic Research, Inc.
  6. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
  7. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
  8. Breeden, Douglas T & Gibbons, Michael R & Litzenberger, Robert H, 1989. " Empirical Tests of the Consumption-Oriented CAPM," Journal of Finance, American Finance Association, vol. 44(2), pages 231-62, June.
  9. James H. Stock & Mark W. Watson, 1999. "Forecasting Inflation," NBER Working Papers 7023, National Bureau of Economic Research, Inc.
  10. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, 07.
  11. Jushan Bai & Serena Ng, 2004. "Evaluating Latent and Observed Factors in Macroeconomics and Financ," Econometrics 0408007, EconWPA.
  12. Forni, Mario & Reichlin, Lucrezia, 1995. "Dynamic Common Factors in Large Cross-Sections," CEPR Discussion Papers 1285, C.E.P.R. Discussion Papers.
  13. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 1999. "The Generalized Dynamic Factor Model: Identification and Estimation," CEPR Discussion Papers 2338, C.E.P.R. Discussion Papers.
  14. Forni, Mario & Reichlin, Lucrezia, 1995. "Let's Get Real: A Dynamic Factor Analytical Approach to Disaggregated Business Cycle," CEPR Discussion Papers 1244, C.E.P.R. Discussion Papers.
  15. Corradi, V. & Swanson, N.R., 2000. "A Consistent Test for Nonlinear Out of Sample Predictive Accuracy," Discussion Papers 0012, Exeter University, Department of Economics.
  16. Connor, Gregory & Korajczyk, Robert A., 1988. "Risk and return in an equilibrium APT : Application of a new test methodology," Journal of Financial Economics, Elsevier, vol. 21(2), pages 255-289, September.
  17. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
  18. Corradi, Valentina & Swanson, Norman R., 2006. "Predictive Density Evaluation," Handbook of Economic Forecasting, Elsevier.
  19. Andrew G. Haldane & Nicoletta Batini, 1998. "Forward-Looking Rules for Monetary Policy," NBER Working Papers 6543, National Bureau of Economic Research, Inc.
  20. Connor, Gregory & Korajczyk, Robert A, 1993. " A Test for the Number of Factors in an Approximate Factor Model," Journal of Finance, American Finance Association, vol. 48(4), pages 1263-91, September.
  21. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
  22. Richard Clarida & Jordi Galí & Mark Gertler, 2000. "Monetary Policy Rules and Macroeconomic Stability: Evidence and Some Theory," The Quarterly Journal of Economics, Oxford University Press, vol. 115(1), pages 147-180.
  23. Connor, Gregory & Korajczyk, Robert A., 1986. "Performance measurement with the arbitrage pricing theory : A new framework for analysis," Journal of Financial Economics, Elsevier, vol. 15(3), pages 373-394, March.
  24. James H. Stock & Mark W. Watson, 1994. "Evidence on structural instability in macroeconomic times series relations," Working Paper Series, Macroeconomic Issues 94-13, Federal Reserve Bank of Chicago.
  25. Douglas T. Breeden & Michael R Gibbons & Robert H. Litzenberger, . "Empirical Tests of the Consumption-Oriented CAPM," Rodney L. White Center for Financial Research Working Papers 7-89, Wharton School Rodney L. White Center for Financial Research.
  26. Douglas T. Breeden & Michael R Gibbons & Robert H. Litzenberger, . "Empirical Tests of the Consumption-Oriented CAPM," Rodney L. White Center for Financial Research Working Papers 07-89, Wharton School Rodney L. White Center for Financial Research.
  27. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-38, May.
  28. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
  29. Shanken, Jay, 1992. "On the Estimation of Beta-Pricing Models," Review of Financial Studies, Society for Financial Studies, vol. 5(1), pages 1-33.
  30. Bai, Jushan & Ng, Serena, 2007. "Determining the Number of Primitive Shocks in Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 52-60, January.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:rut:rutres:201105. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ()

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.