Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Large Scale Macroeconomic Time Series Environments
Abstract
In economics, common factors are often assumed to underlie the co-movements of a set of macroeconomic variables. For this reason, many authors have used estimated factors in the construction of prediction models. In this article, we begin by surveying the extant literature on diffusion indexes. We then outline a number of approaches to the selection of factor proxies (observed variables that proxy unobserved estimated factors) using the statistics developed in Bai and Ng (2006a,b). Our approach to factor proxy selection is examined via a small Monte Carlo experiment, where evidence supporting our proposed methodology is presented, and via a large set of prediction experiments using the panel dataset of Stock and Watson (2005). One of our main empirical findings is that our “smoothed” approaches to factor proxy selection appear to yield predictions that are often superior not only to a benchmark factor model, but also to simple linear time series models which are generally difficult to beat in forecasting competitions. In some sense, by using our approach to predictive factor proxy selection, one is able to open up the “black box” often associated with factor analysis, and to identify actual variables that can serve as primitive building blocks for (prediction) models of a host of macroeconomic variables, and that can also serve as policy instruments, for example. Our findings suggest that important observable variables include various S&P500 variables, including stock price indices and dividend series; a 1-year Treasury bond rate; various housing activity variables; industrial production; and exchange rates.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic Info
Article provided by Taylor and Francis Journals in its journal Econometric Reviews.
Volume (Year): 29 (2010)
Issue (Month): 5-6 ()
Pages: 476-510
Contact details of provider:
Web page: http://taylorandfrancis.metapress.com/link.asp?target=journal&id=107830
Order Information:
Web: http://www.tandf.co.uk/journals/subscription.asp
Related research
Keywords: Diffusion index; Factor; Forecast; Macroeconometrics; Parameter estimation error; Proxy;Other versions of this item:
- Nii Ayi Armah & Norman R. Swanson, 2008. "Seeing inside the black box: Using diffusion index methodology to construct factor proxies in large scale macroeconomic time series environments," Working Papers 08-25, Federal Reserve Bank of Philadelphia.
- Norman R. Swanson & Nii Ayi Armah, 2011. "Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Largescale Macroeconomic Time Series Environments," Departmental Working Papers 201105, Rutgers University, Department of Economics.
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Corradi, Valentina & Swanson, Norman R., 2002.
"A consistent test for nonlinear out of sample predictive accuracy,"
Journal of Econometrics,
Elsevier, vol. 110(2), pages 353-381, October.
- Corradi, V. & Swanson, N.R., 2000. "A Consistent Test for Nonlinear Out of Sample Predictive Accuracy," Discussion Papers 0012, Exeter University, Department of Economics.
- Clarida, Richard & Galí, Jordi & Gertler, Mark, 1998.
"Monetary Policy Rules and Macroeconomic Stability: Evidence and Some Theory,"
CEPR Discussion Papers
1908, C.E.P.R. Discussion Papers.
- Richard Clarida & Jordi Galí & Mark Gertler, 2000. "Monetary Policy Rules And Macroeconomic Stability: Evidence And Some Theory," The Quarterly Journal of Economics, MIT Press, vol. 115(1), pages 147-180, February.
- Richard Clarida & Jordi Gali & Mark Gertler, 1998. "Monetary Policy Rules and Macroeconomic Stability: Evidence and Some Theory," NBER Working Papers 6442, National Bureau of Economic Research, Inc.
- Richard Clarida & Jordi Galí & Mark Gertler, 1997. "Monetary policy rules and macroeconomic stability: Evidence and some theory," Economics Working Papers 350, Department of Economics and Business, Universitat Pompeu Fabra, revised May 1999.
- Clarida, R. & Gali, J. & Gertler, M., 1998. "Monetary Policy Rules and Macroeconomic Stability: Evidence and some Theory," Working Papers 98-01, C.V. Starr Center for Applied Economics, New York University.
- Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2003.
"The Generalized Dynamic Factor Model. One-Sided Estimation and Forecasting,"
LEM Papers Series
2003/13, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
- Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2005. "The generalised dynamic factor model: one sided estimation and forecasting," ULB Institutional Repository 2013/10129, ULB -- Universite Libre de Bruxelles.
- Forni M. & Hallin M., 2003. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Computing in Economics and Finance 2003 143, Society for Computational Economics.
- Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2002. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," CEPR Discussion Papers 3432, C.E.P.R. Discussion Papers.
- Bernanke, Ben S. & Boivin, Jean, 2003.
"Monetary policy in a data-rich environment,"
Journal of Monetary Economics,
Elsevier, vol. 50(3), pages 525-546, April.
- Ben S. Bernanke & Jean Boivin, 2001. "Monetary Policy in a Data-Rich Environment," NBER Working Papers 8379, National Bureau of Economic Research, Inc.
- Connor, Gregory & Korajczyk, Robert A., 1988. "Risk and return in an equilibrium APT : Application of a new test methodology," Journal of Financial Economics, Elsevier, vol. 21(2), pages 255-289, September.
- Clarida, Richard & Galí, Jordi & Gertler, Mark, 1999.
"The Science of Monetary Policy: A New Keynesian Perspective,"
CEPR Discussion Papers
2139, C.E.P.R. Discussion Papers.
- Mark Gertler & Jordi Gali & Richard Clarida, 1999. "The Science of Monetary Policy: A New Keynesian Perspective," Journal of Economic Literature, American Economic Association, vol. 37(4), pages 1661-1707, December.
- Clarida, R. & Gali, J. & Gertler, M., 1999. "The Science of Monetary Policy: A New Keynesian Perspective," Working Papers 99-13, C.V. Starr Center for Applied Economics, New York University.
- Richard Clarida & Jordi Galí & Mark Gertler, 1997. "The science of monetary policy: A new Keynesian perspective," Economics Working Papers 356, Department of Economics and Business, Universitat Pompeu Fabra, revised Apr 1999.
- Richard Clarida & Jordi Gali & Mark Gertler, 1999. "The Science of Monetary Policy: A New Keynesian Perspective," NBER Working Papers 7147, National Bureau of Economic Research, Inc.
- Forni, Mario & Reichlin, Lucrezia, 1996.
"Dynamic Common Factors in Large Cross-Sections,"
Empirical Economics,
Springer, vol. 21(1), pages 27-42.
- Mario Forni & Lucrezia Reichlin, 1996. "Dynamic common factors in large cross-sections," ULB Institutional Repository 2013/10149, ULB -- Universite Libre de Bruxelles.
- Forni, Mario & Reichlin, Lucrezia, 1995. "Dynamic Common Factors in Large Cross-Sections," CEPR Discussion Papers 1285, C.E.P.R. Discussion Papers.
- Forni, Mario & Reichlin, Lucrezia, 1995. "Let's Get Real: A Dynamic Factor Analytical Approach to Disaggregated Business Cycle," CEPR Discussion Papers 1244, C.E.P.R. Discussion Papers.
- Andrew G. Haldane & Nicoletta Batini, 1998.
"Forward-Looking Rules for Monetary Policy,"
NBER Working Papers
6543, National Bureau of Economic Research, Inc.
- Nicoletta Batini & Andrew Haldane, 1999. "Forward-Looking Rules for Monetary Policy," NBER Chapters, in: Monetary Policy Rules, pages 157-202 National Bureau of Economic Research, Inc.
- Nicoletta Batini & Andrew G Haldane, 1999. "Forward-looking rules for monetary policy," Bank of England working papers 91, Bank of England.
- Jushan Bai & Serena Ng, 2000.
"Determining the Number of Factors in Approximate Factor Models,"
Boston College Working Papers in Economics
440, Boston College Department of Economics.
- Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
- Jushan Bai & Serena Ng, 2000. "Determining the Number of Factors in Approximate Factor Models," Econometric Society World Congress 2000 Contributed Papers 1504, Econometric Society.
- James H. Stock & Mark W. Watson, 1999.
"Forecasting Inflation,"
NBER Working Papers
7023, National Bureau of Economic Research, Inc.
- Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
- Douglas T. Breeden & Michael R Gibbons & Robert H. Litzenberger, . "Empirical Tests of the Consumption-Oriented CAPM," Rodney L. White Center for Financial Research Working Papers 7-89, Wharton School Rodney L. White Center for Financial Research.
- Bai, Jushan & Ng, Serena, 2007. "Determining the Number of Primitive Shocks in Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 52-60, January.
- White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-38, May.
- Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 1999.
"The Generalized Dynamic Factor Model: Identification and Estimation,"
CEPR Discussion Papers
2338, C.E.P.R. Discussion Papers.
- Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
- Mario Forni & Marc Hallin & Lucrezia Reichlin & Marco Lippi, 2000. "The generalised dynamic factor model: identification and estimation," ULB Institutional Repository 2013/10143, ULB -- Universite Libre de Bruxelles.
- Valentina Corradi & Norman R. Swanson, 2003.
"Bootstrap Conditional Distribution Tests In the Presence of Dynamic Misspecification,"
Departmental Working Papers
200311, Rutgers University, Department of Economics.
- Corradi, Valentina & Swanson, Norman R., 2006. "Bootstrap conditional distribution tests in the presence of dynamic misspecification," Journal of Econometrics, Elsevier, vol. 133(2), pages 779-806, August.
- Diebold, Francis X & Mariano, Roberto S, 1995.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 13(3), pages 253-63, July.
- Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Tom Doan, . "DMARIANO: RATS procedure to compute Diebold-Mariano Forecast Comparison Test," Statistical Software Components RTS00055, Boston College Department of Economics.
- Connor, Gregory & Korajczyk, Robert A, 1993. " A Test for the Number of Factors in an Approximate Factor Model," Journal of Finance, American Finance Association, vol. 48(4), pages 1263-91, September.
- Bai, Jushan & Ng, Serena, 2006.
"Evaluating latent and observed factors in macroeconomics and finance,"
Journal of Econometrics,
Elsevier, vol. 131(1-2), pages 507-537.
- Jushan Bai & Serena Ng, 2004. "Evaluating Latent and Observed Factors in Macroeconomics and Financ," Econometrics 0408007, EconWPA.
- James H. Stock & Mark W. Watson, 1994.
"Evidence on Structural Instability in Macroeconomic Time Series Relations,"
NBER Technical Working Papers
0164, National Bureau of Economic Research, Inc.
- Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
- James H. Stock & Mark W. Watson, 1994. "Evidence on structural instability in macroeconomic times series relations," Working Paper Series, Macroeconomic Issues 94-13, Federal Reserve Bank of Chicago.
- Valentina Corradi & Norman Swanson, 2004.
"Predictive Density Evaluation,"
Departmental Working Papers
200419, Rutgers University, Department of Economics.
- Corradi, Valentina & Swanson, Norman R., 2006. "Predictive Density Evaluation," Handbook of Economic Forecasting, Elsevier.
- Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
- Douglas T. Breeden & Michael R Gibbons & Robert H. Litzenberger, . "Empirical Tests of the Consumption-Oriented CAPM," Rodney L. White Center for Financial Research Working Papers 07-89, Wharton School Rodney L. White Center for Financial Research.
- Breeden, Douglas T & Gibbons, Michael R & Litzenberger, Robert H, 1989. " Empirical Tests of the Consumption-Oriented CAPM," Journal of Finance, American Finance Association, vol. 44(2), pages 231-62, June.
- Thomas J. Sargent & Christopher A. Sims, 1977.
"Business cycle modeling without pretending to have too much a priori economic theory,"
Working Papers
55, Federal Reserve Bank of Minneapolis.
- Tom Doan, . "RATS program to estimate observable index model from Sargent-Sims(1977)," Statistical Software Components RTZ00126, Boston College Department of Economics.
- Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
- Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
- Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, 07.
- Shanken, Jay, 1992. "On the Estimation of Beta-Pricing Models," Review of Financial Studies, Society for Financial Studies, vol. 5(1), pages 1-33.
- Connor, Gregory & Korajczyk, Robert A., 1986. "Performance measurement with the arbitrage pricing theory : A new framework for analysis," Journal of Financial Economics, Elsevier, vol. 15(3), pages 373-394, March.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Dahl, Christian M. & Hansen, Henrik & Smidt, John, 2009.
"The cyclical component factor model,"
International Journal of Forecasting,
Elsevier, vol. 25(1), pages 119-127.
- Christian M. Dahl & Henrik Hansen & John Smidt, 2008. "The cyclical component factor model," CREATES Research Papers 2008-44, School of Economics and Management, University of Aarhus.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:29:y:2010:i:5-6:p:476-510For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Michael McNulty).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

