IDEAS home Printed from https://ideas.repec.org/p/aah/create/2012-18.html
   My bibliography  Save this paper

Stein-Rule Estimation and Generalized Shrinkage Methods for Forecasting Using Many Predictors

Author

Listed:
  • Eric Hillebrand

    (Aarhus University and CREATES)

  • Tae-Hwy Lee

    (University of California, Riverside)

Abstract

We examine the Stein-rule shrinkage estimator for possible improvements in estimation and forecasting when there are many predictors in a linear time series model. We consider the Stein-rule estimator of Hill and Judge (1987) that shrinks the unrestricted unbiased OLS estimator towards a restricted biased principal component (PC) estimator. Since the Stein-rule estimator combines the OLS and PC estimators, it is a model-averaging estimator and produces a combined forecast. The conditions under which the improvement can be achieved depend on several unknown parameters that determine the degree of the Stein-rule shrinkage. We conduct Monte Carlo simulations to examine these parameter regions. The overall picture that emerges is that the Stein-rule shrinkage estimator can dominate both OLS and principal components estimators within an intermediate range of the signal-to-noise ratio. If the signal-to-noise ratio is low, the PC estimator is superior. If the signal-to-noise ratio is high, the OLS estimator is superior. In out-of-sample forecasting with AR(1) predictors, the Stein-rule shrinkage estimator can dominate both OLS and PC estimators when the predictors exhibit low persistence.

Suggested Citation

  • Eric Hillebrand & Tae-Hwy Lee, 2012. "Stein-Rule Estimation and Generalized Shrinkage Methods for Forecasting Using Many Predictors," CREATES Research Papers 2012-18, Department of Economics and Business Economics, Aarhus University.
  • Handle: RePEc:aah:create:2012-18
    as

    Download full text from publisher

    File URL: ftp://ftp.econ.au.dk/creates/rp/12/rp12_18.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mittelhammer, Ron C., 1985. "Quadratic risk domination of restricted least squares estimators via Stein-ruled auxiliary constraints," Journal of Econometrics, Elsevier, vol. 29(3), pages 289-303, September.
    2. Eric Hillebrand & Huiyu Huang & Tae-Hwy Lee & Canlin Li, 2011. "Using the Yield Curve in Forecasting Output Growth and In?flation," CREATES Research Papers 2012-17, Department of Economics and Business Economics, Aarhus University.
    3. Todd E. Clark & Michael W. McCracken, 2009. "Combining Forecasts from Nested Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 303-329, June.
    4. Granger, C. W. J., 1980. "Long memory relationships and the aggregation of dynamic models," Journal of Econometrics, Elsevier, vol. 14(2), pages 227-238, October.
    5. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    6. Inoue, Atsushi & Kilian, Lutz, 2005. "How Useful is Bagging in Forecasting Economic Time Series? A Case Study of US CPI Inflation," CEPR Discussion Papers 5304, C.E.P.R. Discussion Papers.
    7. Fomby, Thomas B & Samanta, Subarna K, 1991. "Application of Stein Rules to Combination Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 391-407, October.
    8. Bair, Eric & Hastie, Trevor & Paul, Debashis & Tibshirani, Robert, 2006. "Prediction by Supervised Principal Components," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 119-137, March.
    9. Carter Hill, R. & Judge, George, 1987. "Improved prediction in the presence of multicollinearity," Journal of Econometrics, Elsevier, vol. 35(1), pages 83-100, May.
    10. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    11. Hill, R.Carter & Judge, George G, 1990. "Improved estimation under collinearity and squared error loss," Journal of Multivariate Analysis, Elsevier, vol. 32(2), pages 296-312, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. What I Learned Last Week
      by Dave Giles in Econometrics Beat: Dave Giles' Blog on 2012-10-13 09:19:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abberger, Klaus & Graff, Michael & Siliverstovs, Boriss & Sturm, Jan-Egbert, 2018. "Using rule-based updating procedures to improve the performance of composite indicators," Economic Modelling, Elsevier, vol. 68(C), pages 127-144.
    2. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    3. Françoise Charpin, 2009. "Estimation précoce de la croissance: De la régression LARS au modèle à facteurs," Sciences Po publications info:hdl:2441/5l6uh8ogmqi, Sciences Po.
    4. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    5. Fan, Jianqing & Xue, Lingzhou & Yao, Jiawei, 2017. "Sufficient forecasting using factor models," Journal of Econometrics, Elsevier, vol. 201(2), pages 292-306.
    6. Eric Hillebrand & Huiyu Huang & Tae-Hwy Lee & Canlin Li, 2018. "Using the Entire Yield Curve in Forecasting Output and Inflation," Econometrics, MDPI, Open Access Journal, vol. 6(3), pages 1-27, August.
    7. Claudio Morana, 2014. "Factor Vector Autoregressive Estimation of Heteroskedastic Persistent and Non Persistent Processes Subject to Structural Breaks," Working Papers 273, University of Milano-Bicocca, Department of Economics, revised May 2014.
    8. Ruiz, Esther & Poncela, Pilar, 2012. "More is not always better : back to the Kalman filter in dynamic factor models," DES - Working Papers. Statistics and Econometrics. WS ws122317, Universidad Carlos III de Madrid. Departamento de Estadística.
    9. Tomohiro Ando & Ruey S. Tsay, 2009. "Model selection for generalized linear models with factor‐augmented predictors," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 25(3), pages 207-235, May.
    10. Cassola, Nuno & Morana, Claudio, 2010. "Comovements in volatility in the euro money market," Journal of International Money and Finance, Elsevier, vol. 29(3), pages 525-539, April.
    11. Rachida Ouysse, 2013. "Forecasting using a large number of predictors: Bayesian model averaging versus principal components regression," Discussion Papers 2013-04, School of Economics, The University of New South Wales.
    12. Norman R. Swanson & Weiqi Xiong, 2018. "Big data analytics in economics: What have we learned so far, and where should we go from here?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 51(3), pages 695-746, August.
    13. Ouysse, Rachida, 2016. "Bayesian model averaging and principal component regression forecasts in a data rich environment," International Journal of Forecasting, Elsevier, vol. 32(3), pages 763-787.
    14. Katja Heinisch & Rolf Scheufele, 2018. "Bottom-up or direct? Forecasting German GDP in a data-rich environment," Empirical Economics, Springer, vol. 54(2), pages 705-745, March.
    15. Francisco Dias & Maximiano Pinheiro & António Rua, 2010. "Forecasting using targeted diffusion indexes," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 341-352.
    16. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    17. Tommaso Proietti, 2016. "On the Selection of Common Factors for Macroeconomic Forecasting," Advances in Econometrics, in: Eric Hillebrand & Siem Jan Koopman (ed.), Dynamic Factor Models, volume 35, pages 593-628, Emerald Publishing Ltd.
    18. David F. Hendry & Kirstin Hubrich, 2011. "Combining Disaggregate Forecasts or Combining Disaggregate Information to Forecast an Aggregate," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(2), pages 216-227, April.
    19. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.
    20. Pilar Poncela & Esther Ruiz, 2016. "Small- Versus Big-Data Factor Extraction in Dynamic Factor Models: An Empirical Assessment," Advances in Econometrics, in: Eric Hillebrand & Siem Jan Koopman (ed.), Dynamic Factor Models, volume 35, pages 401-434, Emerald Publishing Ltd.

    More about this item

    Keywords

    Stein-rule; shrinkage; risk; variance-bias tradeo; OLS; principal components.;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C2 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2012-18. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.econ.au.dk/afn/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.