IDEAS home Printed from https://ideas.repec.org/a/taf/emetrv/v29y2010i5-6p511-533.html
   My bibliography  Save this article

Bagging or Combining (or Both)? An Analysis Based on Forecasting U.S. Employment Growth

Author

Listed:
  • David Rapach
  • Jack Strauss

Abstract

Forecasting a macroeconomic variable is challenging in an environment with many potential predictors whose predictive ability can vary over time. We compare two approaches to forecasting U.S. employment growth in this type of environment. The first approach applies bootstrap aggregating (bagging) to a general-to-specific procedure based on a general dynamic linear regression model with 30 potential predictors. The second approach considers several methods for combining forecasts from 30 individual autoregressive distributed lag (ARDL) models, where each individual ARDL model contains a potential predictor. We analyze bagging and combination forecasts at multiple horizons over four different out-of-sample periods using a mean square forecast error (MSFE) criterion and forecast encompassing tests. We find that bagging forecasts often deliver the lowest MSFE. Interestingly, we also find that incorporating information from both bagging and combination forecasts based on principal components often leads to further gains in forecast accuracy.

Suggested Citation

  • David Rapach & Jack Strauss, 2010. "Bagging or Combining (or Both)? An Analysis Based on Forecasting U.S. Employment Growth," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 511-533.
    • Handle: RePEc:taf:emetrv:v:29:y:2010:i:5-6:p:511-533
    DOI: 10.1080/07474938.2010.481550
    as

    Download full text from publisher

    File URL: http://www.tandfonline.com/doi/abs/10.1080/07474938.2010.481550
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/07474938.2010.481550?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    2. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    3. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    4. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    5. Lee, Tae-Hwy & Yang, Yang, 2006. "Bagging binary and quantile predictors for time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 465-497.
    6. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    7. Bai, Jushan & Ng, Serena, 2006. "Evaluating latent and observed factors in macroeconomics and finance," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 507-537.
    8. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    9. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809.
    10. David E. Rapach & Jack K. Strauss, 2008. "Forecasting US employment growth using forecast combining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(1), pages 75-93.
    11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    12. Figlewski, Stephen, 1983. "Optimal Price Forecasting Using Survey Data," The Review of Economics and Statistics, MIT Press, vol. 65(1), pages 13-21, February.
    13. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    14. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    15. Yeung Lewis Chan & James H. Stock & Mark W. Watson, 1999. "A dynamic factor model framework for forecast combination," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 91-121.
    16. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    17. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jordan, Steven J. & Vivian, Andrew & Wohar, Mark E., 2017. "Forecasting market returns: bagging or combining?," International Journal of Forecasting, Elsevier, vol. 33(1), pages 102-120.
    2. Rapach, David E. & Strauss, Jack K., 2012. "Forecasting US state-level employment growth: An amalgamation approach," International Journal of Forecasting, Elsevier, vol. 28(2), pages 315-327.
    3. Pedro Henrique Melo Albuquerque & Yaohao Peng & João Pedro Fontoura da Silva, 2022. "Making the whole greater than the sum of its parts: A literature review of ensemble methods for financial time series forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1701-1724, December.
    4. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    5. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    6. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    7. Aye, Goodness C. & Balcilar, Mehmet & Gupta, Rangan & Majumdar, Anandamayee, 2015. "Forecasting aggregate retail sales: The case of South Africa," International Journal of Production Economics, Elsevier, vol. 160(C), pages 66-79.
    8. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    9. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    10. Schumacher Christian & Dreger Christian, 2004. "Estimating Large-Scale Factor Models for Economic Activity in Germany: Do They Outperform Simpler Models? / Die Schätzung von großen Faktormodellen für die deutsche Volkswirtschaft: Übertreffen sie ei," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 224(6), pages 731-750, December.
    11. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    12. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.
    13. Jordan, Steven J. & Vivian, Andrew & Wohar, Mark E., 2016. "Can commodity returns forecast Canadian sector stock returns?," International Review of Economics & Finance, Elsevier, vol. 41(C), pages 172-188.
    14. David E. Rapach & Jack K. Strauss, 2008. "Forecasting US employment growth using forecast combining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(1), pages 75-93.
    15. Yang, Ke & Tian, Fengping & Chen, Langnan & Li, Steven, 2017. "Realized volatility forecast of agricultural futures using the HAR models with bagging and combination approaches," International Review of Economics & Finance, Elsevier, vol. 49(C), pages 276-291.
    16. Rangan Gupta & Alain Kabundi & Stephen Miller & Josine Uwilingiye, 2014. "Using large data sets to forecast sectoral employment," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(2), pages 229-264, June.
    17. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    18. Ali Dib & Mohamed Gammoudi & Kevin Moran, 2008. "Forecasting Canadian time series with the New Keynesian model," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 138-165, February.
    19. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    20. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:29:y:2010:i:5-6:p:511-533. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.tandfonline.com/LECR20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.