IDEAS home Printed from https://ideas.repec.org/a/jof/jforec/v30y2011i6p579-596.html
   My bibliography  Save this article

Combining forecasts based on multiple encompassing tests in a macroeconomic core system

Author

Listed:
  • Mauro Costantini
  • Robert M. Kunst

Abstract

This paper investigates whether and to what extent multiple encompassing tests may help determine weights for forecast averaging in a standard vector autoregressive setting. To this end we consider a new test-based procedure, which assigns non‐zero weights to candidate models that add information not covered by other models. The potential benefits of this procedure are explored in extensive Monte Carlo simulations using realistic designs that are adapted to UK and to French macroeconomic data, to which trivariate vector autoregressions (VAR) are fitted. Thus simulations rely on potential data‐generating mechanisms for macroeconomic data rather than on simple but artificial designs. We run two types of forecast ‘competitions’. In the first one, one of the model classes is the trivariate VAR, such that it contains the generating mechanism. In the second specification, none of the competing models contains the true structure. The simulation results show that the performance of test‐based averaging is comparable to uniform weighting of individual models. In one of our role model economies, test‐based averaging achieves advantages in small samples. In larger samples, pure prediction models outperform forecast averages. Copyright (C) 2010 John Wiley & Sons, Ltd.

Suggested Citation

  • Mauro Costantini & Robert M. Kunst, 2011. "Combining forecasts based on multiple encompassing tests in a macroeconomic core system," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(6), pages 579-596, September.
  • Handle: RePEc:jof:jforec:v:30:y:2011:i:6:p:579-596
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/for.1190
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Tillmann, Peter, 2007. "Inflation regimes in the US term structure of interest rates," Economic Modelling, Elsevier, vol. 24(2), pages 203-223, March.
    2. Hansen, Bruce E. & Seo, Byeongseon, 2002. "Testing for two-regime threshold cointegration in vector error-correction models," Journal of Econometrics, Elsevier, vol. 110(2), pages 293-318, October.
    3. Saikkonen, Pentti & L tkepohl, Helmut & Trenkler, Carsten, 2006. "Break Date Estimation For Var Processes With Level Shift With An Application To Cointegration Testing," Econometric Theory, Cambridge University Press, vol. 22(01), pages 15-68, February.
    4. Saikkonen, Pentti & L tkepohl, Helmut, 2000. "Testing For The Cointegrating Rank Of A Var Process With An Intercept," Econometric Theory, Cambridge University Press, vol. 16(03), pages 373-406, June.
    5. Phillips, Peter C. B. & McFarland, James W., 1997. "Forward exchange market unbiasedness: the case of the Australian dollar since 1984," Journal of International Money and Finance, Elsevier, vol. 16(6), pages 885-907, December.
    6. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    7. Henrik Hansen & Søren Johansen, 1999. "Some tests for parameter constancy in cointegrated VAR-models," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 306-333.
    8. Christoffersen, Peter F & Diebold, Francis X, 1998. "Cointegration and Long-Horizon Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(4), pages 450-458, October.
    9. Clements, Michael P & Hendry, David F, 1995. "Forecasting in Cointegration Systems," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(2), pages 127-146, April-Jun.
    10. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, pages 47-78.
    11. Saikkonen, Pentti & Lutkepohl, Helmut, 2000. "Testing for the Cointegrating Rank of a VAR Process with Structural Shifts," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(4), pages 451-464, October.
    12. Seo, Byeongseon, 2003. "Nonlinear mean reversion in the term structure of interest rates," Journal of Economic Dynamics and Control, Elsevier, vol. 27(11), pages 2243-2265.
    13. Gonzalo, Jesus & Pitarakis, Jean-Yves, 1998. "Specification via model selection in vector error correction models," Economics Letters, Elsevier, vol. 60(3), pages 321-328, September.
    14. Bai, Jushan, 1997. "Estimating Multiple Breaks One at a Time," Econometric Theory, Cambridge University Press, vol. 13(03), pages 315-352, June.
    15. Badi Baltagi & Zijun Wang, 2007. "Testing for Cointegrating Rank Via Model Selection: Evidence From 165 Data Sets," Empirical Economics, Springer, pages 41-49.
    16. Søren Johansen & Rocco Mosconi & Bent Nielsen, 2000. "Cointegration analysis in the presence of structural breaks in the deterministic trend," Econometrics Journal, Royal Economic Society, vol. 3(2), pages 216-249.
    17. Sarno, Lucio & Thornton, Daniel L., 2003. "The dynamic relationship between the federal funds rate and the Treasury bill rate: An empirical investigation," Journal of Banking & Finance, Elsevier, vol. 27(6), pages 1079-1110, June.
    18. Hansen, Peter Reinhard, 2003. "Structural changes in the cointegrated vector autoregressive model," Journal of Econometrics, Elsevier, vol. 114(2), pages 261-295, June.
    19. Sarno, Lucio & Thornton, Daniel L & Valente, Giorgio, 2005. "Federal Funds Rate Prediction," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 449-471, June.
    20. Shea, Gary S, 1992. "Benchmarking the Expectations Hypothesis of the Interest-Rate Term Structure: An Analysis of Cointegration Vectors," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(3), pages 347-366, July.
    21. Chao, John C. & Phillips, Peter C. B., 1999. "Model selection in partially nonstationary vector autoregressive processes with reduced rank structure," Journal of Econometrics, Elsevier, vol. 91(2), pages 227-271, August.
    22. Hall, Anthony D & Anderson, Heather M & Granger, Clive W J, 1992. "A Cointegration Analysis of Treasury Bill Yields," The Review of Economics and Statistics, MIT Press, vol. 74(1), pages 116-126, February.
    23. Wang, Zijun & Bessler, David A., 2005. "A Monte Carlo Study On The Selection Of Cointegrating Rank Using Information Criteria," Econometric Theory, Cambridge University Press, vol. 21(03), pages 593-620, June.
    24. Richard H. Clarida & Lucio Sarno & Mark P. Taylor & Giorgio Valente, 2006. "The Role of Asymmetries and Regime Shifts in the Term Structure of Interest Rates," The Journal of Business, University of Chicago Press, vol. 79(3), pages 1193-1224, May.
    25. Lin, Jin-Lung & Tsay, Ruey S, 1996. "Co-integration Constraint and Forecasting: An Empirical Examination," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 519-538, Sept.-Oct.
    26. Seo, Byeongseon, 1998. "Tests For Structural Change In Cointegrated Systems," Econometric Theory, Cambridge University Press, vol. 14(02), pages 222-259, April.
    27. Inoue, Atsushi, 1999. "Tests of cointegrating rank with a trend-break," Journal of Econometrics, Elsevier, vol. 90(2), pages 215-237, June.
    28. Seo, Byeongseon, 2003. "Nonlinear mean reversion in the term structure of interest rates," Journal of Economic Dynamics and Control, Elsevier, vol. 27(11-12), pages 2243-2265, September.
    29. Kapetanios, George, 2004. "The Asymptotic Distribution Of The Cointegration Rank Estimator Under The Akaike Information Criterion," Econometric Theory, Cambridge University Press, vol. 20(04), pages 735-742, August.
    30. Lutkepohl, Helmut & Saikkonen, Pentti, 2000. "Testing for the cointegrating rank of a VAR process with a time trend," Journal of Econometrics, Elsevier, vol. 95(1), pages 177-198, March.
    31. Helmut Lütkepohl & Pentti Saikkonen & Carsten Trenkler, 2004. "Testing for the Cointegrating Rank of a VAR Process with Level Shift at Unknown Time," Econometrica, Econometric Society, vol. 72(2), pages 647-662, March.
    32. Pena, Daniel & Poncela, Pilar, 2004. "Forecasting with nonstationary dynamic factor models," Journal of Econometrics, Elsevier, vol. 119(2), pages 291-321, April.
    33. Markku Lanne, 2000. "Near unit roots, cointegration, and the term structure of interest rates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 513-529.
    34. Jose Luis Fernandez-Serrano & M. Dolores Robles-Fernandez, 2008. "Time-series model forecasts and structural breaks: evidence from Spanish pre-EMU interest rates," Applied Economics, Taylor & Francis Journals, vol. 40(13), pages 1707-1721.
    35. Hamilton, James D., 1988. "Rational-expectations econometric analysis of changes in regime : An investigation of the term structure of interest rates," Journal of Economic Dynamics and Control, Elsevier, vol. 12(2-3), pages 385-423.
    36. Søren Johansen & Rocco Mosconi & Bent Nielsen, 2000. "Cointegration analysis in the presence of structural breaks in the deterministic trend," Econometrics Journal, Royal Economic Society, vol. 3(2), pages 216-249.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Antonis Michis, 2012. "Monitoring Forecasting Combinations with Semiparametric Regression Models," Working Papers 2012-02, Central Bank of Cyprus.
    2. Pablo Pincheira, 2012. "Are Forecast Combinations Efficient?," Working Papers Central Bank of Chile 661, Central Bank of Chile.
    3. Gunter, Ulrich & Önder, Irem, 2016. "Forecasting city arrivals with Google Analytics," Annals of Tourism Research, Elsevier, vol. 61(C), pages 199-212.
    4. Costantini, Mauro & Gunter, Ulrich & Kunst, Robert M., 2012. "Forecast Combination Based on Multiple Encompassing Tests in a Macroeconomic DSGE-VAR System," Economics Series 292, Institute for Advanced Studies.
    5. Alessandro Girardi & Roberto Golinelli & Carmine Pappalardo, 2017. "The role of indicator selection in nowcasting euro-area GDP in pseudo-real time," Empirical Economics, Springer, vol. 53(1), pages 79-99, August.
    6. Crespo Cuaresma, Jesus & Fortin, Ines & Hlouskova, Jaroslava, 2017. "Exchange rate forecasting and the performance of currency portfolios," Economics Series 326, Institute for Advanced Studies.
    7. Chen, Qiwei & Costantini, Mauro & Deschamps, Bruno, 2016. "How accurate are professional forecasts in Asia? Evidence from ten countries," International Journal of Forecasting, Elsevier, vol. 32(1), pages 154-167.
    8. Wojciech Charemza & Carlos Diaz Vela & Svetlana Makarova, 2013. "Inflation fan charts, monetary policy and skew normal distribution," Discussion Papers in Economics 13/06, Department of Economics, University of Leicester.
    9. Bergmeir, Christoph & Costantini, Mauro & Benítez, José M., 2014. "On the usefulness of cross-validation for directional forecast evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 132-143.
    10. repec:wly:jforec:v:36:y:2017:i:3:p:305-324 is not listed on IDEAS
    11. Mauro Costantini & Ulrich Gunter & Robert M. Kunst, 2017. "Forecast Combinations in a DSGE‐VAR Lab," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(3), pages 305-324, April.
    12. Costantini, Mauro & Kunst, Robert M., 2011. "On the Usefulness of the Diebold-Mariano Test in the Selection of Prediction Models," Economics Series 276, Institute for Advanced Studies.

    More about this item

    Keywords

    combining forecasts ; encompassing tests ; model selection ; time series ;

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:30:y:2011:i:6:p:579-596. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.