IDEAS home Printed from https://ideas.repec.org/p/eca/wpaper/2013-124527.html
   My bibliography  Save this paper

Optimal Combination of Survey Forecasts

Author

Listed:
  • Cristina Conflitti
  • Christine De Mol
  • Domenico Giannone

Abstract

We consider the problem of optimally combining individual forecasts of gross domestic product (GDP) and inflation from the Survey of Professional Forecasters (SPF) dataset for the Euro Area. Contrary to the common practice of using equal combination weights, we compute optimal weights which minimize the mean square forecast error (MSFE) in the case of point forecasts and maximize a logarithmic score in the case of density forecasts. We show that this is a viable strategy even when the number of forecasts to combine gets large, provided we constrain these weights to be positive and to sum to one. Indeed, this enforces a form of shrinkage on the weights which ensures good out-of-sample performance of the combined forecasts.

Suggested Citation

  • Cristina Conflitti & Christine De Mol & Domenico Giannone, 2012. "Optimal Combination of Survey Forecasts," Working Papers ECARES ECARES 2012-023, ULB -- Universite Libre de Bruxelles.
  • Handle: RePEc:eca:wpaper:2013/124527
    as

    Download full text from publisher

    File URL: https://dipot.ulb.ac.be/dspace/bitstream/2013/124527/1/2012-023-CONFLITTI_DEMOL_GIANNONE-optimal.pdf
    File Function: 2012-023-CONFLITTI_DEMOL_GIANNONE-optimal
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29.
    2. Yeung Lewis Chan & James H. Stock & Mark W. Watson, 1999. "A dynamic factor model framework for forecast combination," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 91-121.
    3. Billio, Monica & Casarin, Roberto & Ravazzolo, Francesco & van Dijk, Herman K., 2013. "Time-varying combinations of predictive densities using nonlinear filtering," Journal of Econometrics, Elsevier, vol. 177(2), pages 213-232.
    4. Carlos Bowles & Roberta Friz & Veronique Genre & Geoff Kenny & Aidan Meyler & Tuomas Rautanen, 2007. "The ECB survey of professional forecasters (SPF) – A review after eight years’ experience," Occasional Paper Series 59, European Central Bank.
    5. Monica Billio & Roberto Casarin & Francesco Ravazzolo & Herman K. van Dijk, 2010. "Combining predictive densities using Bayesian filtering with applications to US economics data," Working Paper 2010/29, Norges Bank.
    6. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    7. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    8. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    9. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, Elsevier.
    10. Domenico Giannone & Jérôme Henry & Magdalena Lalik & Michele Modugno, 2012. "An Area-Wide Real-Time Database for the Euro Area," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1000-1013, November.
    11. Kenneth Wallis, 2011. "Combining forecasts - forty years later," Applied Financial Economics, Taylor & Francis Journals, vol. 21(1-2), pages 33-41.
    12. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    13. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    14. Carlos Bowles & Roberta Friz & Veronique Genre & Geoff Kenny & Aidan Meyler & Tuomas Rautanen, 2010. "An Evaluation of the Growth and Unemployment Forecasts in the ECB Survey of Professional Forecasters," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(2), pages 1-28.
    15. Poncela, Pilar & Rodríguez, Julio & Sánchez-Mangas, Rocío & Senra, Eva, 2011. "Forecast combination through dimension reduction techniques," International Journal of Forecasting, Elsevier, vol. 27(2), pages 224-237, April.
    16. Geweke, John & Amisano, Gianni, 2011. "Optimal prediction pools," Journal of Econometrics, Elsevier, vol. 164(1), pages 130-141, September.
    17. John Geweke & Gianni Amisano, 2012. "Prediction with Misspecified Models," American Economic Review, American Economic Association, vol. 102(3), pages 482-486, May.
    18. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
    19. Brodie, Joshua & Daubechies, Ingrid & De Mol, Christine & Giannone, Domenico, 2007. "Sparse and Stable Markowitz Portfolios," CEPR Discussion Papers 6474, C.E.P.R. Discussion Papers.
    20. Sloughter, J. McLean & Gneiting, Tilmann & Raftery, Adrian E., 2010. "Probabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 25-35.
    21. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    22. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    23. Juan Angel Garcia, 2003. "An introduction to the ECB’s survey of professional forecasters," Occasional Paper Series 08, European Central Bank.
    24. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    25. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    26. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    27. Clements, Michael P. & Harvey, David I., 2011. "Combining probability forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 208-223, April.
    28. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2010. "Combining the forecasts in the ECB survey of professional forecasters: can anything beat the simple average?," Working Paper Series 1277, European Central Bank.
    29. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    30. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Roberto Casarin & Stefano Grassi & Francesco Ravazzolo & Herman K. van Dijk, 2015. "Dynamic predictive density combinations for large data sets in economics and finance," Working Paper 2015/12, Norges Bank.
    2. repec:gam:jecnmx:v:5:y:2017:i:4:p:44-:d:114224 is not listed on IDEAS
    3. Constantin Bürgi & Tara M. Sinclair, 2017. "A nonparametric approach to identifying a subset of forecasters that outperforms the simple average," Empirical Economics, Springer, vol. 53(1), pages 101-115, August.
    4. Espasa Terrades, Antoni & Senra, Eva, 2017. "22 Years of inflation assessment and forecasting experience at the bulletin of EU & US inflation and macroeconomic analysis," DES - Working Papers. Statistics and Econometrics. WS 24678, Universidad Carlos III de Madrid. Departamento de Estadística.
    5. repec:spr:jbuscr:v:13:y:2017:i:2:d:10.1007_s41549-017-0017-6 is not listed on IDEAS
    6. Anne Opschoor & Dick van Dijk & Michel van der Wel, 2014. "Improving Density Forecasts and Value-at-Risk Estimates by Combining Densities," Tinbergen Institute Discussion Papers 14-090/III, Tinbergen Institute.
    7. Víctor López-Pérez, 2017. "Do professional forecasters behave as if they believed in the New Keynesian Phillips Curve for the euro area?," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 44(1), pages 147-174, February.
    8. Rodríguez, Julio & Poncela, Pilar & Fuentes, Julieta, 2014. "Selecting and combining experts from survey forecasts," DES - Working Papers. Statistics and Econometrics. WS ws140905, Universidad Carlos III de Madrid. Departamento de Estadística.
    9. McDonald, Christopher & Thamotheram, Craig & Vahey, Shaun P. & Wakerly, Elizabeth C., 2015. "Assessing the Economic Value of Probabilistic Forecasts in the Presence of an Inflation Target," EMF Research Papers 09, Economic Modelling and Forecasting Group.
    10. repec:kap:jgeosy:v:19:y:2017:i:4:d:10.1007_s10109-017-0259-9 is not listed on IDEAS
    11. Victor Lopez-Perez, 2016. "Macroeconomic Forecast Uncertainty In The Euro Area," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 11(1), pages 9-41, March.
    12. Cobb, Marcus P A, 2017. "Joint Forecast Combination of Macroeconomic Aggregates and Their Components," MPRA Paper 76556, University Library of Munich, Germany.
    13. repec:spr:empeco:v:53:y:2017:i:1:d:10.1007_s00181-016-1181-6 is not listed on IDEAS
    14. repec:eee:renene:v:116:y:2018:i:pa:p:669-684 is not listed on IDEAS
    15. McAdam, Peter & Warne, Anders, 2018. "Euro area real-time density forecasting with financial or labor market frictions," Working Paper Series 2140, European Central Bank.
    16. Sami Oinonen & Maritta Paloviita, 2017. "How Informative are Aggregated Inflation Expectations? Evidence from the ECB Survey of Professional Forecasters," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 13(2), pages 139-163, November.
    17. repec:eee:jomega:v:78:y:2018:i:c:p:165-175 is not listed on IDEAS

    More about this item

    Keywords

    forecast combination; forecast evaluation; survey of professional forecasters; real-time data; shrinkage; high-dimensional data;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eca:wpaper:2013/124527. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Benoit Pauwels). General contact details of provider: http://edirc.repec.org/data/arulbbe.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.