IDEAS home Printed from https://ideas.repec.org/p/een/camaaa/2019-47.html
   My bibliography  Save this paper

Empirically-transformed linear opinion pools

Author

Listed:
  • Anthony Garratt
  • Timo Henckel
  • Shaun P. Vahey

Abstract

Many studies have found that combining density forecasts improves predictive accuracy for macroeconomic variables. A prevalent approach known as the Linear Opinion Pool (LOP) combines forecast densities from “experts”; see, among others, Stone (1961), Geweke and Amisano (2011), Kascha and Ravazzolo (2011), Ranjan and Gneiting (2010) and Gneiting and Ranjan (2013). Since the LOP approach averages the experts’ probabilistic assessments, the distribution of the combination generally differs from the marginal distributions of the experts. As a result, the LOP combination forecasts sometimes fail to match salient features of the sample data, including asymmetries in risk. In this paper, we propose a computationally convenient transformation for a target macroeconomic variable with an asymmetric marginal distribution. Our methodology involves a Smirnov transform to reshape the LOP combination forecasts using a nonparametric kernel-smoothed empirical cumulative distribution function. We illustrate our methodology with an application examining quarterly real-time forecasts for US inflation based on multiple output gap measures over an evaluation sample from 1990:1 to 2017:2. Our proposed methodology improves combination forecast performance by approximately 10% in terms of both the root mean squared forecast error and the continuous ranked probability score. We find that our methodology delivers a similar performance gain for the Logarithmic Opinion Pool (LogOP), a commonly-used alternative to the LOP.

Suggested Citation

  • Anthony Garratt & Timo Henckel & Shaun P. Vahey, 2019. "Empirically-transformed linear opinion pools," CAMA Working Papers 2019-47, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
  • Handle: RePEc:een:camaaa:2019-47
    as

    Download full text from publisher

    File URL: https://cama.crawford.anu.edu.au/sites/default/files/publication/cama_crawford_anu_edu_au/2019-07/47_2019_garratt_henckel_vahey.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Orphanides, Athanasios & van Norden, Simon, 2005. "The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 583-601, June.
    2. Morris H. DeGroot & Julia Mortera, 1991. "Optimal Linear Opinion Pools," Management Science, INFORMS, vol. 37(5), pages 546-558, May.
    3. Ozer Karagedikli & Shaun P. Vahey & Elizabeth C. Wakerly, 2019. "Improved methods for combining point forecasts for an asymmetrically distributed variable," CAMA Working Papers 2019-15, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    4. Athanasios Orphanides & Simon van Norden, 2002. "The Unreliability of Output-Gap Estimates in Real Time," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 569-583, November.
    5. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    6. John W. Galbraith & Simon van Norden, 2012. "Assessing gross domestic product and inflation probability forecasts derived from Bank of England fan charts," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(3), pages 713-727, July.
    7. Hodrick, Robert J & Prescott, Edward C, 1997. "Postwar U.S. Business Cycles: An Empirical Investigation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 29(1), pages 1-16, February.
    8. Dante Amengual & Enrique Sentana & Zhanyuan Tian, 2022. "Gaussian Rank Correlation and Regression," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Panel Modeling, Micro Applications, and Econometric Methodology, volume 43, pages 269-306, Emerald Group Publishing Limited.
    9. Rossi, Barbara & Sekhposyan, Tatevik, 2014. "Evaluating predictive densities of US output growth and inflation in a large macroeconomic data set," International Journal of Forecasting, Elsevier, vol. 30(3), pages 662-682.
    10. Tobias Adrian & Nina Boyarchenko & Domenico Giannone, 2021. "Multimodality In Macrofinancial Dynamics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 62(2), pages 861-886, May.
    11. Rossi, Barbara & Sekhposyan, Tatevik, 2019. "Alternative tests for correct specification of conditional predictive densities," Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
    12. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2020. "Capturing Macroeconomic Tail Risks with Bayesian Vector Autoregressions," Working Papers 20-02R, Federal Reserve Bank of Cleveland, revised 22 Sep 2020.
    13. Deheuvels, Paul, 1981. "An asymptotic decomposition for multivariate distribution-free tests of independence," Journal of Multivariate Analysis, Elsevier, vol. 11(1), pages 102-113, March.
    14. Christian Kascha & Francesco Ravazzolo, 2010. "Combining inflation density forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 231-250.
    15. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    16. Geweke, John & Amisano, Gianni, 2011. "Optimal prediction pools," Journal of Econometrics, Elsevier, vol. 164(1), pages 130-141, September.
    17. Lawrence J. Christiano & Terry J. Fitzgerald, 2003. "The Band Pass Filter," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(2), pages 435-465, May.
    18. Rubén Loaiza-Maya & Michael Stanley Smith, 2020. "Real-Time Macroeconomic Forecasting With a Heteroscedastic Inversion Copula," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 470-486, April.
    19. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    20. Garratt, Anthony & Mitchell, James & Vahey, Shaun P., 2014. "Measuring output gap nowcast uncertainty," International Journal of Forecasting, Elsevier, vol. 30(2), pages 268-279.
    21. Anthony Garratt & Kevin Lee & Emi Mise & Kalvinder Shields, 2008. "Real-Time Representations of the Output Gap," The Review of Economics and Statistics, MIT Press, vol. 90(4), pages 792-804, November.
    22. Gergely Akos Ganics, 2017. "Optimal density forecast combinations," Working Papers 1751, Banco de España.
    23. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29.
    24. Anthony Garratt & Ivan Petrella, 2022. "Commodity prices and inflation risk," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 392-414, March.
    25. Beveridge, Stephen & Nelson, Charles R., 1981. "A new approach to decomposition of economic time series into permanent and transitory components with particular attention to measurement of the `business cycle'," Journal of Monetary Economics, Elsevier, vol. 7(2), pages 151-174.
    26. Roopesh Ranjan & Tilmann Gneiting, 2010. "Combining probability forecasts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 71-91, January.
    27. Marianne Baxter & Robert G. King, 1999. "Measuring Business Cycles: Approximate Band-Pass Filters For Economic Time Series," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 575-593, November.
    28. Mateo Velásquez‐Giraldo & Gustavo Canavire‐Bacarreza & Kim P. Huynh & David T. Jacho‐Chavez, 2018. "Flexible Estimation of Demand Systems: A Copula Approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(7), pages 1109-1116, November.
    29. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    30. Francis X. Diebold & Minchul Shin & Boyuan Zhang, 2020. "On the Aggregation of Probability Assessments: Regularized Mixtures of Predictive Densities for Eurozone Inflation and Real Interest Rates," Papers 2012.11649, arXiv.org, revised Jun 2022.
    31. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    32. Garratt, Anthony & Mitchell, James & Vahey, Shaun P. & Wakerly, Elizabeth C., 2011. "Real-time inflation forecast densities from ensemble Phillips curves," The North American Journal of Economics and Finance, Elsevier, vol. 22(1), pages 77-87, January.
    33. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    34. Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2018. "Bayesian Nonparametric Calibration and Combination of Predictive Distributions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 675-685, April.
    35. Malte Knüppel & Fabian Krüger, 2022. "Forecast uncertainty, disagreement, and the linear pool," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 23-41, January.
    36. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    37. Barbara Rossi, 2019. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," Working Papers 1162, Barcelona School of Economics.
    38. Cogley, Timothy & Morozov, Sergei & Sargent, Thomas J., 2005. "Bayesian fan charts for U.K. inflation: Forecasting and sources of uncertainty in an evolving monetary system," Journal of Economic Dynamics and Control, Elsevier, vol. 29(11), pages 1893-1925, November.
    39. Michael S. Smith & Shaun P. Vahey, 2016. "Asymmetric Forecast Densities for U.S. Macroeconomic Variables from a Gaussian Copula Model of Cross-Sectional and Serial Dependence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 416-434, July.
    40. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    41. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    42. Patrick J. Coe & Shaun P. Vahey, 2020. "Financial conditions and the risks to economic growth in the United States since 1875," CAMA Working Papers 2020-36, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    43. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Barbara Rossi, 2019. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," Working Papers 1162, Barcelona School of Economics.
    2. Knotek, Edward S. & Zaman, Saeed, 2023. "Real-time density nowcasts of US inflation: A model combination approach," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1736-1760.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Garratt, Anthony & Mitchell, James & Vahey, Shaun P., 2014. "Measuring output gap nowcast uncertainty," International Journal of Forecasting, Elsevier, vol. 30(2), pages 268-279.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Dr. James Mitchell, 2009. "Measuring Output Gap Uncertainty," National Institute of Economic and Social Research (NIESR) Discussion Papers 342, National Institute of Economic and Social Research.
    4. Knotek, Edward S. & Zaman, Saeed, 2023. "Real-time density nowcasts of US inflation: A model combination approach," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1736-1760.
    5. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    6. Garratt, Anthony & Mitchell, James & Vahey, Shaun P. & Wakerly, Elizabeth C., 2011. "Real-time inflation forecast densities from ensemble Phillips curves," The North American Journal of Economics and Finance, Elsevier, vol. 22(1), pages 77-87, January.
    7. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    8. Buncic, Daniel & Müller, Oliver, 2017. "Measuring the output gap in Switzerland with linear opinion pools," Economic Modelling, Elsevier, vol. 64(C), pages 153-171.
    9. Knut Are Aastveit & James Mitchell & Francesco Ravazzolo & Herman van Dijk, 2018. "The Evolution of Forecast Density Combinations in Economics," Tinbergen Institute Discussion Papers 18-069/III, Tinbergen Institute.
    10. Knut Are Aastveit & Karsten R. Gerdrup & Anne Sofie Jore & Leif Anders Thorsrud, 2014. "Nowcasting GDP in Real Time: A Density Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 48-68, January.
    11. Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2019. "Density Forecasting," BEMPS - Bozen Economics & Management Paper Series BEMPS59, Faculty of Economics and Management at the Free University of Bozen.
    12. Garratt, Anthony & Mitchell, James & Vahey, Shaun P., 2014. "Probability Forecasting for Inflation Warnings from the Federal Reserve," EMF Research Papers 07, Economic Modelling and Forecasting Group.
    13. Anthony Garratt & Ivan Petrella, 2022. "Commodity prices and inflation risk," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 392-414, March.
    14. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    15. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    16. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    17. Bjørnland, Hilde C. & Ravazzolo, Francesco & Thorsrud, Leif Anders, 2017. "Forecasting GDP with global components: This time is different," International Journal of Forecasting, Elsevier, vol. 33(1), pages 153-173.
    18. Ravazzolo Francesco & Vahey Shaun P., 2014. "Forecast densities for economic aggregates from disaggregate ensembles," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 18(4), pages 1-15, September.
    19. Ruben Loaiza‐Maya & Gael M. Martin & David T. Frazier, 2021. "Focused Bayesian prediction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 517-543, August.
    20. Galvão, Ana Beatriz & Garratt, Anthony & Mitchell, James, 2021. "Does judgment improve macroeconomic density forecasts?," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1247-1260.

    More about this item

    Keywords

    Forecast density combination; Smirnov transform; inflation;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:een:camaaa:2019-47. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Cama Admin (email available below). General contact details of provider: https://edirc.repec.org/data/asanuau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.