IDEAS home Printed from https://ideas.repec.org/a/wly/jforec/v39y2020i3p412-437.html
   My bibliography  Save this article

Revealing forecaster's preferences: A Bayesian multivariate loss function approach

Author

Listed:
  • Emmanuel C. Mamatzakis
  • Mike G. Tsionas

Abstract

Revealing the underlying preferences of a forecaster has always been at the core of much controversy. Herein, we build on the multivariate loss function concept and propose a flexible and multivariate family of likelihoods. This allows examining whether a vector of forecast errors, along with control variables, shapes a forecaster's preferences and, therefore, the underlying multivariate, nonseparable, loss function. We estimate the likelihood function using Bayesian exponentially tilted empirical likelihood, which reveals the shape of the parameter and the power of the multivariate loss function. In the empirical section, the reported evidence reveals that the EU Commission forecasts are predominantly asymmetric, leaning towards optimism in the year ahead, while a correction towards pessimism occurs in the current year forecast. There is some variability of this asymmetry across member states, with forecasts, i.e. gross domestic product growth, for large Member States exhibiting more optimism

Suggested Citation

  • Emmanuel C. Mamatzakis & Mike G. Tsionas, 2020. "Revealing forecaster's preferences: A Bayesian multivariate loss function approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(3), pages 412-437, April.
  • Handle: RePEc:wly:jforec:v:39:y:2020:i:3:p:412-437
    DOI: 10.1002/for.2636
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/for.2636
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.2636?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    2. Roberts, G. O. & Gilks, W. R., 1994. "Convergence of Adaptive Direction Sampling," Journal of Multivariate Analysis, Elsevier, vol. 49(2), pages 287-298, May.
    3. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    4. Filip Keereman, 1999. "The track record of the Commission forecasts," European Economy - Economic Papers 2008 - 2015 137, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    5. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    6. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    7. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    8. Claude J. P. Bélisle & H. Edwin Romeijn & Robert L. Smith, 1993. "Hit-and-Run Algorithms for Generating Multivariate Distributions," Mathematics of Operations Research, INFORMS, vol. 18(2), pages 255-266, May.
    9. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    10. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    11. Groen, Jan J.J. & Kapetanios, George, 2016. "Revisiting useful approaches to data-rich macroeconomic forecasting," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 221-239.
    12. Lucas, Robert Jr., 1972. "Expectations and the neutrality of money," Journal of Economic Theory, Elsevier, vol. 4(2), pages 103-124, April.
    13. G. A. Christodoulakis & E. C. Mamatzakis, 2009. "Assessing the prudence of economic forecasts in the EU," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 583-606.
    14. Susanne M. Schennach, 2005. "Bayesian exponentially tilted empirical likelihood," Biometrika, Biometrika Trust, vol. 92(1), pages 31-46, March.
    15. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    16. George A. Christodoulakis & Emmanuel C. Mamatzakis, 2008. "An assessment of the EU growth forecasts under asymmetric preferences," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(6), pages 483-492.
    17. Filip Keereman, 2003. "External assumptions, the international environment and the track record of the Commission Forecast," European Economy - Economic Papers 2008 - 2015 189, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    18. Mr. Michael J. Artis, 1996. "How Accurate Are the Imf's Short-Term Forecasts? Another Examination of the World Economic Outlook," IMF Working Papers 1996/089, International Monetary Fund.
    19. Ulrich K. Müller & Gebhard Kirchgässner, 2006. "Are forecasters reluctant to revise their predictions? Some German evidence," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(6), pages 401-413.
    20. Michael P. Clements, 2015. "Are Professional Macroeconomic Forecasters Able To Do Better Than Forecasting Trends?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(2-3), pages 349-382, March.
    21. Mark Girolami & Ben Calderhead, 2011. "Riemann manifold Langevin and Hamiltonian Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(2), pages 123-214, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    2. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    3. Giovannelli, Alessandro & Pericoli, Filippo Maria, 2020. "Are GDP forecasts optimal? Evidence on European countries," International Journal of Forecasting, Elsevier, vol. 36(3), pages 963-973.
    4. George A. Christodoulakis & Emmanuel C. Mamatzakis, 2008. "An assessment of the EU growth forecasts under asymmetric preferences," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(6), pages 483-492.
    5. Matteo Iacopini & Francesco Ravazzolo & Luca Rossini, 2020. "Proper scoring rules for evaluating asymmetry in density forecasting," Papers 2006.11265, arXiv.org, revised Sep 2020.
    6. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    7. Michael P. Clements, 2022. "Forecaster Efficiency, Accuracy, and Disagreement: Evidence Using Individual‐Level Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(2-3), pages 537-568, March.
    8. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    9. Jesús Fernández-Villaverde, 2010. "The econometrics of DSGE models," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 3-49, March.
    10. Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019. "Predictive regressions under asymmetric loss: Factor augmentation and model selection," International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.
    11. Jörg Döpke & Ulrich Fritsche & Boriss Siliverstovs, 2010. "Evaluating German business cycle forecasts under an asymmetric loss function," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(1), pages 1-18.
    12. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
    13. Julieta Caunedo & Riccardo Dicecio & Ivana Komunjer & Michael T. Owyang, 2020. "Asymmetry, Complementarities, and State Dependence in Federal Reserve Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 52(1), pages 205-228, February.
    14. Wang, Yiyao & Lee, Tae-Hwy, 2014. "Asymmetric loss in the Greenbook and the Survey of Professional Forecasters," International Journal of Forecasting, Elsevier, vol. 30(2), pages 235-245.
    15. Christodoulakis, George, 2020. "Estimating the term structure of commodity market preferences," European Journal of Operational Research, Elsevier, vol. 282(3), pages 1146-1163.
    16. Rülke, Jan-Christoph & Pierdzioch, Christian, 2014. "Government Forecasts of Budget Balances Under Asymmetric Loss: International Evidence," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100317, Verein für Socialpolitik / German Economic Association.
    17. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    18. Jens J. Krüger, 2014. "A multivariate evaluation of German output growth and inflation forecasts," Economics Bulletin, AccessEcon, vol. 34(3), pages 1410-1418.
    19. Michael P. Clements, 2014. "US Inflation Expectations and Heterogeneous Loss Functions, 1968–2010," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 1-14, January.
    20. Geweke, J. & Joel Horowitz & Pesaran, M.H., 2006. "Econometrics: A Bird’s Eye View," Cambridge Working Papers in Economics 0655, Faculty of Economics, University of Cambridge.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jforec:v:39:y:2020:i:3:p:412-437. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.