IDEAS home Printed from https://ideas.repec.org/a/gam/jecomi/v7y2019i3p93-d265705.html
   My bibliography  Save this article

A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss

Author

Listed:
  • Christoph Behrens

    (Department of Economics, Helmut Schmidt University, Holstenhofweg 85, 22043 Hamburg, Germany)

Abstract

This study contributes to research on the nonparametric evaluation of German trade forecasts. To this end, I compute random classification and regression forests to analyze the optimality of annual German export and import growth forecasts from 1970 to 2017. A forecast is considered as optimal if a set of predictors, which models the information set of a forecaster at the time of forecast formation, has no explanatory power for the corresponding (sign of the) forecast error. I analyze trade forecasts of four major German economic research institutes, a collaboration of German economic research institutes, and one international forecaster. For trade forecasts with a horizon of half-a-year, I cannot reject forecast optimality for all but one forecaster. In the case of a forecast horizon of one year, forecast optimality is rejected in more cases if the underlying loss function is assumed to be quadratic. Allowing for a flexible loss function results in more favorable assessment of forecast optimality.

Suggested Citation

  • Christoph Behrens, 2019. "A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss," Economies, MDPI, vol. 7(3), pages 1-23, September.
  • Handle: RePEc:gam:jecomi:v:7:y:2019:i:3:p:93-:d:265705
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7099/7/3/93/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7099/7/3/93/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Caldara, Dario & Iacoviello, Matteo & Molligo, Patrick & Prestipino, Andrea & Raffo, Andrea, 2020. "The economic effects of trade policy uncertainty," Journal of Monetary Economics, Elsevier, vol. 109(C), pages 38-59.
    2. Sun, Yuying & Wang, Shouyang & Zhang, Xun, 2018. "How efficient are China's macroeconomic forecasts? Evidences from a new forecasting evaluation approach," Economic Modelling, Elsevier, vol. 68(C), pages 506-513.
    3. Fritsche, Ulrich & Pierdzioch, Christian & Rülke, Jan-Christoph & Stadtmann, Georg, 2015. "Forecasting the Brazilian real and the Mexican peso: Asymmetric loss, forecast rationality, and forecaster herding," International Journal of Forecasting, Elsevier, vol. 31(1), pages 130-139.
    4. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    5. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    6. Aretz, Kevin & Bartram, Söhnke M. & Pope, Peter F., 2011. "Asymmetric loss functions and the rationality of expected stock returns," International Journal of Forecasting, Elsevier, vol. 27(2), pages 413-437.
    7. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    8. Ito, Takatoshi, 1990. "Foreign Exchange Rate Expectations: Micro Survey Data," American Economic Review, American Economic Association, vol. 80(3), pages 434-449, June.
    9. Grimme, Christian & Lehmann, Robert & Noeller, Marvin, 2021. "Forecasting imports with information from abroad," Economic Modelling, Elsevier, vol. 98(C), pages 109-117.
    10. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    11. Bae, Kee-Hong & Stulz, René M. & Tan, Hongping, 2008. "Do local analysts know more? A cross-country study of the performance of local analysts and foreign analysts," Journal of Financial Economics, Elsevier, vol. 88(3), pages 581-606, June.
    12. Robert Lehmann, 2021. "Forecasting exports across Europe: What are the superior survey indicators?," Empirical Economics, Springer, vol. 60(5), pages 2429-2453, May.
    13. Tarek A Hassan & Stephan Hollander & Laurence van Lent & Ahmed Tahoun, 2019. "Firm-Level Political Risk: Measurement and Effects," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 2135-2202.
    14. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    15. Elena Angelini & Marta Banbura & Gerhard Rünstler, 2010. "Estimating and forecasting the euro area monthly national accounts from a dynamic factor model," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(1), pages 1-22.
    16. Jesús Fernández-Villaverde & Pablo Guerrón-Quintana & Keith Kuester & Juan Rubio-Ramírez, 2015. "Fiscal Volatility Shocks and Economic Activity," American Economic Review, American Economic Association, vol. 105(11), pages 3352-3384, November.
    17. Sandra Hanslin Grossmann & Rolf Scheufele, 2019. "PMIs: Reliable indicators for exports?," Review of International Economics, Wiley Blackwell, vol. 27(2), pages 711-734, May.
    18. Michael Artis & Massimiliano Marcellino, 2001. "Fiscal forecasting: The track record of the IMF, OECD and EC," Econometrics Journal, Royal Economic Society, vol. 4(1), pages 20-36.
    19. Katja Heinisch & Rolf Scheufele, 2018. "Bottom-up or direct? Forecasting German GDP in a data-rich environment," Empirical Economics, Springer, vol. 54(2), pages 705-745, March.
    20. Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
    21. Jörg Döpke & Ulrich Fritsche, 2006. "Growth and inflation forecasts for Germany a panel-based assessment of accuracy and efficiency," Empirical Economics, Springer, vol. 31(3), pages 777-798, September.
    22. Christopher D. Carroll, 2003. "Macroeconomic Expectations of Households and Professional Forecasters," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 269-298.
    23. Christian Pierdzioch & Jan-Christoph Rülke, 2013. "A Note on Forecasting the Rate of Change of the Price of Oil: Asymmetric Loss and Forecast Rationality," Economies, MDPI, vol. 1(1), pages 1-8, March.
    24. Steffen Elstner & Christian Grimme & Ulrich Haskamp, 2013. "The Ifo Export Climate – an Early Indicator for the German Export Forecast," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 66(04), pages 36-43, March.
    25. George A. Christodoulakis & Emmanuel C. Mamatzakis, 2008. "An assessment of the EU growth forecasts under asymmetric preferences," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(6), pages 483-492.
    26. Christoffersen, Peter F & Diebold, Francis X, 1996. "Further Results on Forecasting and Model Selection under Asymmetric Loss," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 561-571, Sept.-Oct.
    27. Pierdzioch, Christian & Reid, Monique B. & Gupta, Rangan, 2016. "Forecasting the South African inflation rate: On asymmetric loss and forecast rationality," Economic Systems, Elsevier, vol. 40(1), pages 82-92.
    28. Nagwa Riad & Luca Errico & Christian Henn & Christian Saborowski & Mika Saito & Jarkko Turunen, 2012. "Changing Patterns of Global Trade," IMF Departmental Papers / Policy Papers 2012/001, International Monetary Fund.
    29. Andrade, Philippe & Le Bihan, Hervé, 2013. "Inattentive professional forecasters," Journal of Monetary Economics, Elsevier, vol. 60(8), pages 967-982.
    30. Cecilia Frale & Massimiliano Marcellino & Gian Luigi Mazzi & Tommaso Proietti, 2010. "Survey data as coincident or leading indicators," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 109-131.
    31. Oller, Lars-Erik & Barot, Bharat, 2000. "The accuracy of European growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 16(3), pages 293-315.
    32. Antonello D’Agostino & Michele Modugno & Chiara Osbat, 2017. "A Global Trade Model for the Euro Area," International Journal of Central Banking, International Journal of Central Banking, vol. 13(4), pages 1-34, December.
    33. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    34. Drechsel, Katja & Scheufele, Rolf, 2012. "The performance of short-term forecasts of the German economy before and during the 2008/2009 recession," International Journal of Forecasting, Elsevier, vol. 28(2), pages 428-445.
    35. Döhrn Roland & Schmidt Christoph M., 2011. "Information or Institution?: On the Determinants of Forecast Accuracy," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(1), pages 9-27, February.
    36. Theodore Pelagidis, 2018. "Free Trade, Protectionism, and the Global Economy," World Economics, World Economics, 1 Ivory Square, Plantation Wharf, London, United Kingdom, SW11 3UE, vol. 19(2), pages 121-128, April.
    37. Gebhardt Kirschgässner & Marcel Savioz, 2001. "Monetary Policy and Forecasts for Real GDP Growth: An Empirical Investigation for the Federal Republic of Germany," German Economic Review, Verein für Socialpolitik, vol. 2(4), pages 339-365, November.
    38. Pesaran, M Hashem & Timmermann, Allan, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    39. Berger, Helge & Ehrmann, Michael & Fratzscher, Marcel, 2009. "Forecasting ECB monetary policy: Accuracy is a matter of geography," European Economic Review, Elsevier, vol. 53(8), pages 1028-1041, November.
    40. Stéphanie Guichard & Elena Rusticelli, 2011. "A Dynamic Factor Model for World Trade Growth," OECD Economics Department Working Papers 874, OECD Publishing.
    41. Christopher J. Malloy, 2005. "The Geography of Equity Analysis," Journal of Finance, American Finance Association, vol. 60(2), pages 719-755, April.
    42. R. Scott Hacker & Abdulnasser Hatemi‐J, 2004. "The effect of exchange rate changes on trade balances in the short and long run," The Economics of Transition, The European Bank for Reconstruction and Development, vol. 12(4), pages 777-799, December.
    43. Frenkel, Michael & Lis, Eliza M. & Rülke, Jan-Christoph, 2011. "Has the economic crisis of 2007-2009 changed the expectation formation process in the Euro area?," Economic Modelling, Elsevier, vol. 28(4), pages 1808-1814, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Foltas, Alexander, 2020. "Testing investment forecast efficiency with textual data," Working Papers 19, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    2. Behrens, Christoph, 2020. "German trade forecasts since 1970: An evaluation using the panel dimension," Working Papers 26, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    3. Heinisch, Katja & Behrens, Christoph & Döpke, Jörg & Foltas, Alexander & Fritsche, Ulrich & Köhler, Tim & Müller, Karsten & Puckelwald, Johannes & Reichmayr, Hannes, 2023. "The IWH Forecasting Dashboard: From forecasts to evaluation and comparison," IWH Technical Reports 1/2023, Halle Institute for Economic Research (IWH).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Behrens, Christoph, 2019. "Evaluating the Joint Efficiency of German Trade Forecasts. A nonparametric multivariate approach," Working Papers 9, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    2. Behrens, Christoph & Pierdzioch, Christian & Risse, Marian, 2018. "Testing the optimality of inflation forecasts under flexible loss with random forests," Economic Modelling, Elsevier, vol. 72(C), pages 270-277.
    3. Behrens, Christoph, 2020. "German trade forecasts since 1970: An evaluation using the panel dimension," Working Papers 26, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    4. Robert Lehmann, 2021. "Forecasting exports across Europe: What are the superior survey indicators?," Empirical Economics, Springer, vol. 60(5), pages 2429-2453, May.
    5. Carlos Capistr¡N & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2-3), pages 365-396, March.
    6. Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019. "Predictive regressions under asymmetric loss: Factor augmentation and model selection," International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.
    7. Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2021. "The Rationality of USDA Forecasts under Multivariate Asymmetric Loss," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1006-1033, May.
    8. Carlos Capistrán & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2‐3), pages 365-396, March.
    9. Döpke, Jörg & Fritsche, Ulrich & Müller, Karsten, 2019. "Has macroeconomic forecasting changed after the Great Recession? Panel-based evidence on forecast accuracy and forecaster behavior from Germany," Journal of Macroeconomics, Elsevier, vol. 62(C).
    10. Matteo Iacopini & Francesco Ravazzolo & Luca Rossini, 2020. "Proper scoring rules for evaluating asymmetry in density forecasting," Papers 2006.11265, arXiv.org, revised Sep 2020.
    11. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    12. Giovannelli, Alessandro & Pericoli, Filippo Maria, 2020. "Are GDP forecasts optimal? Evidence on European countries," International Journal of Forecasting, Elsevier, vol. 36(3), pages 963-973.
    13. Anatolyev, Stanislav, 2009. "Dynamic modeling under linear-exponential loss," Economic Modelling, Elsevier, vol. 26(1), pages 82-89, January.
    14. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    15. Jörg Döpke & Ulrich Fritsche & Boriss Siliverstovs, 2010. "Evaluating German business cycle forecasts under an asymmetric loss function," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(1), pages 1-18.
    16. Christian Pierdzioch & Marian Risse & Sebastian Rohloff, 2016. "Fluctuations of the real exchange rate, real interest rates, and the dynamics of the price of gold in a small open economy," Empirical Economics, Springer, vol. 51(4), pages 1481-1499, December.
    17. Grimme, Christian & Lehmann, Robert & Noeller, Marvin, 2021. "Forecasting imports with information from abroad," Economic Modelling, Elsevier, vol. 98(C), pages 109-117.
    18. Robert Lehmann, 2016. "Economic Growth and Business Cycle Forecasting at the Regional Level," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 65.
    19. Pierdzioch, Christian & Risse, Marian & Rohloff, Sebastian, 2014. "The international business cycle and gold-price fluctuations," The Quarterly Review of Economics and Finance, Elsevier, vol. 54(2), pages 292-305.
    20. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecomi:v:7:y:2019:i:3:p:93-:d:265705. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.