IDEAS home Printed from https://ideas.repec.org/p/ces/ifowps/_196.html
   My bibliography  Save this paper

Survey-based indicators vs. hard data: What improves export forecasts in Europe?

Author

Listed:
  • Robert Lehmann

Abstract

In this study, we evaluate whether survey-based indicators produce lower forecast errors for export growth than indicators obtained from hard data such as price and cost competitiveness measures. Our pseudo out-of-sample analyses and forecastencompassing tests reveal that survey-based indicators outperform the benchmark model as well as the indicators from hard data for most of the twenty European states focused on in our study and the aggregates EA-18 and EU-28. The most accurate forecasts are on average produced by the confidence indicator in the manufacturing sector, the economic sentiment indicator and the production expectations. However, large country differences in the forecast accuracy of survey-based indicators emerge. These differences are mainly explained by country-specific export compositions. A larger share in raw material or oil exports worsens the accuracy of soft indicators. The accuracy of soft indicators improves if countries have a larger share in exports of machinery goods. For hard indicators, we find only weak evidence for the export composition to explain differences in forecast accuracy.

Suggested Citation

  • Robert Lehmann, 2015. "Survey-based indicators vs. hard data: What improves export forecasts in Europe?," ifo Working Paper Series 196, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
  • Handle: RePEc:ces:ifowps:_196
    as

    Download full text from publisher

    File URL: https://www.ifo.de/DocDL/IfoWorkingPaper-196.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sandra Hanslin Grossmann & Rolf Scheufele, 2019. "PMIs: Reliable indicators for exports?," Review of International Economics, Wiley Blackwell, vol. 27(2), pages 711-734, May.
    2. Katja Heinisch & Rolf Scheufele, 2018. "Bottom-up or direct? Forecasting German GDP in a data-rich environment," Empirical Economics, Springer, vol. 54(2), pages 705-745, March.
    3. Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
    4. Cecilia Frale & Massimiliano Marcellino & Gian Luigi Mazzi & Tommaso Proietti, 2010. "Survey data as coincident or leading indicators," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 109-131.
    5. Robert Lehmann & Antje Weyh, 2016. "Forecasting Employment in Europe: Are Survey Results Helpful?," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 81-117, September.
    6. Christian Seiler, 2015. "On the robustness of balance statistics with respect to nonresponse," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2014(2), pages 45-62.
    7. Nils Jannsen & Julia Richter, 2012. "Kapazitätsauslastung im Ausland als Indikator für die deutschen Investitionsgüterexporte," Wirtschaftsdienst, Springer;ZBW - Leibniz Information Centre for Economics, vol. 92(12), pages 833-837, December.
    8. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    9. David H. Romer & Jeffrey A. Frankel, 1999. "Does Trade Cause Growth?," American Economic Review, American Economic Association, vol. 89(3), pages 379-399, June.
    10. Alexander Keck & Alexander Raubold & Alessandro Truppia, 2010. "Forecasting international trade: A time series approach," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2009(2), pages 157-176.
    11. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    12. Steffen Elstner & Christian Grimme & Ulrich Haskamp, 2013. "The Ifo Export Climate – an Early Indicator for the German Export Forecast," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 66(04), pages 36-43, March.
    13. Stéphanie Guichard & Elena Rusticelli, 2011. "A Dynamic Factor Model for World Trade Growth," OECD Economics Department Working Papers 874, OECD Publishing.
    14. Simeon Vosen & Torsten Schmidt, 2011. "Forecasting private consumption: survey‐based indicators vs. Google trends," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(6), pages 565-578, September.
    15. Christian Gayer, 2006. "Forecast Evaluation of European Commission Survey Indicators," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2005(2), pages 157-183.
    16. Elena Angelini & Marta Banbura & Gerhard Rünstler, 2010. "Estimating and forecasting the euro area monthly national accounts from a dynamic factor model," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(1), pages 1-22.
    17. Fiorito, Riccardo & Kollintzas, Tryphon, 1994. "Stylized facts of business cycles in the G7 from a real business cycles perspective," European Economic Review, Elsevier, vol. 38(2), pages 235-269, February.
    18. Lemmens, Aurelie & Croux, Christophe & Dekimpe, Marnik G., 2005. "On the predictive content of production surveys: A pan-European study," International Journal of Forecasting, Elsevier, vol. 21(2), pages 363-375.
    19. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    20. Grimme, Christian & Lehmann, Robert & Noeller, Marvin, 2021. "Forecasting imports with information from abroad," Economic Modelling, Elsevier, vol. 98(C), pages 109-117.
    21. Baghestani, Hamid, 1994. "Evaluating multiperiod survey forecasts of real net exports," Economics Letters, Elsevier, vol. 44(3), pages 267-272.
    22. Hanslin Grossmann, Sandra & Scheufele, Rolf, 2015. "Foreign PMIs: A reliable indicator for Swiss exports," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112830, Verein für Socialpolitik / German Economic Association.
    23. Sarah Gelper & Christophe Croux, 2010. "On the Construction of the European Economic Sentiment Indicator," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(1), pages 47-62, February.
    24. Weber, Enzo & Zika, Gerd, 2013. "Labour market forecasting : is disaggregation useful?," IAB-Discussion Paper 201314, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    25. Claveria, Oscar & Pons, Ernest & Ramos, Raul, 2007. "Business and consumer expectations and macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 47-69.
    26. Chi-Chen Wang & Yun-Sheng Hsu & Cheng-Hwai Liou, 2011. "A comparison of ARIMA forecasting and heuristic modelling," Applied Financial Economics, Taylor & Francis Journals, vol. 21(15), pages 1095-1102.
    27. Lemmens, A. & Croux, C. & Dekimpe, M.G., 2005. "On the Predictive Content of Production Surveys : a Pan-European Study," Other publications TiSEM adab9f0e-7dfd-4dc4-bd92-b, Tilburg University, School of Economics and Management.
    28. Nikolay Robinzonov & Klaus Wohlrabe, 2010. "Freedom of Choice in Macroeconomic Forecasting ," CESifo Economic Studies, CESifo Group, vol. 56(2), pages 192-220, June.
    29. Cláudia Duarte & Fátima Cardoso, 2006. "The Use of Qualitative Information for Forecasting Exports," Economic Bulletin and Financial Stability Report Articles and Banco de Portugal Economic Studies, Banco de Portugal, Economics and Research Department.
    30. Enzo Weber & Gerd Zika, 2016. "Labour market forecasting in Germany: is disaggregation useful?," Applied Economics, Taylor & Francis Journals, vol. 48(23), pages 2183-2198, May.
    31. Dr. Sandra Hanslin Grossmann & Dr. Rolf Scheufele, 2016. "Foreign PMIs: A reliable indicator for exports?," Working Papers 2016-01, Swiss National Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Robert Lehmann & Antje Weyh, 2016. "Forecasting Employment in Europe: Are Survey Results Helpful?," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 81-117, September.
    2. Robert Lehmann, 2016. "Economic Growth and Business Cycle Forecasting at the Regional Level," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 65.
    3. Waldemar Marz & Johannes Pfeiffer, 2015. "Resource Market Power and Levels of Knowledge in General Equilibrium," ifo Working Paper Series 197, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    4. Garnitz, Johanna & Lehmann, Robert & Wohlrabe, Klaus, 2019. "Forecasting GDP all over the world using leading indicators based on comprehensive survey data," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 51(54), pages 5802-5816.
    5. Behrens, Christoph, 2020. "German trade forecasts since 1970: An evaluation using the panel dimension," Working Papers 26, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    6. Dr. Sandra Hanslin Grossmann & Dr. Rolf Scheufele, 2016. "Foreign PMIs: A reliable indicator for exports?," Working Papers 2016-01, Swiss National Bank.
    7. Grimme, Christian & Lehmann, Robert & Noeller, Marvin, 2021. "Forecasting imports with information from abroad," Economic Modelling, Elsevier, vol. 98(C), pages 109-117.
    8. Sohrabpour, Vahid & Oghazi, Pejvak & Toorajipour, Reza & Nazarpour, Ali, 2021. "Export sales forecasting using artificial intelligence," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    9. Christian Glocker & Serguei Kaniovski, 2022. "Macroeconometric forecasting using a cluster of dynamic factor models," Empirical Economics, Springer, vol. 63(1), pages 43-91, July.
    10. Stefan Sauer & Klaus Wohlrabe, 2020. "ifo Handbuch der Konjunkturumfragen," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 88.
    11. Behrens, Christoph, 2019. "Evaluating the Joint Efficiency of German Trade Forecasts. A nonparametric multivariate approach," Working Papers 9, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    12. Emilian DOBRESCU, 2020. "Self-fulfillment degree of economic expectations within an integrated space: The European Union case study," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(4), pages 5-32, December.
    13. Christoph Behrens, 2019. "A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss," Economies, MDPI, vol. 7(3), pages 1-23, September.
    14. Christian Grimme & Robert Lehmann, 2020. "The ifo Export Climate – A Leading Indicator to Forecast German Export Growth," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 20(04), pages 36-42, January.
    15. Hanslin Grossmann, Sandra & Scheufele, Rolf, 2015. "Foreign PMIs: A reliable indicator for Swiss exports," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112830, Verein für Socialpolitik / German Economic Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert Lehmann, 2016. "Economic Growth and Business Cycle Forecasting at the Regional Level," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 65.
    2. Robert Lehmann & Antje Weyh, 2016. "Forecasting Employment in Europe: Are Survey Results Helpful?," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 81-117, September.
    3. Christoph Behrens, 2019. "A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss," Economies, MDPI, vol. 7(3), pages 1-23, September.
    4. Dr. Sandra Hanslin Grossmann & Dr. Rolf Scheufele, 2016. "Foreign PMIs: A reliable indicator for exports?," Working Papers 2016-01, Swiss National Bank.
    5. Behrens, Christoph, 2019. "Evaluating the Joint Efficiency of German Trade Forecasts. A nonparametric multivariate approach," Working Papers 9, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    6. Grimme, Christian & Lehmann, Robert & Noeller, Marvin, 2021. "Forecasting imports with information from abroad," Economic Modelling, Elsevier, vol. 98(C), pages 109-117.
    7. Sohrabpour, Vahid & Oghazi, Pejvak & Toorajipour, Reza & Nazarpour, Ali, 2021. "Export sales forecasting using artificial intelligence," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    8. Robert Lehmann & Klaus Wohlrabe, 2014. "Forecasting gross value-added at the regional level: are sectoral disaggregated predictions superior to direct ones?," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 34(1), pages 61-90, February.
    9. Oscar Claveria & Enric Monte & Salvador Torra, 2018. "A Data-Driven Approach to Construct Survey-Based Indicators by Means of Evolutionary Algorithms," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(1), pages 1-14, January.
    10. Hanslin Grossmann, Sandra & Scheufele, Rolf, 2015. "Foreign PMIs: A reliable indicator for Swiss exports," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112830, Verein für Socialpolitik / German Economic Association.
    11. Garnitz, Johanna & Lehmann, Robert & Wohlrabe, Klaus, 2019. "Forecasting GDP all over the world using leading indicators based on comprehensive survey data," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 51(54), pages 5802-5816.
    12. Behrens, Christoph, 2020. "German trade forecasts since 1970: An evaluation using the panel dimension," Working Papers 26, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    13. Kaufmann, Daniel & Scheufele, Rolf, 2017. "Business tendency surveys and macroeconomic fluctuations," International Journal of Forecasting, Elsevier, vol. 33(4), pages 878-893.
    14. Robert Lehmann, 2023. "The Forecasting Power of the ifo Business Survey," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 19(1), pages 43-94, March.
    15. Coble, David & Pincheira, Pablo, 2017. "Nowcasting Building Permits with Google Trends," MPRA Paper 76514, University Library of Munich, Germany.
    16. Stefan Sauer & Klaus Wohlrabe, 2020. "ifo Handbuch der Konjunkturumfragen," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 88.
    17. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    18. Marta Necadova, 2019. "Changes in Economic Sentiment Indicators before and after Economic Crisis (Position of Visegrad Group and Germany in EU)," Central European Business Review, Prague University of Economics and Business, vol. 2019(4), pages 55-85.
    19. Galvão, Ana Beatriz, 2013. "Changes in predictive ability with mixed frequency data," International Journal of Forecasting, Elsevier, vol. 29(3), pages 395-410.
    20. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.

    More about this item

    JEL classification:

    • F01 - International Economics - - General - - - Global Outlook
    • F10 - International Economics - - Trade - - - General
    • F17 - International Economics - - Trade - - - Trade Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ifowps:_196. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/ifooode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.