IDEAS home Printed from https://ideas.repec.org/p/eti/dpaper/19084.html
   My bibliography  Save this paper

Uncertainty in Long-Term Macroeconomic Forecasts: Ex post Evaluation of Forecasts by Economics Researchers

Author

Listed:
  • MORIKAWA Masayuki

Abstract

This study presents an ex post evaluation of the accuracy of long-term macroeconomic forecasts made by economics researchers. The results indicate, first, that the economic growth and inflation forecasts for the next ten years are biased upward. Second, there are positive correlations between real gross domestic product (GDP) and total factor productivity (TFP) growth forecasts, and between nominal GDP growth and consumer price index (CPI) inflation forecasts, resulting in the same correlations between forecasting errors for these macroeconomic variables. Third, GDP growth forecasts by academic researchers in economics are less upwardly biased than those by professional forecasters in private institutes. However, the upward bias of academic researchers specializing in macroeconomics and economic growth is larger than those in the other research fields. These results indicate that long-term economic forecasting involves significant uncertainty, even for economists.

Suggested Citation

  • MORIKAWA Masayuki, 2019. "Uncertainty in Long-Term Macroeconomic Forecasts: Ex post Evaluation of Forecasts by Economics Researchers," Discussion papers 19084, Research Institute of Economy, Trade and Industry (RIETI).
  • Handle: RePEc:eti:dpaper:19084
    as

    Download full text from publisher

    File URL: https://www.rieti.go.jp/jp/publications/dp/19e084.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Merola, Rossana & Pérez, Javier J., 2013. "Fiscal forecast errors: Governments versus independent agencies?," European Journal of Political Economy, Elsevier, vol. 32(C), pages 285-299.
    2. N. Bloom, 2016. "Fluctuations in uncertainty," Voprosy Ekonomiki, NP Voprosy Ekonomiki, issue 4.
    3. Jeffrey Frankel & Jesse Schreger, 2013. "Over-optimistic official forecasts and fiscal rules in the eurozone," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 149(2), pages 247-272, June.
    4. Tanaka, Mari & Bloom, Nicholas & David, Joel M. & Koga, Maiko, 2020. "Firm performance and macro forecast accuracy," Journal of Monetary Economics, Elsevier, vol. 114(C), pages 26-41.
    5. Soojin Jo & Rodrigo Sekkel, 2019. "Macroeconomic Uncertainty Through the Lens of Professional Forecasters," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 436-446, July.
    6. Lars Jonung & Martin Larch, 2006. "Improving fiscal policy in the EU: the case for independent forecasts [‘Fiscal forecasting: The track record of the IMF, OECD and EC’]," Economic Policy, CEPR;CES;MSH, vol. 21(47), pages 492-534.
    7. Jonas Dovern & Ulrich Fritsche & Jiri Slacalek, 2012. "Disagreement Among Forecasters in G7 Countries," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1081-1096, November.
    8. Barbara Rossi & Tatevik Sekhposyan, 2015. "Macroeconomic Uncertainty Indices Based on Nowcast and Forecast Error Distributions," American Economic Review, American Economic Association, vol. 105(5), pages 650-655, May.
    9. Bomberger, William A, 1996. "Disagreement as a Measure of Uncertainty," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 28(3), pages 381-392, August.
    10. Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
    11. Morikawa, Masayuki, 2016. "Business uncertainty and investment: Evidence from Japanese companies," Journal of Macroeconomics, Elsevier, vol. 49(C), pages 224-236.
    12. Scott R. Baker & Tucker S. McElroy & Xuguang S. Sheng, 2020. "Expectation Formation Following Large, Unexpected Shocks," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 287-303, May.
    13. Jeffrey Frankel, 2011. "Over-optimism in forecasts by official budget agencies and its implications," Oxford Review of Economic Policy, Oxford University Press, vol. 27(4), pages 536-562.
    14. Yavuz Arslan & Aslıhan Atabek & Timur Hulagu & Saygın Şahinöz, 2015. "Expectation errors, uncertainty, and economic activity," Oxford Economic Papers, Oxford University Press, vol. 67(3), pages 634-660.
    15. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    16. R?diger Bachmann & Steffen Elstner & Eric R. Sims, 2013. "Uncertainty and Economic Activity: Evidence from Business Survey Data," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(2), pages 217-249, April.
    17. Giang Ho & Paolo Mauro, 2016. "Growth—Now and Forever?," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 64(3), pages 526-547, August.
    18. Sylwia Nowak & Pratiti Chatterjee, 2016. "Forecast Errors and Uncertainty Shocks," IMF Working Papers 2016/228, International Monetary Fund.
    19. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    20. Morikawa, Masayuki, 2019. "Uncertainty over production forecasts: An empirical analysis using monthly quantitative survey data," Journal of Macroeconomics, Elsevier, vol. 60(C), pages 163-179.
    21. Knüppel, Malte, 2018. "Forecast-error-based estimation of forecast uncertainty when the horizon is increased," International Journal of Forecasting, Elsevier, vol. 34(1), pages 105-116.
    22. Frankel, Jeffrey A. & Schreger, Jesse, 2016. "Bias in Official Fiscal Forecasts: Can Private Forecasts Help?," Working Paper Series 16-021, Harvard University, John F. Kennedy School of Government.
    23. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    24. Ashiya, Masahiro, 2007. "Forecast accuracy of the Japanese government: Its year-ahead GDP forecast is too optimistic," Japan and the World Economy, Elsevier, vol. 19(1), pages 68-85, January.
    25. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    26. Kozeniauskas, Nicholas & Orlik, Anna & Veldkamp, Laura, 2018. "What are uncertainty shocks?," Journal of Monetary Economics, Elsevier, vol. 100(C), pages 1-15.
    27. Nigel Pain & Christine Lewis & Thai-Thanh Dang & Yosuke Jin & Pete Richardson, 2014. "OECD Forecasts During and After the Financial Crisis: A Post Mortem," OECD Economics Department Working Papers 1107, OECD Publishing.
    28. repec:oup:ecpoli:v:21:y:2006:i:47:p:491-534 is not listed on IDEAS
    29. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    30. Christine Lewis & Nigel Pain, 2014. "Lessons from OECD forecasts during and after the financial crisis," OECD Journal: Economic Studies, OECD Publishing, vol. 2014(1), pages 9-39.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kejin Wu & Sayar Karmakar, 2023. "A model-free approach to do long-term volatility forecasting and its variants," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-38, December.
    2. Masahito Ambashi & Fusanori Iwasaki & Keita Oikawa, 2022. "Prediction Errors of Macroeconomic Indicators and Economic Shocks for ASEAN Member States, 1990-2021," KIER Working Papers 1088, Kyoto University, Institute of Economic Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Masahito Ambashi & Fusanori Iwasaki & Keita Oikawa, 2022. "Prediction Errors of Macroeconomic Indicators and Economic Shocks for ASEAN Member States, 1990-2021," KIER Working Papers 1088, Kyoto University, Institute of Economic Research.
    2. Morikawa, Masayuki, 2019. "Uncertainty over production forecasts: An empirical analysis using monthly quantitative survey data," Journal of Macroeconomics, Elsevier, vol. 60(C), pages 163-179.
    3. Danilo Cascaldi-Garcia & Cisil Sarisoy & Juan M. Londono & Bo Sun & Deepa D. Datta & Thiago Ferreira & Olesya Grishchenko & Mohammad R. Jahan-Parvar & Francesca Loria & Sai Ma & Marius Rodriguez & Ilk, 2023. "What Is Certain about Uncertainty?," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 624-654, June.
    4. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    5. Masahito Ambashi & Fusanori Iwasaki & Keita Oikawa, 2021. "Prediction Errors of Macroeconomic Indicators and Economic Shocks for ASEAN Member States," Working Papers DP-2022-02, Economic Research Institute for ASEAN and East Asia (ERIA).
    6. Julia Estefania‐Flores & Davide Furceri & Siddharth Kothari & Jonathan D. Ostry, 2023. "Worse than you think: Public debt forecast errors in advanced and developing economies," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(3), pages 685-714, April.
    7. Himounet, Nicolas, 2022. "Searching the nature of uncertainty: Macroeconomic and financial risks VS geopolitical and pandemic risks," International Economics, Elsevier, vol. 170(C), pages 1-31.
    8. Laurent Ferrara & Pierre Guérin, 2018. "What are the macroeconomic effects of high‐frequency uncertainty shocks?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(5), pages 662-679, August.
    9. Joan Paredes & Javier J. Pérez & Gabriel Perez Quiros, 2023. "Fiscal targets. A guide to forecasters?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 472-492, June.
    10. repec:zbw:bofrdp:037 is not listed on IDEAS
    11. Carabotta, Laura & Paluzie, Elisenda & Ramos, Raul, 2017. "Does fiscal responsibility matter? Evidence from public and private forecasters in Italy," International Journal of Forecasting, Elsevier, vol. 33(3), pages 694-706.
    12. Saygin Sahinoz & Evren Erdogan Cosar, 2020. "Quantifying uncertainty and identifying its impacts on the Turkish economy," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 47(2), pages 365-387, May.
    13. Ambrocio, Gene, 2017. "The real effects of overconfidence and fundamental uncertainty shocks," Research Discussion Papers 37/2017, Bank of Finland.
    14. Oscar Claveria, 2021. "On the Aggregation of Survey-Based Economic Uncertainty Indicators Between Different Agents and Across Variables," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 17(1), pages 1-26, April.
    15. Sheen, Jeffrey & Wang, Ben Zhe, 2021. "Measuring macroeconomic disagreement – A mixed frequency approach," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 547-566.
    16. Claveria, Oscar, 2022. "Global economic uncertainty and suicide: Worldwide evidence," Social Science & Medicine, Elsevier, vol. 305(C).
    17. Fracasso, Andrea & Secchi, Angelo & Tomasi, Chiara, 2022. "Export pricing and exchange rate expectations under uncertainty," Journal of Comparative Economics, Elsevier, vol. 50(1), pages 135-152.
    18. Ozturk, Ezgi O. & Sheng, Xuguang Simon, 2018. "Measuring global and country-specific uncertainty," Journal of International Money and Finance, Elsevier, vol. 88(C), pages 276-295.
    19. Andreas Dibiasi & David Iselin, 2021. "Measuring Knightian uncertainty," Empirical Economics, Springer, vol. 61(4), pages 2113-2141, October.
    20. Oscar Claveria, 2021. "Disagreement on expectations: firms versus consumers," SN Business & Economics, Springer, vol. 1(12), pages 1-23, December.
    21. repec:zbw:bofrdp:2017_037 is not listed on IDEAS
    22. Corinna Ghirelli & María Gil & Javier J. Pérez & Alberto Urtasun, 2021. "Measuring economic and economic policy uncertainty and their macroeconomic effects: the case of Spain," Empirical Economics, Springer, vol. 60(2), pages 869-892, February.

    More about this item

    JEL classification:

    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • O47 - Economic Development, Innovation, Technological Change, and Growth - - Economic Growth and Aggregate Productivity - - - Empirical Studies of Economic Growth; Aggregate Productivity; Cross-Country Output Convergence

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eti:dpaper:19084. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: TANIMOTO, Toko (email available below). General contact details of provider: https://edirc.repec.org/data/rietijp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.