IDEAS home Printed from https://ideas.repec.org/a/aho/journl/v14y2019i1p28-52.html
   My bibliography  Save this article

An evaluation of the forecast performance of DSGE and VAR Models: The case of a developing country

Author

Listed:
  • Shahzad Ahmad

    (State Bank of Pakistan,)

  • Adnan Haider

    (Institute of Business Administration, Karachi)

Abstract

This paper estimates a DSGE model and three versions of VAR models (VARX, BVARX and BVAR) to analyze forecasting performance of these models in context of Pakistan. VAR models and a medium-scale DSGE model are estimated using quarterly data (1980Q4-2017Q2). Expanding window recursive out-of-sample forecasts for GDP growth, call money rate, CPI inflation and percent change in exchange rate are generated and compared over the period 2009Q1-2017Q2. Forecasting performance is analyzed by the comparison of bias and root mean squared errors (RMSE). Analysis of forecasting performance over 1-8 quarters forecast horizon reveals that BVAR model provides relatively better forecast in case of GDP growth, interest rate and inflation while BVARX provides more accurate forecast in case of exchange rate. In case of GDP growth, inflation and exchange rate, forecasting performance of DSGE model considerably improves as forecasting horizon expands. For longer forecast horizons, divergence between DSGE and Bayesian VAR forecasts tends to disappear. This implies that DSGE model is more relevant for medium term forecasting rather than short term forecasting. Structural interpretation of DSGE forecast errors reveals that there has been unutilized growth potential in economic activity. This slack in economic activity might be attributable to unnecessarily high interest rate and overvalued exchange rate.

Suggested Citation

  • Shahzad Ahmad & Adnan Haider, 2019. "An evaluation of the forecast performance of DSGE and VAR Models: The case of a developing country," Business Review, School of Economics and Social Sciences, IBA Karachi, vol. 14(1), pages 28-52, January-J.
  • Handle: RePEc:aho:journl:v:14:y:2019:i:1:p:28-52
    as

    Download full text from publisher

    File URL: https://businessreview.iba.edu.pk/articles/forecast-performance-12719.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Adnan Haider & Musleh ud Din & Ejaz Ghani, 2012. "Monetary Policy, Informality and Business Cycle Fluctuations in a Developing Economy Vulnerable to External Shocks," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 51(4), pages 609-681.
    2. Adnan Haider Bukhari & Safdar Ullah Khan, 2008. "A Small Open Economy DSGE Model for Pakistan," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 47(4), pages 963-1008.
    3. Waqas Ahmed & Farooq Pasha & Sajawal Khan & Muhammad Rehman, 2012. "Pakistan Economy DSGE Model with Informality," SBP Working Paper Series 47, State Bank of Pakistan, Research Department.
    4. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    5. Wieland, Volker & Cwik, Tobias & Müller, Gernot J. & Schmidt, Sebastian & Wolters, Maik, 2012. "A new comparative approach to macroeconomic modeling and policy analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 83(3), pages 523-541.
    6. Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
    7. Mark Gertler & Jordi Gali & Richard Clarida, 1999. "The Science of Monetary Policy: A New Keynesian Perspective," Journal of Economic Literature, American Economic Association, vol. 37(4), pages 1661-1707, December.
    8. Erceg, Christopher J. & Henderson, Dale W. & Levin, Andrew T., 2000. "Optimal monetary policy with staggered wage and price contracts," Journal of Monetary Economics, Elsevier, vol. 46(2), pages 281-313, October.
    9. Muhammad Javid & Kashif Munir, 2010. "The Price Puzzle and Monetary Policy Transmission Mechanism in Pakistan: Structural Vector Autoregressive Approach," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 49(4), pages 449-460.
    10. Ahmed, Shahzad & Pasha, Farooq, 2014. "The Role of Money in Explaining Business Cycles for a Developing Economy: The Case of Pakistan," MPRA Paper 55262, University Library of Munich, Germany, revised 11 Apr 2014.
    11. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    12. Muhammad Nadim Hanif & Muhammad Jahanzeb Malik, 2013. "Quarterisation of National Income Accounts of Pakistan," SBP Research Bulletin, State Bank of Pakistan, Research Department, vol. 9, pages 1-61.
    13. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    14. Muhammad Ali Choudhary & Farooq Pasha, 2013. "The RBC View of Pakistan: A Declaration of Stylized Facts and Essential Models," SBP Working Paper Series 56, State Bank of Pakistan, Research Department.
    15. Choudhary, M. Ali & Faheem, Abdul & Hanif, M. Nadim & Naeem, Saima & Pasha, Farooq, 2016. "Price setting & price stickiness: A developing economy perspective," Journal of Macroeconomics, Elsevier, vol. 48(C), pages 44-61.
    16. Ahmed, Waqas & Choudhary, M. Ali & Khan, Sajawal & Naeem, Saima & Zoega, Gylfi, 2014. "Determinants of wage stickiness in a developing economy," Economic Modelling, Elsevier, vol. 38(C), pages 296-304.
    17. Bloor, Chris & Matheson, Troy, 2011. "Real-time conditional forecasts with Bayesian VARs: An application to New Zealand," The North American Journal of Economics and Finance, Elsevier, vol. 22(1), pages 26-42, January.
    18. Tovar, Camilo Ernesto, 2009. "DSGE Models and Central Banks," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-31.
    19. Shahzad Ahmad & Farooq Pasha, 2015. "A Pragmatic Model for Monetary Policy Analysis I: The Case of Pakistan," SBP Research Bulletin, State Bank of Pakistan, Research Department, vol. 11, pages 1-42.
    20. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    21. Litterman, Robert, 1986. "Forecasting with Bayesian vector autoregressions -- Five years of experience : Robert B. Litterman, Journal of Business and Economic Statistics 4 (1986) 25-38," International Journal of Forecasting, Elsevier, vol. 2(4), pages 497-498.
    22. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sonan Memon, 2022. "Inflation in Pakistan: High-Frequency Estimation and Forecasting," PIDE-Working Papers 2022:12, Pakistan Institute of Development Economics.
    2. Bahram Adrangi & Juan Nicolás D’Amico, 2023. "Equity Returns and the Output Shocks in a Dynamic Stochastic General Equilibrium Framework," JRFM, MDPI, vol. 16(5), pages 1-14, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ahmed, Shahzad & Pasha, Farooq, 2014. "The Role of Money in Explaining Business Cycles for a Developing Economy: The Case of Pakistan," MPRA Paper 55262, University Library of Munich, Germany, revised 11 Apr 2014.
    2. Shahid, Muhammad & Qayyum, Abdul & Shahid, Waseem, 2016. "Fiscal and Monetary Policy Interactions in Pakistan Using a Dynamic Stochastic General Equilibrium Framework," MPRA Paper 72595, University Library of Munich, Germany.
    3. Henzel, Steffen R. & Mayr, Johannes, 2013. "The mechanics of VAR forecast pooling—A DSGE model based Monte Carlo study," The North American Journal of Economics and Finance, Elsevier, vol. 24(C), pages 1-24.
    4. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    5. Adnan Haider & Musleh ud Din & Ejaz Ghani, 2012. "Monetary Policy, Informality and Business Cycle Fluctuations in a Developing Economy Vulnerable to External Shocks," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 51(4), pages 609-681.
    6. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    7. Federico Di Pace & Matthias Hertweck, 2019. "Labor Market Frictions, Monetary Policy, and Durable Goods," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 32, pages 274-304, April.
    8. Chauvet, Marcelle & Potter, Simon, 2013. "Forecasting Output," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 141-194, Elsevier.
    9. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    10. Schmidt, Sebastian & Wieland, Volker, 2013. "The New Keynesian Approach to Dynamic General Equilibrium Modeling: Models, Methods and Macroeconomic Policy Evaluation," Handbook of Computable General Equilibrium Modeling, in: Peter B. Dixon & Dale Jorgenson (ed.), Handbook of Computable General Equilibrium Modeling, edition 1, volume 1, chapter 0, pages 1439-1512, Elsevier.
    11. Anders Warne & Günter Coenen & Kai Christoffel, 2017. "Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE, DSGE‐VAR, and VAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 103-119, January.
    12. Aadil Nakhoda, 2014. "The Influence of Industry Financial Composition on the Exports from Pakistan," SBP Research Bulletin, State Bank of Pakistan, Research Department, vol. 10, pages 21-49.
    13. Carlos C. Bautista, 2009. "An examination of Philippine monetary policy rules," UP School of Economics Discussion Papers 200912, University of the Philippines School of Economics.
    14. Wieland, Volker & Wolters, Maik, 2013. "Forecasting and Policy Making," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 239-325, Elsevier.
    15. Adolfson, Malin & Laséen, Stefan & Lindé, Jesper & Ratto, Marco, 2019. "Identification versus misspecification in New Keynesian monetary policy models," European Economic Review, Elsevier, vol. 113(C), pages 225-246.
    16. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    17. Gonzalo Fernández-de-Córdoba & José Torres, 2011. "Forecasting the Spanish economy with an augmented VAR–DSGE model," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 2(3), pages 379-399, September.
    18. Marcin Kolasa & Michał Rubaszek & Paweł Skrzypczyński, 2012. "Putting the New Keynesian DSGE Model to the Real‐Time Forecasting Test," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(7), pages 1301-1324, October.
    19. Malin Adolfson & Michael K. Andersson & Jesper Lindé & Mattias Villani & Anders Vredin, 2007. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 111-144, December.
    20. Lindé, J. & Smets, F. & Wouters, R., 2016. "Challenges for Central Banks’ Macro Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 2185-2262, Elsevier.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aho:journl:v:14:y:2019:i:1:p:28-52. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: sshabbar (email available below). General contact details of provider: https://edirc.repec.org/data/ibakapk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.