IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/9056.html
   My bibliography  Save this paper

Testing DSGE models by Indirect inference and other methods: some Monte Carlo experiments

Author

Listed:
  • Minford, Patrick
  • Wickens, Michael R.
  • Meenagh, David
  • Le, Vo Phuong Mai

Abstract

Using Monte Carlo experiments, we examine the performance of Indirect Inference tests of DSGE models, usually versions of the Smets-Wouters New Keynesian model of the US postwar period. We compare these with tests based on direct inference (using the Likelihood Ratio), and on the Del Negro-Schorfheide DSGE-VAR weight. We find that the power of all three tests is substantial so that a false model will tend to be rejected by all three; but that the power of the indirect inference tests are by far the greatest, necessitating re-estimation by indirect inference to ensure that the model is tested in its fullest sense.

Suggested Citation

  • Minford, Patrick & Wickens, Michael R. & Meenagh, David & Le, Vo Phuong Mai, 2012. "Testing DSGE models by Indirect inference and other methods: some Monte Carlo experiments," CEPR Discussion Papers 9056, C.E.P.R. Discussion Papers.
    • Handle: RePEc:cpr:ceprdp:9056
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP9056
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Canova, Fabio, 1994. "Statistical Inference in Calibrated Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 9(S), pages 123-144, Suppl. De.
    2. Watson, Mark W, 1993. "Measures of Fit for Calibrated Models," Journal of Political Economy, University of Chicago Press, vol. 101(6), pages 1011-1041, December.
    3. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2017. "A Monte Carlo procedure for checking identification in DSGE models," Journal of Economic Dynamics and Control, Elsevier, vol. 76(C), pages 202-210.
    4. Canova, Fabio & Sala, Luca, 2009. "Back to square one: Identification issues in DSGE models," Journal of Monetary Economics, Elsevier, vol. 56(4), pages 431-449, May.
    5. Le, Vo Phuong Mai & Minford, Patrick & Wickens, Michael, 2010. "The 'Puzzles' methodology: En route to Indirect Inference?," Economic Modelling, Elsevier, vol. 27(6), pages 1417-1428, November.
    6. V. V Chari & Patrick J. Kehoe & Ellen R. McGrattan, 2002. "Can Sticky Price Models Generate Volatile and Persistent Real Exchange Rates?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 69(3), pages 533-563.
    7. Bruce E. Hansen, 1999. "The Grid Bootstrap And The Autoregressive Model," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 594-607, November.
    8. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2011. "How much nominal rigidity is there in the US economy? Testing a new Keynesian DSGE model using indirect inference," Journal of Economic Dynamics and Control, Elsevier, vol. 35(12), pages 2078-2104.
    9. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    10. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    11. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    12. Allan W. Gregory & Gregor W. Smith, 1991. "Calibration in Macroeconomics," Working Paper 826, Economics Department, Queen's University.
    13. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    14. Gregory, Allan W & Smith, Gregor W, 1991. "Calibration as Testing: Inference in Simulated Macroeconomic Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(3), pages 297-303, July.
    15. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    16. David N. DeJong & Chetan Dave, 2007. "Introduction to Structural Macroeconometrics," Introductory Chapters, in: Structural Macroeconometrics, Princeton University Press.
    17. Horowitz, Joel L., 2001. "The bootstrap and hypothesis tests in econometrics," Journal of Econometrics, Elsevier, vol. 100(1), pages 37-40, January.
    18. Davidson, James & Meenagh, David & Minford, Patrick & Wickens, Michael, 2010. "Why crises happen - nonstationary macroeconomics," Cardiff Economics Working Papers E2010/13, Cardiff University, Cardiff Business School, Economics Section.
    19. Canova, Fabio, 1995. "Sensitivity Analysis and Model Evaluation in Simulated Dynamic General Equilibrium Economies," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 36(2), pages 477-501, May.
    20. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Minford, Patrick & Meenagh, David & Le, Vo Phuong Mai, 2012. "What causes banking crises? An empirical investigation," CEPR Discussion Papers 9057, C.E.P.R. Discussion Papers.
    2. Vo Le & David Meenagh & Patrick Minford & Zhirong Ou, 2013. "What Causes Banking Crises? An Empirical Investigation for the World Economy," Open Economies Review, Springer, vol. 24(4), pages 581-611, September.
    3. Li Dai & Patrick Minford & Peng Zhou, 2015. "A DSGE model of China," Applied Economics, Taylor & Francis Journals, vol. 47(59), pages 6438-6460, December.
    4. Liu, Chunping & Minford, Patrick, 2014. "How important is the credit channel? An empirical study of the US banking crisis," Journal of Banking & Finance, Elsevier, vol. 41(C), pages 119-134.
    5. Fan, Jingwen & Minford, Patrick & Ou, Zhirong, 2016. "The role of fiscal policy in Britain's Great Inflation," Economic Modelling, Elsevier, vol. 58(C), pages 203-218.
    6. Patrick Minford & Zhirong Ou & Michael Wickens, 2015. "Revisiting the Great Moderation: Policy or Luck?," Open Economies Review, Springer, vol. 26(2), pages 197-223, April.
    7. Vo Le & Kent Matthews & David Meenagh & Patrick Minford & Zhiguo Xiao, 2014. "Banking and the Macroeconomy in China: A Banking Crisis Deferred?," Open Economies Review, Springer, vol. 25(1), pages 123-161, February.
    8. Liu, Chunping & Minford, Patrick, 2014. "Comparing behavioural and rational expectations for the US post-war economy," Economic Modelling, Elsevier, vol. 43(C), pages 407-415.
    9. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick, 2016. "Monetarism rides again? US monetary policy in a world of Quantitative Easing," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 44(C), pages 85-102.
    10. Minford, Patrick & Ou, Zhirong & Fan, Jingwen, 2013. "The Fiscal Theory of the Price Level - identification and testing for the UK in the 1970s," CEPR Discussion Papers 9763, C.E.P.R. Discussion Papers.
    11. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2017. "A Monte Carlo procedure for checking identification in DSGE models," Journal of Economic Dynamics and Control, Elsevier, vol. 76(C), pages 202-210.
    12. Le, Vo Phuong Mai & Matthews, Kent & Meenagh, David & Minford, Patrick & Xiao, Zhiguo, 2015. "China s financial crisis the role of banks and monetary policy," Cardiff Economics Working Papers E2015/1, Cardiff University, Cardiff Business School, Economics Section.
    13. Patrick Minford & Yongdeng Xu & Peng Zhou, 2015. "How Good are Out of Sample Forecasting Tests on DSGE Models?," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 1(3), pages 333-351, November.
    14. Wickens, Michael R., 2014. "How did we get to where we are now? Reflections on 50 years of macroeconomic and financial econometrics," CEPR Discussion Papers 10197, C.E.P.R. Discussion Papers.
    15. Michael Wickens, 2015. "How Did We Get to Where We Are Now? Reflections on 50 Years of Macroeconomic and Financial Econometrics," Manchester School, University of Manchester, vol. 83, pages 60-82, December.
    16. Nasir Aminu, 2018. "Evaluation of a DSGE Model of Energy in the United Kingdom Using Stationary Data," Computational Economics, Springer;Society for Computational Economics, vol. 51(4), pages 1033-1068, April.
    17. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wang, Ziqing, 2023. "UK monetary and fiscal policy since the Great Recession- an evaluation," Cardiff Economics Working Papers E2023/9, Cardiff University, Cardiff Business School, Economics Section.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vo Le & David Meenagh & Patrick Minford & Michael Wickens & Yongdeng Xu, 2016. "Testing Macro Models by Indirect Inference: A Survey for Users," Open Economies Review, Springer, vol. 27(1), pages 1-38, February.
    2. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2015. "Small sample performance of indirect inference on DSGE models," Cardiff Economics Working Papers E2015/2, Cardiff University, Cardiff Business School, Economics Section.
    3. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2011. "How much nominal rigidity is there in the US economy? Testing a new Keynesian DSGE model using indirect inference," Journal of Economic Dynamics and Control, Elsevier, vol. 35(12), pages 2078-2104.
    4. Minford, Patrick & Meenagh, David & Le, Vo Phuong Mai, 2012. "What causes banking crises? An empirical investigation," CEPR Discussion Papers 9057, C.E.P.R. Discussion Papers.
    5. Le, Vo Phuong Mai & Minford, Patrick & Wickens, Michael, 2010. "The 'Puzzles' methodology: En route to Indirect Inference?," Economic Modelling, Elsevier, vol. 27(6), pages 1417-1428, November.
    6. Paccagnini, Alessia, 2010. "DSGE Model Validation in a Bayesian Framework: an Assessment," MPRA Paper 24509, University Library of Munich, Germany.
    7. Alessia Paccagnini, 2012. "Comparing Hybrid DSGE Models," Working Papers 228, University of Milano-Bicocca, Department of Economics, revised Dec 2012.
    8. Li Dai & Patrick Minford & Peng Zhou, 2015. "A DSGE model of China," Applied Economics, Taylor & Francis Journals, vol. 47(59), pages 6438-6460, December.
    9. Pablo A. Guerrón-Quintana & James M. Nason, 2013. "Bayesian estimation of DSGE models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 21, pages 486-512, Edward Elgar Publishing.
    10. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    11. David Meenagh & Patrick Minford & Michael Wickens & Yongdeng Xu, 2019. "Testing DSGE Models by Indirect Inference: a Survey of Recent Findings," Open Economies Review, Springer, vol. 30(3), pages 593-620, July.
    12. Carlo A. Favero, 2009. "The Econometrics of Monetary Policy: An Overview," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 16, pages 821-850, Palgrave Macmillan.
    13. Vo Le & David Meenagh & Patrick Minford & Zhirong Ou, 2013. "What Causes Banking Crises? An Empirical Investigation for the World Economy," Open Economies Review, Springer, vol. 24(4), pages 581-611, September.
    14. Minford, Patrick & Ou, Zhirong, 2013. "Taylor Rule or optimal timeless policy? Reconsidering the Fed's behavior since 1982," Economic Modelling, Elsevier, vol. 32(C), pages 113-123.
    15. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.
    16. Komunjer, Ivana & Zhu, Yinchu, 2020. "Likelihood ratio testing in linear state space models: An application to dynamic stochastic general equilibrium models," Journal of Econometrics, Elsevier, vol. 218(2), pages 561-586.
    17. Minford, Patrick & Wickens, Michael R. & Meenagh, David, 2012. "Testing macroeconomic models by indirect inference on unfiltered data," CEPR Discussion Papers 9058, C.E.P.R. Discussion Papers.
    18. Loria, Francesca & Matthes, Christian & Wang, Mu-Chun, 2022. "Economic theories and macroeconomic reality," Journal of Monetary Economics, Elsevier, vol. 126(C), pages 105-117.
    19. Wickens, Michael R., 2014. "How did we get to where we are now? Reflections on 50 years of macroeconomic and financial econometrics," CEPR Discussion Papers 10197, C.E.P.R. Discussion Papers.
    20. Olayinka Oyekola & David Meenagh & Patrick Minford, 2023. "Global Shocks in the US Economy: Effects on Output and the Real Exchange Rate," Open Economies Review, Springer, vol. 34(2), pages 411-435, April.

    More about this item

    Keywords

    Bootstrap; Dsge; Dsge-var weight; indirect inference; Likelihood ratio; New classical; New keynesian; Wald statistic;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • E1 - Macroeconomics and Monetary Economics - - General Aggregative Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:9056. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.