IDEAS home Printed from https://ideas.repec.org/a/kap/openec/v27y2016i1p1-38.html
   My bibliography  Save this article

Testing Macro Models by Indirect Inference: A Survey for Users

Author

Listed:
  • Vo Le
  • David Meenagh
  • Patrick Minford
  • Michael Wickens
  • Yongdeng Xu

Abstract

With Monte Carlo experiments on models in widespread use we examine the performance of indirect inference (II) tests of DSGE models in small samples. We compare these tests with ones based on direct inference (using the Likelihood Ratio, LR). We find that both tests have power so that a substantially false model will tend to be rejected by both; but that the power of the II test is substantially greater, both because the LR is applied after re-estimation of the model error processes and because the II test uses the false model’s own restricted distribution for the auxiliary model’s coefficients. This greater power allows users to focus this test more narrowly on features of interest, trading off power against tractability. Copyright Springer Science+Business Media New York 2016

Suggested Citation

  • Vo Le & David Meenagh & Patrick Minford & Michael Wickens & Yongdeng Xu, 2016. "Testing Macro Models by Indirect Inference: A Survey for Users," Open Economies Review, Springer, vol. 27(1), pages 1-38, February.
    • Handle: RePEc:kap:openec:v:27:y:2016:i:1:p:1-38
    DOI: 10.1007/s11079-015-9377-5
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11079-015-9377-5
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11079-015-9377-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Vo Le & David Meenagh & Patrick Minford & Michael Wickens, 2010. "Two Orthogonal Continents? Testing a Two-country DSGE Model of the US and the EU Using Indirect Inference," Open Economies Review, Springer, vol. 21(1), pages 23-44, February.
    2. Canova, Fabio, 1994. "Statistical Inference in Calibrated Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 9(S), pages 123-144, Suppl. De.
    3. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    4. David Meenagh & Patrick Minford & Michael Wickens, 2009. "Testing a DSGE Model of the EU Using Indirect Inference," Open Economies Review, Springer, vol. 20(4), pages 435-471, September.
    5. Watson, Mark W, 1993. "Measures of Fit for Calibrated Models," Journal of Political Economy, University of Chicago Press, vol. 101(6), pages 1011-1041, December.
    6. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Thomas J. Sargent & Mark W. Watson, 2007. "ABCs (and Ds) of Understanding VARs," American Economic Review, American Economic Association, vol. 97(3), pages 1021-1026, June.
    7. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2017. "A Monte Carlo procedure for checking identification in DSGE models," Journal of Economic Dynamics and Control, Elsevier, vol. 76(C), pages 202-210.
    8. Canova, Fabio & Sala, Luca, 2009. "Back to square one: Identification issues in DSGE models," Journal of Monetary Economics, Elsevier, vol. 56(4), pages 431-449, May.
    9. Gregory, Allan W & Smith, Gregor W, 1991. "Calibration as Testing: Inference in Simulated Macroeconomic Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(3), pages 297-303, July.
    10. Bruce E. Hansen, 1999. "The Grid Bootstrap And The Autoregressive Model," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 594-607, November.
    11. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    12. Li Dai & Patrick Minford & Peng Zhou, 2015. "A DSGE model of China," Applied Economics, Taylor & Francis Journals, vol. 47(59), pages 6438-6460, December.
    13. McCallum, Bennett T, 1976. "Rational Expectations and the Natural Rate Hypothesis: Some Consistent Estimates," Econometrica, Econometric Society, vol. 44(1), pages 43-52, January.
    14. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    15. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick, 2012. "What causes banking crises? An empirical investigation," Cardiff Economics Working Papers E2012/14, Cardiff University, Cardiff Business School, Economics Section, revised Apr 2013.
    16. George W. Evans & Seppo Honkapohja, 2005. "An Interview with Thomas J. Sargent," CESifo Working Paper Series 1434, CESifo.
    17. Mark Gertler & Jordi Gali & Richard Clarida, 1999. "The Science of Monetary Policy: A New Keynesian Perspective," Journal of Economic Literature, American Economic Association, vol. 37(4), pages 1661-1707, December.
    18. Wieland, Volker & Wolters, Maik, 2013. "Forecasting and Policy Making," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 239-325, Elsevier.
    19. Lars Peter Hansen & James J. Heckman, 1996. "The Empirical Foundations of Calibration," Journal of Economic Perspectives, American Economic Association, vol. 10(1), pages 87-104, Winter.
    20. Evans, George W. & Honkapohja, Seppo, 2005. "An Interview With Thomas J. Sargent," Macroeconomic Dynamics, Cambridge University Press, vol. 9(04), pages 561-583, September.
    21. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    22. Michael Wickens, 2014. "How Useful are DSGE Macroeconomic Models for Forecasting?," Open Economies Review, Springer, vol. 25(1), pages 171-193, February.
    23. David N. DeJong & Chetan Dave, 2007. "Introduction to Structural Macroeconometrics," Introductory Chapters, in: Structural Macroeconometrics, Princeton University Press.
    24. Mark Gertler & Jordi Gali & Richard Clarida, 1999. "The Science of Monetary Policy: A New Keynesian Perspective," Journal of Economic Literature, American Economic Association, vol. 37(4), pages 1661-1707, December.
    25. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2011. "How much nominal rigidity is there in the US economy? Testing a new Keynesian DSGE model using indirect inference," Journal of Economic Dynamics and Control, Elsevier, vol. 35(12), pages 2078-2104.
    26. Horowitz, Joel L., 2001. "The bootstrap and hypothesis tests in econometrics," Journal of Econometrics, Elsevier, vol. 100(1), pages 37-40, January.
    27. Minford, Patrick & Ou, Zhirong, 2013. "Taylor Rule or optimal timeless policy? Reconsidering the Fed's behavior since 1982," Economic Modelling, Elsevier, vol. 32(C), pages 113-123.
    28. Meenagh, David & Minford, Patrick & Nowell, Eric & Sofat, Prakriti, 2010. "Can a real business cycle model without price and wage stickiness explain UK real exchange rate behaviour?," Journal of International Money and Finance, Elsevier, vol. 29(6), pages 1131-1150, October.
    29. Liu, Chunping & Minford, Patrick, 2014. "Comparing behavioural and rational expectations for the US post-war economy," Economic Modelling, Elsevier, vol. 43(C), pages 407-415.
    30. Patrick Minford & Konstantinos Theodoridis & David Meenagh, 2009. "Testing a Model of the UK by the Method of Indirect Inference," Open Economies Review, Springer, vol. 20(2), pages 265-291, April.
    31. Vo Le & Kent Matthews & David Meenagh & Patrick Minford & Zhiguo Xiao, 2014. "Banking and the Macroeconomy in China: A Banking Crisis Deferred?," Open Economies Review, Springer, vol. 25(1), pages 123-161, February.
    32. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    33. Canova, Fabio, 1995. "Sensitivity Analysis and Model Evaluation in Simulated Dynamic General Equilibrium Economies," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 36(2), pages 477-501, May.
    34. Patrick Minford & Zhirong Ou & Michael Wickens, 2015. "Revisiting the Great Moderation: Policy or Luck?," Open Economies Review, Springer, vol. 26(2), pages 197-223, April.
    35. Meenagh, David & Minford, Patrick & Wickens, Michael, 2012. "Testing macroeconomic models by indirect inference on unfiltered data," Cardiff Economics Working Papers E2012/17, Cardiff University, Cardiff Business School, Economics Section.
    36. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    37. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    38. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    39. Meenagh, David & Minford, Patrick & Wickens, Michael & Xu, Yongdeng, 2015. "Comparing Indirect Inference and Likelihood testing: asymptotic and small sample results," Cardiff Economics Working Papers E2015/8, Cardiff University, Cardiff Business School, Economics Section.
    40. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    41. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2015. "Small sample performance of indirect inference on DSGE models," Cardiff Economics Working Papers E2015/2, Cardiff University, Cardiff Business School, Economics Section.
    2. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2011. "How much nominal rigidity is there in the US economy? Testing a new Keynesian DSGE model using indirect inference," Journal of Economic Dynamics and Control, Elsevier, vol. 35(12), pages 2078-2104.
    3. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2012. "Testing DSGE models by Indirect inference and other methods: some Monte Carlo experiments," Cardiff Economics Working Papers E2012/15, Cardiff University, Cardiff Business School, Economics Section.
    4. David Meenagh & Patrick Minford & Michael Wickens & Yongdeng Xu, 2019. "Testing DSGE Models by Indirect Inference: a Survey of Recent Findings," Open Economies Review, Springer, vol. 30(3), pages 593-620, July.
    5. Minford, Patrick & Ou, Zhirong, 2013. "Taylor Rule or optimal timeless policy? Reconsidering the Fed's behavior since 1982," Economic Modelling, Elsevier, vol. 32(C), pages 113-123.
    6. Le, Vo Phuong Mai & Minford, Patrick & Wickens, Michael, 2010. "The 'Puzzles' methodology: En route to Indirect Inference?," Economic Modelling, Elsevier, vol. 27(6), pages 1417-1428, November.
    7. Li Dai & Patrick Minford & Peng Zhou, 2015. "A DSGE model of China," Applied Economics, Taylor & Francis Journals, vol. 47(59), pages 6438-6460, December.
    8. Vo Le & David Meenagh & Patrick Minford & Zhirong Ou, 2013. "What Causes Banking Crises? An Empirical Investigation for the World Economy," Open Economies Review, Springer, vol. 24(4), pages 581-611, September.
    9. Le, Vo Phuong Mai & Matthews, Kent & Meenagh, David & Minford, Patrick & Xiao, Zhiguo, 2015. "China s financial crisis the role of banks and monetary policy," Cardiff Economics Working Papers E2015/1, Cardiff University, Cardiff Business School, Economics Section.
    10. Vo Le & Kent Matthews & David Meenagh & Patrick Minford & Zhiguo Xiao, 2014. "Banking and the Macroeconomy in China: A Banking Crisis Deferred?," Open Economies Review, Springer, vol. 25(1), pages 123-161, February.
    11. Fan, Jingwen & Minford, Patrick & Ou, Zhirong, 2016. "The role of fiscal policy in Britain's Great Inflation," Economic Modelling, Elsevier, vol. 58(C), pages 203-218.
    12. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    13. Wickens, Michael R., 2014. "How did we get to where we are now? Reflections on 50 years of macroeconomic and financial econometrics," CEPR Discussion Papers 10197, C.E.P.R. Discussion Papers.
    14. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick, 2016. "Monetarism rides again? US monetary policy in a world of Quantitative Easing," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 44(C), pages 85-102.
    15. Patrick Minford & Zhirong Ou & Michael Wickens, 2015. "Revisiting the Great Moderation: Policy or Luck?," Open Economies Review, Springer, vol. 26(2), pages 197-223, April.
    16. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    17. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    18. Meenagh, David & Minford, Patrick & Wickens, Michael & Xu, Yongdeng, 2016. "What is the truth about DSGE models? Testing by indirect inference," Cardiff Economics Working Papers E2016/14, Cardiff University, Cardiff Business School, Economics Section.
    19. Minford, Patrick & Meenagh, David & Le, Vo Phuong Mai, 2012. "What causes banking crises? An empirical investigation," CEPR Discussion Papers 9057, C.E.P.R. Discussion Papers.
    20. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.

    More about this item

    Keywords

    Bootstrap; DSGE; New Keynesian; New classical; Indirect inference; Wald statistic; Likelihood ratio; C12; C32; C52; E1;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • E1 - Macroeconomics and Monetary Economics - - General Aggregative Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:openec:v:27:y:2016:i:1:p:1-38. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.