IDEAS home Printed from https://ideas.repec.org/p/ubc/pmicro/vadim_marmer-2008-14.html
   My bibliography  Save this paper

Comparison of Misspecified Calibrated Models: The Minimum Distance Approach

Author

Listed:
  • Hnatkovska, Viktoria
  • Marmer, Vadim
  • Tang, Yao

Abstract

This paper proposes several testing procedures for comparison of misspecified calibrated models. The proposed tests are of the Vuong-type (Vuong, 1989; Rivers and Vuong, 2002). In our framework, the econometrician selects values for model's parameters in order to match some characteristics of data with those implied by the theoretical model. We assume that all competing models are misspecified, and suggest a test for the null hypothesis that they provide equivalent fit to data characteristics, against the alternative that one of the models is a better approximation. We consider both nested and non-nested cases. We also relax the dependence of models' ranking on the choice of a weight matrix by suggesting averaged and sup-norm procedures. The methods are illustrated by comparing the cash-in-advance and portfolio adjustment cost models in their ability to match the impulse responses of output and inflation to money growth shocks.

Suggested Citation

  • Hnatkovska, Viktoria & Marmer, Vadim & Tang, Yao, 2008. "Comparison of Misspecified Calibrated Models: The Minimum Distance Approach," Microeconomics.ca working papers vadim_marmer-2008-14, Vancouver School of Economics, revised 28 Sep 2011.
  • Handle: RePEc:ubc:pmicro:vadim_marmer-2008-14
    as

    Download full text from publisher

    File URL: http://microeconomics.ca/vadim_marmer/calibr23.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Blanchard, Olivier Jean & Quah, Danny, 1989. "The Dynamic Effects of Aggregate Demand and Supply Disturbances," American Economic Review, American Economic Association, vol. 79(4), pages 655-673, September.
    2. Canova, Fabio, 1994. "Statistical Inference in Calibrated Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 9(S), pages 123-144, Suppl. De.
    3. Corradi, Valentina & Swanson, Norman R., 2007. "Evaluation of dynamic stochastic general equilibrium models based on distributional comparison of simulated and historical data," Journal of Econometrics, Elsevier, vol. 136(2), pages 699-723, February.
    4. Gregory, Allan W & Smith, Gregor W, 1991. "Calibration as Testing: Inference in Simulated Macroeconomic Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(3), pages 297-303, July.
    5. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    6. Lawrence J. Christiano & Martin S. Eichenbaum, 1992. "Liquidity effects, the monetary transmission mechanism, and monetary policy," Economic Perspectives, Federal Reserve Bank of Chicago, vol. 16(Nov), pages 2-14.
    7. Cogley, Timothy & Nason, James M, 1995. "Output Dynamics in Real-Business-Cycle Models," American Economic Review, American Economic Association, vol. 85(3), pages 492-511, June.
    8. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    9. Hall, Alastair R. & Inoue, Atsushi, 2003. "The large sample behaviour of the generalized method of moments estimator in misspecified models," Journal of Econometrics, Elsevier, vol. 114(2), pages 361-394, June.
    10. Raymond Kan & Cesare Robotti, 2009. "Model Comparison Using the Hansen-Jagannathan Distance," Review of Financial Studies, Society for Financial Studies, vol. 22(9), pages 3449-3490, September.
    11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    12. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    13. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    14. Maasoumi, Esfandiar & Phillips, Peter C. B., 1982. "On the behavior of inconsistent instrumental variable estimators," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 183-201, August.
    15. Christiano, Lawrence J & Eichenbaum, Martin, 1992. "Liquidity Effects and the Monetary Transmission Mechanism," American Economic Review, American Economic Association, vol. 82(2), pages 346-353, May.
    16. Nason, James M & Cogley, Timothy, 1994. "Testing the Implications of Long-Run Neutrality for Monetary Business Cycle Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 9(S), pages 37-70, Suppl. De.
    17. Dridi, Ramdan & Guay, Alain & Renault, Eric, 2007. "Indirect inference and calibration of dynamic stochastic general equilibrium models," Journal of Econometrics, Elsevier, vol. 136(2), pages 397-430, February.
    18. Lucas, Robert Jr., 1990. "Liquidity and interest rates," Journal of Economic Theory, Elsevier, vol. 50(2), pages 237-264, April.
    19. Hnatkovska, Viktoria & Marmer, Vadim & Tang, Yao, 2009. "Supplement to "Comparison of Misspecified Calibrated Models"," Microeconomics.ca working papers vadim_marmer-2009-58, Vancouver School of Economics, revised 03 Feb 2011.
    20. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    21. Fuerst, Timothy S., 1992. "Liquidity, loanable funds, and real activity," Journal of Monetary Economics, Elsevier, vol. 29(1), pages 3-24, February.
    22. Lawrence J. Christiano, 1991. "Modeling the liquidity effect of a money shock," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 15(Win), pages 3-34.
    23. Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
    24. Allan W. Gregory & Gregor W. Smith, 1991. "Calibration in Macroeconomics," Working Paper 826, Economics Department, Queen's University.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Franke, Reiner & Jang, Tae-Seok & Sacht, Stephen, 2015. "Moment matching versus Bayesian estimation: Backward-looking behaviour in a New-Keynesian baseline model," The North American Journal of Economics and Finance, Elsevier, vol. 31(C), pages 126-154.
    2. Xue-Zhong He & Youwei Li, 2017. "The adaptiveness in stock markets: testing the stylized facts in the DAX 30," Journal of Evolutionary Economics, Springer, vol. 27(5), pages 1071-1094, November.
    3. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    4. Gao, Xiaodan & Hnatkovska, Viktoria & Marmer, Vadim, 2013. "Supplement to “Limited Participation in International Business Cycle Models: A Formal Evaluationâ€Â," Microeconomics.ca working papers vadim_marmer-2013-54, Vancouver School of Economics, revised 21 Dec 2013.
    5. Franke, Reiner & Jang, Tae-Seok & Sacht, Stephen, 2011. "Moment matching versus Bayesian estimation: Backward-looking behaviour in the new-Keynesian three-equations model," Economics Working Papers 2011-10, Christian-Albrechts-University of Kiel, Department of Economics.
    6. Gao, Xiaodan & Hnatkovska, Viktoria & Marmer, Vadim, 2014. "Limited participation in international business cycle models: A formal evaluation," Journal of Economic Dynamics and Control, Elsevier, vol. 39(C), pages 255-272.
    7. Yoonsuk Lee & B. Wade Brorsen, 2017. "Permanent Breaks and Temporary Shocks in a Time Series," Computational Economics, Springer;Society for Computational Economics, vol. 49(2), pages 255-270, February.
    8. Hnatkovska, Viktoria & Marmer, Vadim & Tang, Yao, 2009. "Supplement to "Comparison of Misspecified Calibrated Models"," Microeconomics.ca working papers vadim_marmer-2009-58, Vancouver School of Economics, revised 03 Feb 2011.
    9. repec:fip:feddar:y:2011:p:2-12 is not listed on IDEAS
    10. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian Model: a formal test of backward- and forward-looking expectations," MPRA Paper 40278, University Library of Munich, Germany.
    11. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian model: A formal test of backward- and forward-looking behavior," Economics Working Papers 2012-07, Christian-Albrechts-University of Kiel, Department of Economics.
    12. Reiner Franke & Frank Westerhoff, 2016. "Why a simple herding model may generate the stylized facts of daily returns: explanation and estimation," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 11(1), pages 1-34, April.
    13. Yoonsuk Lee & B. Wade Brorsen, 2017. "Permanent shocks and forecasting with moving averages," Applied Economics, Taylor & Francis Journals, vol. 49(12), pages 1213-1225, March.
    14. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian Model: a formal test of backward- and forward-looking expectations," MPRA Paper 39669, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marmer, Vadim & Otsu, Taisuke, 2012. "Optimal comparison of misspecified moment restriction models under a chosen measure of fit," Journal of Econometrics, Elsevier, vol. 170(2), pages 538-550.
    2. Karamé, Frédéric & Patureau, Lise & Sopraseuth, Thepthida, 2008. "Limited participation and exchange rate dynamics: Does theory meet the data?," Journal of Economic Dynamics and Control, Elsevier, vol. 32(4), pages 1041-1087, April.
    3. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    4. Valentina Corradi & Norman Swanson, 2013. "A Survey of Recent Advances in Forecast Accuracy Comparison Testing, with an Extension to Stochastic Dominance," Departmental Working Papers 201309, Rutgers University, Department of Economics.
    5. Patrick Minford & Konstantinos Theodoridis & David Meenagh, 2009. "Testing a Model of the UK by the Method of Indirect Inference," Open Economies Review, Springer, vol. 20(2), pages 265-291, April.
    6. Carlo A. Favero, 2007. "Model Evaluation in Macroeconometrics: from early empirical macroeconomic models to DSGE models," Working Papers 327, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    7. Norman Swanson & Oleg Korenok, 2006. "The Incremental Predictive Information Associated with Using Theoretical New Keynesian DSGE Models Versus Simple Linear Alternatives," Departmental Working Papers 200615, Rutgers University, Department of Economics.
    8. He, Xue-Zhong & Li, Youwei, 2015. "Testing of a market fraction model and power-law behaviour in the DAX 30," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 1-17.
    9. Dave Andolfatto & Scott Hendry & Kevin Moran, 2004. "Labour markets, liquidity, and monetary policy regimes," Canadian Journal of Economics, Canadian Economics Association, vol. 37(2), pages 392-420, May.
    10. Xue-Zhong He & Youwei Li, 2017. "The adaptiveness in stock markets: testing the stylized facts in the DAX 30," Journal of Evolutionary Economics, Springer, vol. 27(5), pages 1071-1094, November.
    11. Pablo A. Guerrón-Quintana & James M. Nason, 2013. "Bayesian estimation of DSGE models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 21, pages 486-512, Edward Elgar Publishing.
    12. Corradi, Valentina & Swanson, Norman R., 2011. "Predictive density construction and accuracy testing with multiple possibly misspecified diffusion models," Journal of Econometrics, Elsevier, vol. 161(2), pages 304-324, April.
    13. Díaz-Giménez, Javier & Kirkby, Robert, 2016. "Inflation and the growth rate of money in the long run and the short run," Working Paper Series 5047, Victoria University of Wellington, School of Economics and Finance.
    14. Li, Tong, 2009. "Simulation based selection of competing structural econometric models," Journal of Econometrics, Elsevier, vol. 148(2), pages 114-123, February.
    15. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian Model: a formal test of backward- and forward-looking expectations," MPRA Paper 40278, University Library of Munich, Germany.
    16. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
    17. Norman Swanson & Oleg Korenok, 2006. "How Sticky Is Sticky Enough? A Distributional and Impulse Response Analysis of New Keynesian DSGE Models. Extended Working Paper Version," Departmental Working Papers 200612, Rutgers University, Department of Economics.
    18. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian Model: a formal test of backward- and forward-looking expectations," MPRA Paper 39669, University Library of Munich, Germany.
    19. repec:hal:journl:peer-00796745 is not listed on IDEAS
    20. Gao, Xiaodan & Hnatkovska, Viktoria & Marmer, Vadim, 2014. "Limited participation in international business cycle models: A formal evaluation," Journal of Economic Dynamics and Control, Elsevier, vol. 39(C), pages 255-272.
    21. Carlo A. Favero, 2009. "The Econometrics of Monetary Policy: An Overview," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 16, pages 821-850, Palgrave Macmillan.

    More about this item

    Keywords

    misspecified models; calibration; matching; minimum distance estimation;
    All these keywords.

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ubc:pmicro:vadim_marmer-2008-14. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.economics.ubc.ca/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Maureen Chin (email available below). General contact details of provider: http://www.economics.ubc.ca/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.