IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v15y2000i6p645-670.html
   My bibliography  Save this article

Loss function-based evaluation of DSGE models

Author

Listed:
  • Frank Schorfheide

    (Department of Economics, University of Pennsylvania, 3718 Locust Walk, Philadelphia, PA 19104-6297, USA)

Abstract

In this paper we propose a Bayesian econometric procedure for the evaluation and comparison of DSGE models. Unlike in many previous econometric approaches we explicitly take into account the possibility that the DSGE models are misspecified and introduce a reference model to complete the model space. Three loss functions are proposed to assess the discrepancy between DSGE model predictions and an overall posterior distribution of population characteristics that the researcher is trying to match. The evaluation procedure is applied to the comparison of a standard cash-in-advance (CIA) and a portfolio adjustment cost (PAC) model. We find that the CIA model has higher posterior probability than the PAC model and achieves a better in-sample time series fit. Both models overpredict the magnitude of the negative correlation between output growth and inflation. However, unlike the PAC model, the CIA model is not able to generate a positive real effect of money growth shocks on aggregate output. Overall, the impulse response dynamics of the PAC model resemble the posterior mean impulse response functions more closely than the responses of the CIA model. Copyright © 2000 John Wiley & Sons, Ltd.

Suggested Citation

  • Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    • Handle: RePEc:jae:japmet:v:15:y:2000:i:6:p:645-670
    as

    Download full text from publisher

    File URL: http://qed.econ.queensu.ca:80/jae/2000-v15.6/
    File Function: Supporting data files and programs
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Blanchard, Olivier Jean & Quah, Danny, 1989. "The Dynamic Effects of Aggregate Demand and Supply Disturbances," American Economic Review, American Economic Association, vol. 79(4), pages 655-673, September.
    2. Francis X. Diebold & Lee E. Ohanian & Jeremy Berkowitz, 1998. "Dynamic Equilibrium Economies: A Framework for Comparing Models and Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 433-451.
    3. Canova, Fabio, 1994. "Statistical Inference in Calibrated Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 9(S), pages 123-144, Suppl. De.
    4. Cogley, Timothy & Nason, James M, 1995. "Output Dynamics in Real-Business-Cycle Models," American Economic Review, American Economic Association, vol. 85(3), pages 492-511, June.
    5. Kim, Jinill, 2000. "Constructing and estimating a realistic optimizing model of monetary policy," Journal of Monetary Economics, Elsevier, vol. 45(2), pages 329-359, April.
    6. Finn E. Kydland & Edward C. Prescott, 1996. "The Computational Experiment: An Econometric Tool," Journal of Economic Perspectives, American Economic Association, vol. 10(1), pages 69-85, Winter.
    7. Martin Crowder, 1988. "Asymptotic expansions of posterior expectations, distributions and densities for stochastic processes," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 40(2), pages 297-309, June.
    8. Christiano, Lawrence J & Eichenbaum, Martin, 1992. "Current Real-Business-Cycle Theories and Aggregate Labor-Market Fluctuations," American Economic Review, American Economic Association, vol. 82(3), pages 430-450, June.
    9. Christiano, Lawrence J & Eichenbaum, Martin, 1992. "Liquidity Effects and the Monetary Transmission Mechanism," American Economic Review, American Economic Association, vol. 82(2), pages 346-353, May.
    10. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    11. Ireland, Peter N., 2004. "A method for taking models to the data," Journal of Economic Dynamics and Control, Elsevier, vol. 28(6), pages 1205-1226, March.
    12. Nason, James M & Cogley, Timothy, 1994. "Testing the Implications of Long-Run Neutrality for Monetary Business Cycle Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 9(S), pages 37-70, Suppl. De.
    13. Altug, Sumru, 1989. "Time-to-Build and Aggregate Fluctuations: Some New Evidence," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 30(4), pages 889-920, November.
    14. Rotemberg, Julio J & Woodford, Michael, 1996. "Real-Business-Cycle Models and the Forecastable Movements in Output, Hours, and Consumption," American Economic Review, American Economic Association, vol. 86(1), pages 71-89, March.
    15. Fuerst, Timothy S., 1992. "Liquidity, loanable funds, and real activity," Journal of Monetary Economics, Elsevier, vol. 29(1), pages 3-24, February.
    16. Taylor, John B & Uhlig, Harald, 1990. "Solving Nonlinear Stochastic Growth Models: A Comparison of Alternative Solution Methods," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 1-17, January.
    17. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    18. Phillips, Peter C B, 1996. "Econometric Model Determination," Econometrica, Econometric Society, vol. 64(4), pages 763-812, July.
    19. John Geweke, 1999. "Computational Experiments and Reality," Computing in Economics and Finance 1999 401, Society for Computational Economics.
    20. Christopher A. Sims, 1996. "Macroeconomics and Methodology," Journal of Economic Perspectives, American Economic Association, vol. 10(1), pages 105-120, Winter.
    21. Christopher A. Sims, 1982. "Policy Analysis with Econometric Models," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 13(1), pages 107-164.
    22. DeJong, David N. & Ingram, Beth F. & Whiteman, Charles H., 2000. "A Bayesian approach to dynamic macroeconomics," Journal of Econometrics, Elsevier, vol. 98(2), pages 203-223, October.
    23. DeJong, David N & Ingram, Beth Fisher & Whiteman, Charles H, 1996. "A Bayesian Approach to Calibration," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 1-9, January.
    24. Lawrence J. Christiano, 1991. "Modeling the liquidity effect of a money shock," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 15(Win), pages 3-34.
    25. Soderlind, Paul, 1994. "Cyclical Properties of a Real Business Cycle Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 9(S), pages 113-122, Suppl. De.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    2. Paccagnini, Alessia, 2010. "DSGE Model Validation in a Bayesian Framework: an Assessment," MPRA Paper 24509, University Library of Munich, Germany.
    3. Alessia Paccagnini, 2012. "Comparing Hybrid DSGE Models," Working Papers 228, University of Milano-Bicocca, Department of Economics, revised Dec 2012.
    4. Carlo A. Favero, 2009. "The Econometrics of Monetary Policy: An Overview," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 16, pages 821-850, Palgrave Macmillan.
    5. Carlo A. Favero, 2007. "Model Evaluation in Macroeconometrics: from early empirical macroeconomic models to DSGE models," Working Papers 327, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    6. Ruge-Murcia, Francisco J., 2007. "Methods to estimate dynamic stochastic general equilibrium models," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2599-2636, August.
    7. Smets, Frank & Wouters, Raf, 2002. "An estimated stochastic dynamic general equilibrium model of the euro area," Working Paper Series 171, European Central Bank.
    8. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    9. Adnan Haider Bukhari & Safdar Ullah Khan, 2008. "A Small Open Economy DSGE Model for Pakistan," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 47(4), pages 963-1008.
    10. Canova, Fabio, 2002. "Validating Monetary DSGE Models through VARs," CEPR Discussion Papers 3442, C.E.P.R. Discussion Papers.
    11. Hnatkovska, Viktoria & Marmer, Vadim & Tang, Yao, 2012. "Comparison of misspecified calibrated models: The minimum distance approach," Journal of Econometrics, Elsevier, vol. 169(1), pages 131-138.
    12. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    13. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    14. Ireland, Peter N., 2004. "A method for taking models to the data," Journal of Economic Dynamics and Control, Elsevier, vol. 28(6), pages 1205-1226, March.
    15. Marc P. Giannoni & Jean Boivin, 2005. "DSGE Models in a Data-Rich Environment," Computing in Economics and Finance 2005 431, Society for Computational Economics.
    16. Takashi Kano & James M. Nason, 2014. "Business Cycle Implications of Internal Consumption Habit for New Keynesian Models," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 46(2-3), pages 519-544, March.
    17. Adrian Pagan, 2001. "The Getting of Macroeconomic Wisdom," International Economic Association Series, in: Jacques Drèze (ed.), Advances in Macroeconomic Theory, chapter 11, pages 219-235, Palgrave Macmillan.
    18. Patrick Minford & Konstantinos Theodoridis & David Meenagh, 2009. "Testing a Model of the UK by the Method of Indirect Inference," Open Economies Review, Springer, vol. 20(2), pages 265-291, April.
    19. Komunjer, Ivana & Zhu, Yinchu, 2020. "Likelihood ratio testing in linear state space models: An application to dynamic stochastic general equilibrium models," Journal of Econometrics, Elsevier, vol. 218(2), pages 561-586.
    20. Fabio Canova & Eva Ortega, 1996. "Testing calibrated general equilibrium models," Economics Working Papers 166, Department of Economics and Business, Universitat Pompeu Fabra.

    More about this item

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Loss function-based evaluation of DSGE models (Journal of Applied Econometrics 2000) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:15:y:2000:i:6:p:645-670. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.