IDEAS home Printed from https://ideas.repec.org/a/fip/fedlrv/y2007ijulp349-360nv.89no.4.html
   My bibliography  Save this article

Model fit and model selection

Author

Listed:
  • Narayana R. Kocherlakota

Abstract

This paper uses an example to show that a model that fits the available data perfectly may provide worse answers to policy questions than an alternative, imperfectly fitting model. The author argues that, in the context of Bayesian estimation, this result can be interpreted as being due to the use of an inappropriate prior over the parameters of shock processes. He urges the use of priors that are obtained from explicit auxiliary information, not from the desire to obtain identification.

Suggested Citation

  • Narayana R. Kocherlakota, 2007. "Model fit and model selection," Review, Federal Reserve Bank of St. Louis, vol. 89(Jul), pages 349-360.
  • Handle: RePEc:fip:fedlrv:y:2007:i:jul:p:349-360:n:v.89no.4
    as

    Download full text from publisher

    File URL: https://files.stlouisfed.org/files/htdocs/publications/review/07/07/Kocherlakota.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thomas A. Lubik & Frank Schorfheide, 2004. "Testing for Indeterminacy: An Application to U.S. Monetary Policy," American Economic Review, American Economic Association, vol. 94(1), pages 190-217, March.
    2. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    3. Brunner, Karl & Meltzer, Allan H., 1976. "The Phillips curve," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 1-18, January.
    4. Mark Bils & Peter J. Klenow, 2004. "Some Evidence on the Importance of Sticky Prices," Journal of Political Economy, University of Chicago Press, vol. 112(5), pages 947-985, October.
    5. Canova, Fabio & Sala, Luca, 2009. "Back to square one: Identification issues in DSGE models," Journal of Monetary Economics, Elsevier, vol. 56(4), pages 431-449, May.
    6. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    7. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Kocherlakota Speaks
      by Agent Continuum in Agent Continuum on 2010-05-17 23:43:50

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marco Del Negro & Frank Schorfheide, 2009. "Monetary Policy Analysis with Potentially Misspecified Models," American Economic Review, American Economic Association, vol. 99(4), pages 1415-1450, September.
    2. Lee E. Ohanian, 2007. "Commentary on \\"Model fit and model selection\\"," Review, Federal Reserve Bank of St. Louis, vol. 89(Jul), pages 361-370.
    3. Tovar, Camilo Ernesto, 2009. "DSGE Models and Central Banks," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-31.
    4. Grazzini, Jakob & Richiardi, Matteo, 2015. "Estimation of ergodic agent-based models by simulated minimum distance," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 148-165.
    5. Canova, Fabio & Paustian, Matthias, 2011. "Business cycle measurement with some theory," Journal of Monetary Economics, Elsevier, vol. 58(4), pages 345-361.
    6. Celso Jose Costa Junior, 2016. "Understanding DSGE models," Vernon Press Titles in Economics, Vernon Art and Science Inc, edition 1, number 70, July.
    7. Dilip Nachane, 2017. "Dynamic Stochastic General Equilibrium (DSGE) Modelling :Theory And Practice," Working Papers id:11699, eSocialSciences.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fair, Ray C., 2007. "Evaluating Inflation Targeting Using a Macroeconometric Model," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 1, pages 1-52.
    2. Ascari, Guido & Castelnuovo, Efrem & Rossi, Lorenza, 2011. "Calvo vs. Rotemberg in a trend inflation world: An empirical investigation," Journal of Economic Dynamics and Control, Elsevier, vol. 35(11), pages 1852-1867.
    3. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2008. "How Structural Are Structural Parameters?," NBER Chapters, in: NBER Macroeconomics Annual 2007, Volume 22, pages 83-137, National Bureau of Economic Research, Inc.
    4. Argia M. Sbordone & Timothy Cogley, 2004. "A Search for a Structural Phillips Curve," Computing in Economics and Finance 2004 291, Society for Computational Economics.
    5. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.
    6. Carboni, Giacomo, 2014. "Term premia implications of macroeconomic regime changes," Working Paper Series 1694, European Central Bank.
    7. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    8. Liu, Zheng & Waggoner, Daniel F. & Zha, Tao, 2007. "Asymmetric Expectation Effects of Regime Shifts and the Great Moderation," Kiel Working Papers 1357, Kiel Institute for the World Economy (IfW Kiel).
    9. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    10. Homburg, Stefan, 2017. "A Study in Monetary Macroeconomics," OUP Catalogue, Oxford University Press, number 9780198807537.
    11. Roccazzella, Francesco, 2019. "Credit market frictions and rational agents' myopia: Modeling financial frictions and shock to expectations in a DSGE setting estimated on Slovenian data," LIDAM Discussion Papers LFIN 2019004, Université catholique de Louvain, Louvain Finance (LFIN).
    12. Jesús Fernández-Villaverde, 2010. "The econometrics of DSGE models," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 3-49, March.
    13. Giovanni Di Bartolomeo & Marco Di Pietro, 2017. "Intrinsic Persistence of Wage Inflation in New Keynesian Models of the Business Cycles," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 49(6), pages 1161-1195, September.
    14. Consolo, Agostino & Favero, Carlo A. & Paccagnini, Alessia, 2009. "On the statistical identification of DSGE models," Journal of Econometrics, Elsevier, vol. 150(1), pages 99-115, May.
    15. Ray Fair, 2006. "Evaluating Inflation Targeting Using a Macroeconometric Model," Yale School of Management Working Papers amz2483, Yale School of Management, revised 01 Aug 2007.
    16. Richard Dennis, 2006. "The frequency of price adjustment and New Keynesian business cycle dynamics," Working Paper Series 2006-22, Federal Reserve Bank of San Francisco.
    17. Carlo A. Favero, 2009. "The Econometrics of Monetary Policy: An Overview," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 16, pages 821-850, Palgrave Macmillan.
    18. Ray C. Fair, 2006. "Evaluating Inflation Targeting Using a Macroeconometric Model," Levine's Bibliography 321307000000000303, UCLA Department of Economics.
    19. Lhuissier, Stéphane & Zabelina, Margarita, 2015. "On the stability of Calvo-style price-setting behavior," Journal of Economic Dynamics and Control, Elsevier, vol. 57(C), pages 77-95.
    20. Del Negro, Marco & Schorfheide, Frank, 2008. "Forming priors for DSGE models (and how it affects the assessment of nominal rigidities)," Journal of Monetary Economics, Elsevier, vol. 55(7), pages 1191-1208, October.

    More about this item

    Keywords

    Econometric models; Macroeconomics;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedlrv:y:2007:i:jul:p:349-360:n:v.89no.4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Scott St. Louis (email available below). General contact details of provider: https://edirc.repec.org/data/frbslus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.