IDEAS home Printed from https://ideas.repec.org/p/byu/byumcl/201406.html
   My bibliography  Save this paper

Lower Bounds on Approximation Errors: Testing the Hypothesis That a Numerical Solution Is Accurate?

Author

Listed:
  • Kenneth L. Judd

    (Hoover Institution, Stanford University)

  • Lilia Maliar

    (Department of Economics, Stanford University)

  • Serguei Maliar

    (Leavey School of Business, Santa Clara University)

Abstract

We propose a novel methodology for evaluating the accuracy of numerical solutions to dynamic economic models. Specifically, we construct a lower bound on the size of approximation errors. A small lower bound on errors is a necessary condition for accuracy: If a lower error bound is unacceptably large, then the actual approximation errors are even larger, and hence, we reject the hypothesis that a numerical solution is accurate. Our accuracy analysis is logically equivalent to hypothesis testing in statistics. As an illustration of our methodology, we assess approximation errors in the first- and second-order perturbation solutions for two stylized models: a neoclassical growth model and a new Keynesian model. The errors are small for the former model but unacceptably large for the latter model under some empirically relevant parameterizations.

Suggested Citation

  • Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2014. "Lower Bounds on Approximation Errors: Testing the Hypothesis That a Numerical Solution Is Accurate?," BYU Macroeconomics and Computational Laboratory Working Paper Series 2014-06, Brigham Young University, Department of Economics, BYU Macroeconomics and Computational Laboratory.
  • Handle: RePEc:byu:byumcl:201406
    as

    Download full text from publisher

    File URL: https://docs.google.com/file/d/0B6KGaihAO5TJeDhERnROOFlDc2s/edit
    File Function: First version, 2014
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christiano, Lawrence J. & Fisher, Jonas D. M., 2000. "Algorithms for solving dynamic models with occasionally binding constraints," Journal of Economic Dynamics and Control, Elsevier, vol. 24(8), pages 1179-1232, July.
    2. Fernández-Villaverde, Jesús & Gordon, Grey & Guerrón-Quintana, Pablo & Rubio-Ramírez, Juan F., 2015. "Nonlinear adventures at the zero lower bound," Journal of Economic Dynamics and Control, Elsevier, vol. 57(C), pages 182-204.
    3. Kollmann, Robert & Maliar, Serguei & Malin, Benjamin A. & Pichler, Paul, 2011. "Comparison of solutions to the multi-country Real Business Cycle model," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 186-202, February.
    4. Kollmann, Robert & Kim, Jinill & Kim, Sunghyun H., 2011. "Solving the multi-country Real Business Cycle model using a perturbation method," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 203-206, February.
    5. S. Boragan Aruoba & Frank Schorfheide, 2013. "Macroeconomic dynamics near the ZLB: a tale of two equilibria," Working Papers 13-29, Federal Reserve Bank of Philadelphia.
    6. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, December.
    7. Juillard, Michel & Villemot, Sébastien, 2011. "Multi-country real business cycle models: Accuracy tests and test bench," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 178-185, February.
    8. Maliar, Serguei & Maliar, Lilia & Judd, Kenneth, 2011. "Solving the multi-country real business cycle model using ergodic set methods," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 207-228, February.
    9. William T. Gavin & Benjamin D. Keen & Alexander W. Richter & Nathaniel A. Throckmorton, 2013. "Global Dynamics at the Zero Lower Bound," Auburn Economics Working Paper Series auwp2013-17, Department of Economics, Auburn University.
    10. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2011. "Numerically stable and accurate stochastic simulation approaches for solving dynamic economic models," Quantitative Economics, Econometric Society, vol. 2(2), pages 173-210, July.
    11. den Haan, Wouter J & Marcet, Albert, 1990. "Solving the Stochastic Growth Model by Parameterizing Expectations," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 31-34, January.
    12. S Borağan Aruoba & Pablo Cuba-Borda & Frank Schorfheide, 2018. "Macroeconomic Dynamics Near the ZLB: A Tale of Two Countries," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(1), pages 87-118.
    13. Krueger, Dirk & Kubler, Felix, 2004. "Computing equilibrium in OLG models with stochastic production," Journal of Economic Dynamics and Control, Elsevier, vol. 28(7), pages 1411-1436, April.
    14. Gaspar, Jess & L. Judd, Kenneth, 1997. "Solving Large-Scale Rational-Expectations Models," Macroeconomic Dynamics, Cambridge University Press, vol. 1(1), pages 45-75, January.
    15. Manuel S. Santos & Adrian Peralta-Alva, 2005. "Accuracy of Simulations for Stochastic Dynamic Models," Econometrica, Econometric Society, vol. 73(6), pages 1939-1976, November.
    16. Felix Kubler & Karl Schmedders, 2008. "Approximate Versus Exact Equilibria in Dynamic Economies," Lecture Notes in Economics and Mathematical Systems, in: Computational Aspects of General Equilibrium Theory, pages 135-163, Springer.
    17. Manuel S. Santos & Jesus Vigo-Aguiar, 1998. "Analysis of a Numerical Dynamic Programming Algorithm Applied to Economic Models," Econometrica, Econometric Society, vol. 66(2), pages 409-426, March.
    18. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    19. Manuel S. Santos & Adrian Peralta-Alva, 2012. "Analysis of Numerical Errors," Working Papers 2012-6, University of Miami, Department of Economics.
    20. Collard, Fabrice & Juillard, Michel, 2001. "Accuracy of stochastic perturbation methods: The case of asset pricing models," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 979-999, June.
    21. Manuel S. Santos & Adrian Peralta-Alva, 2005. "Accuracy of Simulations for Stochastic Dynamic Models," Econometrica, Econometric Society, vol. 73(6), pages 1939-1976, November.
    22. Wouter J. Den Haan & Albert Marcet, 1994. "Accuracy in Simulations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(1), pages 3-17.
    23. Den Haan, Wouter J., 2010. "Comparison of solutions to the incomplete markets model with aggregate uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 34(1), pages 4-27, January.
    24. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    25. Taylor, John B & Uhlig, Harald, 1990. "Solving Nonlinear Stochastic Growth Models: A Comparison of Alternative Solution Methods," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 1-17, January.
    26. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    27. Gavin, William T. & Keen, Benjamin D. & Richter, Alexander W. & Throckmorton, Nathaniel A., 2015. "The zero lower bound, the dual mandate, and unconventional dynamics," Journal of Economic Dynamics and Control, Elsevier, vol. 55(C), pages 14-38.
    28. Kenneth Judd & Lilia Maliar & Serguei Maliar, 2012. "Merging simulation and projection approaches to solve high-dimensional problems," Working Papers. Serie AD 2012-20, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    29. Santos, Manuel S., 1999. "Numerical solution of dynamic economic models," Handbook of Macroeconomics, in: J. B. Taylor & M. Woodford (ed.), Handbook of Macroeconomics, edition 1, volume 1, chapter 5, pages 311-386, Elsevier.
    30. Kollmann, Robert, 2002. "Monetary policy rules in the open economy: effects on welfare and business cycles," Journal of Monetary Economics, Elsevier, vol. 49(5), pages 989-1015, July.
    31. Sims, Christopher A, 1990. "Solving the Stochastic Growth Model by Backsolving with a Particular Nonlinear Form for the Decision Rule," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 45-47, January.
    32. Manuel S. Santos, 2000. "Accuracy of Numerical Solutions using the Euler Equation Residuals," Econometrica, Econometric Society, vol. 68(6), pages 1377-1402, November.
    33. Judd, Kenneth L., 1992. "Projection methods for solving aggregate growth models," Journal of Economic Theory, Elsevier, vol. 58(2), pages 410-452, December.
    34. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    2. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2017. "Lower Bounds on Approximation Errors to Numerical Solutions of Dynamic Economic Models," Econometrica, Econometric Society, vol. 85, pages 991-1012, May.
    3. Lilia Maliar & Serguei Maliar & John B. Taylor & Inna Tsener, 2020. "A tractable framework for analyzing a class of nonstationary Markov models," Quantitative Economics, Econometric Society, vol. 11(4), pages 1289-1323, November.
    4. Serguei Maliar & John Taylor & Lilia Maliar, 2016. "The Impact of Alternative Transitions to Normalized Monetary Policy," 2016 Meeting Papers 794, Society for Economic Dynamics.
    5. Arellano, Cristina & Maliar, Lilia & Maliar, Serguei & Tsyrennikov, Viktor, 2016. "Envelope condition method with an application to default risk models," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 436-459.
    6. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2010. "A Cluster-Grid Projection Method: Solving Problems with High Dimensionality," NBER Working Papers 15965, National Bureau of Economic Research, Inc.
    7. Kenneth L. Judd & Lilia Maliar & Serguei Maliar & Inna Tsener, 2017. "How to solve dynamic stochastic models computing expectations just once," Quantitative Economics, Econometric Society, vol. 8(3), pages 851-893, November.
    8. Judd, Kenneth L. & Maliar, Lilia & Maliar, Serguei & Valero, Rafael, 2014. "Smolyak method for solving dynamic economic models: Lagrange interpolation, anisotropic grid and adaptive domain," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 92-123.
    9. Kollmann, Robert & Maliar, Serguei & Malin, Benjamin A. & Pichler, Paul, 2011. "Comparison of solutions to the multi-country Real Business Cycle model," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 186-202, February.
    10. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    11. Guerrieri, Luca & Iacoviello, Matteo, 2015. "OccBin: A toolkit for solving dynamic models with occasionally binding constraints easily," Journal of Monetary Economics, Elsevier, vol. 70(C), pages 22-38.
    12. Lepetyuk, Vadym & Maliar, Lilia & Maliar, Serguei, 2020. "When the U.S. catches a cold, Canada sneezes: A lower-bound tale told by deep learning," Journal of Economic Dynamics and Control, Elsevier, vol. 117(C).
    13. Maliar, Serguei & Maliar, Lilia & Judd, Kenneth, 2011. "Solving the multi-country real business cycle model using ergodic set methods," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 207-228, February.
    14. Lilia Maliar & Serguei Maliar & Sébastien Villemot, 2013. "Taking Perturbation to the Accuracy Frontier: A Hybrid of Local and Global Solutions," Computational Economics, Springer;Society for Computational Economics, vol. 42(3), pages 307-325, October.
    15. Kenneth Judd & Lilia Maliar & Serguei Maliar, 2009. "Numerically Stable Stochastic Simulation Approaches for Solving Dynamic Economic Models," NBER Working Papers 15296, National Bureau of Economic Research, Inc.
    16. Yasuo Hirose & Takeki Sunakawa, 2019. "Review of Solution and Estimation Methods for Nonlinear Dynamic Stochastic General Equilibrium Models with the Zero Lower Bound," The Japanese Economic Review, Japanese Economic Association, vol. 70(1), pages 51-104, March.
    17. Alexander Richter & Nathaniel Throckmorton & Todd Walker, 2014. "Accuracy, Speed and Robustness of Policy Function Iteration," Computational Economics, Springer;Society for Computational Economics, vol. 44(4), pages 445-476, December.
    18. Manuel S. Santos & Adrian Peralta-Alva, 2012. "Analysis of Numerical Errors," Working Papers 2012-6, University of Miami, Department of Economics.
    19. Marlon Azinovic & Luca Gaegauf & Simon Scheidegger, 2022. "Deep Equilibrium Nets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1471-1525, November.
    20. de Castro, Luciano & Galvao, Antonio F. & Muchon, Andre, 2023. "Numerical Solution of Dynamic Quantile Models," Journal of Economic Dynamics and Control, Elsevier, vol. 148(C).

    More about this item

    Keywords

    approximation errors; best case scenario; error bounds; Euler equation residuals; accuracy; numerical solution; algorithm; new Keynesian model;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C68 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computable General Equilibrium Models
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:byu:byumcl:201406. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kerk Phillips (email available below). General contact details of provider: https://edirc.repec.org/data/debyuus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.