IDEAS home Printed from https://ideas.repec.org/p/kyo/wpaper/618.html
   My bibliography  Save this paper

Continuous State Dynamic Programming Via Nonexpansive Approximation

Author

Listed:
  • John Stachurski

    () (Department of Economics, University of Melbourne)

Abstract

This paper studies fitted value iteration for continuous state dynamic programming using nonexpansive function approximators. A number of nonexpansive approximation schemes are discussed. The main contribution is to provide error bounds for approximate optimal policies generated by the value iteration algorithm.

Suggested Citation

  • John Stachurski, 2006. "Continuous State Dynamic Programming Via Nonexpansive Approximation," KIER Working Papers 618, Kyoto University, Institute of Economic Research.
  • Handle: RePEc:kyo:wpaper:618
    as

    Download full text from publisher

    File URL: http://www.kier.kyoto-u.ac.jp/DP/DP618.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Lucas, Robert E, Jr & Prescott, Edward C, 1971. "Investment Under Uncertainty," Econometrica, Econometric Society, vol. 39(5), pages 659-681, September.
    2. Mehra, Rajnish & Prescott, Edward C., 1985. "The equity premium: A puzzle," Journal of Monetary Economics, Elsevier, vol. 15(2), pages 145-161, March.
    3. Wilfredo Leiva Maldonado & Benar Fux Svaiter, 2001. "On the accuracy of the estimated policy function using the Bellman contraction method," Economics Bulletin, AccessEcon, vol. 3(15), pages 1-8.
    4. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    5. J. J. McCall, 1970. "Economics of Information and Job Search," The Quarterly Journal of Economics, Oxford University Press, vol. 84(1), pages 113-126.
    6. Manuel S. Santos & Jesus Vigo-Aguiar, 1998. "Analysis of a Numerical Dynamic Programming Algorithm Applied to Economic Models," Econometrica, Econometric Society, vol. 66(2), pages 409-426, March.
    7. Brock, William A. & Mirman, Leonard J., 1972. "Optimal economic growth and uncertainty: The discounted case," Journal of Economic Theory, Elsevier, vol. 4(3), pages 479-513, June.
    8. Michael Reiter, 2000. "Estimating The Accuracy Of Numerical Solutions To Dynamic Optimization Problems," Computing in Economics and Finance 2000 254, Society for Computational Economics.
    9. Wouter J. Den Haan & Albert Marcet, 1994. "Accuracy in Simulations," Review of Economic Studies, Oxford University Press, vol. 61(1), pages 3-17.
    10. Rust, John, 1996. "Numerical dynamic programming in economics," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 14, pages 619-729, Elsevier.
    11. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    12. Lucas, Robert E, Jr, 1978. "Asset Prices in an Exchange Economy," Econometrica, Econometric Society, vol. 46(6), pages 1429-1445, November.
    13. Chambers, Marcus J & Bailey, Roy E, 1996. "A Theory of Commodity Price Fluctuations," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 924-957, October.
    14. John Rust, 1997. "Using Randomization to Break the Curse of Dimensionality," Econometrica, Econometric Society, vol. 65(3), pages 487-516, May.
    15. Manuel S. Santos, 2000. "Accuracy of Numerical Solutions using the Euler Equation Residuals," Econometrica, Econometric Society, vol. 68(6), pages 1377-1402, November.
    16. Judd, Kenneth L., 1992. "Projection methods for solving aggregate growth models," Journal of Economic Theory, Elsevier, vol. 58(2), pages 410-452, December.
    17. Hans M. Amman & David A. Kendrick, . "Computational Economics," Online economics textbooks, SUNY-Oswego, Department of Economics, number comp1.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Arellano, Cristina & Maliar, Lilia & Maliar, Serguei & Tsyrennikov, Viktor, 2016. "Envelope condition method with an application to default risk models," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 436-459.
    2. Richard Anton Braun & Huiyu Li & John Stachurski, 2009. "Computing Densities and Expectations in Stochastic Recursive Economies: Generalized Look-Ahead Techniques," CIRJE F-Series CIRJE-F-620, CIRJE, Faculty of Economics, University of Tokyo.
    3. Fukushima, Kenichi & Waki, Yuichiro, 2013. "A polyhedral approximation approach to concave numerical dynamic programming," Journal of Economic Dynamics and Control, Elsevier, vol. 37(11), pages 2322-2335.
    4. Robert Kirkby Author-Email: robertkirkby@gmail.com|, 2017. "Convergence of Discretized Value Function Iteration," Computational Economics, Springer;Society for Computational Economics, vol. 49(1), pages 117-153, January.
    5. Takefumi Yamazaki, 2018. "Accuracy and speed of the solution methods for sovereign default models: The stable performance of the Tauchen method and cubic spline interpolation," Public Policy Review, Policy Research Institute, Ministry of Finance Japan, vol. 14(4), pages 641-662, July.
    6. Huiyu Li, 2015. "Numerical Policy Error Bounds for $$\eta $$ η -Concave Stochastic Dynamic Programming with Non-interior Solutions," Computational Economics, Springer;Society for Computational Economics, vol. 46(2), pages 171-187, August.
    7. Jenö Pál & John Stachurski, 2011. "Fitted Value Function Iteration With Probability One Contractions," ANU Working Papers in Economics and Econometrics 2011-560, Australian National University, College of Business and Economics, School of Economics.
    8. Nishimura, Kazuo & Stachurski, John, 2010. "Perfect simulation of stationary equilibria," Journal of Economic Dynamics and Control, Elsevier, vol. 34(4), pages 577-584, April.
    9. Pál, Jenő & Stachurski, John, 2013. "Fitted value function iteration with probability one contractions," Journal of Economic Dynamics and Control, Elsevier, vol. 37(1), pages 251-264.
    10. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, September.
    11. Takefumi Yamazaki, 2018. "Financial friction sources in emerging economies: Structural estimation of sovereign default models," Discussion papers ron303, Policy Research Institute, Ministry of Finance Japan.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, September.
    2. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    3. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    4. Barillas, Francisco & Fernandez-Villaverde, Jesus, 2007. "A generalization of the endogenous grid method," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2698-2712, August.
    5. Lars Grüne & Willi Semmler, 2007. "Asset pricing with dynamic programming," Computational Economics, Springer;Society for Computational Economics, vol. 29(3), pages 233-265, May.
    6. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2017. "Lower Bounds on Approximation Errors to Numerical Solutions of Dynamic Economic Models," Econometrica, Econometric Society, vol. 85, pages 991-1012, May.
    7. Peter Woehrmann & Willi Semmler & Martin Lettau, "undated". "Nonparametric Estimation of the Time-varying Sharpe Ratio in Dynamic Asset Pricing Models," IEW - Working Papers 225, Institute for Empirical Research in Economics - University of Zurich.
    8. Olson, Lars J. & Roy, Santanu, 2005. "Theory of Stochastic Optimal Economic Growth," Working Papers 28601, University of Maryland, Department of Agricultural and Resource Economics.
    9. Stephanie Becker & Lars Grüne & Willi Semmler, 2007. "Comparing accuracy of second-order approximation and dynamic programming," Computational Economics, Springer;Society for Computational Economics, vol. 30(1), pages 65-91, August.
    10. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2014. "Lower Bounds on Approximation Errors: Testing the Hypothesis That a Numerical Solution Is Accurate?," BYU Macroeconomics and Computational Laboratory Working Paper Series 2014-06, Brigham Young University, Department of Economics, BYU Macroeconomics and Computational Laboratory.
    11. Willi Semmler & Lars Grüne, 2004. "Asset Pricing with Delayed Consumption Decisions," Computing in Economics and Finance 2004 59, Society for Computational Economics.
    12. Manuel S. Santos & Adrian Peralta-Alva, 2012. "Analysis of Numerical Errors," Working Papers 2012-6, University of Miami, Department of Economics.
    13. Raahauge, Peter, 2006. "Upper Bounds on Numerical Approximation Errors," Working Papers 2004-4, Copenhagen Business School, Department of Finance.
    14. Willi Semmler, 2011. "Asset Prices, Booms and Recessions," Springer Books, Springer, number 978-3-642-20680-1, January.
    15. Atolia, Manoj & Chatterjee, Santanu & Turnovsky, Stephen J., 2010. "How misleading is linearization? Evaluating the dynamics of the neoclassical growth model," Journal of Economic Dynamics and Control, Elsevier, vol. 34(9), pages 1550-1571, September.
    16. Lim, G.C. & McNelis, Paul D., 2008. "Computational Macroeconomics for the Open Economy," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262123061, September.
    17. Olaf Posch & Timo Trimborn, 2011. "Numerical Solution of Dynamic Equilibrium Models under Poisson Uncertainty," CESifo Working Paper Series 3431, CESifo.
    18. Posch, Olaf & Trimborn, Timo, 2013. "Numerical solution of dynamic equilibrium models under Poisson uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 37(12), pages 2602-2622.
    19. Athreya, Kartik B., 2014. "Big Ideas in Macroeconomics: A Nontechnical View," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262019736, September.
    20. Dario Caldara & Jesus Fernandez-Villaverde & Juan Rubio-Ramirez & Wen Yao, 2012. "Computing DSGE Models with Recursive Preferences and Stochastic Volatility," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(2), pages 188-206, April.

    More about this item

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kyo:wpaper:618. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ryo Okui) The email address of this maintainer does not seem to be valid anymore. Please ask Ryo Okui to update the entry or send us the correct email address. General contact details of provider: http://edirc.repec.org/data/iekyojp.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.