IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_9161.html
   My bibliography  Save this paper

Exploiting Symmetry in High-Dimensional Dynamic Programming

Author

Listed:
  • Mahdi Ebrahimi Kahou
  • Jesús Fernández-Villaverde
  • Jesse Perla
  • Arnav Sood

Abstract

We propose a new method for solving high-dimensional dynamic programming problems and recursive competitive equilibria with a large (but finite) number of heterogeneous agents using deep learning. The „curse of dimensionality“ is avoided due to four complementary techniques: (1) exploiting symmetry in the approximate law of motion and the value function; (2) constructing a concentration of measure to calculate high-dimensional expectations using a single Monte Carlo draw from the distribution of idiosyncratic shocks; (3) sampling methods to ensure the model fits along manifolds of interest; and (4) selecting the most generalizable over-parameterized deep learning approximation without calculating the stationary distribution or applying a transversality condition. As an application, we solve a global solution of a multi-firm version of the classic Lucas and Prescott (1971) model of „investment under uncertainty.“ First, we compare the solution against a linear-quadratic Gaussian version for validation and benchmarking. Next, we solve nonlinear versions with aggregate shocks. Finally, we describe how our approach applies to a large class of models in economics.

Suggested Citation

  • Mahdi Ebrahimi Kahou & Jesús Fernández-Villaverde & Jesse Perla & Arnav Sood, 2021. "Exploiting Symmetry in High-Dimensional Dynamic Programming," CESifo Working Paper Series 9161, CESifo.
  • Handle: RePEc:ces:ceswps:_9161
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp9161.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Duffy, John & McNelis, Paul D., 2001. "Approximating and simulating the stochastic growth model: Parameterized expectations, neural networks, and the genetic algorithm," Journal of Economic Dynamics and Control, Elsevier, vol. 25(9), pages 1273-1303, September.
    2. Anderson, Evan W. & McGrattan, Ellen R. & Hansen, Lars Peter & Sargent, Thomas J., 1996. "Mechanics of forming and estimating dynamic linear economies," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 4, pages 171-252, Elsevier.
    3. Jess Benhabib & Jesse Perla & Christopher Tonetti, 2021. "Reconciling Models of Diffusion and Innovation: A Theory of the Productivity Distribution and Technology Frontier," Econometrica, Econometric Society, vol. 89(5), pages 2261-2301, September.
    4. Greg Kaplan & Benjamin Moll & Giovanni L. Violante, 2018. "Monetary Policy According to HANK," American Economic Review, American Economic Association, vol. 108(3), pages 697-743, March.
    5. Vasco M. Carvalho & Alireza Tahbaz-Salehi, 2019. "Production Networks: A Primer," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 635-663, August.
    6. Jesús Fernández‐Villaverde & Samuel Hurtado & Galo Nuño, 2023. "Financial Frictions and the Wealth Distribution," Econometrica, Econometric Society, vol. 91(3), pages 869-901, May.
    7. Den Haan, Wouter J., 2010. "Comparison of solutions to the incomplete markets model with aggregate uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 34(1), pages 4-27, January.
    8. Sato, Ryuzo, 1985. "The invariance principle and income-wealth conservation laws : Application of Lie groups and related transformations," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 365-389.
    9. Edward C. Prescott & Rajnish Mehra, 2005. "Recursive Competitive Equilibrium: The Case Of Homogeneous Households," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 11, pages 357-371, World Scientific Publishing Co. Pte. Ltd..
    10. Kenneth L. Judd & Lilia Maliar & Serguei Maliar & Inna Tsener, 2017. "How to solve dynamic stochastic models computing expectations just once," Quantitative Economics, Econometric Society, vol. 8(3), pages 851-893, November.
    11. Ezra Oberfield, 2018. "A Theory of Input–Output Architecture," Econometrica, Econometric Society, vol. 86(2), pages 559-589, March.
    12. Per Krusell & Anthony A. Smith & Jr., 1998. "Income and Wealth Heterogeneity in the Macroeconomy," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 867-896, October.
    13. Maliar, Serguei & Winant, Pablo, 2019. "Will Artificial Intelligence Replace Computational Economists Any Time Soon?," CEPR Discussion Papers 14024, C.E.P.R. Discussion Papers.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Takeshi Fukasawa, 2023. "The Use of Symmetry for Models with Variable-size Variables," Papers 2311.08650, arXiv.org, revised Apr 2024.
    2. Pedro Afonso Fernandes, 2024. "Forecasting with Neuro-Dynamic Programming," Papers 2404.03737, arXiv.org.
    3. Jiequn Han & Yucheng Yang & Weinan E, 2021. "DeepHAM: A Global Solution Method for Heterogeneous Agent Models with Aggregate Shocks," Papers 2112.14377, arXiv.org, revised Feb 2022.
    4. Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hull, Isaiah, 2015. "Approximate dynamic programming with post-decision states as a solution method for dynamic economic models," Journal of Economic Dynamics and Control, Elsevier, vol. 55(C), pages 57-70.
    2. Jesús Fernández‐Villaverde & Samuel Hurtado & Galo Nuño, 2023. "Financial Frictions and the Wealth Distribution," Econometrica, Econometric Society, vol. 91(3), pages 869-901, May.
    3. Marlon Azinovic & Luca Gaegauf & Simon Scheidegger, 2022. "Deep Equilibrium Nets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1471-1525, November.
    4. Dong, Feng & Wen, Yi, 2019. "Long and Plosser meet Bewley and Lucas," Journal of Monetary Economics, Elsevier, vol. 102(C), pages 70-92.
    5. Lepetyuk, Vadym & Maliar, Lilia & Maliar, Serguei, 2020. "When the U.S. catches a cold, Canada sneezes: A lower-bound tale told by deep learning," Journal of Economic Dynamics and Control, Elsevier, vol. 117(C).
    6. Emoto, Masakazu & Sunakawa, Takeki, 2021. "Applying the explicit aggregation algorithm to heterogeneous agent models in continuous time," Economics Letters, Elsevier, vol. 206(C).
    7. Maliar, Lilia & Maliar, Serguei, 2022. "Deep learning classification: Modeling discrete labor choice," Journal of Economic Dynamics and Control, Elsevier, vol. 135(C).
    8. Maliar, Lilia & Maliar, Serguei & Winant, Pablo, 2021. "Deep learning for solving dynamic economic models," Journal of Monetary Economics, Elsevier, vol. 122(C), pages 76-101.
    9. Chipeniuk, Karsten O. & Katz, Nets Hawk & Walker, Todd B., 2022. "Households, auctioneers, and aggregation," European Economic Review, Elsevier, vol. 141(C).
    10. SeHyoun Ahn & Greg Kaplan & Benjamin Moll & Thomas Winberry & Christian Wolf, 2018. "When Inequality Matters for Macro and Macro Matters for Inequality," NBER Macroeconomics Annual, University of Chicago Press, vol. 32(1), pages 1-75.
    11. Heejeong Kim, 2022. "Inequality, Disaster risk, and the Great Recession," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 45, pages 187-216, July.
    12. Adrien Auclert & Bence Bardóczy & Matthew Rognlie & Ludwig Straub, 2021. "Using the Sequence‐Space Jacobian to Solve and Estimate Heterogeneous‐Agent Models," Econometrica, Econometric Society, vol. 89(5), pages 2375-2408, September.
    13. Papp, Tamás K. & Reiter, Michael, 2020. "Estimating linearized heterogeneous agent models using panel data," Journal of Economic Dynamics and Control, Elsevier, vol. 115(C).
    14. David Staines, 2023. "Stochastic Equilibrium the Lucas Critique and Keynesian Economics," Papers 2312.16214, arXiv.org.
    15. Jiequn Han & Yucheng Yang & Weinan E, 2021. "DeepHAM: A Global Solution Method for Heterogeneous Agent Models with Aggregate Shocks," Papers 2112.14377, arXiv.org, revised Feb 2022.
    16. Soyoung Lee, 2023. "The Macroeconomic Effects of Debt Relief Policies During Recessions," Staff Working Papers 23-48, Bank of Canada.
    17. Jesús Fernández-Villaverde & Pablo A. Guerrón-Quintana, 2021. "Estimating DSGE Models: Recent Advances and Future Challenges," Annual Review of Economics, Annual Reviews, vol. 13(1), pages 229-252, August.
    18. Karsten O. Chipeniuk, 2020. "Optimal Grid Selection for the Numerical Solution of Dynamic Stochastic Optimization Problems," Computational Economics, Springer;Society for Computational Economics, vol. 56(4), pages 883-928, December.
    19. Jesús Fernández-Villaverde & Joël Marbet & Galo Nuño & Omar Rachedi, 2023. "Inequality and the Zero Lower Bound," NBER Working Papers 31282, National Bureau of Economic Research, Inc.
    20. Anmol Bhandari & David Evans & Mikhail Golosov & Thomas J. Sargent, 2021. "Inequality, Business Cycles, and Monetary‐Fiscal Policy," Econometrica, Econometric Society, vol. 89(6), pages 2559-2599, November.

    More about this item

    Keywords

    dynamic programming; deep learning; breaking the curse of dimensionality;
    All these keywords.

    JEL classification:

    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C60 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_9161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.