IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/16285.html
   My bibliography  Save this paper

Exploiting Symmetry in High-Dimensional Dynamic Programming

Author

Listed:
  • Fernández-Villaverde, Jesús
  • Ebrahimi Kahou, Mahdi
  • Perla, Jesse
  • Sood, Arnav

Abstract

We propose a new method for solving high-dimensional dynamic programming problems and recursive competitive equilibria with a large (but finite) number of heterogeneous agents using deep learning. The ``curse of dimensionality'' is avoided due to four complementary techniques: (1) exploiting symmetry in the approximate law of motion and the value function; (2) constructing a concentration of measure to calculate high-dimensional expectations using a single Monte Carlo draw from the distribution of idiosyncratic shocks; (3) sampling methods to ensure the model fits along manifolds of interest; and (4) selecting the most generalizable over-parameterized deep learning approximation without calculating the stationary distribution or applying a transversality condition. As an application, we solve a global solution of a multi-firm version of the classic Lucas and Prescott (1971) model of ``investment under uncertainty.'' First, we compare the solution against a linear-quadratic Gaussian version for validation and benchmarking. Next, we solve nonlinear versions with aggregate shocks. Finally, we describe how our approach applies to a large class of models in economics.

Suggested Citation

  • Fernández-Villaverde, Jesús & Ebrahimi Kahou, Mahdi & Perla, Jesse & Sood, Arnav, 2021. "Exploiting Symmetry in High-Dimensional Dynamic Programming," CEPR Discussion Papers 16285, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:16285
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP16285
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Duffy, John & McNelis, Paul D., 2001. "Approximating and simulating the stochastic growth model: Parameterized expectations, neural networks, and the genetic algorithm," Journal of Economic Dynamics and Control, Elsevier, vol. 25(9), pages 1273-1303, September.
    2. Anderson, Evan W. & McGrattan, Ellen R. & Hansen, Lars Peter & Sargent, Thomas J., 1996. "Mechanics of forming and estimating dynamic linear economies," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 4, pages 171-252, Elsevier.
    3. Jess Benhabib & Jesse Perla & Christopher Tonetti, 2021. "Reconciling Models of Diffusion and Innovation: A Theory of the Productivity Distribution and Technology Frontier," Econometrica, Econometric Society, vol. 89(5), pages 2261-2301, September.
    4. Greg Kaplan & Benjamin Moll & Giovanni L. Violante, 2018. "Monetary Policy According to HANK," American Economic Review, American Economic Association, vol. 108(3), pages 697-743, March.
    5. Kenneth L. Judd & Lilia Maliar & Serguei Maliar & Inna Tsener, 2017. "How to solve dynamic stochastic models computing expectations just once," Quantitative Economics, Econometric Society, vol. 8(3), pages 851-893, November.
    6. Jesús Fernández‐Villaverde & Samuel Hurtado & Galo Nuño, 2023. "Financial Frictions and the Wealth Distribution," Econometrica, Econometric Society, vol. 91(3), pages 869-901, May.
    7. Vasco M. Carvalho & Alireza Tahbaz-Salehi, 2019. "Production Networks: A Primer," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 635-663, August.
    8. Edward C. Prescott & Rajnish Mehra, 2005. "Recursive Competitive Equilibrium: The Case Of Homogeneous Households," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 11, pages 357-371, World Scientific Publishing Co. Pte. Ltd..
    9. Ezra Oberfield, 2018. "A Theory of Input–Output Architecture," Econometrica, Econometric Society, vol. 86(2), pages 559-589, March.
    10. Den Haan, Wouter J., 2010. "Comparison of solutions to the incomplete markets model with aggregate uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 34(1), pages 4-27, January.
    11. Sato, Ryuzo, 1985. "The invariance principle and income-wealth conservation laws : Application of Lie groups and related transformations," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 365-389.
    12. Per Krusell & Anthony A. Smith & Jr., 1998. "Income and Wealth Heterogeneity in the Macroeconomy," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 867-896, October.
    13. Maliar, Serguei & Winant, Pablo, 2019. "Will Artificial Intelligence Replace Computational Economists Any Time Soon?," CEPR Discussion Papers 14024, C.E.P.R. Discussion Papers.
    14. Jesus Fernandez-Villaverde & Samuel Hurtado & Galo Nuno, 2019. "Financial Frictions and the Wealth Distribution," PIER Working Paper Archive 19-015, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Takeshi Fukasawa, 2023. "The Use of Symmetry for Models with Variable-size Variables," Papers 2311.08650, arXiv.org, revised Dec 2023.
    2. Jiequn Han & Yucheng Yang & Weinan E, 2021. "DeepHAM: A Global Solution Method for Heterogeneous Agent Models with Aggregate Shocks," Papers 2112.14377, arXiv.org, revised Feb 2022.
    3. Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lepetyuk, Vadym & Maliar, Lilia & Maliar, Serguei, 2020. "When the U.S. catches a cold, Canada sneezes: A lower-bound tale told by deep learning," Journal of Economic Dynamics and Control, Elsevier, vol. 117(C).
    2. Marlon Azinovic & Luca Gaegauf & Simon Scheidegger, 2022. "Deep Equilibrium Nets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1471-1525, November.
    3. Maliar, Lilia & Maliar, Serguei & Winant, Pablo, 2021. "Deep learning for solving dynamic economic models," Journal of Monetary Economics, Elsevier, vol. 122(C), pages 76-101.
    4. Emoto, Masakazu & Sunakawa, Takeki, 2021. "Applying the explicit aggregation algorithm to heterogeneous agent models in continuous time," Economics Letters, Elsevier, vol. 206(C).
    5. Jesús Fernández‐Villaverde & Samuel Hurtado & Galo Nuño, 2023. "Financial Frictions and the Wealth Distribution," Econometrica, Econometric Society, vol. 91(3), pages 869-901, May.
    6. Adrien Auclert & Bence Bardóczy & Matthew Rognlie & Ludwig Straub, 2021. "Using the Sequence‐Space Jacobian to Solve and Estimate Heterogeneous‐Agent Models," Econometrica, Econometric Society, vol. 89(5), pages 2375-2408, September.
    7. Hull, Isaiah, 2015. "Approximate dynamic programming with post-decision states as a solution method for dynamic economic models," Journal of Economic Dynamics and Control, Elsevier, vol. 55(C), pages 57-70.
    8. Papp, Tamás K. & Reiter, Michael, 2020. "Estimating linearized heterogeneous agent models using panel data," Journal of Economic Dynamics and Control, Elsevier, vol. 115(C).
    9. Jesús Fernández-Villaverde & Pablo A. Guerrón-Quintana, 2021. "Estimating DSGE Models: Recent Advances and Future Challenges," Annual Review of Economics, Annual Reviews, vol. 13(1), pages 229-252, August.
    10. Maliar, Lilia & Maliar, Serguei, 2022. "Deep learning classification: Modeling discrete labor choice," Journal of Economic Dynamics and Control, Elsevier, vol. 135(C).
    11. Dong, Feng & Wen, Yi, 2019. "Long and Plosser meet Bewley and Lucas," Journal of Monetary Economics, Elsevier, vol. 102(C), pages 70-92.
    12. Ruitu Xu & Yifei Min & Tianhao Wang & Zhaoran Wang & Michael I. Jordan & Zhuoran Yang, 2023. "Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning," Papers 2303.04833, arXiv.org.
    13. Chipeniuk, Karsten O. & Katz, Nets Hawk & Walker, Todd B., 2022. "Households, auctioneers, and aggregation," European Economic Review, Elsevier, vol. 141(C).
    14. SeHyoun Ahn & Greg Kaplan & Benjamin Moll & Thomas Winberry & Christian Wolf, 2018. "When Inequality Matters for Macro and Macro Matters for Inequality," NBER Macroeconomics Annual, University of Chicago Press, vol. 32(1), pages 1-75.
    15. Heejeong Kim, 2022. "Inequality, Disaster risk, and the Great Recession," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 45, pages 187-216, July.
    16. Fernández-Villaverde, Jesús & Marbet, Joël & Nuño, Galo & Rachedi, Omar, 2023. "Inequality and the Zero Lower Bound," CEPR Discussion Papers 18168, C.E.P.R. Discussion Papers.
    17. David Staines, 2023. "Stochastic Equilibrium the Lucas Critique and Keynesian Economics," Papers 2312.16214, arXiv.org.
    18. Broer, Tobias & Kohlhas, Alexandre N. & Mitman, Kurt & Schlafmann, Kathrin, 2022. "On the possibility of Krusell-Smith Equilibria," Journal of Economic Dynamics and Control, Elsevier, vol. 141(C).
    19. Jiequn Han & Yucheng Yang & Weinan E, 2021. "DeepHAM: A Global Solution Method for Heterogeneous Agent Models with Aggregate Shocks," Papers 2112.14377, arXiv.org, revised Feb 2022.
    20. Ben Moll, 2020. "The Research Agenda: Ben Moll on the Rich Interactions between Inequality and the Macroeconomy," EconomicDynamics Newsletter, Review of Economic Dynamics, vol. 21(2), November.

    More about this item

    Keywords

    Machine learning; Dynamic programming;

    JEL classification:

    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C60 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:16285. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.