IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2401.10473.html
   My bibliography  Save this paper

Dynamic Programming: Finite States

Author

Listed:
  • Thomas J. Sargent
  • John Stachurski

Abstract

This book is about dynamic programming and its applications in economics, finance, and adjacent fields. It brings together recent innovations in the theory of dynamic programming and provides applications and code that can help readers approach the research frontier. The book is aimed at graduate students and researchers, although most chapters are accessible to undergraduate students with solid quantitative backgrounds.

Suggested Citation

  • Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.
    • Handle: RePEc:arx:papers:2401.10473
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2401.10473
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erosa, Andrés & González, Beatriz, 2019. "Taxation and the life cycle of firms," Journal of Monetary Economics, Elsevier, vol. 105(C), pages 114-130.
    2. Lucas, Robert E, Jr & Prescott, Edward C, 1971. "Investment Under Uncertainty," Econometrica, Econometric Society, vol. 39(5), pages 659-681, September.
    3. Angus Deaton & Guy Laroque, 1992. "On the Behaviour of Commodity Prices," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 59(1), pages 1-23.
    4. Yue, Vivian Z., 2010. "Sovereign default and debt renegotiation," Journal of International Economics, Elsevier, vol. 80(2), pages 176-187, March.
    5. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2018. "On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty," Journal of Economic Theory, Elsevier, vol. 176(C), pages 293-310.
    6. Esponda, Ignacio & Pouzo, Demian, 2021. "Equilibrium in misspecified Markov decision processes," Theoretical Economics, Econometric Society, vol. 16(2), May.
    7. Christopher D. Carroll, 1997. "Buffer-Stock Saving and the Life Cycle/Permanent Income Hypothesis," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(1), pages 1-55.
    8. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," The Review of Financial Studies, Society for Financial Studies, vol. 14(1), pages 113-147.
    9. Javier Bianchi, 2011. "Overborrowing and Systemic Externalities in the Business Cycle," American Economic Review, American Economic Association, vol. 101(7), pages 3400-3426, December.
    10. Frank Riedel, 2009. "Optimal Stopping With Multiple Priors," Econometrica, Econometric Society, vol. 77(3), pages 857-908, May.
    11. Marcet, Albert & Obiols-Homs, Francesc & Weil, Philippe, 2007. "Incomplete markets, labor supply and capital accumulation," Journal of Monetary Economics, Elsevier, vol. 54(8), pages 2621-2635, November.
    12. Andriy Norets, 2010. "Continuity and differentiability of expected value functions in dynamic discrete choice models," Quantitative Economics, Econometric Society, vol. 1(2), pages 305-322, November.
    13. Jovanovic, Boyan, 1984. "Matching, Turnover, and Unemployment," Journal of Political Economy, University of Chicago Press, vol. 92(1), pages 108-122, February.
    14. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    15. Pissarides, C A, 1979. "Job Matchings with State Employment Agencies and Random Search," Economic Journal, Royal Economic Society, vol. 89(356), pages 818-833, December.
    16. Luigi Paciello & Mirko Wiederholt, 2014. "Exogenous Information, Endogenous Information, and Optimal Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(1), pages 356-388.
    17. , & ,, 2014. "Stochastic stability in monotone economies," Theoretical Economics, Econometric Society, vol. 9(2), May.
    18. Carroll, Christopher D., 2009. "Precautionary saving and the marginal propensity to consume out of permanent income," Journal of Monetary Economics, Elsevier, vol. 56(6), pages 780-790, September.
    19. Hansen, Lars Peter & Sargent, Thomas J., 2007. "Recursive robust estimation and control without commitment," Journal of Economic Theory, Elsevier, vol. 136(1), pages 1-27, September.
    20. Kristensen, Dennis & Mogensen, Patrick K. & Moon, Jong Myun & Schjerning, Bertel, 2021. "Solving dynamic discrete choice models using smoothing and sieve methods," Journal of Econometrics, Elsevier, vol. 223(2), pages 328-360.
    21. Claudio Michelacci & Luigi Paciello & Andrea Pozzi, 2022. "The Extensive Margin of Aggregate Consumption Demand [Cost of Living Inequality during the Great Recession]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(2), pages 909-947.
    22. Nick Bloom & Stephen Bond & John Van Reenen, 2007. "Uncertainty and Investment Dynamics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(2), pages 391-415.
    23. Antoine Bommier & Bertrand Villeneuve, 2012. "Risk Aversion and the Value of Risk to Life," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 79(1), pages 77-104, March.
    24. Jonathan Heathcote & Fabrizio Perri, 2018. "Wealth and Volatility," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(4), pages 2173-2213.
    25. Patrick DeJarnette & David Dillenberger & Daniel Gottlieb & Pietro Ortoleva, 2020. "Time Lotteries and Stochastic Impatience," Econometrica, Econometric Society, vol. 88(2), pages 619-656, March.
    26. Fatih Guvenen, 2009. "An Empirical Investigation of Labor Income Processes," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 12(1), pages 58-79, January.
    27. Fatih Guvenen, 2007. "Learning Your Earning: Are Labor Income Shocks Really Very Persistent?," American Economic Review, American Economic Association, vol. 97(3), pages 687-712, June.
    28. Oliver de Groot & Alexander W. Richter & Nathaniel A. Throckmorton, 2018. "Uncertainty Shocks in a Model of Effective Demand: Comment," Econometrica, Econometric Society, vol. 86(4), pages 1513-1526, July.
    29. Takashi Kamihigashi, 2014. "Elementary results on solutions to the bellman equation of dynamic programming: existence, uniqueness, and convergence," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 56(2), pages 251-273, June.
    30. TallariniJr., Thomas D., 2000. "Risk-sensitive real business cycles," Journal of Monetary Economics, Elsevier, vol. 45(3), pages 507-532, June.
    31. Michael Woodford, 2011. "Simple Analytics of the Government Expenditure Multiplier," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(1), pages 1-35, January.
    32. Greg Kaplan & Benjamin Moll & Giovanni L. Violante, 2018. "Monetary Policy According to HANK," American Economic Review, American Economic Association, vol. 108(3), pages 697-743, March.
    33. Lorenzo Bastianello & José Heleno Faro, 2022. "Choquet expected discounted utility," Post-Print hal-04103604, HAL.
    34. Emmanuelle Augeraud-Véron & Giorgio Fabbri & Katheline Schubert, 2019. "The Value of Biodiversity as an Insurance Device," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 101(4), pages 1068-1081.
    35. Hopenhayn, Hugo A & Prescott, Edward C, 1992. "Stochastic Monotonicity and Stationary Distributions for Dynamic Economies," Econometrica, Econometric Society, vol. 60(6), pages 1387-1406, November.
    36. repec:hal:spmain:info:hdl:2441/8623 is not listed on IDEAS
    37. Mirman, Leonard J. & Zilcha, Itzhak, 1975. "On optimal growth under uncertainty," Journal of Economic Theory, Elsevier, vol. 11(3), pages 329-339, December.
    38. Benny Kleinman & Ernest Liu & Stephen J. Redding, 2023. "Dynamic Spatial General Equilibrium," Econometrica, Econometric Society, vol. 91(2), pages 385-424, March.
    39. repec:dau:papers:123456789/13605 is not listed on IDEAS
    40. Epstein, Larry G & Zin, Stanley E, 1991. "Substitution, Risk Aversion, and the Temporal Behavior of Consumption and Asset Returns: An Empirical Analysis," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 263-286, April.
    41. Mariacristina De Nardi & Eric French & John B. Jones, 2010. "Why Do the Elderly Save? The Role of Medical Expenses," Journal of Political Economy, University of Chicago Press, vol. 118(1), pages 39-75, February.
    42. Andreas Fagereng & Martin Blomhoff Holm & Benjamin Moll & Gisle Natvik, 2019. "Saving Behavior Across the Wealth Distribution: The Importance of Capital Gains," NBER Working Papers 26588, National Bureau of Economic Research, Inc.
    43. Lars Ljungqvist, 2002. "How Do Lay--off Costs Affect Employment?," Economic Journal, Royal Economic Society, vol. 112(482), pages 829-853, October.
    44. Yves Achdou & Jiequn Han & Jean-Michel Lasry & Pierre-Louis Lionse & Benjamin Moll, 2022. "Income and Wealth Distribution in Macroeconomics: A Continuous-Time Approach [On the Existence and Uniqueness of Stationary Equilibrium in Bewley Economies with Production]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(1), pages 45-86.
    45. Cristina Arellano & Ananth Ramanarayanan, 2012. "Default and the Maturity Structure in Sovereign Bonds," Journal of Political Economy, University of Chicago Press, vol. 120(2), pages 187-232.
    46. Vasco M. Carvalho & Basile Grassi, 2019. "Large Firm Dynamics and the Business Cycle," American Economic Review, American Economic Association, vol. 109(4), pages 1375-1425, April.
    47. Frank Schorfheide & Dongho Song & Amir Yaron, 2018. "Identifying Long‐Run Risks: A Bayesian Mixed‐Frequency Approach," Econometrica, Econometric Society, vol. 86(2), pages 617-654, March.
    48. Lars Peter Hansen & José A. Scheinkman, 2009. "Long-Term Risk: An Operator Approach," Econometrica, Econometric Society, vol. 77(1), pages 177-234, January.
    49. Jean-Pierre Drugeon & Bertrand Wigniolle, 2021. "On Markovian collective choice with heterogeneous quasi-hyperbolic discounting," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 72(4), pages 1257-1296, November.
    50. Ric Colacito & Max Croce & Steven Ho & Philip Howard, 2018. "BKK the EZ Way: International Long-Run Growth News and Capital Flows," American Economic Review, American Economic Association, vol. 108(11), pages 3416-3449, November.
    51. Susanto Basu & Brent Bundick, 2017. "Uncertainty Shocks in a Model of Effective Demand," Econometrica, Econometric Society, vol. 85, pages 937-958, May.
    52. Pol Antràs & Alonso de Gortari, 2020. "On the Geography of Global Value Chains," Econometrica, Econometric Society, vol. 88(4), pages 1553-1598, July.
    53. repec:hal:wpspec:info:hdl:2441/8623 is not listed on IDEAS
    54. Giovannetti, Bruno C., 2013. "Asset pricing under quantile utility maximization," Review of Financial Economics, Elsevier, vol. 22(4), pages 169-179.
    55. Atish R. Ghosh & Jun I. Kim & Enrique G. Mendoza & Jonathan D. Ostry & Mahvash S. Qureshi, 2013. "Fiscal Fatigue, Fiscal Space and Debt Sustainability in Advanced Economies," Economic Journal, Royal Economic Society, vol. 0, pages 4-30, February.
    56. Jesse Perla & Christopher Tonetti, 2014. "Equilibrium Imitation and Growth," Journal of Political Economy, University of Chicago Press, vol. 122(1), pages 52-76.
    57. Karp, Larry, 2005. "Global warming and hyperbolic discounting," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 261-282, February.
    58. Klibanoff, Peter & Marinacci, Massimo & Mukerji, Sujoy, 2009. "Recursive smooth ambiguity preferences," Journal of Economic Theory, Elsevier, vol. 144(3), pages 930-976, May.
    59. Yao Luo & Peijun Sang, 2022. "Penalized Sieve Estimation of Structural Models," Papers 2204.13488, arXiv.org.
    60. Philippe Weil, 1990. "Nonexpected Utility in Macroeconomics," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 105(1), pages 29-42.
    61. Larry G. Epstein & Stanley E. Zin, 2013. "Substitution, risk aversion and the temporal behavior of consumption and asset returns: A theoretical framework," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 12, pages 207-239, World Scientific Publishing Co. Pte. Ltd..
    62. Leonidas Paroussos & Antoine Mandel & Kostas Fragkiadakis & Panagiotis Fragkos & Jochen Hinkel & Zoi Vrontisi, 2019. "Climate clubs and the macro-economic benefits of international cooperation on climate policy," Nature Climate Change, Nature, vol. 9(7), pages 542-546, July.
    63. Marco Cagetti & Lars Peter Hansen & Thomas Sargent & Noah Williams, 2002. "Robustness and Pricing with Uncertain Growth," The Review of Financial Studies, Society for Financial Studies, vol. 15(2), pages 363-404, March.
    64. Ma, Qingyin & Toda, Alexis Akira, 2021. "A theory of the saving rate of the rich," Journal of Economic Theory, Elsevier, vol. 192(C).
    65. Caterina Calsamiglia & Chao Fu & Maia Güell, 2020. "Structural Estimation of a Model of School Choices: The Boston Mechanism versus Its Alternatives," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 642-680.
    66. Nengjiu Ju & Jianjun Miao, 2012. "Ambiguity, Learning, and Asset Returns," Econometrica, Econometric Society, vol. 80(2), pages 559-591, March.
    67. Nicola Gennaioli & Alberto Martin & Stefano Rossi, 2014. "Sovereign Default, Domestic Banks, and Financial Institutions," Journal of Finance, American Finance Association, vol. 69(2), pages 819-866, April.
    68. Christensen, Timothy M., 2022. "Existence and uniqueness of recursive utilities without boundedness," Journal of Economic Theory, Elsevier, vol. 200(C).
    69. Rui Albuquerque & Martin Eichenbaum & Victor Xi Luo & Sergio Rebelo, 2016. "Valuation Risk and Asset Pricing," Journal of Finance, American Finance Association, vol. 71(6), pages 2861-2904, December.
    70. Lucas, Robert E, Jr, 1978. "Asset Prices in an Exchange Economy," Econometrica, Econometric Society, vol. 46(6), pages 1429-1445, November.
    71. Lars Peter Hansen & Thomas J Sargent, 2014. "Doubts or Variability?," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 7, pages 217-256, World Scientific Publishing Co. Pte. Ltd..
    72. Jaroslav Borovička & John Stachurski, 2020. "Necessary and Sufficient Conditions for Existence and Uniqueness of Recursive Utilities," Journal of Finance, American Finance Association, vol. 75(3), pages 1457-1493, June.
    73. David Newhouse, 2005. "The Persistence of Income Shocks: Evidence from Rural Indonesia," Review of Development Economics, Wiley Blackwell, vol. 9(3), pages 415-433, August.
    74. L. G. Mitten, 1964. "Composition Principles for Synthesis of Optimal Multistage Processes," Operations Research, INFORMS, vol. 12(4), pages 610-619, August.
    75. Oliver de Groot & Alexander W. Richter & Nathaniel A. Throckmorton, 2022. "Valuation risk revalued," Quantitative Economics, Econometric Society, vol. 13(2), pages 723-759, May.
    76. Raj Chetty, 2008. "Moral Hazard versus Liquidity and Optimal Unemployment Insurance," Journal of Political Economy, University of Chicago Press, vol. 116(2), pages 173-234, April.
    77. Miao, Jianjun, 2006. "Competitive equilibria of economies with a continuum of consumers and aggregate shocks," Journal of Economic Theory, Elsevier, vol. 128(1), pages 274-298, May.
    78. Kwanho Shin & Jaewoo Lee, 2000. "The Role of a Variable Input in the Relationship between Investment and Uncertainty," American Economic Review, American Economic Association, vol. 90(3), pages 667-680, June.
    79. Toda, Alexis Akira, 2019. "Wealth distribution with random discount factors," Journal of Monetary Economics, Elsevier, vol. 104(C), pages 101-113.
    80. James Andreoni & Charles Sprenger, 2012. "Risk Preferences Are Not Time Preferences," American Economic Review, American Economic Association, vol. 102(7), pages 3357-3376, December.
    81. J. Doyne Farmer & John Geanakoplos & Matteo G. Richiardi & Miquel Montero & Josep Perelló & Jaume Masoliver, 2024. "Discounting the Distant Future: What Do Historical Bond Prices Imply about the Long-Term Discount Rate?," Mathematics, MDPI, vol. 12(5), pages 1-25, February.
    82. Efe A. Ok, 2007. "Preliminaries of Real Analysis, from Real Analysis with Economic Applications," Introductory Chapters, in: Real Analysis with Economic Applications, Princeton University Press.
    83. Schechtman, Jack, 1976. "An income fluctuation problem," Journal of Economic Theory, Elsevier, vol. 12(2), pages 218-241, April.
    84. , & ,, 2011. "Intertemporal substitution and recursive smooth ambiguity preferences," Theoretical Economics, Econometric Society, vol. 6(3), September.
    85. Hens, Thorsten & Schindler, Nilüfer, 2020. "Value and patience: The value premium in a dividend-growth model with hyperbolic discounting," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 161-179.
    86. Saijo, Hikaru, 2017. "The uncertainty multiplier and business cycles," Journal of Economic Dynamics and Control, Elsevier, vol. 78(C), pages 1-25.
    87. Kikuchi, Tomoo & Nishimura, Kazuo & Stachurski, John & Zhang, Junnan, 2021. "Coase meets Bellman: Dynamic programming for production networks," Journal of Economic Theory, Elsevier, vol. 196(C).
    88. Havranek, Tomas & Horvath, Roman & Irsova, Zuzana & Rusnak, Marek, 2015. "Cross-country heterogeneity in intertemporal substitution," Journal of International Economics, Elsevier, vol. 96(1), pages 100-118.
    89. Pengfei Wang & Yi Wen, 2012. "Hayashi Meets Kiyotaki and Moore: A Theory of Capital Adjustment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(2), pages 207-225, April.
    90. Al-Najjar, Nabil I. & Shmaya, Eran, 2019. "Recursive utility and parameter uncertainty," Journal of Economic Theory, Elsevier, vol. 181(C), pages 274-288.
    91. Loewenstein, George F & Sicherman, Nachum, 1991. "Do Workers Prefer Increasing Wage Profiles?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 67-84, January.
    92. Ariel Rubinstein, 2003. ""Economics and Psychology"? The Case of Hyperbolic Discounting," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(4), pages 1207-1216, November.
    93. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    94. Ravi Bansal & Amir Yaron, 2004. "Risks for the Long Run: A Potential Resolution of Asset Pricing Puzzles," Journal of Finance, American Finance Association, vol. 59(4), pages 1481-1509, August.
    95. Bansal, Ravi & Kiku, Dana & Yaron, Amir, 2012. "An Empirical Evaluation of the Long-Run Risks Model for Asset Prices," Critical Finance Review, now publishers, vol. 1(1), pages 183-221, January.
    96. Patrick Kofod Mogensen, 2018. "Solving Dynamic Discrete Choice Models: Integrated or Expected Value Function?," Papers 1801.03978, arXiv.org.
    97. Tauchen, George, 1986. "Finite state markov-chain approximations to univariate and vector autoregressions," Economics Letters, Elsevier, vol. 20(2), pages 177-181.
    98. John Rust, 1997. "Using Randomization to Break the Curse of Dimensionality," Econometrica, Econometric Society, vol. 65(3), pages 487-516, May.
    99. Blundell, Richard & Graber, Michael & Mogstad, Magne, 2015. "Labor income dynamics and the insurance from taxes, transfers, and the family," Journal of Public Economics, Elsevier, vol. 127(C), pages 58-73.
    100. Guihai Zhao, 2020. "Ambiguity, Nominal Bond Yields, and Real Bond Yields," American Economic Review: Insights, American Economic Association, vol. 2(2), pages 177-192, June.
    101. Vladimir Tyazhelnikov, 2022. "Production Clustering and Offshoring," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 700-732, August.
    102. Partha Dasgupta & Eric Maskin, 2005. "Uncertainty and Hyperbolic Discounting," American Economic Review, American Economic Association, vol. 95(4), pages 1290-1299, September.
    103. Luciano Castro & Antonio F. Galvao, 2022. "Static and dynamic quantile preferences," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(2), pages 747-779, April.
    104. Hansen, Lars Peter & Sargent, Thomas J., 1980. "Formulating and estimating dynamic linear rational expectations models," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 7-46, May.
    105. Luciano de Castro & Antonio F. Galvao, 2019. "Dynamic Quantile Models of Rational Behavior," Econometrica, Econometric Society, vol. 87(6), pages 1893-1939, November.
    106. Shane Frederick & George Loewenstein & Ted O'Donoghue, 2002. "Time Discounting and Time Preference: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 351-401, June.
    107. J. J. McCall, 1970. "Economics of Information and Job Search," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 84(1), pages 113-126.
    108. Uri Benzion & Amnon Rapoport & Joseph Yagil, 1989. "Discount Rates Inferred from Decisions: An Experimental Study," Management Science, INFORMS, vol. 35(3), pages 270-284, March.
    109. Lars Peter Hansen & John C. Heaton & Nan Li, 2008. "Consumption Strikes Back? Measuring Long-Run Risk," Journal of Political Economy, University of Chicago Press, vol. 116(2), pages 260-302, April.
    110. repec:dau:papers:123456789/4812 is not listed on IDEAS
    111. Hills, Timothy S. & Nakata, Taisuke & Schmidt, Sebastian, 2019. "Effective lower bound risk," European Economic Review, Elsevier, vol. 120(C).
    112. Bocola, Luigi & Bornstein, Gideon & Dovis, Alessandro, 2019. "Quantitative sovereign default models and the European debt crisis," Journal of International Economics, Elsevier, vol. 118(C), pages 20-30.
    113. Kenneth Gillingham & Fedor Iskhakov & Anders Munk-Nielsen & John Rust & Bertel Schjerning, 2022. "Equilibrium Trade in Automobiles," Journal of Political Economy, University of Chicago Press, vol. 130(10), pages 2534-2593.
    114. S. Rao Aiyagari, 1994. "Uninsured Idiosyncratic Risk and Aggregate Saving," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 109(3), pages 659-684.
    115. Fernández-Villaverde, Jesús & Ebrahimi Kahou, Mahdi & Perla, Jesse & Sood, Arnav, 2021. "Exploiting Symmetry in High-Dimensional Dynamic Programming," CEPR Discussion Papers 16285, C.E.P.R. Discussion Papers.
    116. Diamond, Peter & Koszegi, Botond, 2003. "Quasi-hyperbolic discounting and retirement," Journal of Public Economics, Elsevier, vol. 87(9-10), pages 1839-1872, September.
    117. Hu, Tai-Wei & Shmaya, Eran, 2019. "Unique monetary equilibrium with inflation in a stationary Bewley–Aiyagari model," Journal of Economic Theory, Elsevier, vol. 180(C), pages 368-382.
    118. Stachurski, John & Toda, Alexis Akira, 2019. "An impossibility theorem for wealth in heterogeneous-agent models with limited heterogeneity," Journal of Economic Theory, Elsevier, vol. 182(C), pages 1-24.
    119. Anna Jaśkiewicz & Andrzej S. Nowak, 2021. "Markov decision processes with quasi-hyperbolic discounting," Finance and Stochastics, Springer, vol. 25(2), pages 189-229, April.
    120. Boud, John III, 1990. "Recursive utility and the Ramsey problem," Journal of Economic Theory, Elsevier, vol. 50(2), pages 326-345, April.
    121. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 473-522, June.
    122. Nicolas Legrand, 2019. "The Empirical Merit Of Structural Explanations Of Commodity Price Volatility: Review And Perspectives," Journal of Economic Surveys, Wiley Blackwell, vol. 33(2), pages 639-664, April.
    123. Jaśkiewicz, Anna & Nowak, Andrzej S., 2014. "Stationary Markov perfect equilibria in risk sensitive stochastic overlapping generations models," Journal of Economic Theory, Elsevier, vol. 151(C), pages 411-447.
    124. Per Krusell & Anthony A. Smith & Jr., 1998. "Income and Wealth Heterogeneity in the Macroeconomy," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 867-896, October.
    125. Ma, Qingyin & Stachurski, John & Toda, Alexis Akira, 2020. "The income fluctuation problem and the evolution of wealth," Journal of Economic Theory, Elsevier, vol. 187(C).
    126. Marinacci, Massimo & Montrucchio, Luigi, 2010. "Unique solutions for stochastic recursive utilities," Journal of Economic Theory, Elsevier, vol. 145(5), pages 1776-1804, September.
    127. Lehrer, Ehud & Light, Bar, 2018. "The effect of interest rates on consumption in an income fluctuation problem," Journal of Economic Dynamics and Control, Elsevier, vol. 94(C), pages 63-71.
    128. Alan Carruth & Andy Dickerson & Andrew Henley, 2000. "What do We Know About Investment Under Uncertainty?," Journal of Economic Surveys, Wiley Blackwell, vol. 14(2), pages 119-154, April.
    129. Lucas, Robert Jr. & Stokey, Nancy L., 1984. "Optimal growth with many consumers," Journal of Economic Theory, Elsevier, vol. 32(1), pages 139-171, February.
    130. Ernesto Mordecki, 2002. "Optimal stopping and perpetual options for Lévy processes," Finance and Stochastics, Springer, vol. 6(4), pages 473-493.
    131. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    132. Wen‐Tai Hsu, 2012. "Central Place Theory and City Size Distribution," Economic Journal, Royal Economic Society, vol. 122(563), pages 903-932, September.
    133. Massimo Marinacci & Giulio Principi & Lorenzo Stanca, 2023. "Recursive Preferences and Ambiguity Attitudes," Carlo Alberto Notebooks 695 JEL Classification: C, Collegio Carlo Alberto.
    134. Walter Pohl & Karl Schmedders & Ole Wilms, 2018. "Higher Order Effects in Asset Pricing Models with Long‐Run Risks," Journal of Finance, American Finance Association, vol. 73(3), pages 1061-1111, June.
    135. Massimo Marinacci & Luigi Montrucchio, 2019. "Unique Tarski Fixed Points," Management Science, INFORMS, vol. 44(4), pages 1174-1191, November.
    136. Thaler, Richard, 1981. "Some empirical evidence on dynamic inconsistency," Economics Letters, Elsevier, vol. 8(3), pages 201-207.
    137. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2022. "Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting," Journal of Economic Theory, Elsevier, vol. 204(C).
    138. Cristina Arellano, 2008. "Default Risk and Income Fluctuations in Emerging Economies," American Economic Review, American Economic Association, vol. 98(3), pages 690-712, June.
    139. Fedor Iskhakov & John Rust & Bertel Schjerning, 2020. "Machine learning and structural econometrics: contrasts and synergies," The Econometrics Journal, Royal Economic Society, vol. 23(3), pages 81-124.
    140. Roberts, Mark J & Tybout, James R, 1997. "The Decision to Export in Colombia: An Empirical Model of Entry with Sunk Costs," American Economic Review, American Economic Association, vol. 87(4), pages 545-564, September.
    141. Raj Chetty, 2008. "Moral Hazard versus Liquidity and Optimal Unemployment Insurance," Journal of Political Economy, University of Chicago Press, vol. 116(2), pages 173-234, April.
    142. Dan Cao & Iván Werning, 2018. "Saving and Dissaving With Hyperbolic Discounting," Econometrica, Econometric Society, vol. 86(3), pages 805-857, May.
    143. Foss, Sergey & Shneer, Vsevolod & Thomas, Jonathan P. & Worrall, Tim, 2018. "Stochastic stability of monotone economies in regenerative environments," Journal of Economic Theory, Elsevier, vol. 173(C), pages 334-360.
    144. Jesús Fernández‐Villaverde & Samuel Hurtado & Galo Nuño, 2023. "Financial Frictions and the Wealth Distribution," Econometrica, Econometric Society, vol. 91(3), pages 869-901, May.
    145. Antoine Bommier & Asen Kochov & François Le Grand, 2017. "On Monotone Recursive Preferences," Econometrica, Econometric Society, vol. 85, pages 1433-1466, September.
    146. V. Filipe Martins-da-Rocha & Yiannis Vailakis, 2010. "Existence and Uniqueness of a Fixed Point for Local Contractions," Econometrica, Econometric Society, vol. 78(3), pages 1127-1141, May.
    147. Bäuerle, Nicole & Glauner, Alexander, 2022. "Markov decision processes with recursive risk measures," European Journal of Operational Research, Elsevier, vol. 296(3), pages 953-966.
    148. William A. Brock & Leonard J. Mirman, 2001. "Optimal Economic Growth And Uncertainty: The Discounted Case," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 1, pages 3-37, Edward Elgar Publishing.
    149. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    150. Lowenstein, George & Prelec, Drazen, 1991. "Negative Time Preference," American Economic Review, American Economic Association, vol. 81(2), pages 347-352, May.
    151. Toda, Alexis Akira, 2014. "Incomplete market dynamics and cross-sectional distributions," Journal of Economic Theory, Elsevier, vol. 154(C), pages 310-348.
    152. Jovanovic, Boyan, 1982. "Selection and the Evolution of Industry," Econometrica, Econometric Society, vol. 50(3), pages 649-670, May.
    153. Bloise, Gaetano & Vailakis, Yiannis, 2018. "Convex dynamic programming with (bounded) recursive utility," Journal of Economic Theory, Elsevier, vol. 173(C), pages 118-141.
    154. Marlon Azinovic & Luca Gaegauf & Simon Scheidegger, 2022. "Deep Equilibrium Nets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1471-1525, November.
    155. Ramon Marimon, 1984. "General Equilibrium and Growth Under Uncertainty: The Turnpike Theory," Discussion Papers 624, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    156. Łukasz Balbus, 2020. "On recursive utilities with non-affine aggregator and conditional certainty equivalent," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 70(2), pages 551-577, September.
    157. Guohui Guan & Xiaojun Wang, 2020. "Time-consistent reinsurance and investment strategies for an AAI under smooth ambiguity utility," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2020(8), pages 677-699, September.
    158. repec:dau:papers:123456789/416 is not listed on IDEAS
    159. Marimon, Ramon, 1989. "Stochastic turnpike property and stationary equilibrium," Journal of Economic Theory, Elsevier, vol. 47(2), pages 282-306, April.
    160. Jovanovic, Boyan, 1979. "Firm-specific Capital and Turnover," Journal of Political Economy, University of Chicago Press, vol. 87(6), pages 1246-1260, December.
    161. Hopenhayn, Hugo A, 1992. "Entry, Exit, and Firm Dynamics in Long Run Equilibrium," Econometrica, Econometric Society, vol. 60(5), pages 1127-1150, September.
    162. Bar Light, 2020. "Uniqueness of equilibrium in a Bewley–Aiyagari model," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 69(2), pages 435-450, March.
    163. Ninna Reitzel Jensen, 2019. "Life insurance decisions under recursive utility," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2019(3), pages 204-227, March.
    164. Li, Huiyu & Stachurski, John, 2014. "Solving the income fluctuation problem with unbounded rewards," Journal of Economic Dynamics and Control, Elsevier, vol. 45(C), pages 353-365.
    165. Keyvan Eslami & Tom Phelan, 2023. "The Art of Temporal Approximation An Investigation into Numerical Solutions to Discrete and Continuous-Time Problems in Economics," Working Papers 23-10, Federal Reserve Bank of Cleveland.
    166. Berthold Herrendorf & Richard Rogerson & Ákos Valentinyi, 2021. "Structural Change in Investment and Consumption—A Unified Analysis [Capital Deepening and Non-balanced Economic Growth]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1311-1346.
    167. Juan J. Cruces & Christoph Trebesch, 2013. "Sovereign Defaults: The Price of Haircuts," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(3), pages 85-117, July.
    168. Kelle, Peter & Milne, Alistair, 1999. "The effect of (s, S) ordering policy on the supply chain," International Journal of Production Economics, Elsevier, vol. 59(1-3), pages 113-122, March.
    169. Bommier, Antoine & Kochov, Asen & Le Grand, François, 2019. "Ambiguity and endogenous discounting," Journal of Mathematical Economics, Elsevier, vol. 83(C), pages 48-62.
    170. L. C. G. Rogers, 2002. "Monte Carlo valuation of American options," Mathematical Finance, Wiley Blackwell, vol. 12(3), pages 271-286, July.
    171. Kreps, David M & Porteus, Evan L, 1978. "Temporal Resolution of Uncertainty and Dynamic Choice Theory," Econometrica, Econometric Society, vol. 46(1), pages 185-200, January.
    172. Benhabib, Jess & Bisin, Alberto & Zhu, Shenghao, 2015. "The wealth distribution in Bewley economies with capital income risk," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 489-515.
    173. Quah, Danny, 1990. "Permanent and Transitory Movements in Labor Income: An Explanation for "Excess Smoothness" in Consumption," Journal of Political Economy, University of Chicago Press, vol. 98(3), pages 449-475, June.
    174. McFadden, Daniel, 1974. "The measurement of urban travel demand," Journal of Public Economics, Elsevier, vol. 3(4), pages 303-328, November.
    175. Massimo Marinacci & Giulio Principi & Lorenzo Stanca, 2023. "Recursive Preferences and Ambiguity Attitudes," Papers 2304.06830, arXiv.org, revised Aug 2023.
    176. Stachurski, John & Zhang, Junnan, 2021. "Dynamic programming with state-dependent discounting," Journal of Economic Theory, Elsevier, vol. 192(C).
    177. Galo Nuno & Benjamin Moll, 2018. "Social Optima in Economies with Heterogeneous Agents," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 28, pages 150-180, April.
    178. Hsu, Wen-Tai & Holmes, Thomas J. & Morgan, Frank, 2014. "Optimal city hierarchy: A dynamic programming approach to central place theory," Journal of Economic Theory, Elsevier, vol. 154(C), pages 245-273.
    179. Cao, Dan, 2020. "Recursive equilibrium in Krusell and Smith (1998)," Journal of Economic Theory, Elsevier, vol. 186(C).
    180. Meissner, Thomas & Pfeiffer, Philipp, 2022. "Measuring preferences over the temporal resolution of consumption uncertainty," Journal of Economic Theory, Elsevier, vol. 200(C).
    181. Edward Hill & Marco Bardoscia & Arthur Turrell, 2021. "Solving Heterogeneous General Equilibrium Economic Models with Deep Reinforcement Learning," Papers 2103.16977, arXiv.org.
    182. Maliar, Lilia & Maliar, Serguei & Winant, Pablo, 2021. "Deep learning for solving dynamic economic models," Journal of Monetary Economics, Elsevier, vol. 122(C), pages 76-101.
    183. Rendahl, Pontus, 2022. "Continuous vs. discrete time: Some computational insights," Journal of Economic Dynamics and Control, Elsevier, vol. 144(C).
    184. Pontus Rendahl, 2016. "Fiscal Policy in an Unemployment Crisis," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(3), pages 1189-1224.
    185. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," University of California at Los Angeles, Anderson Graduate School of Management qt43n1k4jb, Anderson Graduate School of Management, UCLA.
    186. J. Michael Harrison & David M. Kreps, 1978. "Speculative Investor Behavior in a Stock Market with Heterogeneous Expectations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 92(2), pages 323-336.
    187. Joachim Hubmer & Per Krusell & Anthony A. Smith Jr., 2020. "Sources of US Wealth Inequality: Past, Present, and Future," NBER Chapters, in: NBER Macroeconomics Annual 2020, volume 35, pages 391-455, National Bureau of Economic Research, Inc.
    188. Nirei, Makoto, 2006. "Threshold behavior and aggregate fluctuation," Journal of Economic Theory, Elsevier, vol. 127(1), pages 309-322, March.
    189. Huggett, Mark, 1993. "The risk-free rate in heterogeneous-agent incomplete-insurance economies," Journal of Economic Dynamics and Control, Elsevier, vol. 17(5-6), pages 953-969.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ma, Qingyin & Stachurski, John & Toda, Alexis Akira, 2022. "Unbounded dynamic programming via the Q-transform," Journal of Mathematical Economics, Elsevier, vol. 100(C).
    2. Ma, Qingyin & Stachurski, John & Toda, Alexis Akira, 2020. "The income fluctuation problem and the evolution of wealth," Journal of Economic Theory, Elsevier, vol. 187(C).
    3. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, December.
    4. Ma, Qingyin & Toda, Alexis Akira, 2022. "Asymptotic linearity of consumption functions and computational efficiency," Journal of Mathematical Economics, Elsevier, vol. 98(C).
    5. Jaroslav Borovička & John Stachurski, 2020. "Necessary and Sufficient Conditions for Existence and Uniqueness of Recursive Utilities," Journal of Finance, American Finance Association, vol. 75(3), pages 1457-1493, June.
    6. Christensen, Timothy M., 2022. "Existence and uniqueness of recursive utilities without boundedness," Journal of Economic Theory, Elsevier, vol. 200(C).
    7. Timothy M. Christensen, 2020. "Existence and uniqueness of recursive utilities without boundedness," Papers 2008.00963, arXiv.org, revised Aug 2021.
    8. Guanlong Ren & John Stachurski, 2018. "Dynamic Programming with Recursive Preferences: Optimality and Applications," Papers 1812.05748, arXiv.org, revised Jun 2020.
    9. Nengjiu Ju & Jianjun Miao, 2012. "Ambiguity, Learning, and Asset Returns," Econometrica, Econometric Society, vol. 80(2), pages 559-591, March.
    10. Kikuchi, Tomoo & Nishimura, Kazuo & Stachurski, John & Zhang, Junnan, 2021. "Coase meets Bellman: Dynamic programming for production networks," Journal of Economic Theory, Elsevier, vol. 196(C).
    11. Wang, Chong & Wang, Neng & Yang, Jinqiang, 2016. "Optimal consumption and savings with stochastic income and recursive utility," Journal of Economic Theory, Elsevier, vol. 165(C), pages 292-331.
    12. Isoré, Marlène & Szczerbowicz, Urszula, 2017. "Disaster risk and preference shifts in a New Keynesian model," Journal of Economic Dynamics and Control, Elsevier, vol. 79(C), pages 97-125.
    13. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2022. "Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting," Journal of Economic Theory, Elsevier, vol. 204(C).
    14. Jing Guo & Xue Dong He, 2021. "Recursive Utility with Investment Gains and Losses: Existence, Uniqueness, and Convergence," Papers 2107.05163, arXiv.org.
    15. Stijn Claessens & M Ayhan Kose, 2018. "Frontiers of macrofinancial linkages," BIS Papers, Bank for International Settlements, number 95.
    16. Shenghao Zhu, 2020. "Existence Of Stationary Equilibrium In An Incomplete‐Market Model With Endogenous Labor Supply," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(3), pages 1115-1138, August.
    17. Orazio P. Attanasio & Guglielmo Weber, 2010. "Consumption and Saving: Models of Intertemporal Allocation and Their Implications for Public Policy," Journal of Economic Literature, American Economic Association, vol. 48(3), pages 693-751, September.
    18. Backus, David & Ferriere, Axelle & Zin, Stanley, 2015. "Risk and ambiguity in models of business cycles," Journal of Monetary Economics, Elsevier, vol. 69(C), pages 42-63.
    19. Svetlana Pashchenko & Ponpoje Porapakkarm, 2022. "Value of life and annuity demand," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 89(2), pages 371-396, June.
    20. Oliver de Groot & Alexander W. Richter & Nathaniel A. Throckmorton, 2022. "Valuation risk revalued," Quantitative Economics, Econometric Society, vol. 13(2), pages 723-759, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2401.10473. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.