IDEAS home Printed from https://ideas.repec.org/p/cmu/gsiawp/1772106779.html
   My bibliography  Save this paper

On the Dual Approach to Recursive Optimization

Author

Listed:
  • Matthias Messner
  • Nicola Pavoni
  • Sleet Christopher

Abstract

We bring together the theories of duality and dynamic programming. We show that the dual of an additively separable dynamic optimization problem can be recursively decomposed using summaries of past Lagrange multipliers as state variables. Analogous to the Bellman decomposition of the primal problem, we prove equality of values and solution sets for recursive and sequential dual problems. In non-additively separable settings, the equivalence of the recursive and sequential dual is not guaranteed. We relate recursive dual and recursive primal problems. If the Lagrangian associated with a constrained optimization problem admits a saddle then, even in non-additively separable settings, the values of the recursive dual and recursive primal problems are equal. Additionally, the recursive dual method delivers necessary conditions for a primal optimum. If the problem is strictly concave, the recursive dual method delivers necessary and sufficient conditions for a primal optimum. When a saddle exists, states on the optimal dual path are subdifferentials of the primal value function evaluated at states on the optimal primal path and vice versa.

Suggested Citation

  • Matthias Messner & Nicola Pavoni & Sleet Christopher, 2011. "On the Dual Approach to Recursive Optimization," GSIA Working Papers 2012-E8, Carnegie Mellon University, Tepper School of Business.
  • Handle: RePEc:cmu:gsiawp:1772106779
    as

    Download full text from publisher

    File URL: https://student-3k.tepper.cmu.edu/gsiadoc/WP/2012-E8.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Matthias Messner & Nicola Pavoni & Christopher Sleet, 2012. "Recursive Methods for Incentive Problems," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 501-525, October.
    2. Albert Marcet & Ramon Marimon, 2019. "Recursive Contracts," Econometrica, Econometric Society, vol. 87(5), pages 1589-1631, September.
    3. Yili Chien & Harold Cole & Hanno Lustig, 2011. "A Multiplier Approach to Understanding the Macro Implications of Household Finance," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(1), pages 199-234.
    4. Harold Cole & Felix Kubler, 2012. "Recursive Contracts, Lotteries and Weakly Concave Pareto Sets," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 479-500, October.
    5. Daron Acemoglu & Mikhail Golosov & Aleh Tsyvinski, 2010. "Dynamic Mirrlees Taxation under Political Economy Constraints," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(3), pages 841-881.
    6. Matthias Messner & Nicola Pavoni, 2004. "On the Recursive Saddle Point Method," Working Papers 255, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    7. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "On the Dual Approach to Recursive Optimization," GSIA Working Papers 2012-E12, Carnegie Mellon University, Tepper School of Business.
    8. Ramon Marimon & Vincenzo Quadrini, 2005. "Competition, innovation and growth with limited commitment," Economics Working Papers 933, Department of Economics and Business, Universitat Pompeu Fabra.
    9. Mele, Antonio, 2014. "Repeated moral hazard and recursive Lagrangeans," Journal of Economic Dynamics and Control, Elsevier, vol. 42(C), pages 69-85.
    10. Kydland, Finn E. & Prescott, Edward C., 1980. "Dynamic optimal taxation, rational expectations and optimal control," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 79-91, May.
    11. S. Rao Aiyagari & Albert Marcet & Thomas J. Sargent & Juha Seppala, 2002. "Optimal Taxation without State-Contingent Debt," Journal of Political Economy, University of Chicago Press, vol. 110(6), pages 1220-1254, December.
    12. Patrick J. Kehoe & Fabrizio Perri, 2002. "International Business Cycles with Endogenous Incomplete Markets," Econometrica, Econometric Society, vol. 70(3), pages 907-928, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matthias Messner & Nicola Pavoni & Christopher Sleet, 2012. "Recursive Methods for Incentive Problems," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 501-525, October.
    2. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "Recursive Methods for Dynamic Incentive Problems," GSIA Working Papers 2012-E13, Carnegie Mellon University, Tepper School of Business.
    3. Nicola Pavoni & Christopher Sleet & Matthias Messner, 2018. "The Dual Approach to Recursive Optimization: Theory and Examples," Econometrica, Econometric Society, vol. 86(1), pages 133-172, January.
    4. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "On the Dual Approach to Recursive Optimization," GSIA Working Papers 2012-E12, Carnegie Mellon University, Tepper School of Business.
    5. Miao, Jianjun & Zhang, Yuzhe, 2015. "A duality approach to continuous-time contracting problems with limited commitment," Journal of Economic Theory, Elsevier, vol. 159(PB), pages 929-988.
    6. David Martimort & Aggey Semenov & Lars Stole, 2017. "A Theory of Contracts with Limited Enforcement," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(2), pages 816-852.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicola Pavoni & Christopher Sleet & Matthias Messner, 2018. "The Dual Approach to Recursive Optimization: Theory and Examples," Econometrica, Econometric Society, vol. 86(1), pages 133-172, January.
    2. Albert Marcet & Ramon Marimon, 2019. "Recursive Contracts," Econometrica, Econometric Society, vol. 87(5), pages 1589-1631, September.
    3. Marimon, Ramon & Werner, Jan, 2021. "The envelope theorem, Euler and Bellman equations, without differentiability," Journal of Economic Theory, Elsevier, vol. 196(C).
    4. Miao, Jianjun & Zhang, Yuzhe, 2015. "A duality approach to continuous-time contracting problems with limited commitment," Journal of Economic Theory, Elsevier, vol. 159(PB), pages 929-988.
    5. Matthias Messner & Nicola Pavoni & Christopher Sleet, "undated". "Contractive Dual Methods for Incentive Problems," GSIA Working Papers 2012-E26, Carnegie Mellon University, Tepper School of Business.
    6. Harold Cole & Felix Kubler, 2012. "Recursive Contracts, Lotteries and Weakly Concave Pareto Sets," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 479-500, October.
    7. YiLi Chien & Harold L. Cole & Hanno Lustig, 2014. "Implications of heterogeneity in preferences, beliefs and asset trading technologies for the macroeconomy," Working Papers 2014-14, Federal Reserve Bank of St. Louis.
    8. Golosov, M. & Tsyvinski, A. & Werquin, N., 2016. "Recursive Contracts and Endogenously Incomplete Markets," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 725-841, Elsevier.
    9. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "Recursive Methods for Dynamic Incentive Problems," GSIA Working Papers 2012-E13, Carnegie Mellon University, Tepper School of Business.
    10. Yili Chien & Harold Cole & Hanno Lustig, 2016. "Implications of Heterogeneity in Preferences, Beliefs and Asset Trading Technologies in an Endowment Economy," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 20, pages 215-239, April.
    11. Matthias Messner & Nicola Pavoni & Christopher Sleet, 2012. "Recursive Methods for Incentive Problems," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 501-525, October.
    12. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    13. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2015. "Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(1), pages 83-112, February.
    14. Karantounias, Anastasios G., 2023. "Doubts about the model and optimal policy," Journal of Economic Theory, Elsevier, vol. 210(C).
    15. Ester Faia & Tommaso Monacelli, 2003. "Ramsey monetary policy and international relative prices," Proceedings, Board of Governors of the Federal Reserve System (U.S.).
    16. Gorostiaga, Arantza, 2003. "Should fiscal policy be different in a non-competitive framework?," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1311-1331, September.
    17. François Le Grand & Xavier Ragot, 2022. "Managing Inequality Over Business Cycles: Optimal Policies With Heterogeneous Agents And Aggregate Shocks," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(1), pages 511-540, February.
    18. Anastasios G. Karantounias, 2009. "Ramsey Taxation and fear of misspecification," 2009 Meeting Papers 822, Society for Economic Dynamics.
    19. Matthias Messner & Nicola Pavoni, 2004. "On the Recursive Saddle Point Method," Working Papers 255, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    20. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cmu:gsiawp:1772106779. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Steve Spear (email available below). General contact details of provider: https://www.cmu.edu/tepper .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.