IDEAS home Printed from https://ideas.repec.org/a/spr/finsto/v21y2017i2d10.1007_s00780-017-0327-5.html
   My bibliography  Save this article

On time-inconsistent stochastic control in continuous time

Author

Listed:
  • Tomas Björk

    (Stockholm School of Economics)

  • Mariana Khapko

    (University of Toronto)

  • Agatha Murgoci

    (Aarhus University)

Abstract

In this paper, which is a continuation of the discrete-time paper (Björk and Murgoci in Finance Stoch. 18:545–592, 2004), we study a class of continuous-time stochastic control problems which, in various ways, are time-inconsistent in the sense that they do not admit a Bellman optimality principle. We study these problems within a game-theoretic framework, and we look for Nash subgame perfect equilibrium points. For a general controlled continuous-time Markov process and a fairly general objective functional, we derive an extension of the standard Hamilton–Jacobi–Bellman equation, in the form of a system of nonlinear equations, for the determination of the equilibrium strategy as well as the equilibrium value function. The main theoretical result is a verification theorem. As an application of the general theory, we study a time-inconsistent linear-quadratic regulator. We also present a study of time-inconsistency within the framework of a general equilibrium production economy of Cox–Ingersoll–Ross type (Cox et al. in Econometrica 53:363–384, 1985).

Suggested Citation

  • Tomas Björk & Mariana Khapko & Agatha Murgoci, 2017. "On time-inconsistent stochastic control in continuous time," Finance and Stochastics, Springer, vol. 21(2), pages 331-360, April.
    • Handle: RePEc:spr:finsto:v:21:y:2017:i:2:d:10.1007_s00780-017-0327-5
    DOI: 10.1007/s00780-017-0327-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00780-017-0327-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00780-017-0327-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Per Krusell & Anthony A. Smith, Jr., 2003. "Consumption--Savings Decisions with Quasi--Geometric Discounting," Econometrica, Econometric Society, vol. 71(1), pages 365-375, January.
    2. R. A. Pollak, 1968. "Consistent Planning," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 35(2), pages 201-208.
    3. Pirvu, Traian A. & Zhang, Huayue, 2014. "Investment–consumption with regime-switching discount rates," Mathematical Social Sciences, Elsevier, vol. 71(C), pages 142-150.
    4. R. H. Strotz, 1955. "Myopia and Inconsistency in Dynamic Utility Maximization," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 23(3), pages 165-180.
    5. Tomas Björk & Agatha Murgoci, 2014. "A theory of Markovian time-inconsistent stochastic control in discrete time," Finance and Stochastics, Springer, vol. 18(3), pages 545-592, July.
    6. Bezalel Peleg & Menahem E. Yaari, 1973. "On the Existence of a Consistent Course of Action when Tastes are Changing," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 40(3), pages 391-401.
    7. Erzo G. J. Luttmer & Thomas Mariotti, 2003. "Subjective Discounting in an Exchange Economy," Journal of Political Economy, University of Chicago Press, vol. 111(5), pages 959-989, October.
    8. Harris, Christopher & Laibson, David, 2001. "Dynamic Choices of Hyperbolic Consumers," Econometrica, Econometric Society, vol. 69(4), pages 935-957, July.
    9. Suleyman Basak & Georgy Chabakauri, 2010. "Dynamic Mean-Variance Asset Allocation," The Review of Financial Studies, Society for Financial Studies, vol. 23(8), pages 2970-3016, August.
    10. Steven M. Goldman, 1980. "Consistent Plans," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(3), pages 533-537.
    11. Christopher Harris & David Laibson, 2013. "Instantaneous Gratification," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 205-248.
    12. Nicolas Vieille & Jörgen Weibull, 2009. "Multiple solutions under quasi-exponential discounting," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 39(3), pages 513-526, June.
    13. Cox, John C & Ingersoll, Jonathan E, Jr & Ross, Stephen A, 1985. "An Intertemporal General Equilibrium Model of Asset Prices," Econometrica, Econometric Society, vol. 53(2), pages 363-384, March.
    14. Marín-Solano, Jesús & Navas, Jorge, 2010. "Consumption and portfolio rules for time-inconsistent investors," European Journal of Operational Research, Elsevier, vol. 201(3), pages 860-872, March.
    15. Robert J. Barro, 1999. "Ramsey Meets Laibson in the Neoclassical Growth Model," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(4), pages 1125-1152.
    16. Christoph Czichowsky, 2013. "Time-consistent mean-variance portfolio selection in discrete and continuous time," Finance and Stochastics, Springer, vol. 17(2), pages 227-271, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tomas Björk & Agatha Murgoci, 2014. "A theory of Markovian time-inconsistent stochastic control in discrete time," Finance and Stochastics, Springer, vol. 18(3), pages 545-592, July.
    2. Xue Dong He & Xun Yu Zhou, 2021. "Who Are I: Time Inconsistency and Intrapersonal Conflict and Reconciliation," Papers 2105.01829, arXiv.org.
    3. Tyson, Christopher J., 2008. "Management of a capital stock by Strotz's naive planner," Journal of Economic Dynamics and Control, Elsevier, vol. 32(7), pages 2214-2239, July.
    4. Takeo Hori & Koichi Futagami, 2019. "A Non‐unitary Discount Rate Model," Economica, London School of Economics and Political Science, vol. 86(341), pages 139-165, January.
    5. Li, Yongwu & Qiao, Han & Wang, Shouyang & Zhang, Ling, 2015. "Time-consistent investment strategy under partial information," Insurance: Mathematics and Economics, Elsevier, vol. 65(C), pages 187-197.
    6. Mariana Khapko, 2023. "Asset pricing with dynamically inconsistent agents," Finance and Stochastics, Springer, vol. 27(4), pages 1017-1046, October.
    7. Camilo Hern'andez & Dylan Possamai, 2020. "Me, myself and I: a general theory of non-Markovian time-inconsistent stochastic control for sophisticated agents," Papers 2002.12572, arXiv.org, revised Jul 2021.
    8. Li, Yongwu & Li, Zhongfei, 2013. "Optimal time-consistent investment and reinsurance strategies for mean–variance insurers with state dependent risk aversion," Insurance: Mathematics and Economics, Elsevier, vol. 53(1), pages 86-97.
    9. Zhao, Qian & Shen, Yang & Wei, Jiaqin, 2014. "Consumption–investment strategies with non-exponential discounting and logarithmic utility," European Journal of Operational Research, Elsevier, vol. 238(3), pages 824-835.
    10. Liya Liu & Yingjie Niu & Yuanping Wang & Jinqiang Yang, 2020. "Optimal consumption with time-inconsistent preferences," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 70(3), pages 785-815, October.
    11. Alain Bensoussan & Kwok Chuen Wong & Sheung Chi Phillip Yam, 2019. "A paradox in time-consistency in the mean–variance problem?," Finance and Stochastics, Springer, vol. 23(1), pages 173-207, January.
    12. Tomas Björk & Agatha Murgoci & Xun Yu Zhou, 2014. "Mean–Variance Portfolio Optimization With State-Dependent Risk Aversion," Mathematical Finance, Wiley Blackwell, vol. 24(1), pages 1-24, January.
    13. Anna Jaśkiewicz & Andrzej S. Nowak, 2021. "Markov decision processes with quasi-hyperbolic discounting," Finance and Stochastics, Springer, vol. 25(2), pages 189-229, April.
    14. Fahrenwaldt, Matthias Albrecht & Jensen, Ninna Reitzel & Steffensen, Mogens, 2020. "Nonrecursive separation of risk and time preferences," Journal of Mathematical Economics, Elsevier, vol. 90(C), pages 95-108.
    15. Tommaso Gabrieli & Sayantan Ghosal, 2013. "Non-existence of competitive equilibria with dynamically inconsistent preferences," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 52(1), pages 299-313, January.
    16. Ivar Ekeland & Traian A. Pirvu, 2007. "Investment and Consumption without Commitment," Papers 0708.0588, arXiv.org.
    17. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    18. Nicolas Vieille & Jörgen Weibull, 2009. "Multiple solutions under quasi-exponential discounting," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 39(3), pages 513-526, June.
    19. Tyson, Christopher J., 2008. "Management of a capital stock by Strotz's naive planner," Journal of Economic Dynamics and Control, Elsevier, vol. 32(7), pages 2214-2239, July.
    20. Takeshi Ojima, 2018. "General Equilibrium Dynamics with Naïve and Sophisticated Hyperbolic Consumers in an Overlapping Generations Economy," Economica, London School of Economics and Political Science, vol. 85(338), pages 281-304, April.

    More about this item

    Keywords

    Time-consistency; Time-inconsistency; Time-inconsistent control; Dynamic programming; Stochastic control; Bellman equation; Hyperbolic discounting; Mean-variance; Equilibrium;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • D5 - Microeconomics - - General Equilibrium and Disequilibrium
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:finsto:v:21:y:2017:i:2:d:10.1007_s00780-017-0327-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.