IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2002.12572.html
   My bibliography  Save this paper

Me, myself and I: a general theory of non-Markovian time-inconsistent stochastic control for sophisticated agents

Author

Listed:
  • Camilo Hern'andez
  • Dylan Possamai

Abstract

We develop a theory for continuous-time non-Markovian stochastic control problems which are inherently time-inconsistent. Their distinguishing feature is that the classical Bellman optimality principle no longer holds. Our formulation is cast within the framework of a controlled non-Markovian forward stochastic differential equation, and a general objective functional setting. We adopt a game-theoretic approach to study such problems, meaning that we seek for sub-game perfect Nash equilibrium points. As a first novelty of this work, we introduce and motivate a refinement of the definition of equilibrium that allows us to establish a direct and rigorous proof of an extended dynamic programming principle, in the same spirit as in the classical theory. This in turn allows us to introduce a system consisting of an infinite family of backward stochastic differential equations analogous to the classical HJB equation. We prove that this system is fundamental, in the sense that its well-posedness is both necessary and sufficient to characterise the value function and equilibria. As a final step we provide an existence and uniqueness result. Some examples and extensions of our results are also presented.

Suggested Citation

  • Camilo Hern'andez & Dylan Possamai, 2020. "Me, myself and I: a general theory of non-Markovian time-inconsistent stochastic control for sophisticated agents," Papers 2002.12572, arXiv.org, revised Jul 2021.
  • Handle: RePEc:arx:papers:2002.12572
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2002.12572
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jakša Cvitanić & Dylan Possamaï & Nizar Touzi, 2018. "Dynamic programming approach to principal–agent problems," Finance and Stochastics, Springer, vol. 22(1), pages 1-37, January.
    2. Mehra, Rajnish & Prescott, Edward C., 1985. "The equity premium: A puzzle," Journal of Monetary Economics, Elsevier, vol. 15(2), pages 145-161, March.
    3. Kfir Eliaz & Ran Spiegler, 2006. "Contracting with Diversely Naive Agents," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(3), pages 689-714.
    4. Yu‐Jui Huang & Adrien Nguyen‐Huu & Xun Yu Zhou, 2020. "General stopping behaviors of naïve and noncommitted sophisticated agents, with application to probability distortion," Mathematical Finance, Wiley Blackwell, vol. 30(1), pages 310-340, January.
    5. Ying Hu & Hanqing Jin & Xun Yu Zhou, 2012. "Time-Inconsistent Stochastic Linear--Quadratic Control," Post-Print hal-00691816, HAL.
    6. Matthew Rabin & Ted O'Donoghue, 1999. "Doing It Now or Later," American Economic Review, American Economic Association, vol. 89(1), pages 103-124, March.
    7. David K. Levine & Drew Fudenberg, 2006. "A Dual-Self Model of Impulse Control," American Economic Review, American Economic Association, vol. 96(5), pages 1449-1476, December.
    8. Marín-Solano, Jesús & Navas, Jorge, 2010. "Consumption and portfolio rules for time-inconsistent investors," European Journal of Operational Research, Elsevier, vol. 201(3), pages 860-872, March.
    9. R. H. Strotz, 1955. "Myopia and Inconsistency in Dynamic Utility Maximization," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 23(3), pages 165-180.
    10. Xue Dong He & Moris S. Strub & Thaleia Zariphopoulou, 2019. "Forward Rank-Dependent Performance Criteria: Time-Consistent Investment Under Probability Distortion," Papers 1904.01745, arXiv.org.
    11. Faruk Gul & Wolfgang Pesendorfer, 2001. "Temptation and Self-Control," Econometrica, Econometric Society, vol. 69(6), pages 1403-1435, November.
    12. Yu-Jui Huang & Adrien Nguyen-Huu & Xun Yu Zhou, 2018. "General stopping behaviors of naïve and non-committed sophisticated agents, with application to probability distortion," CEE-M Working Papers 18-16, CEE-M, Universitiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
    13. Marcel Nutz & Ramon van Handel, 2012. "Constructing Sublinear Expectations on Path Space," Papers 1205.2415, arXiv.org, revised Apr 2013.
    14. Nicolas Vieille & Jörgen Weibull, 2009. "Multiple solutions under quasi-exponential discounting," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 39(3), pages 513-526, June.
    15. Karandikar, Rajeeva L., 1995. "On pathwise stochastic integration," Stochastic Processes and their Applications, Elsevier, vol. 57(1), pages 11-18, May.
    16. Harris, Christopher & Laibson, David, 2001. "Dynamic Choices of Hyperbolic Consumers," Econometrica, Econometric Society, vol. 69(4), pages 935-957, July.
    17. Martin J. Osborne & Ariel Rubinstein, 1994. "A Course in Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262650401, December.
    18. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    19. Suleyman Basak & Georgy Chabakauri, 2010. "Dynamic Mean-Variance Asset Allocation," The Review of Financial Studies, Society for Financial Studies, vol. 23(8), pages 2970-3016, August.
    20. Milton Friedman & L. J. Savage, 1948. "The Utility Analysis of Choices Involving Risk," Journal of Political Economy, University of Chicago Press, vol. 56(4), pages 279-279.
    21. Nutz, Marcel & van Handel, Ramon, 2013. "Constructing sublinear expectations on path space," Stochastic Processes and their Applications, Elsevier, vol. 123(8), pages 3100-3121.
    22. Xing, Hao & Žitković, Gordan, 2018. "A class of globally solvable Markovian quadratic BSDE systems and applications," LSE Research Online Documents on Economics 73440, London School of Economics and Political Science, LSE Library.
    23. Ying Hu & Hanqing Jin & Xun Yu Zhou, 2017. "Time-Inconsistent Stochastic Linear--Quadratic Control: Characterization and Uniqueness of Equilibrium," Post-Print hal-01139343, HAL.
    24. Robert J. Barro, 1999. "Ramsey Meets Laibson in the Neoclassical Growth Model," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(4), pages 1125-1152.
    25. Tomas Björk & Mariana Khapko & Agatha Murgoci, 2017. "On time-inconsistent stochastic control in continuous time," Finance and Stochastics, Springer, vol. 21(2), pages 331-360, April.
    26. Brutscher, P., 2011. "Payment Matters? - An Exploratory Study into the Pre-Payment Electricity Metering," Cambridge Working Papers in Economics 1124, Faculty of Economics, University of Cambridge.
    27. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    28. Matthew Rabin, 1998. "Psychology and Economics," Journal of Economic Literature, American Economic Association, vol. 36(1), pages 11-46, March.
    29. Paul A. Samuelson, 1937. "A Note on Measurement of Utility," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 4(2), pages 155-161.
    30. E. S. Phelps & R. A. Pollak, 1968. "On Second-Best National Saving and Game-Equilibrium Growth," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 35(2), pages 185-199.
    31. Ted O'Donoghue & Matthew Rabin, 1999. "Incentives for Procrastinators," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 769-816.
    32. Christoph Czichowsky, 2013. "Time-consistent mean-variance portfolio selection in discrete and continuous time," Finance and Stochastics, Springer, vol. 17(2), pages 227-271, April.
    33. Philipp-Bastian Brutscher, 2011. "Payment Matters? – An Exploratory Study into Pre-Payment Electricity Metering," Working Papers EPRG 1108, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    34. Antonis Papapantoleon & Dylan Possamai & Alexandros Saplaouras, 2016. "Existence and uniqueness results for BSDEs with jumps: the whole nine yards," Papers 1607.04214, arXiv.org, revised Nov 2018.
    35. Daniel Ellsberg, 1961. "Risk, Ambiguity, and the Savage Axioms," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 75(4), pages 643-669.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zongxia Liang & Fengyi Yuan, 2021. "Weak equilibria for time-inconsistent control: with applications to investment-withdrawal decisions," Papers 2105.06607, arXiv.org, revised Jun 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Camilo Hern'andez & Dylan Possamai, 2023. "Time-inconsistent contract theory," Papers 2303.01601, arXiv.org.
    2. Xue Dong He & Xun Yu Zhou, 2021. "Who Are I: Time Inconsistency and Intrapersonal Conflict and Reconciliation," Papers 2105.01829, arXiv.org.
    3. Méder, Zsombor Z. & Flesch, János & Peeters, Ronald, 2017. "Naiveté and sophistication in dynamic inconsistency," Mathematical Social Sciences, Elsevier, vol. 87(C), pages 40-54.
    4. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    5. Tyson, Christopher J., 2008. "Management of a capital stock by Strotz's naive planner," Journal of Economic Dynamics and Control, Elsevier, vol. 32(7), pages 2214-2239, July.
    6. Eduard Marinov, 2017. "The 2017 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 117-159.
    7. Committee, Nobel Prize, 2017. "Richard H. Thaler: Integrating Economics with Psychology," Nobel Prize in Economics documents 2017-1, Nobel Prize Committee.
    8. Laureti, Carolina & Szafarz, Ariane, 2023. "Banking regulation and costless commitment contracts for time-inconsistent agents," Economic Modelling, Elsevier, vol. 129(C).
    9. Marcel Nutz & Yuchong Zhang, 2019. "Conditional Optimal Stopping: A Time-Inconsistent Optimization," Papers 1901.05802, arXiv.org, revised Oct 2019.
    10. Salanie, Francois & Treich, Nicolas, 2006. "Over-savings and hyperbolic discounting," European Economic Review, Elsevier, vol. 50(6), pages 1557-1570, August.
    11. Zhao, Qian & Shen, Yang & Wei, Jiaqin, 2014. "Consumption–investment strategies with non-exponential discounting and logarithmic utility," European Journal of Operational Research, Elsevier, vol. 238(3), pages 824-835.
    12. Cherchye, Laurens & De Rock, Bram & Griffith, Rachel & O’Connell, Martin & Smith, Kate & Vermeulen, Frederic, 2020. "A new year, a new you? Within-individual variation in food purchases," European Economic Review, Elsevier, vol. 127(C).
    13. Ubfal, Diego, 2016. "How general are time preferences? Eliciting good-specific discount rates," Journal of Development Economics, Elsevier, vol. 118(C), pages 150-170.
    14. Liya Liu & Yingjie Niu & Yuanping Wang & Jinqiang Yang, 2020. "Optimal consumption with time-inconsistent preferences," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 70(3), pages 785-815, October.
    15. Cobb-Clark, Deborah A. & Dahmann, Sarah C. & Kamhöfer, Daniel A. & Schildberg-Hörisch, Hannah, 2022. "The Predictive Power of Self-Control for Life Outcomes," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 725-744.
    16. Xavier Giné & Dean Karlan & Jonathan Zinman, 2010. "Put Your Money Where Your Butt Is: A Commitment Contract for Smoking Cessation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(4), pages 213-235, October.
    17. Teck H. Ho & Noah Lim & Colin Camerer, 2005. "Modeling the Psychology of Consumer and Firm Behavior with Behavioral Economics," Levine's Bibliography 784828000000000476, UCLA Department of Economics.
    18. Alessandro Bucciol, 2007. "Life-Cycle Models, Economic Puzzles and Temptation Preferences," Giornale degli Economisti, GDE (Giornale degli Economisti e Annali di Economia), Bocconi University, vol. 66(1), pages 115-144, March.
    19. Alexander K. Koch & Julia Nafziger, 2011. "Self‐regulation through Goal Setting," Scandinavian Journal of Economics, Wiley Blackwell, vol. 113(1), pages 212-227, March.
    20. Bisin, Alberto & Hyndman, Kyle, 2020. "Present-bias, procrastination and deadlines in a field experiment," Games and Economic Behavior, Elsevier, vol. 119(C), pages 339-357.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2002.12572. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.