IDEAS home Printed from https://ideas.repec.org/a/spr/mathme/v88y2018i2d10.1007_s00186-018-0633-5.html
   My bibliography  Save this article

Risk measurement and risk-averse control of partially observable discrete-time Markov systems

Author

Listed:
  • Jingnan Fan

    (Rutgers University)

  • Andrzej Ruszczyński

    (Rutgers University)

Abstract

We consider risk measurement in controlled partially observable Markov processes in discrete time. We introduce a new concept of conditional stochastic time consistency and we derive the structure of risk measures enjoying this property. We prove that they can be represented by a collection of static law invariant risk measures on the space of function of the observable part of the state. We also derive the corresponding dynamic programming equations. Finally we illustrate the results on a machine deterioration problem.

Suggested Citation

  • Jingnan Fan & Andrzej Ruszczyński, 2018. "Risk measurement and risk-averse control of partially observable discrete-time Markov systems," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 88(2), pages 161-184, October.
    • Handle: RePEc:spr:mathme:v:88:y:2018:i:2:d:10.1007_s00186-018-0633-5
    DOI: 10.1007/s00186-018-0633-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00186-018-0633-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00186-018-0633-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Riedel, Frank, 2004. "Dynamic coherent risk measures," Stochastic Processes and their Applications, Elsevier, vol. 112(2), pages 185-200, August.
    2. Chen, Zhiping & Li, Gang & Zhao, Yonggan, 2014. "Time-consistent investment policies in Markovian markets: A case of mean–variance analysis," Journal of Economic Dynamics and Control, Elsevier, vol. 40(C), pages 293-316.
    3. Jingnan Fan & Andrzej Ruszczynski, 2014. "Process-Based Risk Measures and Risk-Averse Control of Discrete-Time Systems," Papers 1411.2675, arXiv.org, revised Nov 2016.
    4. A. Jobert & L. C. G. Rogers, 2008. "Valuations And Dynamic Convex Risk Measures," Mathematical Finance, Wiley Blackwell, vol. 18(1), pages 1-22, January.
    5. Patrick Cheridito & Michael Kupper, 2011. "Composition Of Time-Consistent Dynamic Monetary Risk Measures In Discrete Time," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 14(01), pages 137-162.
    6. Runggaldier, Wolfgang J., 1998. "Concepts and methods for discrete and continuous time control under uncertainty," Insurance: Mathematics and Economics, Elsevier, vol. 22(1), pages 25-39, May.
    7. Mannor, Shie & Tsitsiklis, John N., 2013. "Algorithmic aspects of mean–variance optimization in Markov decision processes," European Journal of Operational Research, Elsevier, vol. 231(3), pages 645-653.
    8. Nicole Bäauerle & Ulrich Rieder, 2017. "Partially Observable Risk-Sensitive Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 42(4), pages 1180-1196, November.
    9. Ogryczak, Wlodzimierz & Ruszczynski, Andrzej, 1999. "From stochastic dominance to mean-risk models: Semideviations as risk measures," European Journal of Operational Research, Elsevier, vol. 116(1), pages 33-50, July.
    10. Susanne Klöppel & Martin Schweizer, 2007. "Dynamic Indifference Valuation Via Convex Risk Measures," Mathematical Finance, Wiley Blackwell, vol. 17(4), pages 599-627, October.
    11. Eugene A. Feinberg & Pavlo O. Kasyanov & Michael Z. Zgurovsky, 2016. "Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities," Mathematics of Operations Research, INFORMS, vol. 41(2), pages 656-681, May.
    12. Jerzy A. Filar & L. C. M. Kallenberg & Huey-Miin Lee, 1989. "Variance-Penalized Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 14(1), pages 147-161, February.
    13. Alessandro Arlotto & Noah Gans & J. Michael Steele, 2014. "Markov Decision Problems Where Means Bound Variances," Operations Research, INFORMS, vol. 62(4), pages 864-875, August.
    14. A. Jaśkiewicz & J. Matkowski & A. S. Nowak, 2013. "Persistently Optimal Policies in Stochastic Dynamic Programming with Generalized Discounting," Mathematics of Operations Research, INFORMS, vol. 38(1), pages 108-121, February.
    15. Berend Roorda & J. M. Schumacher & Jacob Engwerda, 2005. "Coherent Acceptability Measures In Multiperiod Models," Mathematical Finance, Wiley Blackwell, vol. 15(4), pages 589-612, October.
    16. Philippe Artzner & Freddy Delbaen & Jean-Marc Eber & David Heath & Hyejin Ku, 2007. "Coherent multiperiod risk adjusted values and Bellman’s principle," Annals of Operations Research, Springer, vol. 152(1), pages 5-22, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Randall Martyr & John Moriarty & Magnus Perninge, 2019. "Discrete-time risk-aware optimal switching with non-adapted costs," Papers 1910.04047, arXiv.org, revised Sep 2021.
    2. Tomasz R. Bielecki & Igor Cialenco & Andrzej Ruszczy'nski, 2022. "Risk Filtering and Risk-Averse Control of Markovian Systems Subject to Model Uncertainty," Papers 2206.09235, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jingnan Fan & Andrzej Ruszczynski, 2014. "Process-Based Risk Measures and Risk-Averse Control of Discrete-Time Systems," Papers 1411.2675, arXiv.org, revised Nov 2016.
    2. Acciaio, Beatrice & Föllmer, Hans & Penner, Irina, 2012. "Risk assessment for uncertain cash flows: model ambiguity, discounting ambiguity, and the role of bubbles," LSE Research Online Documents on Economics 50118, London School of Economics and Political Science, LSE Library.
    3. Zachary Feinstein & Birgit Rudloff, 2018. "Scalar multivariate risk measures with a single eligible asset," Papers 1807.10694, arXiv.org, revised Feb 2021.
    4. Karl-Theodor Eisele & Michael Kupper, 2016. "Asymptotically stable dynamic risk assessments," Post-Print hal-03548963, HAL.
    5. Engsner Hampus & Lindskog Filip, 2020. "Continuous-time limits of multi-period cost-of-capital margins," Statistics & Risk Modeling, De Gruyter, vol. 37(3-4), pages 79-106, July.
    6. Antoon Pelsser & Mitja Stadje, 2014. "Time-Consistent And Market-Consistent Evaluations," Mathematical Finance, Wiley Blackwell, vol. 24(1), pages 25-65, January.
    7. Zhiping Chen & Jia Liu & Gang Li & Zhe Yan, 2016. "Composite time-consistent multi-period risk measure and its application in optimal portfolio selection," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 515-540, October.
    8. Tomasz R. Bielecki & Igor Cialenco & Marcin Pitera, 2014. "A unified approach to time consistency of dynamic risk measures and dynamic performance measures in discrete time," Papers 1409.7028, arXiv.org, revised Sep 2017.
    9. Roorda Berend & Schumacher Hans, 2013. "Membership conditions for consistent families of monetary valuations," Statistics & Risk Modeling, De Gruyter, vol. 30(3), pages 255-280, August.
    10. Stadje, Mitja, 2010. "Extending dynamic convex risk measures from discrete time to continuous time: A convergence approach," Insurance: Mathematics and Economics, Elsevier, vol. 47(3), pages 391-404, December.
    11. Özlem Çavuş & Andrzej Ruszczyński, 2014. "Computational Methods for Risk-Averse Undiscounted Transient Markov Models," Operations Research, INFORMS, vol. 62(2), pages 401-417, April.
    12. D. Madan & M. Pistorius & M. Stadje, 2017. "On dynamic spectral risk measures, a limit theorem and optimal portfolio allocation," Finance and Stochastics, Springer, vol. 21(4), pages 1073-1102, October.
    13. Barigou, Karim & Chen, Ze & Dhaene, Jan, 2019. "Fair dynamic valuation of insurance liabilities: Merging actuarial judgement with market- and time-consistency," Insurance: Mathematics and Economics, Elsevier, vol. 88(C), pages 19-29.
    14. Martijn Pistorius & Mitja Stadje, 2016. "On Dynamic Deviation Measures and Continuous-Time Portfolio Optimisation," Papers 1604.08037, arXiv.org.
    15. Marlon Moresco & M'elina Mailhot & Silvana M. Pesenti, 2023. "Uncertainty Propagation and Dynamic Robust Risk Measures," Papers 2308.12856, arXiv.org, revised Feb 2024.
    16. Ji, Ronglin & Shi, Xuejun & Wang, Shijie & Zhou, Jinming, 2019. "Dynamic risk measures for processes via backward stochastic differential equations," Insurance: Mathematics and Economics, Elsevier, vol. 86(C), pages 43-50.
    17. Yanhong Chen & Zachary Feinstein, 2022. "Set-valued dynamic risk measures for processes and for vectors," Finance and Stochastics, Springer, vol. 26(3), pages 505-533, July.
    18. Qinyu Wu & Fan Yang & Ping Zhang, 2023. "Conditional generalized quantiles based on expected utility model and equivalent characterization of properties," Papers 2301.12420, arXiv.org.
    19. Elisa Mastrogiacomo & Emanuela Rosazza Gianin, 2019. "Time-consistency of risk measures: how strong is such a property?," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 42(1), pages 287-317, June.
    20. Chen, Zhiping & Li, Gang & Zhao, Yonggan, 2014. "Time-consistent investment policies in Markovian markets: A case of mean–variance analysis," Journal of Economic Dynamics and Control, Elsevier, vol. 40(C), pages 293-316.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:mathme:v:88:y:2018:i:2:d:10.1007_s00186-018-0633-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.