Lipschitz Continuity of Value Functions in Markovian Decision Processes
AbstractWe present tools and guidelines for investigating Lipschitz continuity of the value functions in MDP’s, using the Hausdorff metric and the Kantorovich metric for measuring the influence of the constraint set and the transition law, respectively. The methods are explained by examples. Additional topics include an application to the the discretization algorithm of Bertsekas (1975). Copyright Springer-Verlag Berlin Heidelberg 2005
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Springer in its journal Mathematical Methods of Operations Research.
Volume (Year): 62 (2005)
Issue (Month): 1 (09)
Contact details of provider:
Web page: http://www.springerlink.com/link.asp?id=120306
Find related papers by JEL classification:
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Flavio Toxvaerd & Chryssi Giannitsarou, 2004.
"Recursive global games,"
Money Macro and Finance (MMF) Research Group Conference 2003
104, Money Macro and Finance Research Group.
- Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Guenther Eichhorn) or (Christopher F Baum).
If references are entirely missing, you can add them using this form.