IDEAS home Printed from https://ideas.repec.org/p/wpa/wuwpco/9710001.html
   My bibliography  Save this paper

An Approximated Solution to Continuous-Time Stochastic Optimal Control Problems Through Markov Decision Chains

Author

Listed:
  • Jacek B. Krawczyk

    (Victoria University of Wellington)

  • Alistair Windsor

    (Victoria University of Wellington)

Abstract

Strategies for constructing a Markov decision chain approximating a continuous-time finite-horizon optimal control problem are investigated. Some simple, analytically soluble, examples are treated and low computational complexity is reported. Extensions to the method and implementation are discussed. In particular, relevance of the approximated solution to a stochastic renewable resource valuation problem is examined.

Suggested Citation

  • Jacek B. Krawczyk & Alistair Windsor, 1997. "An Approximated Solution to Continuous-Time Stochastic Optimal Control Problems Through Markov Decision Chains," Computational Economics 9710001, University Library of Munich, Germany.
    • Handle: RePEc:wpa:wuwpco:9710001
    Note: Type of Document - LaTeX; prepared on UNIX; to print on PostScript; pages: 38 ; figures: included
    as

    Download full text from publisher

    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/comp/papers/9710/9710001.ps.gz
    Download Restriction: no
    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/comp/papers/9710/9710001.pdf
    Download Restriction: no
    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/comp/papers/9710/9710001.zip
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Azzato, Jeffrey & Krawczyk, Jacek, 2006. "SOCSol4L An improved MATLAB package for approximating the solution to a continuous-time stochastic optimal control problem," MPRA Paper 1179, University Library of Munich, Germany.
    2. Azzato, Jeffrey & Krawczyk, Jacek B & Sissons, Christopher, 2011. "On loss-avoiding lump-sum pension optimization with contingent targets," Working Paper Series 18552, Victoria University of Wellington, School of Economics and Finance.
    3. Marco Guerrazzi & Pier Giuseppe Giribone, 2022. "The dynamics of working hours and wages under implicit contracts," Bulletin of Economic Research, Wiley Blackwell, vol. 74(4), pages 1075-1094, October.
    4. Jacek B. Krawczyk, 2000. "A Markovian Approximated Solution To A Portfolio Management Problem," Computing in Economics and Finance 2000 233, Society for Computational Economics.
    5. Azzato, Jeffrey & Krawczyk, Jacek B & Sissons, Christopher, 2011. "On loss-avoiding lump-sum pension optimization with contingent targets," Working Paper Series 1532, Victoria University of Wellington, School of Economics and Finance.

    More about this item

    Keywords

    Approximating Markov decision chains; simple noise discretisation. Natural resource valuation.;

    JEL classification:

    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • D92 - Microeconomics - - Micro-Based Behavioral Economics - - - Intertemporal Firm Choice, Investment, Capacity, and Financing
    • Q25 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Renewable Resources and Conservation - - - Water

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpco:9710001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: EconWPA (email available below). General contact details of provider: https://econwpa.ub.uni-muenchen.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.