IDEAS home Printed from
   My bibliography  Save this paper

InfSOCSol2 An updated MATLAB Package for Approximating the Solution to a Continuous-Time Infinite Horizon Stochastic Optimal Control Problem with Control and State Constraints


  • Azzato, Jeffrey D.
  • Krawczyk, Jacek B.


This paper is a successor of [AK08]. Both papers describe the same suite of MATLAB R° routines devised to provide an approximately optimal solution to an infinite horizon stochastic optimal control problem. The difference is that this paper explains how to allow for state and control constraints. The suite routines implement a policy improvement algorithm to optimise a Markov decision chain approximating the original control problem, as described in [Kra01c] and [Kra01b].

Suggested Citation

  • Azzato, Jeffrey D. & Krawczyk, Jacek B., 2009. "InfSOCSol2 An updated MATLAB Package for Approximating the Solution to a Continuous-Time Infinite Horizon Stochastic Optimal Control Problem with Control and State Constraints," MPRA Paper 17027, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:17027

    Download full text from publisher

    File URL:
    File Function: original version
    Download Restriction: no

    References listed on IDEAS

    1. Brown, Gordon D. A. & Gardner, Jonathan & Oswald, Andrew J. & Qian, Jing, 2005. "Does Wage Rank Affect Employees' Wellbeing?," IZA Discussion Papers 1505, Institute for the Study of Labor (IZA).
    2. Claudia Senik, 2008. "Ambition and Jealousy: Income Interactions in the 'Old' Europe versus the 'New' Europe and the United States," Economica, London School of Economics and Political Science, vol. 75(299), pages 495-513, August.
    3. Stutzer, Alois, 2004. "The role of income aspirations in individual happiness," Journal of Economic Behavior & Organization, Elsevier, vol. 54(1), pages 89-109, May.
    4. Terasvirta, T & Anderson, H M, 1992. "Characterizing Nonlinearities in Business Cycles Using Smooth Transition Autoregressive Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(S), pages 119-136, Suppl. De.
    5. Andrew E. Clark & Ed Diener & Yannis Georgellis & Richard E. Lucas, 2008. "Lags And Leads in Life Satisfaction: a Test of the Baseline Hypothesis," Economic Journal, Royal Economic Society, vol. 118(529), pages 222-243, June.
    6. Hirschman, Albert O., 1973. "The changing tolerance for income inequality in the course of economic development," World Development, Elsevier, vol. 1(12), pages 29-36, December.
    7. Clark, Andrew E. & Oswald, Andrew J., 1996. "Satisfaction and comparison income," Journal of Public Economics, Elsevier, vol. 61(3), pages 359-381, September.
    8. John A. Rizzo & Richard J. Zeckhauser, 2003. "Reference Incomes, Loss Aversion, and Physician Behavior," The Review of Economics and Statistics, MIT Press, vol. 85(4), pages 909-922, November.
    9. Easterlin, Richard A., 2005. "A puzzle for adaptive theory," Journal of Economic Behavior & Organization, Elsevier, vol. 56(4), pages 513-521, April.
    10. Lawrence F. Katz & Alan B. Krueger, 1991. "Changes in the Structure of Wages in the Public and Private Sectors," Working Papers 662, Princeton University, Department of Economics, Industrial Relations Section..
    11. Fiegenbaum, Avi, 1990. "Prospect theory and the risk-return association : An empirical examination in 85 industries," Journal of Economic Behavior & Organization, Elsevier, vol. 14(2), pages 187-203, October.
    12. Kahneman, Daniel & Tversky, Amos, 1979. "Prospect Theory: An Analysis of Decision under Risk," Econometrica, Econometric Society, vol. 47(2), pages 263-291, March.
    13. Henry S. Farber, 2008. "Reference-Dependent Preferences and Labor Supply: The Case of New York City Taxi Drivers," American Economic Review, American Economic Association, vol. 98(3), pages 1069-1082, June.
    14. Fliessbach, Klaus & Weber, Bernd & Trautner, P. & Dohmen, Thomas J. & Sunde, Uwe & Elger, C. E. & Falk, Armin, 2007. "Social comparison affects reward-related brain activity in the human ventral striatum," Munich Reprints in Economics 20362, University of Munich, Department of Economics.
    15. McBride, Michael, 2001. "Relative-income effects on subjective well-being in the cross-section," Journal of Economic Behavior & Organization, Elsevier, vol. 45(3), pages 251-278, July.
    16. Stephen J. Mezias & Ya-Ru Chen & Patrice R. Murphy, 2002. "Aspiration-Level Adaptation in an American Financial Services Organization: A Field Study," Management Science, INFORMS, vol. 48(10), pages 1285-1300, October.
    17. Ferrer-i-Carbonell, Ada, 2005. "Income and well-being: an empirical analysis of the comparison income effect," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 997-1019, June.
    Full references (including those not matched with items on IDEAS)


    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.

    Cited by:

    1. Krawczyk, Jacek B & Pharo, Alastair S, 2014. "InfsocSol3: An updated MATLAB® package for approximating the solution to a continuous-time infinite horizon stochastic optimal control problem," Working Paper Series 3412, Victoria University of Wellington, School of Economics and Finance.

    More about this item


    Computational economics; Financial engineering; Approximating Markov decision chains;

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • G23 - Financial Economics - - Financial Institutions and Services - - - Non-bank Financial Institutions; Financial Instruments; Institutional Investors

    NEP fields

    This paper has been announced in the following NEP Reports:


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:17027. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joachim Winter). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.