IDEAS home Printed from https://ideas.repec.org/p/jrp/jrpwrp/2013-051.html
   My bibliography  Save this paper

Solving nonlinear stochastic optimal control problems using evolutionary heuristic optimization

Author

Listed:
  • Ivan Savin

    (Faculty of Economics and Business Administration, Friedrich Schiller University Jena, and Chair for Econometrics and Statistics, Graduate School of Economics and Management, Ural Federal University)

  • Dmitri Blueschke

    () (University of Klagenfurt)

Abstract

Policy makers constantly face optimal control problems: what controls allow to achieve certain targets in, e.g., GDP growth or inflation? Conventionally this is done by applying certain linear-quadratic optimization algorithms to dynamic econometric models. Several algorithms extend this baseline framework to nonlinear stochastic problems. However, those algorithms are limited in a variety of ways including, most importantly, restriction to local best solutions only and the symmetry of objective function. In Blueschke et al. (2013a) a new flexible optimization method based on Differential Evolution is suggested. It allows to lift these limitations and achieve better approximations of the policy targets, but is designed to deterministic problems only. This study extends the methodology by dealing with stochastic problems in two different ways: applying extreme event analysis and by minimizing the median objective value. Thus, this research is aimed to broaden the range of decision support information used by policy makers in choosing optimal strategy under much more realistic conditions.

Suggested Citation

  • Ivan Savin & Dmitri Blueschke, 2013. "Solving nonlinear stochastic optimal control problems using evolutionary heuristic optimization," Jena Economic Research Papers 2013-051, Friedrich-Schiller-University Jena.
  • Handle: RePEc:jrp:jrpwrp:2013-051
    as

    Download full text from publisher

    File URL: http://pubdb.wiwi.uni-jena.de/pdf/wp_2013_051.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. Lyra, M. & Paha, J. & Paterlini, S. & Winker, P., 2010. "Optimization heuristics for determining internal rating grading scales," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2693-2706, November.
    2. Neck, Reinhard, 1984. "Stochastic control theory and operational research," European Journal of Operational Research, Elsevier, vol. 17(3), pages 283-301, September.
    3. Abiodun Egbetokun & Ivan Savin, 2014. "Absorptive capacity and innovation: when is it better to cooperate?," Journal of Evolutionary Economics, Springer, vol. 24(2), pages 399-420, April.
    4. Blueschke-Nikolaeva, V. & Blueschke, D. & Neck, R., 2012. "Optimal control of nonlinear dynamic econometric models: An algorithm and an application," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3230-3240.
    5. Blueschke, D. & Blueschke-Nikolaeva, V. & Savin, I., 2013. "New insights into optimal control of nonlinear dynamic econometric models: Application of a heuristic approach," Journal of Economic Dynamics and Control, Elsevier, vol. 37(4), pages 821-837.
    6. Benigno, Pierpaolo & Woodford, Michael, 2012. "Linear-quadratic approximation of optimal policy problems," Journal of Economic Theory, Elsevier, vol. 147(1), pages 1-42.
    7. MacRae, Elizabeth Chase, 1975. "An Adaptive Learning Rule for Multiperiod Decision Problems," Econometrica, Econometric Society, vol. 43(5-6), pages 893-906, Sept.-Nov.
    8. D. Blueschke & V. Blueschke-Nikolaeva & R. Neck, 2013. "Stochastic Control of Linear and Nonlinear Econometric Models: Some Computational Aspects," Computational Economics, Springer;Society for Computational Economics, vol. 42(1), pages 107-118, June.
    9. Peter Winker & Marianna Lyra & Chris Sharpe, 2011. "Least median of squares estimation by optimization heuristics with an application to the CAPM and a multi-factor model," Computational Management Science, Springer, vol. 8(1), pages 103-123, April.
    10. Kendrick, David A., 2005. "Stochastic control for economic models: past, present and the paths ahead," Journal of Economic Dynamics and Control, Elsevier, vol. 29(1-2), pages 3-30, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Herrmann, Johannes & Savin, Ivan, 2015. "Evolution of the electricity market in Germany: Identifying policy implications by an agent-based model," Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112959, Verein für Socialpolitik / German Economic Association.

    More about this item

    Keywords

    Differential evolution; stochstic problems; nonlinear optimization; optimal control;

    JEL classification:

    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
    • E61 - Macroeconomics and Monetary Economics - - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook - - - Policy Objectives; Policy Designs and Consistency; Policy Coordination
    • E63 - Macroeconomics and Monetary Economics - - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook - - - Comparative or Joint Analysis of Fiscal and Monetary Policy; Stabilization; Treasury Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jrp:jrpwrp:2013-051. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Markus Pasche). General contact details of provider: http://www.jenecon.de .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.