IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v56y2020i1d10.1007_s10614-019-09949-0.html
   My bibliography  Save this article

OPTCON3: An Active Learning Control Algorithm for Nonlinear Quadratic Stochastic Problems

Author

Listed:
  • V. Blueschke-Nikolaeva

    () (University of Klagenfurt)

  • D. Blueschke

    () (University of Klagenfurt)

  • R. Neck

    () (University of Klagenfurt)

Abstract

In this paper, we describe the new OPTCON3 algorithm, which serves to determine approximately optimal policies for stochastic control problems with a quadratic objective function and nonlinear dynamic models. It includes active learning and the dual effect of optimizing policies, whereby optimal policies are used to learn about the stochastics of the dynamic system in addition to their immediate effect on the performance of the system. The OPTCON3 algorithm approximates the nonlinear model with a time-varying linear model and applies a procedure similar to that of Kendrick to the series of linearized models to calculate approximately optimal policies. The results for two simple economic models serve to test the OPTCON3 algorithm and compare it to previous solutions of the stochastic control problem. Initial evaluations show that the OPTCON3 approach may be promising to enhance our understanding of the adaptive economic policy problem under uncertainty.

Suggested Citation

  • V. Blueschke-Nikolaeva & D. Blueschke & R. Neck, 2020. "OPTCON3: An Active Learning Control Algorithm for Nonlinear Quadratic Stochastic Problems," Computational Economics, Springer;Society for Computational Economics, vol. 56(1), pages 145-162, June.
  • Handle: RePEc:kap:compec:v:56:y:2020:i:1:d:10.1007_s10614-019-09949-0
    DOI: 10.1007/s10614-019-09949-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-019-09949-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mizrach, Bruce, 1991. "Nonconvexities in a stochastic control problem with learning," Journal of Economic Dynamics and Control, Elsevier, vol. 15(3), pages 515-538, July.
    2. Blueschke-Nikolaeva, V. & Blueschke, D. & Neck, R., 2012. "Optimal control of nonlinear dynamic econometric models: An algorithm and an application," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3230-3240.
    3. Elizabeth Chase MacRae, 1972. "Linear Decision with Experimentation," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 4, pages 437-447, National Bureau of Economic Research, Inc.
    4. Amman, Hans M & Kendrick, David A, 1995. "Nonconvexities in Stochastic Control Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 36(2), pages 455-475, May.
    5. Kendrick, David, 1982. "Caution and probing in a macroeconomic model," Journal of Economic Dynamics and Control, Elsevier, vol. 4(1), pages 149-170, November.
    6. Yaakov Bar-Shalom & Edison Tse, 1976. "Caution, Probing, and the Value of Information in the Control of Uncertain Systems," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 3, pages 323-337, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:56:y:2020:i:1:d:10.1007_s10614-019-09949-0. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla) or (Springer Nature Abstracting and Indexing). General contact details of provider: http://www.springer.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.