IDEAS home Printed from https://ideas.repec.org/p/eth/wpswif/06-59.html
   My bibliography  Save this paper

Numerical solution of optimal control problems with constant control delays

Author

Listed:
  • Ulrich Brandt-Pollmann

    (Interdisciplinary Center for Scientific Computing, University of Heidelberg, Germany)

  • Ralph Winkler

    (Center of Economic Research (CER-ETH) at ETH Zürich)

  • Sebastian Sager

    (Interdisciplinary Center for Scientific Computing, University of Heidelberg, Germany)

  • Ulf Moslener

    (Centre for European Economic Research (ZEW), Mannheim, Germany)

  • Johannes P. Schlöder

    (Interdisciplinary Center for Scientific Computing, University of Heidelberg, Germany)

Abstract

We investigate a class of optimal control problems that exhibit constant exogenously given delays in the control in the equation of motion of the differential states. Therefore, we formulate an exemplary optimal control problem with one stock and one control variable and review some analytic properties of an optimal solution. However, analytical considerations are quite limited in case of delayed optimal control problems. In order to overcome these limits, we reformulate the problem and apply direct numerical methods to calculate approximate solutions that give a better understanding of this class of optimization problems. In particular, we present two possibilities to reformulate the delayed optimal control problem into an instantaneous optimal control problem and show how these can be solved numerically with a state-of-the-art direct method by applying Bock’s direct multiple shooting algorithm. We further demonstrate the strength of our approach by two economic examples.

Suggested Citation

  • Ulrich Brandt-Pollmann & Ralph Winkler & Sebastian Sager & Ulf Moslener & Johannes P. Schlöder, 2006. "Numerical solution of optimal control problems with constant control delays," CER-ETH Economics working paper series 06/59, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    • Handle: RePEc:eth:wpswif:06-59
    as

    Download full text from publisher

    File URL: https://www.ethz.ch/content/dam/ethz/special-interest/mtec/cer-eth/cer-eth-dam/documents/working-papers/wp_06_59.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Raouf Boucekkine & David Croix & Omar Licandro, 2004. "MODELLING VINTAGE STRUCTURES WITH DDEs: PRINCIPLES AND APPLICATIONS," Mathematical Population Studies, Taylor & Francis Journals, vol. 11(3-4), pages 151-179.
    2. Jody Overland & Christopher D. Carroll & David N. Weil, 2000. "Saving and Growth with Habit Formation," American Economic Review, American Economic Association, vol. 90(3), pages 341-355, June.
    3. Asea, Patrick K. & Zak, Paul J., 1999. "Time-to-build and cycles," Journal of Economic Dynamics and Control, Elsevier, vol. 23(8), pages 1155-1175, August.
    4. Boucekkine, Raouf & Germain, Marc & Licandro, Omar, 1997. "Replacement Echoes in the Vintage Capital Growth Model," Journal of Economic Theory, Elsevier, vol. 74(2), pages 333-348, June.
    5. Boucekkine, Raouf & Licandro, Omar & Paul, Christopher, 1997. "Differential-difference equations in economics: On the numerical solution of vintage capital growth models," Journal of Economic Dynamics and Control, Elsevier, vol. 21(2-3), pages 347-362.
    6. Fabrice Collard & Omar Licandro & Luis A. Puch, 2008. "The short-run Dynamics of Optimal Growth Model with Delays," Annals of Economics and Statistics, GENES, issue 90, pages 127-143.
    7. Boucekkine, Raouf & Germain, Marc & Licandro, Omar & Magnus, Alphonse, 1998. "Creative Destruction, Investment Volatility, and the Average Age of Capital," Journal of Economic Growth, Springer, vol. 3(4), pages 361-384, December.
    8. Raouf Boucekkine & David de la Croix & Omar Licandro, 2006. "Vintage Capital," Economics Working Papers ECO2006/8, European University Institute.
    9. de la Croix, David & Licandro, Omar, 1999. "Life expectancy and endogenous growth," Economics Letters, Elsevier, vol. 65(2), pages 255-263, November.
    10. Boucekkine, Raouf & Germain, Marc & Licandro, Omar & Magnus, Alphonse, 2001. "Numerical solution by iterative methods of a class of vintage capital models," Journal of Economic Dynamics and Control, Elsevier, vol. 25(5), pages 655-669, May.
    11. Winkler, Ralph & Brandt-Pollmann, Ulrich & Moslener, Ulf & Schlöder, Johannes, 2005. "On the Transition from Instantaneous to Time-Lagged Capital Accumilation: The Case of Leontief Type Production Functions," ZEW Discussion Papers 05-30, ZEW - Leibniz Centre for European Economic Research.
    12. Boucekkine, Raouf & Licandro, Omar & Puch, Luis A. & del Rio, Fernando, 2005. "Vintage capital and the dynamics of the AK model," Journal of Economic Theory, Elsevier, vol. 120(1), pages 39-72, January.
    13. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    14. Boucekkine, Raouf & de la Croix, David & Licandro, Omar, 2002. "Vintage Human Capital, Demographic Trends, and Endogenous Growth," Journal of Economic Theory, Elsevier, vol. 104(2), pages 340-375, June.
    15. Benhabib, Jess & Rustichini, Aldo, 1991. "Vintage capital, investment, and growth," Journal of Economic Theory, Elsevier, vol. 55(2), pages 323-339, December.
    16. Boyer, Marcel, 1978. "A Habit Forming Optimal Growth Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 19(3), pages 585-609, October.
    17. Feichtinger, Gustav & Hartl, Richard F. & Kort, Peter M. & Veliov, Vladimir M., 2006. "Anticipation effects of technological progress on capital accumulation: a vintage capital approach," Journal of Economic Theory, Elsevier, vol. 126(1), pages 143-164, January.
    18. El-Hodiri, Mohamed A & Loehman, Edna & Whinston, Andrew B, 1972. "An Optimal Growth Model with Time Lags," Econometrica, Econometric Society, vol. 40(6), pages 1137-1146, November.
    19. Peeters, Marga, 1996. "Investment gestation lags: The difference between time-to-build and delivery lags," MPRA Paper 28549, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yüksel, Mustafa Kerem, 2011. "Capital dependent population growth induces cycles," Chaos, Solitons & Fractals, Elsevier, vol. 44(9), pages 759-763.
    2. Balistreri, Edward J. & Hillberry, Russell H. & Rutherford, Thomas F., 2011. "Structural estimation and solution of international trade models with heterogeneous firms," Journal of International Economics, Elsevier, vol. 83(2), pages 95-108, March.
    3. Ralph Winkler, 2008. "Optimal control of pollutants with delayed stock accumulation," CER-ETH Economics working paper series 08/91, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    4. Leon A. Petrosyan & David W.K. Yeung, 2020. "Cooperative Dynamic Games with Durable Controls: Theory and Application," Dynamic Games and Applications, Springer, vol. 10(4), pages 872-896, December.
    5. Cyril Bourgeois & Pierre-Alain Jayet, 2010. "Revisited water-oriented relationships between a set of farmers and an aquifer: accounting for lag effect," Working Papers 2010/06, INRA, Economie Publique.
    6. David W. K. Yeung & Leon A. Petrosyan, 2019. "Cooperative Dynamic Games with Control Lags," Dynamic Games and Applications, Springer, vol. 9(2), pages 550-567, June.
    7. Rădulescu, I.R. & Cândea, D. & Halanay, A., 2016. "Optimal control analysis of a leukemia model under imatinib treatment," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 121(C), pages 1-11.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raouf Boucekkine & David Croix & Omar Licandro, 2004. "MODELLING VINTAGE STRUCTURES WITH DDEs: PRINCIPLES AND APPLICATIONS," Mathematical Population Studies, Taylor & Francis Journals, vol. 11(3-4), pages 151-179.
    2. Raouf Boucekkine & David De la Croix & Omar Licandro, 2011. "Vintage Capital Growth Theory: Three Breakthroughs," Working Papers 565, Barcelona School of Economics.
    3. Bambi, Mauro & Gozzi, Fausto & Licandro, Omar, 2014. "Endogenous growth and wave-like business fluctuations," Journal of Economic Theory, Elsevier, vol. 154(C), pages 68-111.
    4. Fabrice Collard & Omar Licandro & Luis A. Puch, 2008. "The short-run Dynamics of Optimal Growth Model with Delays," Annals of Economics and Statistics, GENES, issue 90, pages 127-143.
    5. Hippolyte d'Albis & Jean-Pierre Drugeon, 2020. "On Investment and Cycles in Explicitely Solved Vintage Capital Models," PSE Working Papers halshs-02570648, HAL.
    6. Augeraud-Veron, Emmanuelle & Bambi, Mauro, 2015. "Endogenous growth with addictive habits," Journal of Mathematical Economics, Elsevier, vol. 56(C), pages 15-25.
    7. Lin, Hwan C. & Shampine, L.F., 2014. "Finite-length Patents and Functional Differential Equations in a Non-scale R&D-based Growth Model," MPRA Paper 61603, University Library of Munich, Germany.
    8. Hwan C. Lin & L. F. Shampine, 2018. "R&D-based Calibrated Growth Models with Finite-Length Patents: A Novel Relaxation Algorithm for Solving an Autonomous FDE System of Mixed Type," Computational Economics, Springer;Society for Computational Economics, vol. 51(1), pages 123-158, January.
    9. Mauro Bambi & Cristina Girolami & Salvatore Federico & Fausto Gozzi, 2017. "Generically distributed investments on flexible projects and endogenous growth," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 63(2), pages 521-558, February.
    10. d’Albis, Hippolyte & Augeraud-Véron, Emmanuelle & Hupkes, Hermen Jan, 2014. "Multiple solutions in systems of functional differential equations," Journal of Mathematical Economics, Elsevier, vol. 52(C), pages 50-56.
    11. Mauro Bambi, 2006. "Endogenous growth and time to build: the AK case," Computing in Economics and Finance 2006 77, Society for Computational Economics.
    12. Faggian, Silvia & Gozzi, Fausto & Kort, Peter M., 2021. "Optimal investment with vintage capital: Equilibrium distributions," Journal of Mathematical Economics, Elsevier, vol. 96(C).
    13. Fabbri, Giorgio & Gozzi, Fausto, 2008. "Solving optimal growth models with vintage capital: The dynamic programming approach," Journal of Economic Theory, Elsevier, vol. 143(1), pages 331-373, November.
    14. Gamboa, Franklin & Maldonado, Wilfredo Leiva, 2014. "Feasibility and optimality of the initial capital stock in the Ramsey vintage capital model," Journal of Mathematical Economics, Elsevier, vol. 52(C), pages 40-45.
    15. Fabbri, Giorgio, 2006. "Viscosity solutions approach to economic models governed by DDEs," MPRA Paper 2826, University Library of Munich, Germany.
    16. Futagami, Koichi & Iwaisako, Tatsuro, 2007. "Dynamic analysis of patent policy in an endogenous growth model," Journal of Economic Theory, Elsevier, vol. 132(1), pages 306-334, January.
    17. Feichtinger, Gustav & Hartl, Richard F. & Kort, Peter M. & Veliov, Vladimir M., 2005. "Environmental policy, the porter hypothesis and the composition of capital: Effects of learning and technological progress," Journal of Environmental Economics and Management, Elsevier, vol. 50(2), pages 434-446, September.
    18. David de la Croix & Omar Licandro, 2013. "The Child is Father Of the Man: Implications for the Demographic Transition," Economic Journal, Royal Economic Society, vol. 123(567), pages 236-261, March.
    19. d’Albis, Hippolyte & Augeraud-Veron, Emmanuelle & Venditti, Alain, 2012. "Business cycle fluctuations and learning-by-doing externalities in a one-sector model," Journal of Mathematical Economics, Elsevier, vol. 48(5), pages 295-308.
    20. Ralph Winkler, 2008. "Optimal control of pollutants with delayed stock accumulation," CER-ETH Economics working paper series 08/91, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.

    More about this item

    Keywords

    delayed differential equations; delayed optimal control; numerical optimization; time-to-build;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eth:wpswif:06-59. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/iwethch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.