IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v562y2021ics0378437120307032.html
   My bibliography  Save this article

Second class constraints and the consistency of optimal control theory in phase space

Author

Listed:
  • Contreras G., Mauricio
  • Peña, Juan Pablo
  • Aros, Rodrigo

Abstract

As has been shown in the literature (Rothe and Rothe, 2010; Rothe and Scholtz, 2003), the description of a mechanical system in terms of canonical transformations together with the Hamilton–Jacobi equation for the S function is ill-defined when the system has second class constraints. In this case, Carathéodory’s integrability conditions are violated and either the corresponding Hamilton–Jacobi equation cannot be solved or their solutions do not describe the system at all. This can be remedied by enlarging the phase space so that the constraints become first class in the extended space. Another way to approach this problem, is to apply the Rothe–Scholtz method discussed in Rothe and Rothe (2010) and Rothe and Scholtz (2003), so that the constraints themselves become variables of a new canonical transformation. This method works when the elements of the Dirac matrix are constant. On the other hand, it has been shown that optimal control theory can be written in phase space as a mechanical system with second class restrictions (Itami, 2001; Hojman, 0000; Contreras et al., 2017; Contreras and Peña 2018). This implies that the description of control theory can become inconsistent in terms of the Hamilton–Jacobi equation. In this article we will use the description of Rothe–Scholtz to analyse a subclass of LQ linear-quadratic problems whose Dirac matrix is constant and to check if the integrability conditions can be fulfilled so as to not get inconsistencies.

Suggested Citation

  • Contreras G., Mauricio & Peña, Juan Pablo & Aros, Rodrigo, 2021. "Second class constraints and the consistency of optimal control theory in phase space," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 562(C).
  • Handle: RePEc:eee:phsmap:v:562:y:2021:i:c:s0378437120307032
    DOI: 10.1016/j.physa.2020.125335
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437120307032
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2020.125335?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Caputo,Michael R., 2005. "Foundations of Dynamic Economic Analysis," Cambridge Books, Cambridge University Press, number 9780521842723, January.
    2. Richard Bellman, 1954. "Some Applications of the Theory of Dynamic Programming---A Review," Operations Research, INFORMS, vol. 2(3), pages 275-288, August.
    3. Contreras, Mauricio & Pellicer, Rely & Villena, Marcelo, 2017. "Dynamic optimization and its relation to classical and quantum constrained systems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 479(C), pages 12-25.
    4. Richard Bellman, 1954. "On some applications of the theory of dynamic programming to logistics," Naval Research Logistics Quarterly, John Wiley & Sons, vol. 1(2), pages 141-153, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alves, P.R.L., 2022. "Quantifying chaos in stock markets before and during COVID-19 pandemic from the phase space reconstruction," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 202(C), pages 480-499.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. G., Mauricio Contreras & Peña, Juan Pablo, 2019. "The quantum dark side of the optimal control theory," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 515(C), pages 450-473.
    2. Xiaoyue Li & John M. Mulvey, 2023. "Optimal Portfolio Execution in a Regime-switching Market with Non-linear Impact Costs: Combining Dynamic Program and Neural Network," Papers 2306.08809, arXiv.org.
    3. Mahmoud Mahfouz & Angelos Filos & Cyrine Chtourou & Joshua Lockhart & Samuel Assefa & Manuela Veloso & Danilo Mandic & Tucker Balch, 2019. "On the Importance of Opponent Modeling in Auction Markets," Papers 1911.12816, arXiv.org.
    4. Dawei Chen & Fangxu Mo & Ye Chen & Jun Zhang & Xinyu You, 2022. "Optimization of Ramp Locations along Freeways: A Dynamic Programming Approach," Sustainability, MDPI, vol. 14(15), pages 1-13, August.
    5. Harrold, Daniel J.B. & Cao, Jun & Fan, Zhong, 2022. "Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    6. Wadi Khalid Anuar & Lai Soon Lee & Hsin-Vonn Seow & Stefan Pickl, 2021. "A Multi-Depot Vehicle Routing Problem with Stochastic Road Capacity and Reduced Two-Stage Stochastic Integer Linear Programming Models for Rollout Algorithm," Mathematics, MDPI, vol. 9(13), pages 1-44, July.
    7. Matthias Breuer & David Windisch, 2019. "Investment Dynamics and Earnings‐Return Properties: A Structural Approach," Journal of Accounting Research, Wiley Blackwell, vol. 57(3), pages 639-674, June.
    8. Diefenbach, Heiko & Emde, Simon & Glock, Christoph H., 2020. "Loading tow trains ergonomically for just-in-time part supply," European Journal of Operational Research, Elsevier, vol. 284(1), pages 325-344.
    9. Michael J. Pennock & William B. Rouse & Diane L. Kollar, 2007. "Transforming the Acquisition Enterprise: A Framework for Analysis and a Case Study of Ship Acquisition," Systems Engineering, John Wiley & Sons, vol. 10(2), pages 99-117, June.
    10. Quetschlich, Mathias & Moetz, André & Otto, Boris, 2021. "Optimisation model for multi-item multi-echelon supply chains with nested multi-level products," European Journal of Operational Research, Elsevier, vol. 290(1), pages 144-158.
    11. Coit, David W. & Zio, Enrico, 2019. "The evolution of system reliability optimization," Reliability Engineering and System Safety, Elsevier, vol. 192(C).
    12. Peng, Hujun & Li, Jianxiang & Löwenstein, Lars & Hameyer, Kay, 2020. "A scalable, causal, adaptive energy management strategy based on optimal control theory for a fuel cell hybrid railway vehicle," Applied Energy, Elsevier, vol. 267(C).
    13. Vincent Huang & James Unwin, 2019. "Markov Chain Models of Refugee Migration Data," Papers 1903.08255, arXiv.org.
    14. Esmaeili Aliabadi, Danial & Chan, Katrina, 2022. "The emerging threat of artificial intelligence on competition in liberalized electricity markets: A deep Q-network approach," Applied Energy, Elsevier, vol. 325(C).
    15. Alex Sharp & Ryan Browne, 2021. "Functional data clustering by projection into latent generalized hyperbolic subspaces," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(3), pages 735-757, September.
    16. Thomas L. Magnanti, 2021. "Optimization: From Its Inception," Management Science, INFORMS, vol. 67(9), pages 5349-5363, September.
    17. Yann Disser & John Fearnley & Martin Gairing & Oliver Göbel & Max Klimm & Daniel Schmand & Alexander Skopalik & Andreas Tönnis, 2020. "Hiring Secretaries over Time: The Benefit of Concurrent Employment," Mathematics of Operations Research, INFORMS, vol. 45(1), pages 323-352, February.
    18. Sean Williams & Michael Short & Tracey Crosbie & Maryam Shadman-Pajouh, 2020. "A Decentralized Informatics, Optimization, and Control Framework for Evolving Demand Response Services," Energies, MDPI, vol. 13(16), pages 1-30, August.
    19. Peng, Hujun & Chen, Zhu & Li, Jianxiang & Deng, Kai & Dirkes, Steffen & Gottschalk, Jonas & Ünlübayir, Cem & Thul, Andreas & Löwenstein, Lars & Pischinger, Stefan & Hameyer, Kay, 2021. "Offline optimal energy management strategies considering high dynamics in batteries and constraints on fuel cell system power rate: From analytical derivation to validation on test bench," Applied Energy, Elsevier, vol. 282(PA).
    20. Alena Otto & Xiyu Li & Erwin Pesch, 2017. "Two-Way Bounded Dynamic Programming Approach for Operations Planning in Transshipment Yards," Transportation Science, INFORMS, vol. 51(1), pages 325-342, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:562:y:2021:i:c:s0378437120307032. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.