IDEAS home Printed from https://ideas.repec.org/a/spr/coopap/v66y2017i3d10.1007_s10589-016-9880-7.html
   My bibliography  Save this article

Structured regularization for barrier NLP solvers

Author

Listed:
  • Wei Wan

    (Carnegie Mellon University)

  • Lorenz T. Biegler

    (Carnegie Mellon University)

Abstract

Barrier methods have led to several nonlinear programming (NLP) solvers (e.g. IPOPT, KNITRO, LOQO). However, certain regularity conditions are required for convergence of these methods. These conditions are violated for optimization models with dependent constraints, thus leading to method failure. These shortcomings can be identified by checking the inertia of the KKT matrix, and current solvers either add regularizing terms to correct the inertia of the KKT matrix or revert to more expensive trust region methods to solve the barrier problem. This study improves on these approaches with a new structured regularization strategy; within the Newton step it identifies an independent subset of equality constraints and removes the remaining constraints without modifying the KKT matrix structure. This approach leads to more accurate Newton steps and faster convergence, while maintaining global convergence properties. Implemented in IPOPT with linear solvers HSL_MA57, HSL_MA97 and MUMPS, we present numerical experiments on hundreds of examples from the CUTEr test set, modified for dependency. These results show an average reduction in iterations of more than 50 % over the current version of IPOPT. In addition, several nonlinear blending problems are solved with the proposed algorithm, and improvements over existing regularization strategies are further demonstrated.

Suggested Citation

  • Wei Wan & Lorenz T. Biegler, 2017. "Structured regularization for barrier NLP solvers," Computational Optimization and Applications, Springer, vol. 66(3), pages 401-424, April.
    • Handle: RePEc:spr:coopap:v:66:y:2017:i:3:d:10.1007_s10589-016-9880-7
    DOI: 10.1007/s10589-016-9880-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10589-016-9880-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10589-016-9880-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Eligius M. T. Hendrix & Boglárka G.-Tóth, 2010. "Nonlinear Programming algorithms," Springer Optimization and Its Applications, in: Introduction to Nonlinear and Global Optimization, chapter 5, pages 91-136, Springer.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Soledad Aronna & J. Frédéric Bonnans & Pierre Martinon, 2013. "A Shooting Algorithm for Optimal Control Problems with Singular Arcs," Journal of Optimization Theory and Applications, Springer, vol. 158(2), pages 419-459, August.
    2. Cao, Yankai & Zavala, Victor M. & D’Amato, Fernando, 2018. "Using stochastic programming and statistical extrapolation to mitigate long-term extreme loads in wind turbines," Applied Energy, Elsevier, vol. 230(C), pages 1230-1241.
    3. Bethany L. Nicholson & Wei Wan & Shivakumar Kameswaran & Lorenz T. Biegler, 2018. "Parallel cyclic reduction strategies for linear systems that arise in dynamic optimization problems," Computational Optimization and Applications, Springer, vol. 70(2), pages 321-350, June.
    4. Huster, Wolfgang R. & Vaupel, Yannic & Mhamdi, Adel & Mitsos, Alexander, 2018. "Validated dynamic model of an organic Rankine cycle (ORC) for waste heat recovery in a diesel truck," Energy, Elsevier, vol. 151(C), pages 647-661.
    5. Zebian, Hussam & Mitsos, Alexander, 2012. "A double-pinch criterion for regenerative Rankine cycles," Energy, Elsevier, vol. 40(1), pages 258-270.
    6. D. Gerard & M. Köppe & Q. Louveaux, 2017. "Guided dive for the spatial branch-and-bound," Journal of Global Optimization, Springer, vol. 68(4), pages 685-711, August.
    7. Seung-Jun Shin & Duck Bong Kim & Guodong Shao & Alexander Brodsky & David Lechevalier, 2017. "Developing a decision support system for improving sustainability performance of manufacturing processes," Journal of Intelligent Manufacturing, Springer, vol. 28(6), pages 1421-1440, August.
    8. Brage Rugstad Knudsen & Hanne Kauko & Trond Andresen, 2019. "An Optimal-Control Scheme for Coordinated Surplus-Heat Exchange in Industry Clusters," Energies, MDPI, vol. 12(10), pages 1-22, May.
    9. Aydogmus, Ozgur & TOR, Ali Hakan, 2021. "A Modified Multiple Shooting Algorithm for Parameter Estimation in ODEs Using Adjoint Sensitivity Analysis," Applied Mathematics and Computation, Elsevier, vol. 390(C).
    10. Lizarraga-Garcia, Enrique & Ghobeity, Amin & Totten, Mark & Mitsos, Alexander, 2013. "Optimal operation of a solar-thermal power plant with energy storage and electricity buy-back from grid," Energy, Elsevier, vol. 51(C), pages 61-70.
    11. Dizqah, Arash M. & Maheri, Alireza & Busawon, Krishna, 2014. "An accurate method for the PV model identification based on a genetic algorithm and the interior-point method," Renewable Energy, Elsevier, vol. 72(C), pages 212-222.
    12. Máša, Vítězslav & Stehlík, Petr & Touš, Michal & Vondra, Marek, 2018. "Key pillars of successful energy saving projects in small and medium industrial enterprises," Energy, Elsevier, vol. 158(C), pages 293-304.
    13. Gabriel Haeser, 2018. "A second-order optimality condition with first- and second-order complementarity associated with global convergence of algorithms," Computational Optimization and Applications, Springer, vol. 70(2), pages 615-639, June.
    14. Paweł Tomtas & Amadeusz Skwiot & Elżbieta Sobiecka & Andrzej Obraniak & Katarzyna Ławińska & Tomasz P. Olejnik, 2021. "Bench Tests and CFD Simulations of Liquid–Gas Phase Separation Modeling with Simultaneous Liquid Transport and Mechanical Foam Destruction," Energies, MDPI, vol. 14(6), pages 1-14, March.
    15. Jinhai Chen & Herschel Rabitz, 2019. "On Lifting Operators and Regularity of Nonsmooth Newton Methods for Optimal Control Problems of Differential Algebraic Equations," Journal of Optimization Theory and Applications, Springer, vol. 180(2), pages 518-535, February.
    16. Habib ur Rehman & Poom Kumam & Meshal Shutaywi & Nasser Aedh Alreshidi & Wiyada Kumam, 2020. "Inertial Optimization Based Two-Step Methods for Solving Equilibrium Problems with Applications in Variational Inequality Problems and Growth Control Equilibrium Models," Energies, MDPI, vol. 13(12), pages 1-28, June.
    17. Vaupel, Yannic & Huster, Wolfgang R. & Mhamdi, Adel & Mitsos, Alexander, 2021. "Optimal operating policies for organic Rankine cycles for waste heat recovery under transient conditions," Energy, Elsevier, vol. 224(C).
    18. Zebian, Hussam & Gazzino, Marco & Mitsos, Alexander, 2012. "Multi-variable optimization of pressurized oxy-coal combustion," Energy, Elsevier, vol. 38(1), pages 37-57.
    19. Bigi, Giancarlo & Castellani, Marco & Pappalardo, Massimo & Passacantando, Mauro, 2013. "Existence and solution methods for equilibria," European Journal of Operational Research, Elsevier, vol. 227(1), pages 1-11.
    20. Knudsen, Brage Rugstad & Rohde, Daniel & Kauko, Hanne, 2021. "Thermal energy storage sizing for industrial waste-heat utilization in district heating: A model predictive control approach," Energy, Elsevier, vol. 234(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:coopap:v:66:y:2017:i:3:d:10.1007_s10589-016-9880-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.