IDEAS home Printed from https://ideas.repec.org/a/spr/coopap/v91y2025i2d10.1007_s10589-025-00650-7.html
   My bibliography  Save this article

Exploiting effective negative curvature directions via SYMMBK algorithm, in Newton–Krylov methods

Author

Listed:
  • Giovanni Fasano

    (University Ca’ Foscari)

  • Christian Piermarini

    (SAPIENZA University of Rome)

  • Massimo Roma

    (SAPIENZA University of Rome)

Abstract

In this paper we consider the issue of computing negative curvature directions, for nonconvex functions, within Newton–Krylov methods for large scale unconstrained optimization. In the last decades this issue has been widely investigated in the literature, and different approaches have been proposed. We focus on the well known SYMMBK method introduced for solving large scale symmetric possibly indefinite linear systems (Bunch and Kaufman in Math Comput 31:163–179, 2003; Chandra in Conjugate gradient methods for partial differential equations, Yale University, New Haven, 1978; Conn et al. Trust-region methods. MPS-SIAM Series on Optimization, Philadelphia, 2000; HSL 2013: A collection of Fortran codes for large scale scientific computation. http://www.hsl.rl.ac.uk/ ), and show how to exploit it to yield an effective negative curvature direction in optimization frameworks. The distinguishing feature of our proposal is that the computation of negative curvatures is basically carried out as by–product of SYMMBK procedure, without storing no more than two additional vectors. Hence, no explicit matrix factorization or matrix storage is required. An extensive numerical experimentation has been performed on CUTEst problems; the obtained results have been analyzed also through novel profiles (Quality Profiles) which highlighted the good capability of the algorithms which use negative curvature directions to determine better local minimizers.

Suggested Citation

  • Giovanni Fasano & Christian Piermarini & Massimo Roma, 2025. "Exploiting effective negative curvature directions via SYMMBK algorithm, in Newton–Krylov methods," Computational Optimization and Applications, Springer, vol. 91(2), pages 617-647, June.
  • Handle: RePEc:spr:coopap:v:91:y:2025:i:2:d:10.1007_s10589-025-00650-7
    DOI: 10.1007/s10589-025-00650-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10589-025-00650-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10589-025-00650-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hao Jiang & Daniel P. Robinson & René Vidal & Chong You, 2018. "A nonconvex formulation for low rank subspace clustering: algorithms and convergence analysis," Computational Optimization and Applications, Springer, vol. 70(2), pages 395-418, June.
    2. Andrea Caliciotti & Giovanni Fasano & Florian Potra & Massimo Roma, 2020. "Issues on the use of a modified Bunch and Kaufman decomposition for large scale Newton’s equation," Computational Optimization and Applications, Springer, vol. 77(3), pages 627-651, December.
    3. Nicholas Gould & Dominique Orban & Philippe Toint, 2015. "CUTEst: a Constrained and Unconstrained Testing Environment with safe threads for mathematical optimization," Computational Optimization and Applications, Springer, vol. 60(3), pages 545-557, April.
    4. Renato Leone & Giovanni Fasano & Massimo Roma & Yaroslav D. Sergeyev, 2020. "Iterative Grossone-Based Computation of Negative Curvature Directions in Large-Scale Optimization," Journal of Optimization Theory and Applications, Springer, vol. 186(2), pages 554-589, August.
    5. G. Fasano, 2005. "Planar Conjugate Gradient Algorithm for Large-Scale Unconstrained Optimization, Part 1: Theory," Journal of Optimization Theory and Applications, Springer, vol. 125(3), pages 523-541, June.
    6. Caliciotti, Andrea & Fasano, Giovanni & Roma, Massimo, 2018. "Preconditioned Nonlinear Conjugate Gradient methods based on a modified secant equation," Applied Mathematics and Computation, Elsevier, vol. 318(C), pages 196-214.
    7. G. Fasano, 2005. "Planar Conjugate Gradient Algorithm for Large-Scale Unconstrained Optimization, Part 2: Application," Journal of Optimization Theory and Applications, Springer, vol. 125(3), pages 543-558, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stefania Bellavia & Valentina Simone & Benedetta Morini, 2025. "Preface: New trends in large scale optimization," Computational Optimization and Applications, Springer, vol. 91(2), pages 351-356, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Caliciotti & Giovanni Fasano & Florian Potra & Massimo Roma, 2020. "Issues on the use of a modified Bunch and Kaufman decomposition for large scale Newton’s equation," Computational Optimization and Applications, Springer, vol. 77(3), pages 627-651, December.
    2. Giovanni Fasano, 2015. "A Framework of Conjugate Direction Methods for Symmetric Linear Systems in Optimization," Journal of Optimization Theory and Applications, Springer, vol. 164(3), pages 883-914, March.
    3. Giovanni Fasano & Massimo Roma, 2016. "A novel class of approximate inverse preconditioners for large positive definite linear systems in optimization," Computational Optimization and Applications, Springer, vol. 65(2), pages 399-429, November.
    4. Giovanni Fasano & Raffaele Pesenti, 2017. "Conjugate Direction Methods and Polarity for Quadratic Hypersurfaces," Journal of Optimization Theory and Applications, Springer, vol. 175(3), pages 764-794, December.
    5. Renato Leone & Giovanni Fasano & Massimo Roma & Yaroslav D. Sergeyev, 2020. "Iterative Grossone-Based Computation of Negative Curvature Directions in Large-Scale Optimization," Journal of Optimization Theory and Applications, Springer, vol. 186(2), pages 554-589, August.
    6. Giovanni Fasano & Massimo Roma, 2013. "Preconditioning Newton–Krylov methods in nonconvex large scale optimization," Computational Optimization and Applications, Springer, vol. 56(2), pages 253-290, October.
    7. Giovanni Fasano & Massimo Roma, 2011. "A Class of Preconditioners for Large Indefinite Linear Systems, as by-product of Krylov subspace Methods: Part I," Working Papers 4, Venice School of Management - Department of Management, Università Ca' Foscari Venezia.
    8. Mehiddin Al-Baali & Andrea Caliciotti & Giovanni Fasano & Massimo Roma, 2017. "Exploiting damped techniques for nonlinear conjugate gradient methods," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 86(3), pages 501-522, December.
    9. Renato De Leone & Giovanni Fasano & Yaroslav D. Sergeyev, 2018. "Planar methods and grossone for the Conjugate Gradient breakdown in nonlinear programming," Computational Optimization and Applications, Springer, vol. 71(1), pages 73-93, September.
    10. G. Fasano, 2007. "Lanczos Conjugate-Gradient Method and Pseudoinverse Computation on Indefinite and Singular Systems," Journal of Optimization Theory and Applications, Springer, vol. 132(2), pages 267-285, February.
    11. David J. Eckman & Shane G. Henderson & Sara Shashaani, 2023. "Diagnostic Tools for Evaluating and Comparing Simulation-Optimization Algorithms," INFORMS Journal on Computing, INFORMS, vol. 35(2), pages 350-367, March.
    12. Brian Irwin & Eldad Haber, 2023. "Secant penalized BFGS: a noise robust quasi-Newton method via penalizing the secant condition," Computational Optimization and Applications, Springer, vol. 84(3), pages 651-702, April.
    13. Matteo Lapucci & Alessio Sortino, 2024. "On the Convergence of Inexact Alternate Minimization in Problems with $$\ell _0$$ ℓ 0 Penalties," SN Operations Research Forum, Springer, vol. 5(2), pages 1-11, June.
    14. S. Gratton & Ph. L. Toint, 2020. "A note on solving nonlinear optimization problems in variable precision," Computational Optimization and Applications, Springer, vol. 76(3), pages 917-933, July.
    15. Lahcen El Bourkhissi & Ion Necoara, 2025. "Complexity of linearized quadratic penalty for optimization with nonlinear equality constraints," Journal of Global Optimization, Springer, vol. 91(3), pages 483-510, March.
    16. Yutao Zheng & Bing Zheng, 2017. "Two New Dai–Liao-Type Conjugate Gradient Methods for Unconstrained Optimization Problems," Journal of Optimization Theory and Applications, Springer, vol. 175(2), pages 502-509, November.
    17. Yonggang Pei & Shaofang Song & Detong Zhu, 2023. "A sequential adaptive regularisation using cubics algorithm for solving nonlinear equality constrained optimization," Computational Optimization and Applications, Springer, vol. 84(3), pages 1005-1033, April.
    18. A. L. Custódio & R. Garmanjani & M. Raydan, 2024. "Derivative-free separable quadratic modeling and cubic regularization for unconstrained optimization," 4OR, Springer, vol. 22(1), pages 121-144, March.
    19. Ashkan Sadeghi-Lotfabadi & Kamaledin Ghiasi-Shirazi, 2025. "Speeding up L-BFGS by direct approximation of the inverse Hessian matrix," Computational Optimization and Applications, Springer, vol. 91(1), pages 283-310, May.
    20. M. Ahmadvand & M. Esmaeilbeigi & A. Kamandi & F. M. Yaghoobi, 2019. "A novel hybrid trust region algorithm based on nonmonotone and LOOCV techniques," Computational Optimization and Applications, Springer, vol. 72(2), pages 499-524, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:coopap:v:91:y:2025:i:2:d:10.1007_s10589-025-00650-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.