IDEAS home Printed from https://ideas.repec.org/a/spr/coopap/v87y2024i1d10.1007_s10589-023-00513-z.html
   My bibliography  Save this article

A modified inexact Levenberg–Marquardt method with the descent property for solving nonlinear equations

Author

Listed:
  • Jianghua Yin

    (Guangxi Key Laboratory of Hybrid Computation and IC Design Analysis, Guangxi Minzu University)

  • Jinbao Jian

    (Guangxi Key Laboratory of Hybrid Computation and IC Design Analysis, Guangxi Minzu University)

  • Guodong Ma

    (Guangxi Key Laboratory of Hybrid Computation and IC Design Analysis, Guangxi Minzu University)

Abstract

In this work, we propose a modified inexact Levenberg–Marquardt method with the descent property for solving nonlinear equations. A novel feature of the proposed method is that one can directly use the search direction generated by the approach to perform Armijo-type line search once the unit step size is not acceptable. We achieve this via properly controlling the level of inexactness such that the resulting search direction is automatically a descent direction for the merit function. Under the local Lipschitz continuity of the Jacobian, the global convergence of the proposed method is established, and an iteration complexity bound of $$O(1/\epsilon ^2)$$ O ( 1 / ϵ 2 ) to reach an $$\epsilon $$ ϵ -stationary solution is proved under some appropriate conditions. Moreover, with the aid of the designed inexactness condition, we establish the local superlinear rate of convergence for the proposed method under the Hölderian continuity of the Jacobian and the Hölderian local error bound condition. For some special parameters, the convergence rate is even quadratic. The numerical experiments on the underdetermined nonlinear equations illustrate the effectiveness and efficiency of the algorithm compared with a previously proposed inexact Levenberg–Marquardt method. Finally, applying it to solve the Tikhonov-regularized logistic regression shows that our proposed method is quite promising.

Suggested Citation

  • Jianghua Yin & Jinbao Jian & Guodong Ma, 2024. "A modified inexact Levenberg–Marquardt method with the descent property for solving nonlinear equations," Computational Optimization and Applications, Springer, vol. 87(1), pages 289-322, January.
  • Handle: RePEc:spr:coopap:v:87:y:2024:i:1:d:10.1007_s10589-023-00513-z
    DOI: 10.1007/s10589-023-00513-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10589-023-00513-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10589-023-00513-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. El Houcine Bergou & Youssef Diouane & Vyacheslav Kungurtsev, 2020. "Convergence and Complexity Analysis of a Levenberg–Marquardt Algorithm for Inverse Problems," Journal of Optimization Theory and Applications, Springer, vol. 185(3), pages 927-944, June.
    2. Lei Guo & Gui-Hua Lin & Jane J. Ye, 2015. "Solving Mathematical Programs with Equilibrium Constraints," Journal of Optimization Theory and Applications, Springer, vol. 166(1), pages 234-256, July.
    3. Liang Chen, 2016. "A modified Levenberg–Marquardt method with line search for nonlinear equations," Computational Optimization and Applications, Springer, vol. 65(3), pages 753-779, December.
    4. Joseph Frédéric Bonnans & Alexander Ioffe, 1995. "Second-order Sufficiency and Quadratic Growth for Nonisolated Minima," Mathematics of Operations Research, INFORMS, vol. 20(4), pages 801-817, November.
    5. Kenji Ueda & Nobuo Yamashita, 2012. "Global Complexity Bound Analysis of the Levenberg–Marquardt Method for Nonsmooth Equations and Its Application to the Nonlinear Complementarity Problem," Journal of Optimization Theory and Applications, Springer, vol. 152(2), pages 450-467, February.
    6. Roger Behling & Douglas S. Gonçalves & Sandra A. Santos, 2019. "Local Convergence Analysis of the Levenberg–Marquardt Framework for Nonzero-Residue Nonlinear Least-Squares Problems Under an Error Bound Condition," Journal of Optimization Theory and Applications, Springer, vol. 183(3), pages 1099-1122, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andreas Fischer & Alexey F. Izmailov & Mikhail V. Solodov, 2024. "The Levenberg–Marquardt method: an overview of modern convergence theories and more," Computational Optimization and Applications, Springer, vol. 89(1), pages 33-67, September.
    2. Jifeng Bao & Carisa Kwok Wai Yu & Jinhua Wang & Yaohua Hu & Jen-Chih Yao, 2019. "Modified inexact Levenberg–Marquardt methods for solving nonlinear least squares problems," Computational Optimization and Applications, Springer, vol. 74(2), pages 547-582, November.
    3. Naoki Marumo & Takayuki Okuno & Akiko Takeda, 2023. "Majorization-minimization-based Levenberg–Marquardt method for constrained nonlinear least squares," Computational Optimization and Applications, Springer, vol. 84(3), pages 833-874, April.
    4. Boos, Everton & Gonçalves, Douglas S. & Bazán, Fermín S.V., 2024. "Levenberg-Marquardt method with singular scaling and applications," Applied Mathematics and Computation, Elsevier, vol. 474(C).
    5. Chungen Shen & Lei-Hong Zhang & Wei Liu, 2016. "A stabilized filter SQP algorithm for nonlinear programming," Journal of Global Optimization, Springer, vol. 65(4), pages 677-708, August.
    6. Won-Kwang Park, 2021. "Fast Localization of Small Inhomogeneities from Far-Field Pattern Data in the Limited-Aperture Inverse Scattering Problem," Mathematics, MDPI, vol. 9(17), pages 1-22, August.
    7. Nataša Krejić & Greta Malaspina & Lense Swaenen, 2023. "A split Levenberg-Marquardt method for large-scale sparse problems," Computational Optimization and Applications, Springer, vol. 85(1), pages 147-179, May.
    8. El Houcine Bergou & Youssef Diouane & Vyacheslav Kungurtsev, 2020. "Convergence and Complexity Analysis of a Levenberg–Marquardt Algorithm for Inverse Problems," Journal of Optimization Theory and Applications, Springer, vol. 185(3), pages 927-944, June.
    9. Gaoxi Li & Zhongping Wan, 2018. "On Bilevel Programs with a Convex Lower-Level Problem Violating Slater’s Constraint Qualification," Journal of Optimization Theory and Applications, Springer, vol. 179(3), pages 820-837, December.
    10. Qingna Li & Zhen Li & Alain Zemkoho, 2022. "Bilevel hyperparameter optimization for support vector classification: theoretical analysis and a solution method," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 96(3), pages 315-350, December.
    11. Hoai An Le Thi & Huynh Ngai & Tao Pham Dinh, 2016. "Error Bounds Via Exact Penalization with Applications to Concave and Quadratic Systems," Journal of Optimization Theory and Applications, Springer, vol. 171(1), pages 228-250, October.
    12. Tao Liu & Di Ouyang & Lianjun Guo & Ruofeng Qiu & Yunfei Qi & Wu Xie & Qiang Ma & Chao Liu, 2023. "Combination of Multigrid with Constraint Data for Inverse Problem of Nonlinear Diffusion Equation," Mathematics, MDPI, vol. 11(13), pages 1-15, June.
    13. Stephen J. Wright & Dominique Orban, 2002. "Properties of the Log-Barrier Function on Degenerate Nonlinear Programs," Mathematics of Operations Research, INFORMS, vol. 27(3), pages 585-613, August.
    14. Xide Zhu & Peijun Guo, 2020. "Bilevel programming approaches to production planning for multiple products with short life cycles," 4OR, Springer, vol. 18(2), pages 151-175, June.
    15. Sergey Guminov & Alexander Gasnikov & Ilya Kuruzov, 2023. "Accelerated methods for weakly-quasi-convex optimization problems," Computational Management Science, Springer, vol. 20(1), pages 1-19, December.
    16. Kerstin Dächert & Sauleh Siddiqui & Javier Saez-Gallego & Steven A. Gabriel & Juan Miguel Morales, 2019. "A Bicriteria Perspective on L-Penalty Approaches – a Corrigendum to Siddiqui and Gabriel’s L-Penalty Approach for Solving MPECs," Networks and Spatial Economics, Springer, vol. 19(4), pages 1199-1214, December.
    17. Gaoxi Li & Xinmin Yang, 2021. "Convexification Method for Bilevel Programs with a Nonconvex Follower’s Problem," Journal of Optimization Theory and Applications, Springer, vol. 188(3), pages 724-743, March.
    18. E. V. Castelani & R. Lopes & W. V. I. Shirabayashi & F. N. C. Sobral, 2021. "A robust method based on LOVO functions for solving least squares problems," Journal of Global Optimization, Springer, vol. 80(2), pages 387-414, June.
    19. Giorgio, 2019. "On Second-Order Optimality Conditions in Smooth Nonlinear Programming Problems," DEM Working Papers Series 171, University of Pavia, Department of Economics and Management.
    20. Chungen Shen & Lei-Hong Zhang & Bo Wang & Wenqiong Shao, 2014. "Global and local convergence of a nonmonotone SQP method for constrained nonlinear optimization," Computational Optimization and Applications, Springer, vol. 59(3), pages 435-473, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:coopap:v:87:y:2024:i:1:d:10.1007_s10589-023-00513-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.