IDEAS home Printed from https://ideas.repec.org/a/spr/joptap/v93y1997i2d10.1023_a1022602123316.html

Convergence Analysis of Perturbed Feasible Descent Methods

Author

Listed:
  • M. V. Solodov

    (Instituto de Matemática Pura e Aplicada)

Abstract

We develop a general approach to convergence analysis of feasible descent methods in the presence of perturbations. The important novel feature of our analysis is that perturbations need not tend to zero in the limit. In that case, standard convergence analysis techniques are not applicable. Therefore, a new approach is needed. We show that, in the presence of perturbations, a certain ε-approximate solution can be obtained, where ε depends linearly on the level of perturbations. Applications to the gradient projection, proximal minimization, extragradient and incremental gradient algorithms are described.

Suggested Citation

  • M. V. Solodov, 1997. "Convergence Analysis of Perturbed Feasible Descent Methods," Journal of Optimization Theory and Applications, Springer, vol. 93(2), pages 337-353, May.
    • Handle: RePEc:spr:joptap:v:93:y:1997:i:2:d:10.1023_a:1022602123316
    DOI: 10.1023/A:1022602123316
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1023/A:1022602123316
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1023/A:1022602123316?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jong-Shi Pang, 1987. "A Posteriori Error Bounds for the Linearly-Constrained Variational Inequality Problem," Mathematics of Operations Research, INFORMS, vol. 12(3), pages 474-484, August.
    2. Z.-Q. Luo & O. L. Mangasarian & J. Ren & M. V. Solodov, 1994. "New Error Bounds for the Linear Complementarity Problem," Mathematics of Operations Research, INFORMS, vol. 19(4), pages 880-892, November.
    3. O. L. Mangasarian, 1993. "Mathematical Programming in Neural Networks," INFORMS Journal on Computing, INFORMS, vol. 5(4), pages 349-360, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. M. V. Solodov, 2003. "On Approximations with Finite Precision in Bundle Methods for Nonsmooth Optimization," Journal of Optimization Theory and Applications, Springer, vol. 119(1), pages 151-165, October.
    2. Wenma Jin & Yair Censor & Ming Jiang, 2016. "Bounded perturbation resilience of projected scaled gradient methods," Computational Optimization and Applications, Springer, vol. 63(2), pages 365-392, March.
    3. M. V. Solodov & S. K. Zavriev, 1998. "Error Stability Properties of Generalized Gradient-Type Algorithms," Journal of Optimization Theory and Applications, Springer, vol. 98(3), pages 663-680, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shou-qiang Du & Yan Gao, 2011. "The Levenberg‐Marquardt‐Type Methods for a Kind of Vertical Complementarity Problem," Journal of Applied Mathematics, John Wiley & Sons, vol. 2011(1).
    2. Eva K. Lee & Richard J. Gallagher & David A. Patterson, 2003. "A Linear Programming Approach to Discriminant Analysis with a Reserved-Judgment Region," INFORMS Journal on Computing, INFORMS, vol. 15(1), pages 23-41, February.
    3. M. V. Solodov & S. K. Zavriev, 1998. "Error Stability Properties of Generalized Gradient-Type Algorithms," Journal of Optimization Theory and Applications, Springer, vol. 98(3), pages 663-680, September.
    4. Zhengyu Ma & Hong Seo Ryoo, 2021. "Spherical Classification of Data, a New Rule-Based Learning Method," Journal of Classification, Springer;The Classification Society, vol. 38(1), pages 44-71, April.
    5. Bodo Rosenhahn, 2023. "Optimization of Sparsity-Constrained Neural Networks as a Mixed Integer Linear Program," Journal of Optimization Theory and Applications, Springer, vol. 199(3), pages 931-954, December.
    6. C. Kanzow & N. Yamashita & M. Fukushima, 1997. "New NCP-Functions and Their Properties," Journal of Optimization Theory and Applications, Springer, vol. 94(1), pages 115-135, July.
    7. H. D. Qi, 1999. "On Minimizing and Stationary Sequences of a New Class of Merit Functions for Nonlinear Complementarity Problems," Journal of Optimization Theory and Applications, Springer, vol. 102(2), pages 411-431, August.
    8. W. Nick Street, 2005. "Oblique Multicategory Decision Trees Using Nonlinear Programming," INFORMS Journal on Computing, INFORMS, vol. 17(1), pages 25-31, February.
    9. Giovanni Felici & Klaus Truemper, 2002. "A MINSAT Approach for Learning in Logic Domains," INFORMS Journal on Computing, INFORMS, vol. 14(1), pages 20-36, February.
    10. P. S. Bradley & Usama M. Fayyad & O. L. Mangasarian, 1999. "Mathematical Programming for Data Mining: Formulations and Challenges," INFORMS Journal on Computing, INFORMS, vol. 11(3), pages 217-238, August.
    11. Palocsay, Susan W. & Stevens, Scott P. & Brookshire, Robert G. & Sacco, William J. & Copes, Wayne S. & Buckman, Robert F. & Smith, J. Stanley, 1996. "Using neural networks for trauma outcome evaluation," European Journal of Operational Research, Elsevier, vol. 93(2), pages 369-386, September.
    12. Sexton, Randall S. & Dorsey, Robert E. & Johnson, John D., 1999. "Optimization of neural networks: A comparative analysis of the genetic algorithm and simulated annealing," European Journal of Operational Research, Elsevier, vol. 114(3), pages 589-601, May.
    13. Fan Jianghua & Wang Xiaoguo, 2007. "Global Bounds for Cocoercive Variational Inequalities," Abstract and Applied Analysis, John Wiley & Sons, vol. 2007(1).
    14. Yongchao Liu & Huifu Xu & Gui-Hua Lin, 2012. "Stability Analysis of One Stage Stochastic Mathematical Programs with Complementarity Constraints," Journal of Optimization Theory and Applications, Springer, vol. 152(2), pages 537-555, February.
    15. Hongchun Sun & Yiju Wang & Houchun Zhou & Shengjie Li, 2014. "An Improvement of Global Error Bound for the Generalized Nonlinear Complementarity Problem over a Polyhedral Cone," Abstract and Applied Analysis, John Wiley & Sons, vol. 2014(1).
    16. Shouqiang Du & Weiyang Ding & Yimin Wei, 2021. "Acceptable Solutions and Backward Errors for Tensor Complementarity Problems," Journal of Optimization Theory and Applications, Springer, vol. 188(1), pages 260-276, January.
    17. Hongchun Sun & Yiju Wang, 2012. "Global Error Bound Estimation for the Generalized Nonlinear Complementarity Problem over a Closed Convex Cone," Journal of Applied Mathematics, John Wiley & Sons, vol. 2012(1).
    18. M. V. Solodov, 1997. "Stationary Points of Bound Constrained Minimization Reformulations of Complementarity Problems," Journal of Optimization Theory and Applications, Springer, vol. 94(2), pages 449-467, August.
    19. Orsenigo, Carlotta & Vercellis, Carlo, 2004. "Discrete support vector decision trees via tabu search," Computational Statistics & Data Analysis, Elsevier, vol. 47(2), pages 311-322, September.
    20. M. H. Li & K. W. Meng & X. Q. Yang, 2025. "Kurdyka-Łojasiewicz inequality and error bounds of D-Gap functions for nonsmooth and nonmonotone variational inequality problems," Journal of Global Optimization, Springer, vol. 93(3), pages 833-860, November.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joptap:v:93:y:1997:i:2:d:10.1023_a:1022602123316. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.