IDEAS home Printed from https://ideas.repec.org/a/eee/apmaco/v369y2020ics0096300319308215.html
   My bibliography  Save this article

Superlinear convergence of nonlinear conjugate gradient method and scaled memoryless BFGS method based on assumptions about the initial point

Author

Listed:
  • Nataj, Sarah
  • Lui, S.H.

Abstract

The Perry nonlinear conjugate gradient method and scaled memoryless BFGS method are two quasi-Newton methods for unconstrained minimization. All convergence theory in the literature assume existence of a minimizer and bounds on the objective function in a neighbourhood of the minimizer. These conditions cannot be checked in practice. The motivation of this work is to derive a convergence theory where all assumptions can be verified, and the existence of a minimizer and its superlinear rate of convergence are consequences of the theory. Only the basic versions of these methods without line search are considered. The theory is simple in the sense that it contains as few constants as possible.

Suggested Citation

  • Nataj, Sarah & Lui, S.H., 2020. "Superlinear convergence of nonlinear conjugate gradient method and scaled memoryless BFGS method based on assumptions about the initial point," Applied Mathematics and Computation, Elsevier, vol. 369(C).
    • Handle: RePEc:eee:apmaco:v:369:y:2020:i:c:s0096300319308215
    DOI: 10.1016/j.amc.2019.124829
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0096300319308215
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.amc.2019.124829?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Defever, Fabrice & Imbruno, Michele & Kneller, Richard, 2020. "Trade liberalization, input intermediaries and firm productivity: Evidence from China," Journal of International Economics, Elsevier, vol. 126(C).
    2. Shmuel S. Oren, 1974. "Self-Scaling Variable Metric (SSVM) Algorithms," Management Science, INFORMS, vol. 20(5), pages 863-874, January.
    3. Spyros Galanis, 2021. "Speculative trade and the value of public information," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 23(1), pages 53-68, February.
    4. Avinoam Perry, 1978. "Technical Note—A Modified Conjugate Gradient Algorithm," Operations Research, INFORMS, vol. 26(6), pages 1073-1078, December.
    5. Galanis, S. & Ioannou, C. & Kotronis, S., 2019. "Information Aggregation Under Ambiguity: Theory and Experimental Evidence," Working Papers 20/05, Department of Economics, City University London.
    6. Paul Levine & Joseph Pearlman & Stephen Wright & Bo Yang, 2019. "Information, VARs and DSGE Models," School of Economics Discussion Papers 1619, School of Economics, University of Surrey.
    7. Shmuel S. Oren & David G. Luenberger, 1974. "Self-Scaling Variable Metric (SSVM) Algorithms," Management Science, INFORMS, vol. 20(5), pages 845-862, January.
    8. Mamageishvili, A. & Schlegel, J. C., 2019. "Optimal Smart Contracts with Costly Verification," Working Papers 19/13, Department of Economics, City University London.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Yonggang & Liu, Junjun & Zhang, Yuanjian & Wu, Yitao & Chen, Zheng & Ye, Ming, 2020. "Rule learning based energy management strategy of fuel cell hybrid vehicles considering multi-objective optimization," Energy, Elsevier, vol. 207(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fa, Kwok Sau, 2020. "A class of nonlinear Langevin equation with the drift and diffusion coefficients separable in time and space driven by different noises," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    2. Liu, Changqing & He, Yigang & Peng, Guanghan, 2019. "The stabilization effect of self-delayed flux integral for two-lane lattice hydrodynamic model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 535(C).
    3. Torres-Vargas, G. & Fossion, R. & Méndez-Bermúdez, J.A., 2020. "Normal mode analysis of spectra of random networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    4. Kowalski, A.M. & Plastino, A., 2019. "A nonlinear matter-field Hamiltonian analyzed with Renyi and Tsallis statistics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 535(C).
    5. Cebreiros, Florencia & Clavijo, Leonardo & Boix, Elzeario & Ferrari, Mario Daniel & Lareo, Claudia, 2020. "Integrated valorization of eucalyptus sawdust within a biorefinery approach by autohydrolysis and organosolv pretreatments," Renewable Energy, Elsevier, vol. 149(C), pages 115-127.
    6. Algaba, Encarnación & Béal, Sylvain & Fragnelli, Vito & Llorca, Natividad & Sánchez-Soriano, Joaquin, 2019. "Relationship between labeled network games and other cooperative games arising from attributes situations," Economics Letters, Elsevier, vol. 185(C).
    7. Nunes, Maria Eugênia Silva & de Mello Silva, Érica & Martins, Paulo H.L. & Florencio, João & Plascak, J.A., 2020. "Dynamics of the one-dimensional isotropic Heisenberg model with Dzyaloshinskii–Moryia interaction in a random transverse field," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 541(C).
    8. Wu, Jing Cynthia & Zhang, Ji, 2019. "A shadow rate New Keynesian model," Journal of Economic Dynamics and Control, Elsevier, vol. 107(C), pages 1-1.
    9. Aldakheel, F. & Ismail, M.S. & Hughes, K.J. & Ingham, D.B. & Ma, L. & Pourkashanian, M. & Cumming, D. & Smith, R., 2020. "Gas permeability, wettability and morphology of gas diffusion layers before and after performing a realistic ex-situ compression test," Renewable Energy, Elsevier, vol. 151(C), pages 1082-1091.
    10. Zhu, Wen-Xing & Zhang, Jing-Yu & Song, Ze-Rui, 2019. "Study on braking process of vehicles at the signalized intersection based on car-following theory," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 523(C), pages 1306-1314.
    11. Liu, Hong & Gao, Yuhang & Tisdell, Clement A. & Wang, Fei, 2020. "Are housing property rights important for fertility outcomes in China? Empirical evidence and policy issues," Economic Analysis and Policy, Elsevier, vol. 65(C), pages 211-223.
    12. Nagatani, Takashi, 2019. "Infection promotes species coexistence: Rock–paper–scissors game with epidemic on graphs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 535(C).
    13. Jiang, Mengmeng & Westerholm, Maria & Qiao, Wei & Wandera, Simon M. & Dong, Renjie, 2020. "High rate anaerobic digestion of swine wastewater in an anaerobic membrane bioreactor," Energy, Elsevier, vol. 193(C).
    14. Borjas, George J. & Cassidy, Hugh, 2019. "The wage penalty to undocumented immigration," Labour Economics, Elsevier, vol. 61(C).
    15. Ishihara, Masamichi, 2020. "Derivation of density operators for generalized entropies with quantum analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 543(C).
    16. Ou, Hui & Wang, Tao & Tang, Tie-Qiao, 2019. "Analysis of trip cost in a two-lane traffic corridor with one entry and one exit," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 524(C), pages 65-72.
    17. Birol, Fatih & Okogu, Bright E., 1997. "Purchasing-Power-Parity (PPP) approach to energy-efficiency measurement: Implications for energy and environmental policy," Energy, Elsevier, vol. 22(1), pages 7-16.
    18. Sen, Parongama, 2020. "Scaling and crossover behaviour in a truncated long range quantum walk," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    19. Gargiulo, Nicola & Peluso, Antonio & Aprea, Paolo & Marino, Ottavio & Cioffi, Raffaele & Jannelli, Elio & Cimino, Stefano & Lisi, Luciana & Caputo, Domenico, 2019. "Chromium-based MIL-101 metal organic framework as a fully regenerable D4 adsorbent for biogas purification," Renewable Energy, Elsevier, vol. 138(C), pages 230-235.
    20. Arian Zad, Hamid & Kenna, Ralph & Ananikian, Nerses, 2020. "Magnetic and thermodynamic properties of the octanuclear nickel phosphonate-based cage," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 538(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:apmaco:v:369:y:2020:i:c:s0096300319308215. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/applied-mathematics-and-computation .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.