IDEAS home Printed from https://ideas.repec.org/a/spr/joptap/v200y2024i3d10.1007_s10957-023-02336-8.html
   My bibliography  Save this article

Golden Ratio Proximal Gradient ADMM for Distributed Composite Convex Optimization

Author

Listed:
  • Chao Yin

    (Nanjing University)

  • Junfeng Yang

    (Nanjing University)

Abstract

This paper introduces a golden ratio proximal gradient alternating direction method of multipliers (GRPG-ADMM) for distributed composite convex optimization. When applied to the consensus optimization problem, the GRPG-ADMM provides a superior safety protection approach to computing an optimal decision for a network of agents connected by edges in an undirected graph. To ensure convergence, we expand the parameter range used in the convex combination step. The algorithm has been implemented to solve a decentralized composite convex consensus optimization problem, resulting in a single-loop decentralized golden ratio proximal gradient algorithm. Notably, the agents do not need to communicate with their neighbors before launching the algorithm. Our algorithm guarantees convergence for both primal and dual iterates, with an ergodic convergence rate of $$\mathcal O(1/k)$$ O ( 1 / k ) measured by function value residual and consensus violation. To demonstrate the efficiency of the algorithm, we compare its performance with two state-of-the-art algorithms and present numerical results on the decentralized sparse group LASSO problem and the decentralized compressed sensing problem.

Suggested Citation

  • Chao Yin & Junfeng Yang, 2024. "Golden Ratio Proximal Gradient ADMM for Distributed Composite Convex Optimization," Journal of Optimization Theory and Applications, Springer, vol. 200(3), pages 895-922, March.
    • Handle: RePEc:spr:joptap:v:200:y:2024:i:3:d:10.1007_s10957-023-02336-8
    DOI: 10.1007/s10957-023-02336-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10957-023-02336-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10957-023-02336-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hongmei Chen & Guoyong Gu & Junfeng Yang, 2023. "A golden ratio proximal alternating direction method of multipliers for separable convex optimization," Journal of Global Optimization, Springer, vol. 87(2), pages 581-602, November.
    2. Laurent Condat, 2013. "A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms," Journal of Optimization Theory and Applications, Springer, vol. 158(2), pages 460-479, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Puya Latafat & Panagiotis Patrinos, 2017. "Asymmetric forward–backward–adjoint splitting for solving monotone inclusions involving three operators," Computational Optimization and Applications, Springer, vol. 68(1), pages 57-93, September.
    2. Xin Jiang & Lieven Vandenberghe, 2022. "Bregman primal–dual first-order method and application to sparse semidefinite programming," Computational Optimization and Applications, Springer, vol. 81(1), pages 127-159, January.
    3. Sun, Shilin & Wang, Tianyang & Yang, Hongxing & Chu, Fulei, 2022. "Damage identification of wind turbine blades using an adaptive method for compressive beamforming based on the generalized minimax-concave penalty function," Renewable Energy, Elsevier, vol. 181(C), pages 59-70.
    4. David Degras, 2021. "Sparse group fused lasso for model segmentation: a hybrid approach," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(3), pages 625-671, September.
    5. Fernando Roldán, 2025. "Forward-Primal-Dual-Half-Forward Algorithm for Splitting Four Operators," Journal of Optimization Theory and Applications, Springer, vol. 204(1), pages 1-26, January.
    6. Xiaoliang Wang & Liping Pang & Qi Wu & Mingkun Zhang, 2021. "An Adaptive Proximal Bundle Method with Inexact Oracles for a Class of Nonconvex and Nonsmooth Composite Optimization," Mathematics, MDPI, vol. 9(8), pages 1-27, April.
    7. Walaa M. Moursi & Lieven Vandenberghe, 2019. "Douglas–Rachford Splitting for the Sum of a Lipschitz Continuous and a Strongly Monotone Operator," Journal of Optimization Theory and Applications, Springer, vol. 183(1), pages 179-198, October.
    8. Adil Salim & Laurent Condat & Konstantin Mishchenko & Peter Richtárik, 2022. "Dualize, Split, Randomize: Toward Fast Nonsmooth Optimization Algorithms," Journal of Optimization Theory and Applications, Springer, vol. 195(1), pages 102-130, October.
    9. Luis Briceño-Arias & Fernando Roldán, 2023. "Primal-dual splittings as fixed point iterations in the range of linear operators," Journal of Global Optimization, Springer, vol. 85(4), pages 847-866, April.
    10. Ke-wei Ding & Jörg Fliege & Phan Tu Vuong, 2025. "Fast convergence of the primal-dual dynamical system and corresponding algorithms for a nonsmooth bilinearly coupled saddle point problem," Computational Optimization and Applications, Springer, vol. 90(1), pages 151-192, January.
    11. Eisuke Yamagata & Shunsuke Ono, 2023. "Sparse Index Tracking: Simultaneous Asset Selection and Capital Allocation via $\ell_0$-Constrained Portfolio," Papers 2309.10152, arXiv.org, revised Mar 2024.
    12. Dong, Yunda, 2024. "Extended splitting methods for systems of three-operator monotone inclusions with continuous operators," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 223(C), pages 86-107.
    13. Ying Gao & Wenxing Zhang, 2023. "An alternative extrapolation scheme of PDHGM for saddle point problem with nonlinear function," Computational Optimization and Applications, Springer, vol. 85(1), pages 263-291, May.
    14. S. Bonettini & M. Prato & S. Rebegoldi, 2023. "A nested primal–dual FISTA-like scheme for composite convex optimization problems," Computational Optimization and Applications, Springer, vol. 84(1), pages 85-123, January.
    15. Wenli Huang & Yuchao Tang & Meng Wen & Haiyang Li, 2022. "Relaxed Variable Metric Primal-Dual Fixed-Point Algorithm with Applications," Mathematics, MDPI, vol. 10(22), pages 1-16, November.
    16. Luis Briceño-Arias & Julio Deride & Cristian Vega, 2022. "Random Activations in Primal-Dual Splittings for Monotone Inclusions with a Priori Information," Journal of Optimization Theory and Applications, Springer, vol. 192(1), pages 56-81, January.
    17. Xin Jiang & Lieven Vandenberghe, 2023. "Bregman Three-Operator Splitting Methods," Journal of Optimization Theory and Applications, Springer, vol. 196(3), pages 936-972, March.
    18. Yunda Dong, 2021. "Weak convergence of an extended splitting method for monotone inclusions," Journal of Global Optimization, Springer, vol. 79(1), pages 257-277, January.
    19. Paul-Emile Maingé & André Weng-Law, 2024. "Accelerated forward–backward algorithms for structured monotone inclusions," Computational Optimization and Applications, Springer, vol. 88(1), pages 167-215, May.
    20. Cécile Bastidon & Myriam Bontonou & Pierre Borgnat & Pablo Jensen & Patrice Abry & Antoine Parent, 2024. "Learning smooth graphs with sparse temporal variations to explore long-term financial trends," Post-Print hal-04731912, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joptap:v:200:y:2024:i:3:d:10.1007_s10957-023-02336-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.