IDEAS home Printed from https://ideas.repec.org/a/spr/coopap/v71y2018i1d10.1007_s10589-018-9998-x.html
   My bibliography  Save this article

Algorithms for positive semidefinite factorization

Author

Listed:
  • Arnaud Vandaele

    (Université de Mons)

  • François Glineur

    (Université Catholique de Louvain
    Université Catholique de Louvain)

  • Nicolas Gillis

    (Université de Mons)

Abstract

This paper considers the problem of positive semidefinite factorization (PSD factorization), a generalization of exact nonnegative matrix factorization. Given an m-by-n nonnegative matrix X and an integer k, the PSD factorization problem consists in finding, if possible, symmetric k-by-k positive semidefinite matrices $$\{A^1,\ldots ,A^m\}$$ { A 1 , … , A m } and $$\{B^1,\ldots ,B^n\}$$ { B 1 , … , B n } such that $$X_{i,j}=\text {trace}(A^iB^j)$$ X i , j = trace ( A i B j ) for $$i=1,\ldots ,m$$ i = 1 , … , m , and $$j=1,\ldots ,n$$ j = 1 , … , n . PSD factorization is NP-hard. In this work, we introduce several local optimization schemes to tackle this problem: a fast projected gradient method and two algorithms based on the coordinate descent framework. The main application of PSD factorization is the computation of semidefinite extensions, that is, the representations of polyhedrons as projections of spectrahedra, for which the matrix to be factorized is the slack matrix of the polyhedron. We compare the performance of our algorithms on this class of problems. In particular, we compute the PSD extensions of size $$k=1+ \lceil \log _2(n) \rceil $$ k = 1 + ⌈ log 2 ( n ) ⌉ for the regular n-gons when $$n=5$$ n = 5 , 8 and 10. We also show how to generalize our algorithms to compute the square root rank (which is the size of the factors in a PSD factorization where all factor matrices $$A^i$$ A i and $$B^j$$ B j have rank one) and completely PSD factorizations (which is the special case where the input matrix is symmetric and equality $$A^i=B^i$$ A i = B i is required for all i).

Suggested Citation

  • Arnaud Vandaele & François Glineur & Nicolas Gillis, 2018. "Algorithms for positive semidefinite factorization," Computational Optimization and Applications, Springer, vol. 71(1), pages 193-219, September.
  • Handle: RePEc:spr:coopap:v:71:y:2018:i:1:d:10.1007_s10589-018-9998-x
    DOI: 10.1007/s10589-018-9998-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10589-018-9998-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10589-018-9998-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. João Gouveia & Pablo A. Parrilo & Rekha R. Thomas, 2013. "Lifts of Convex Sets and Cone Factorizations," Mathematics of Operations Research, INFORMS, vol. 38(2), pages 248-264, May.
    2. GILLIS, Nicolas & GLINEUR, François, 2011. "Accelerated multiplicative updates and hierarchical als algorithms for nonnegative matrix factorization," LIDAM Discussion Papers CORE 2011030, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    3. Gillis, Nicolas & Glineur, François & Tuyttens, Daniel & Vandaele, Arnaud, 2015. "Heuristics for exact nonnegative matrix factorization," LIDAM Discussion Papers CORE 2015006, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. Nicolas GILLIS & François GLINEUR & Arnaud VANDAELE, 2017. "On the linear extension complexity of regular n-gons," LIDAM Reprints CORE 2830, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    5. Da Kuang & Sangwoon Yun & Haesun Park, 2015. "SymNMF: nonnegative low-rank approximation of a similarity matrix for graph clustering," Journal of Global Optimization, Springer, vol. 62(3), pages 545-574, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gribling, Sander, 2019. "Applications of optimization to factorization ranks and quantum information theory," Other publications TiSEM 5c681ab9-2344-4a07-b818-f, Tilburg University, School of Economics and Management.
    2. Shun Arahata & Takayuki Okuno & Akiko Takeda, 2023. "Complexity analysis of interior-point methods for second-order stationary points of nonlinear semidefinite optimization problems," Computational Optimization and Applications, Springer, vol. 86(2), pages 555-598, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rundong Du & Da Kuang & Barry Drake & Haesun Park, 2017. "DC-NMF: nonnegative matrix factorization based on divide-and-conquer for fast clustering and topic modeling," Journal of Global Optimization, Springer, vol. 68(4), pages 777-798, August.
    2. Gillis, Nicolas & Glineur, François & Tuyttens, Daniel & Vandaele, Arnaud, 2015. "Heuristics for exact nonnegative matrix factorization," LIDAM Discussion Papers CORE 2015006, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    3. Rundong Du & Barry Drake & Haesun Park, 2019. "Hybrid clustering based on content and connection structure using joint nonnegative matrix factorization," Journal of Global Optimization, Springer, vol. 74(4), pages 861-877, August.
    4. Takehiro Sano & Tsuyoshi Migita & Norikazu Takahashi, 2022. "A novel update rule of HALS algorithm for nonnegative matrix factorization and Zangwill’s global convergence," Journal of Global Optimization, Springer, vol. 84(3), pages 755-781, November.
    5. Andrej Čopar & Blaž Zupan & Marinka Zitnik, 2019. "Fast optimization of non-negative matrix tri-factorization," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-15, June.
    6. CHANDER, Parkash & TULKENS, Henry, 2011. "The kyoto Protocol, the Copenhagen Accord, the Cancun Agreements, and beyond: an economic and game theoretical exploration and interpretation," LIDAM Discussion Papers CORE 2011051, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    7. GAHUNGU, Joachim & SMEERS, Yves, 2011. "A real options model for electricity capacity expansion," LIDAM Discussion Papers CORE 2011044, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    8. Radu-Alexandru Dragomir & Alexandre d’Aspremont & Jérôme Bolte, 2021. "Quartic First-Order Methods for Low-Rank Minimization," Journal of Optimization Theory and Applications, Springer, vol. 189(2), pages 341-363, May.
    9. Jingu Kim & Yunlong He & Haesun Park, 2014. "Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent framework," Journal of Global Optimization, Springer, vol. 58(2), pages 285-319, February.
    10. He, Chaobo & Zhang, Qiong & Tang, Yong & Liu, Shuangyin & Zheng, Jianhua, 2019. "Community detection method based on robust semi-supervised nonnegative matrix factorization," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 523(C), pages 279-291.
    11. GABSZEWICZ, Jean J. & VAN YPERSELE, Tanguy & ZANAJ, Skerdilajda, 2011. "Does the seller of a house facing a large number of buyers always decrease its price when its first offer is rejected?," LIDAM Discussion Papers CORE 2011049, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    12. Melisew Tefera Belachew & Nicolas Gillis, 2017. "Solving the Maximum Clique Problem with Symmetric Rank-One Non-negative Matrix Approximation," Journal of Optimization Theory and Applications, Springer, vol. 173(1), pages 279-296, April.
    13. Hamza Fawzi & James Saunderson & Pablo A. Parrilo, 2017. "Equivariant Semidefinite Lifts of Regular Polygons," Mathematics of Operations Research, INFORMS, vol. 42(2), pages 472-494, May.
    14. Duy Khuong Nguyen & Tu Bao Ho, 2017. "Accelerated parallel and distributed algorithm using limited internal memory for nonnegative matrix factorization," Journal of Global Optimization, Springer, vol. 68(2), pages 307-328, June.
    15. VAN VYVE, Mathieu, 2011. "Linear prices for non-convex electricity markets: models and algorithms," LIDAM Discussion Papers CORE 2011050, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    16. Yukihiro Nishimura & Pierre Pestieau, 2016. "Efficient taxation with differential risks of dependence and mortality," Economics Bulletin, AccessEcon, vol. 36(1), pages 52-57.
    17. Veit Elser, 2017. "Matrix product constraints by projection methods," Journal of Global Optimization, Springer, vol. 68(2), pages 329-355, June.
    18. Lei Yang, 2024. "Proximal Gradient Method with Extrapolation and Line Search for a Class of Non-convex and Non-smooth Problems," Journal of Optimization Theory and Applications, Springer, vol. 200(1), pages 68-103, January.
    19. Norikazu Takahashi & Ryota Hibi, 2014. "Global convergence of modified multiplicative updates for nonnegative matrix factorization," Computational Optimization and Applications, Springer, vol. 57(2), pages 417-440, March.
    20. Gribling, Sander & Laat, David de & Laurent, Monique, 2017. "Lower Bounds on Matrix Factorization Ranks via Noncommutative Polynomial Optimization," Other publications TiSEM 2dddf156-3d4b-4936-bf02-a, Tilburg University, School of Economics and Management.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:coopap:v:71:y:2018:i:1:d:10.1007_s10589-018-9998-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.