IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v41y2002i1p157-170.html
   My bibliography  Save this article

Setting up alternating least squares and iterative majorization algorithms for solving various matrix optimization problems

Author

Listed:
  • Kiers, Henk A. L.

Abstract

No abstract is available for this item.

Suggested Citation

  • Kiers, Henk A. L., 2002. "Setting up alternating least squares and iterative majorization algorithms for solving various matrix optimization problems," Computational Statistics & Data Analysis, Elsevier, vol. 41(1), pages 157-170, November.
    • Handle: RePEc:eee:csdana:v:41:y:2002:i:1:p:157-170
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(02)00142-1
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Henk Kiers, 1997. "Weighted least squares fitting using ordinary least squares algorithms," Psychometrika, Springer;The Psychometric Society, vol. 62(2), pages 251-266, June.
    2. Henk Kiers, 1990. "Majorization as a tool for optimizing a class of matrix functions," Psychometrika, Springer;The Psychometric Society, vol. 55(3), pages 417-428, September.
    3. Norman Cliff, 1966. "Orthogonal rotation to congruence," Psychometrika, Springer;The Psychometric Society, vol. 31(1), pages 33-42, March.
    4. Henk Kiers, 1995. "Maximization of sums of quotients of quadratic forms and some generalizations," Psychometrika, Springer;The Psychometric Society, vol. 60(2), pages 221-245, June.
    5. Jos Berge & Klaas Nevels, 1977. "A general solution to Mosier's oblique procrustes problem," Psychometrika, Springer;The Psychometric Society, vol. 42(4), pages 593-600, December.
    6. Henk Kiers & Jos Berge, 1992. "Minimization of a class of matrix trace functions by means of refined majorization," Psychometrika, Springer;The Psychometric Society, vol. 57(3), pages 371-382, September.
    7. Jan Leeuw, 1988. "Convergence of the majorization method for multidimensional scaling," Journal of Classification, Springer;The Classification Society, vol. 5(2), pages 163-180, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Groenen, P.J.F. & Giaquinto, P. & Kiers, H.A.L., 2003. "Weighted Majorization Algorithms for Weighted Least Squares Decomposition Models," Econometric Institute Research Papers EI 2003-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    2. Heij, C. & Groenen, P.J.F. & van Dijk, D.J.C., 2006. "Time series forecasting by principal covariate regression," Econometric Institute Research Papers EI 2006-37, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    3. Naoto Yamashita, 2023. "Principal component analysis constrained by layered simple structures," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(2), pages 347-367, June.
    4. Raoul Pietersz & Patrick Groenen, 2004. "Rank reduction of correlation matrices by majorization," Quantitative Finance, Taylor & Francis Journals, vol. 4(6), pages 649-662.
    5. Cristina Tortora & Brian C. Franczak & Ryan P. Browne & Paul D. McNicholas, 2019. "A Mixture of Coalesced Generalized Hyperbolic Distributions," Journal of Classification, Springer;The Classification Society, vol. 36(1), pages 26-57, April.
    6. Groenen, P.J.F. & Winsberg, S. & Rodriguez, O. & Diday, E., 2005. "SymScal: symbolic multidimensional scaling of interval dissimilarities," Econometric Institute Research Papers EI 2005-15, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Antonio Calcagnì & Luigi Lombardi & Lorenzo Avanzi & Eduardo Pascali, 2020. "Multiple mediation analysis for interval-valued data," Statistical Papers, Springer, vol. 61(1), pages 347-369, February.
    8. Groenen, P.J.F. & Kaymak, U. & van Rosmalen, J.M., 2006. "Fuzzy clustering with Minkowski distance," Econometric Institute Research Papers EI 2006-24, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    9. Ryan Browne & Paul McNicholas, 2014. "Estimating common principal components in high dimensions," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 8(2), pages 217-226, June.
    10. Qingna Li & Houduo Qi & Naihua Xiu, 2011. "Block relaxation and majorization methods for the nearest correlation matrix with factor structure," Computational Optimization and Applications, Springer, vol. 50(2), pages 327-349, October.
    11. Markovsky, Ivan & Niranjan, Mahesan, 2010. "Approximate low-rank factorization with structured factors," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3411-3420, December.
    12. Kim, Nam-Hwui & Browne, Ryan P., 2021. "In the pursuit of sparseness: A new rank-preserving penalty for a finite mixture of factor analyzers," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    13. Laura Vicente-Gonzalez & Jose Luis Vicente-Villardon, 2022. "Partial Least Squares Regression for Binary Responses and Its Associated Biplot Representation," Mathematics, MDPI, vol. 10(15), pages 1-23, July.
    14. Kuroda, Masahiro & Mori, Yuichi & Iizuka, Masaya & Sakakihara, Michio, 2011. "Acceleration of the alternating least squares algorithm for principal components analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 143-153, January.
    15. Salvatore D. Tomarchio & Luca Bagnato & Antonio Punzo, 2022. "Model-based clustering via new parsimonious mixtures of heavy-tailed distributions," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 106(2), pages 315-347, June.
    16. Rosember Guerra-Urzola & Niek C. Schipper & Anya Tonne & Klaas Sijtsma & Juan C. Vera & Katrijn Deun, 2023. "Sparsifying the least-squares approach to PCA: comparison of lasso and cardinality constraint," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(1), pages 269-286, March.
    17. van Deun, K. & Groenen, P.J.F. & Delbeke, L., 2005. "VIPSCAL: A combined vector ideal point model for preference data," Econometric Institute Research Papers EI 2005-03, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    18. Li, Guoqi & Tang, Pei & Meng, Ziyang & Wen, Changyun & Pei, Jing & Shi, Luping, 2018. "Optimization on matrix manifold based on gradient information and its applications in network control," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 508(C), pages 481-500.
    19. Groenen, P.J.F. & Bioch, J.C. & Nalbantov, G.I., 2006. "Nonlinear support vector machines through iterative majorization and I-splines," Econometric Institute Research Papers EI 2006-25, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    20. Krijnen, Wim P., 2006. "Convergence of the sequence of parameters generated by alternating least squares algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 51(2), pages 481-489, November.
    21. K. Van Deun & P. J. F. Groenen, 2005. "Majorization Algorithms for Inspecting Circles, Ellipses, Squares, Rectangles, and Rhombi," Operations Research, INFORMS, vol. 53(6), pages 957-967, December.
    22. Groenen, P.J.F. & Winsberg, S. & Rodriguez, O. & Diday, E., 2006. "I-Scal: Multidimensional scaling of interval dissimilarities," Computational Statistics & Data Analysis, Elsevier, vol. 51(1), pages 360-378, November.
    23. Groenen, P.J.F. & Nalbantov, G.I. & Bioch, J.C., 2007. "SVM-Maj: a majorization approach to linear support vector machines with different hinge errors," Econometric Institute Research Papers EI 2007-49, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hanafi, Mohamed & Kiers, Henk A.L., 2006. "Analysis of K sets of data, with differential emphasis on agreement between and within sets," Computational Statistics & Data Analysis, Elsevier, vol. 51(3), pages 1491-1508, December.
    2. Robert Jennrich, 2001. "A simple general procedure for orthogonal rotation," Psychometrika, Springer;The Psychometric Society, vol. 66(2), pages 289-306, June.
    3. Henk Kiers, 1997. "Techniques for rotating two or more loading matrices to optimal agreement and simple structure: A comparison and some technical details," Psychometrika, Springer;The Psychometric Society, vol. 62(4), pages 545-568, December.
    4. Henk Kiers, 1997. "Weighted least squares fitting using ordinary least squares algorithms," Psychometrika, Springer;The Psychometric Society, vol. 62(2), pages 251-266, June.
    5. Henk Kiers, 1995. "Maximization of sums of quotients of quadratic forms and some generalizations," Psychometrika, Springer;The Psychometric Society, vol. 60(2), pages 221-245, June.
    6. Kohei Adachi, 2009. "Joint Procrustes Analysis for Simultaneous Nonsingular Transformation of Component Score and Loading Matrices," Psychometrika, Springer;The Psychometric Society, vol. 74(4), pages 667-683, December.
    7. Henk Kiers & Patrick Groenen, 1996. "A monotonically convergent algorithm for orthogonal congruence rotation," Psychometrika, Springer;The Psychometric Society, vol. 61(2), pages 375-389, June.
    8. Mohammed Bennani Dosse & Jos Berge, 2010. "Anisotropic Orthogonal Procrustes Analysis," Journal of Classification, Springer;The Classification Society, vol. 27(1), pages 111-128, March.
    9. Justin L. Kern, 2017. "On the Correspondence Between Procrustes Analysis and Bidimensional Regression," Journal of Classification, Springer;The Classification Society, vol. 34(1), pages 35-48, April.
    10. Naoto Yamashita, 2023. "Principal component analysis constrained by layered simple structures," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(2), pages 347-367, June.
    11. Qing Li & Long Hai Vo, 2021. "Intangible Capital and Innovation: An Empirical Analysis of Vietnamese Enterprises," Economics Discussion / Working Papers 21-02, The University of Western Australia, Department of Economics.
    12. Joost Ginkel & Pieter Kroonenberg, 2014. "Using Generalized Procrustes Analysis for Multiple Imputation in Principal Component Analysis," Journal of Classification, Springer;The Classification Society, vol. 31(2), pages 242-269, July.
    13. Husson, François & Josse, Julie & Saporta, Gilbert, 2016. "Jan de Leeuw and the French School of Data Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 73(i06).
    14. de Leeuw, Jan, 2006. "Principal component analysis of binary data by iterated singular value decomposition," Computational Statistics & Data Analysis, Elsevier, vol. 50(1), pages 21-39, January.
    15. Henk Kiers, 1994. "Simplimax: Oblique rotation to an optimal target with simple structure," Psychometrika, Springer;The Psychometric Society, vol. 59(4), pages 567-579, December.
    16. Patrick Groenen & Rudolf Mathar & Willem Heiser, 1995. "The majorization approach to multidimensional scaling for Minkowski distances," Journal of Classification, Springer;The Classification Society, vol. 12(1), pages 3-19, March.
    17. Stegeman, Alwin, 2016. "A new method for simultaneous estimation of the factor model parameters, factor scores, and unique parts," Computational Statistics & Data Analysis, Elsevier, vol. 99(C), pages 189-203.
    18. Xu Cheng & Zhipeng Liao & Frank Schorfheide, 2016. "Shrinkage Estimation of High-Dimensional Factor Models with Structural Instabilities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1511-1543.
    19. Michael J. Greenacre & Patrick J. F. Groenen, 2016. "Weighted Euclidean Biplots," Journal of Classification, Springer;The Classification Society, vol. 33(3), pages 442-459, October.
    20. Michael Browne & Walter Kristof, 1969. "On the oblique rotation of a factor matrix to a specified pattern," Psychometrika, Springer;The Psychometric Society, vol. 34(2), pages 237-248, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:41:y:2002:i:1:p:157-170. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.