IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v10y2022i21p4059-d959829.html
   My bibliography  Save this article

Pairwise Constraints Multidimensional Scaling for Discriminative Feature Learning

Author

Listed:
  • Linghao Zhang

    (State Gid Sichuan Electric Power Research Institute, Power Internet of Things Key Laboratory of Sichuan Province, Chengdu 610094, China)

  • Bo Pang

    (State Gid Sichuan Electric Power Research Institute, Power Internet of Things Key Laboratory of Sichuan Province, Chengdu 610094, China)

  • Haitao Tang

    (School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611731, China
    Manufacturing Industry Chains Collaboration and Information Support Technology Key Laboratory of Sichuan Province, Chengdu 611731, China)

  • Hongjun Wang

    (School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611731, China
    Manufacturing Industry Chains Collaboration and Information Support Technology Key Laboratory of Sichuan Province, Chengdu 611731, China)

  • Chongshou Li

    (School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611731, China
    Manufacturing Industry Chains Collaboration and Information Support Technology Key Laboratory of Sichuan Province, Chengdu 611731, China)

  • Zhipeng Luo

    (School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611731, China
    Manufacturing Industry Chains Collaboration and Information Support Technology Key Laboratory of Sichuan Province, Chengdu 611731, China)

Abstract

As an important data analysis method in the field of machine learning and data mining, feature learning has a wide range of applications in various industries. The traditional multidimensional scaling (MDS) maintains the topology of data points in the low-dimensional embeddings obtained during feature learning, but ignores the discriminative nature between classes of low-dimensional embedded data. Thus, the discriminative multidimensional scaling based on pairwise constraints for feature learning (pcDMDS) model is proposed in this paper. The model enhances the discriminativeness from two aspects. The first aspect is to increase the compactness of the new data representation in the same cluster through fuzzy k -means. The second aspect is to obtain more extended pairwise constraint information between samples. In the whole feature learning process, the model considers both the topology of samples in the original space and the cluster structure in the new space. It also incorporates the extended pairwise constraint information in the samples, which further improves the model’s ability to obtain discriminative features. Finally, the experimental results on twelve datasets show that pcDMDS performs 10.31 % and 8.31 % higher than PMDS model in terms of accuracy and purity.

Suggested Citation

  • Linghao Zhang & Bo Pang & Haitao Tang & Hongjun Wang & Chongshou Li & Zhipeng Luo, 2022. "Pairwise Constraints Multidimensional Scaling for Discriminative Feature Learning," Mathematics, MDPI, vol. 10(21), pages 1-16, November.
  • Handle: RePEc:gam:jmathe:v:10:y:2022:i:21:p:4059-:d:959829
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/10/21/4059/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/10/21/4059/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ian C McDowell & Dinesh Manandhar & Christopher M Vockley & Amy K Schmid & Timothy E Reddy & Barbara E Engelhardt, 2018. "Clustering gene expression time series data using an infinite Gaussian process mixture model," PLOS Computational Biology, Public Library of Science, vol. 14(1), pages 1-27, January.
    2. Jan Leeuw, 1988. "Convergence of the majorization method for multidimensional scaling," Journal of Classification, Springer;The Classification Society, vol. 5(2), pages 163-180, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Weihua Ou & Jianping Gou & Shaoning Zeng & Lan Du, 2023. "Preface to the Special Issue “Advancement of Mathematical Methods in Feature Representation Learning for Artificial Intelligence, Data Mining and Robotics”—Special Issue Book," Mathematics, MDPI, vol. 11(4), pages 1-4, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Patrick Groenen & Rudolf Mathar & Willem Heiser, 1995. "The majorization approach to multidimensional scaling for Minkowski distances," Journal of Classification, Springer;The Classification Society, vol. 12(1), pages 3-19, March.
    2. Hanafi, Mohamed & Kiers, Henk A.L., 2006. "Analysis of K sets of data, with differential emphasis on agreement between and within sets," Computational Statistics & Data Analysis, Elsevier, vol. 51(3), pages 1491-1508, December.
    3. Michael J. Greenacre & Patrick J. F. Groenen, 2016. "Weighted Euclidean Biplots," Journal of Classification, Springer;The Classification Society, vol. 33(3), pages 442-459, October.
    4. Mijeong Kim & Yu Jin Jang & Muyoung Lee & Qingqing Guo & Albert J. Son & Nikita A. Kakkad & Abigail B. Roland & Bum-Kyu Lee & Jonghwan Kim, 2024. "The transcriptional regulatory network modulating human trophoblast stem cells to extravillous trophoblast differentiation," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    5. Simon J. L. Billinge & Phillip M. Duxbury & Douglas S. Gonçalves & Carlile Lavor & Antonio Mucherino, 2018. "Recent results on assigned and unassigned distance geometry with applications to protein molecules and nanostructures," Annals of Operations Research, Springer, vol. 271(1), pages 161-203, December.
    6. Peter Verboon & Willem Heiser, 1992. "Resistant orthogonal procrustes analysis," Journal of Classification, Springer;The Classification Society, vol. 9(2), pages 237-256, December.
    7. Qidi Peng & Nan Rao & Ran Zhao, 2019. "Some Developments in Clustering Analysis on Stochastic Processes," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 9(3), pages 72-77, April.
    8. de Leeuw, Jan & Mair, Patrick, 2009. "Multidimensional Scaling Using Majorization: SMACOF in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 31(i03).
    9. Wei Liu & Li Yang & Bo Yu, 2020. "A Lifting-Penalty Method for Quadratic Programming with a Quadratic Matrix Inequality Constraint," Mathematics, MDPI, vol. 8(2), pages 1-11, January.
    10. van den Burg, G.J.J. & Groenen, P.J.F., 2014. "GenSVM: A Generalized Multiclass Support Vector Machine," Econometric Institute Research Papers EI 2014-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    11. Kiers, Henk A. L., 2002. "Setting up alternating least squares and iterative majorization algorithms for solving various matrix optimization problems," Computational Statistics & Data Analysis, Elsevier, vol. 41(1), pages 157-170, November.
    12. Kagie, M. & van Wezel, M.C. & Groenen, P.J.F., 2007. "A graphical shopping interface bases on product attributes," Econometric Institute Research Papers EI 2007-02, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    13. Jacobovic Royi, 2018. "On the relation between the true and sample correlations under Bayesian modelling of gene expression datasets," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 17(4), pages 1-14, August.
    14. Leung, Pui Lam & Lau, Kin-nam, 2004. "Estimating the city-block two-dimensional scaling model with simulated annealing," European Journal of Operational Research, Elsevier, vol. 158(2), pages 518-524, October.
    15. Husson, F. & Pages, J., 2006. "INDSCAL model: geometrical interpretation and methodology," Computational Statistics & Data Analysis, Elsevier, vol. 50(2), pages 358-378, January.
    16. Kagie, M. & van Wezel, M.C. & Groenen, P.J.F., 2009. "Map Based Visualization of Product Catalogs," ERIM Report Series Research in Management ERS-2009-010-MKT, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    17. Groenen, P.J.F. & Borg, I., 2013. "The Past, Present, and Future of Multidimensional Scaling," Econometric Institute Research Papers EI 2013-07, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    18. Giuseppe Ciaburro & Gino Iannace, 2021. "Machine Learning-Based Algorithms to Knowledge Extraction from Time Series Data: A Review," Data, MDPI, vol. 6(6), pages 1-30, May.
    19. Groenen, P.J.F. & van de Velden, M., 2004. "Multidimensional scaling," Econometric Institute Research Papers EI 2004-15, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    20. Robert Schneider, 1992. "A uniform approach to multidimensional scaling," Journal of Classification, Springer;The Classification Society, vol. 9(2), pages 257-273, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:21:p:4059-:d:959829. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.