IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v210y2025ics0047259x25000685.html

Generalized score matching

Author

Listed:
  • Xu, Jiazhen
  • Scealy, Janice L.
  • Wood, Andrew T.A.
  • Zou, Tao

Abstract

Score matching is an estimation procedure that has been developed for statistical models whose probability density function or probability mass function is known up to proportionality but whose normalizing constant is intractable, so that maximum likelihood is difficult or impossible to implement. To date, applications of score matching have focused more on continuous IID models. Motivated by various data modeling problems, this article proposes a unified asymptotic theory of generalized score matching developed under the independence assumption, covering both continuous and discrete response data, thereby giving a sound basis for score-matching-based inference. Real data analyses and simulation studies provide convincing evidence of strong practical performance of the proposed methods.

Suggested Citation

  • Xu, Jiazhen & Scealy, Janice L. & Wood, Andrew T.A. & Zou, Tao, 2025. "Generalized score matching," Journal of Multivariate Analysis, Elsevier, vol. 210(C).
    • Handle: RePEc:eee:jmvana:v:210:y:2025:i:c:s0047259x25000685
    DOI: 10.1016/j.jmva.2025.105473
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X25000685
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2025.105473?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jenish, Nazgul & Prucha, Ingmar R., 2009. "Central limit theorems and uniform laws of large numbers for arrays of random fields," Journal of Econometrics, Elsevier, vol. 150(1), pages 86-98, May.
    2. Kaiser, Mark S. & Cressie, Noel, 2000. "The Construction of Multivariate Distributions from Markov Random Fields," Journal of Multivariate Analysis, Elsevier, vol. 73(2), pages 199-220, May.
    3. Fan, Xinyan & Zhang, Qingzhao & Ma, Shuangge & Fang, Kuangnan, 2021. "Conditional score matching for high-dimensional partial graphical models," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    4. Galit Shmueli & Thomas P. Minka & Joseph B. Kadane & Sharad Borle & Peter Boatwright, 2005. "A useful distribution for fitting discrete data: revival of the Conway–Maxwell–Poisson distribution," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(1), pages 127-142, January.
    5. Saharon Rosset & Ryan J. Tibshirani, 2020. "From Fixed-X to Random-X Regression: Bias-Variance Decompositions, Covariance Penalties, and Prediction Error Estimation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 138-151, January.
    6. Saharon Rosset & Ryan J. Tibshirani, 2020. "From Fixed-X to Random-X Regression: Bias-Variance Decompositions, Covariance Penalties, and Prediction Error Estimation: Rejoinder," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 161-162, January.
    7. Takuo Matsubara & Jeremias Knoblauch & François-Xavier Briol & Chris. J. Oates, 2024. "Generalized Bayesian Inference for Discrete Intractable Likelihood," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(547), pages 2345-2355, July.
    8. Jie Cheng & Elizaveta Levina & Pei Wang & Ji Zhu, 2014. "A sparse ising model with covariates," Biometrics, The International Biometric Society, vol. 70(4), pages 943-953, December.
    9. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504.
    10. J. Scott Long & Jeremy Freese, 2006. "Regression Models for Categorical Dependent Variables using Stata, 2nd Edition," Stata Press books, StataCorp LLC, edition 2, number long2, March.
    11. T. Tony Cai & Hongzhe Li & Weidong Liu & Jichun Xie, 2013. "Covariate-adjusted precision matrix estimation with an application in genetical genomics," Biometrika, Biometrika Trust, vol. 100(1), pages 139-156.
    12. Xiongtao Dai & Zhenhua Lin & Hans‐Georg Müller, 2021. "Modeling sparse longitudinal data on Riemannian manifolds," Biometrics, The International Biometric Society, vol. 77(4), pages 1328-1341, December.
    13. J. L. Scealy & A. H. Welsh, 2011. "Regression for compositional data by using distributions defined on the hypersphere," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(3), pages 351-375, June.
    14. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    15. Junlong Zhao & Xiumin Liu & Hansheng Wang & Chenlei Leng, 2022. "Dimension reduction for covariates in network data [On semidefinite relaxations for the block model]," Biometrika, Biometrika Trust, vol. 109(1), pages 85-102.
    16. Janice L. Scealy & Andrew T. A. Wood, 2023. "Score Matching for Compositional Distributions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(543), pages 1811-1823, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhuang, Juncong & Chen, Jie & Wei, Bangji & Lin, Xiaoqing & Li, Xiaodong & Yan, Jianhua, 2026. "Recent advances in chloride molten salt-based thermal energy storage: Melting behavior, modification, and corrosion mitigation strategies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 229(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiao Guo & Hai Zhang, 2020. "Sparse directed acyclic graphs incorporating the covariates," Statistical Papers, Springer, vol. 61(5), pages 2119-2148, October.
    2. Weihua Zhao & Weiping Zhang & Heng Lian, 2020. "Marginal quantile regression for varying coefficient models with longitudinal data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(1), pages 213-234, February.
    3. Tino Werner, 2022. "Asymptotic linear expansion of regularized M-estimators," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(1), pages 167-194, February.
    4. Runmin Shi & Faming Liang & Qifan Song & Ye Luo & Malay Ghosh, 2018. "A Blockwise Consistency Method for Parameter Estimation of Complex Models," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(1), pages 179-223, December.
    5. He, Xin & Mao, Xiaojun & Wang, Zhonglei, 2024. "Nonparametric augmented probability weighting with sparsity," Computational Statistics & Data Analysis, Elsevier, vol. 191(C).
    6. Sermpinis, Georgios & Tsoukas, Serafeim & Zhang, Ping, 2018. "Modelling market implied ratings using LASSO variable selection techniques," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 19-35.
    7. Bradley Efron, 2021. "Resampling Plans and the Estimation of Prediction Error," Stats, MDPI, vol. 4(4), pages 1-25, December.
    8. DelSole, Timothy & Tippett, Michael K., 2021. "Correcting the corrected AIC," Statistics & Probability Letters, Elsevier, vol. 173(C).
    9. Guangxin Jiang & L. Jeff Hong & Barry L. Nelson, 2020. "Online Risk Monitoring Using Offline Simulation," INFORMS Journal on Computing, INFORMS, vol. 32(2), pages 356-375, April.
    10. Chen, Jia & Li, Degui & Li, Yu-Ning & Linton, Oliver, 2025. "Estimating time-varying networks for high-dimensional time series," Journal of Econometrics, Elsevier, vol. 249(PC).
    11. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    12. Jinsuk Yang & Qing Hao & Mahmut Yaşar, 2023. "Institutional investors and cross‐border mergers and acquisitions: The 2000–2018 period," International Review of Finance, International Review of Finance Ltd., vol. 23(3), pages 553-583, September.
    13. Guan, Wei & Gray, Alexander, 2013. "Sparse high-dimensional fractional-norm support vector machine via DC programming," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 136-148.
    14. Margherita Giuzio, 2017. "Genetic algorithm versus classical methods in sparse index tracking," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 40(1), pages 243-256, November.
    15. Chang, Jinyuan & Chen, Song Xi & Chen, Xiaohong, 2015. "High dimensional generalized empirical likelihood for moment restrictions with dependent data," Journal of Econometrics, Elsevier, vol. 185(1), pages 283-304.
    16. Xu, Yang & Zhao, Shishun & Hu, Tao & Sun, Jianguo, 2021. "Variable selection for generalized odds rate mixture cure models with interval-censored failure time data," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    17. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Emmanouil Androulakis & Christos Koukouvinos & Kalliopi Mylona & Filia Vonta, 2010. "A real survival analysis application via variable selection methods for Cox's proportional hazards model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(8), pages 1399-1406.
    19. Meng An & Haixiang Zhang, 2023. "High-Dimensional Mediation Analysis for Time-to-Event Outcomes with Additive Hazards Model," Mathematics, MDPI, vol. 11(24), pages 1-11, December.
    20. Gregory Thompson & Jeffrey Brown & Torsha Bhattacharya, 2012. "What Really Matters for Increasing Transit Ridership: Understanding the Determinants of Transit Ridership Demand in Broward County, Florida," Urban Studies, Urban Studies Journal Limited, vol. 49(15), pages 3327-3345, November.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:210:y:2025:i:c:s0047259x25000685. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.