IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v77y2021i1p113-124.html
   My bibliography  Save this article

On computation of semiparametric maximum likelihood estimators with shape constraints

Author

Listed:
  • Yudong Wang
  • Zhi‐Sheng Ye
  • Hongyuan Cao

Abstract

Large sample theory of semiparametric models based on maximum likelihood estimation (MLE) with shape constraint on the nonparametric component is well studied. Relatively less attention has been paid to the computational aspect of semiparametric MLE. The computation of semiparametric MLE based on existing approaches such as the expectation‐maximization (EM) algorithm can be computationally prohibitive when the missing rate is high. In this paper, we propose a computational framework for semiparametric MLE based on an inexact block coordinate ascent (BCA) algorithm. We show theoretically that the proposed algorithm converges. This computational framework can be applied to a wide range of data with different structures, such as panel count data, interval‐censored data, and degradation data, among others. Simulation studies demonstrate favorable performance compared with existing algorithms in terms of accuracy and speed. Two data sets are used to illustrate the proposed computational method. We further implement the proposed computational method in R package BCA1SG, available at CRAN.

Suggested Citation

  • Yudong Wang & Zhi‐Sheng Ye & Hongyuan Cao, 2021. "On computation of semiparametric maximum likelihood estimators with shape constraints," Biometrics, The International Biometric Society, vol. 77(1), pages 113-124, March.
  • Handle: RePEc:bla:biomet:v:77:y:2021:i:1:p:113-124
    DOI: 10.1111/biom.13266
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13266
    Download Restriction: no

    File URL: https://libkey.io/10.1111/biom.13266?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jianguo Sun, 2003. "A nonparametric test for panel count data," Biometrika, Biometrika Trust, vol. 90(1), pages 199-208, March.
    2. Wang, Xiao, 2010. "Wiener processes with random effects for degradation data," Journal of Multivariate Analysis, Elsevier, vol. 101(2), pages 340-351, February.
    3. Gang Cheng & Ying Zhang & Liqiang Lu, 2011. "Efficient algorithms for computing the non and semi-parametric maximum likelihood estimates with panel count data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(2), pages 567-579.
    4. P. Tseng, 2001. "Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization," Journal of Optimization Theory and Applications, Springer, vol. 109(3), pages 475-494, June.
    5. Lu, Minggen & Zhang, Ying & Huang, Jian, 2009. "Semiparametric Estimation Methods for Panel Count Data Using Monotone B-Splines," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1060-1070.
    6. Jamshidian, Mortaza, 2004. "On algorithms for restricted maximum likelihood estimation," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 137-157, March.
    7. Ying Zhang & Lei Hua & Jian Huang, 2010. "A Spline‐Based Semiparametric Maximum Likelihood Estimation Method for the Cox Model with Interval‐Censored Data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 37(2), pages 338-354, June.
    8. Lianming Wang & Christopher S. McMahan & Michael G. Hudgens & Zaina P. Qureshi, 2016. "A flexible, computationally efficient method for fitting the proportional hazards model to interval-censored data," Biometrics, The International Biometric Society, vol. 72(1), pages 222-231, March.
    9. Donglin Zeng & Lu Mao & D. Y. Lin, 2016. "Maximum likelihood estimation for semiparametric transformation models with interval-censored data," Biometrika, Biometrika Trust, vol. 103(2), pages 253-271.
    10. Cassioli, A. & Di Lorenzo, D. & Sciandrone, M., 2013. "On the convergence of inexact block coordinate descent methods for constrained optimization," European Journal of Operational Research, Elsevier, vol. 231(2), pages 274-281.
    11. Sy Han Chiou & Gongjun Xu & Jun Yan & Chiung‐Yu Huang, 2018. "Semiparametric estimation of the accelerated mean model with panel count data under informative examination times," Biometrics, The International Biometric Society, vol. 74(3), pages 944-953, September.
    12. Thomas R. Fleming & D. Y. Lin, 2000. "Survival Analysis in Clinical Trials: Past Developments and Future Directions," Biometrics, The International Biometric Society, vol. 56(4), pages 971-983, December.
    13. Qingning Zhou & Tao Hu & Jianguo Sun, 2017. "A Sieve Semiparametric Maximum Likelihood Approach for Regression Analysis of Bivariate Interval-Censored Failure Time Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 664-672, April.
    14. J. Sun & L. J. Wei, 2000. "Regression analysis of panel count data with covariate‐dependent observation and censoring times," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(2), pages 293-302.
    15. Lu, Minggen, 2010. "Spline-based sieve maximum likelihood estimation in the partly linear model under monotonicity constraints," Journal of Multivariate Analysis, Elsevier, vol. 101(10), pages 2528-2542, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qingning Zhou & Jianwen Cai & Haibo Zhou, 2018. "Outcome†dependent sampling with interval†censored failure time data," Biometrics, The International Biometric Society, vol. 74(1), pages 58-67, March.
    2. Minggen Lu, 2015. "Spline estimation of generalised monotonic regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 27(1), pages 19-39, March.
    3. Gang Cheng & Ying Zhang & Liqiang Lu, 2011. "Efficient algorithms for computing the non and semi-parametric maximum likelihood estimates with panel count data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(2), pages 567-579.
    4. Yanqing Sun & Qingning Zhou & Peter B. Gilbert, 2023. "Analysis of the Cox Model with Longitudinal Covariates with Measurement Errors and Partly Interval Censored Failure Times, with Application to an AIDS Clinical Trial," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(2), pages 430-454, July.
    5. Da Xu & Hui Zhao & Jianguo Sun, 2018. "Joint analysis of interval-censored failure time data and panel count data," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 24(1), pages 94-109, January.
    6. Xin He & Xuenan Feng & Xingwei Tong & Xingqiu Zhao, 2017. "Semiparametric partially linear varying coefficient models with panel count data," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 23(3), pages 439-466, July.
    7. Zhao, Xingqiu & Tong, Xingwei & Sun, Jianguo, 2013. "Robust estimation for panel count data with informative observation times," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 33-40.
    8. Sy Han Chiou & Gongjun Xu & Jun Yan & Chiung‐Yu Huang, 2018. "Semiparametric estimation of the accelerated mean model with panel count data under informative examination times," Biometrics, The International Biometric Society, vol. 74(3), pages 944-953, September.
    9. Yao, Bin & Wang, Lianming & He, Xin, 2016. "Semiparametric regression analysis of panel count data allowing for within-subject correlation," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 47-59.
    10. Xingqiu Zhao & Jianguo Sun, 2011. "Nonparametric Comparison for Panel Count Data with Unequal Observation Processes," Biometrics, The International Biometric Society, vol. 67(3), pages 770-779, September.
    11. Fei Qin & Zhangsheng Yu, 2021. "Penalized spline estimation for panel count data model with time-varying coefficients," Computational Statistics, Springer, vol. 36(4), pages 2413-2434, December.
    12. Liuquan Sun & Shuwei Li & Lianming Wang & Xinyuan Song & Xuemei Sui, 2022. "Simultaneous variable selection in regression analysis of multivariate interval‐censored data," Biometrics, The International Biometric Society, vol. 78(4), pages 1402-1413, December.
    13. Liang Zhu & Ying Zhang & Yimei Li & Jianguo Sun & Leslie L. Robison, 2018. "A semiparametric likelihood†based method for regression analysis of mixed panel†count data," Biometrics, The International Biometric Society, vol. 74(2), pages 488-497, June.
    14. Ye, Mao & Lu, Zhao-Hua & Li, Yimei & Song, Xinyuan, 2019. "Finite mixture of varying coefficient model: Estimation and component selection," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 452-474.
    15. Eddie Anderson & Artem Prokhorov & Yajing Zhu, 2020. "A Simple Estimator of Two‐Dimensional Copulas, with Applications," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(6), pages 1375-1412, December.
    16. Jianguo Sun & Xingwei Tong & Xin He, 2007. "Regression Analysis of Panel Count Data with Dependent Observation Times," Biometrics, The International Biometric Society, vol. 63(4), pages 1053-1059, December.
    17. Du, Mingyue & Li, Huiqiong & Sun, Jianguo, 2021. "Regression analysis of censored data with nonignorable missing covariates and application to Alzheimer Disease," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    18. Li, Yang & Zhao, Hui & Sun, Jianguo & Kim, KyungMann, 2014. "Nonparametric tests for panel count data with unequal observation processes," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 103-111.
    19. N. Balakrishnan & Xingqiu Zhao, 2011. "A class of multi-sample nonparametric tests for panel count data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(1), pages 135-156, February.
    20. Xingwei Tong & Xin He & Liuquan Sun & Jianguo Sun, 2009. "Variable Selection for Panel Count Data via Non‐Concave Penalized Estimating Function," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(4), pages 620-635, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:77:y:2021:i:1:p:113-124. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.