IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v72y2016i4p1173-1183.html
   My bibliography  Save this article

Oracle estimation of parametric models under boundary constraints

Author

Listed:
  • Kin Yau Wong
  • Yair Goldberg
  • Jason P. Fine

Abstract

In many classical estimation problems, the parameter space has a boundary. In most cases, the standard asymptotic properties of the estimator do not hold when some of the underlying true parameters lie on the boundary. However, without knowledge of the true parameter values, confidence intervals constructed assuming that the parameters lie in the interior are generally over‐conservative. A penalized estimation method is proposed in this article to address this issue. An adaptive lasso procedure is employed to shrink the parameters to the boundary, yielding oracle inference which adapt to whether or not the true parameters are on the boundary. When the true parameters are on the boundary, the inference is equivalent to that which would be achieved with a priori knowledge of the boundary, while if the converse is true, the inference is equivalent to that which is obtained in the interior of the parameter space. The method is demonstrated under two practical scenarios, namely the frailty survival model and linear regression with order‐restricted parameters. Simulation studies and real data analyses show that the method performs well with realistic sample sizes and exhibits certain advantages over standard methods.

Suggested Citation

  • Kin Yau Wong & Yair Goldberg & Jason P. Fine, 2016. "Oracle estimation of parametric models under boundary constraints," Biometrics, The International Biometric Society, vol. 72(4), pages 1173-1183, December.
  • Handle: RePEc:bla:biomet:v:72:y:2016:i:4:p:1173-1183
    DOI: 10.1111/biom.12520
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.12520
    Download Restriction: no

    File URL: https://libkey.io/10.1111/biom.12520?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Donglin Zeng & D. Y. Lin, 2006. "Efficient estimation of semiparametric transformation models for counting processes," Biometrika, Biometrika Trust, vol. 93(3), pages 627-640, September.
    3. Shang, Junfeng & Cavanaugh, Joseph E., 2008. "Bootstrap variants of the Akaike information criterion for mixed model selection," Computational Statistics & Data Analysis, Elsevier, vol. 52(4), pages 2004-2021, January.
    4. A. N. Pettitt, 1984. "Proportional Odds Models for Survival Data and Estimates Using Ranks," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 33(2), pages 169-175, June.
    5. Howard D. Bondell & Arun Krishna & Sujit K. Ghosh, 2010. "Joint Variable Selection for Fixed and Random Effects in Linear Mixed-Effects Models," Biometrics, The International Biometric Society, vol. 66(4), pages 1069-1077, December.
    6. Joseph G. Ibrahim & Hongtu Zhu & Ramon I. Garcia & Ruixin Guo, 2011. "Fixed and Random Effects Selection in Mixed Effects Models," Biometrics, The International Biometric Society, vol. 67(2), pages 495-503, June.
    7. Hirotsu, Chihiro & Srivastava, Muni S., 2000. "Simultaneous confidence intervals based on one-sided max t test," Statistics & Probability Letters, Elsevier, vol. 49(1), pages 25-37, August.
    8. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    9. Torben Martinussen & Thomas H. Scheike, 2009. "Covariate Selection for the Semiparametric Additive Risk Model," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(4), pages 602-619, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simona Buscemi & Antonella Plaia, 2020. "Model selection in linear mixed-effect models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(4), pages 529-575, December.
    2. Ping Wu & Xinchao Luo & Peirong Xu & Lixing Zhu, 2017. "New variable selection for linear mixed-effects models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(3), pages 627-646, June.
    3. Mojtaba Ganjali & Taban Baghfalaki, 2018. "Application of Penalized Mixed Model in Identification of Genes in Yeast Cell-Cycle Gene Expression Data," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 6(2), pages 38-41, April.
    4. Shakhawat Hossain & Trevor Thomson & Ejaz Ahmed, 2018. "Shrinkage estimation in linear mixed models for longitudinal data," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 81(5), pages 569-586, July.
    5. Zangdong He & Wanzhu Tu & Sijian Wang & Haoda Fu & Zhangsheng Yu, 2015. "Simultaneous variable selection for joint models of longitudinal and survival outcomes," Biometrics, The International Biometric Society, vol. 71(1), pages 178-187, March.
    6. Jan Pablo Burgard & Joscha Krause & Ralf Münnich, 2019. "Penalized Small Area Models for the Combination of Unit- and Area-level Data," Research Papers in Economics 2019-05, University of Trier, Department of Economics.
    7. Kramlinger, Peter & Schneider, Ulrike & Krivobokova, Tatyana, 2023. "Uniformly valid inference based on the Lasso in linear mixed models," Journal of Multivariate Analysis, Elsevier, vol. 198(C).
    8. Joseph G. Ibrahim & Hongtu Zhu & Ramon I. Garcia & Ruixin Guo, 2011. "Fixed and Random Effects Selection in Mixed Effects Models," Biometrics, The International Biometric Society, vol. 67(2), pages 495-503, June.
    9. Tan, Xin Lu, 2019. "Optimal estimation of slope vector in high-dimensional linear transformation models," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 179-204.
    10. Luoying Yang & Tong Tong Wu, 2023. "Model‐based clustering of high‐dimensional longitudinal data via regularization," Biometrics, The International Biometric Society, vol. 79(2), pages 761-774, June.
    11. Po-Hsien Huang & Hung Chen & Li-Jen Weng, 2017. "A Penalized Likelihood Method for Structural Equation Modeling," Psychometrika, Springer;The Psychometric Society, vol. 82(2), pages 329-354, June.
    12. Zhang, Yan-Qing & Tian, Guo-Liang & Tang, Nian-Sheng, 2016. "Latent variable selection in structural equation models," Journal of Multivariate Analysis, Elsevier, vol. 152(C), pages 190-205.
    13. Wenyan Zhong & Xuewen Lu & Jingjing Wu, 2021. "Bi-level variable selection in semiparametric transformation models with right-censored data," Computational Statistics, Springer, vol. 36(3), pages 1661-1692, September.
    14. Wei Wang & Shou‐En Lu & Jerry Q. Cheng & Minge Xie & John B. Kostis, 2022. "Multivariate survival analysis in big data: A divide‐and‐combine approach," Biometrics, The International Biometric Society, vol. 78(3), pages 852-866, September.
    15. Abhik Ghosh & Magne Thoresen, 2018. "Non-concave penalization in linear mixed-effect models and regularized selection of fixed effects," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 179-210, April.
    16. Yan, Xiaodong & Wang, Hongni & Wang, Wei & Xie, Jinhan & Ren, Yanyan & Wang, Xinjun, 2021. "Optimal model averaging forecasting in high-dimensional survival analysis," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1147-1155.
    17. Chen, Xiaolin & Wang, Qihua, 2013. "Variable selection in the additive rate model for recurrent event data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 491-503.
    18. Zhang, Hao Helen & Lu, Wenbin & Wang, Hansheng, 2010. "On sparse estimation for semiparametric linear transformation models," Journal of Multivariate Analysis, Elsevier, vol. 101(7), pages 1594-1606, August.
    19. Rohart, Florian & San Cristobal, Magali & Laurent, Béatrice, 2014. "Selection of fixed effects in high dimensional linear mixed models using a multicycle ECM algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 209-222.
    20. Li, Haocheng & Shu, Di & He, Wenqing & Yi, Grace Y., 2019. "Variable selection via the composite likelihood method for multilevel longitudinal data with missing responses and covariates," Computational Statistics & Data Analysis, Elsevier, vol. 135(C), pages 25-34.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:72:y:2016:i:4:p:1173-1183. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.