IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v110y2015i512p1463-1478.html

A Simple Formula for Mixing Estimators With Different Convergence Rates

Author

Listed:
  • Stephen S. M. Lee
  • Mehdi Soleymani

Abstract

Suppose that two estimators, and , are available for estimating an unknown parameter θ, and are known to have convergence rates n -super-1/2 and r n = o ( n -super-1/2), respectively, based on a sample of size n . Typically, the more efficient estimator is less robust than , and a definitive choice cannot be easily made between them under practical circumstances. We propose a simple mixture estimator, in the form of a linear combination of and , which successfully reaps the benefits of both estimators. We prove that the mixture estimator possesses a kind of oracle property so that it captures the fast n -super-1/2 convergence rate of when conditions are favorable, and is at least r n -consistent otherwise. Applications of the mixture estimator are illustrated with examples drawn from different problem settings including orthogonal function regression, local polynomial regression, density derivative estimation, and bootstrap inferences for possibly dependent data.

Suggested Citation

  • Stephen S. M. Lee & Mehdi Soleymani, 2015. "A Simple Formula for Mixing Estimators With Different Convergence Rates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1463-1478, December.
    • Handle: RePEc:taf:jnlasa:v:110:y:2015:i:512:p:1463-1478
    DOI: 10.1080/01621459.2014.960966
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2014.960966
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/01621459.2014.960966?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Pötscher, Benedikt M. & Leeb, Hannes, 2009. "On the distribution of penalized maximum likelihood estimators: The LASSO, SCAD, and thresholding," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2065-2082, October.
    2. Fan, Yanqin & Ullah, Aman, 1999. "Asymptotic Normality of a Combined Regression Estimator," Journal of Multivariate Analysis, Elsevier, vol. 71(2), pages 191-240, November.
    3. Ying Wei & Yanyuan Ma & Raymond J. Carroll, 2012. "Multiple imputation in quantile regression," Biometrika, Biometrika Trust, vol. 99(2), pages 423-438.
    4. Ying Yuan & Guosheng Yin, 2011. "Dose–Response Curve Estimation: A Semiparametric Mixture Approach," Biometrics, The International Biometric Society, vol. 67(4), pages 1543-1554, December.
    5. Chen, Yi-Hau & Chatterjee, Nilanjan & Carroll, Raymond J., 2009. "Shrinkage Estimators for Robust and Efficient Inference in Haplotype-Based Case-Control Studies," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 220-233.
    6. Ahmed, S. Ejaz & Nicol, Christopher J., 2012. "An application of shrinkage estimation to the nonlinear regression model," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3309-3321.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gildas Mazo & François Portier, 2021. "Parametric versus nonparametric: The fitness coefficient," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(4), pages 1344-1383, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tonghui Yu & Liming Xiang & Huixia Judy Wang, 2021. "Quantile regression for survival data with covariates subject to detection limits," Biometrics, The International Biometric Society, vol. 77(2), pages 610-621, June.
    2. Hao Cheng & Ying Wei, 2018. "A fast imputation algorithm in quantile regression," Computational Statistics, Springer, vol. 33(4), pages 1589-1603, December.
    3. Dabo-Niang, Sophie & Francq, Christian & Zakoïan, Jean-Michel, 2010. "Combining Nonparametric and Optimal Linear Time Series Predictions," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1554-1565.
    4. Anders Bredahl Kock, 2012. "On the Oracle Property of the Adaptive Lasso in Stationary and Nonstationary Autoregressions," CREATES Research Papers 2012-05, Department of Economics and Business Economics, Aarhus University.
    5. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney K. Newey, 2016. "Double machine learning for treatment and causal parameters," CeMMAP working papers 49/16, Institute for Fiscal Studies.
    6. Talamakrouni, Majda & El Ghouch, Anouar & Van Keilegom, Ingrid, 2012. "Guided censored regression," LIDAM Discussion Papers ISBA 2012023, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    7. Andreas Groll & Gerhard Tutz, 2017. "Variable selection in discrete survival models including heterogeneity," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 23(2), pages 305-338, April.
    8. Liugen Xue & Junshan Xie, 2024. "Efficient robust estimation for single-index mixed effects models with missing observations," Statistical Papers, Springer, vol. 65(2), pages 827-864, April.
    9. Marcelo C. Medeiros & Eduardo F. Mendes, 2015. "l1-Regularization of High-Dimensional Time-Series Models with Flexible Innovations," Textos para discussão 636, Department of Economics PUC-Rio (Brazil).
    10. Harding, Matthew & Lamarche, Carlos, 2019. "A panel quantile approach to attrition bias in Big Data: Evidence from a randomized experiment," Journal of Econometrics, Elsevier, vol. 211(1), pages 61-82.
    11. Bo Sun & Siyuan Cheng & Jingdong Xie & Xin Sun, 2022. "Identification of Generators’ Economic Withholding Behavior Based on a SCAD-Logit Model in Electricity Spot Market," Energies, MDPI, vol. 15(11), pages 1-23, June.
    12. Yoshimasa Uematsu & Takashi Yamagata, 2019. "Estimation of Weak Factor Models," ISER Discussion Paper 1053r, Institute of Social and Economic Research, The University of Osaka, revised Mar 2020.
    13. Stanislav Anatolyev, 2007. "Optimal Instruments In Time Series: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 21(1), pages 143-173, February.
    14. Hao Cheng, 2025. "Efficient B-spline imputation methods in functional structural equation model with missing data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 34(4), pages 1036-1079, December.
    15. Drukker, David M. & Liu, Di, 2025. "A cluster plugin method for selecting the GLM lasso tuning parameters in models for unbalanced panel data," Econometrics and Statistics, Elsevier, vol. 34(C), pages 14-31.
    16. Tino Werner, 2022. "Asymptotic linear expansion of regularized M-estimators," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(1), pages 167-194, February.
    17. Cheng Chou & Ruoyao Shi, 2020. "Utilizing Two Types of Survey Data to Enhance the Accuracy of Labor Supply Elasticity Estimation," Working Papers 202018, University of California at Riverside, Department of Economics.
    18. Liu, Xiaodong & Prucha, Ingmar R., 2018. "A robust test for network generated dependence," Journal of Econometrics, Elsevier, vol. 207(1), pages 92-113.
    19. Farrell, Max H., 2015. "Robust inference on average treatment effects with possibly more covariates than observations," Journal of Econometrics, Elsevier, vol. 189(1), pages 1-23.
    20. Adolfo Maza, 2006. "Migrations and Regional Convergence: The Case of Spain," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 26(2), pages 191-202, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:110:y:2015:i:512:p:1463-1478. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.