IDEAS home Printed from https://ideas.repec.org/a/eee/stapro/v82y2012i1p58-62.html
   My bibliography  Save this article

Asymptotic efficiency of ridge estimator in linear and semiparametric linear models

Author

Listed:
  • Luo, June

Abstract

The linear model with a growing number of predictors arises in many contemporary scientific endeavor. In this article, we consider the commonly used ridge estimator in linear models. We propose analyzing the ridge estimator for a finite sample size n and a growing dimension p. The existence and asymptotic normality of the ridge estimator are established under some regularity conditions when p→∞. It also occurs that a strictly linear model is inadequate when some of the relations are believed to be of certain linear form while others are not easily parameterized, and thus a semiparametric partial linear model is considered. For these semiparametric partial linear models with p>n, we develop a procedure to estimate the linear coefficients as if the nonparametric part is not present. The asymptotic efficiency of the proposed estimator for the linear component is studied for p→∞. It is shown that the proposed estimator of the linear component asymptotically performs very well.

Suggested Citation

  • Luo, June, 2012. "Asymptotic efficiency of ridge estimator in linear and semiparametric linear models," Statistics & Probability Letters, Elsevier, vol. 82(1), pages 58-62.
    • Handle: RePEc:eee:stapro:v:82:y:2012:i:1:p:58-62
    DOI: 10.1016/j.spl.2011.08.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167715211002835
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.spl.2011.08.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yatchew, A., 1997. "An elementary estimator of the partial linear model," Economics Letters, Elsevier, vol. 57(2), pages 135-143, December.
    2. Luo, June, 2010. "The discovery of mean square error consistency of a ridge estimator," Statistics & Probability Letters, Elsevier, vol. 80(5-6), pages 343-347, March.
    3. Lam, Clifford & Fan, Jianqing, 2008. "Profile-kernel likelihood inference with diverging number of parameters," LSE Research Online Documents on Economics 31548, London School of Economics and Political Science, LSE Library.
    4. A. Yatchew, 2000. "Scale economies in electricity distribution: a semiparametric analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 187-210.
    5. Fan J. & Huang L-S., 2001. "Goodness-of-Fit Tests for Parametric Regression Models," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 640-652, June.
    6. Shao, Jun & Chow, Shein-Chung, 2007. "Variable screening in predicting clinical outcome with high-dimensional microarrays," Journal of Multivariate Analysis, Elsevier, vol. 98(8), pages 1529-1538, September.
    7. Ahn, Hyungtaik & Powell, James L., 1993. "Semiparametric estimation of censored selection models with a nonparametric selection mechanism," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 3-29, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Luo, June & Gerard, Patrick, 2013. "Using thresholding difference-based estimators for variable selection in partial linear models," Statistics & Probability Letters, Elsevier, vol. 83(12), pages 2601-2606.
    2. Luo, June & Kulasekera, K.B., 2013. "Error covariance matrix estimation using ridge estimator," Statistics & Probability Letters, Elsevier, vol. 83(1), pages 257-264.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luo, June & Gerard, Patrick, 2013. "Using thresholding difference-based estimators for variable selection in partial linear models," Statistics & Probability Letters, Elsevier, vol. 83(12), pages 2601-2606.
    2. Justin L. Tobias, 2003. "Are Returns to Schooling Concentrated Among the Most Able? A Semiparametric Analysis of the Ability–earnings Relationships," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(1), pages 1-29, February.
    3. Luo, June & Kulasekera, K.B., 2013. "Error covariance matrix estimation using ridge estimator," Statistics & Probability Letters, Elsevier, vol. 83(1), pages 257-264.
    4. Akdeniz Duran, Esra & Härdle, Wolfgang Karl & Osipenko, Maria, 2012. "Difference based ridge and Liu type estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 164-175.
    5. Shen, Leilei, 2013. "Financial dependence and growth: Diminishing returns to improvement in financial development," Economics Letters, Elsevier, vol. 120(2), pages 215-219.
    6. Justin McCrary & Heather Royer, 2011. "The Effect of Female Education on Fertility and Infant Health: Evidence from School Entry Policies Using Exact Date of Birth," American Economic Review, American Economic Association, vol. 101(1), pages 158-195, February.
    7. Dette, Holger & Marchlewski, Mareen, 2007. "A test for the parametric form of the variance function in apartial linear regression model," Technical Reports 2007,26, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    8. Shen, Chung-Wei & Tsou, Tsung-Shan & Balakrishnan, N., 2011. "Robust likelihood inference for regression parameters in partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1696-1714, April.
    9. Yatchew, A., 1999. "An elementary nonparametric differencing test of equality of regression functions," Economics Letters, Elsevier, vol. 62(3), pages 271-278, March.
    10. Chien-Chia L. Huang & Yow-Jen Jou & Hsun-Jung Cho, 2017. "Difference-based matrix perturbation method for semi-parametric regression with multicollinearity," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(12), pages 2161-2171, September.
    11. John DiNardo & Justin L. Tobias, 2001. "Nonparametric Density and Regression Estimation," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 11-28, Fall.
    12. Fikri Akdeniz & Mahdi Roozbeh, 2019. "Generalized difference-based weighted mixed almost unbiased ridge estimator in partially linear models," Statistical Papers, Springer, vol. 60(5), pages 1717-1739, October.
    13. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    14. Hardle, Wolfgang & Linton, Oliver, 1986. "Applied nonparametric methods," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 38, pages 2295-2339, Elsevier.
    15. Paul Ellickson & Sanjog Misra, 2012. "Enriching interactions: Incorporating outcome data into static discrete games," Quantitative Marketing and Economics (QME), Springer, vol. 10(1), pages 1-26, March.
    16. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    17. Mehdi Farsi & Aurelio Fetz & Massimo Filippini, 2007. "Economies of Scale and Scope in the Swiss Multi-Utilities Sector," CEPE Working paper series 07-59, CEPE Center for Energy Policy and Economics, ETH Zurich.
    18. Delgado, Miguel A & Robinson, Peter M, 1992. "Nonparametric and Semiparametric Methods for Economic Research," Journal of Economic Surveys, Wiley Blackwell, vol. 6(3), pages 201-249.
    19. Juan Carlos Escanciano & Telmo P'erez-Izquierdo, 2023. "Automatic Locally Robust Estimation with Generated Regressors," Papers 2301.10643, arXiv.org, revised Nov 2023.
    20. Mohammad Arashi & Mina Norouzirad & Mahdi Roozbeh & Naushad Mamode Khan, 2021. "A High-Dimensional Counterpart for the Ridge Estimator in Multicollinear Situations," Mathematics, MDPI, vol. 9(23), pages 1-11, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:stapro:v:82:y:2012:i:1:p:58-62. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.