IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v60y2019i3d10.1007_s00362-016-0843-y.html
   My bibliography  Save this article

Some improved estimation strategies in high-dimensional semiparametric regression models with application to riboflavin production data

Author

Listed:
  • M. Arashi

    (Shahrood University of Technology)

  • Mahdi Roozbeh

    (Semnan University)

Abstract

Due to advances in technologies, modern statistical studies often encounter linear models with high-dimension, where the number of explanatory variables is larger than the sample size. Estimation in these high-dimensional problems with deterministic covariates or designs is very different from those in the case of random covariates, due to the identifiability of the high-dimensional semiparametric regression parameters. In this paper, we consider ridge estimators and propose preliminary test, shrinkage and its positive rule ridge estimators in the restricted semiparametric regression model when the errors are dependent under a multicollinear setting, in high-dimension. The asymptotic risk expressions in addition to biases are exactly derived for the estimators under study. For our proposal, a real data analysis about production of vitamin B2 and a Monté–Carlo simulation study are considered to illustrate the efficiency of the proposed estimators. In this regard, kernel smoothing and cross-validation methods for estimating the optimum ridge parameter and nonparametric function are used.

Suggested Citation

  • M. Arashi & Mahdi Roozbeh, 2019. "Some improved estimation strategies in high-dimensional semiparametric regression models with application to riboflavin production data," Statistical Papers, Springer, vol. 60(3), pages 667-686, June.
    • Handle: RePEc:spr:stpapr:v:60:y:2019:i:3:d:10.1007_s00362-016-0843-y
    DOI: 10.1007/s00362-016-0843-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-016-0843-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00362-016-0843-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jibo Wu & Hu Yang, 2016. "More on the unbiased ridge regression estimation," Statistical Papers, Springer, vol. 57(1), pages 31-42, March.
    2. M. Arashi & T. Valizadeh, 2015. "Performance of Kibria’s methods in partial linear ridge regression model," Statistical Papers, Springer, vol. 56(1), pages 231-246, February.
    3. Raheem, S.M. Enayetur & Ahmed, S. Ejaz & Doksum, Kjell A., 2012. "Absolute penalty and shrinkage estimation in partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 874-891.
    4. Jialiang Li & Wenyang Zhang & Zhengxiao Wu, 2011. "Optimal zone for bandwidth selection in semiparametric models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(3), pages 701-717.
    5. M. Arashi & A. Saleh & S. Tabatabaey, 2010. "Estimation of parameters of parallelism model with elliptically distributed errors," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 71(1), pages 79-100, January.
    6. Roozbeh, Mahdi, 2015. "Shrinkage ridge estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 56-74.
    7. Akdeniz Duran, Esra & Härdle, Wolfgang Karl & Osipenko, Maria, 2012. "Difference based ridge and Liu type estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 164-175.
    8. Li, Qi, 2000. "Efficient Estimation of Additive Partially Linear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 1073-1092, November.
    9. A. Saleh & B. Golam Kibria, 2011. "On some ridge regression estimators: a nonparametric approach," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(3), pages 819-851.
    10. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    11. Amini, Morteza & Roozbeh, Mahdi, 2015. "Optimal partial ridge estimation in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 26-40.
    12. Arashi, M. & Tabatabaey, S.M.M., 2009. "Improved variance estimation under sub-space restriction," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1752-1760, September.
    13. Roozbeh, M. & Arashi, M., 2013. "Feasible ridge estimator in partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 35-44.
    14. Zhang, Chunming & Li, Jialiang & Meng, Jingci, 2008. "On Stein's lemma, dependent covariates and functional monotonicity in multi-dimensional modeling," Journal of Multivariate Analysis, Elsevier, vol. 99(10), pages 2285-2303, November.
    15. repec:hum:journl:v:105:y:2012:i:1:p:164-175 is not listed on IDEAS
    16. Saber Fallahpour & S. Ejaz Ahmed & Kjell A. Doksum, 2012. "L1 penalty and shrinkage estimation in partially linear models with random coefficient autoregressive errors," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 28(3), pages 236-250, May.
    17. Arashi, M. & Kibria, B.M. Golam & Norouzirad, M. & Nadarajah, S., 2014. "Improved preliminary test and Stein-rule Liu estimators for the ill-conditioned elliptical linear regression model," Journal of Multivariate Analysis, Elsevier, vol. 126(C), pages 53-74.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roozbeh, Mahdi, 2016. "Robust ridge estimator in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 127-144.
    2. Roozbeh, Mahdi, 2015. "Shrinkage ridge estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 56-74.
    3. Roozbeh, Mahdi, 2018. "Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 45-61.
    4. Bahadır Yüzbaşı & S. Ejaz Ahmed & Dursun Aydın, 2020. "Ridge-type pretest and shrinkage estimations in partially linear models," Statistical Papers, Springer, vol. 61(2), pages 869-898, April.
    5. Hadi Emami, 2018. "Local influence for Liu estimators in semiparametric linear models," Statistical Papers, Springer, vol. 59(2), pages 529-544, June.
    6. Amini, Morteza & Roozbeh, Mahdi, 2015. "Optimal partial ridge estimation in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 26-40.
    7. Guozhi Hu & Weihu Cheng & Jie Zeng, 2023. "Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data," Mathematics, MDPI, vol. 11(3), pages 1-21, February.
    8. Mohammad Arashi & Mina Norouzirad & S. Ejaz Ahmed & Bahadır Yüzbaşı, 2018. "Rank-based Liu regression," Computational Statistics, Springer, vol. 33(3), pages 1525-1561, September.
    9. Kim, Kun Ho & Chao, Shih-Kang & Härdle, Wolfgang Karl, 2020. "Simultaneous Inference of the Partially Linear Model with a Multivariate Unknown Function," IRTG 1792 Discussion Papers 2020-008, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    10. Dette, Holger & Marchlewski, Mareen, 2007. "A test for the parametric form of the variance function in apartial linear regression model," Technical Reports 2007,26, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    11. Ferraccioli, Federico & Sangalli, Laura M. & Finos, Livio, 2022. "Some first inferential tools for spatial regression with differential regularization," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    12. Cui, Xia & Lu, Ying & Peng, Heng, 2017. "Estimation of partially linear regression models under the partial consistency property," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 103-121.
    13. Yuejin Zhou & Yebin Cheng & Wenlin Dai & Tiejun Tong, 2018. "Optimal difference-based estimation for partially linear models," Computational Statistics, Springer, vol. 33(2), pages 863-885, June.
    14. Zhu, Xuehu & Wang, Tao & Zhao, Junlong & Zhu, Lixing, 2017. "Inference for biased transformation models," Computational Statistics & Data Analysis, Elsevier, vol. 109(C), pages 105-120.
    15. Kim, Namhyun & W. Saart, Patrick, 2021. "Estimation in partially linear semiparametric models with parametric and/or nonparametric endogeneity," Cardiff Economics Working Papers E2021/9, Cardiff University, Cardiff Business School, Economics Section.
    16. Lu Lin & Lili Liu & Xia Cui & Kangning Wang, 2021. "A generalized semiparametric regression and its efficient estimation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(1), pages 1-24, March.
    17. Aifen Feng & Xiaogai Chang & Jingya Fan & Zhengfen Jin, 2023. "Application of LADMM and As-LADMM for a High-Dimensional Partially Linear Model," Mathematics, MDPI, vol. 11(19), pages 1-14, October.
    18. B. Ettinger & S. Perotto & L. M. Sangalli, 2016. "Spatial regression models over two-dimensional manifolds," Biometrika, Biometrika Trust, vol. 103(1), pages 71-88.
    19. Lian, Heng & Liang, Hua, 2016. "Separation of linear and index covariates in partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 56-70.
    20. Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:60:y:2019:i:3:d:10.1007_s00362-016-0843-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.