IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v41y2026i2d10.1007_s00180-025-01713-3.html

Semi-proximal ADMM for fused Lasso penalized least absolute deviation in partially linear model

Author

Listed:
  • Fanke Kong

    (Henan University of Science and Technology, School of Mathematics and Statistics)

  • Zheng-Fen Jin

    (Henan University of Science and Technology, School of Mathematics and Statistics)

  • Youlin Shang

    (Henan University of Science and Technology, School of Mathematics and Statistics)

  • Yunhai Xiao

    (Henan University, Center for Applied Mathematics of Henan Province)

  • Deren Han

    (Beihang University, LMIB of the Ministry of Education, School of Mathematical Sciences)

Abstract

The partially linear model is a type of semiparametric regression model characterized by unknown linear regression coefficients, an unknown nonparametric function, and random errors. This model is particularly useful when the relationship between the dependent variable and some predictors is not strictly linear, allowing for more flexibility in capturing complex relationships in the data. In this paper, we propose a novel variable selection model using fused lasso penalized least absolute deviation in partially linear model (PLM-RFlasso), while simultaneously estimating both parametric and nonparametric components. The proposed model exhibits superior robustness and applicability compared to the least squares model. It is capable of handling high-dimensional data with correlated adjacent variables and with outliers or containing variables with heavy tailed distributions. Then we design a semi-proximal alternating direction method of multipliers (sPADMM) to solve the dual problem of PLM-RFlasso, and give its convergence guarantees and statistical property analysis. Finally, numerical experiments on simulated and real datasets illustrate the robustness and the effectiveness of the proposed model and algorithm.

Suggested Citation

  • Fanke Kong & Zheng-Fen Jin & Youlin Shang & Yunhai Xiao & Deren Han, 2026. "Semi-proximal ADMM for fused Lasso penalized least absolute deviation in partially linear model," Computational Statistics, Springer, vol. 41(2), pages 1-36, February.
  • Handle: RePEc:spr:compst:v:41:y:2026:i:2:d:10.1007_s00180-025-01713-3
    DOI: 10.1007/s00180-025-01713-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-025-01713-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00180-025-01713-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Peili Li & Min Liu & Zhou Yu, 2023. "A global two-stage algorithm for non-convex penalized high-dimensional linear regression problems," Computational Statistics, Springer, vol. 38(2), pages 871-898, June.
    2. Yongxin Liu & Peng Zeng & Lu Lin, 2021. "Degrees of freedom for regularized regression with Huber loss and linear constraints," Statistical Papers, Springer, vol. 62(5), pages 2383-2405, October.
    3. M. H. Xu & T. Wu, 2011. "A Class of Linearized Proximal Alternating Direction Methods," Journal of Optimization Theory and Applications, Springer, vol. 151(2), pages 321-337, November.
    4. Wang, Xiuli & Zhao, Shengli & Wang, Mingqiu, 2017. "Restricted profile estimation for partially linear models with large-dimensional covariates," Statistics & Probability Letters, Elsevier, vol. 128(C), pages 71-76.
    5. Jianchao Bai & Miao Zhang & Hongchao Zhang, 2025. "An inexact ADMM for separable nonconvex and nonsmooth optimization," Computational Optimization and Applications, Springer, vol. 90(2), pages 445-479, March.
    6. Li, Qi, 2000. "Efficient Estimation of Additive Partially Linear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 1073-1092, November.
    7. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    8. Wang, Hansheng & Li, Guodong & Jiang, Guohua, 2007. "Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 347-355, July.
    9. Jianchao Bai & William W. Hager & Hongchao Zhang, 2022. "An inexact accelerated stochastic ADMM for separable convex optimization," Computational Optimization and Applications, Springer, vol. 81(2), pages 479-518, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aifen Feng & Xiaogai Chang & Jingya Fan & Zhengfen Jin, 2023. "Application of LADMM and As-LADMM for a High-Dimensional Partially Linear Model," Mathematics, MDPI, vol. 11(19), pages 1-14, October.
    2. Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.
    3. Aifen Feng & Xiaogai Chang & Youlin Shang & Jingya Fan, 2022. "Application of the ADMM Algorithm for a High-Dimensional Partially Linear Model," Mathematics, MDPI, vol. 10(24), pages 1-13, December.
    4. Kim, Kun Ho & Chao, Shih-Kang & Härdle, Wolfgang Karl, 2020. "Simultaneous Inference of the Partially Linear Model with a Multivariate Unknown Function," IRTG 1792 Discussion Papers 2020-008, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    5. Ferraccioli, Federico & Sangalli, Laura M. & Finos, Livio, 2022. "Some first inferential tools for spatial regression with differential regularization," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    6. Akdeniz Duran, Esra & Härdle, Wolfgang Karl & Osipenko, Maria, 2012. "Difference based ridge and Liu type estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 164-175.
    7. Zhu, Xuehu & Wang, Tao & Zhao, Junlong & Zhu, Lixing, 2017. "Inference for biased transformation models," Computational Statistics & Data Analysis, Elsevier, vol. 109(C), pages 105-120.
    8. Xin Lu & Brent A. Johnson, 2015. "Direct estimation of the mean outcome on treatment when treatment assignment and discontinuation compete," Biometrika, Biometrika Trust, vol. 102(4), pages 797-807.
    9. Mou, Xichen & Wang, Dewei, 2024. "Additive partially linear model for pooled biomonitoring data," Computational Statistics & Data Analysis, Elsevier, vol. 190(C).
    10. Zhang, Jun & Feng, Zhenghui & Peng, Heng, 2018. "Estimation and hypothesis test for partial linear multiplicative models," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 87-103.
    11. Wang, Xiuli & Zhao, Shengli & Wang, Mingqiu, 2017. "Restricted profile estimation for partially linear models with large-dimensional covariates," Statistics & Probability Letters, Elsevier, vol. 128(C), pages 71-76.
    12. Wei Lan & Ronghua Luo & Chih-Ling Tsai & Hansheng Wang & Yunhong Yang, 2015. "Testing the Diagonality of a Large Covariance Matrix in a Regression Setting," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 76-86, January.
    13. Zhang, Yuanqing & Sun, Yanqing, 2015. "Estimation of partially specified dynamic spatial panel data models with fixed-effects," Regional Science and Urban Economics, Elsevier, vol. 51(C), pages 37-46.
    14. Zhang, Jun & Zhou, Yan & Lin, Bingqing & Yu, Yao, 2017. "Estimation and hypothesis test on partial linear models with additive distortion measurement errors," Computational Statistics & Data Analysis, Elsevier, vol. 112(C), pages 114-128.
    15. A. Delaigle & P. Hall & J. R. Wishart, 2014. "New approaches to nonparametric and semiparametric regression for univariate and multivariate group testing data," Biometrika, Biometrika Trust, vol. 101(3), pages 567-585.
    16. Daniel Becker & Alois Kneip & Valentin Patilea, 2021. "Semiparametric inference for partially linear regressions with Box-Cox transformation," Papers 2106.10723, arXiv.org.
    17. Dong, Chaohua & Gao, Jiti & Linton, Oliver, 2023. "High dimensional semiparametric moment restriction models," Journal of Econometrics, Elsevier, vol. 232(2), pages 320-345.
    18. Roozbeh, Mahdi, 2016. "Robust ridge estimator in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 127-144.
    19. Han Shang, 2014. "Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density," Computational Statistics, Springer, vol. 29(3), pages 829-848, June.
    20. Helmut Wasserbacher & Martin Spindler, 2024. "Credit Ratings: Heterogeneous Effect on Capital Structure," Papers 2406.18936, arXiv.org.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:41:y:2026:i:2:d:10.1007_s00180-025-01713-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.