IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v76y2024i3d10.1007_s10463-023-00895-1.html
   My bibliography  Save this article

Regularized nonlinear regression with dependent errors and its application to a biomechanical model

Author

Listed:
  • Hojun You

    (University of Houston)

  • Kyubaek Yoon

    (Yonsei University)

  • Wei-Ying Wu

    (National Dong Hwa University)

  • Jongeun Choi

    (Yonsei University)

  • Chae Young Lim

    (Seoul National University)

Abstract

A biomechanical model often requires parameter estimation and selection in a known but complicated nonlinear function. Motivated by observing that the data from a head-neck position tracking system, one of biomechanical models, show multiplicative time-dependent errors, we develop a modified penalized weighted least squares estimator. The proposed method can be also applied to a model with possible non-zero mean time-dependent additive errors. Asymptotic properties of the proposed estimator are investigated under mild conditions on a weight matrix and the error process. A simulation study demonstrates that the proposed estimation works well in both parameter estimation and selection with time-dependent error. The analysis and comparison with an existing method for head-neck position tracking data show better performance of the proposed method in terms of the variance accounted for.

Suggested Citation

  • Hojun You & Kyubaek Yoon & Wei-Ying Wu & Jongeun Choi & Chae Young Lim, 2024. "Regularized nonlinear regression with dependent errors and its application to a biomechanical model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 76(3), pages 481-510, June.
    • Handle: RePEc:spr:aistmt:v:76:y:2024:i:3:d:10.1007_s10463-023-00895-1
    DOI: 10.1007/s10463-023-00895-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10463-023-00895-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10463-023-00895-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jun Zhang & Bingqing Lin & Yiping Yang, 2022. "Maximum nonparametric kernel likelihood estimation for multiplicative linear regression models," Statistical Papers, Springer, vol. 63(3), pages 885-918, June.
    2. Juliane Geller & Michael H. Neumann, 2018. "Improved local polynomial estimation in time series regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 30(1), pages 1-27, January.
    3. El Machkouri, Mohamed & Es-Sebaiy, Khalifa & Ouassou, Idir, 2017. "On local linear regression for strongly mixing random fields," Journal of Multivariate Analysis, Elsevier, vol. 156(C), pages 103-115.
    4. Chen, Kani & Lin, Yuanyuan & Wang, Zhanfeng & Ying, Zhiliang, 2016. "Least product relative error estimation," Journal of Multivariate Analysis, Elsevier, vol. 144(C), pages 91-98.
    5. Radchenko, Peter, 2015. "High dimensional single index models," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 266-282.
    6. Liqun Wang & Alexandre Leblanc, 2008. "Second-order nonlinear least squares estimation," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 60(4), pages 883-900, December.
    7. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    8. Simon N. Wood, 2010. "Statistical inference for noisy nonlinear ecological dynamic systems," Nature, Nature, vol. 466(7310), pages 1102-1104, August.
    9. Chen, Kani & Guo, Shaojun & Lin, Yuanyuan & Ying, Zhiliang, 2010. "Least Absolute Relative Error Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1104-1112.
    10. Athreya, Krishna B. & Pantula, Sastry G., 1986. "A note on strong mixing of ARMA processes," Statistics & Probability Letters, Elsevier, vol. 4(4), pages 187-190, June.
    11. Wang, Qiying, 2021. "Least Squares Estimation For Nonlinear Regression Models With Heteroscedasticity," Econometric Theory, Cambridge University Press, vol. 37(6), pages 1267-1289, December.
    12. Bhattacharyya, B. B. & Khoshgoftaar, T. M. & Richardson, G. D., 1992. "Inconsistent M-estimators: nonlinear regression with multiplicative error," Statistics & Probability Letters, Elsevier, vol. 14(5), pages 407-411, July.
    13. Pollard, David & Radchenko, Peter, 2006. "Nonlinear least-squares estimation," Journal of Multivariate Analysis, Elsevier, vol. 97(2), pages 548-562, February.
    14. Huijun Guo & Youming Liu, 2019. "Regression estimation under strong mixing data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(3), pages 553-576, June.
    15. Larbi Ait-Hennani & Zoulikha Kaid & Ali Laksaci & Mustapha Rachdi, 2022. "Nonparametric Estimation of the Expected Shortfall Regression for Quasi-Associated Functional Data," Mathematics, MDPI, vol. 10(23), pages 1-23, November.
    16. Mustafa Salamh & Liqun Wang, 2021. "Second-Order Least Squares Estimation in Nonlinear Time Series Models with ARCH Errors," Econometrics, MDPI, vol. 9(4), pages 1-17, November.
    17. Ibrahim M. Almanjahie & Salim Bouzebda & Zoulikha Kaid & Ali Laksaci, 2022. "Nonparametric estimation of expectile regression in functional dependent data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 34(1), pages 250-281, January.
    18. Aman Ullah & Tao Wang & Weixin Yao, 2022. "Nonlinear modal regression for dependent data with application for predicting COVID‐19," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1424-1453, July.
    19. Roussas, George G. & Tran, Lanh T. & Ioannides, D. A., 1992. "Fixed design regression for time series: Asymptotic normality," Journal of Multivariate Analysis, Elsevier, vol. 40(2), pages 262-291, February.
    20. Lim, C.Y. & Meerschaert, M.M. & Scheffler, H.-P., 2014. "Parameter estimation for operator scaling random fields," Journal of Multivariate Analysis, Elsevier, vol. 123(C), pages 172-183.
    21. Mijeong Kim & Yanyuan Ma, 2012. "The efficiency of the second-order nonlinear least squares estimator and its extension," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(4), pages 751-764, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yinjun Chen & Hao Ming & Hu Yang, 2024. "Efficient variable selection for high-dimensional multiplicative models: a novel LPRE-based approach," Statistical Papers, Springer, vol. 65(6), pages 3713-3737, August.
    2. Zhang, Jun & Feng, Zhenghui & Peng, Heng, 2018. "Estimation and hypothesis test for partial linear multiplicative models," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 87-103.
    3. Hao, Meiling & Lin, Yunyuan & Zhao, Xingqiu, 2016. "A relative error-based approach for variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 250-262.
    4. Jun Zhang & Junpeng Zhu & Zhenghui Feng, 2019. "Estimation and hypothesis test for single-index multiplicative models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(1), pages 242-268, March.
    5. Jun Zhang & Junpeng Zhu & Yan Zhou & Xia Cui & Tao Lu, 2020. "Multiplicative regression models with distortion measurement errors," Statistical Papers, Springer, vol. 61(5), pages 2031-2057, October.
    6. Zhanfeng Wang & Zhuojian Chen & Zimu Chen, 2018. "H-relative error estimation for multiplicative regression model with random effect," Computational Statistics, Springer, vol. 33(2), pages 623-638, June.
    7. Tianzhen Wang & Haixiang Zhang & Liuquan Sun, 2024. "Renewable learning for multiplicative regression with streaming datasets," Computational Statistics, Springer, vol. 39(3), pages 1559-1586, May.
    8. Litimein, Ouahiba & Laksaci, Ali & Ait-Hennani, Larbi & Mechab, Boubaker & Rachdi, Mustapha, 2024. "Asymptotic normality of the local linear estimator of the functional expectile regression," Journal of Multivariate Analysis, Elsevier, vol. 202(C).
    9. Rong Jiang & Mengxian Sun, 2022. "Single-index composite quantile regression for ultra-high-dimensional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(2), pages 443-460, June.
    10. Mustafa Salamh & Liqun Wang, 2021. "Second-Order Least Squares Estimation in Nonlinear Time Series Models with ARCH Errors," Econometrics, MDPI, vol. 9(4), pages 1-17, November.
    11. Ullah, Aman & Wang, Tao & Yao, Weixin, 2023. "Semiparametric partially linear varying coefficient modal regression," Journal of Econometrics, Elsevier, vol. 235(2), pages 1001-1026.
    12. Fei Jiang & Yanyuan Ma & J. Jack Lee, 2017. "A second-order semiparametric method for survival analysis, with application to an acquired immune deficiency syndrome clinical trial study," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(4), pages 833-846, August.
    13. Jun Zhang & Xia Cui & Heng Peng, 2020. "Estimation and hypothesis test for partial linear single-index multiplicative models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 699-740, June.
    14. Huilan Liu & Xiawei Zhang & Huaiqing Hu & Junjie Ma, 2024. "Analysis of the positive response data with the varying coefficient partially nonlinear multiplicative model," Statistical Papers, Springer, vol. 65(5), pages 3063-3092, July.
    15. Salim Bouzebda & Boutheina Nemouchi, 2023. "Weak-convergence of empirical conditional processes and conditional U-processes involving functional mixing data," Statistical Inference for Stochastic Processes, Springer, vol. 26(1), pages 33-88, April.
    16. Francesco Bravo, 2013. "Partially linear varying coefficient models with missing at random responses," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(4), pages 721-762, August.
    17. Xin Wang & Lingchen Kong & Liqun Wang, 2022. "Estimation of Error Variance in Regularized Regression Models via Adaptive Lasso," Mathematics, MDPI, vol. 10(11), pages 1-19, June.
    18. Litimein, Ouahiba & Laksaci, Ali & Mechab, Boubaker & Bouzebda, Salim, 2023. "Local linear estimate of the functional expectile regression," Statistics & Probability Letters, Elsevier, vol. 192(C).
    19. Tan, Xin Lu, 2019. "Optimal estimation of slope vector in high-dimensional linear transformation models," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 179-204.
    20. Cheng Maolin, 2016. "A Generalized Constant Elasticity of Substitution Production Function Model and Its Application," Journal of Systems Science and Information, De Gruyter, vol. 4(3), pages 269-279, June.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:76:y:2024:i:3:d:10.1007_s10463-023-00895-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.