IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v324y2025i1p142-154.html
   My bibliography  Save this article

Structure identification for partially linear partially concave models

Author

Listed:
  • Xie, Jianhui
  • Pan, Zhewen

Abstract

Partially linear partially concave models are semiparametric regression models that can capture linear and concavity-constrained nonlinear effects within one framework. A fundamental problem of this kind of model is deciding which covariates have linear effects and which covariates have strictly concave effects. Assuming that the true regression function is partially linear partially concave and sparse, we develop two structure selection procedures for classifying the covariates into linear, strictly concave, and irrelevant subsets. We show that the procedures based on penalized concavity-constrained additive regressions can correctly identify structures even if the underlying true functions are nonadditive; namely, the proposed procedures are additively faithful in a general setting. We prove that consistent structure selection is achievable when the total number of covariates and the number of concave covariates grow at polynomial rates with sample size. We introduce algorithms to implement the proposed procedures and demonstrate their performance by simulation analysis.

Suggested Citation

  • Xie, Jianhui & Pan, Zhewen, 2025. "Structure identification for partially linear partially concave models," European Journal of Operational Research, Elsevier, vol. 324(1), pages 142-154.
    • Handle: RePEc:eee:ejores:v:324:y:2025:i:1:p:142-154
    DOI: 10.1016/j.ejor.2025.01.014
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221725000396
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2025.01.014?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Varian, Hal R, 1982. "The Nonparametric Approach to Demand Analysis," Econometrica, Econometric Society, vol. 50(4), pages 945-973, July.
    2. Wu, Guojun & Xiao, Zhijie, 2002. "A generalized partially linear model of asymmetric volatility," Journal of Empirical Finance, Elsevier, vol. 9(3), pages 287-319, August.
    3. Eric Auerbach, 2022. "Identification and Estimation of a Partially Linear Regression Model Using Network Data," Econometrica, Econometric Society, vol. 90(1), pages 347-365, January.
    4. Ait-Sahalia, Yacine & Duarte, Jefferson, 2003. "Nonparametric option pricing under shape restrictions," Journal of Econometrics, Elsevier, vol. 116(1-2), pages 9-47.
    5. Dimitris Bertsimas & Nishanth Mundru, 2021. "Sparse Convex Regression," INFORMS Journal on Computing, INFORMS, vol. 33(1), pages 262-279, January.
    6. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    7. Rahul Mazumder & Arkopal Choudhury & Garud Iyengar & Bodhisattva Sen, 2019. "A Computational Framework for Multivariate Convex Regression and Its Variants," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 318-331, January.
    8. Daisuke Yagi & Yining Chen & Andrew L. Johnson & Timo Kuosmanen, 2020. "Shape-Constrained Kernel-Weighted Least Squares: Estimating Production Functions for Chilean Manufacturing Industries," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 43-54, January.
    9. Lee, Chia-Yen & Johnson, Andrew L. & Moreno-Centeno, Erick & Kuosmanen, Timo, 2013. "A more efficient algorithm for Convex Nonparametric Least Squares," European Journal of Operational Research, Elsevier, vol. 227(2), pages 391-400.
    10. Liao, Zhiqiang & Dai, Sheng & Kuosmanen, Timo, 2024. "Convex support vector regression," European Journal of Operational Research, Elsevier, vol. 313(3), pages 858-870.
    11. Andrew Johnson & Timo Kuosmanen, 2011. "One-stage estimation of the effects of operational conditions and practices on productive performance: asymptotically normal and efficient, root-n consistent StoNEZD method," Journal of Productivity Analysis, Springer, vol. 36(2), pages 219-230, October.
    12. Liang, Hua & Li, Runze, 2009. "Variable Selection for Partially Linear Models With Measurement Errors," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 234-248.
    13. Li, Qi, 2000. "Efficient Estimation of Additive Partially Linear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 1073-1092, November.
    14. Xia, Yingcun & Härdle, Wolfgang, 2002. "Semi-parametric estimation of generalized partially linear single-index models," SFB 373 Discussion Papers 2002,56, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    15. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    16. Eunji Lim & Peter W. Glynn, 2012. "Consistency of Multidimensional Convex Regression," Operations Research, INFORMS, vol. 60(1), pages 196-208, February.
    17. Wang, Yongqiao & Wang, Shouyang & Dang, Chuangyin & Ge, Wenxiu, 2014. "Nonparametric quantile frontier estimation under shape restriction," European Journal of Operational Research, Elsevier, vol. 232(3), pages 671-678.
    18. Dai, Sheng & Kuosmanen, Timo & Zhou, Xun, 2023. "Generalized quantile and expectile properties for shape constrained nonparametric estimation," European Journal of Operational Research, Elsevier, vol. 310(2), pages 914-927.
    19. Zhang, Hao Helen & Cheng, Guang & Liu, Yufeng, 2011. "Linear or Nonlinear? Automatic Structure Discovery for Partially Linear Models," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1099-1112.
    20. Gad Allon & Michael Beenstock & Steven Hackman & Ury Passy & Alexander Shapiro, 2007. "Nonparametric estimation of concave production technologies by entropic methods," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(4), pages 795-816.
    21. Richard Schmalensee & Thomas M. Stoker, 1999. "Household Gasoline Demand in the United States," Econometrica, Econometric Society, vol. 67(3), pages 645-662, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dai, Sheng & Kuosmanen, Timo & Zhou, Xun, 2023. "Generalized quantile and expectile properties for shape constrained nonparametric estimation," European Journal of Operational Research, Elsevier, vol. 310(2), pages 914-927.
    2. Liao, Zhiqiang & Dai, Sheng & Kuosmanen, Timo, 2024. "Convex support vector regression," European Journal of Operational Research, Elsevier, vol. 313(3), pages 858-870.
    3. Zhiqiang Liao, 2024. "Variable selection in convex nonparametric least squares via structured Lasso: An application to the Swedish electricity distribution networks," Papers 2409.01911, arXiv.org, revised Nov 2024.
    4. Keshvari, Abolfazl, 2017. "A penalized method for multivariate concave least squares with application to productivity analysis," European Journal of Operational Research, Elsevier, vol. 257(3), pages 1016-1029.
    5. Dai, Sheng, 2023. "Variable selection in convex quantile regression: L1-norm or L0-norm regularization?," European Journal of Operational Research, Elsevier, vol. 305(1), pages 338-355.
    6. Kim, Kun Ho & Chao, Shih-Kang & Härdle, Wolfgang Karl, 2020. "Simultaneous Inference of the Partially Linear Model with a Multivariate Unknown Function," IRTG 1792 Discussion Papers 2020-008, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    7. Dimitris Bertsimas & Nishanth Mundru, 2021. "Sparse Convex Regression," INFORMS Journal on Computing, INFORMS, vol. 33(1), pages 262-279, January.
    8. Aifen Feng & Xiaogai Chang & Jingya Fan & Zhengfen Jin, 2023. "Application of LADMM and As-LADMM for a High-Dimensional Partially Linear Model," Mathematics, MDPI, vol. 11(19), pages 1-14, October.
    9. Lian, Heng & Liang, Hua, 2016. "Separation of linear and index covariates in partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 56-70.
    10. Zhang, Jun & Feng, Zhenghui & Peng, Heng, 2018. "Estimation and hypothesis test for partial linear multiplicative models," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 87-103.
    11. Wang, Xiuli & Zhao, Shengli & Wang, Mingqiu, 2017. "Restricted profile estimation for partially linear models with large-dimensional covariates," Statistics & Probability Letters, Elsevier, vol. 128(C), pages 71-76.
    12. Han Shang, 2014. "Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density," Computational Statistics, Springer, vol. 29(3), pages 829-848, June.
    13. Haotian Chen & Xibin Zhang, 2014. "Bayesian Estimation for Partially Linear Models with an Application to Household Gasoline Consumption," Monash Econometrics and Business Statistics Working Papers 28/14, Monash University, Department of Econometrics and Business Statistics.
    14. Liu, Jialuo & Chu, Tingjin & Zhu, Jun & Wang, Haonan, 2021. "Semiparametric method and theory for continuously indexed spatio-temporal processes," Journal of Multivariate Analysis, Elsevier, vol. 183(C).
    15. Jun Zhang & Zhenghui Feng & Peirong Xu & Hua Liang, 2017. "Generalized varying coefficient partially linear measurement errors models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(1), pages 97-120, February.
    16. Hadi Emami & Omid Khademnoe, 2025. "Shrinkage and pretest Liu estimators in semiparametric linear measurement error models," Statistical Papers, Springer, vol. 66(2), pages 1-35, February.
    17. Preciado Arreola, José Luis & Johnson, Andrew L. & Chen, Xun C. & Morita, Hiroshi, 2020. "Estimating stochastic production frontiers: A one-stage multivariate semiparametric Bayesian concave regression method," European Journal of Operational Research, Elsevier, vol. 287(2), pages 699-711.
    18. Lee, Chia-Yen & Johnson, Andrew L. & Moreno-Centeno, Erick & Kuosmanen, Timo, 2013. "A more efficient algorithm for Convex Nonparametric Least Squares," European Journal of Operational Research, Elsevier, vol. 227(2), pages 391-400.
    19. Jose M. Cordero & Cristina Polo & Daniel Santín, 2020. "Assessment of new methods for incorporating contextual variables into efficiency measures: a Monte Carlo simulation," Operational Research, Springer, vol. 20(4), pages 2245-2265, December.
    20. Jun Zhang & Zhenghui Feng & Peirong Xu, 2015. "Estimating the conditional single-index error distribution with a partial linear mean regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(1), pages 61-83, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:324:y:2025:i:1:p:142-154. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.