IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/11987.html
   My bibliography  Save this paper

Nonparametric and semiparametric regression model selection

Author

Listed:
  • Gao, Jiti
  • Tong, Howell

Abstract

It is known that semiparametric time series regression is often used without checking its suitability and compactness. In theory, this may result in dealing with an unnecessarily complicated model. In practice, one may encounter the computational difficulty caused by the spareness of the data. This is partly because the curse of dimensionality problem may still arise from using a semiparametric time series regression model. This paper suggests that in order to provide more precise predictions we need to choose the most significant regressors for both the parametric and nonparametric time series components. We develop a novel cross-validation based model selection procedure for the choice of both the parametric and nonparametric time series components in semiparametric time series regression, and then establish some asymptotic properties of the proposed model selection procedure. In addition, we demonstrate how to implement the model selection procedure in practice through using both simulated and real examples. Our empirical studies show that the proposed cross-validation selection procedure works well numerically.

Suggested Citation

  • Gao, Jiti & Tong, Howell, 2002. "Nonparametric and semiparametric regression model selection," MPRA Paper 11987, University Library of Munich, Germany, revised Feb 2004.
  • Handle: RePEc:pra:mprapa:11987
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/11987/1/MPRA_paper_11987.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gao, Jiti & Tong, Howell & Wolff, Rodney, 2002. "Model Specification Tests in Nonparametric Stochastic Regression Models," Journal of Multivariate Analysis, Elsevier, vol. 83(2), pages 324-359, November.
    2. Yingcun Xia & Howell Tong & W. K. Li & Li‐Xing Zhu, 2002. "An adaptive estimation of dimension reduction space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 363-410, August.
    3. Yao, Qiwei & Tong, Howell, 1994. "On subset selection in non-parametric stochastic regression," LSE Research Online Documents on Economics 6409, London School of Economics and Political Science, LSE Library.
    4. Masry, Elias & Tjøstheim, Dag, 1997. "Additive Nonlinear ARX Time Series and Projection Estimates," Econometric Theory, Cambridge University Press, vol. 13(2), pages 214-252, April.
    5. Wolfgang Härdle & Philippe Vieu, 1992. "Kernel Regression Smoothing Of Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 13(3), pages 209-232, May.
    6. Vieu, Philippe, 1994. "Choice of regressors in nonparametric estimation," Computational Statistics & Data Analysis, Elsevier, vol. 17(5), pages 575-594, June.
    7. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    8. Wolfgang Härdle & Helmut Lütkepohl & Rong Chen, 1997. "A Review of Nonparametric Time Series Analysis," International Statistical Review, International Statistical Institute, vol. 65(1), pages 49-72, April.
    9. Jiti Gao & Howell Tong, 2004. "Semiparametric non‐linear time series model selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 321-336, May.
    10. Gao, Jiti & Anh, Vo, 2000. "A central limit theorem for a random quadratic form of strictly stationary processes," Statistics & Probability Letters, Elsevier, vol. 49(1), pages 69-79, August.
    11. Masry, Elias & Tjøstheim, Dag, 1995. "Nonparametric Estimation and Identification of Nonlinear ARCH Time Series Strong Convergence and Asymptotic Normality: Strong Convergence and Asymptotic Normality," Econometric Theory, Cambridge University Press, vol. 11(2), pages 258-289, February.
    12. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    13. Boente, Graciela & Fraiman, Ricardo, 1988. "Consistency of a nonparametric estimate of a density function for dependent variables," Journal of Multivariate Analysis, Elsevier, vol. 25(1), pages 90-99, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    2. Dong, Chaohua & Gao, Jiti & Tong, Howell, 2006. "Semiparametric penalty function method in partially linear model selection," MPRA Paper 11975, University Library of Munich, Germany, revised Aug 2006.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    2. Dong, Chaohua & Gao, Jiti & Tong, Howell, 2006. "Semiparametric penalty function method in partially linear model selection," MPRA Paper 11975, University Library of Munich, Germany, revised Aug 2006.
    3. Gao, Jiti & Tong, Howell & Wolff, Rodney, 2002. "Model Specification Tests in Nonparametric Stochastic Regression Models," Journal of Multivariate Analysis, Elsevier, vol. 83(2), pages 324-359, November.
    4. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    5. Patrick Saart & Jiti Gao & Nam Hyun Kim, 2014. "Semiparametric methods in nonlinear time series analysis: a selective review," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(1), pages 141-169, March.
    6. Xialu Liu & Zongwu Cai & Rong Chen, 2015. "Functional coefficient seasonal time series models with an application of Hawaii tourism data," Computational Statistics, Springer, vol. 30(3), pages 719-744, September.
    7. Ayse Yilmaz & Ufuk Yolcu, 2022. "Dendritic neuron model neural network trained by modified particle swarm optimization for time‐series forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(4), pages 793-809, July.
    8. Yang, Lijian & Park, Byeong U. & Xue, Lan & Hardle, Wolfgang, 2006. "Estimation and Testing for Varying Coefficients in Additive Models With Marginal Integration," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1212-1227, September.
    9. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Estimation of Generalized Impulse Response Functions," Econometric Society World Congress 2000 Contributed Papers 1417, Econometric Society.
    10. Cai, Zongwu, 2003. "Nonparametric estimation equations for time series data," Statistics & Probability Letters, Elsevier, vol. 62(4), pages 379-390, May.
    11. Jürgen Franke & Peter Mwita & Weining Wang, 2015. "Nonparametric estimates for conditional quantiles of time series," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 99(1), pages 107-130, January.
    12. Lütkepohl,Helmut & Krätzig,Markus (ed.), 2004. "Applied Time Series Econometrics," Cambridge Books, Cambridge University Press, number 9780521547871.
    13. O. Linton & E. Mammen, 2005. "Estimating Semiparametric ARCH(∞) Models by Kernel Smoothing Methods," Econometrica, Econometric Society, vol. 73(3), pages 771-836, May.
    14. Kim, Namhyun & W. Saart, Patrick, 2021. "Estimation in partially linear semiparametric models with parametric and/or nonparametric endogeneity," Cardiff Economics Working Papers E2021/9, Cardiff University, Cardiff Business School, Economics Section.
    15. Linton, Oliver & Mammen, Enno, 2003. "Estimating semiparametric ARCH (8) models by kernel smoothing methods," LSE Research Online Documents on Economics 2187, London School of Economics and Political Science, LSE Library.
    16. Chaohua Dong & Jiti Gao & Dag Tjostheim, 2014. "Estimation for Single-index and Partially Linear Single-index Nonstationary Time Series Models," Monash Econometrics and Business Statistics Working Papers 7/14, Monash University, Department of Econometrics and Business Statistics.
    17. Dong, Chaohua & Gao, Jiti & Linton, Oliver, 2023. "High dimensional semiparametric moment restriction models," Journal of Econometrics, Elsevier, vol. 232(2), pages 320-345.
    18. Cai, Zongwu, 2007. "Trending time-varying coefficient time series models with serially correlated errors," Journal of Econometrics, Elsevier, vol. 136(1), pages 163-188, January.
    19. Liu, Jun M. & Chen, Rong & Yao, Qiwei, 2010. "Nonparametric transfer function models," Journal of Econometrics, Elsevier, vol. 157(1), pages 151-164, July.
    20. Gao, Jiti, 2012. "Identification, Estimation and Specification in a Class of Semi-Linear Time Series Models," MPRA Paper 39256, University Library of Munich, Germany, revised 14 May 2012.

    More about this item

    Keywords

    Linear model; model selection; mixing process; nonlinear time series; nonparametric regression; semiparametric regression; strictly stationary process; variable selection;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:11987. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.