IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v64y2002i3p363-410.html

An adaptive estimation of dimension reduction space

Author

Listed:
  • Yingcun Xia
  • Howell Tong
  • W. K. Li
  • Li‐Xing Zhu

Abstract

Summary. Searching for an effective dimension reduction space is an important problem in regression, especially for high dimensional data. We propose an adaptive approach based on semiparametric models, which we call the (conditional) minimum average variance estimation (MAVE) method, within quite a general setting. The MAVE method has the following advantages. Most existing methods must undersmooth the nonparametric link function estimator to achieve a faster rate of consistency for the estimator of the parameters (than for that of the nonparametric function). In contrast, a faster consistency rate can be achieved by the MAVE method even without undersmoothing the nonparametric link function estimator. The MAVE method is applicable to a wide range of models, with fewer restrictions on the distribution of the covariates, to the extent that even time series can be included. Because of the faster rate of consistency for the parameter estimators, it is possible for us to estimate the dimension of the space consistently. The relationship of the MAVE method with other methods is also investigated. In particular, a simple outer product gradient estimator is proposed as an initial estimator. In addition to theoretical results, we demonstrate the efficacy of the MAVE method for high dimensional data sets through simulation. Two real data sets are analysed by using the MAVE approach.

Suggested Citation

  • Yingcun Xia & Howell Tong & W. K. Li & Li‐Xing Zhu, 2002. "An adaptive estimation of dimension reduction space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 363-410, August.
  • Handle: RePEc:bla:jorssb:v:64:y:2002:i:3:p:363-410
    DOI: 10.1111/1467-9868.03411
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1467-9868.03411
    Download Restriction: no

    File URL: https://libkey.io/10.1111/1467-9868.03411?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yao, Qiwei & Tong, Howell, 1994. "On subset selection in non-parametric stochastic regression," LSE Research Online Documents on Economics 6409, London School of Economics and Political Science, LSE Library.
    2. Linton, Oliver, 1995. "Second Order Approximation in the Partially Linear Regression Model," Econometrica, Econometric Society, vol. 63(5), pages 1079-1112, September.
    3. Xingcun Xia & H. Z. An, 1999. "Projection Pursuit Autoregression in Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 20(6), pages 693-714, November.
    4. L. Yang & R. Tschernig, 1999. "Multivariate bandwidth selection for local linear regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(4), pages 793-815.
    5. Cai, Zongwu & Fan, Jianqing & Yao, Qiwei, 2000. "Functional-coefficient regression models for nonlinear time series," LSE Research Online Documents on Economics 6314, London School of Economics and Political Science, LSE Library.
    6. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    7. Posse, Christian, 1995. "Projection pursuit exploratory data analysis," Computational Statistics & Data Analysis, Elsevier, vol. 20(6), pages 669-687, December.
    8. Fujikoshi, Yasunori, 1985. "Selection of variables in two-group discriminant analysis by error rate and Akaike's information criteria," Journal of Multivariate Analysis, Elsevier, vol. 17(1), pages 27-37, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355, December.
    2. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    3. Chen, Xiaohong & Pouzo, Demian, 2009. "Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals," Journal of Econometrics, Elsevier, vol. 152(1), pages 46-60, September.
    4. Yang Ning & Sida Peng & Jing Tao, 2020. "Doubly Robust Semiparametric Difference-in-Differences Estimators with High-Dimensional Data," Papers 2009.03151, arXiv.org.
    5. Wang Q. & Linton O. & Hardle W., 2004. "Semiparametric Regression Analysis With Missing Response at Random," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 334-345, January.
    6. Wu, Guojun & Xiao, Zhijie, 2002. "A generalized partially linear model of asymmetric volatility," Journal of Empirical Finance, Elsevier, vol. 9(3), pages 287-319, August.
    7. Byunghoon Kang, 2018. "Inference in Nonparametric Series Estimation with Specification Searches for the Number of Series Terms," Working Papers 240829404, Lancaster University Management School, Economics Department.
    8. Dandan Liu & Rui Li & Zijun Wang, 2011. "Testing for structural breaks in panel varying coefficient models: with an application to OECD health expenditure," Empirical Economics, Springer, vol. 40(1), pages 95-118, February.
    9. repec:wyi:journl:002096 is not listed on IDEAS
    10. Xia, Yingcun & Härdle, Wolfgang, 2006. "Semi-parametric estimation of partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 97(5), pages 1162-1184, May.
    11. Boente, Graciela & Rodriguez, Daniela, 2008. "Robust bandwidth selection in semiparametric partly linear regression models: Monte Carlo study and influential analysis," Computational Statistics & Data Analysis, Elsevier, vol. 52(5), pages 2808-2828, January.
    12. Oliver Linton, 2001. "Symmetrizing and unitizing transformations for linear smoother weights," Computational Statistics, Springer, vol. 16(1), pages 153-164, March.
    13. Aneiros-Pérez, Germán, 2002. "On bandwidth selection in partial linear regression models under dependence," Statistics & Probability Letters, Elsevier, vol. 57(4), pages 393-401, May.
    14. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    15. Das, M., 2005. "Instrumental variables estimators of nonparametric models with discrete endogenous regressors," Journal of Econometrics, Elsevier, vol. 124(2), pages 335-361, February.
    16. T. Stengos & E. Zacharias, 2006. "Intertemporal pricing and price discrimination: a semiparametric hedonic analysis of the personal computer market," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(3), pages 371-386, April.
    17. Germán Aneiros-Pérez, 2004. "Plug-in bandwidth choice for estimation of nonparametric part in partial linear regression models with strong mixing errors," Statistical Papers, Springer, vol. 45(2), pages 191-210, April.
    18. Häggström, Jenny, 2013. "Bandwidth selection for backfitting estimation of semiparametric additive models: A simulation study," Computational Statistics & Data Analysis, Elsevier, vol. 62(C), pages 136-148.
    19. Ullah, Aman & Wang, Tao & Yao, Weixin, 2023. "Semiparametric partially linear varying coefficient modal regression," Journal of Econometrics, Elsevier, vol. 235(2), pages 1001-1026.
    20. Wang, Qihua & Härdle, Wolfgang & Linton, Oliver, 2002. "Semiparametric regression analysis under imputation for missing response data," SFB 373 Discussion Papers 2002,6, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    21. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:64:y:2002:i:3:p:363-410. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.