IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/925.html
   My bibliography  Save this paper

Additive Interactive Regression Models: Circumvention of the Curse of Dimensionality

Author

Abstract

This paper considers series estimators of additive interactive regression (AIR) models. AIR models are nonparametric regression models that generalize additive regression models by allowing interactions between different regressor variables. They place more restrictions on the regression function, however, than do fully nonparametric regression models. By doing so, they attempt to circumvent the curse of dimensionality that afflicts the estimation of fully nonparametric regression models. In this paper, we present a finite sample bound and asymptotic rate of convergence results for the mean average squared error of series estimators that show the AIR models do circumvent the curse of dimensionality. The rate of convergency of these estimators is shown to depend on the order of the AIR model and the smoothness of the regression function, but not on the dimension of the regressor vector. Series estimators with fixed and data-dependent truncation parameters are considered.

Suggested Citation

  • Donald W.K. Andrews & Yoon-Jae Whang, 1989. "Additive Interactive Regression Models: Circumvention of the Curse of Dimensionality," Cowles Foundation Discussion Papers 925, Cowles Foundation for Research in Economics, Yale University.
  • Handle: RePEc:cwl:cwldpp:925
    Note: CFP 771.
    as

    Download full text from publisher

    File URL: http://cowles.yale.edu/sites/default/files/files/pub/d09/d0925.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andrews, Donald W K, 1991. "Asymptotic Normality of Series Estimators for Nonparametric and Semiparametric Regression Models," Econometrica, Econometric Society, vol. 59(2), pages 307-345, March.
    2. Gallant, A. Ronald, 1981. "On the bias in flexible functional forms and an essentially unbiased form : The fourier flexible form," Journal of Econometrics, Elsevier, vol. 15(2), pages 211-245, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Camlong-Viot, Christine & Rodríguez-Póo, Juan M. & Vieu, Philippe, 2003. "Nonparametric and Semiparametric Estimation of Additive Models with both Discrete and Continuous Variables under Dependence," SFB 373 Discussion Papers 2003,38, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    2. Hardle, Wolfgang & Linton, Oliver, 1986. "Applied nonparametric methods," Handbook of Econometrics,in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 38, pages 2295-2339 Elsevier.
    3. Gordon B. Dahl, 2002. "Mobility and the Return to Education: Testing a Roy Model with Multiple Markets," Econometrica, Econometric Society, vol. 70(6), pages 2367-2420, November.
    4. Donald W.K. Andrews, 1989. "Asymptotic Optimality of Generalized C_{L}, Cross-Validation, and Generalized Cross-Validation in Regression with Heteroskedastic Errors," Cowles Foundation Discussion Papers 906, Cowles Foundation for Research in Economics, Yale University.
    5. Jing Wang & Lijian Yang, 2009. "Efficient and fast spline-backfitted kernel smoothing of additive models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(3), pages 663-690, September.
    6. Michael Hamers & Michael Kohler, 2006. "Nonasymptotic Bounds on the L 2 Error of Neural Network Regression Estimates," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 58(1), pages 131-151, March.
    7. Vieu, Philippe & Sperlich, Stefan & Rodriguez Poo, Juan M., 2000. "Semiparametric estimation of weak and strong separable models," DES - Working Papers. Statistics and Econometrics. WS 10064, Universidad Carlos III de Madrid. Departamento de Estadística.
    8. Hengartner, Nicolas W. & Sperlich, Stefan, 2005. "Rate optimal estimation with the integration method in the presence of many covariates," Journal of Multivariate Analysis, Elsevier, vol. 95(2), pages 246-272, August.
    9. Damian Kozbur, 2013. "Inference in additively separable models with a high-dimensional set of conditioning variables," ECON - Working Papers 284, Department of Economics - University of Zurich, revised Apr 2018.
    10. Das, M., 2003. "Identification and sequential estimation of panel data models with insufficient exclusion restrictions," Journal of Econometrics, Elsevier, vol. 114(2), pages 297-328, June.
    11. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, number 8355.
    12. Hardle, Wolfgang & Sperlich, Stefan & Yang, Lijian, 2000. "Derivative estimation and testing in generalized additive models," DES - Working Papers. Statistics and Econometrics. WS 10084, Universidad Carlos III de Madrid. Departamento de Estadística.
    13. Mitali Das, 2000. "Instrumental Variables Estimation of Nonparametric Models with Discrete Endogenous Regressors," Econometric Society World Congress 2000 Contributed Papers 1008, Econometric Society.
    14. Li, Qi & Hsiao, Cheng & Zinn, Joel, 2003. "Consistent specification tests for semiparametric/nonparametric models based on series estimation methods," Journal of Econometrics, Elsevier, vol. 112(2), pages 295-325, February.
    15. Gozalo, Pedro L. & Linton, Oliver B., 2001. "Testing additivity in generalized nonparametric regression models with estimated parameters," Journal of Econometrics, Elsevier, vol. 104(1), pages 1-48, August.
    16. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    17. Donald, Stephen G., 1995. "Two-step estimation of heteroskedastic sample selection models," Journal of Econometrics, Elsevier, vol. 65(2), pages 347-380, February.
    18. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics,in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76 Elsevier.
    19. Cai, Zongwu & Das, Mitali & Xiong, Huaiyu & Wu, Xizhi, 2006. "Functional coefficient instrumental variables models," Journal of Econometrics, Elsevier, vol. 133(1), pages 207-241, July.
    20. Lai, Peng & Meng, Jie & Lian, Heng, 2015. "Polynomial spline approach for variable selection and estimation in varying coefficient models for time series data," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 21-27.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:925. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Matthew Regan). General contact details of provider: http://edirc.repec.org/data/cowleus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.