IDEAS home Printed from https://ideas.repec.org/h/eee/ecochp/6b-74.html
   My bibliography  Save this book chapter

Implementing Nonparametric and Semiparametric Estimators

In: Handbook of Econometrics

Author

Listed:
  • Ichimura, Hidehiko
  • Todd, Petra E.

Abstract

This chapter reviews recent advances in nonparametric and semiparametric estimation, with an emphasis on applicability to empirical research and on resolving issues that arise in implementation. It considers techniques for estimating densities, conditional mean functions, derivatives of functions and conditional quantiles in a flexible way that imposes minimal functional form assumptions. The chapter begins by illustrating how flexible modeling methods have been applied in empirical research, drawing on recent examples of applications from labor economics, consumer demand estimation and treatment effects models. Then, key concepts in semiparametric and nonparametric modeling are introduced that do not have counterparts in parametric modeling, such as the so-called curse of dimensionality, the notion of models with an infinite number of parameters, the criteria used to define optimal convergence rates, and "dimension-free" estimators. After defining these new concepts, a large literature on nonparametric estimation is reviewed and a unifying framework presented for thinking about how different approaches relate to one another. Local polynomial estimators are discussed in detail and their distribution theory is developed. The chapter then shows how nonparametric estimators form the building blocks for many semiparametric estimators, such as estimators for average derivatives, index models, partially linear models, and additively separable models. Semiparametric methods offer a middle ground between fully nonparametric and parametric approaches. Their main advantage is that they typically achieve faster rates of convergence than fully nonparametric approaches. In many cases, they converge at the parametric rate. The second part of the chapter considers in detail two issues that are central with regard to implementing flexible modeling methods: how to select the values of smoothing parameters in an optimal way and how to implement "trimming" procedures. It also reviews newly developed techniques for deriving the distribution theory of semiparametric estimators. The chapter concludes with an overview of approximation methods that speed up the computation of nonparametric estimates and make flexible estimation feasible even in very large size samples.

Suggested Citation

  • Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
  • Handle: RePEc:eee:ecochp:6b-74
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/B7GX7-4R9GYJS-7/2/e2a9fe26a12ea1a4ab8cc439ab2dd6cf
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Horowitz, Joel L. & Lee, Sokbae, 2005. "Nonparametric Estimation of an Additive Quantile Regression Model," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1238-1249, December.
    2. P. M. Robinson, 1989. "Hypothesis Testing in Semiparametric and Nonparametric Models for Econometric Time Series," Review of Economic Studies, Oxford University Press, vol. 56(4), pages 511-534.
    3. Kim, W. C. & Park, B. U. & Marron, J. S., 1994. "Asymptotically best bandwidth selectors in kernel density estimation," Statistics & Probability Letters, Elsevier, vol. 19(2), pages 119-127, January.
    4. Powell, James L. & Stoker, Thomas M., 1996. "Optimal bandwidth choice for density-weighted averages," Journal of Econometrics, Elsevier, vol. 75(2), pages 291-316, December.
    5. Robinson, P M, 1991. "Automatic Frequency Domain Inference on Semiparametric and Nonparametric Models," Econometrica, Econometric Society, vol. 59(5), pages 1329-1363, September.
    6. Delgado, Miguel A & Robinson, Peter M, 1992. "Nonparametric and Semiparametric Methods for Economic Research," Journal of Economic Surveys, Wiley Blackwell, vol. 6(3), pages 201-249.
    7. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    8. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    9. DiNardo, John & Fortin, Nicole M & Lemieux, Thomas, 1996. "Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach," Econometrica, Econometric Society, vol. 64(5), pages 1001-1044, September.
    10. Chaudhuri, Probal, 1991. "Global nonparametric estimation of conditional quantile functions and their derivatives," Journal of Multivariate Analysis, Elsevier, vol. 39(2), pages 246-269, November.
    11. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    12. Hardle, Wolfgang & Linton, Oliver, 1986. "Applied nonparametric methods," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 38, pages 2295-2339, Elsevier.
    13. Pagan,Adrian & Ullah,Aman, 1999. "Nonparametric Econometrics," Cambridge Books, Cambridge University Press, number 9780521355643, November.
    14. Wu, De-Min, 1974. "Alternative Tests of Independence between Stochastic Regressors and Disturbances: Finite Sample Results," Econometrica, Econometric Society, vol. 42(3), pages 529-546, May.
    15. Stern, Steven, 1996. "Semiparametric estimates of the supply and demand effects of disability on labor force participation," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 49-70.
    16. Newey, Whitney K & Powell, James L & Walker, James R, 1990. "Semiparametric Estimation of Selection Models: Some Empirical Results," American Economic Review, American Economic Association, vol. 80(2), pages 324-328, May.
    17. Newey, Whitney K, 1994. "The Asymptotic Variance of Semiparametric Estimators," Econometrica, Econometric Society, vol. 62(6), pages 1349-1382, November.
    18. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    19. Yoshihiko Nishiyama & Peter M. Robinson, 2005. "The Bootstrap and the Edgeworth Correction for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 73(3), pages 903-948, May.
    20. Buchinsky, Moshe, 1994. "Changes in the U.S. Wage Structure 1963-1987: Application of Quantile Regression," Econometrica, Econometric Society, vol. 62(2), pages 405-458, March.
    21. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    22. Manski, Charles F., 1985. "Semiparametric analysis of discrete response : Asymptotic properties of the maximum score estimator," Journal of Econometrics, Elsevier, vol. 27(3), pages 313-333, March.
    23. Powell, James L & Stock, James H & Stoker, Thomas M, 1989. "Semiparametric Estimation of Index Coefficients," Econometrica, Econometric Society, vol. 57(6), pages 1403-1430, November.
    24. Angus Deaton & Christina Paxson, 1998. "Economies of Scale, Household Size, and the Demand for Food," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 897-930, October.
    25. Conley, Timothy G. & Hansen, Lars Peter & Liu, Wen-Fang, 1997. "Bootstrapping The Long Run," Macroeconomic Dynamics, Cambridge University Press, vol. 1(2), pages 279-311, June.
    26. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    27. Gronau, Reuben, 1973. "The Intrafamily Allocation of Time: The Value of the Housewives' Time," American Economic Review, American Economic Association, vol. 63(4), pages 634-651, September.
    28. Buchinsky, Moshe, 1995. "Estimating the asymptotic covariance matrix for quantile regression models a Monte Carlo study," Journal of Econometrics, Elsevier, vol. 68(2), pages 303-338, August.
    29. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    30. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731, April.
    31. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-660, November.
    32. Moshe Buchinsky & Jinyong Hahn, 1998. "An Alternative Estimator for the Censored Quantile Regression Model," Econometrica, Econometric Society, vol. 66(3), pages 653-672, May.
    33. Tauchen, George, 1985. "Diagnostic testing and evaluation of maximum likelihood models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 415-443.
    34. Y. Nishiyama & P. M. Robinson, 2000. "Edgeworth Expansions for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 68(4), pages 931-980, July.
    35. Kathryn Prewitt & Sharon Lohr, 2006. "Bandwidth selection in local polynomial regression using eigenvalues," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 135-154, February.
    36. Buchinsky, Moshe, 1995. "Quantile regression, Box-Cox transformation model, and the U.S. wage structure, 1963-1987," Journal of Econometrics, Elsevier, vol. 65(1), pages 109-154, January.
    37. Klein, Roger W & Spady, Richard H, 1993. "An Efficient Semiparametric Estimator for Binary Response Models," Econometrica, Econometric Society, vol. 61(2), pages 387-421, March.
    38. Newey, Whitney K, 1990. "Semiparametric Efficiency Bounds," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(2), pages 99-135, April-Jun.
    39. Adonis Yatchew, 1998. "Nonparametric Regression Techniques in Economics," Journal of Economic Literature, American Economic Association, vol. 36(2), pages 669-721, June.
    40. Delgado, Miguel A. & Robinson, Peter M., 1992. "Nonparametric and semiparametric methods for economic research," UC3M Working papers. Economics 2827, Universidad Carlos III de Madrid. Departamento de Economía.
    41. Sherman, Robert P., 1994. "U-Processes in the Analysis of a Generalized Semiparametric Regression Estimator," Econometric Theory, Cambridge University Press, vol. 10(2), pages 372-395, June.
    42. Horowitz, Joel L, 1992. "A Smoothed Maximum Score Estimator for the Binary Response Model," Econometrica, Econometric Society, vol. 60(3), pages 505-531, May.
    43. Yatchew,Adonis, 2003. "Semiparametric Regression for the Applied Econometrician," Cambridge Books, Cambridge University Press, number 9780521012263, November.
    44. Lewis, H Gregg, 1974. "Comments on Selectivity Biases in Wage Comparisons," Journal of Political Economy, University of Chicago Press, vol. 82(6), pages 1145-1155, Nov.-Dec..
    45. Newey, Whitney K., 1987. "Specification tests for distributional assumptions in the Tobit model," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 125-145.
    46. Hardle, Wolfgang & Hildenbrand, Werner & Jerison, Michael, 1991. "Empirical Evidence on the Law of Demand," Econometrica, Econometric Society, vol. 59(6), pages 1525-1549, November.
    47. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
    48. Robinson, P M, 1995. "The Normal Approximation for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 63(3), pages 667-680, May.
    49. Stoker, Thomas M., 1996. "Smoothing bias in the measurement of marginal effects," Journal of Econometrics, Elsevier, vol. 72(1-2), pages 49-84.
    50. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
    51. Honore, Bo E. & Powell, James L., 1994. "Pairwise difference estimators of censored and truncated regression models," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 241-278.
    52. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    53. White, Halbert, 1980. "Using Least Squares to Approximate Unknown Regression Functions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 21(1), pages 149-170, February.
    54. Richard Blundell & Alan Duncan, 1998. "Kernel Regression in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 62-87.
    55. Pollard, David, 1985. "New Ways to Prove Central Limit Theorems," Econometric Theory, Cambridge University Press, vol. 1(3), pages 295-313, December.
    56. Powell, James L., 1987. "Semiparametric Estimation Of Bivariate Latent Variable Models," SSRI Workshop Series 292689, University of Wisconsin-Madison, Social Systems Research Institute.
    57. Thomas Fraker & Rebecca Maynard, 1987. "The Adequacy of Comparison Group Designs for Evaluations of Employment-Related Programs," Journal of Human Resources, University of Wisconsin Press, vol. 22(2), pages 194-227.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, number 8355.
    2. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Jochmans, Koen, 2015. "Multiplicative-error models with sample selection," Journal of Econometrics, Elsevier, vol. 184(2), pages 315-327.
    5. Wan, Yuanyuan & Xu, Haiqing, 2015. "Inference in semiparametric binary response models with interval data," Journal of Econometrics, Elsevier, vol. 184(2), pages 347-360.
    6. Steven Lehrer & Gregory Kordas, 2013. "Matching using semiparametric propensity scores," Empirical Economics, Springer, vol. 44(1), pages 13-45, February.
    7. Yoshihiko Nishiyama & Peter M. Robinson, 2005. "The Bootstrap and the Edgeworth Correction for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 73(3), pages 903-948, May.
    8. Sadikoglu, Serhan, 2019. "Essays in econometric theory," Other publications TiSEM 99d83644-f9dc-49e3-a4e1-5, Tilburg University, School of Economics and Management.
    9. Lewbel, Arthur, 2000. "Semiparametric qualitative response model estimation with unknown heteroscedasticity or instrumental variables," Journal of Econometrics, Elsevier, vol. 97(1), pages 145-177, July.
    10. Chen, Pian & Velamuri, Malathi, 2009. "Misspecification and Heterogeneity in Single-Index, Binary Choice Models," MPRA Paper 15722, University Library of Munich, Germany.
    11. Linton, Oliver, 1995. "Second Order Approximation in the Partially Linear Regression Model," Econometrica, Econometric Society, vol. 63(5), pages 1079-1112, September.
    12. Chen, Xiaohong & Pouzo, Demian, 2009. "Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals," Journal of Econometrics, Elsevier, vol. 152(1), pages 46-60, September.
    13. Geweke, J. & Joel Horowitz & Pesaran, M.H., 2006. "Econometrics: A Bird’s Eye View," Cambridge Working Papers in Economics 0655, Faculty of Economics, University of Cambridge.
    14. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    15. Kotlyarova, Yulia & Schafgans, Marcia M. A. & Zinde‐Walsh, Victoria, 2011. "Adapting kernel estimation to uncertain smoothness," LSE Research Online Documents on Economics 42015, London School of Economics and Political Science, LSE Library.
    16. Escanciano, Juan Carlos & Song, Kyungchul, 2010. "Testing single-index restrictions with a focus on average derivatives," Journal of Econometrics, Elsevier, vol. 156(2), pages 377-391, June.
    17. Khan, Shakeeb & Powell, James L., 2001. "Two-step estimation of semiparametric censored regression models," Journal of Econometrics, Elsevier, vol. 103(1-2), pages 73-110, July.
    18. Chen, Songnian & Khan, Shakeeb & Tang, Xun, 2016. "Informational content of special regressors in heteroskedastic binary response models," Journal of Econometrics, Elsevier, vol. 193(1), pages 162-182.
    19. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    20. Aradillas-Lopez, Andres, 2012. "Pairwise-difference estimation of incomplete information games," Journal of Econometrics, Elsevier, vol. 168(1), pages 120-140.

    More about this item

    JEL classification:

    • C39 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecochp:6b-74. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/wps/find/bookseriesdescription.cws_home/BS_HE/description .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/bookseriesdescription.cws_home/BS_HE/description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.