IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this book chapter

Implementing Nonparametric and Semiparametric Estimators

In: Handbook of Econometrics

  • Ichimura, Hidehiko
  • Todd, Petra E.

This chapter reviews recent advances in nonparametric and semiparametric estimation, with an emphasis on applicability to empirical research and on resolving issues that arise in implementation. It considers techniques for estimating densities, conditional mean functions, derivatives of functions and conditional quantiles in a flexible way that imposes minimal functional form assumptions. The chapter begins by illustrating how flexible modeling methods have been applied in empirical research, drawing on recent examples of applications from labor economics, consumer demand estimation and treatment effects models. Then, key concepts in semiparametric and nonparametric modeling are introduced that do not have counterparts in parametric modeling, such as the so-called curse of dimensionality, the notion of models with an infinite number of parameters, the criteria used to define optimal convergence rates, and "dimension-free" estimators. After defining these new concepts, a large literature on nonparametric estimation is reviewed and a unifying framework presented for thinking about how different approaches relate to one another. Local polynomial estimators are discussed in detail and their distribution theory is developed. The chapter then shows how nonparametric estimators form the building blocks for many semiparametric estimators, such as estimators for average derivatives, index models, partially linear models, and additively separable models. Semiparametric methods offer a middle ground between fully nonparametric and parametric approaches. Their main advantage is that they typically achieve faster rates of convergence than fully nonparametric approaches. In many cases, they converge at the parametric rate. The second part of the chapter considers in detail two issues that are central with regard to implementing flexible modeling methods: how to select the values of smoothing parameters in an optimal way and how to implement "trimming" procedures. It also reviews newly developed techniques for deriving the distribution theory of semiparametric estimators. The chapter concludes with an overview of approximation methods that speed up the computation of nonparametric estimates and make flexible estimation feasible even in very large size samples.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: Full text for ScienceDirect subscribers only

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

in new window

This chapter was published in:
  • J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6b.
  • This item is provided by Elsevier in its series Handbook of Econometrics with number 6b-74.
    Handle: RePEc:eee:ecochp:6b-74
    Contact details of provider: Web page:

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as in new window
    1. Kathryn Prewitt & Sharon Lohr, 2006. "Bandwidth selection in local polynomial regression using eigenvalues," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 135-154.
    2. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    3. Oliver LINTON, . "Applied nonparametric methods," Statistic und Oekonometrie 9312, Humboldt Universitaet Berlin.
    4. Stern, Steven, 1996. "Semiparametric estimates of the supply and demand effects of disability on labor force participation," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 49-70.
    5. Robinson, P M, 1991. "Automatic Frequency Domain Inference on Semiparametric and Nonparametric Models," Econometrica, Econometric Society, vol. 59(5), pages 1329-63, September.
    6. Horowitz, Joel L. & Lee, Sokbae, 2005. "Nonparametric Estimation of an Additive Quantile Regression Model," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1238-1249, December.
    7. Newey, Whitney K & Powell, James L & Walker, James R, 1990. "Semiparametric Estimation of Selection Models: Some Empirical Results," American Economic Review, American Economic Association, vol. 80(2), pages 324-28, May.
    8. Dinardo, J. & Fortin, N.M. & Lemieux, T., 1994. "Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach," Cahiers de recherche 9406, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    9. Buchinsky, Moshe, 1995. "Estimating the asymptotic covariance matrix for quantile regression models a Monte Carlo study," Journal of Econometrics, Elsevier, vol. 68(2), pages 303-338, August.
    10. Hausman, Jerry A, 1978. "Specification Tests in Econometrics," Econometrica, Econometric Society, vol. 46(6), pages 1251-71, November.
    11. Yatchew,Adonis, 2003. "Semiparametric Regression for the Applied Econometrician," Cambridge Books, Cambridge University Press, number 9780521012263, December.
    12. Moshe Buchinsky & Jinyong Hahn, 1998. "An Alternative Estimator for the Censored Quantile Regression Model," Econometrica, Econometric Society, vol. 66(3), pages 653-672, May.
    13. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-60, November.
    14. Tauchen, George, 1985. "Diagnostic testing and evaluation of maximum likelihood models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 415-443.
    15. Robinson, Peter M. & Delgado, Miguel A., 1992. "Nonparametric and semiparametric methods for economic research," UC3M Working papers. Economics 2827, Universidad Carlos III de Madrid. Departamento de Economía.
    16. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521608275, December.
    17. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-57, September.
    18. P. M. Robinson, 1989. "Hypothesis Testing in Semiparametric and Nonparametric Models for Econometric Time Series," Review of Economic Studies, Oxford University Press, vol. 56(4), pages 511-534.
    19. Horowitz, Joel L, 1992. "A Smoothed Maximum Score Estimator for the Binary Response Model," Econometrica, Econometric Society, vol. 60(3), pages 505-31, May.
    20. Buchinsky, Moshe, 1995. "Quantile regression, Box-Cox transformation model, and the U.S. wage structure, 1963-1987," Journal of Econometrics, Elsevier, vol. 65(1), pages 109-154, January.
    21. Hardle, Wolfgang & Hildenbrand, Werner & Jerison, Michael, 1991. "Empirical Evidence on the Law of Demand," Econometrica, Econometric Society, vol. 59(6), pages 1525-49, November.
    22. Hardle, W., 1992. "Applied Nonparametric Methods," Papers 9206, Tilburg - Center for Economic Research.
    23. Yoshihiko Nishiyama & Peter M. Robinson, 2005. "The Bootstrap and the Edgeworth Correction for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 73(3), pages 903-948, 05.
    24. Kim, W. C. & Park, B. U. & Marron, J. S., 1994. "Asymptotically best bandwidth selectors in kernel density estimation," Statistics & Probability Letters, Elsevier, vol. 19(2), pages 119-127, January.
    25. Newey, Whitney K, 1994. "The Asymptotic Variance of Semiparametric Estimators," Econometrica, Econometric Society, vol. 62(6), pages 1349-82, November.
    26. James J. Heckman, 1989. "Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: The Case of Manpower Training," NBER Working Papers 2861, National Bureau of Economic Research, Inc.
    27. Gronau, Reuben, 1973. "The Intrafamily Allocation of Time: The Value of the Housewives' Time," American Economic Review, American Economic Association, vol. 63(4), pages 634-51, September.
    28. Adonis Yatchew, 1998. "Nonparametric Regression Techniques in Economics," Journal of Economic Literature, American Economic Association, vol. 36(2), pages 669-721, June.
    29. Newey, Whitney K, 1990. "Semiparametric Efficiency Bounds," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(2), pages 99-135, April-Jun.
    30. Wu, De-Min, 1974. "Alternative Tests of Independence between Stochastic Regressors and Disturbances: Finite Sample Results," Econometrica, Econometric Society, vol. 42(3), pages 529-46, May.
    31. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    32. Pollard, David, 1985. "New Ways to Prove Central Limit Theorems," Econometric Theory, Cambridge University Press, vol. 1(03), pages 295-313, December.
    33. Klein, R.W. & Spady, R.H., 1991. "An Efficient Semiparametric Estimator for Binary Response Models," Papers 70, Bell Communications - Economic Research Group.
    34. Lewis, H Gregg, 1974. "Comments on Selectivity Biases in Wage Comparisons," Journal of Political Economy, University of Chicago Press, vol. 82(6), pages 1145-55, Nov.-Dec..
    35. Honore, Bo E. & Powell, James L., 1994. "Pairwise difference estimators of censored and truncated regression models," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 241-278.
    36. Angus Deaton & Christina Paxson, 1998. "Economies of Scale, Household Size, and the Demand for Food," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 897-930, October.
    37. Conley, Timothy G. & Hansen, Lars Peter & Liu, Wen-Fang, 1997. "Bootstrapping The Long Run," Macroeconomic Dynamics, Cambridge University Press, vol. 1(02), pages 279-311, June.
    38. Richard Blundell & Alan Duncan, 1998. "Kernel Regression in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 62-87.
    39. Robinson, P M, 1995. "The Normal Approximation for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 63(3), pages 667-80, May.
    40. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492 National Bureau of Economic Research, Inc.
    41. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
    42. Pagan,Adrian & Ullah,Aman, 1999. "Nonparametric Econometrics," Cambridge Books, Cambridge University Press, number 9780521355643, December.
    43. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    44. Powell, James L & Stock, James H & Stoker, Thomas M, 1989. "Semiparametric Estimation of Index Coefficients," Econometrica, Econometric Society, vol. 57(6), pages 1403-30, November.
    45. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    46. White, Halbert, 1980. "Using Least Squares to Approximate Unknown Regression Functions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 21(1), pages 149-70, February.
    47. Newey, Whitney K., 1987. "Specification tests for distributional assumptions in the Tobit model," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 125-145.
    48. Manski, Charles F., 1985. "Semiparametric analysis of discrete response : Asymptotic properties of the maximum score estimator," Journal of Econometrics, Elsevier, vol. 27(3), pages 313-333, March.
    49. Y. Nishiyama & P. M. Robinson, 2000. "Edgeworth Expansions for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 68(4), pages 931-980, July.
    50. Delgado, Miguel A & Robinson, Peter M, 1992. " Nonparametric and Semiparametric Methods for Economic Research," Journal of Economic Surveys, Wiley Blackwell, vol. 6(3), pages 201-49.
    51. Thomas Fraker & Rebecca Maynard, 1987. "The Adequacy of Comparison Group Designs for Evaluations of Employment-Related Programs," Journal of Human Resources, University of Wisconsin Press, vol. 22(2), pages 194-227.
    52. Yoshihiko Nishiyama & Peter M. Robinson, 2005. "The bootstrap and the Edgeworth correction for semiparametric averaged derivatives," LSE Research Online Documents on Economics 2297, London School of Economics and Political Science, LSE Library.
    53. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
    54. Powell, James L. & Stoker, Thomas M., 1996. "Optimal bandwidth choice for density-weighted averages," Journal of Econometrics, Elsevier, vol. 75(2), pages 291-316, December.
    55. Stoker, Thomas M., 1996. "Smoothing bias in the measurement of marginal effects," Journal of Econometrics, Elsevier, vol. 72(1-2), pages 49-84.
    56. Chaudhuri, Probal, 1991. "Global nonparametric estimation of conditional quantile functions and their derivatives," Journal of Multivariate Analysis, Elsevier, vol. 39(2), pages 246-269, November.
    57. Sherman, Robert P., 1994. "U-Processes in the Analysis of a Generalized Semiparametric Regression Estimator," Econometric Theory, Cambridge University Press, vol. 10(02), pages 372-395, June.
    58. Buchinsky, Moshe, 1994. "Changes in the U.S. Wage Structure 1963-1987: Application of Quantile Regression," Econometrica, Econometric Society, vol. 62(2), pages 405-58, March.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:eee:ecochp:6b-74. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Shamier, Wendy)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.