IDEAS home Printed from https://ideas.repec.org/p/tky/fseres/2006cf452.html
   My bibliography  Save this paper

Implementing Nonparametric and Semiparametric Estimators

Author

Listed:
  • Hidehiko Ichimura

    (Faculty of Economics, University of Tokyo)

  • Petra E. Todd

    (Department of Economics, University of Pennsylvania)

Abstract

This chapter reviews recent advances in nonparametric and semiparametric estimation, with an emphasis on applicability to empirical research and on resolving issues that arise in implementation. It considers techniques for estimating densities, conditional mean functions, derivatives of functions and conditional quantiles in a flexible way that imposes minimal functional form assumptions. The chapter begins by illustrating how flexible modeling methods have been applied in empirical research, drawing on recent examples of applications from labor economics, consumer demand estimation and treatment effects models. Then, key concepts in semiparametric and nonparametric modeling are introduced that do not have counterparts in parametric modeling, such as the so-called curse of dimensionality, the notion of models with an infinite number of parameters, the criteria used to define optimal convergence rates, and "dimension-free" estimators. After defining these new concepts, a large literature on nonparametric estimation is reviewed and a unifying framework presented for thinking about how different approaches relate to one another. Local polynomial estimators are discussed in detail and their distribution theory is developed. The chapter then shows how nonparametric estimators form the building blocks for many semiparametric estimators, such as estimators for average derivatives, index models, partially linear models, and additively separable models. Semiparametric methods offer a middle ground between fully nonparametric and parametric approaches. Their main advantage is that they typically achieve faster rates of convergence than fully nonparametric approaches. In many cases, they converge at the parametric rate. The second part of the chapter considers in detail two issues that are central with regard to implementing flexible modeling methods: how to select the values of smoothing parameters in an optimal way and how to implement "trimming" procedures. It also reviews newly developed techniques for deriving the distribution theory of semiparametric estimators. The chapter concludes with an overview of approximation methods that speed up the computation of nonparametric estimates and make flexible estimation feasible even in very large size samples.

Suggested Citation

  • Hidehiko Ichimura & Petra E. Todd, 2006. "Implementing Nonparametric and Semiparametric Estimators," CIRJE F-Series CIRJE-F-452, CIRJE, Faculty of Economics, University of Tokyo.
  • Handle: RePEc:tky:fseres:2006cf452
    as

    Download full text from publisher

    File URL: http://www.cirje.e.u-tokyo.ac.jp/research/dp/2006/2006cf452.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Horowitz, Joel L. & Lee, Sokbae, 2005. "Nonparametric Estimation of an Additive Quantile Regression Model," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1238-1249, December.
    2. P. M. Robinson, 1989. "Hypothesis Testing in Semiparametric and Nonparametric Models for Econometric Time Series," Review of Economic Studies, Oxford University Press, vol. 56(4), pages 511-534.
    3. Kim, W. C. & Park, B. U. & Marron, J. S., 1994. "Asymptotically best bandwidth selectors in kernel density estimation," Statistics & Probability Letters, Elsevier, vol. 19(2), pages 119-127, January.
    4. Delgado, Miguel A & Robinson, Peter M, 1992. " Nonparametric and Semiparametric Methods for Economic Research," Journal of Economic Surveys, Wiley Blackwell, vol. 6(3), pages 201-249.
    5. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    6. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters,in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492 National Bureau of Economic Research, Inc.
    7. DiNardo, John & Fortin, Nicole M & Lemieux, Thomas, 1996. "Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach," Econometrica, Econometric Society, vol. 64(5), pages 1001-1044, September.
    8. Chaudhuri, Probal, 1991. "Global nonparametric estimation of conditional quantile functions and their derivatives," Journal of Multivariate Analysis, Elsevier, vol. 39(2), pages 246-269, November.
    9. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    10. Pagan,Adrian & Ullah,Aman, 1999. "Nonparametric Econometrics," Cambridge Books, Cambridge University Press, number 9780521355643.
    11. Wu, De-Min, 1974. "Alternative Tests of Independence between Stochastic Regressors and Disturbances: Finite Sample Results," Econometrica, Econometric Society, vol. 42(3), pages 529-546, May.
    12. Newey, Whitney K & Powell, James L & Walker, James R, 1990. "Semiparametric Estimation of Selection Models: Some Empirical Results," American Economic Review, American Economic Association, vol. 80(2), pages 324-328, May.
    13. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    14. Hardle, Wolfgang & Hildenbrand, Werner & Jerison, Michael, 1991. "Empirical Evidence on the Law of Demand," Econometrica, Econometric Society, vol. 59(6), pages 1525-1549, November.
    15. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 38(2), pages 112-134.
    16. Hardle, Wolfgang & Linton, Oliver, 1986. "Applied nonparametric methods," Handbook of Econometrics,in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 38, pages 2295-2339 Elsevier.
    17. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    18. Moshe Buchinsky & Jinyong Hahn, 1998. "An Alternative Estimator for the Censored Quantile Regression Model," Econometrica, Econometric Society, vol. 66(3), pages 653-672, May.
    19. Angus Deaton & Christina Paxson, 1998. "Economies of Scale, Household Size, and the Demand for Food," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 897-930, October.
    20. Tauchen, George, 1985. "Diagnostic testing and evaluation of maximum likelihood models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 415-443.
    21. Kathryn Prewitt & Sharon Lohr, 2006. "Bandwidth selection in local polynomial regression using eigenvalues," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 135-154.
    22. Newey, Whitney K, 1990. "Semiparametric Efficiency Bounds," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(2), pages 99-135, April-Jun.
    23. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    24. Delgado, Miguel A. & Robinson, Peter M., 1992. "Nonparametric and semiparametric methods for economic research," UC3M Working papers. Economics 2827, Universidad Carlos III de Madrid. Departamento de Economía.
    25. Newey, Whitney K., 1987. "Specification tests for distributional assumptions in the Tobit model," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 125-145.
    26. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-660, November.
    27. Newey, Whitney K, 1994. "The Asymptotic Variance of Semiparametric Estimators," Econometrica, Econometric Society, vol. 62(6), pages 1349-1382, November.
    28. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    29. White, Halbert, 1980. "Using Least Squares to Approximate Unknown Regression Functions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 21(1), pages 149-170, February.
    30. Richard Blundell & Alan Duncan, 1998. "Kernel Regression in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 62-87.
    31. Pollard, David, 1985. "New Ways to Prove Central Limit Theorems," Econometric Theory, Cambridge University Press, vol. 1(03), pages 295-313, December.
    32. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    33. Yatchew,Adonis, 2003. "Semiparametric Regression for the Applied Econometrician," Cambridge Books, Cambridge University Press, number 9780521812832.
    34. Robinson, P M, 1991. "Automatic Frequency Domain Inference on Semiparametric and Nonparametric Models," Econometrica, Econometric Society, vol. 59(5), pages 1329-1363, September.
    35. Stern, Steven, 1996. "Semiparametric estimates of the supply and demand effects of disability on labor force participation," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 49-70.
    36. Buchinsky, Moshe, 1994. "Changes in the U.S. Wage Structure 1963-1987: Application of Quantile Regression," Econometrica, Econometric Society, vol. 62(2), pages 405-458, March.
    37. Manski, Charles F., 1985. "Semiparametric analysis of discrete response : Asymptotic properties of the maximum score estimator," Journal of Econometrics, Elsevier, vol. 27(3), pages 313-333, March.
    38. Powell, James L & Stock, James H & Stoker, Thomas M, 1989. "Semiparametric Estimation of Index Coefficients," Econometrica, Econometric Society, vol. 57(6), pages 1403-1430, November.
    39. Nishiyama, Yoshihiko & Robinson, Peter M., 2005. "The bootstrap and the Edgeworth correction for semiparametric averaged derivatives," LSE Research Online Documents on Economics 2297, London School of Economics and Political Science, LSE Library.
    40. Conley, Timothy G. & Hansen, Lars Peter & Liu, Wen-Fang, 1997. "Bootstrapping The Long Run," Macroeconomic Dynamics, Cambridge University Press, vol. 1(02), pages 279-311, June.
    41. Yoshihiko Nishiyama & Peter M. Robinson, 2005. "The Bootstrap and the Edgeworth Correction for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 73(3), pages 903-948, May.
    42. Gronau, Reuben, 1973. "The Intrafamily Allocation of Time: The Value of the Housewives' Time," American Economic Review, American Economic Association, vol. 63(4), pages 634-651, September.
    43. Buchinsky, Moshe, 1995. "Estimating the asymptotic covariance matrix for quantile regression models a Monte Carlo study," Journal of Econometrics, Elsevier, vol. 68(2), pages 303-338, August.
    44. Y. Nishiyama & P. M. Robinson, 2000. "Edgeworth Expansions for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 68(4), pages 931-980, July.
    45. Hardle, Wolfgang & Linton, Oliver, 1986. "Applied nonparametric methods," Handbook of Econometrics,in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 38, pages 2295-2339 Elsevier.
    46. Buchinsky, Moshe, 1995. "Quantile regression, Box-Cox transformation model, and the U.S. wage structure, 1963-1987," Journal of Econometrics, Elsevier, vol. 65(1), pages 109-154, January.
    47. Powell, James L. & Stoker, Thomas M., 1996. "Optimal bandwidth choice for density-weighted averages," Journal of Econometrics, Elsevier, vol. 75(2), pages 291-316, December.
    48. Klein, Roger W & Spady, Richard H, 1993. "An Efficient Semiparametric Estimator for Binary Response Models," Econometrica, Econometric Society, vol. 61(2), pages 387-421, March.
    49. Adonis Yatchew, 1998. "Nonparametric Regression Techniques in Economics," Journal of Economic Literature, American Economic Association, vol. 36(2), pages 669-721, June.
    50. Sherman, Robert P., 1994. "U-Processes in the Analysis of a Generalized Semiparametric Regression Estimator," Econometric Theory, Cambridge University Press, vol. 10(02), pages 372-395, June.
    51. Horowitz, Joel L, 1992. "A Smoothed Maximum Score Estimator for the Binary Response Model," Econometrica, Econometric Society, vol. 60(3), pages 505-531, May.
    52. Lewis, H Gregg, 1974. "Comments on Selectivity Biases in Wage Comparisons," Journal of Political Economy, University of Chicago Press, vol. 82(6), pages 1145-1155, Nov.-Dec..
    53. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
    54. Robinson, P M, 1995. "The Normal Approximation for Semiparametric Averaged Derivatives," Econometrica, Econometric Society, vol. 63(3), pages 667-680, May.
    55. Stoker, Thomas M., 1996. "Smoothing bias in the measurement of marginal effects," Journal of Econometrics, Elsevier, vol. 72(1-2), pages 49-84.
    56. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
    57. Honore, Bo E. & Powell, James L., 1994. "Pairwise difference estimators of censored and truncated regression models," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 241-278.
    58. Thomas Fraker & Rebecca Maynard, 1987. "The Adequacy of Comparison Group Designs for Evaluations of Employment-Related Programs," Journal of Human Resources, University of Wisconsin Press, vol. 22(2), pages 194-227.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Heckman, James J. & Schmierer, Daniel, 2010. "Tests of hypotheses arising in the correlated random coefficient model," Economic Modelling, Elsevier, vol. 27(6), pages 1355-1367, November.
    2. Wang, Xiaojun & Fleisher, Belton M. & Li, Haizheng & Li, Shi, 2014. "Access to college and heterogeneous returns to education in China," Economics of Education Review, Elsevier, vol. 42(C), pages 78-92.
    3. Kristensen, Dennis, 2010. "Pseudo-maximum likelihood estimation in two classes of semiparametric diffusion models," Journal of Econometrics, Elsevier, vol. 156(2), pages 239-259, June.
    4. Cattaneo, Matias D. & Crump, Richard K. & Jansson, Michael, 2010. "Robust Data-Driven Inference for Density-Weighted Average Derivatives," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1070-1083.
    5. Carlos A. Flores & Alfonso Flores-Lagunes & Arturo Gonzalez & Todd C. Neumann, 2009. "Estimating the Effects of Lenght of Exposure to Traning Program: The Case of Job Corps," Working Papers 2010-3, University of Miami, Department of Economics.
    6. Galvao, Antonio F. & Kato, Kengo, 2016. "Smoothed quantile regression for panel data," Journal of Econometrics, Elsevier, vol. 193(1), pages 92-112.
    7. Shin Kanaya, 2015. "Uniform Convergence Rates of Kernel-Based Nonparametric Estimators for Continuous Time Diffusion Processes: A Damping Function Approach," CREATES Research Papers 2015-50, Department of Economics and Business Economics, Aarhus University.
    8. Heckman, James J. & Schmierer, Daniel & Urzua, Sergio, 2010. "Testing the correlated random coefficient model," Journal of Econometrics, Elsevier, vol. 158(2), pages 177-203, October.
    9. Hill, Jonathan B. & Shneyerov, Artyom, 2013. "Are there common values in first-price auctions? A tail-index nonparametric test," Journal of Econometrics, Elsevier, vol. 174(2), pages 144-164.
    10. Cattaneo, Matias D. & Farrell, Max H., 2013. "Optimal convergence rates, Bahadur representation, and asymptotic normality of partitioning estimators," Journal of Econometrics, Elsevier, vol. 174(2), pages 127-143.
    11. Gelo, Dambala & Muchapondwa, Edwin & Koch, Steven F., 2016. "Decentralization, market integration and efficiency-equity trade-offs: Evidence from Joint Forest Management in Ethiopian villages," Journal of Forest Economics, Elsevier, vol. 22(C), pages 1-23.
    12. Gagliardini, Patrick & Ronchetti, Diego, 2013. "Semi-parametric estimation of American option prices," Journal of Econometrics, Elsevier, vol. 173(1), pages 57-82.
    13. Pedro Cerqueira, 2013. "A closer look at the world business cycle synchronization," International Economics and Economic Policy, Springer, vol. 10(3), pages 349-363, September.
    14. Rothe, Christoph, 2009. "Semiparametric estimation of binary response models with endogenous regressors," Journal of Econometrics, Elsevier, vol. 153(1), pages 51-64, November.
    15. Lee, Wang-Sheng, 2014. "Big and Tall: Is there a Height Premium or Obesity Penalty in the Labor Market?," IZA Discussion Papers 8606, Institute for the Study of Labor (IZA).
    16. Mogstad, M. & Wiswall, M., 2012. "Instrumental variables estimation with partially missing instruments," Economics Letters, Elsevier, vol. 114(2), pages 186-189.
    17. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics,in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76 Elsevier.
    18. Dennis Kristensen, 2009. "Semiparametric Modelling and Estimation: A Selective Overview," CREATES Research Papers 2009-44, Department of Economics and Business Economics, Aarhus University.
    19. Cohen, Jeffrey P. & Osleeb, Jeffrey P. & Yang, Ke, 2014. "Semi-parametric regression models and economies of scale in the presence of an endogenous variable," Regional Science and Urban Economics, Elsevier, vol. 49(C), pages 252-261.

    More about this item

    JEL classification:

    • C39 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Other

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tky:fseres:2006cf452. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (CIRJE administrative office). General contact details of provider: http://edirc.repec.org/data/ritokjp.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.