Calculating confidence intervals for continuous and discontinuous functions of parameters
Applied researchers often need to estimate confidence intervals for functions of parameters, such as the effects of counterfactual policy changes. If the function is continuously differentiable and has non-zero and bounded derivatives, then they can use the delta method. However, if the function is nondifferentiable (as in the case of simulating functions with zero-one outcomes), has zero derivatives, or unbounded derivatives, then researchers usually use the nonparametric bootstrap or sample from the asymptotic distribution of the estimated parameter vector. Researchers also use these bootstrap approaches when the function is well-behaved but complicated. Indeed, these approaches are advocated by two very influential published articles. We first show that both of these bootstrap procedures can produce confidence intervals whose asymptotic coverage is less than advertised, i.e. confidence intervals that are too small. We then propose two procedures that provide correct coverage. In applications, we find that the bootstrap approaches mentioned above produce confidence intervals that are significantly smaller than their consistent counterparts, suggesting that previous empirical work is likely to have been overly optimistic in terms of the precision of estimated counterfactual effects.
|Date of creation:||31 May 2013|
|Contact details of provider:|| Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE|
Phone: (+44) 020 7291 4800
Fax: (+44) 020 7323 4780
Web page: http://cemmap.ifs.org.uk
More information through EDIRC
|Order Information:|| Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Gunter J. Hitsch & Ali Hortaçsu & Dan Ariely, 2010. "Matching and Sorting in Online Dating," American Economic Review, American Economic Association, vol. 100(1), pages 130-163, March.
- Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "ASYMPTOTIC SIZE AND A PROBLEM WITH SUBSAMPLING AND WITH THE m OUT OF n BOOTSTRAP," Econometric Theory, Cambridge University Press, vol. 26(02), pages 426-468, April.
- Hoderlein, Stefan & Mihaleva, Sonya, 2008. "Increasing the price variation in a repeated cross section," Journal of Econometrics, Elsevier, vol. 147(2), pages 316-325, December.
- Jorg Stoye, 2009.
"More on Confidence Intervals for Partially Identified Parameters,"
Econometric Society, vol. 77(4), pages 1299-1315, 07.
- Jörg Stoye, 2008. "More on confidence intervals for partially identified parameters," CeMMAP working papers CWP11/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Donald W.K. Andrews & Xu Cheng, 2010.
"Estimation and Inference with Weak, Semi-strong, and Strong Identification,"
Cowles Foundation Discussion Papers
1773, Cowles Foundation for Research in Economics, Yale University.
- Donald W. K. Andrews & Xu Cheng, 2012. "Estimation and Inference With Weak, Semi‐Strong, and Strong Identification," Econometrica, Econometric Society, vol. 80(5), pages 2153-2211, 09.
- Donald W.K. Andrews & Xu Cheng, 2010. "Estimation and Inference with Weak, Semi-strong, and Strong Identification," Cowles Foundation Discussion Papers 1773R, Cowles Foundation for Research in Economics, Yale University, revised Jul 2011.
- Fitzenberger, Bernd & Osikominu, Aderonke & Paul, Marie, 2010.
"The heterogeneous effects of training incidence and duration on labor market transitions,"
ZEW Discussion Papers
10-077, ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
- Fitzenberger, Bernd & Osikominu, Aderonke & Paul, Marie, 2010. "The Heterogeneous Effects of Training Incidence and Duration on Labor Market Transitions," IZA Discussion Papers 5269, Institute for the Study of Labor (IZA).
- Cameron,A. Colin & Trivedi,Pravin K., 2005. "Microeconometrics," Cambridge Books, Cambridge University Press, number 9780521848053, December.
- Donald W. K. Andrews & Xu Cheng, 2011.
"Maximum Likelihood Estimation and Uniform Inference with Sporadic Identification Failure,"
Cowles Foundation Discussion Papers
1824R, Cowles Foundation for Research in Economics, Yale University, revised Oct 2012.
- Andrews, Donald W.K. & Cheng, Xu, 2013. "Maximum likelihood estimation and uniform inference with sporadic identification failure," Journal of Econometrics, Elsevier, vol. 173(1), pages 36-56.
- Donald W. K. Andrews & Xu Cheng, 2011. "Maximum Likelihood Estimation and Uniform Inference with Sporadic Identification Failure," Cowles Foundation Discussion Papers 1824, Cowles Foundation for Research in Economics, Yale University.
- Stephen P. Ryan, 2012.
"The Costs of Environmental Regulation in a Concentrated Industry,"
Econometric Society, vol. 80(3), pages 1019-1061, 05.
- Stephen Ryan, 2005. "The Costs of Environmental Regulation in a Concentrated Industry," Working Papers 0510, Massachusetts Institute of Technology, Center for Energy and Environmental Policy Research.
- Stephen Ryan, 2006. "The Costs of Environmental Regulation in a Concentrated Industry," 2006 Meeting Papers 9, Society for Economic Dynamics.
- Gaure, Simen & Røed, Knut & Westlie, Lars, 2012. "Job search incentives and job match quality," Labour Economics, Elsevier, vol. 19(3), pages 438-450.
- Andrew Harvey (ed.), 1994. "Time Series," Books, Edward Elgar Publishing, volume 0, number 599.
- Donald W. K. Andrews, 2000. "Inconsistency of the Bootstrap when a Parameter Is on the Boundary of the Parameter Space," Econometrica, Econometric Society, vol. 68(2), pages 399-406, March.
When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:23/13. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Emma Hyman)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.