IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this paper

Bonferroni-Based Size-Correction for Nonstandard Testing Problems

We develop powerful new size-correction procedures for nonstandard hypothesis testing environments in which the asymptotic distribution of a test statistic is discontinuous in a parameter under the null hypothesis. Examples of this form of testing problem are pervasive in econometrics and complicate inference by making size di- cult to control. This paper introduces two sets of new size-correction methods that correspond to two di erent general hypothesis testing frameworks. The new methods are designed to maximize the power of the underlying test while maintaining correct asymptotic size uniformly over the parameter space speci ed by the null hypothesis. They involve the construction of critical values that make use of reasoning derived from Bonferroni bounds. The rst set of new methods provides complementary alternatives to existing size-correction methods, entailing substantially higher power for many testing problems. The second set of new methods provides the rst available asymptotically size-correct tests for the general class of testing problems to which it applies. This class includes hypothesis tests on parameters after consistent model selection and tests on super-ecient/hard-thresholding estimators. We detail the construction and performance of the new tests in three speci c examples: testing after conservative model selection, testing when a nuisance parameter may be on a boundary and testing after consistent model selection.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Brown University, Department of Economics in its series Working Papers with number 2012-16.

in new window

Date of creation: 2012
Date of revision:
Handle: RePEc:bro:econwp:2012-16
Contact details of provider: Postal:
Department of Economics, Brown University, Providence, RI 02912

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Donald W.K. Andrews & Panle Jia, 2008. "Inference for Parameters Defined by Moment Inequalities: A Recommended Moment Selection Procedure," Cowles Foundation Discussion Papers 1676, Cowles Foundation for Research in Economics, Yale University.
  2. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
  3. Jörg Stoye, 2008. "More on confidence intervals for partially identified parameters," CeMMAP working papers CWP11/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  4. Hansen, Bruce E., 2005. "Challenges For Econometric Model Selection," Econometric Theory, Cambridge University Press, vol. 21(01), pages 60-68, February.
  5. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "ASYMPTOTIC SIZE AND A PROBLEM WITH SUBSAMPLING AND WITH THE m OUT OF n BOOTSTRAP," Econometric Theory, Cambridge University Press, vol. 26(02), pages 426-468, April.
  6. Anna Mikusheva, 2007. "Uniform Inference in Autoregressive Models," Econometrica, Econometric Society, vol. 75(5), pages 1411-1452, 09.
  7. Saraswata Chaudhuri & Eric Zivot, 2008. "A new method of projection-based inference in GMM with weakly identified nuisance parameters," Working Papers UWEC-2008-26, University of Washington, Department of Economics.
  8. Donald W. K. Andrews & Xu Cheng, 2012. "Estimation and Inference With Weak, Semi‐Strong, and Strong Identification," Econometrica, Econometric Society, vol. 80(5), pages 2153-2211, 09.
  9. Donald W.K. Andrews & Xu Cheng & Patrik Guggenberger, 2011. "Generic Results for Establishing the Asymptotic Size of Confidence Sets and Tests," Cowles Foundation Discussion Papers 1813, Cowles Foundation for Research in Economics, Yale University.
  10. Leeb, Hannes & P tscher, Benedikt M., 2008. "Can One Estimate The Unconditional Distribution Of Post-Model-Selection Estimators?," Econometric Theory, Cambridge University Press, vol. 24(02), pages 338-376, April.
  11. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2014. "A Practical Two‐Step Method for Testing Moment Inequalities," Econometrica, Econometric Society, vol. 82, pages 1979-2002, 09.
  12. Douglas Staiger & James H. Stock, 1994. "Instrumental Variables Regression with Weak Instruments," NBER Technical Working Papers 0151, National Bureau of Economic Research, Inc.
  13. Pötscher, Benedikt M. & Leeb, Hannes, 2009. "On the distribution of penalized maximum likelihood estimators: The LASSO, SCAD, and thresholding," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2065-2082, October.
  14. Leeb, Hannes & P tscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(01), pages 21-59, February.
  15. Donald W. K. Andrews & Patrik Guggenberger, 2009. "Hybrid and Size-Corrected Subsampling Methods," Econometrica, Econometric Society, vol. 77(3), pages 721-762, 05.
  16. Donald W.K. Andrews, 1999. "Testing When a Parameter Is on the Boundary of the Maintained Hypothesis," Cowles Foundation Discussion Papers 1229, Cowles Foundation for Research in Economics, Yale University.
  17. Patrik Guggenberger & Frank Kleibergen & Sophocles Mavroeidis & Linchun Chen, 2012. "On the Asymptotic Sizes of Subset Anderson–Rubin and Lagrange Multiplier Tests in Linear Instrumental Variables Regression," Econometrica, Econometric Society, vol. 80(6), pages 2649-2666, November.
  18. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, 07.
  19. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "Applications of subsampling, hybrid, and size-correction methods," Journal of Econometrics, Elsevier, vol. 158(2), pages 285-305, October.
  20. Kabaila, Paul, 1998. "Valid Confidence Intervals In Regression After Variable Selection," Econometric Theory, Cambridge University Press, vol. 14(04), pages 463-482, August.
  21. Moon, Hyungsik Roger & Schorfheide, Frank, 2009. "Estimation with overidentifying inequality moment conditions," Journal of Econometrics, Elsevier, vol. 153(2), pages 136-154, December.
  22. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
  23. Guggenberger, Patrik, 2010. "The Impact Of A Hausman Pretest On The Asymptotic Size Of A Hypothesis Test," Econometric Theory, Cambridge University Press, vol. 26(02), pages 369-382, April.
  24. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators," Journal of Econometrics, Elsevier, vol. 152(1), pages 19-27, September.
  25. Donald W. K. Andrews, 1999. "Estimation When a Parameter Is on a Boundary," Econometrica, Econometric Society, vol. 67(6), pages 1341-1384, November.
  26. Leeb, Hannes & Pötscher, Benedikt M., 2012. "Testing in the Presence of Nuisance Parameters: Some Comments on Tests Post-Model-Selection and Random Critical Values," MPRA Paper 41459, University Library of Munich, Germany.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:bro:econwp:2012-16. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Brown Economics Webmaster)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.