IDEAS home Printed from https://ideas.repec.org/p/bro/econwp/2012-16.html
   My bibliography  Save this paper

Bonferroni-Based Size-Correction for Nonstandard Testing Problems

Author

Abstract

We develop powerful new size-correction procedures for nonstandard hypothesis testing environments in which the asymptotic distribution of a test statistic is discontinuous in a parameter under the null hypothesis. Examples of this form of testing problem are pervasive in econometrics and complicate inference by making size di- cult to control. This paper introduces two sets of new size-correction methods that correspond to two di erent general hypothesis testing frameworks. The new methods are designed to maximize the power of the underlying test while maintaining correct asymptotic size uniformly over the parameter space speci ed by the null hypothesis. They involve the construction of critical values that make use of reasoning derived from Bonferroni bounds. The rst set of new methods provides complementary alternatives to existing size-correction methods, entailing substantially higher power for many testing problems. The second set of new methods provides the rst available asymptotically size-correct tests for the general class of testing problems to which it applies. This class includes hypothesis tests on parameters after consistent model selection and tests on super-ecient/hard-thresholding estimators. We detail the construction and performance of the new tests in three speci c examples: testing after conservative model selection, testing when a nuisance parameter may be on a boundary and testing after consistent model selection.

Suggested Citation

  • Adam McCloskey, 2012. "Bonferroni-Based Size-Correction for Nonstandard Testing Problems," Working Papers 2012-16, Brown University, Department of Economics.
  • Handle: RePEc:bro:econwp:2012-16
    as

    Download full text from publisher

    File URL: https://economics.brown.edu/sites/g/files/dprerj726/files/papers/2012-16_paper.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Validity Of Subsampling And “Plug-In Asymptotic” Inference For Parameters Defined By Moment Inequalities," Econometric Theory, Cambridge University Press, vol. 25(3), pages 669-709, June.
    2. Graham Elliott & Ulrich K. Müller & Mark W. Watson, 2015. "Nearly Optimal Tests When a Nuisance Parameter Is Present Under the Null Hypothesis," Econometrica, Econometric Society, vol. 83, pages 771-811, March.
    3. Donald W. K. Andrews & Xu Cheng, 2012. "Estimation and Inference With Weak, Semi‐Strong, and Strong Identification," Econometrica, Econometric Society, vol. 80(5), pages 2153-2211, September.
    4. Elliott, Graham & Stock, James H., 1994. "Inference in Time Series Regression When the Order of Integration of a Regressor is Unknown," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 672-700, August.
    5. Bruce E. Hansen, 1999. "The Grid Bootstrap And The Autoregressive Model," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 594-607, November.
    6. Xiaoxia Shi, 2015. "A nondegenerate Vuong test," Quantitative Economics, Econometric Society, vol. 6(1), pages 85-121, March.
    7. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    8. Patrik Guggenberger & Frank Kleibergen & Sophocles Mavroeidis & Linchun Chen, 2012. "On the Asymptotic Sizes of Subset Anderson–Rubin and Lagrange Multiplier Tests in Linear Instrumental Variables Regression," Econometrica, Econometric Society, vol. 80(6), pages 2649-2666, November.
    9. Donald W. K. Andrews, 1999. "Estimation When a Parameter Is on a Boundary," Econometrica, Econometric Society, vol. 67(6), pages 1341-1384, November.
    10. Leeb, Hannes & Pötscher, Benedikt M., 2008. "Can One Estimate The Unconditional Distribution Of Post-Model-Selection Estimators?," Econometric Theory, Cambridge University Press, vol. 24(2), pages 338-376, April.
    11. Donald W. K. Andrews & Panle Jia Barwick, 2012. "Inference for Parameters Defined by Moment Inequalities: A Recommended Moment Selection Procedure," Econometrica, Econometric Society, vol. 80(6), pages 2805-2826, November.
    12. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    13. Cheng, Xu, 2015. "Robust inference in nonlinear models with mixed identification strength," Journal of Econometrics, Elsevier, vol. 189(1), pages 207-228.
    14. Nelson, Charles R & Startz, Richard, 1990. "Some Further Results on the Exact Small Sample Properties of the Instrumental Variable Estimator," Econometrica, Econometric Society, vol. 58(4), pages 967-976, July.
    15. Sukjin Han & Adam McCloskey, 2019. "Estimation and inference with a (nearly) singular Jacobian," Quantitative Economics, Econometric Society, vol. 10(3), pages 1019-1068, July.
    16. Jorg Stoye, 2009. "More on Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 77(4), pages 1299-1315, July.
    17. Massimo Franchi & Søren Johansen, 2017. "Improved Inference on Cointegrating Vectors in the Presence of a near Unit Root Using Adjusted Quantiles," Econometrics, MDPI, vol. 5(2), pages 1-20, June.
    18. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2014. "A Practical Two‐Step Method for Testing Moment Inequalities," Econometrica, Econometric Society, vol. 82, pages 1979-2002, September.
    19. Pötscher, Benedikt M. & Leeb, Hannes, 2009. "On the distribution of penalized maximum likelihood estimators: The LASSO, SCAD, and thresholding," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2065-2082, October.
    20. Hansen, Bruce E., 2005. "Challenges For Econometric Model Selection," Econometric Theory, Cambridge University Press, vol. 21(1), pages 60-68, February.
    21. Pötscher, Benedikt M. & Schneider, Ulrike, 2008. "Confidence sets based on penalized maximum likelihood estimators," MPRA Paper 9062, University Library of Munich, Germany.
    22. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    23. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "ASYMPTOTIC SIZE AND A PROBLEM WITH SUBSAMPLING AND WITH THE m OUT OF n BOOTSTRAP," Econometric Theory, Cambridge University Press, vol. 26(2), pages 426-468, April.
    24. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    25. Moon, Hyungsik Roger & Schorfheide, Frank, 2009. "Estimation with overidentifying inequality moment conditions," Journal of Econometrics, Elsevier, vol. 153(2), pages 136-154, December.
    26. Chaudhuri, Saraswata & Zivot, Eric, 2011. "A new method of projection-based inference in GMM with weakly identified nuisance parameters," Journal of Econometrics, Elsevier, vol. 164(2), pages 239-251, October.
    27. Hansen, Bruce E., 2016. "Efficient shrinkage in parametric models," Journal of Econometrics, Elsevier, vol. 190(1), pages 115-132.
    28. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "Applications of subsampling, hybrid, and size-correction methods," Journal of Econometrics, Elsevier, vol. 158(2), pages 285-305, October.
    29. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    30. Campbell, John Y. & Yogo, Motohiro, 2006. "Efficient tests of stock return predictability," Journal of Financial Economics, Elsevier, vol. 81(1), pages 27-60, July.
    31. Elliott, Graham & Müller, Ulrich K., 2014. "Pre and post break parameter inference," Journal of Econometrics, Elsevier, vol. 180(2), pages 141-157.
    32. Kabaila, Paul, 1998. "Valid Confidence Intervals In Regression After Variable Selection," Econometric Theory, Cambridge University Press, vol. 14(4), pages 463-482, August.
    33. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    34. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    35. Peter C. B. Phillips, 2014. "On Confidence Intervals for Autoregressive Roots and Predictive Regression," Econometrica, Econometric Society, vol. 82(3), pages 1177-1195, May.
    36. Frank Kleibergen, 2002. "Pivotal Statistics for Testing Structural Parameters in Instrumental Variables Regression," Econometrica, Econometric Society, vol. 70(5), pages 1781-1803, September.
    37. Andrews, Donald W K, 2001. "Testing When a Parameter Is on the Boundary of the Maintained Hypothesis," Econometrica, Econometric Society, vol. 69(3), pages 683-734, May.
    38. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," Review of Economic Studies, Oxford University Press, vol. 81(2), pages 608-650.
    39. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators," Journal of Econometrics, Elsevier, vol. 152(1), pages 19-27, September.
    40. Guggenberger, Patrik, 2010. "The impact of a Hausman pretest on the size of a hypothesis test: The panel data case," Journal of Econometrics, Elsevier, vol. 156(2), pages 337-343, June.
    41. Guggenberger, Patrik, 2010. "The Impact Of A Hausman Pretest On The Asymptotic Size Of A Hypothesis Test," Econometric Theory, Cambridge University Press, vol. 26(2), pages 369-382, April.
    42. Leeb, Hannes & Pötscher, Benedikt M., 2012. "Testing in the Presence of Nuisance Parameters: Some Comments on Tests Post-Model-Selection and Random Critical Values," MPRA Paper 41459, University Library of Munich, Germany.
    43. Bruce E. Hansen, 2014. "Model averaging, asymptotic risk, and regressor groups," Quantitative Economics, Econometric Society, vol. 5(3), pages 495-530, November.
    44. Cavanagh, Christopher L. & Elliott, Graham & Stock, James H., 1995. "Inference in Models with Nearly Integrated Regressors," Econometric Theory, Cambridge University Press, vol. 11(5), pages 1131-1147, October.
    45. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    46. Graham Elliott, 1998. "On the Robustness of Cointegration Methods when Regressors Almost Have Unit Roots," Econometrica, Econometric Society, vol. 66(1), pages 149-158, January.
    47. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    48. Donald W. K. Andrews & Patrik Guggenberger, 2009. "Hybrid and Size-Corrected Subsampling Methods," Econometrica, Econometric Society, vol. 77(3), pages 721-762, May.
    49. Anna Mikusheva, 2007. "Uniform Inference in Autoregressive Models," Econometrica, Econometric Society, vol. 75(5), pages 1411-1452, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    2. Wang, Wenjie & Doko Tchatoka, Firmin, 2018. "On Bootstrap inconsistency and Bonferroni-based size-correction for the subset Anderson–Rubin test under conditional homoskedasticity," Journal of Econometrics, Elsevier, vol. 207(1), pages 188-211.
    3. Cheng, Xu, 2015. "Robust inference in nonlinear models with mixed identification strength," Journal of Econometrics, Elsevier, vol. 189(1), pages 207-228.
    4. Firmin Doko Tchatoka & Wenjie Wang, 2020. "Uniform Inference after Pretesting for Exogeneity," School of Economics Working Papers 2020-05, University of Adelaide, School of Economics.
    5. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    6. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    7. Tetsuya Kaji, 2019. "Theory of Weak Identification in Semiparametric Models," Papers 1908.10478, arXiv.org, revised Aug 2020.
    8. Gregory Cox, 2020. "Weak Identification with Bounds in a Class of Minimum Distance Models," Papers 2012.11222, arXiv.org.
    9. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    10. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "Applications of subsampling, hybrid, and size-correction methods," Journal of Econometrics, Elsevier, vol. 158(2), pages 285-305, October.
    11. Andrews, Donald W.K. & Cheng, Xu, 2014. "Gmm Estimation And Uniform Subvector Inference With Possible Identification Failure," Econometric Theory, Cambridge University Press, vol. 30(2), pages 287-333, April.
    12. Chen, Le-Yu & Szroeter, Jerzy, 2014. "Testing multiple inequality hypotheses: A smoothed indicator approach," Journal of Econometrics, Elsevier, vol. 178(P3), pages 678-693.
    13. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    14. Mikusheva, Anna, 2013. "Survey on statistical inferences in weakly-identified instrumental variable models," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 29(1), pages 117-131.
    15. Andrews, Donald W.K. & Cheng, Xu, 2013. "Maximum likelihood estimation and uniform inference with sporadic identification failure," Journal of Econometrics, Elsevier, vol. 173(1), pages 36-56.
    16. Ketz, Philipp, 2018. "Subvector inference when the true parameter vector may be near or at the boundary," Journal of Econometrics, Elsevier, vol. 207(2), pages 285-306.
    17. Rosen, Adam M., 2008. "Confidence sets for partially identified parameters that satisfy a finite number of moment inequalities," Journal of Econometrics, Elsevier, vol. 146(1), pages 107-117, September.
    18. Shi, Xiaoxia, 2015. "Model selection tests for moment inequality models," Journal of Econometrics, Elsevier, vol. 187(1), pages 1-17.
    19. Moreira, Humberto & Moreira, Marcelo J., 2019. "Optimal two-sided tests for instrumental variables regression with heteroskedastic and autocorrelated errors," Journal of Econometrics, Elsevier, vol. 213(2), pages 398-433.
    20. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.

    More about this item

    Keywords

    Hypothesis testing; uniform inference; asymptotic size; exact size; power; size-correction; model selection; boundary problems; local asymptotics;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bro:econwp:2012-16. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brown Economics Webmaster (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.