IDEAS home Printed from https://ideas.repec.org/a/cup/etheor/v39y2023i4p789-847_4.html
   My bibliography  Save this article

How Reliable Are Bootstrap-Based Heteroskedasticity Robust Tests?

Author

Listed:
  • Pötscher, Benedikt M.
  • Preinerstorfer, David

Abstract

We develop theoretical finite-sample results concerning the size of wild bootstrap-based heteroskedasticity robust tests in linear regression models. In particular, these results provide an efficient diagnostic check, which can be used to weed out tests that are unreliable for a given testing problem in the sense that they overreject substantially. This allows us to assess the reliability of a large variety of wild bootstrap-based tests in an extensive numerical study.

Suggested Citation

  • Pötscher, Benedikt M. & Preinerstorfer, David, 2023. "How Reliable Are Bootstrap-Based Heteroskedasticity Robust Tests?," Econometric Theory, Cambridge University Press, vol. 39(4), pages 789-847, August.
    • Handle: RePEc:cup:etheor:v:39:y:2023:i:4:p:789-847_4
    as

    Download full text from publisher

    File URL: https://www.cambridge.org/core/product/identifier/S0266466622000184/type/journal_article
    File Function: link to article abstract page
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Chesher, Andrew, 1989. "Hajek Inequalities, Measures of Leverage and the Size of Heteroskedasticity Robust Wald Tests," Econometrica, Econometric Society, vol. 57(4), pages 971-977, July.
    2. Godfrey, Leslie G. & Orme, Chris D., 2004. "Controlling the finite sample significance levels of heteroskedasticity-robust tests of several linear restrictions on regression coefficients," Economics Letters, Elsevier, vol. 82(2), pages 281-287, February.
    3. Guido W. Imbens & Michal Kolesár, 2016. "Robust Standard Errors in Small Samples: Some Practical Advice," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 701-712, October.
    4. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589833, September.
    5. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    6. DAVIDSON, Russel & MACKINNON, James G., 1985. "Heteroskedastcity-robust tests in regressions directions," LIDAM Reprints CORE 678, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    7. Cribari-Neto, Francisco, 2004. "Asymptotic inference under heteroskedasticity of unknown form," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 215-233, March.
    8. Richard, Patrick, 2017. "Robust heteroskedasticity-robust tests," Economics Letters, Elsevier, vol. 159(C), pages 28-32.
    9. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    10. Pötscher, Benedikt M. & Preinerstorfer, David, 2018. "Controlling the size of autocorrelation robust tests," Journal of Econometrics, Elsevier, vol. 207(2), pages 406-431.
    11. Chesher, Andrew & Austin, Gerard, 1991. "The finite-sample distributions of heteroskedasticity robust Wald statistics," Journal of Econometrics, Elsevier, vol. 47(1), pages 153-173, January.
    12. Chesher, Andrew & Jewitt, Ian, 1987. "The Bias of a Heteroskedasticity Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 55(5), pages 1217-1222, September.
    13. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589819, September.
    14. Flachaire, Emmanuel, 1999. "A better way to bootstrap pairs," Economics Letters, Elsevier, vol. 64(3), pages 257-262, September.
    15. Cragg, John G., 1992. "Quasi-Aitken estimation for heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 179-201.
    16. Rothenberg, Thomas J, 1988. "Approximate Power Functions for Some Robust Tests of Regression Coefficients," Econometrica, Econometric Society, vol. 56(5), pages 997-1019, September.
    17. van Giersbergen, Noud P. A. & Kiviet, Jan F., 2002. "How to implement the bootstrap in static or stable dynamic regression models: test statistic versus confidence region approach," Journal of Econometrics, Elsevier, vol. 108(1), pages 133-156, May.
    18. MacKinnon, James G. & White, Halbert, 1985. "Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties," Journal of Econometrics, Elsevier, vol. 29(3), pages 305-325, September.
    19. Eric S. Lin & Ta-Sheng Chou, 2018. "Finite-sample refinement of GMM approach to nonlinear models under heteroskedasticity of unknown form," Econometric Reviews, Taylor & Francis Journals, vol. 37(1), pages 1-28, January.
    20. Flachaire, Emmanuel, 2005. "Bootstrapping heteroskedastic regression models: wild bootstrap vs. pairs bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 361-376, April.
    21. Bates, Douglas & Eddelbuettel, Dirk, 2013. "Fast and Elegant Numerical Linear Algebra Using the RcppEigen Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 52(i05).
    22. Emmanuel Flachaire, 2005. "More Efficient Tests Robust to Heteroskedasticity of Unknown Form," Econometric Reviews, Taylor & Francis Journals, vol. 24(2), pages 219-241.
    23. Romano, Joseph P. & Wolf, Michael, 2017. "Resurrecting weighted least squares," Journal of Econometrics, Elsevier, vol. 197(1), pages 1-19.
    24. Preinerstorfer, David & Pötscher, Benedikt M., 2016. "On Size And Power Of Heteroskedasticity And Autocorrelation Robust Tests," Econometric Theory, Cambridge University Press, vol. 32(2), pages 261-358, April.
    25. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589826, September.
    26. Xiaohong Chen & Norman R. Swanson (ed.), 2013. "Recent Advances and Future Directions in Causality, Prediction, and Specification Analysis," Springer Books, Springer, edition 127, number 978-1-4614-1653-1, December.
    27. Cragg, John G, 1983. "More Efficient Estimation in the Presence of Heteroscedasticity of Unknown Form," Econometrica, Econometric Society, vol. 51(3), pages 751-763, May.
    28. Godfrey, L.G., 2006. "Tests for regression models with heteroskedasticity of unknown form," Computational Statistics & Data Analysis, Elsevier, vol. 50(10), pages 2715-2733, June.
    29. DiCiccio, Cyrus J. & Romano, Joseph P. & Wolf, Michael, 2019. "Improving weighted least squares inference," Econometrics and Statistics, Elsevier, vol. 10(C), pages 96-119.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pötscher, Benedikt M. & Preinerstorfer, David, 2021. "Valid Heteroskedasticity Robust Testing," MPRA Paper 117855, University Library of Munich, Germany, revised Jul 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pötscher, Benedikt M. & Preinerstorfer, David, 2021. "Valid Heteroskedasticity Robust Testing," MPRA Paper 107420, University Library of Munich, Germany.
    2. Torben Klarl, 2014. "Is Spatial Bootstrapping A Panacea For Valid Inference?," Journal of Regional Science, Wiley Blackwell, vol. 54(2), pages 304-312, March.
    3. Emmanuel Flachaire, 2005. "More Efficient Tests Robust to Heteroskedasticity of Unknown Form," Econometric Reviews, Taylor & Francis Journals, vol. 24(2), pages 219-241.
    4. Romano, Joseph P. & Wolf, Michael, 2017. "Resurrecting weighted least squares," Journal of Econometrics, Elsevier, vol. 197(1), pages 1-19.
    5. Eric S. Lin & Ta-Sheng Chou, 2018. "Finite-sample refinement of GMM approach to nonlinear models under heteroskedasticity of unknown form," Econometric Reviews, Taylor & Francis Journals, vol. 37(1), pages 1-28, January.
    6. Jianghao Chu & Tae-Hwy Lee & Aman Ullah & Haifeng Xu, 2020. "Exact Distribution of the F-statistic under Heteroskedasticity of Unknown Form for Improved Inference," Working Papers 202027, University of California at Riverside, Department of Economics.
    7. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    8. Cyrus J. DiCiccio & Joseph P. Romano & Michael Wolf, 2016. "Improving weighted least squares inference," ECON - Working Papers 232, Department of Economics - University of Zurich, revised Nov 2017.
    9. Godfrey, L.G., 2006. "Tests for regression models with heteroskedasticity of unknown form," Computational Statistics & Data Analysis, Elsevier, vol. 50(10), pages 2715-2733, June.
    10. Flachaire, Emmanuel, 2005. "Bootstrapping heteroskedastic regression models: wild bootstrap vs. pairs bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 361-376, April.
    11. Joel L. Horowitz, 2018. "Bootstrap Methods in Econometrics," Papers 1809.04016, arXiv.org.
    12. James G. MacKinnon, 2012. "Thirty Years Of Heteroskedasticity-robust Inference," Working Paper 1268, Economics Department, Queen's University.
    13. Joel L. Horowitz, 2018. "Bootstrap methods in econometrics," CeMMAP working papers CWP53/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    14. DiCiccio, Cyrus J. & Romano, Joseph P. & Wolf, Michael, 2019. "Improving weighted least squares inference," Econometrics and Statistics, Elsevier, vol. 10(C), pages 96-119.
    15. Richard H. Spady & Sami Stouli, 2018. "Simultaneous Mean-Variance Regression," Bristol Economics Discussion Papers 18/697, School of Economics, University of Bristol, UK.
    16. Erdenebat Bataa & Dong H. Kim & Denise R. Osborn, 2007. "Expectations Hypothesis Tests in the Presence of Model Uncertainty," Discussion Paper Series 0703, Institute of Economic Research, Korea University.
    17. Michael O'Hara & Christopher F. Parmeter, 2013. "Nonparametric Generalized Least Squares in Applied Regression Analysis," Pacific Economic Review, Wiley Blackwell, vol. 18(4), pages 456-474, October.
    18. Hartigan, Luke, 2018. "Alternative HAC covariance matrix estimators with improved finite sample properties," Computational Statistics & Data Analysis, Elsevier, vol. 119(C), pages 55-73.
    19. Sin, C.Y. (Chor-yiu) & Lee, Cheng-Few, 2021. "Using heteroscedasticity-non-consistent or heteroscedasticity-consistent variances in linear regression," Econometrics and Statistics, Elsevier, vol. 18(C), pages 117-142.
    20. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.

    More about this item

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C2 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cup:etheor:v:39:y:2023:i:4:p:789-847_4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kirk Stebbing (email available below). General contact details of provider: https://www.cambridge.org/ect .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.