IDEAS home Printed from https://ideas.repec.org/a/eee/ecosta/v9y2019icp122-139.html
   My bibliography  Save this article

Testing for heteroscedasticity in high-dimensional regressions

Author

Listed:
  • Li, Zhaoyuan
  • Yao, Jianfeng

Abstract

Testing heteroscedasticity of the errors is a major challenge in high-dimensional regressions where the number of covariates is large compared to the sample size. Traditional procedures such as the White and the Breusch–Pagan tests typically suffer from low sizes and powers. Two new test procedures are proposed based on standard OLS residuals. Using the theory of random Haar orthogonal matrices, the asymptotic normality of both test statistics is obtained under the null when the degrees of freedom tend to infinity. This encompasses both the classical low-dimensional setting where the number of variables is fixed while the sample size tends to infinity, and the proportional high-dimensional setting where these dimensions grow to infinity proportionally. This is the first procedures in the literature for testing heteroscedasticity which are valid for medium and high-dimensional regressions. Notice however that as the procedures are based on the OLS residuals, the number of variables must be smaller than the sample size, although both can grow to infinity. The superiority of our proposed tests over the existing methods are demonstrated by extensive simulations and by several real data analyses as well.

Suggested Citation

  • Li, Zhaoyuan & Yao, Jianfeng, 2019. "Testing for heteroscedasticity in high-dimensional regressions," Econometrics and Statistics, Elsevier, vol. 9(C), pages 122-139.
  • Handle: RePEc:eee:ecosta:v:9:y:2019:i:c:p:122-139
    DOI: 10.1016/j.ecosta.2018.01.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2452306218300029
    Download Restriction: Full text for ScienceDirect subscribers only. Contains open access articles

    File URL: https://libkey.io/10.1016/j.ecosta.2018.01.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. H. Dette & A. Munk, 1998. "Testing heteroscedasticity in nonparametric regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(4), pages 693-708.
    2. Diblasi, Angela & Bowman, Adrian, 1997. "Testing for constant variance in a linear model," Statistics & Probability Letters, Elsevier, vol. 33(1), pages 95-103, April.
    3. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    4. Z. John Daye & Jinbo Chen & Hongzhe Li, 2012. "High-Dimensional Heteroscedastic Regression with an Application to eQTL Data Analysis," Biometrics, The International Biometric Society, vol. 68(1), pages 316-326, March.
    5. Yawitz, Jess B & Marshall, William J, 1981. "Measuring the Effect of Callability on Bond Yields," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 13(1), pages 60-71, February.
    6. Godfrey, Leslie G., 1996. "Some results on the Glejser and Koenker tests for heteroskedasticity," Journal of Econometrics, Elsevier, vol. 72(1-2), pages 275-299.
    7. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    8. Ferrari, Silvia L. P. & Cribari-Neto, Francisco, 2002. "Corrected modified profile likelihood heteroskedasticity tests," Statistics & Probability Letters, Elsevier, vol. 57(4), pages 353-361, May.
    9. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2011. "Inference for high-dimensional sparse econometric models," CeMMAP working papers CWP41/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Cook, Timothy Q & Hendershott, Patric H, 1978. "The Impact of Taxes, Risk and Relative Security Supplies on Interest Rate Differentials," Journal of Finance, American Finance Association, vol. 33(4), pages 1173-1186, September.
    11. Bordo, Michael D & Choudhri, Ehsan U, 1982. "Currency Substitution and the Demand for Money: Some Evidence for Canada," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 14(1), pages 48-57, February.
    12. Su, Liangjun & Ullah, Aman, 2013. "A Nonparametric Goodness-Of-Fit-Based Test For Conditional Heteroskedasticity," Econometric Theory, Cambridge University Press, vol. 29(1), pages 187-212, February.
    13. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    14. Lee, Byung-Joo, 1992. "A Heteroskedasticity Test Robust to Conditional Mean Misspecification," Econometrica, Econometric Society, vol. 60(1), pages 159-171, January.
    15. Koenker, Roger & Bassett, Gilbert, Jr, 1982. "Robust Tests for Heteroscedasticity Based on Regression Quantiles," Econometrica, Econometric Society, vol. 50(1), pages 43-61, January.
    16. Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-1294, September.
    17. L. G. Godfrey & C. D. Orme, 1999. "The robustness, reliabiligy and power of heteroskedasticity tests," Econometric Reviews, Taylor & Francis Journals, vol. 18(2), pages 169-194.
    18. Matt Taddy, 2013. "Multinomial Inverse Regression for Text Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 755-770, September.
    19. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    20. Koenker, Roger, 1981. "A note on studentizing a test for heteroscedasticity," Journal of Econometrics, Elsevier, vol. 17(1), pages 107-112, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kanchan Popli & Chunkyoo Park & Sang-Min Han & Seungdo Kim, 2021. "Prediction of Solid Waste Generation Rates in Urban Region of Laos Using Socio-Demographic and Economic Parameters with a Multi Linear Regression Approach," Sustainability, MDPI, vol. 13(6), pages 1-15, March.
    2. Zhenhong Huang & Chen Wang & Jianfeng Yao, 2023. "Assessing the strength of many instruments with the first-stage F and Cragg-Donald statistics," Papers 2302.14423, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Machado, Jose A. F. & Silva, J. M. C. Santos, 2000. "Glejser's test revisited," Journal of Econometrics, Elsevier, vol. 97(1), pages 189-202, July.
    2. Dufour, Jean-Marie & Khalaf, Lynda & Bernard, Jean-Thomas & Genest, Ian, 2004. "Simulation-based finite-sample tests for heteroskedasticity and ARCH effects," Journal of Econometrics, Elsevier, vol. 122(2), pages 317-347, October.
    3. LE GALLO, Julie, 2000. "Econométrie spatiale 2 -Hétérogénéité spatiale," LATEC - Document de travail - Economie (1991-2003) 2001-01, LATEC, Laboratoire d'Analyse et des Techniques EConomiques, CNRS UMR 5118, Université de Bourgogne.
    4. Vanessa Berenguer Rico & Ines Wilms, 2018. "White heteroscedasticty testing after outlier removal," Economics Series Working Papers 853, University of Oxford, Department of Economics.
    5. Romano, Joseph P. & Wolf, Michael, 2017. "Resurrecting weighted least squares," Journal of Econometrics, Elsevier, vol. 197(1), pages 1-19.
    6. Jana Jurečková & Radim Navrátil, 2014. "Rank tests in heteroscedastic linear model with nuisance parameters," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 77(3), pages 433-450, April.
    7. Julie Le Gallo, 2000. "Spatial econometrics (2, Spatial heterogeneity) [Econométrie spatiale (2, Hétérogénéité spatiale)]," Working Papers hal-01526969, HAL.
    8. José Murteira & Esmeralda Ramalho & Joaquim Ramalho, 2011. "Heteroskedasticity Testing Through Comparison of Wald-Type Statistics," GEMF Working Papers 2011-05, GEMF, Faculty of Economics, University of Coimbra.
    9. Dastoor, Naorayex K., 1997. "Testing for conditional heteroskedasticity with misspecified alternative hypotheses," Journal of Econometrics, Elsevier, vol. 82(1), pages 63-80.
    10. Clarke, George R. G., 1995. "More evidence on income distribution and growth," Journal of Development Economics, Elsevier, vol. 47(2), pages 403-427, August.
    11. Tsimpanos, Apostolos & Tsimbos, Cleon & Kalogirou, Stamatis, 2018. "Assessing spatial variation and heterogeneity of fertility in Greece at local authority level," MPRA Paper 100406, University Library of Munich, Germany.
    12. Michael O'Connor Keefe & David Gallagher, 2014. "Does the effect of revealed private information on initial public offering (IPO) first trading day return differ by IPO market heat?," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 54(3), pages 921-964, September.
    13. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    14. Richard H. Spady & Sami Stouli, 2018. "Simultaneous Mean-Variance Regression," Bristol Economics Discussion Papers 18/697, School of Economics, University of Bristol, UK.
    15. Christopher F Baum & Mark E. Schaffer & Steven Stillman, 2003. "Instrumental variables and GMM: Estimation and testing," Stata Journal, StataCorp LP, vol. 3(1), pages 1-31, March.
    16. Pedro Delicado & Juan Romo, 1998. "Constant coefficient tests for random coefficient regression," Economics Working Papers 329, Department of Economics and Business, Universitat Pompeu Fabra.
    17. Sander Gerritsen & Mark Kattenberg & Sonny Kuijpers, 2019. "The impact of age at arrival on education and mental health," CPB Discussion Paper 389.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    18. Kendix, Michael & Walls, W.D., 2010. "Oil industry consolidation and refined product prices: Evidence from US wholesale gasoline terminals," Energy Policy, Elsevier, vol. 38(7), pages 3498-3507, July.
    19. Juhl, Ted & Sosa-Escudero, Walter, 2014. "Testing for heteroskedasticity in fixed effects models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 484-494.
    20. Sander Gerritsen & Mark Kattenberg & Sonny Kuijpers, 2019. "The impact of age at arrival on education and mental health," CPB Discussion Paper 389, CPB Netherlands Bureau for Economic Policy Analysis.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecosta:v:9:y:2019:i:c:p:122-139. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/econometrics-and-statistics .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.