IDEAS home Printed from https://ideas.repec.org/a/eee/ecosta/v18y2021icp117-142.html
   My bibliography  Save this article

Using heteroscedasticity-non-consistent or heteroscedasticity-consistent variances in linear regression

Author

Listed:
  • Sin, C.Y. (Chor-yiu)
  • Lee, Cheng-Few

Abstract

The properties of the heteroscedasticity non-consistent variances and heteroscedasticity consistent variances are reviewed. Unlike the related existing results, the following cases are discussed separately: (i) the cases where the explanatory variables are strictly exogenous; and (ii) the cases where the explanatory variables may or may not be strictly exogenous. The latter cases allow weakly dependent explanatory variables such as those generating from an autoregressive process. New results on the original robust variance (denoted by HC0) and its variants (denoted by HC1,HC2,HC3,HC4 and HCj) are derived. In particular, the followings are shown: (i) the ordering of the original robust variance and its variants; (ii) the asymptotic equivalence among different variants of robust variance; and (iii) under quadratic form of heteroscedasticity (with mesokurtic/leptokurtic normalized error) or GARCH(1,1)-error, non-robust variance rejects more often than robust variance. Simulation studies suggest HC4 by and large does not over-rejects or mildly under-rejects.

Suggested Citation

  • Sin, C.Y. (Chor-yiu) & Lee, Cheng-Few, 2021. "Using heteroscedasticity-non-consistent or heteroscedasticity-consistent variances in linear regression," Econometrics and Statistics, Elsevier, vol. 18(C), pages 117-142.
    • Handle: RePEc:eee:ecosta:v:18:y:2021:i:c:p:117-142
    DOI: 10.1016/j.ecosta.2020.10.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2452306220300848
    Download Restriction: Full text for ScienceDirect subscribers only. Contains open access articles
    File URL: https://libkey.io/10.1016/j.ecosta.2020.10.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. DRYGAS, Hilmar, 1971. "Consistency of the least-squares and Gauss-Markov estimators in regression models," LIDAM Reprints CORE 74, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    2. James H. Stock & Mark W. Watson, 2008. "Heteroskedasticity-Robust Standard Errors for Fixed Effects Panel Data Regression," Econometrica, Econometric Society, vol. 76(1), pages 155-174, January.
    3. Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
    4. Cribari-Neto, Francisco, 2004. "Asymptotic inference under heteroskedasticity of unknown form," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 215-233, March.
    5. Thompson, Samuel B., 2011. "Simple formulas for standard errors that cluster by both firm and time," Journal of Financial Economics, Elsevier, vol. 99(1), pages 1-10, January.
    6. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    7. Zhang, Rong-Mao & Sin, Chor-yiu (CY) & Ling, Shiqing, 2015. "On functional limits of short- and long-memory linear processes with GARCH(1,1) noises," Stochastic Processes and their Applications, Elsevier, vol. 125(2), pages 482-512.
    8. Mitchell A. Petersen, 2009. "Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches," Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 435-480, January.
    9. Hausman, Jerry & Palmer, Christopher, 2012. "Heteroskedasticity-robust inference in finite samples," Economics Letters, Elsevier, vol. 116(2), pages 232-235.
    10. Cartwright, Phillip A & Lee, Cheng F, 1987. "Time Aggregation and the Estimation of the Market Model: Empirical Evidence," Journal of Business & Economic Statistics, American Statistical Association, vol. 5(1), pages 131-143, January.
    11. Xiaohong Chen & Norman R. Swanson (ed.), 2013. "Recent Advances and Future Directions in Causality, Prediction, and Specification Analysis," Springer Books, Springer, edition 127, number 978-1-4614-1653-1, September.
    12. Andreas Steinhauer & Tobias Wuergler, 2010. "Leverage and covariance matrix estimation in finite-sample IV regressions," IEW - Working Papers 521, Institute for Empirical Research in Economics - University of Zurich.
    13. Froot, Kenneth A., 1989. "Consistent Covariance Matrix Estimation with Cross-Sectional Dependence and Heteroskedasticity in Financial Data," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 24(3), pages 333-355, September.
    14. Hong-Yi Chen & Manak C. Gupta & Alice C. Lee & Cheng Few Lee, 2020. "Sustainable Growth Rate, Optimal Growth Rate, and Optimal Payout Ratio: A Joint Optimization Approach," World Scientific Book Chapters, in: Cheng Few Lee & John C Lee (ed.), HANDBOOK OF FINANCIAL ECONOMETRICS, MATHEMATICS, STATISTICS, AND MACHINE LEARNING, chapter 97, pages 3413-3464, World Scientific Publishing Co. Pte. Ltd..
    15. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
    16. Chang, Hui-shyong & Lee, Cheng F., 1977. "Using Pooled Time-Series and Cross-Section Data to Test the Firm and Time Effects in Financial Analyses," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 12(3), pages 457-471, September.
    17. Harrison, David Jr. & Rubinfeld, Daniel L., 1978. "Hedonic housing prices and the demand for clean air," Journal of Environmental Economics and Management, Elsevier, vol. 5(1), pages 81-102, March.
    18. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    19. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    20. Cheng Few Lee & Manak C. Gupta & Hong-Yi Chen & Alice C. Lee, 2020. "Optimal Payout Ratio Under Uncertainty and the Flexibility Hypothesis: Theory and Empirical Evidence," World Scientific Book Chapters, in: Cheng Few Lee & John C Lee (ed.), HANDBOOK OF FINANCIAL ECONOMETRICS, MATHEMATICS, STATISTICS, AND MACHINE LEARNING, chapter 96, pages 3367-3412, World Scientific Publishing Co. Pte. Ltd..
    21. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    22. Chesher, Andrew & Jewitt, Ian, 1987. "The Bias of a Heteroskedasticity Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 55(5), pages 1217-1222, September.
    23. Cho, Jin Seo & Phillips, Peter C.B., 2018. "Pythagorean generalization of testing the equality of two symmetric positive definite matrices," Journal of Econometrics, Elsevier, vol. 202(1), pages 45-56.
    24. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    25. MacKinnon, James G. & White, Halbert, 1985. "Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties," Journal of Econometrics, Elsevier, vol. 29(3), pages 305-325, September.
    26. Ling, Shiqing & Li, W.K., 2003. "Asymptotic Inference For Unit Root Processes With Garch(1,1) Errors," Econometric Theory, Cambridge University Press, vol. 19(4), pages 541-564, August.
    27. Ghulam Ali, 2013. "EGARCH, GJR-GARCH, TGARCH, AVGARCH, NGARCH, IGARCH and APARCH Models for Pathogens at Marine Recreational Sites," Journal of Statistical and Econometric Methods, SCIENPRESS Ltd, vol. 2(3), pages 1-6.
    28. Romano, Joseph P. & Wolf, Michael, 2017. "Resurrecting weighted least squares," Journal of Econometrics, Elsevier, vol. 197(1), pages 1-19.
    29. McDonald, Bill & Lee, Cheng-Few, 1988. "An Analysis of Nonlinearities, Heteroscedasticity, and Functional Form in the Market Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(4), pages 505-509, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pötscher, Benedikt M. & Preinerstorfer, David, 2021. "Valid Heteroskedasticity Robust Testing," MPRA Paper 107420, University Library of Munich, Germany.
    2. Romano, Joseph P. & Wolf, Michael, 2017. "Resurrecting weighted least squares," Journal of Econometrics, Elsevier, vol. 197(1), pages 1-19.
    3. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    4. James G. MacKinnon, 2012. "Thirty Years Of Heteroskedasticity-robust Inference," Working Paper 1268, Economics Department, Queen's University.
    5. Cheng Few Lee, 2020. "Financial econometrics, mathematics, statistics, and financial technology: an overall view," Review of Quantitative Finance and Accounting, Springer, vol. 54(4), pages 1529-1578, May.
    6. Pötscher, Benedikt M. & Preinerstorfer, David, 2023. "How Reliable Are Bootstrap-Based Heteroskedasticity Robust Tests?," Econometric Theory, Cambridge University Press, vol. 39(4), pages 789-847, August.
    7. Hartigan, Luke, 2018. "Alternative HAC covariance matrix estimators with improved finite sample properties," Computational Statistics & Data Analysis, Elsevier, vol. 119(C), pages 55-73.
    8. David Roodman & James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2019. "Fast and wild: Bootstrap inference in Stata using boottest," Stata Journal, StataCorp LP, vol. 19(1), pages 4-60, March.
    9. Richard H. Spady & Sami Stouli, 2018. "Simultaneous Mean-Variance Regression," Bristol Economics Discussion Papers 18/697, School of Economics, University of Bristol, UK.
    10. Cheng, Tsung-Chi, 2012. "On simultaneously identifying outliers and heteroscedasticity without specific form," Computational Statistics & Data Analysis, Elsevier, vol. 56(7), pages 2258-2272.
    11. Francisco Cribari-Neto & Maria da Gloria Lima, 2010. "Approximate inference in heteroskedastic regressions: A numerical evaluation," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(4), pages 591-615.
    12. Jushan Bai & Sung Hoon Choi & Yuan Liao, 2021. "Feasible generalized least squares for panel data with cross-sectional and serial correlations," Empirical Economics, Springer, vol. 60(1), pages 309-326, January.
    13. Annalivia Polselli, 2023. "Robust Inference in Panel Data Models: Some Effects of Heteroskedasticity and Leveraged Data in Small Samples," Papers 2312.17676, arXiv.org.
    14. Uchôa, Carlos F.A. & Cribari-Neto, Francisco & Menezes, Tatiane A., 2014. "Testing inference in heteroskedastic fixed effects models," European Journal of Operational Research, Elsevier, vol. 235(3), pages 660-670.
    15. Francisco Cribari-Neto & Wilton Silva, 2011. "A new heteroskedasticity-consistent covariance matrix estimator for the linear regression model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(2), pages 129-146, June.
    16. Ke-Hai Yuan & Ying Cheng & Scott Maxwell, 2014. "Moderation Analysis Using a Two-Level Regression Model," Psychometrika, Springer;The Psychometric Society, vol. 79(4), pages 701-732, October.
    17. Jianghao Chu & Tae-Hwy Lee & Aman Ullah & Haifeng Xu, 2020. "Exact Distribution of the F-statistic under Heteroskedasticity of Unknown Form for Improved Inference," Working Papers 202027, University of California at Riverside, Department of Economics.
    18. José Curto & José Pinto & Ana Morais & Isabel Lourenço, 2011. "The heteroskedasticity-consistent covariance estimator in accounting," Review of Quantitative Finance and Accounting, Springer, vol. 37(4), pages 427-449, November.
    19. Millo, Giovanni, 2014. "Robust standard error estimators for panel models: a unifying approach," MPRA Paper 54954, University Library of Munich, Germany.
    20. Francisco Cribari-Neto & Maria Lima, 2010. "Sequences of bias-adjusted covariance matrix estimators under heteroskedasticity of unknown form," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 62(6), pages 1053-1082, December.

    More about this item

    Keywords

    Asymptotic properties; Finite-sample properties; non-robust variance; Robust variance; Strictly exogenous; Weakly dependent;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecosta:v:18:y:2021:i:c:p:117-142. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/econometrics-and-statistics .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.