IDEAS home Printed from https://ideas.repec.org/p/jku/econwp/2025-06.html
   My bibliography  Save this paper

On Bessel’s Correction: Unbiased Sample Variance, the “Bariance,†and a Novel Runtime-Optimized Estimator

Author

Listed:
  • Felix Reichel

Abstract

Bessel’s correction adjusts the denominator in the sample variance formula from n to n −1 to produce an unbiased estimator for the population variance. This paper includes rigorous derivations, geometric interpretations, and visualizations. It then introduces the concept of “bariance,†an alternative pairwise distances intuition of sample dispersion without an arithmetic mean. Finally, we address practical concerns raised in Rosenthal’s article [1] advocating the use of n-based estimates from a more holistic MSE-based viewpoint for pedagogical reasons and in certain practical contexts. Finally, the empirical part using simulation reveals that the run-time of estimating population variance can be shortened when using an algebraically optimized “bariance“ approach to estimate an unbiased variance.

Suggested Citation

  • Felix Reichel, 2025. "On Bessel’s Correction: Unbiased Sample Variance, the “Bariance,†and a Novel Runtime-Optimized Estimator," Economics working papers 2025-06, Department of Economics, Johannes Kepler University Linz, Austria.
    • Handle: RePEc:jku:econwp:2025-06
    Note: English
    as

    Download full text from publisher

    File URL: http://www.economics.jku.at/papers/2025/wp2506.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Smyth Gordon K, 2004. "Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray Experiments," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 3(1), pages 1-28, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xu, Ping & Brock, Guy N. & Parrish, Rudolph S., 2009. "Modified linear discriminant analysis approaches for classification of high-dimensional microarray data," Computational Statistics & Data Analysis, Elsevier, vol. 53(5), pages 1674-1687, March.
    2. Hannart, Alexis & Naveau, Philippe, 2014. "Estimating high dimensional covariance matrices: A new look at the Gaussian conjugate framework," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 149-162.
    3. Aaron C Ericsson & J Wade Davis & William Spollen & Nathan Bivens & Scott Givan & Catherine E Hagan & Mark McIntosh & Craig L Franklin, 2015. "Effects of Vendor and Genetic Background on the Composition of the Fecal Microbiota of Inbred Mice," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-19, February.
    4. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    5. Avagyan, Vahe & Alonso Fernández, Andrés Modesto & Nogales, Francisco J., 2015. "D-trace Precision Matrix Estimation Using Adaptive Lasso Penalties," DES - Working Papers. Statistics and Econometrics. WS 21775, Universidad Carlos III de Madrid. Departamento de Estadística.
    6. Mishra, Anil V., 2016. "Foreign bias in Australian-domiciled mutual fund holdings," Pacific-Basin Finance Journal, Elsevier, vol. 39(C), pages 101-123.
    7. McDowell, Shaun, 2018. "An empirical evaluation of estimation error reduction strategies applied to international diversification," Journal of Multinational Financial Management, Elsevier, vol. 44(C), pages 1-13.
    8. Hossain, Ahmed & Beyene, Joseph & Willan, Andrew R. & Hu, Pingzhao, 2009. "A flexible approximate likelihood ratio test for detecting differential expression in microarray data," Computational Statistics & Data Analysis, Elsevier, vol. 53(10), pages 3685-3695, August.
    9. Olivier Ledoit & Michael Wolf, 2003. "Honey, I shrunk the sample covariance matrix," Economics Working Papers 691, Department of Economics and Business, Universitat Pompeu Fabra.
    10. repec:plo:pone00:0103514 is not listed on IDEAS
    11. Konno, Yoshihiko, 2009. "Shrinkage estimators for large covariance matrices in multivariate real and complex normal distributions under an invariant quadratic loss," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2237-2253, November.
    12. Wessel N. Wieringen & Gwenaël G. R. Leday, 2024. "Ridge-type covariance and precision matrix estimators of the multivariate normal distribution," Statistical Papers, Springer, vol. 65(9), pages 5835-5849, December.
    13. Xiaohong Li & Guy N Brock & Eric C Rouchka & Nigel G F Cooper & Dongfeng Wu & Timothy E O’Toole & Ryan S Gill & Abdallah M Eteleeb & Liz O’Brien & Shesh N Rai, 2017. "A comparison of per sample global scaling and per gene normalization methods for differential expression analysis of RNA-seq data," PLOS ONE, Public Library of Science, vol. 12(5), pages 1-22, May.
    14. Yuan, Ke-Hai & Chan, Wai, 2008. "Structural equation modeling with near singular covariance matrices," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4842-4858, June.
    15. Jian Zhang & Li Su, 2015. "Temporal Autocorrelation-Based Beamforming With MEG Neuroimaging Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1375-1388, December.
    16. Kerr Kathleen F., 2012. "Optimality Criteria for the Design of 2-Color Microarray Studies," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(1), pages 1-9, January.
    17. Ambroise Jérôme & Bearzatto Bertrand & Robert Annie & Macq Benoit & Gala Jean-Luc, 2012. "Combining Multiple Laser Scans of Spotted Microarrays by Means of a Two-Way ANOVA Model," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(3), pages 1-20, February.
    18. J. McClatchy & R. Strogantsev & E. Wolfe & H. Y. Lin & M. Mohammadhosseini & B. A. Davis & C. Eden & D. Goldman & W. H. Fleming & P. Conley & G. Wu & L. Cimmino & H. Mohammed & A. Agarwal, 2023. "Clonal hematopoiesis related TET2 loss-of-function impedes IL1β-mediated epigenetic reprogramming in hematopoietic stem and progenitor cells," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    19. Alexandra Gyurdieva & Stefan Zajic & Ya-Fang Chang & E. Andres Houseman & Shan Zhong & Jaegil Kim & Michael Nathenson & Thomas Faitg & Mary Woessner & David C. Turner & Aisha N. Hasan & John Glod & Ro, 2022. "Biomarker correlates with response to NY-ESO-1 TCR T cells in patients with synovial sarcoma," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    20. MohammadAmin Fazli & Parsa Alian & Ali Owfi & Erfan Loghmani, 2021. "RPS: Portfolio Asset Selection using Graph based Representation Learning," Papers 2111.15634, arXiv.org.
    21. Hafner, Christian M. & Linton, Oliver B. & Tang, Haihan, 2020. "Estimation of a multiplicative correlation structure in the large dimensional case," Journal of Econometrics, Elsevier, vol. 217(2), pages 431-470.

    More about this item

    Keywords

    Unbiased sample variance; Runtime-optimized linear unbiased sample variance estimators;

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jku:econwp:2025-06. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: René Böheim (email available below). General contact details of provider: https://edirc.repec.org/data/vlinzat.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.