IDEAS home Printed from https://ideas.repec.org/p/umc/wpaper/2308.html
   My bibliography  Save this paper

Confidence Intervals for Intentionally Biased Estimators

Author

Listed:

Abstract

We propose and study two confidence intervals (CIs) centered at an estimator that is intentionally biased in order to reduce mean squared error. The first CI simply uses an unbiased estimator's standard error. It is not obvious that this CI should work well; indeed, for confidence levels below 68.3%, the coverage probability can be near zero, and the CI using the biased estimator's standard error is also known to suffer from undercoverage. However, for confidence levels 91.7% and higher, even if the unbiased and biased estimators have identical mean squared error (which yields a bound on coverage probability), our CI is better than the benchmark CI centered at the unbiased estimator: they are the same length, but our CI has higher coverage probability (lower coverage error rate), regardless of the magnitude of bias. That is, whereas generally there is a tradeoff that requires increasing CI length in order to reduce the coverage error rate, in this case we can reduce the error rate for free (without increasing length) simply by recentering the CI at the biased estimator instead of the unbiased estimator. If rounding to the nearest hundredth of a percent, then even at the 90% confidence level our CI's worst-case coverage probability is 90.00% and can be significantly higher depending on the magnitude of bias. In addition to its favorable statistical properties, our proposed CI applies broadly and is simple to compute, making it attractive in practice. Building on these results, our second CI trades some of the first CI's "excess" coverage probability for shorter length. It also dominates the benchmark CI (centered at unbiased estimator) for conventional confidence levels, with higher coverage probability and shorter length, so we recommend this CI in practice.

Suggested Citation

  • David M. Kaplan & Xin Liu, 2023. "Confidence Intervals for Intentionally Biased Estimators," Working Papers 2308, Department of Economics, University of Missouri.
  • Handle: RePEc:umc:wpaper:2308
    as

    Download full text from publisher

    File URL: https://drive.google.com/file/d/13l6_IROJrZim5NLRkr2-hwLQDAah6rir/view?usp=sharing
    Download Restriction: no
    ---><---

    Other versions of this item:

    More about this item

    Keywords

    averaging estimators; bias-variance tradeoff; coverage probability; mean squared error; smoothing;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:umc:wpaper:2308. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chao Gu (email available below). General contact details of provider: https://edirc.repec.org/data/edumous.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.