IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.10558.html

Local Asymptotic Power of Honest Confidence Intervals

Author

Listed:
  • Hugo Freeman

Abstract

Confidence intervals that are conservative against an untestable bias, called bias-aware or honest, are now standard in DiD, IV, RD, and factor-model settings. This paper characterises the local power of the tests they induce. Power is governed by the rate of the bias bound relative to the sampling rate, giving three regimes: when the bound vanishes faster than the standard error, conservatism is asymptotically free; when the two are of the same order it costs a bounded, explicit amount; and when the bound dominates, the typical case at the parametric rate, the honest test has zero local power: it covers every local alternative with probability approaching one. A minimax argument shows this loss is intrinsic to honesty itself, not a property of any particular construction. No honest procedure recovers it, and the standard bias-aware interval is rate-optimal. Broadly, any confidence interval whose width fails to shrink fast enough has no local power in the interior of the set it traces out, and at best one-sided power at the boundary. Partial identification is the limiting case of this argument. Simulations and two empirical applications illustrate the regimes in which the loss binds. The practical recommendation is to report the power "dead zone" half-width alongside bias-aware intervals.

Suggested Citation

  • Hugo Freeman, 2026. "Local Asymptotic Power of Honest Confidence Intervals," Papers 2607.10558, arXiv.org, revised Aug 2026.
  • Handle: RePEc:arx:papers:2607.10558
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.10558
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    2. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    3. Timothy B. Armstrong & Michal Kolesár, 2018. "Optimal Inference in a Class of Regression Models," Econometrica, Econometric Society, vol. 86(2), pages 655-683, March.
    4. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    5. Carlos Dobkin & Amy Finkelstein & Raymond Kluender & Matthew J. Notowidigdo, 2018. "The Economic Consequences of Hospital Admissions," American Economic Review, American Economic Association, vol. 108(2), pages 308-352, February.
    6. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2017. "Measuring the Sensitivity of Parameter Estimates to Estimation Moments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1553-1592.
    7. Claudia Noack & Christoph Rothe, 2024. "Bias‐Aware Inference in Fuzzy Regression Discontinuity Designs," Econometrica, Econometric Society, vol. 92(3), pages 687-711, May.
    8. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    9. Manudeep Bhuller & Tarjei Havnes & Edwin Leuven & Magne Mogstad, 2013. "Broadband Internet: An Information Superhighway to Sex Crime?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(4), pages 1237-1266.
    10. Onatski, Alexei, 2012. "Asymptotics of the principal components estimator of large factor models with weakly influential factors," Journal of Econometrics, Elsevier, vol. 168(2), pages 244-258.
    11. Jorg Stoye, 2009. "More on Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 77(4), pages 1299-1315, July.
    12. Timothy B. Armstrong & Michal Kolesár, 2020. "Simple and honest confidence intervals in nonparametric regression," Quantitative Economics, Econometric Society, vol. 11(1), pages 1-39, January.
    13. Ashesh Rambachan & Jonathan Roth, 2023. "A More Credible Approach to Parallel Trends," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(5), pages 2555-2591.
    14. Michal Kolesár & Christoph Rothe, 2018. "Inference in Regression Discontinuity Designs with a Discrete Running Variable," American Economic Review, American Economic Association, vol. 108(8), pages 2277-2304, August.
    15. Guido Imbens & Stefan Wager, 2019. "Optimized Regression Discontinuity Designs," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 264-278, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Burhan Ogut & Michelle Yin, 2026. "Partial Identification with Multiple Nonlinear Measurements of a Latent Regressor," Papers 2607.12219, arXiv.org.
    2. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    3. Claudia Noack & Christoph Rothe, 2024. "Bias‐Aware Inference in Fuzzy Regression Discontinuity Designs," Econometrica, Econometric Society, vol. 92(3), pages 687-711, May.
    4. Stéphane Bonhomme & Martin Weidner, 2022. "Minimizing sensitivity to model misspecification," Quantitative Economics, Econometric Society, vol. 13(3), pages 907-954, July.
    5. Soonwoo Kwon & Liyang Sun, 2025. "Estimating Treatment Effects Under Bounded Heterogeneity," Papers 2510.05454, arXiv.org, revised Aug 2026.
    6. Timothy B. Armstrong & Martin Weidner & Andrei Zeleneev, 2022. "Robust Estimation and Inference in Panels with Interactive Fixed Effects," Papers 2210.06639, arXiv.org, revised May 2025.
    7. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    8. Timothy B. Armstrong & Michal Kolesár & Soonwoo Kwon, 2020. "Bias-Aware Inference in Regularized Regression Models," Working Papers 2020-2, Princeton University. Economics Department..
    9. Reca Sarfati & Vod Vilfort, 2026. "Integrating Diagnostic Checks into Estimation," Papers 2604.16690, arXiv.org.
    10. Yang He & Otávio Bartalotti, 2020. "Wild bootstrap for fuzzy regression discontinuity designs: obtaining robust bias-corrected confidence intervals," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 211-231.
    11. Yingying Dong & Michal Kolesár, 2023. "When can we ignore measurement error in the running variable?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 735-750, August.
    12. Hirano, Keisuke & Porter, Jack R., 2020. "Asymptotic analysis of statistical decision rules in econometrics," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 283-354, Elsevier.
    13. Vod Vilfort, 2026. "Robust Inference for Weighted Estimands," Papers 2607.07524, arXiv.org.
    14. Timothy B. Armstrong & Patrick Kline & Liyang Sun, 2025. "Adapting to Misspecification," Econometrica, Econometric Society, vol. 93(6), pages 1981-2005, November.
    15. Rahul Singh & Moses Stewart, 2025. "Placebo Discontinuity Design," Papers 2507.12693, arXiv.org, revised Jul 2026.
    16. Aristotelis Epanomeritakis & Davide Viviano, 2025. "Learning What to Learn: Experimental Design when Combining Experimental with Observational Evidence," Papers 2510.23434, arXiv.org, revised Aug 2026.
    17. Isaiah Andrews & Matthew Gentzkow & Jesse M. Shapiro, 2020. "On the Informativeness of Descriptive Statistics for Structural Estimates," Econometrica, Econometric Society, vol. 88(6), pages 2231-2258, November.
    18. Bo Honoré & Thomas Jørgensen & Áureo de Paula, 2020. "The informativeness of estimation moments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(7), pages 797-813, November.
    19. Karthik Muralidharan & Mauricio Romero & Kaspar Wüthrich, 2025. "Factorial Designs, Model Selection, and (Incorrect) Inference in Randomized Experiments," The Review of Economics and Statistics, MIT Press, vol. 107(3), pages 589-604, May.
    20. Keisuke Hirano & Jack R. Porter, 2023. "Asymptotic Representations for Sequential Decisions, Adaptive Experiments, and Batched Bandits," Papers 2302.03117, arXiv.org, revised Feb 2025.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.10558. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.