IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v108y2013i501p165-176.html
   My bibliography  Save this article

Selection Adjusted Confidence Intervals With More Power to Determine the Sign

Author

Listed:
  • Asaf Weinstein
  • William Fithian
  • Yoav Benjamini

Abstract

In many current large-scale problems, confidence intervals (CIs) are constructed only for the parameters that are large, as indicated by their estimators, ignoring the smaller parameters. Such selective inference poses a problem to the usual marginal CIs that no longer offer the right level of coverage, not even on the average over the selected parameters. We address this problem by developing three methods to construct short and valid CIs for the location parameter of a symmetric unimodal distribution, while conditioning on its estimator being larger than some constant threshold. In two of these methods, the CI is further required to offer early sign determination, that is, to avoid including parameters of both signs for relatively small values of the estimator. One of the two, the Conditional Quasi-Conventional CI, offers a good balance between length and sign determination while protecting from the effect of selection. The CI is not symmetric, extending more toward 0 than away from it, nor is it of constant shape. However, when the estimator is far away from the threshold, the proposed CI tends to the usual marginal one. In spite of its complexity, it is specified by closed form expressions, up to a small set of constants that are each the solution of a single variable equation. When multiple testing procedures are used to control the false discovery rate or other error rates, the resulting threshold for selecting may be data dependent. We show that conditioning the above CIs on the data-dependent threshold still offers false coverage-statement rate (FCR) for many widely used testing procedures. For these reasons, the conditional CIs for the parameters selected this way are an attractive alternative to the available general FCR adjusted intervals. We demonstrate the use of the method in the analysis of some 14,000 correlations between hormone change and brain activity change in response to the subjects being exposed to stressful movie clips. Supplementary materials for this article are available online.

Suggested Citation

  • Asaf Weinstein & William Fithian & Yoav Benjamini, 2013. "Selection Adjusted Confidence Intervals With More Power to Determine the Sign," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 165-176, March.
    • Handle: RePEc:taf:jnlasa:v:108:y:2013:i:501:p:165-176
    DOI: 10.1080/01621459.2012.737740
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2012.737740
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/01621459.2012.737740?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yoav Benjamini & Daniel Yekutieli, 2005. "False Discovery Rate-Adjusted Multiple Confidence Intervals for Selected Parameters," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 71-81, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Haibing Zhao & Xinping Cui, 2020. "Constructing confidence intervals for selected parameters," Biometrics, The International Biometric Society, vol. 76(4), pages 1098-1108, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guillermo Durand & Gilles Blanchard & Pierre Neuvial & Etienne Roquain, 2020. "Post hoc false positive control for structured hypotheses," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1114-1148, December.
    2. Ruben Dezeure & Peter Bühlmann & Cun-Hui Zhang, 2017. "Rejoinder on: High-dimensional simultaneous inference with the bootstrap," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(4), pages 751-758, December.
    3. Qingyun Cai & Hock Peng Chan, 2017. "A Double Application of the Benjamini-Hochberg Procedure for Testing Batched Hypotheses," Methodology and Computing in Applied Probability, Springer, vol. 19(2), pages 429-443, June.
    4. Bansal Naveen K., 2007. "Decision theoretic Bayesian hypothesis testing with the selection goal," Statistics & Risk Modeling, De Gruyter, vol. 25(1/2007), pages 1-21, January.
    5. Timothy B. Armstrong & Michal Kolesár & Mikkel Plagborg‐Møller, 2022. "Robust Empirical Bayes Confidence Intervals," Econometrica, Econometric Society, vol. 90(6), pages 2567-2602, November.
    6. Hanxin Zhang & Torsten Dahlén & Atif Khan & Gustaf Edgren & Andrey Rzhetsky, 2020. "Measurable health effects associated with the daylight saving time shift," PLOS Computational Biology, Public Library of Science, vol. 16(6), pages 1-13, June.
    7. Andrew Y. Chen & Tom Zimmermann, 2022. "Publication Bias in Asset Pricing Research," Papers 2209.13623, arXiv.org, revised Sep 2023.
    8. Marcaccioli, Riccardo & Livan, Giacomo, 2020. "Maximum entropy approach to multivariate time series randomization," LSE Research Online Documents on Economics 115284, London School of Economics and Political Science, LSE Library.
    9. Karen D. Corbin & Elvis A. Carnero & Blake Dirks & Daria Igudesman & Fanchao Yi & Andrew Marcus & Taylor L. Davis & Richard E. Pratley & Bruce E. Rittmann & Rosa Krajmalnik-Brown & Steven R. Smith, 2023. "Host-diet-gut microbiome interactions influence human energy balance: a randomized clinical trial," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    10. Megan L Head & Luke Holman & Rob Lanfear & Andrew T Kahn & Michael D Jennions, 2015. "The Extent and Consequences of P-Hacking in Science," PLOS Biology, Public Library of Science, vol. 13(3), pages 1-15, March.
    11. Bickel David R., 2012. "Empirical Bayes Interval Estimates that are Conditionally Equal to Unadjusted Confidence Intervals or to Default Prior Credibility Intervals," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(3), pages 1-34, February.
    12. Lee, Donghwan & Lee, Youngjo, 2016. "Extended likelihood approach to multiple testing with directional error control under a hidden Markov random field model," Journal of Multivariate Analysis, Elsevier, vol. 151(C), pages 1-13.
    13. Klingenberg, Bernhard & Satopää, Ville, 2013. "Simultaneous confidence intervals for comparing margins of multivariate binary data," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 87-98.
    14. K. J. Kachiashvili & I.A. Prangishvili & J. K. Kachiashvili, 2019. "Constrained Bayesian Methods for Testing Directional Hypotheses Restricted False Discovery Rates," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 9(3), pages 47-56, March.
    15. Yoav Benjamini & Ruth Heller, 2008. "Screening for Partial Conjunction Hypotheses," Biometrics, The International Biometric Society, vol. 64(4), pages 1215-1222, December.
    16. Yoav Benjamini, 2010. "Discovering the false discovery rate," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 405-416, September.
    17. Toshiaki Tsukurimichi & Yu Inatsu & Vo Nguyen Le Duy & Ichiro Takeuchi, 2022. "Conditional selective inference for robust regression and outlier detection using piecewise-linear homotopy continuation," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(6), pages 1197-1228, December.
    18. Jimmy T. Efird & Ethan J. Anderson & Charulata Jindal & Thomas S. Redding & Andrew D. Thompson & Ashlyn M. Press & Julie Upchurch & Christina D. Williams & Yuk Ming Choi & Ayako Suzuki, 2021. "The Interaction of Vitamin D and Corticosteroids: A Mortality Analysis of 26,508 Veterans Who Tested Positive for SARS-CoV-2," IJERPH, MDPI, vol. 19(1), pages 1-19, December.
    19. Justus J. Randolph & Anaya Bryson & Lakshmi Menon & David K. Henderson & Austin Kureethara Manuel & Stephen Michaels & debra leigh walls rosenstein & Warren McPherson & Rebecca O'Grady & Angeline S. L, 2023. "Montessori education's impact on academic and nonacademic outcomes: A systematic review," Campbell Systematic Reviews, John Wiley & Sons, vol. 19(3), September.
    20. Sofia Palionnaya & Oleg Shestakov, 2020. "Asymptotic Properties of MSE Estimate for the False Discovery Rate Controlling Procedures in Multiple Hypothesis Testing," Mathematics, MDPI, vol. 8(11), pages 1-11, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:108:y:2013:i:501:p:165-176. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.