IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v82y2014i3p457-476.html
   My bibliography  Save this article

Small-scale Inference: Empirical Bayes and Confidence Methods for as Few as a Single Comparison

Author

Listed:
  • David R. Bickel

Abstract

type="main" xml:id="insr12064-abs-0001"> Empirical Bayes methods of estimating the local false discovery rate (LFDR) by maximum likelihood estimation (MLE), originally developed for large numbers of comparisons, are applied to a single comparison. Specifically, when assuming a lower bound on the mixing proportion of true null hypotheses, the LFDR MLE can yield reliable hypothesis tests and confidence intervals given as few as one comparison. Simulations indicate that constrained LFDR MLEs perform markedly better than conventional methods, both in testing and in confidence intervals, for high values of the mixing proportion, but not for low values. (A decision-theoretic interpretation of the confidence distribution made those comparisons possible.) In conclusion, the constrained LFDR estimators and the resulting effect-size interval estimates are not only effective multiple comparison procedures but also they might replace p-values and confidence intervals more generally. The new methodology is illustrated with the analysis of proteomics data.

Suggested Citation

  • David R. Bickel, 2014. "Small-scale Inference: Empirical Bayes and Confidence Methods for as Few as a Single Comparison," International Statistical Review, International Statistical Institute, vol. 82(3), pages 457-476, December.
    • Handle: RePEc:bla:istatr:v:82:y:2014:i:3:p:457-476
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/insr.12064
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lu Tian & Rui Wang & Tianxi Cai & Lee-Jen Wei, 2011. "The Highest Confidence Density Region and Its Usage for Joint Inferences about Constrained Parameters," Biometrics, The International Biometric Society, vol. 67(2), pages 604-610, June.
    2. Senn, Stephen, 2008. "A Note Concerning a Selection Paradox of Dawid's," The American Statistician, American Statistical Association, vol. 62, pages 206-210, August.
    3. Jan Hannig & Thomas C. M. Lee, 2009. "Generalized fiducial inference for wavelet regression," Biometrika, Biometrika Trust, vol. 96(4), pages 847-860.
    4. Gajdos, Thibault & Tallon, Jean-Marc & Vergnaud, Jean-Christophe, 2004. "Decision making with imprecise probabilistic information," Journal of Mathematical Economics, Elsevier, vol. 40(6), pages 647-681, September.
    5. Montazeri Zahra & Yanofsky Corey M. & Bickel David R., 2010. "Shrinkage Estimation of Effect Sizes as an Alternative to Hypothesis Testing Followed by Estimation in High-Dimensional Biology: Applications to Differential Gene Expression," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 9(1), pages 1-33, June.
    6. Hannig, Jan & Iyer, Hari & Patterson, Paul, 2006. "Fiducial Generalized Confidence Intervals," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 254-269, March.
    7. Efron, Bradley, 2004. "Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 96-104, January.
    8. Min-ge Xie & Kesar Singh, 2013. "Confidence Distribution, the Frequentist Distribution Estimator of a Parameter: A Review," International Statistical Review, International Statistical Institute, vol. 81(1), pages 3-39, April.
    9. David R. Bickel, 2011. "Estimating the Null Distribution to Adjust Observed Confidence Levels for Genome-Scale Screening," Biometrics, The International Biometric Society, vol. 67(2), pages 363-370, June.
    10. Tore Schweder & Nils Lid Hjort, 2002. "Confidence and Likelihood," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 29(2), pages 309-332, June.
    11. John D. Storey, 2002. "A direct approach to false discovery rates," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 479-498, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nancy Reid & David R. Cox, 2015. "On Some Principles of Statistical Inference," International Statistical Review, International Statistical Institute, vol. 83(2), pages 293-308, August.
    2. Xuhua Liu & Xingzhong Xu, 2016. "Confidence distribution inferences in one-way random effects model," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 59-74, March.
    3. Piero Veronese & Eugenio Melilli, 2021. "Confidence Distribution for the Ability Parameter of the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 131-166, March.
    4. Yang Liu & Jan Hannig, 2017. "Generalized Fiducial Inference for Logistic Graded Response Models," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1097-1125, December.
    5. Bickel David R., 2012. "Empirical Bayes Interval Estimates that are Conditionally Equal to Unadjusted Confidence Intervals or to Default Prior Credibility Intervals," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(3), pages 1-34, February.
    6. Piero Veronese & Eugenio Melilli, 2015. "Fiducial and Confidence Distributions for Real Exponential Families," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(2), pages 471-484, June.
    7. Shigeyuki Matsui & Hisashi Noma, 2011. "Estimating Effect Sizes of Differentially Expressed Genes for Power and Sample-Size Assessments in Microarray Experiments," Biometrics, The International Biometric Society, vol. 67(4), pages 1225-1235, December.
    8. Patrick Kline & Christopher Walters, 2019. "Audits as Evidence: Experiments, Ensembles, and Enforcement," Papers 1907.06622, arXiv.org, revised Jul 2019.
    9. Shin-Fu Tsai, 2019. "Comparing Coefficients Across Subpopulations in Gaussian Mixture Regression Models," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(4), pages 610-633, December.
    10. Seungyong Hwang & Randy C. S. Lai & Thomas C. M. Lee, 2022. "Generalized Fiducial Inference for Threshold Estimation in Dose–Response and Regression Settings," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(1), pages 109-124, March.
    11. Won, Joong-Ho & Lim, Johan & Yu, Donghyeon & Kim, Byung Soo & Kim, Kyunga, 2014. "Monotone false discovery rate," Statistics & Probability Letters, Elsevier, vol. 87(C), pages 86-93.
    12. La Vecchia, Davide & Moor, Alban & Scaillet, Olivier, 2023. "A higher-order correct fast moving-average bootstrap for dependent data," Journal of Econometrics, Elsevier, vol. 235(1), pages 65-81.
    13. Li, Xinmin & Wang, Juan & Liang, Hua, 2011. "Comparison of several means: A fiducial based approach," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1993-2002, May.
    14. Russell J. Bowater, 2017. "A defence of subjective fiducial inference," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 101(2), pages 177-197, April.
    15. Zhao, Haibing & Fung, Wing Kam, 2016. "A powerful FDR control procedure for multiple hypotheses," Computational Statistics & Data Analysis, Elsevier, vol. 98(C), pages 60-70.
    16. T. Tony Cai & Wenguang Sun & Weinan Wang, 2019. "Covariate‐assisted ranking and screening for large‐scale two‐sample inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 187-234, April.
    17. Park, DoHwan & Park, Junyong & Zhong, Xiaosong & Sadelain, Michel, 2011. "Estimation of empirical null using a mixture of normals and its use in local false discovery rate," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2421-2432, July.
    18. Xiaokang Luo & Tirthankar Dasgupta & Minge Xie & Regina Y. Liu, 2021. "Leveraging the Fisher randomization test using confidence distributions: Inference, combination and fusion learning," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(4), pages 777-797, September.
    19. Yixuan Zou & Jan Hannig & Derek S. Young, 2021. "Generalized fiducial inference on the mean of zero-inflated Poisson and Poisson hurdle models," Journal of Statistical Distributions and Applications, Springer, vol. 8(1), pages 1-15, December.
    20. Iris Ivy M. Gauran & Junyong Park & Johan Lim & DoHwan Park & John Zylstra & Thomas Peterson & Maricel Kann & John L. Spouge, 2018. "Empirical null estimation using zero†inflated discrete mixture distributions and its application to protein domain data," Biometrics, The International Biometric Society, vol. 74(2), pages 458-471, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:82:y:2014:i:3:p:457-476. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.