IDEAS home Printed from https://ideas.repec.org/a/eee/stapro/v228y2026ics0167715225002044.html

Multiple testing in generalized universal inference

Author

Listed:
  • Dey, Neil
  • Martin, Ryan
  • Williams, Jonathan P.

Abstract

Compared to p-values, e-values provably guarantee safe, valid inference. Applications often require consideration of multiple hypotheses simultaneously, and tools for handling such cases using e-values can be found in the relevant literature. Standard e-value constructions, however, require distributional assumptions that may not be justifiable. This short paper demonstrates that, depending on the multiple testing context, the generalized universal inference framework is well-suited for use with the existing e-value merging and adjustment strategies to control frequentist error rates in multiple testing when the quantities of interest are minimizers of risk functions, thereby avoiding the need for certain distributional assumptions. We demonstrate the strong performance of this general approach in a simulation study involving significance testing in quantile regression.

Suggested Citation

  • Dey, Neil & Martin, Ryan & Williams, Jonathan P., 2026. "Multiple testing in generalized universal inference," Statistics & Probability Letters, Elsevier, vol. 228(C).
  • Handle: RePEc:eee:stapro:v:228:y:2026:i:c:s0167715225002044
    DOI: 10.1016/j.spl.2025.110559
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167715225002044
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.spl.2025.110559?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    2. Hien Duy Nguyen & Mayetri Gupta, 2023. "Finite sample inference for empirical Bayesian methods," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 50(4), pages 1616-1640, December.
    3. A. S. Hedayat & Junhui Wang & Tu Xu, 2015. "Minimum clinically important difference in medical studies," Biometrics, The International Biometric Society, vol. 71(1), pages 33-41, March.
    4. Nicholas Syring & Ryan Martin, 2019. "Calibrating general posterior credible regions," Biometrika, Biometrika Trust, vol. 106(2), pages 479-486.
    5. C. C. Holmes & S. G. Walker, 2017. "Assigning a value to a power likelihood in a general Bayesian model," Biometrika, Biometrika Trust, vol. 104(2), pages 497-503.
    6. Ruodu Wang & Aaditya Ramdas, 2022. "False discovery rate control with e‐values," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(3), pages 822-852, July.
    7. P. G. Bissiri & C. C. Holmes & S. G. Walker, 2016. "A general framework for updating belief distributions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(5), pages 1103-1130, November.
    8. S P Lyddon & C C Holmes & S G Walker, 2019. "General Bayesian updating and the loss-likelihood bootstrap," Biometrika, Biometrika Trust, vol. 106(2), pages 465-478.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin, Gael M. & Frazier, David T. & Maneesoonthorn, Worapree & Loaiza-Maya, Rubén & Huber, Florian & Koop, Gary & Maheu, John & Nibbering, Didier & Panagiotelis, Anastasios, 2024. "Bayesian forecasting in economics and finance: A modern review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 811-839.
    2. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    3. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    4. Mai, The Tien, 2025. "On properties of fractional posterior in generalized reduced-rank regression," Journal of Multivariate Analysis, Elsevier, vol. 210(C).
    5. Onizuka, Takahiro & Hashimoto, Shintaro, 2025. "Robust Bayesian graphical modeling using γ-divergence," Journal of Multivariate Analysis, Elsevier, vol. 209(C).
    6. Ruben Loaiza‐Maya & Gael M. Martin & David T. Frazier, 2021. "Focused Bayesian prediction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 517-543, August.
    7. Rong Tang & Yun Yang, 2022. "Bayesian inference for risk minimization via exponentially tilted empirical likelihood," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1257-1286, September.
    8. Yahia Abdel-Aty & Mohamed Kayid & Ghadah Alomani, 2023. "Generalized Bayes Estimation Based on a Joint Type-II Censored Sample from K-Exponential Populations," Mathematics, MDPI, vol. 11(9), pages 1-11, May.
    9. Maria Laura Battagliola & Helle Sørensen & Anders Tolver & Ana-Maria Staicu, 2025. "Quantile Regression for Longitudinal Functional Data with Application to Feed Intake of Lactating Sows," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 30(1), pages 211-230, March.
    10. Tsionas, Mike G., 2023. "Joint production in stochastic non-parametric envelopment of data with firm-specific directions," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1336-1347.
    11. Akosah, Nana Kwame & Alagidede, Imhotep Paul & Schaling, Eric, 2020. "Testing for asymmetry in monetary policy rule for small-open developing economies: Multiscale Bayesian quantile evidence from Ghana," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    12. Molyneux, Philip & Pancotto, Livia & Reghezza, Alessio & Rodriguez d'Acri, Costanza, 2022. "Interest rate risk and monetary policy normalisation in the euro area," Journal of International Money and Finance, Elsevier, vol. 124(C).
    13. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    14. Georgios Bertsatos & Plutarchos Sakellaris & Mike G. Tsionas, 2022. "Correction to: Extensions of the Pesaran, Shin and Smith (2001) bounds testing procedure," Empirical Economics, Springer, vol. 62(2), pages 635-635, February.
    15. Salimata Sissoko, 2011. "Working Paper 03-11 - Niveau de décentralisation de la négociation et structure des salaires," Working Papers 1103, Federal Planning Bureau, Belgium.
    16. Lu, Yao & Zhan, Shuwei & Zhan, Minghua, 2024. "Has FinTech changed the sensitivity of corporate investment to interest rates?—Evidence from China," Research in International Business and Finance, Elsevier, vol. 68(C).
    17. Korom, Philipp, 2016. "Inherited advantage: The importance of inheritance for private wealth accumulation in Europe," MPIfG Discussion Paper 16/11, Max Planck Institute for the Study of Societies.
    18. Daniele, Vittorio, 2007. "Criminalità e investimenti esteri. Un’analisi per le province italiane [The effect of organized crime on Foreign Investments. An Empirical Analysis for the Italian Provinces]," MPRA Paper 6417, University Library of Munich, Germany.
    19. Ma, Lingjie & Koenker, Roger, 2006. "Quantile regression methods for recursive structural equation models," Journal of Econometrics, Elsevier, vol. 134(2), pages 471-506, October.
    20. Cuesta, Lizeth & Ruiz, Yomara, 2021. "Efecto de la globalización sobre la desigualdad. Un estudio global para 104 países usando regresiones cuantílicas [Effect of globalization on inequality. A global study for 104 countries using quantile regressions]," MPRA Paper 111022, University Library of Munich, Germany.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:stapro:v:228:y:2026:i:c:s0167715225002044. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.