IDEAS home Printed from https://ideas.repec.org/p/zur/econwp/254.html

Multiple testing of one-sided hypotheses: combining Bonferroni and the bootstrap

Author

Listed:
  • Joseph P. Romano
  • Michael Wolf

Abstract

In many multiple testing problems, the individual null hypotheses (i) concern univariate parameters and (ii) are one-sided. In such problems, power gains can be obtained for bootstrap multiple testing procedures in scenarios where some of the parameters are 'deep in the null' by making certain adjustments to the null distribution under which to resample. In this paper, we compare a Bonferroni adjustment that is based on finite-sample considerations with certain 'asymptotic' adjustments previously suggested in the literature.

Suggested Citation

  • Joseph P. Romano & Michael Wolf, 2017. "Multiple testing of one-sided hypotheses: combining Bonferroni and the bootstrap," ECON - Working Papers 254, Department of Economics - University of Zurich.
    • Handle: RePEc:zur:econwp:254
    as

    Download full text from publisher

    File URL: https://www.zora.uzh.ch/id/eprint/138641/1/econwp254.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    2. Hsu, Po-Hsuan & Hsu, Yu-Chin & Kuan, Chung-Ming, 2010. "Testing the predictive ability of technical analysis using a new stepwise test without data snooping bias," Journal of Empirical Finance, Elsevier, vol. 17(3), pages 471-484, June.
    3. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2014. "A Practical Two‐Step Method for Testing Moment Inequalities," Econometrica, Econometric Society, vol. 82(5), pages 1979-2002, September.
    4. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    5. Joseph P. Romano & Michael Wolf, 2005. "Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 94-108, March.
    6. Donald W. K. Andrews & Panle Jia Barwick, 2012. "Inference for Parameters Defined by Moment Inequalities: A Recommended Moment Selection Procedure," Econometrica, Econometric Society, vol. 80(6), pages 2805-2826, November.
    7. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joanna Kostanek & Kamil Karolczak & Wiktor Kuliczkowski & Cezary Watala, 2024. "Bootstrap Method as a Tool for Analyzing Data with Atypical Distributions Deviating from Parametric Assumptions: Critique and Effectiveness Evaluation," Data, MDPI, vol. 9(8), pages 1-20, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zeng-Hua Lu & Alec Zuo, 2017. "Child disability, welfare payments, marital status and mothers’ labor supply: Evidence from Australia," Cogent Economics & Finance, Taylor & Francis Journals, vol. 5(1), pages 1339769-133, January.
    2. Christopher J. Bennett, 2009. "p-Value Adjustments for Asymptotic Control of the Generalized Familywise Error Rate," Vanderbilt University Department of Economics Working Papers 0905, Vanderbilt University Department of Economics.
    3. Chen, Le-Yu & Szroeter, Jerzy, 2014. "Testing multiple inequality hypotheses: A smoothed indicator approach," Journal of Econometrics, Elsevier, vol. 178(P3), pages 678-693.
    4. Li, Jia & Liao, Zhipeng & Zhou, Wenyu, 2025. "A general test for functional inequalities," Journal of Econometrics, Elsevier, vol. 251(C).
    5. Donald, Stephen G. & Hsu, Yu-Chin, 2011. "A new test for linear inequality constraints when the variance–covariance matrix depends on the unknown parameters," Economics Letters, Elsevier, vol. 113(3), pages 241-243.
    6. Arvanitis, Stelios & Post, Thierry & Potì, Valerio & Karabati, Selcuk, 2021. "Nonparametric tests for Optimal Predictive Ability," International Journal of Forecasting, Elsevier, vol. 37(2), pages 881-898.
    7. Timmermann, Allan & Qu, Ritong & Zhu, Yinchu, 2019. "Do Any Economists Have Superior Forecasting Skills?," CEPR Discussion Papers 14112, C.E.P.R. Discussion Papers.
    8. McCloskey, Adam, 2017. "Bonferroni-based size-correction for nonstandard testing problems," Journal of Econometrics, Elsevier, vol. 200(1), pages 17-35.
    9. Bajgrowicz, Pierre & Scaillet, Olivier, 2012. "Technical trading revisited: False discoveries, persistence tests, and transaction costs," Journal of Financial Economics, Elsevier, vol. 106(3), pages 473-491.
    10. de Chaisemartin, Clement & D'Haultfoeuille, Xavier, "undated". "Supplement to Fuzzy Differences-in-Differences," Economic Research Papers 270217, University of Warwick - Department of Economics.
    11. Filip Obradovi'c, 2022. "Measuring Diagnostic Test Performance Using Imperfect Reference Tests: A Partial Identification Approach," Papers 2204.00180, arXiv.org, revised Aug 2024.
    12. Hiroaki Kaido & Francesca Molinari & Jörg Stoye, 2019. "Confidence Intervals for Projections of Partially Identified Parameters," Econometrica, Econometric Society, vol. 87(4), pages 1397-1432, July.
    13. Hubert Dichtl, 2020. "Investing in the S&P 500 index: Can anything beat the buy‐and‐hold strategy?," Review of Financial Economics, John Wiley & Sons, vol. 38(2), pages 352-378, April.
    14. Molinari, Francesca, 2020. "Microeconometrics with partial identification," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 355-486, Elsevier.
    15. Isaiah Andrews & Toru Kitagawa & Adam McCloskey, 2024. "Inference on Winners," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(1), pages 305-358.
    16. Psaradellis, Ioannis & Laws, Jason & Pantelous, Athanasios A. & Sermpinis, Georgios, 2023. "Technical analysis, spread trading, and data snooping control," International Journal of Forecasting, Elsevier, vol. 39(1), pages 178-191.
    17. Dan Anghel, 2013. "How Reliable is the Moving Average Crossover Rule for an Investor on the Romanian Stock Market?," The Review of Finance and Banking, Academia de Studii Economice din Bucuresti, Romania / Facultatea de Finante, Asigurari, Banci si Burse de Valori / Catedra de Finante, vol. 5(2), pages 089-115, December.
    18. Shynkevich, Andrei, 2013. "Time-series momentum as an intra- and inter-industry effect: Implications for market efficiency," Journal of Economics and Business, Elsevier, vol. 69(C), pages 64-85.
    19. Chen, Shi & Bao, Si & Zhou, Yu, 2016. "The predictive power of Japanese candlestick charting in Chinese stock market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 457(C), pages 148-165.
    20. Costantini, Mauro & Cuaresma, Jesus Crespo & Hlouskova, Jaroslava, 2014. "Can Macroeconomists Get Rich Forecasting Exchange Rates?," Economics Series 305, Institute for Advanced Studies.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zur:econwp:254. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Severin Oswald (email available below). General contact details of provider: https://edirc.repec.org/data/seizhch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.