IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2303.13406.html
   My bibliography  Save this paper

Sequential Cauchy Combination Test for Multiple Testing Problems with Financial Applications

Author

Listed:
  • Nabil Bouamara
  • S'ebastien Laurent
  • Shuping Shi

Abstract

We introduce a simple tool to control for false discoveries and identify individual signals in scenarios involving many tests, dependent test statistics, and potentially sparse signals. The tool applies the Cauchy combination test recursively on a sequence of expanding subsets of $p$-values and is referred to as the sequential Cauchy combination test. While the original Cauchy combination test aims to make a global statement about a set of null hypotheses by summing transformed $p$-values, our sequential version determines which $p$-values trigger the rejection of the global null. The sequential test achieves strong familywise error rate control, exhibits less conservatism compared to existing controlling procedures when dealing with dependent test statistics, and provides a power boost. As illustrations, we revisit two well-known large-scale multiple testing problems in finance for which the test statistics have either serial dependence or cross-sectional dependence, namely monitoring drift bursts in asset prices and searching for assets with a nonzero alpha. In both applications, the sequential Cauchy combination test proves to be a preferable alternative. It overcomes many of the drawbacks inherent to inequality-based controlling procedures, extreme value approaches, resampling and screening methods, and it improves the power in simulations, leading to distinct empirical outcomes.

Suggested Citation

  • Nabil Bouamara & S'ebastien Laurent & Shuping Shi, 2023. "Sequential Cauchy Combination Test for Multiple Testing Problems with Financial Applications," Papers 2303.13406, arXiv.org, revised Jun 2023.
  • Handle: RePEc:arx:papers:2303.13406
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2303.13406
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christensen, Kim & Oomen, Roel C.A. & Podolskij, Mark, 2014. "Fact or friction: Jumps at ultra high frequency," Journal of Financial Economics, Elsevier, vol. 114(3), pages 576-599.
    2. Stefano Giglio & Yuan Liao & Dacheng Xiu, 2021. "Thousands of Alpha Tests," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3456, National Bureau of Economic Research, Inc.
    3. Ryan Sullivan & Allan Timmermann & Halbert White, 1999. "Data‐Snooping, Technical Trading Rule Performance, and the Bootstrap," Journal of Finance, American Finance Association, vol. 54(5), pages 1647-1691, October.
    4. Laurent Barras & Olivier Scaillet & Russ Wermers, 2010. "False Discoveries in Mutual Fund Performance: Measuring Luck in Estimated Alphas," Journal of Finance, American Finance Association, vol. 65(1), pages 179-216, February.
    5. Yaowu Liu & Jun Xie, 2020. "Cauchy Combination Test: A Powerful Test With Analytic p-Value Calculation Under Arbitrary Dependency Structures," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 393-402, January.
    6. Laurent, Sébastien & Shi, Shuping, 2022. "Unit Root Test With High-Frequency Data," Econometric Theory, Cambridge University Press, vol. 38(1), pages 113-171, February.
    7. Pierre Bajgrowicz & Olivier Scaillet & Adrien Treccani, 2016. "Jumps in High-Frequency Data: Spurious Detections, Dynamics, and News," Management Science, INFORMS, vol. 62(8), pages 2198-2217, August.
    8. Stephen A. Ross, 2013. "The Arbitrage Theory of Capital Asset Pricing," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 1, pages 11-30, World Scientific Publishing Co. Pte. Ltd..
    9. Bajgrowicz, Pierre & Scaillet, Olivier, 2012. "Technical trading revisited: False discoveries, persistence tests, and transaction costs," Journal of Financial Economics, Elsevier, vol. 106(3), pages 473-491.
    10. Laurent, Sébastien & Shi, Shuping, 2020. "Volatility estimation and jump detection for drift–diffusion processes," Journal of Econometrics, Elsevier, vol. 217(2), pages 259-290.
    11. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    12. Andersen, Torben G. & Bollerslev, Tim & Dobrev, Dobrislav, 2007. "No-arbitrage semi-martingale restrictions for continuous-time volatility models subject to leverage effects, jumps and i.i.d. noise: Theory and testable distributional implications," Journal of Econometrics, Elsevier, vol. 138(1), pages 125-180, May.
    13. O. E. Barndorff-Nielsen & P. Reinhard Hansen & A. Lunde & N. Shephard, 2009. "Realized kernels in practice: trades and quotes," Econometrics Journal, Royal Economic Society, vol. 12(3), pages 1-32, November.
    14. Suzanne S. Lee & Per A. Mykland, 2008. "Jumps in Financial Markets: A New Nonparametric Test and Jump Dynamics," The Review of Financial Studies, Society for Financial Studies, vol. 21(6), pages 2535-2563, November.
    15. Fama, Eugene F & French, Kenneth R, 1996. "Multifactor Explanations of Asset Pricing Anomalies," Journal of Finance, American Finance Association, vol. 51(1), pages 55-84, March.
    16. Jianqing Fan & Yuan Liao & Jiawei Yao, 2015. "Power Enhancement in High‐Dimensional Cross‐Sectional Tests," Econometrica, Econometric Society, vol. 83(4), pages 1497-1541, July.
    17. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    18. Lee, Suzanne S. & Mykland, Per A., 2012. "Jumps in equilibrium prices and market microstructure noise," Journal of Econometrics, Elsevier, vol. 168(2), pages 396-406.
    19. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    20. Christensen, Kim & Oomen, Roel & Renò, Roberto, 2022. "The drift burst hypothesis," Journal of Econometrics, Elsevier, vol. 227(2), pages 461-497.
    21. Zhentao Shi & Liangjun Su & Tian Xie, 2020. "L2-Relaxation: With Applications to Forecast Combination and Portfolio Analysis," Papers 2010.09477, arXiv.org, revised Aug 2022.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, X. & Hong, S. Y. & Linton, O. B., 2024. "Jumps Versus Bursts: Dissection and Origins via a New Endogenous Thresholding Approach," Cambridge Working Papers in Economics 2449, Faculty of Economics, University of Cambridge.
    2. Zhao, X. & Hong, S. Y. & Linton, O. B., 2024. "Jumps Versus Bursts: Dissection and Origins via a New Endogenous Thresholding Approach," Janeway Institute Working Papers 2423, Faculty of Economics, University of Cambridge.
    3. Olivier Scaillet & Adrien Treccani & Christopher Trevisan, 2020. "High-Frequency Jump Analysis of the Bitcoin Market," Journal of Financial Econometrics, Oxford University Press, vol. 18(2), pages 209-232.
    4. Pierre Bajgrowicz & Olivier Scaillet & Adrien Treccani, 2016. "Jumps in High-Frequency Data: Spurious Detections, Dynamics, and News," Management Science, INFORMS, vol. 62(8), pages 2198-2217, August.
    5. Bo Yu & Bruce Mizrach & Norman R. Swanson, 2020. "New Evidence of the Marginal Predictive Content of Small and Large Jumps in the Cross-Section," Econometrics, MDPI, vol. 8(2), pages 1-52, May.
    6. Christensen, Kim & Oomen, Roel & Renò, Roberto, 2022. "The drift burst hypothesis," Journal of Econometrics, Elsevier, vol. 227(2), pages 461-497.
    7. Stephen A. Gorman & Frank J. Fabozzi, 2021. "The ABC’s of the alternative risk premium: academic roots," Journal of Asset Management, Palgrave Macmillan, vol. 22(6), pages 405-436, October.
    8. Nabil Bouamara & Kris Boudt & S'ebastien Laurent & Christopher J. Neely, 2023. "Sluggish news reactions: A combinatorial approach for synchronizing stock jumps," Papers 2309.15705, arXiv.org.
    9. Kim Christensen & Roel Oomen & Roberto Renò, 2018. "The drift burst hypothesis," CREATES Research Papers 2018-21, Department of Economics and Business Economics, Aarhus University.
    10. Ge, Shuyi & Li, Shaoran & Linton, Oliver, 2023. "News-implied linkages and local dependency in the equity market," Journal of Econometrics, Elsevier, vol. 235(2), pages 779-815.
    11. Gilder, Dudley & Shackleton, Mark B. & Taylor, Stephen J., 2014. "Cojumps in stock prices: Empirical evidence," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 443-459.
    12. Kim, Soohun & Skoulakis, Georgios, 2018. "Ex-post risk premia estimation and asset pricing tests using large cross sections: The regression-calibration approach," Journal of Econometrics, Elsevier, vol. 204(2), pages 159-188.
    13. Ao Kong & Hongliang Zhu & Robert Azencott, 2021. "Predicting intraday jumps in stock prices using liquidity measures and technical indicators," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 416-438, April.
    14. Ao Kong & Hongliang Zhu & Robert Azencott, 2019. "Predicting intraday jumps in stock prices using liquidity measures and technical indicators," Papers 1912.07165, arXiv.org.
    15. Kim Christensen & Roel Oomen & Roberto Renò, 2016. "The Drift Burst Hypothesis," CREATES Research Papers 2016-28, Department of Economics and Business Economics, Aarhus University.
    16. Nunes, João Pedro Vidal & Ruas, João Pedro, 2024. "A note on the Gumbel convergence for the Lee and Mykland jump tests," Finance Research Letters, Elsevier, vol. 59(C).
    17. Mateus, Irina B. & Mateus, Cesario & Todorovic, Natasa, 2019. "Review of new trends in the literature on factor models and mutual fund performance," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 344-354.
    18. Juho Kanniainen & Ye Yue, 2019. "The Arrival of News and Return Jumps in Stock Markets: A Nonparametric Approach," Papers 1901.02691, arXiv.org.
    19. Francesco Busato & Cuono Massimo Coletta & Maria Manganiello, 2019. "Estimating the Cost of Equity Capital: Forecasting Accuracy for U.S. REIT Sector," International Real Estate Review, Asian Real Estate Society, vol. 22(3), pages 401-432.
    20. Jian Guo & Saizhuo Wang & Lionel M. Ni & Heung-Yeung Shum, 2022. "Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence," Papers 2301.04020, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2303.13406. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.