IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.17451.html

A Variance-Based Test for Heterogeneous Treatment Effects

Author

Listed:
  • Fangzhou Yu

Abstract

This paper proposes a robust nonparametric hypothesis test for the existence of heterogeneous treatment effects. We focus on the variance of the Conditional Average Treatment Effect (CATE) as a natural omnibus parameter, where a non-zero variance implies the presence of relevant heterogeneity. Standard inference for this parameter faces a fundamental theoretical challenge. On one hand, evaluating variance components on the same sample leads to null degeneracy, where the asymptotic variance collapses to zero under the null hypothesis of homogeneity, invalidating standard Gaussian inference. On the other hand, decoupling the empirical processes via standard sample-splitting breaks the Neyman orthogonality of the doubly robust scores due to their nonlinear squared loss, which prevents the cancellation of first-order regularization biases. To resolve this challenge, we propose a novel Intra-Fold Sample-Splitting algorithm. By evaluating variance components on mutually disjoint subsamples while coupling them to identical out-of-fold nuisance estimators, our procedure achieves algebraic cancellation of the nuisance biases. We prove this restores consistency and asymptotic normality, and ensures Type I error control. Monte Carlo simulations demonstrate that the proposed test achieves superior size control relative to existing tests while maintaining high power. In an empirical application to the NSW job training program, the test detects significant heterogeneity that traditional nonparametric tests fail to uncover.

Suggested Citation

  • Fangzhou Yu, 2026. "A Variance-Based Test for Heterogeneous Treatment Effects," Papers 2607.17451, arXiv.org.
  • Handle: RePEc:arx:papers:2607.17451
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.17451
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769, December.
    2. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    2. Yechan Park & Yuya Sasaki, 2024. "Matching $\leq$ Hybrid $\leq$ Difference in Differences," Papers 2411.07952, arXiv.org, revised Feb 2025.
    3. Cristian Mardones & Pablo Herreros, 2023. "Ex post evaluation of voluntary environmental policies on the energy intensity in Chilean firms," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 25(9), pages 9111-9136, September.
    4. Tymon Słoczyński, 2022. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," The Review of Economics and Statistics, MIT Press, vol. 104(3), pages 501-509, May.
    5. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, IZA Network @ LISER.
    6. Chen, Qi & Vashishtha, Rahul, 2017. "The effects of bank mergers on corporate information disclosure," Journal of Accounting and Economics, Elsevier, vol. 64(1), pages 56-77.
    7. McLaughlin, Joanne Song, 2017. "Does Communist party membership pay? Estimating the economic returns to party membership in the labor market in China," Journal of Comparative Economics, Elsevier, vol. 45(4), pages 963-983.
    8. Shimizu, Hiroshi & Wakutsu, Naohiko, 2026. "Stimulating spin-outs and stalled subsequent technological development: Laser diodes in the United States and Japan under the SBIR program," Technological Forecasting and Social Change, Elsevier, vol. 223(C).
    9. Saxena, Vibhor & Bindal, Ishaan & LeMay-Boucher, Philippe, 2020. "Social groups and credit shocks: Evidence of inequalities in consumption smoothing," Economic Analysis and Policy, Elsevier, vol. 68(C), pages 311-326.
    10. Yechan Park & Yuya Sasaki, 2026. "Choosing A Headline Estimand from Matching, DID, and Hybrid Designs: A Minimax-Regret Approach," Papers 2606.20435, arXiv.org.
    11. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    12. Oliveira, Rodrigo & Moura, Klebson & Viana, Jorge & Tigre, Robson & Sampaio, Breno, 2015. "Commute duration and health: Empirical evidence from Brazil," Transportation Research Part A: Policy and Practice, Elsevier, vol. 80(C), pages 62-75.
    13. Yoko Kijima, 2022. "Long-term and spillover effects of rice production training in Uganda," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 14(4), pages 395-415, October.
    14. Olitsky, Neal H. & Cosgrove, Sarah B., 2016. "The better blend? Flipping the principles of microeconomics classroom," International Review of Economics Education, Elsevier, vol. 21(C), pages 1-11.
    15. Le Canh Bich Tho & Chieko Umetsu, 2026. "Paddy Cooperatives and Climate‐Smart Agriculture Adoption: A Case Study in the Vietnamese Mekong Delta," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 70(1), pages 87-101, January.
    16. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    17. repec:ags:bdbjaf:279932 is not listed on IDEAS
    18. Eva Österbacka & Joachim Merz & Cathleen D. Zick, 2012. "Human capital investments in children –A comparative analysis of the role of parent-child shared time in selected countries," electronic International Journal of Time Use Research, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)) and The International Association for Time Use Research (IATUR), vol. 9(1), pages 120-143, November.
    19. Mano, Yukichi & Akoten, John & Yoshino, Yutaka & Sonobe, Tetsushi, 2014. "Teaching KAIZEN to small business owners: An experiment in a metalworking cluster in Nairobi," Journal of the Japanese and International Economies, Elsevier, vol. 33(C), pages 25-42.
    20. Xudong Rao & Yuehua Zhang, 2020. "Livestock insurance, moral hazard, and farmers’ decisions: a field experiment among hog farms in China," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 45(1), pages 134-156, January.
    21. Kornelius Kraft & Julia Lang, 2016. "Just a Question of Selection? The Causal Effect of Profit Sharing on a Firm's Performance," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 55(3), pages 444-467, July.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.17451. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.