IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2608.10294.html

Testing Sign Agreement

Author

Listed:
  • Deborah Kim

Abstract

This article considers the problem of testing sign agreement among a finite number of parameters. This problem arises in empirical settings such as detecting treatment effects with opposite signs across subgroups, outcomes, or time periods, and testing instrument validity for local average treatment effects. For the null hypothesis that the parameters are either all non-negative or all non-positive, I propose two novel tests: a least favorable test and a conditional test. The least favorable test uses a worst-case null critical value, while the conditional test first screens components with large positive or negative estimates and then tests the remaining sign-unresolved components conditional on the screening event. Unlike existing sign agreement tests, both procedures accommodate arbitrary dependence among estimators; in the special case of independent estimators, the critical values depend only on the dimension and testing levels. We show that both tests control asymptotic size uniformly over a large class of nonparametric distributions. Local asymptotic power analysis reveals a tradeoff: the least favorable test is more powerful near boundary configurations where sign restrictions bind, whereas the conditional test is more powerful when some components are well separated from zero. Simulation evidence supports these theoretical predictions in finite samples.

Suggested Citation

  • Deborah Kim, 2026. "Testing Sign Agreement," Papers 2608.10294, arXiv.org.
  • Handle: RePEc:arx:papers:2608.10294
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2608.10294
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    2. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    3. Jiahua Chen, 2013. "A Partial Order on Uncertainty and Information," Journal of Theoretical Probability, Springer, vol. 26(2), pages 349-359, June.
    4. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2014. "A Practical Two‐Step Method for Testing Moment Inequalities," Econometrica, Econometric Society, vol. 82, pages 1979-2002, September.
    5. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    6. Donald W. K. Andrews & Panle Jia Barwick, 2012. "Inference for Parameters Defined by Moment Inequalities: A Recommended Moment Selection Procedure," Econometrica, Econometric Society, vol. 80(6), pages 2805-2826, November.
    7. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Evan K. Rose & Yotam Shem-Tov, 2021. "On Recoding Ordered Treatments as Binary Indicators," Papers 2111.12258, arXiv.org, revised Mar 2024.
    2. Li, Jia & Liao, Zhipeng & Zhou, Wenyu, 2025. "A general test for functional inequalities," Journal of Econometrics, Elsevier, vol. 251(C).
    3. Joseph P. Romano & Michael Wolf, 2017. "Multiple testing of one-sided hypotheses: combining Bonferroni and the bootstrap," ECON - Working Papers 254, Department of Economics - University of Zurich.
    4. Zeng-Hua Lu & Alec Zuo, 2017. "Child disability, welfare payments, marital status and mothers’ labor supply: Evidence from Australia," Cogent Economics & Finance, Taylor & Francis Journals, vol. 5(1), pages 1339769-133, January.
    5. McCloskey, Adam, 2017. "Bonferroni-based size-correction for nonstandard testing problems," Journal of Econometrics, Elsevier, vol. 200(1), pages 17-35.
    6. Huber, Martin & Mellace, Giovanni, 2011. "Testing instrument validity in sample selection models," Economics Working Paper Series 1145, University of St. Gallen, School of Economics and Political Science.
    7. Chen, Le-Yu & Szroeter, Jerzy, 2014. "Testing multiple inequality hypotheses: A smoothed indicator approach," Journal of Econometrics, Elsevier, vol. 178(P3), pages 678-693.
    8. Bolzern, Benjamin & Huber, Martin, 2017. "Testing the validity of the compulsory schooling law instrument," Economics Letters, Elsevier, vol. 159(C), pages 23-27.
    9. de Chaisemartin, Clement & D'Haultfoeuille, Xavier, "undated". "Supplement to Fuzzy Differences-in-Differences," Economic Research Papers 270217, University of Warwick - Department of Economics.
    10. Filip Obradovi'c, 2022. "Measuring Diagnostic Test Performance Using Imperfect Reference Tests: A Partial Identification Approach," Papers 2204.00180, arXiv.org, revised Aug 2024.
    11. Hiroaki Kaido & Francesca Molinari & Jörg Stoye, 2019. "Confidence Intervals for Projections of Partially Identified Parameters," Econometrica, Econometric Society, vol. 87(4), pages 1397-1432, July.
    12. Molinari, Francesca, 2020. "Microeconometrics with partial identification," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 355-486, Elsevier.
    13. Patrick Kline & Christopher R. Walters, 2019. "On Heckits, LATE, and Numerical Equivalence," Econometrica, Econometric Society, vol. 87(2), pages 677-696, March.
    14. Isaiah Andrews & Toru Kitagawa & Adam McCloskey, 2024. "Inference on Winners," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(1), pages 305-358.
    15. Arun G. Chandrasekhar & Victor Chernozhukov & Francesca Molinari & Paul Schrimpf, 2019. "Best Linear Approximations to Set Identified Functions: With an Application to the Gender Wage Gap," NBER Working Papers 25593, National Bureau of Economic Research, Inc.
    16. Tymon Słoczyński & S. Derya Uysal & Jeffrey M. Wooldridge, 2025. "Abadie’s Kappa and Weighting Estimators of the Local Average Treatment Effect," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 43(1), pages 164-177, January.
    17. Shuowen Chen & Hiroaki Kaido, 2022. "Robust Tests of Model Incompleteness in the Presence of Nuisance Parameters," Papers 2208.11281, arXiv.org, revised Sep 2023.
    18. Kédagni, Désiré, 2023. "Identifying treatment effects in the presence of confounded types," Journal of Econometrics, Elsevier, vol. 234(2), pages 479-511.
    19. Xiaohong Chen & Timothy M. Christensen & Elie Tamer, 2018. "Monte Carlo Confidence Sets for Identified Sets," Econometrica, Econometric Society, vol. 86(6), pages 1965-2018, November.
    20. Federico A. Bugni & Ivan A. Canay & Xiaoxia Shi, 2014. "Inference for functions of partially identified parameters in moment inequality models," CeMMAP working papers 22/14, Institute for Fiscal Studies.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2608.10294. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.