IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.07524.html

Robust Inference for Weighted Estimands

Author

Listed:
  • Vod Vilfort

Abstract

Researchers often conduct inference on weighted estimands, defined as weighted averages of group-level effects. Example settings include event studies with cohort-level effects and experiments with site-level effects. Under heterogeneous effects, different weighting schemes yield estimands with distinct empirical and policy interpretations, leading to ambiguity and disagreement over the choice of weights. I establish bounds on differences between weighted estimands and confidence bounds on effect heterogeneity, which I use to construct estimators that minimize worst-case bias and confidence intervals that are uniformly valid over classes of weighted estimands. I apply these methods to an event study in Lakdawala, Nakasone, and Kho (2023), which studies the effects of school-based internet access on test scores. I find that results are robust to broad classes of weights. I then apply the methods to Tennessee's Project STAR experiment and find that results are sensitive to small departures from baseline weights.

Suggested Citation

  • Vod Vilfort, 2026. "Robust Inference for Weighted Estimands," Papers 2607.07524, arXiv.org.
  • Handle: RePEc:arx:papers:2607.07524
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.07524
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    2. Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021. "From Local to Global: External Validity in a Fertility Natural Experiment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
    3. Molinari, Francesca, 2020. "Microeconometrics with partial identification," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 355-486, Elsevier.
    4. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    5. Jonathan Roth & Pedro H. C. Sant’Anna, 2023. "Efficient Estimation for Staggered Rollout Designs," Journal of Political Economy Microeconomics, University of Chicago Press, vol. 1(4), pages 669-709.
    6. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    7. Edward H. Kennedy, 2019. "Nonparametric Causal Effects Based on Incremental Propensity Score Interventions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 645-656, April.
    8. Christine Blandhol & John Bonney & Magne Mogstad & Alexander Torgovitsky, 2022. "When is TSLS Actually LATE?," NBER Working Papers 29709, National Bureau of Economic Research, Inc.
    9. Timothy B. Armstrong & Michal Kolesár, 2018. "Optimal Inference in a Class of Regression Models," Econometrica, Econometric Society, vol. 86(2), pages 655-683, March.
    10. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    11. Timothy B. Armstrong & Patrick Kline & Liyang Sun, 2025. "Adapting to Misspecification," Econometrica, Econometric Society, vol. 93(6), pages 1981-2005, November.
    12. Charles F. Manski, 2021. "Econometrics for Decision Making: Building Foundations Sketched by Haavelmo and Wald," Econometrica, Econometric Society, vol. 89(6), pages 2827-2853, November.
    13. Paul Goldsmith-Pinkham & Peter Hull & Michal Kolesár, 2024. "Contamination Bias in Linear Regressions," American Economic Review, American Economic Association, vol. 114(12), pages 4015-4051, December.
    14. Magne Mogstad & Alexander Torgovitsky & Christopher R. Walters, 2021. "The Causal Interpretation of Two-Stage Least Squares with Multiple Instrumental Variables," American Economic Review, American Economic Association, vol. 111(11), pages 3663-3698, November.
    15. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    16. Kirill Borusyak & Xavier Jaravel & Jann Spiess, 2024. "Revisiting Event-Study Designs: Robust and Efficient Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(6), pages 3253-3285.
    17. Eli Ben-Michael & D. James Greiner & Kosuke Imai & Zhichao Jiang, 2025. "Safe Policy Learning through Extrapolation: Application to Pre-trial Risk Assessment," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 120(551), pages 1386-1399, July.
    18. Stephen Coussens & Jann Spiess, 2021. "Improving Inference from Simple Instruments through Compliance Estimation," Papers 2108.03726, arXiv.org.
    19. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    20. Huntington-Klein Nick, 2020. "Instruments with Heterogeneous Effects: Bias, Monotonicity, and Localness," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 182-208, January.
    21. Henry, Marc & Onatski, Alexei, 2012. "Set coverage and robust policy," Economics Letters, Elsevier, vol. 115(2), pages 256-257.
    22. Peter M. Aronow & Cyrus Samii, 2016. "Does Regression Produce Representative Estimates of Causal Effects?," American Journal of Political Science, John Wiley & Sons, vol. 60(1), pages 250-267, January.
    23. Timothy B. Armstrong & Michal Kolesár, 2021. "Finite‐Sample Optimal Estimation and Inference on Average Treatment Effects Under Unconfoundedness," Econometrica, Econometric Society, vol. 89(3), pages 1141-1177, May.
    24. Alberto Abadie & Joshua Angrist & Brigham Frandsen & Jörn-Steffen Pischke, 2025. "Harvesting Differences-in-Differences and Event-Study Evidence," NBER Working Papers 34550, National Bureau of Economic Research, Inc.
    25. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    26. Hunt Allcott, 2015. "Site Selection Bias in Program Evaluation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1117-1165.
    27. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen & Liyang Sun, 2025. "Policy Learning with Confidence," Papers 2502.10653, arXiv.org, revised Jan 2026.
    28. Timothy B. Armstrong & Michal Kolesár, 2020. "Simple and honest confidence intervals in nonparametric regression," Quantitative Economics, Econometric Society, vol. 11(1), pages 1-39, January.
    29. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504.
    30. Magne Mogstad & Alexander Torgovitsky, 2024. "Instrumental Variables with Unobserved Heterogeneity in Treatment Effects," NBER Working Papers 32927, National Bureau of Economic Research, Inc.
    31. Yiqi Liu, 2025. "Synthetic Parallel Trends," Papers 2511.05870, arXiv.org.
    32. Joshua Angrist & Ivan Fernandez-Val, 2010. "ExtrapoLATE-ing: External Validity and Overidentification in the LATE Framework," NBER Working Papers 16566, National Bureau of Economic Research, Inc.
    33. McCloskey, Adam, 2017. "Bonferroni-based size-correction for nonstandard testing problems," Journal of Econometrics, Elsevier, vol. 200(1), pages 17-35.
    34. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    35. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    36. Albert Chiu & Xingchen Lan & Ziyi Liu & Yiqing Xu, 2023. "Causal Panel Analysis under Parallel Trends: Lessons from a Large Reanalysis Study," Papers 2309.15983, arXiv.org, revised Jan 2026.
    37. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    38. Patrick Kline & Raffaele Saggio & Mikkel Sølvsten, 2020. "Leave‐Out Estimation of Variance Components," Econometrica, Econometric Society, vol. 88(5), pages 1859-1898, September.
    39. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    40. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    41. Yitzhaki, Shlomo, 1996. "On Using Linear Regressions in Welfare Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(4), pages 478-486, October.
    42. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    43. Elizabeth A. Stuart & Stephen R. Cole & Catherine P. Bradshaw & Philip J. Leaf, 2011. "The use of propensity scores to assess the generalizability of results from randomized trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 369-386, April.
    44. Leah K. Lakdawala & Eduardo Nakasone & Kevin Kho, 2023. "Dynamic Impacts of School-Based Internet Access on Student Learning: Evidence from Peruvian Public Primary Schools," American Economic Journal: Economic Policy, American Economic Association, vol. 15(4), pages 222-254, November.
    45. John Gardner, 2022. "Two-stage differences in differences," Papers 2207.05943, arXiv.org.
    46. Bhuller, Manudeep & Sigstad, Henrik, 2024. "2SLS with multiple treatments," Journal of Econometrics, Elsevier, vol. 242(1).
    47. Chiu, Albert & Lan, Xingchen & Liu, Ziyi & Xu, Yiqing, 2026. "Causal Panel Analysis under Parallel Trends: Lessons from a Large Reanalysis Study," American Political Science Review, Cambridge University Press, vol. 120(1), pages 245-266, February.
    48. Fan Li & Kari Lock Morgan & Alan M. Zaslavsky, 2018. "Balancing Covariates via Propensity Score Weighting," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 390-400, January.
    49. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
    50. Abadie, Alberto & Gu, Jiaying & Shen, Shu, 2024. "Instrumental variable estimation with first-stage heterogeneity," Journal of Econometrics, Elsevier, vol. 240(2).
    51. Reca Sarfati & Vod Vilfort, 2026. "Integrating Diagnostic Checks into Estimation," Papers 2604.16690, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2026. "Estimating Causal Effects With Observational Data: Guidelines for Agricultural and Applied Economists," Journal of Agricultural Economics, Wiley Blackwell, vol. 77(2), pages 356-382, June.
    2. Soonwoo Kwon & Liyang Sun, 2025. "Estimating Treatment Effects Under Bounded Heterogeneity," Papers 2510.05454, arXiv.org, revised Aug 2026.
    3. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    4. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    5. Bhuller, Manudeep & Sigstad, Henrik, 2024. "2SLS with multiple treatments," Journal of Econometrics, Elsevier, vol. 242(1).
    6. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Sciences Po Economics Publications (main) hal-03455978, HAL.
    7. Jaworski, Krystian & Olipra, Jakub, 2025. "Cutting VAT rate on food products in a high-inflation environment. Does it work out?," Food Policy, Elsevier, vol. 131(C).
    8. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    9. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    10. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    11. Niklas Potrafke & Luisa Dörr & Klaus Gründler & Tuuli Tähtinen & Luisa Dörr, 2025. "Female Leaders and the Representation of Women in Government," CESifo Working Paper Series 11851, CESifo.
    12. Nyborg, Kjell G. & Woschitz, Jiri, 2025. "Robust difference-in-differences analysis when there is a term structure," Journal of Financial Economics, Elsevier, vol. 170(C).
    13. Angelo Leogrande & Mauro Di Molfetta & Valeria Notarnicola & Maria Giovanna Trotta, 2026. "Picking Winners or Marking Them? Timing-Based Evaluation of Innovation Certification," Working Papers hal-05662584, HAL.
    14. Kyunghoon Ban & D'esir'e K'edagni, 2022. "Robust Difference-in-differences Models," Papers 2211.06710, arXiv.org, revised Aug 2023.
    15. Peter Blair & Elijah Neilson, 2023. "Divorce and Property Division Laws Shape Human Capital Investment," Working Papers 2023-020, Human Capital and Economic Opportunity Working Group.
    16. Ulbing, Philipp, 2024. "The Zero Lower Bound on Household Deposit Rates: Not As Binding As We Thought," VfS Annual Conference 2024 (Berlin): Upcoming Labor Market Challenges 302353, Verein für Socialpolitik / German Economic Association.
    17. Yuhao Deng & Le Kang, 2026. "Doubly Robust Estimation of Treatment Effects in Staggered Difference-in-Differences with Time-Varying Covariates," Papers 2603.04080, arXiv.org.
    18. Art=uras Juodis & Martin Weidner, 2026. "Factor-Augmented Panel Regressions and Variance-Weighted Treatment Effects," Papers 2604.18078, arXiv.org.
    19. Wang, Yimin, 2025. "Links between COVID-19 lockdowns and drug overdose deaths, evidence from panel data," Economics & Human Biology, Elsevier, vol. 58(C).
    20. Hahm, Dong Woo, 2026. "From curriculum to career: Early-career labor market effects of the Common Core," Economics of Education Review, Elsevier, vol. 110(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.07524. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.