IDEAS home Printed from https://ideas.repec.org/a/bpj/causin/v11y2023i1p33n1.html

Adaptive normalization for IPW estimation

Author

Listed:
  • Khan Samir

    (Department of Statistics, Stanford University, Stanford, CA 94305, United States)

  • Ugander Johan

    (Department of Management Science and Engineering, Stanford University, Stanford, CA 94305, United States)

Abstract

Inverse probability weighting (IPW) is a general tool in survey sampling and causal inference, used in both Horvitz–Thompson estimators, which normalize by the sample size, and Hájek/self-normalized estimators, which normalize by the sum of the inverse probability weights. In this work, we study a family of IPW estimators, first proposed by Trotter and Tukey in the context of Monte Carlo problems, that are normalized by an affine combination of the sample size and a sum of inverse weights. We show how selecting an estimator from this family in a data-dependent way to minimize asymptotic variance leads to an iterative procedure that converges to an estimator with connections to regression control methods. We refer to such estimators as adaptively normalized estimators. For mean estimation in survey sampling, the adaptively normalized estimator has asymptotic variance that is never worse than the Horvitz–Thompson and Hájek estimators. Going further, we show that adaptive normalization can be used to propose improvements of the augmented IPW (AIPW) estimator, average treatment effect (ATE) estimators, and policy learning objectives. Appealingly, these proposals preserve both the asymptotic efficiency of AIPW and the regret bounds for policy learning with IPW objectives, and deliver consistent finite sample improvements in simulations for all three of mean estimation, ATE estimation, and policy learning.

Suggested Citation

  • Khan Samir & Ugander Johan, 2023. "Adaptive normalization for IPW estimation," Journal of Causal Inference, De Gruyter, vol. 11(1), pages 1-33, January.
  • Handle: RePEc:bpj:causin:v:11:y:2023:i:1:p:33:n:1
    DOI: 10.1515/jci-2022-0019
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jci-2022-0019
    Download Restriction: no

    File URL: https://libkey.io/10.1515/jci-2022-0019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Qin, Jing & Zhang, Biao & Leung, Denis H. Y., 2009. "Empirical Likelihood in Missing Data Problems," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1492-1503.
    2. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, August.
    3. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Verena Lauber & Johanna Storck, 2016. "Helping with the Kids? How Family-Friendly Workplaces Affect Parental Well-Being and Behavior," Discussion Papers of DIW Berlin 1630, DIW Berlin, German Institute for Economic Research.
    2. Caloffi, Annalisa & Freo, Marzia & Ghinoi, Stefano & Mariani, Marco & Rossi, Federica, 2022. "Assessing the effects of a deliberate policy mix: The case of technology and innovation advisory services and innovation vouchers," Research Policy, Elsevier, vol. 51(6).
    3. Shanike J. Smart & Solomon W. Polachek, 2024. "COVID-19 vaccine and risk-taking," Journal of Risk and Uncertainty, Springer, vol. 68(1), pages 25-49, February.
    4. Vincent Starck, 2025. "Improving control over unobservables with network data," Papers 2511.00612, arXiv.org.
    5. Jonathan Fuhr & Philipp Berens & Dominik Papies, 2024. "Estimating Causal Effects with Double Machine Learning -- A Method Evaluation," Papers 2403.14385, arXiv.org, revised Apr 2024.
    6. J. R. Lockwood & Daniel F. McCaffrey, 2019. "Impact Evaluation Using Analysis of Covariance With Error-Prone Covariates That Violate Surrogacy," Evaluation Review, , vol. 43(6), pages 335-369, December.
    7. Florian Gunsilius & Yuliang Xu, 2021. "Matching for causal effects via multimarginal unbalanced optimal transport," Papers 2112.04398, arXiv.org, revised Jul 2022.
    8. Zhengyuan Zhou & Susan Athey & Stefan Wager, 2023. "Offline Multi-Action Policy Learning: Generalization and Optimization," Operations Research, INFORMS, vol. 71(1), pages 148-183, January.
    9. Borgschulte, Mark & Vogler, Jacob, 2020. "Did the ACA Medicaid expansion save lives?," Journal of Health Economics, Elsevier, vol. 72(C).
    10. Paul Hunermund & Elias Bareinboim, 2019. "Causal Inference and Data Fusion in Econometrics," Papers 1912.09104, arXiv.org, revised Mar 2023.
    11. Plamen Nikolov & Hongjian Wang & Kevin Acker, 2020. "Wage premium of Communist Party membership: Evidence from China," Pacific Economic Review, Wiley Blackwell, vol. 25(3), pages 309-338, August.
    12. Daniel Burkhard & Christian P. R. Schmid & Kaspar Wüthrich, 2019. "Financial incentives and physician prescription behavior: Evidence from dispensing regulations," Health Economics, John Wiley & Sons, Ltd., vol. 28(9), pages 1114-1129, September.
    13. Michael Lechner, 2023. "Causal Machine Learning and its use for public policy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-15, December.
    14. Özler, Berk & Çelik, Çiğdem & Cunningham, Scott & Cuevas, P. Facundo & Parisotto, Luca, 2021. "Children on the move: Progressive redistribution of humanitarian cash transfers among refugees," Journal of Development Economics, Elsevier, vol. 153(C).
    15. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.
    16. Shi Lei & Li Xinran, 2024. "Some theoretical foundations for the design and analysis of randomized experiments," Journal of Causal Inference, De Gruyter, vol. 12(1), pages 1-30.
    17. Wang, Rebecca Jen-Hui & Malthouse, Edward C. & Krishnamurthi, Lakshman, 2015. "On the Go: How Mobile Shopping Affects Customer Purchase Behavior," Journal of Retailing, Elsevier, vol. 91(2), pages 217-234.
    18. Tang, Chuan & Heintzelman, Martin D. & Holsen, Thomas M., 2018. "Mercury pollution, information, and property values," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 418-432.
    19. Graham, Bryan S. & Imbens, Guido W. & Ridder, Geert, 2025. "Measuring the effects of segregation in the presence of social spillovers: A nonparametric approach," Journal of Econometrics, Elsevier, vol. 252(PB).
    20. Brian G. Vegetabile & Daniel L. Gillen & Hal S. Stern, 2020. "Optimally balanced Gaussian process propensity scores for estimating treatment effects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(1), pages 355-377, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:causin:v:11:y:2023:i:1:p:33:n:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyterbrill.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.