IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/29242.html
   My bibliography  Save this paper

Semiparametric Estimation of Treatment Effects in Randomized Experiments

Author

Listed:
  • Susan Athey
  • Peter J. Bickel
  • Aiyou Chen
  • Guido Imbens
  • Michael Pollmann

Abstract

We develop new semiparametric methods for estimating treatment effects. We focus on a setting where the outcome distributions may be thick tailed, where treatment effects are small, where sample sizes are large and where assignment is completely random. This setting is of particular interest in recent experimentation in tech companies. We propose using parametric models for the treatment effects, as opposed to parametric models for the full outcome distributions. This leads to semiparametric models for the outcome distributions. We derive the semiparametric efficiency bound for this setting, and propose efficient estimators. In the case with a constant treatment effect one of the proposed estimators has an interesting interpretation as a weighted average of quantile treatment effects, with the weights proportional to (minus) the second derivative of the log of the density of the potential outcomes. Our analysis also results in an extension of Huber's model and trimmed mean to include asymmetry and a simplified condition on linear combinations of order statistics, which may be of independent interest.

Suggested Citation

  • Susan Athey & Peter J. Bickel & Aiyou Chen & Guido Imbens & Michael Pollmann, 2021. "Semiparametric Estimation of Treatment Effects in Randomized Experiments," NBER Working Papers 29242, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:29242
    Note: LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w29242.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Leigh Linden & Jonah E. Rockoff, 2008. "Estimates of the Impact of Crime Risk on Property Values from Megan's Laws," American Economic Review, American Economic Association, vol. 98(3), pages 1103-1127, June.
    2. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    3. Randall A. Lewis & Justin M. Rao, 2015. "The Unfavorable Economics of Measuring the Returns to Advertising," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(4), pages 1941-1973.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joe Cooprider & Shima Nassiri, 2023. "Science of price experimentation at Amazon," Business Economics, Palgrave Macmillan;National Association for Business Economics, vol. 58(1), pages 34-41, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Susan Athey & Kristen Grabarz & Michael Luca & Nils Wernerfelt, 2023. "Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 120(5), pages 2208110120-, January.
    2. Weijia Dai & Hyunjin Kim & Michael Luca, 2023. "Frontiers: Which Firms Gain from Digital Advertising? Evidence from a Field Experiment," Marketing Science, INFORMS, vol. 42(3), pages 429-439, May.
    3. Hema Yoganarasimhan & Ebrahim Barzegary & Abhishek Pani, 2023. "Design and Evaluation of Optimal Free Trials," Management Science, INFORMS, vol. 69(6), pages 3220-3240, June.
    4. Susan Athey & Kristen Grabarz & Michael Luca & Nils Wernerfelt, 2022. "The Effectiveness of Digital Interventions on COVID-19 Attitudes and Beliefs," Papers 2206.10214, arXiv.org.
    5. Paul B. Ellickson & Wreetabrata Kar & James C. Reeder, 2023. "Estimating Marketing Component Effects: Double Machine Learning from Targeted Digital Promotions," Marketing Science, INFORMS, vol. 42(4), pages 704-728, July.
    6. Tang, Chuan & Czajkowski, Jeffrey & Heintzelman, Martin D. & Li, Minghao & Montgomery, Marilyn, 2020. "Rail accidents and property values in the era of unconventional energy production," Journal of Urban Economics, Elsevier, vol. 120(C).
    7. Weijia Dai & Hyunjin Kim & Michael Luca, 2016. "Which Firms Gain from Digital Advertising? Evidence from a Field Experiment," Harvard Business School Working Papers 17-025, Harvard Business School, revised Jan 2023.
    8. Brett R. Gordon & Robert Moakler & Florian Zettelmeyer, 2023. "Predictive Incrementality by Experimentation (PIE) for Ad Measurement," Papers 2304.06828, arXiv.org.
    9. Chad Lawley, 2021. "Hog Barns and Neighboring House Prices: Anticipation and Post‐Establishment Impacts," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1099-1121, May.
    10. Michael Pollmann, 2020. "Causal Inference for Spatial Treatments," Papers 2011.00373, arXiv.org, revised Jan 2023.
    11. Dimitris Bertsimas & Agni Orfanoudaki & Rory B. Weiner, 2020. "Personalized treatment for coronary artery disease patients: a machine learning approach," Health Care Management Science, Springer, vol. 23(4), pages 482-506, December.
    12. Clément de Chaisemartin & Jaime Ramirez-Cuellar, 2024. "At What Level Should One Cluster Standard Errors in Paired and Small-Strata Experiments?," American Economic Journal: Applied Economics, American Economic Association, vol. 16(1), pages 193-212, January.
    13. Clément de Chaisemartin & Luc Behaghel, 2020. "Estimating the Effect of Treatments Allocated by Randomized Waiting Lists," Econometrica, Econometric Society, vol. 88(4), pages 1453-1477, July.
    14. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    15. Peydró, José-Luis & Jiménez, Gabriel & Kenan, Huremovic & Moral-Benito, Enrique & Vega-Redondo, Fernando, 2020. "Production and financial networks in interplay: Crisis evidence from supplier-customer and credit registers," CEPR Discussion Papers 15277, C.E.P.R. Discussion Papers.
    16. Marie Bjørneby & Annette Alstadsæter & Kjetil Telle, 2018. "Collusive tax evasion by employers and employees. Evidence from a randomized fi eld experiment in Norway," Discussion Papers 891, Statistics Norway, Research Department.
    17. Kai Barron & Luis F. Gamboa & Paul Rodríguez-Lesmes, 2019. "Behavioural Response to a Sudden Health Risk: Dengue and Educational Outcomes in Colombia," Journal of Development Studies, Taylor & Francis Journals, vol. 55(4), pages 620-644, April.
    18. Davide Viviano & Jelena Bradic, 2019. "Synthetic learner: model-free inference on treatments over time," Papers 1904.01490, arXiv.org, revised Aug 2022.
    19. Chenchuan (Mark) Li & Ulrich K. Müller, 2021. "Linear regression with many controls of limited explanatory power," Quantitative Economics, Econometric Society, vol. 12(2), pages 405-442, May.
    20. Jeon, Sung-Hee & Pohl, R. Vincent, 2019. "Medical innovation, education, and labor market outcomes of cancer patients," Journal of Health Economics, Elsevier, vol. 68(C).

    More about this item

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:29242. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.