IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v42y2023i4p746-767.html

Augmented Difference-in-Differences

Author

Listed:
  • Kathleen T. Li

    (McCombs School of Business, University of Texas at Austin, Austin, Texas 78705)

  • Christophe Van den Bulte

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

Abstract

Marketing scientists often estimate causal effects using data from pre/post test/control quasi-experimental settings. We propose a new, easy-to-implement augmented difference-in-differences (ADID) method that complements existing approaches to estimate the average treatment effect on the treated (ATT) from such data. Its advantage over the difference-in-differences method is that it can better handle heterogeneity between treatment and control units and, hence, requires a less stringent causal identification assumption. Its advantages over more flexible approaches like the synthetic control method are that it is easy to implement, provides easy-to-compute confidence intervals, and can be applied to data where the synthetic control and related methods cannot be applied or may not be well suited. Examples are data with short pre- and posttreatment periods or with a large number of treatment and control units. Using analytical proofs, simulations, and nine empirical applications, we document the attractive properties of ADID and provide guidance on what method(s) to use when. With the addition of ADID in their toolkit, marketers are better equipped to address important causal research questions in a wider range of data structures.

Suggested Citation

  • Kathleen T. Li & Christophe Van den Bulte, 2023. "Augmented Difference-in-Differences," Marketing Science, INFORMS, vol. 42(4), pages 746-767, July.
  • Handle: RePEc:inm:ormksc:v:42:y:2023:i:4:p:746-767
    DOI: 10.1287/mksc.2022.1406
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.2022.1406
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mksc.2022.1406?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Maria Petrova & Ananya Sen & Pinar Yildirim, 2021. "Social Media and Political Contributions: The Impact of New Technology on Political Competition," Management Science, INFORMS, vol. 67(5), pages 2997-3021, May.
    2. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    3. Kathleen T. Li, 2020. "Statistical Inference for Average Treatment Effects Estimated by Synthetic Control Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 2068-2083, December.
    4. André Bonfrer & Pradeep K. Chintagunta & John H. Roberts & David Corkindale, 2020. "Assessing the Sales Impact of Plain Packaging Regulation for Cigarettes: Evidence from Australia," Marketing Science, INFORMS, vol. 39(1), pages 234-252, January.
    5. Li, Kathleen T. & Bell, David R., 2017. "Estimation of average treatment effects with panel data: Asymptotic theory and implementation," Journal of Econometrics, Elsevier, vol. 197(1), pages 65-75.
    6. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    7. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    8. Jianqing Fan & Ricardo Masini & Marcelo C. Medeiros, 2022. "Do We Exploit all Information for Counterfactual Analysis? Benefits of Factor Models and Idiosyncratic Correction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 574-590, April.
    9. Nikolay Doudchenko & Guido W. Imbens, 2016. "Balancing, Regression, Difference-In-Differences and Synthetic Control Methods: A Synthesis," NBER Working Papers 22791, National Bureau of Economic Research, Inc.
    10. Cheng Hsiao & H. Steve Ching & Shui Ki Wan, 2012. "A Panel Data Approach For Program Evaluation: Measuring The Benefits Of Political And Economic Integration Of Hong Kong With Mainland China," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 705-740, August.
    11. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jared Amani Greathouse & Mani Bayani & Jason Coupet, 2023. "Splash! Robustifying Donor Pools for Policy Studies," Papers 2308.13688, arXiv.org.
    2. Jared Greathouse & Vincent Nossek & Pierre Mandon, 2026. "Economic Impact of the Socio-Political Crisis in the Northwest and Southwest Regions of Cameroon: A Forward Difference-in-Differences Approach," CERDI Working papers hal-05523002, HAL.
    3. Zhiqi Zhang & Zhiyu Zeng & Ruohan Zhan & Dennis Zhang, 2026. "Personalized Policy Learning through Discrete Experimentation: Theory and Empirical Evidence," Papers 2602.05099, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    2. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    3. Fry, Joseph, 2024. "A method of moments approach to asymptotically unbiased Synthetic Controls," Journal of Econometrics, Elsevier, vol. 244(1).
    4. Anish Agarwal & Devavrat Shah & Dennis Shen, 2026. "Synthetic Interventions: Extending Synthetic Controls to Multiple Treatments," Operations Research, INFORMS, vol. 74(2), pages 840-859, March.
    5. Joseph Fry, 2023. "A Method of Moments Approach to Asymptotically Unbiased Synthetic Controls," Papers 2312.01209, arXiv.org, revised Mar 2024.
    6. Hongyi Jiang & Xingyu Li & Yan Shen & Qiankun Zhou, 2025. "Prediction Intervals of Panel Data Approach for Programme Evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(6), pages 655-668, September.
    7. Viviano, Davide & Bradic, Jelena, 2023. "Synthetic Learner: Model-free inference on treatments over time," Journal of Econometrics, Elsevier, vol. 234(2), pages 691-713.
    8. Cruz A. Echevarría & Serhat Hasancebi & Javier García-Enríquez, 2022. "Economic Effects of Macao’s Integration with Mainland China: A Causal Inference Study," Journal of Economic Integration, Center for Economic Integration, Sejong University, vol. 37(2), pages 179-215.
    9. Andrii Melnychuk, 2024. "Synthetic Controls with spillover effects: A comparative study," Papers 2405.01645, arXiv.org.
    10. Gharehgozli, Orkideh, 2021. "An empirical comparison between a regression framework and the Synthetic Control Method," The Quarterly Review of Economics and Finance, Elsevier, vol. 81(C), pages 70-81.
    11. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    12. Yu, Jisang & Ijaz, Arusha, 2023. "Recovering from Natural Disaster through Exports: The Case of 2010 Pakistan Flood and EU Tariff Waiver on Pakistan Textile Exports," 2023 Annual Meeting, July 23-25, Washington D.C. 335710, Agricultural and Applied Economics Association.
    13. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2023. "Same Root Different Leaves: Time Series and Cross‐Sectional Methods in Panel Data," Econometrica, Econometric Society, vol. 91(6), pages 2125-2154, November.
    14. Niklas Potrafke & Luisa Dörr & Klaus Gründler & Tuuli Tähtinen & Luisa Dörr, 2025. "Female Leaders and the Representation of Women in Government," CESifo Working Paper Series 11851, CESifo.
    15. Xin, Mengwei & Shalaby, Amer & Feng, Shumin & Zhao, Hu, 2021. "Impacts of COVID-19 on urban rail transit ridership using the Synthetic Control Method," Transport Policy, Elsevier, vol. 111(C), pages 1-16.
    16. Carlos Viana de Carvalho & Ricardo Masini & Marcelo Cunha Medeiros, 2016. "The perils of Counterfactual Analysis with Integrated Processes," Textos para discussão 654, Department of Economics PUC-Rio (Brazil).
    17. Kathleen T. Li & Venkatesh Shankar, 2024. "A Two-Step Synthetic Control Approach for Estimating Causal Effects of Marketing Events," Management Science, INFORMS, vol. 70(6), pages 3734-3747, June.
    18. Luya Wang & Jeffrey S. Racine & Qiaoyu Wang, 2025. "Bootstrap inference on a factor model based average treatment effects estimator," Econometric Reviews, Taylor & Francis Journals, vol. 44(1), pages 80-89, January.
    19. Ignacio Martinez & Jaume Vives-i-Bastida, 2022. "Bayesian and Frequentist Inference for Synthetic Controls," Papers 2206.01779, arXiv.org, revised Jul 2024.
    20. Kathleen T. Li, 2024. "Frontiers: A Simple Forward Difference-in-Differences Method," Marketing Science, INFORMS, vol. 43(2), pages 267-279, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:42:y:2023:i:4:p:746-767. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.