IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp15799.html

A Complete Framework for Model-Free Difference-in-Differences Estimation

Author

Listed:
  • Henderson, Daniel J.

    (University of Alabama)

  • Sperlich, Stefan

    (University of Geneva)

Abstract

We propose a complete framework for model-free difference-in-differences analysis with covariates, where model-free means data-driven, in particular nonparametric estimation and testing, variable and scale choice. We start with searching for the preferred data setup by simultaneously choosing confounders and a scale of the outcome variable along identification conditions. The treatment effects themselves are estimated in two steps: first, the heterogeneous effects stratified along the covariates, then the average treatment effect(s) for the population(s) of interest. We provide the asymptotic statistics as well as the finite sample behavior of our methods, and suggest bootstrap procedures to calculate standard errors and p-values of significance tests. The pertinence of our methods is shown with a study of the impact of the Deferred Action for Childhood Arrivals program on human capital responses of non-citizen immigrants. We show that past results underestimated the positive impact on school attendance for individuals aged 14-18, and the positive impact on high school completion. Moreover, we find that the parametric methods fail to identify the negative impact on school attendance of college aged individuals. Practical issues including bandwidth selection, sample weights, and implementation are given in the supplement.

Suggested Citation

  • Henderson, Daniel J. & Sperlich, Stefan, 2022. "A Complete Framework for Model-Free Difference-in-Differences Estimation," IZA Discussion Papers 15799, IZA Network @ LISER.
  • Handle: RePEc:iza:izadps:dp15799
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp15799.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Chi-Yang Chu & Daniel J. Henderson & Christopher F. Parmeter, 2015. "Plug-in Bandwidth Selection for Kernel Density Estimation with Discrete Data," Econometrics, MDPI, vol. 3(2), pages 1-16, March.
    2. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    3. Stefan Sperlich, 2014. "On the choice of regularization parameters in specification testing: a critical discussion," Empirical Economics, Springer, vol. 47(2), pages 427-450, September.
    4. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    5. Hayfield, Tristen & Racine, Jeffrey S., 2008. "Nonparametric Econometrics: The np Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i05).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tran, Nhan, 2023. "The effects of deferred action for childhood arrivals on labor market outcomes," MPRA Paper 118496, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stefan Sperlich, 2022. "Comments on: hybrid semiparametric Bayesian networks," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(2), pages 335-339, June.
    2. Taisuke Otsu & Yoshiyasu Rai, 2017. "Bootstrap Inference of Matching Estimators for Average Treatment Effects," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1720-1732, October.
    3. MacKinnon, James, 2007. "Bootstrap Hypothesis Testing," Queen's Economics Department Working Papers 273603, Queen's University - Department of Economics.
    4. van de Walle, Dominique & Mu, Ren, 2007. "Fungibility and the flypaper effect of project aid: Micro-evidence for Vietnam," Journal of Development Economics, Elsevier, vol. 84(2), pages 667-685, November.
    5. David H. Bernstein & Christopher F. Parmeter, 2017. "Returns to Scale in Electricity Generation: Revisited and Replicated," Working Papers 2017-08, University of Miami, Department of Economics.
    6. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    7. El Ghouch, Anouar & Genton, Marc G. & Bouezmarni , Taoufik, 2012. "Measuring the Discrepancy of a Parametric Model via Local Polynomial Smoothing," LIDAM Discussion Papers ISBA 2012001, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    8. Daiki Maki, 2015. "Wild bootstrap tests for unit root in ESTAR models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(3), pages 475-490, September.
    9. Kemp, Gordon C.R. & Santos Silva, J.M.C., 2012. "Regression towards the mode," Journal of Econometrics, Elsevier, vol. 170(1), pages 92-101.
    10. Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
    11. Jan Fałkowski & Maciej Jakubowski & Paweł Strawiński, 2014. "Returns from income strategies in rural Poland," The Economics of Transition, The European Bank for Reconstruction and Development, vol. 22(1), pages 139-178, January.
    12. Balima, Wenéyam Hippolyte & Combes, Jean-Louis & Minea, Alexandru, 2017. "Sovereign debt risk in emerging market economies: Does inflation targeting adoption make any difference?," Journal of International Money and Finance, Elsevier, vol. 70(C), pages 360-377.
    13. Requillart, Vincent & Nauges, Celine & Simioni, Michel & Bontemps, Christophe, 2012. "Food Safety Regulation and Firm Productivity: Evidence from the French Food Industry," 2012 First Congress, June 4-5, 2012, Trento, Italy 124378, Italian Association of Agricultural and Applied Economics (AIEAA).
    14. Degl’Innocenti, Marta & Matousek, Roman & Sevic, Zeljko & Tzeremes, Nickolaos G., 2017. "Bank efficiency and financial centres: Does geographical location matter?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 46(C), pages 188-198.
    15. George Halkos & Roman Matousek & Nickolaos Tzeremes, 2016. "Pre-evaluating technical efficiency gains from possible mergers and acquisitions: evidence from Japanese regional banks," Review of Quantitative Finance and Accounting, Springer, vol. 46(1), pages 47-77, January.
    16. George E. Halkos & Nickolaos G. Tzeremes, 2015. "Measuring Seaports' Productivity: A Malmquist Productivity Index Decomposition Approach," Journal of Transport Economics and Policy, University of Bath, vol. 49(2), pages 355-376, April.
    17. Qi Li & Juan Lin & Jeffrey S. Racine, 2013. "Optimal Bandwidth Selection for Nonparametric Conditional Distribution and Quantile Functions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 57-65, January.
    18. MacKinnon, James G. & Orregaard Nielsen, Morten & Webb, Matthew D., 2017. "Bootstrap and Asymptotic Inference with Multiway Clustering," Queen's Economics Department Working Papers 274712, Queen's University - Department of Economics.
    19. Bodory, Hugo & Huber, Martin, 2018. "The causalweight package for causal inference in R," FSES Working Papers 493, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    20. D. Dobler & J. Beyersmann & M. Pauly, 2017. "Non-strange weird resampling for complex survival data," Biometrika, Biometrika Trust, vol. 104(3), pages 699-711.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • A2 - General Economics and Teaching - - Economic Education and Teaching of Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp15799. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Fallak (email available below). General contact details of provider: https://edirc.repec.org/data/izaaalu.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.