IDEAS home Printed from https://ideas.repec.org/p/tem/wpaper/1804.html
   My bibliography  Save this paper

Difference-in-Differences with Multiple Time Periods and an Application on the Minimum Wage and Employment

Author

Listed:
  • Brantly Callaway

    (Department of Economics, Temple University)

  • Pedro H. C. Sant'Anna

    (Department of Economics, Vanderbilt University)

Abstract

Difference-in-Differences (DID) is one of the most important and popular designs for evaluating causal effects of policy changes. In its standard format, there are two time periods and two groups: in the first period no one is treated, and in the second period a "treatment group" becomes treated, whereas a "control group" remains untreated. However, many em- pirical applications of the DID design have more than two periods and variation in treatment timing. In this article, we consider identification and estimation of treatment effect parameters using DID with (i) multiple time periods, (ii) variation in treatment timing, and (iii) when the "parallel trends assumption" holds potentially only after conditioning on observed covariates. We propose a simple two-step estimation strategy, establish the asymptotic prop- erties of the proposed estimators, and prove the validity of a computationally convenient bootstrap procedure. Furthermore we propose a semiparametric data-driven testing procedure to assess the credibility of the DID design in our context. Finally, we analyze the effect of the minimum wage on teen employment from 2001-2007. By using our proposed methods we confront the challenges related to variation in the timing of the state-level minimum wage policy changes. Open-source software is available for implementing the proposed methods.

Suggested Citation

  • Brantly Callaway & Pedro H. C. Sant'Anna, 2018. "Difference-in-Differences with Multiple Time Periods and an Application on the Minimum Wage and Employment," DETU Working Papers 1804, Department of Economics, Temple University.
  • Handle: RePEc:tem:wpaper:1804
    as

    Download full text from publisher

    File URL: http://www.cla.temple.edu/RePEc/documents/DETU_18_04.pdf
    File Function: First version, 2018
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. MacKinnon, James G. & Webb, Matthew D., 2020. "Randomization inference for difference-in-differences with few treated clusters," Journal of Econometrics, Elsevier, vol. 218(2), pages 435-450.
    2. Escanciano, J. Carlos, 2006. "A Consistent Diagnostic Test For Regression Models Using Projections," Econometric Theory, Cambridge University Press, vol. 22(6), pages 1030-1051, December.
    3. Jonathan Meer & Jeremy West, 2016. "Effects of the Minimum Wage on Employment Dynamics," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 500-522.
    4. James G. MacKinnon & Matthew D. Webb, 2018. "The wild bootstrap for few (treated) clusters," Econometrics Journal, Royal Economic Society, vol. 21(2), pages 114-135, June.
    5. Arindrajit Dube & T. William Lester & Michael Reich, 2016. "Minimum Wage Shocks, Employment Flows, and Labor Market Frictions," Journal of Labor Economics, University of Chicago Press, vol. 34(3), pages 663-704.
    6. Irene Botosaru & Federico H. Gutierrez, 2018. "Difference‐in‐differences when the treatment status is observed in only one period," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(1), pages 73-90, January.
    7. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "Rejoinder on: An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 442-447, September.
    8. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    9. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    10. Jacobson, Louis S & LaLonde, Robert J & Sullivan, Daniel G, 1993. "Earnings Losses of Displaced Workers," American Economic Review, American Economic Association, vol. 83(4), pages 685-709, September.
    11. David H. Autor & William R. Kerr & Adriana D. Kugler, 2007. "Do Employment Protections Reduce Productivity? Evidence from U.S. States," NBER Working Papers 12860, National Bureau of Economic Research, Inc.
    12. Herman J. Bierens & Werner Ploberger, 1997. "Asymptotic Theory of Integrated Conditional Moment Tests," Econometrica, Econometric Society, vol. 65(5), pages 1129-1152, September.
    13. Matias Busso & John DiNardo & Justin McCrary, 2014. "New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 885-897, December.
    14. Kline Patrick & Santos Andres, 2012. "A Score Based Approach to Wild Bootstrap Inference," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 23-41, August.
    15. Cheng, Guang & Yu, Zhuqing & Huang, Jianhua Z., 2013. "The cluster bootstrap consistency in generalized estimating equations," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 33-47.
    16. Victor Chernozhukov & Iván Fernández‐Val & Ye Luo, 2018. "The Sorted Effects Method: Discovering Heterogeneous Effects Beyond Their Averages," Econometrica, Econometric Society, vol. 86(6), pages 1911-1938, November.
    17. Freyberger, Joachim & Rai, Yoshiyasu, 2018. "Uniform confidence bands: Characterization and optimality," Journal of Econometrics, Elsevier, vol. 204(1), pages 119-130.
    18. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    19. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    20. Stéphane Bonhomme & Ulrich Sauder, 2011. "Recovering Distributions in Difference-in-Differences Models: A Comparison of Selective and Comprehensive Schooling," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 479-494, May.
    21. Anna, Petrenko, 2016. "Мaркування готової продукції як складова частина інформаційного забезпечення маркетингової діяльності підприємств овочепродуктового підкомплексу," Agricultural and Resource Economics: International Scientific E-Journal, Agricultural and Resource Economics: International Scientific E-Journal, vol. 2(1), March.
    22. Brantly Callaway & Tong Li, 2019. "Quantile treatment effects in difference in differences models with panel data," Quantitative Economics, Econometric Society, vol. 10(4), pages 1579-1618, November.
    23. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, June.
    24. Dale Belman & Paul J. Wolfson, 2014. "What Does the Minimum Wage Do?," Books from Upjohn Press, W.E. Upjohn Institute for Employment Research, number wdmwd, August.
    25. Stinchcombe, Maxwell B. & White, Halbert, 1998. "Consistent Specification Testing With Nuisance Parameters Present Only Under The Alternative," Econometric Theory, Cambridge University Press, vol. 14(3), pages 295-325, June.
    26. William Wascher & David Neumark, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Comment," American Economic Review, American Economic Association, vol. 90(5), pages 1362-1396, December.
    27. John Schmitt, 2013. "Why Does the Minimum Wage Have No Discernible Effect on Employment?," CEPR Reports and Issue Briefs 2013-04, Center for Economic and Policy Research (CEPR).
    28. Jeffrey M. Wooldridge, 2005. "Fixed-Effects and Related Estimators for Correlated Random-Coefficient and Treatment-Effect Panel Data Models," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 385-390, May.
    29. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    30. Callaway, Brantly & Li, Tong & Oka, Tatsushi, 2018. "Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods," Journal of Econometrics, Elsevier, vol. 206(2), pages 395-413.
    31. Bierens, Herman J., 1982. "Consistent model specification tests," Journal of Econometrics, Elsevier, vol. 20(1), pages 105-134, October.
    32. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 361-411, September.
    33. David Neumark & William Wascher, 1992. "Employment Effects of Minimum and Subminimum Wages: Panel Data on State Minimum Wage Laws," ILR Review, Cornell University, ILR School, vol. 46(1), pages 55-81, October.
    34. Carlos Escanciano, J., 2008. "Joint and marginal specification tests for conditional mean and variance models," Journal of Econometrics, Elsevier, vol. 143(1), pages 74-87, March.
    35. Escanciano, J. Carlos, 2006. "Goodness-of-Fit Tests for Linear and Nonlinear Time Series Models," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 531-541, June.
    36. A. Belloni & V. Chernozhukov & I. Fernández‐Val & C. Hansen, 2017. "Program Evaluation and Causal Inference With High‐Dimensional Data," Econometrica, Econometric Society, vol. 85, pages 233-298, January.
    37. Ekaterina Jardim & Mark C. Long & Robert Plotnick & Emma van Inwegen & Jacob Vigdor & Hilary Wething, 2017. "Minimum Wage Increases, Wages, and Low-Wage Employment: Evidence from Seattle," NBER Working Papers 23532, National Bureau of Economic Research, Inc.
    38. Philip Oreopoulos & Till von Wachter & Andrew Heisz, 2012. "The Short- and Long-Term Career Effects of Graduating in a Recession," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 1-29, January.
    39. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    40. Victor Chernozhukov & Iván Fernández‐Val & Jinyong Hahn & Whitney Newey, 2013. "Average and Quantile Effects in Nonseparable Panel Models," Econometrica, Econometric Society, vol. 81(2), pages 535-580, March.
    41. David H. Autor & William R. Kerr & Adriana D. Kugler, 2007. "Does Employment Protection Reduce Productivity? Evidence From US States," Economic Journal, Royal Economic Society, vol. 117(521), pages 189-217, June.
    42. Arindrajit Dube & T. William Lester & Michael Reich, 2010. "Minimum Wage Effects Across State Borders: Estimates Using Contiguous Counties," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 945-964, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    2. Sant’Anna, Pedro H.C. & Song, Xiaojun, 2019. "Specification tests for the propensity score," Journal of Econometrics, Elsevier, vol. 210(2), pages 379-404.
    3. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    4. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    5. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    6. Schumann, Mathias, 2017. "The effects of minimum wages on firm-financed apprenticeship training," Labour Economics, Elsevier, vol. 47(C), pages 163-181.
    7. Brantly Callaway, 2022. "Difference-in-Differences for Policy Evaluation," Papers 2203.15646, arXiv.org.
    8. Clemens, Jeffrey & Wither, Michael, 2019. "The minimum wage and the Great Recession: Evidence of effects on the employment and income trajectories of low-skilled workers," Journal of Public Economics, Elsevier, vol. 170(C), pages 53-67.
    9. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    10. Callaway, Brantly & Karami, Sonia, 2023. "Treatment effects in interactive fixed effects models with a small number of time periods," Journal of Econometrics, Elsevier, vol. 233(1), pages 184-208.
    11. Pedro H. C. Sant'Anna, 2016. "Program Evaluation with Right-Censored Data," Papers 1604.02642, arXiv.org.
    12. Matthew T. Gustafson & Jason D. Kotter, 2023. "Higher Minimum Wages Reduce Capital Expenditures," Management Science, INFORMS, vol. 69(5), pages 2933-2953, May.
    13. Colling, Benjamin & Van Keilegom, Ingrid, 2016. "Goodness-of-fit tests in semiparametric transformation models using the integrated regression function," LIDAM Discussion Papers ISBA 2016031, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    14. Sebastian Link, 2019. "The Price and Employment Response of Firms to the Introduction of Minimum Wages," CESifo Working Paper Series 7575, CESifo.
    15. Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
    16. William Torous & Florian Gunsilius & Philippe Rigollet, 2021. "An Optimal Transport Approach to Estimating Causal Effects via Nonlinear Difference-in-Differences," Papers 2108.05858, arXiv.org, revised Mar 2024.
    17. Colling, Benjamin & Van Keilegom, Ingrid, 2017. "Goodness-of-fit tests in semiparametric transformation models using the integrated regression function," Journal of Multivariate Analysis, Elsevier, vol. 160(C), pages 10-30.
    18. Callaway, Brantly & Li, Tong & Oka, Tatsushi, 2018. "Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods," Journal of Econometrics, Elsevier, vol. 206(2), pages 395-413.
    19. Alan Manning, 2021. "The Elusive Employment Effect of the Minimum Wage," Journal of Economic Perspectives, American Economic Association, vol. 35(1), pages 3-26, Winter.
    20. David Neumark, 2019. "The Econometrics and Economics of the Employment Effects of Minimum Wages: Getting from Known Unknowns to Known Knowns," German Economic Review, Verein für Socialpolitik, vol. 20(3), pages 293-329, August.

    More about this item

    Keywords

    Difference-in-Differences; Multiple Periods; Variation in Treatment Timing; Pre- Testing; Minimum Wage;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • J23 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Demand
    • J38 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tem:wpaper:1804. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dimitrios Diamantaras (email available below). General contact details of provider: https://edirc.repec.org/data/edtemus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.