IDEAS home Printed from https://ideas.repec.org/p/ler/wpaper/26551.html
   My bibliography  Save this paper

Matching vs Differencing when Estimating Treatment Effects with Panel Data: the Example of the Effect of Job Training Programs on Earnings

Author

Listed:
  • Chabé-Ferret, Sylvain

Abstract

This paper compares matching and Difference-In-Difference matching (DID) when estimating the effect of a program on a dynamic outcome. I detail the sources of bias of each estimator in a model of entry into a Job Training Program (JTP) and earnings dynamics that I use as a working example. I show that there are plausible settings in which DID is consistent while matching on past outcomes is not. Unfortunately, the consistency of both estimators relies on conditions that are at odds with properties of earnings dynamics. Using calibration and Monte-Carlo simulations, I show that deviations from the most favorable conditions severely bias both estimators. The behavior of matching is nevertheless less erratic: its bias generally decreases when controlling for more past outcomes and it generally provides a lower bound on the true treatment effect. I finally point to previously unnoticed empirical results that confirm that DID does well, and generally better than matching on past outcomes, at replicating the results of an experimental benchmark.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Chabé-Ferret, Sylvain, 2012. "Matching vs Differencing when Estimating Treatment Effects with Panel Data: the Example of the Effect of Job Training Programs on Earnings," LERNA Working Papers 12.24.381, LERNA, University of Toulouse.
  • Handle: RePEc:ler:wpaper:26551
    as

    Download full text from publisher

    File URL: http://www2.toulouse.inra.fr/lerna/travaux/cahiers2012/12.24.381.pdf
    File Function: Full text
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    2. Gobillon, Laurent & Magnac, Thierry & Selod, Harris, 2012. "Do unemployed workers benefit from enterprise zones? The French experience," Journal of Public Economics, Elsevier, pages 881-892.
    3. Martin Browning & Mette Ejrnæs & Javier Alvarez, 2010. "Modelling Income Processes with Lots of Heterogeneity," Review of Economic Studies, Oxford University Press, vol. 77(4), pages 1353-1381.
    4. Markus Frölich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
    5. Balineau, Gaëlle, 2013. "Disentangling the Effects of Fair Trade on the Quality of Malian Cotton," World Development, Elsevier, vol. 44(C), pages 241-255.
    6. Jay Bhattacharya & William B. Vogt, 2007. "Do Instrumental Variables Belong in Propensity Scores?," NBER Technical Working Papers 0343, National Bureau of Economic Research, Inc.
    7. Barry Arnold & Robert Beaver & Richard Groeneveld & William Meeker, 1993. "The nontruncated marginal of a truncated bivariate normal distribution," Psychometrika, Springer;The Psychometric Society, vol. 58(3), pages 471-488, September.
    8. Ziebarth, Nicolas R. & Karlsson, Martin, 2010. "A natural experiment on sick pay cuts, sickness absence, and labor costs," Journal of Public Economics, Elsevier, vol. 94(11-12), pages 1108-1122, December.
    9. MaCurdy, Thomas E., 1982. "The use of time series processes to model the error structure of earnings in a longitudinal data analysis," Journal of Econometrics, Elsevier, vol. 18(1), pages 83-114, January.
    10. Puhani, Patrick A. & Sonderhof, Katja, 2010. "The effects of a sick pay reform on absence and on health-related outcomes," Journal of Health Economics, Elsevier, vol. 29(2), pages 285-302, March.
    11. Fatih Guvenen, 2007. "Learning Your Earning: Are Labor Income Shocks Really Very Persistent?," American Economic Review, American Economic Association, vol. 97(3), pages 687-712, June.
    12. Wooldridge, Jeffrey M., 2005. "Violating Ignorability Of Treatment By Controlling For Too Many Factors," Econometric Theory, Cambridge University Press, vol. 21(05), pages 1026-1028, October.
    13. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    14. Dmytro Hryshko, 2012. "Labor income profiles are not heterogeneous: Evidence from income growth rates," Quantitative Economics, Econometric Society, vol. 3(2), pages 177-209, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. von Eije, Henk & Goyal, Abhinav & Muckley, Cal B., 2014. "Does the information content of payout initiations and omissions influence firm risks?," Journal of Econometrics, Elsevier, vol. 183(2), pages 222-229.

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ler:wpaper:26551. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Maxime MARTY). General contact details of provider: http://edirc.repec.org/data/lrtlsfr.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.