IDEAS home Printed from https://ideas.repec.org/a/tsj/stataj/v7y2007i4p507-541.html
   My bibliography  Save this article

Causal inference with observational data

Author

Listed:
  • Austin Nichols

    (Urban Institute)

Abstract

Problems with inferring causal relationships from nonexperimental data are briefly reviewed, and four broad classes of methods designed to allow estimation of and inference about causal parameters are described: panel regression, matching or reweighting, instrumental variables, and regression discontinuity. Practical examples are offered, and discussion focuses on checking required assumptions to the extent possible. Copyright 2007 by StataCorp LP.

Suggested Citation

  • Austin Nichols, 2007. "Causal inference with observational data," Stata Journal, StataCorp LP, vol. 7(4), pages 507-541, December.
  • Handle: RePEc:tsj:stataj:v:7:y:2007:i:4:p:507-541
    as

    Download full text from publisher

    File URL: http://www.stata-journal.com/article.html?article=st0136
    Download Restriction: no

    File URL: http://www.stata-journal.com/software/sj7-4/st0136/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sandra E. Black, 1999. "Do Better Schools Matter? Parental Valuation of Elementary Education," The Quarterly Journal of Economics, Oxford University Press, vol. 114(2), pages 577-599.
    2. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    3. Roberto G. Gutierrez & Jean Marie Linhart & Jeffrey S. Pitblado, 2003. "From the help desk: Local polynomial regression and Stata plugins," Stata Journal, StataCorp LP, vol. 3(4), pages 412-419, December.
    4. Hall, Alastair R & Rudebusch, Glenn D & Wilcox, David W, 1996. "Judging Instrument Relevance in Instrumental Variables Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 37(2), pages 283-298, May.
    5. Steven Glazerman & Dan M. Levy & David Myers, "undated". "Nonexperimental Versus Experimental Estimates of Earnings Impacts," Mathematica Policy Research Reports 7c8bd68ac8db47caa57c70ee1, Mathematica Policy Research.
    6. Austin Nichols, 2006. "Weak Instruments: An Overview and New Techniques," North American Stata Users' Group Meetings 2006 3, Stata Users Group.
    7. Nelson, Charles R & Startz, Richard, 1990. "Some Further Results on the Exact Small Sample Properties of the Instrumental Variable Estimator," Econometrica, Econometric Society, vol. 58(4), pages 967-976, July.
    8. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    9. Sascha O. Becker & Marco Caliendo, 2007. "Sensitivity analysis for average treatment effects," Stata Journal, StataCorp LP, vol. 7(1), pages 71-83, February.
    10. Griliches, Zvi & Hausman, Jerry A., 1986. "Errors in variables in panel data," Journal of Econometrics, Elsevier, vol. 31(1), pages 93-118, February.
    11. Alberto Abadie & David Drukker & Jane Leber Herr & Guido W. Imbens, 2004. "Implementing matching estimators for average treatment effects in Stata," Stata Journal, StataCorp LP, vol. 4(3), pages 290-311, September.
    12. David S. Lee, 2001. "The Electoral Advantage to Incumbency and Voters' Valuation of Politicians' Experience: A Regression Discontinuity Analysis of Elections to the U.S..," NBER Working Papers 8441, National Bureau of Economic Research, Inc.
    13. Anna Mikusheva & Brian P. Poi, 2006. "Tests and confidence sets with correct size when instruments are potentially weak," Stata Journal, StataCorp LP, vol. 6(3), pages 335-347, September.
    14. Murray Leibbrandt & James Levinsohn & Justin McCrary, 2005. "Incomes in South Africa Since the Fall of Apartheid," NBER Working Papers 11384, National Bureau of Economic Research, Inc.
    15. Joao Pedro Azevedo, 2005. "DFL: Stata module to estimate DiNardo, Fortin and Lemieux Counterfactual Kernel Density," Statistical Software Components S449001, Boston College Department of Economics, revised 21 Dec 2010.
    16. John DiNardo & David S. Lee, 2002. "The Impact of Unionization on Establishment Closure: A Regression Discontinuity Analysis of Representation Elections," NBER Working Papers 8993, National Bureau of Economic Research, Inc.
    17. José Mata & José A. F. Machado, 2005. "Counterfactual decomposition of changes in wage distributions using quantile regression," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 445-465.
    18. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    19. Baker, Michael & Benjamin, Dwayne & Stanger, Shuchita, 1999. "The Highs and Lows of the Minimum Wage Effect: A Time-Series Cross-Section Study of the Canadian Law," Journal of Labor Economics, University of Chicago Press, vol. 17(2), pages 318-350, April.
    20. James W. Hardin & Henrik Schmeidiche & Raymond J. Carroll, 2003. "Instrumental variables, bootstrapping, and generalized linear models," Stata Journal, StataCorp LP, vol. 3(4), pages 351-360, December.
    21. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    22. Justin McCrary, 2007. "Manipulation of the Running Variable in the Regression Discontinuity Design: A Density Test," NBER Technical Working Papers 0334, National Bureau of Economic Research, Inc.
    23. David H. Autor & Lawrence F. Katz & Melissa S. Kearney, 2005. "Rising Wage Inequality: The Role of Composition and Prices," NBER Working Papers 11628, National Bureau of Economic Research, Inc.
    24. Kosuke Imai & David A. van Dyk, 2004. "Causal Inference With General Treatment Regimes: Generalizing the Propensity Score," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 854-866, January.
    25. repec:mpr:mprres:3694 is not listed on IDEAS
    26. Lee, David S. & Card, David, 2008. "Regression discontinuity inference with specification error," Journal of Econometrics, Elsevier, vol. 142(2), pages 655-674, February.
    27. Brian P. Poi, 2006. "Jackknife instrumental variables estimation in Stata," Stata Journal, StataCorp LP, vol. 6(3), pages 364-376, September.
    28. Sascha O. Becker & Andrea Ichino, 2002. "Estimation of average treatment effects based on propensity scores," Stata Journal, StataCorp LP, vol. 2(4), pages 358-377, November.
    29. Michael Spence, 1973. "Job Market Signaling," The Quarterly Journal of Economics, Oxford University Press, vol. 87(3), pages 355-374.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    3. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    4. Roberto ESPOSTI, 2014. "To match, not to match, how to match: Estimating the farm-level impact of the CAP-first pillar reform (or: How to Apply Treatment-Effect Econometrics when the Real World is;a Mess)," Working Papers 403, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    5. Esposti, Roberto, 2015. "To match, not to matchm how to match: Estimating the farm-level impact of the 2005 CAP-first pillar reform," 2015 Conference, August 9-14, 2015, Milan, Italy 211625, International Association of Agricultural Economists.
    6. Olivier Dagnelie & Philippe Lemay‐Boucher, 2012. "Rosca Participation in Benin: A Commitment Issue," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 235-252, April.
    7. Hirota, Haruaki & Yunoue, Hideo, 2017. "Evaluation of the fiscal effect on municipal mergers: Quasi-experimental evidence from Japanese municipal data," Regional Science and Urban Economics, Elsevier, vol. 66(C), pages 132-149.
    8. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    9. Candon, David, 2018. "The effect of cancer on the labor supply of employed men over the age of 65," Economics & Human Biology, Elsevier, vol. 31(C), pages 184-199.
    10. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    11. Hirota, Haruaki & Yunoue, Hideo, 2020. "Public investment and the fiscal common pool problem on municipal mergers in Japan," Economic Analysis and Policy, Elsevier, vol. 67(C), pages 124-135.
    12. Abbott, Joshua K. & Klaiber, H. Allen, 2011. "The Value Of Water As An Urban Club Good: A Matching Approach To Hoa-Provided Lakes," 2011 Annual Meeting, July 24-26, 2011, Pittsburgh, Pennsylvania 103781, Agricultural and Applied Economics Association.
    13. Simone Bertoli & Francesca Marchetta, 2014. "Migration, Remittances and Poverty in Ecuador," Journal of Development Studies, Taylor & Francis Journals, vol. 50(8), pages 1067-1089, August.
    14. repec:bla:afrdev:v:29:y:2017:i:s1:p:56-72 is not listed on IDEAS
    15. Johar, Meliyanni, 2009. "The impact of the Indonesian health card program: A matching estimator approach," Journal of Health Economics, Elsevier, vol. 28(1), pages 35-53, January.
    16. Van Butsic & David J. Lewis & Lindsay Ludwig, 2011. "An Econometric Analysis of Land Development with Endogenous Zoning," Land Economics, University of Wisconsin Press, vol. 87(3), pages 412-432.
    17. Abebaw, Degnet & Haile, Mekbib G., 2013. "The impact of cooperatives on agricultural technology adoption: Empirical evidence from Ethiopia," Food Policy, Elsevier, vol. 38(C), pages 82-91.
    18. Bruno Arpino & Arnstein Aassve, 2013. "Estimating the causal effect of fertility on economic wellbeing: data requirements, identifying assumptions and estimation methods," Empirical Economics, Springer, vol. 44(1), pages 355-385, February.
    19. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    20. Origo, Federica, 2009. "Flexible pay, firm performance and the role of unions. New evidence from Italy," Labour Economics, Elsevier, vol. 16(1), pages 64-78, January.
    21. Martin Binder & Alex Coad, 2013. "Life satisfaction and self-employment: a matching approach," Small Business Economics, Springer, vol. 40(4), pages 1009-1033, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tsj:stataj:v:7:y:2007:i:4:p:507-541. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.stata-journal.com/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum or Lisa Gilmore (email available below). General contact details of provider: http://www.stata-journal.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.