Misunderstandings between experimentalists and observationalists about causal inference
AbstractWe attempt to clarify, and suggest how to avoid, several serious misunderstandings about and fallacies of causal inference. These issues concern some of the most fundamental advantages and disadvantages of each basic research design. Problems include improper use of hypothesis tests for covariate balance between the treated and control groups, and the consequences of using randomization, blocking before randomization and matching after assignment of treatment to achieve covariate balance. Applied researchers in a wide range of scientific disciplines seem to fall prey to one or more of these fallacies and as a result make suboptimal design or analysis choices. To clarify these points, we derive a new four-part decomposition of the key estimation errors in making causal inferences. We then show how this decomposition can help scholars from different experimental and observational research traditions to understand better each other's inferential problems and attempted solutions. Copyright (c) 2008 Royal Statistical Society.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Royal Statistical Society in its journal Journal of the Royal Statistical Society: Series A (Statistics in Society).
Volume (Year): 171 (2008)
Issue (Month): 2 ()
Contact details of provider:
Postal: 12 Errol Street, London EC1Y 8LX, United Kingdom
Web page: http://wileyonlinelibrary.com/journal/rssa
More information through EDIRC
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Solomon Asfaw & Silvio Daidone & Benjamin Davis & Josh Dewbre & Alessandro Romeo & Paul Winters & Katia Covarrubias & Habiba Djebbari, 2012. "Analytical Framework for Evaluating the Productive Impact of Cash Transfer Programmes on Household Behaviour ? Methodological Guidelines for the From Protection to Production Project," Working Papers 101, International Policy Centre for Inclusive Growth.
- Simone BERTOLI & Francesca Marchetta, 2014.
"Migration, remittances and poverty in Ecuador,"
- Berta, P & Callea, G & Martini, G & Vittadini, G, 2009.
"The effects of upcoding, cream skimming and readmissions on the Italian hospitals efficiency: a population–based investigation,"
17671, University Library of Munich, Germany.
- Berta, Paolo & Callea, Giuditta & Martini, Gianmaria & Vittadini, Giorgio, 2010. "The effects of upcoding, cream skimming and readmissions on the Italian hospitals efficiency: A population-based investigation," Economic Modelling, Elsevier, vol. 27(4), pages 812-821, July.
- Luca Zanin & Rosalba Radice & Giampiero Marra, 2013. "Estimating the Effect of Perceived Risk of Crime on Social Trust in the Presence of Endogeneity Bias," Social Indicators Research, Springer, vol. 114(2), pages 523-547, November.
- Tiemann, Oliver & Schreyögg, Jonas, 2011.
"Changes in hospital efficiency after privatization,"
hche Research Papers
2011/02, Hamburg Center for Health Economics (hche), University of Hamburg.
- Oliver Tiemann & Jonas Schreyögg, 2012. "Changes in hospital efficiency after privatization," Health Care Management Science, Springer, vol. 15(4), pages 310-326, December.
- Tiemann, Oliver & Schreyögg, Jonas, 2011. "Changes in hospital efficiency after privatization," hche Research Papers 2011/02, Hamburg Center for Health Economics (hche), University of Hamburg.
- Reichert, A.;, 2013.
"Obesity, Weight Loss, and Employment Prospects: Evidence from a Randomized Trial,"
Health, Econometrics and Data Group (HEDG) Working Papers
13/20, HEDG, c/o Department of Economics, University of York.
- Arndt Reichert, 2012. "Obesity, Weight Loss, and Employment Prospects – Evidence from a Randomized Trial," Ruhr Economic Papers 0381, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
- Victoria Fan, Anup Karan, and Anjay Mahal, 2012. "State Health Insurance and Out-of-Pocket Health Expenditures in Andhra Pradesh, India - Working Paper 298," Working Papers 298, Center for Global Development.
- Victoria Fan & Anup Karan & Ajay Mahal, 2012.
"State Health Insurance and Out-of-Pocket Health Expenditures in Andhra Pradesh, India,"
- Victoria Fan & Anup Karan & Ajay Mahal, 2012. "State health insurance and out-of-pocket health expenditures in Andhra Pradesh, India," International Journal of Health Care Finance and Economics, Springer, vol. 12(3), pages 189-215, September.
- Daniel Ho & Kosuke Imai & Gary King & Elizabeth A. Stuart, . "MatchIt: Nonparametric Preprocessing for Parametric Causal Inference," Journal of Statistical Software, American Statistical Association, vol. 42(i08).
- Gomes, M; & Grieve, R;, 2011. "Estimating the Effects of Friendship Networks on Health Behaviors of Adolescents," Health, Econometrics and Data Group (HEDG) Working Papers 11/14, HEDG, c/o Department of Economics, University of York.
- Moreno-Serra R, . "Health Programme Evaluation by Propensity Score Matching: Accounting for Treatment Intensity and Health Externalities with an Application to Brazil," Health, Econometrics and Data Group (HEDG) Working Papers 09/05, HEDG, c/o Department of Economics, University of York.
- Bruhn, Miriam & McKenzie, David, 2008.
"In pursuit of balance : randomization in practice in development field experiments,"
Policy Research Working Paper Series
4752, The World Bank.
- Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
- Behncke S, 2009.
"How Does Retirement Affect Health?,"
Health, Econometrics and Data Group (HEDG) Working Papers
09/11, HEDG, c/o Department of Economics, University of York.
- Stefanie Behncke, 2009. "How Does Retirement Affect Health?," University of St. Gallen Department of Economics working paper series 2009 2009-13, Department of Economics, University of St. Gallen.
- Behncke, Stefanie, 2009. "How Does Retirement Affect Health?," IZA Discussion Papers 4253, Institute for the Study of Labor (IZA).
- Eliana V. Jimenez & Richard P.C. Brown, 2008. "Assessing the poverty impacts of remittances with alternative counterfactual income estimates," Discussion Papers Series 375, School of Economics, University of Queensland, Australia.
- Noah Buckley & Timothy Frye & Scott Gehlbach & Lauren McCarthy, 2012. "Cooperating with the State: Evidence from Survey Experiments on Policing in Mosscow," HSE Working papers WP BRP 09/PS/2012, National Research University Higher School of Economics.
- Bailey, Michael & Hopkins, Daniel J. & Rogers, Todd, 2013. "Unresponsive and Unpersuaded: The Unintended Consequences of Voter Persuasion Efforts," Working Paper Series rwp13-034, Harvard University, John F. Kennedy School of Government.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.