IDEAS home Printed from https://ideas.repec.org/p/ecl/harjfk/15-064.html
   My bibliography  Save this paper

Explaining Causal Findings without Bias: Detecting and Assessing Direct Effects

Author

Listed:
  • Acharya, Avidit

    (Stanford University)

  • Blackwell, Matthew

    (Harvard University)

  • Sen, Maya

    (Harvard University)

Abstract

Researchers seeking to establish causal relationships frequently control for variables on the purported causal pathway, checking whether the original treatment effect then disappears. Unfortunately, this common approach may lead to biased estimates. In this paper, we show that the bias can be avoided by focusing on a quantity of interest called the controlled direct effect. Under certain conditions, the controlled direct effect enables researchers to rule out competing explanations-an important objective for political scientists. To estimate the controlled direct effect without bias, we describe an easy-to- implement estimation strategy from the biostatistics literature. We extend this approach by deriving a consistent variance estimator and demonstrating how to conduct a sensitivity analysis. Two examples-one on ethnic fractionalization's effect on civil war and one on the impact of historical plough use on contemporary female political participation-illustrate the framework and methodology.

Suggested Citation

  • Acharya, Avidit & Blackwell, Matthew & Sen, Maya, 2015. "Explaining Causal Findings without Bias: Detecting and Assessing Direct Effects," Working Paper Series 15-064, Harvard University, John F. Kennedy School of Government.
  • Handle: RePEc:ecl:harjfk:15-064
    as

    Download full text from publisher

    File URL: https://research.hks.harvard.edu/publications/getFile.aspx?Id=1271
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Imai, Kosuke & Keele, Luke & Tingley, Dustin & Yamamoto, Teppei, 2011. "Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies," American Political Science Review, Cambridge University Press, vol. 105(4), pages 765-789, November.
    2. Alberto Alesina & Paola Giuliano & Nathan Nunn, 2013. "On the Origins of Gender Roles: Women and the Plough," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 469-530.
    3. Tyler J. Vanderweele, 2011. "Controlled Direct and Mediated Effects: Definition, Identification and Bounds," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 38(3), pages 551-563, September.
    4. Nathan Nunn & Leonard Wantchekon, 2011. "The Slave Trade and the Origins of Mistrust in Africa," American Economic Review, American Economic Association, vol. 101(7), pages 3221-3252, December.
    5. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    6. Imai, Kosuke & Yamamoto, Teppei, 2013. "Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments," Political Analysis, Cambridge University Press, vol. 21(2), pages 141-171, April.
    7. Stijn Vansteelandt, 2010. "Estimation of controlled direct effects on a dichotomous outcome using logistic structural direct effect models," Biometrika, Biometrika Trust, vol. 97(4), pages 921-934.
    8. Marshall M. Joffe & Tom Greene, 2009. "Related Causal Frameworks for Surrogate Outcomes," Biometrics, The International Biometric Society, vol. 65(2), pages 530-538, June.
    9. Blackwell, Matthew, 2014. "A Selection Bias Approach to Sensitivity Analysis for Causal Effects," Political Analysis, Cambridge University Press, vol. 22(2), pages 169-182, April.
    10. Kosuke Imai & Dustin Tingley & Teppei Yamamoto, 2013. "Experimental designs for identifying causal mechanisms," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 5-51, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tingley, Dustin & Yamamoto, Teppei & Hirose, Kentaro & Keele, Luke & Imai, Kosuke, 2014. "mediation: R Package for Causal Mediation Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 59(i05).
    2. Nicholas Weller & Jeb Barnes, 2016. "Pathway Analysis and the Search for Causal Mechanisms," Sociological Methods & Research, , vol. 45(3), pages 424-457, August.
    3. Carpena, Fenella & Zia, Bilal, 2020. "The causal mechanism of financial education: Evidence from mediation analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 177(C), pages 143-184.
    4. Wahl, Fabian, 2016. "Does medieval trade still matter? Historical trade centers, agglomeration and contemporary economic development," Regional Science and Urban Economics, Elsevier, vol. 60(C), pages 50-60.
    5. Adam C. Sales, 2017. "Review," Journal of Educational and Behavioral Statistics, , vol. 42(1), pages 69-84, February.
    6. Wunsch, Conny & Strobl, Renate, 2018. "Identification of causal mechanisms based on between-subject double randomization designs," CEPR Discussion Papers 13028, C.E.P.R. Discussion Papers.
    7. Manabu Kuroki, 2016. "The Identification of Direct and Indirect Effects in Studies with an Unmeasured Intermediate Variable," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 228-245, March.
    8. Ward, Jeffrey T. & Hartley, Richard D. & Tillyer, Rob, 2016. "Unpacking gender and racial/ethnic biases in the federal sentencing of drug offenders: A causal mediation approach," Journal of Criminal Justice, Elsevier, vol. 46(C), pages 196-206.
    9. Gay, Victor & Boehnke, Jörn, 2017. "The Missing Men: World War I and Female Labor Participation," MPRA Paper 77560, University Library of Munich, Germany.
    10. Martin Huber, 2015. "Causal Pitfalls in the Decomposition of Wage Gaps," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 179-191, April.
    11. Viviana Celli, 2019. "Causal Mediation Analysis in Economics: objectives, assumptions, models," Working Papers 12/19, Sapienza University of Rome, DISS.
    12. Viviana Celli, 2022. "Causal mediation analysis in economics: Objectives, assumptions, models," Journal of Economic Surveys, Wiley Blackwell, vol. 36(1), pages 214-234, February.
    13. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2016. "Long-Term Persistence," Journal of the European Economic Association, European Economic Association, vol. 14(6), pages 1401-1436, December.
    14. La Ferrara, Eliana & Corno, Lucia & Voena, Alessandra, 2020. "Female Genital Cutting and the Slave Trade," CEPR Discussion Papers 15577, C.E.P.R. Discussion Papers.
    15. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2015. "Corporate Culture, Societal Culture, and Institutions," American Economic Review, American Economic Association, vol. 105(5), pages 336-339, May.
    16. Parker Hevron, 2018. "Judicialization and Its Effects: Experiments as a Way Forward," Laws, MDPI, vol. 7(2), pages 1-21, May.
    17. Sara Lowes & Etienne Le Rossignol, 2022. "Ancestral Livelihoods and Moral Universalism: Evidence from Transhumant Pastoralist Societies," Working Papers hal-04083412, HAL.
    18. Stelios Michalopoulos & Elias Papaioannou, 2016. "The Long-Run Effects of the Scramble for Africa," American Economic Review, American Economic Association, vol. 106(7), pages 1802-1848, July.
    19. Verdier, Thierry & Bisin, Alberto, 2017. "On the Joint Evolution of Culture and Institutions," CEPR Discussion Papers 12000, C.E.P.R. Discussion Papers.
    20. James B. Ang, 2015. "Agricultural Legacy, Individualistic Culture, and Techology Adoption," Economic Growth Centre Working Paper Series 1506, Nanyang Technological University, School of Social Sciences, Economic Growth Centre.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecl:harjfk:15-064. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/ksharus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.