IDEAS home Printed from https://ideas.repec.org/p/fip/fedcwp/1310.html
   My bibliography  Save this paper

Covariates and causal effects: the problem of context

Author

Listed:
  • Dionissi Aliprantis

Abstract

This paper is concerned with understanding how causal effects can be identified in past data and then used to predict the future in light of the problem of context, or the fact that treatment always influences the outcome variable in combination with covariates. Structuralist and experimentalist views of econometric methodology can be reconciled by adopting notation capable of distinguishing between effects independent of and dependent on context, or direct and net effects. By showing that identification of direct and net effects imposes distinct assumptions on selection into covariates (i.e., exclusion restrictions) and explicitly constructing predictions based on past effects, the paper is able to characterize the tradeoff researchers face. Relative to direct effects, net effects can be identified in the past from more general data-generating processes (DGPs), but they can predict the future of less general DGPs. Predicting the future with either type of effect requires knowledge of direct effects. To highlight implications for applied work, I discuss why Local Average Treatment Effects and Marginal Treatment Effects of educational attainment are net effects and are therefore difficult to interpret, even when identified with a perfectly randomized treatment.

Suggested Citation

  • Dionissi Aliprantis, 2013. "Covariates and causal effects: the problem of context," Working Papers (Old Series) 1310, Federal Reserve Bank of Cleveland.
  • Handle: RePEc:fip:fedcwp:1310
    as

    Download full text from publisher

    File URL: https://www.clevelandfed.org/newsroom-and-events/publications/working-papers/2013-working-papers/wp-1310-covariates-and-caual-effects-the-problem-of-context.aspx
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Halbert White & Karim Chalak, 2013. "Identification and Identification Failure for Treatment Effects Using Structural Systems," Econometric Reviews, Taylor & Francis Journals, vol. 32(3), pages 273-317, November.
    2. Keane, Michael P., 2010. "Structural vs. atheoretic approaches to econometrics," Journal of Econometrics, Elsevier, vol. 156(1), pages 3-20, May.
    3. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    4. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    5. Pedro Carneiro & James J. Heckman & Edward Vytlacil, 2010. "Evaluating Marginal Policy Changes and the Average Effect of Treatment for Individuals at the Margin," Econometrica, Econometric Society, vol. 78(1), pages 377-394, January.
    6. Justin McCrary & Heather Royer, 2011. "The Effect of Female Education on Fertility and Infant Health: Evidence from School Entry Policies Using Exact Date of Birth," American Economic Review, American Economic Association, vol. 101(1), pages 158-195, February.
    7. Kincaid, Harold (ed.), 2012. "The Oxford Handbook of Philosophy of Social Science," OUP Catalogue, Oxford University Press, number 9780195392753, Decembrie.
    8. Nathaniel Baum-Snow & Ronni Pavan, 2013. "Inequality and City Size," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1535-1548, December.
    9. Sobel, Michael E., 2006. "What Do Randomized Studies of Housing Mobility Demonstrate?: Causal Inference in the Face of Interference," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1398-1407, December.
    10. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    11. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    12. Belzil, Christian, 2007. "The return to schooling in structural dynamic models: a survey," European Economic Review, Elsevier, vol. 51(5), pages 1059-1105, July.
    13. Kling, Jeffrey R, 2001. "Interpreting Instrumental Variables Estimates of the Returns to Schooling," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 358-364, July.
    14. Small, Dylan S & Rosenbaum, Paul R, 2008. "War and Wages," Journal of the American Statistical Association, American Statistical Association, vol. 103(483), pages 924-933.
    15. Dan Black & Natalia Kolesnikova & Lowell Taylor, 2009. "Earnings Functions When Wages and Prices Vary by Location," Journal of Labor Economics, University of Chicago Press, vol. 27(1), pages 21-47, January.
    16. Rashmi Barua & Kevin Lang, 2009. "School Entry, Educational Attainment and Quarter of Birth: A Cautionary Tale of LATE," NBER Working Papers 15236, National Bureau of Economic Research, Inc.
    17. Karim Chalak & Halbert White, 2008. "Causality, Conditional Independence, and Graphical Separation in Settable Systems," Boston College Working Papers in Economics 689, Boston College Department of Economics, revised 04 Jul 2010.
    18. Dionissi Aliprantis, 2012. "Redshirting, Compulsory Schooling Laws, and Educational Attainment," Journal of Educational and Behavioral Statistics, , vol. 37(2), pages 316-338, April.
    19. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.
    20. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    21. James J. Heckman & Lance J. Lochner & Petra E. Todd, 2008. "Earnings Functions and Rates of Return," Journal of Human Capital, University of Chicago Press, vol. 2(1), pages 1-31.
    22. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    23. Bruce Western & Jeffrey R. Kling & David F. Weiman, 2001. "The Labor Market Consequences of Incarceration," Working Papers 829, Princeton University, Department of Economics, Industrial Relations Section..
    24. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    25. Lance Lochner & Enrico Moretti, 2004. "The Effect of Education on Crime: Evidence from Prison Inmates, Arrests, and Self-Reports," American Economic Review, American Economic Association, vol. 94(1), pages 155-189, March.
    26. Brown, James N, 1989. "Why Do Wages Increase with Tenure? On-the-Job Training and Life-Cycle Wage Growth Observed within Firms," American Economic Review, American Economic Association, vol. 79(5), pages 971-991, December.
    27. James Heckman & Neil Hohmann & Jeffrey Smith & Michael Khoo, 2000. "Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(2), pages 651-694.
    28. Nagin, Daniel & Waldfogel, Joel, 1998. "The Effect of Conviction on Income Through the Life Cycle," International Review of Law and Economics, Elsevier, vol. 18(1), pages 25-40, March.
    29. Scott E. Carrell & Bruce I. Sacerdote & James E. West, 2013. "From Natural Variation to Optimal Policy? The Importance of Endogenous Peer Group Formation," Econometrica, Econometric Society, vol. 81(3), pages 855-882, May.
    30. Brock, William A. & Durlauf, Steven N., 2007. "Identification of binary choice models with social interactions," Journal of Econometrics, Elsevier, vol. 140(1), pages 52-75, September.
    31. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    32. Layard, Richard & Psacharopoulos, George, 1974. "The Screening Hypothesis and the Returns to Education," Journal of Political Economy, University of Chicago Press, vol. 82(5), pages 985-998, Sept./Oct.
    33. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    34. Wolpin, Kenneth I, 1977. "Education and Screening," American Economic Review, American Economic Association, vol. 67(5), pages 949-958, December.
    35. Dionissi Aliprantis, 2011. "Assessing the evidence on neighborhood effects from moving to opportunity," Working Papers (Old Series) 1101, Federal Reserve Bank of Cleveland.
    36. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    37. Light, Audrey, 2001. "In-School Work Experience and the Returns to Schooling," Journal of Labor Economics, University of Chicago Press, vol. 19(1), pages 65-93, January.
    38. Meer, Jonathan, 2007. "Evidence on the returns to secondary vocational education," Economics of Education Review, Elsevier, vol. 26(5), pages 559-573, October.
    39. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    40. Wooldridge, Jeffrey M., 2005. "Violating Ignorability Of Treatment By Controlling For Too Many Factors," Econometric Theory, Cambridge University Press, vol. 21(5), pages 1026-1028, October.
    41. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 473-522, June.
    42. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    43. Brian A. Jacob & Lars Lefgren, 2003. "Are Idle Hands the Devil's Workshop? Incapacitation, Concentration, and Juvenile Crime," American Economic Review, American Economic Association, vol. 93(5), pages 1560-1577, December.
    44. Jeffrey R. Kling, 2006. "Incarceration Length, Employment, and Earnings," American Economic Review, American Economic Association, vol. 96(3), pages 863-876, June.
    45. Dora L. Costa & Matthew E. Kahn, 2000. "Power Couples: Changes in the Locational Choice of the College Educated, 1940–1990," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(4), pages 1287-1315.
    46. Bishop, John H. & Mane, Ferran, 2004. "The impacts of career-technical education on high school labor market success," Economics of Education Review, Elsevier, vol. 23(4), pages 381-402, August.
    47. Helena Skyt Nielsen & Michael Svarer, 2009. "Educational Homogamy: How Much is Opportunities?," Journal of Human Resources, University of Wisconsin Press, vol. 44(4).
    48. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    49. Jeffrey R. Kling & David Weiman & Bruce Western, 2001. "The Labor Market Consequences of Incarceration," Working Papers 829, Princeton University, Department of Economics, Industrial Relations Section..
    50. Heckman, James J, 1996. "Randomization as an Instrumental Variable: Notes," The Review of Economics and Statistics, MIT Press, vol. 78(2), pages 336-341, May.
    51. Card, David, 2001. "Estimating the Return to Schooling: Progress on Some Persistent Econometric Problems," Econometrica, Econometric Society, vol. 69(5), pages 1127-1160, September.
    52. James Heckman, 1997. "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 441-462.
    53. Joshua Angrist & Ivan Fernandez-Val, 2010. "ExtrapoLATE-ing: External Validity and Overidentification in the LATE Framework," NBER Working Papers 16566, National Bureau of Economic Research, Inc.
    54. Karim Chalak & Halbert White, 2007. "An Extended Class of Instrumental Variables for the Estimation of Causal Effects," Boston College Working Papers in Economics 692, Boston College Department of Economics, revised 30 Nov 2009.
    55. Edward E. Leamer, 2010. "Tantalus on the Road to Asymptopia," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 31-46, Spring.
    56. Barton H. Hamilton, 2000. "Does Entrepreneurship Pay? An Empirical Analysis of the Returns to Self-Employment," Journal of Political Economy, University of Chicago Press, vol. 108(3), pages 604-631, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dionissi Aliprantis, 2011. "Assessing the evidence on neighborhood effects from moving to opportunity," Working Papers (Old Series) 1101, Federal Reserve Bank of Cleveland.
    2. Eva Deuchert & Martin Huber, 2017. "A Cautionary Tale About Control Variables in IV Estimation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(3), pages 411-425, June.
    3. Dionissi Aliprantis, 2014. "What Is the Equity-Efficiency Tradeoff when Maintaining Wells in Rural Haiti?," Working Papers (Old Series) 1424, Federal Reserve Bank of Cleveland.
    4. Dionissi Aliprantis, 2017. "Assessing the evidence on neighborhood effects from Moving to Opportunity," Empirical Economics, Springer, vol. 52(3), pages 925-954, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Dionissi Aliprantis, 2017. "Human capital in the inner city," Empirical Economics, Springer, vol. 53(3), pages 1125-1169, November.
    4. Dionissi Aliprantis, 2011. "Assessing the evidence on neighborhood effects from moving to opportunity," Working Papers (Old Series) 1101, Federal Reserve Bank of Cleveland.
    5. Dionissi Aliprantis, 2012. "Redshirting, Compulsory Schooling Laws, and Educational Attainment," Journal of Educational and Behavioral Statistics, , vol. 37(2), pages 316-338, April.
    6. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    7. Cornelissen, Thomas & Dustmann, Christian & Raute, Anna & Schönberg, Uta, 2016. "From LATE to MTE: Alternative methods for the evaluation of policy interventions," Labour Economics, Elsevier, vol. 41(C), pages 47-60.
    8. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    9. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    10. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
    11. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    12. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    13. Karim Chalak & Halbert White, 2011. "Viewpoint: An extended class of instrumental variables for the estimation of causal effects," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 44(1), pages 1-51, February.
    14. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory, 2016. "Dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 191(2), pages 276-292.
    15. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    16. Karim Chalak & Halbert White, 2007. "An Extended Class of Instrumental Variables for the Estimation of Causal Effects," Boston College Working Papers in Economics 692, Boston College Department of Economics, revised 30 Nov 2009.
    17. Hunt Allcott, 2012. "Site Selection Bias in Program Evaluation," NBER Working Papers 18373, National Bureau of Economic Research, Inc.
    18. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    19. Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
    20. Qin, Duo, 2014. "Resurgence of instrument variable estimation and fallacy of endogeneity," Economics Discussion Papers 2014-42, Kiel Institute for the World Economy (IfW Kiel).

    More about this item

    Keywords

    Statistical methods; Econometric models;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedcwp:1310. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: 4D Library (email available below). General contact details of provider: https://edirc.repec.org/data/frbclus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.