IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v20y2009i2p295-313.html
   My bibliography  Save this article

From Association to Causation via a Potential Outcomes Approach

Author

Listed:
  • Sunil Mithas

    (Robert H. Smith School of Business, University of Maryland, College Park, Maryland 20742)

  • M. S. Krishnan

    (Ross School of Business, University of Michigan, Ann Arbor, Michigan 48109)

Abstract

Despite the importance of causal analysis in building a valid knowledge base and in answering managerial questions, the issue of causality rarely receives the attention it deserves in information systems (IS) and management research that uses observational data. In this paper, we discuss a potential outcomes framework for estimating causal effects and illustrate the application of the framework in the context of a phenomenon that is also of substantive interest to IS researchers. We use a matching technique based on propensity scores to estimate the causal effect of an MBA on information technology (IT) professionals' salary in the United States. We demonstrate the utility of this counterfactual or potential outcomes--based framework in providing an estimate of the sensitivity of the estimated causal effects because of selection on unobservables. We also discuss issues related to the heterogeneity of treatment effects that typically do not receive as much attention in alternative methods of estimation, and show how the potential outcomes approach can provide several new insights into who benefits the most from the interventions and treatments that are likely to be of interest to IS researchers. We discuss the usefulness of the matching technique in IS and management research and provide directions to move from establishing association to assessing causation.

Suggested Citation

  • Sunil Mithas & M. S. Krishnan, 2009. "From Association to Causation via a Potential Outcomes Approach," Information Systems Research, INFORMS, vol. 20(2), pages 295-313, June.
  • Handle: RePEc:inm:orisre:v:20:y:2009:i:2:p:295-313
    DOI: 10.1287/isre.1080.0184
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.1080.0184
    Download Restriction: no

    File URL: https://libkey.io/10.1287/isre.1080.0184?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gautam Ray & Jay B. Barney & Waleed A. Muhanna, 2004. "Capabilities, business processes, and competitive advantage: choosing the dependent variable in empirical tests of the resource‐based view," Strategic Management Journal, Wiley Blackwell, vol. 25(1), pages 23-37, January.
    2. Natalia Levina & Mingdi Xin, 2007. "Research Note---Comparing IT Workers’ Compensation Across Country Contexts: Demographic, Human Capital, and Institutional Factors," Information Systems Research, INFORMS, vol. 18(2), pages 193-210, June.
    3. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    4. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    5. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    6. Sunil Mithas & M. S. Krishnan, 2008. "Human Capital and Institutional Effects in the Compensation of Information Technology Professionals in the United States," Management Science, INFORMS, vol. 54(3), pages 415-428, March.
    7. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    8. Heckman, James J, 1978. "Dummy Endogenous Variables in a Simultaneous Equation System," Econometrica, Econometric Society, vol. 46(4), pages 931-959, July.
    9. Thomas W. Ferratt & Ritu Agarwal & Carol V. Brown & Jo Ellen Moore, 2005. "IT Human Resource Management Configurations and IT Turnover: Theoretical Synthesis and Empirical Analysis," Information Systems Research, INFORMS, vol. 16(3), pages 237-255, September.
    10. O. Ashenfelter & D. Card (ed.), 1999. "Handbook of Labor Economics," Handbook of Labor Economics, Elsevier, edition 1, volume 3, number 3.
    11. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    12. John DiNardo & David S. Lee, 2004. "Economic Impacts of Unionization on Private Sector Employers: 1984-2001," NBER Working Papers 10598, National Bureau of Economic Research, Inc.
    13. Pratt, John W. & Schlaifer, Robert, 1988. "On the interpretation and observation of laws," Journal of Econometrics, Elsevier, vol. 39(1-2), pages 23-52.
    14. Dehejia, Rajeev, 2005. "Practical propensity score matching: a reply to Smith and Todd," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 355-364.
    15. Donald B. Rubin, 2005. "Causal Inference Using Potential Outcomes: Design, Modeling, Decisions," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 322-331, March.
    16. John DiNardo & David S. Lee, 2004. "Economic Impacts of New Unionization on Private Sector Employers: 1984–2001," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(4), pages 1383-1441.
    17. Kosuke Imai & David A. van Dyk, 2004. "Causal Inference With General Treatment Regimes: Generalizing the Propensity Score," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 854-866, January.
    18. Elizabeth U. Cascio & Ethan G. Lewis, 2006. "Schooling and the Armed Forces Qualifying Test: Evidence from School-Entry Laws," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    19. Soon Ang & Sandra Slaughter & Kok Yee Ng, 2002. "Human Capital and Institutional Determinants of Information Technology Compensation: Modeling Multilevel and Cross-Level Interactions," Management Science, INFORMS, vol. 48(11), pages 1427-1445, November.
    20. John E. DiNardo & Jörn-Steffen Pischke, 1997. "The Returns to Computer Use Revisited: Have Pencils Changed the Wage Structure Too?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(1), pages 291-303.
    21. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    22. James J. Heckman, 2000. "Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 45-97.
    23. Derek C. Briggs, 2004. "Causal Inference and the Heckman Model," Journal of Educational and Behavioral Statistics, , vol. 29(4), pages 397-420, December.
    24. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    25. James Heckman, 1997. "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 441-462.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Flores, Carlos A. & Mitnik, Oscar A., 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," IZA Discussion Papers 4451, Institute of Labor Economics (IZA).
    3. Stephen L. Morgan & David J. Harding, 2006. "Matching Estimators of Causal Effects," Sociological Methods & Research, , vol. 35(1), pages 3-60, August.
    4. Dettmann, Eva & Becker, Claudia & Schmeißer, Christian, 2010. "Is there a Superior Distance Function for Matching in Small Samples?," IWH Discussion Papers 3/2010, Halle Institute for Economic Research (IWH).
    5. Jochen Kluve & Boris Augurzky, 2007. "Assessing the performance of matching algorithms when selection into treatment is strong," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(3), pages 533-557.
    6. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    7. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    8. Steven Lehrer & Gregory Kordas, 2013. "Matching using semiparametric propensity scores," Empirical Economics, Springer, vol. 44(1), pages 13-45, February.
    9. Jose C. Galdo & Jeffrey Smith & Dan Black, 2008. "Bandwidth Selection and the Estimation of Treatment Effects with Unbalanced Data," Annals of Economics and Statistics, GENES, issue 91-92, pages 189-216.
    10. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    11. Alberto Abadie & Guido W. Imbens, 2002. "Simple and Bias-Corrected Matching Estimators for Average Treatment Effects," NBER Technical Working Papers 0283, National Bureau of Economic Research, Inc.
    12. Chambers, Jeff M. & Lint, Sandy & Thompson, Maggie G. & Carlson, Matthew W. & Graef, Michelle I., 2019. "Outcomes of the Iowa Parent Partner program evaluation: Stability of reunification and re-entry into foster care," Children and Youth Services Review, Elsevier, vol. 104(C), pages 1-1.
    13. Chad D. Meyerhoefer & Muzhe Yang, 2011. "The Relationship between Food Assistance and Health: A Review of the Literature and Empirical Strategies for Identifying Program Effects," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 33(3), pages 304-344.
    14. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    15. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    16. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    17. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    18. Begoña Cueto & F. Mato, 2009. "A nonexperimental evaluation of training programmes: regional evidence for Spain," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 43(2), pages 415-433, June.
    19. Jose Rosero, 2012. "On the Effectiveness of Child Care Centers in Promoting Child Development in Ecuador," Tinbergen Institute Discussion Papers 12-075/3, Tinbergen Institute.
    20. James J. Heckman, 2005. "Micro Data, Heterogeneity and the Evaluation of Public Policy Part 2," The American Economist, Sage Publications, vol. 49(1), pages 16-44, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:20:y:2009:i:2:p:295-313. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.