IDEAS home Printed from https://ideas.repec.org/a/wly/amposc/v54y2010i2p543-560.html
   My bibliography  Save this article

Causal Inference with Differential Measurement Error: Nonparametric Identification and Sensitivity Analysis

Author

Listed:
  • Kosuke Imai
  • Teppei Yamamoto

Abstract

Political scientists have long been concerned about the validity of survey measurements. Although many have studied classical measurement error in linear regression models where the error is assumed to arise completely at random, in a number of situations the error may be correlated with the outcome. We analyze the impact of differential measurement error on causal estimation. The proposed nonparametric identification analysis avoids arbitrary modeling decisions and formally characterizes the roles of different assumptions. We show the serious consequences of differential misclassification and offer a new sensitivity analysis that allows researchers to evaluate the robustness of their conclusions. Our methods are motivated by a field experiment on democratic deliberations, in which one set of estimates potentially suffers from differential misclassification. We show that an analysis ignoring differential measurement error may considerably overestimate the causal effects. This finding contrasts with the case of classical measurement error, which always yields attenuation bias.

Suggested Citation

  • Kosuke Imai & Teppei Yamamoto, 2010. "Causal Inference with Differential Measurement Error: Nonparametric Identification and Sensitivity Analysis," American Journal of Political Science, John Wiley & Sons, vol. 54(2), pages 543-560, April.
  • Handle: RePEc:wly:amposc:v:54:y:2010:i:2:p:543-560
    DOI: 10.1111/j.1540-5907.2010.00446.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1540-5907.2010.00446.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1540-5907.2010.00446.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Aigner, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," Journal of Econometrics, Elsevier, vol. 1(1), pages 49-59, March.
    2. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    3. Valentino, Nicholas A. & Hutchings, Vincent L. & White, Ismail K., 2002. "Cues that Matter: How Political Ads Prime Racial Attitudes During Campaigns," American Political Science Review, Cambridge University Press, vol. 96(1), pages 75-90, March.
    4. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    5. Ashworth, Scott & Clinton, Joshua D. & Meirowitz, Adam & Ramsay, Kristopher W., 2008. "Design, Inference, and the Strategic Logic of Suicide Terrorism," American Political Science Review, Cambridge University Press, vol. 102(2), pages 269-273, May.
    6. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, September.
    7. Bollinger, Christopher R., 1996. "Bounding mean regressions when a binary regressor is mismeasured," Journal of Econometrics, Elsevier, vol. 73(2), pages 387-399, August.
    8. Hausman, Jerry A. & Newey, Whitney K. & Ichimura, Hidehiko & Powell, James L., 1991. "Identification and estimation of polynomial errors-in-variables models," Journal of Econometrics, Elsevier, vol. 50(3), pages 273-295, December.
    9. Druckman, James N. & Green, Donald P. & Kuklinski, James H. & Lupia, Arthur, 2006. "The Growth and Development of Experimental Research in Political Science," American Political Science Review, Cambridge University Press, vol. 100(4), pages 627-635, November.
    10. Mondak, Jeffery J., 1999. "Reconsidering the Measurement of Political Knowledge," Political Analysis, Cambridge University Press, vol. 8(1), pages 57-82, January.
    11. Imai, Kosuke, 2008. "Sharp bounds on the causal effects in randomized experiments with "truncation-by-death"," Statistics & Probability Letters, Elsevier, vol. 78(2), pages 144-149, February.
    12. AIGNER, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," LIDAM Reprints CORE 130, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    13. Bartels, Larry M., 1993. "Messages Received: The Political Impact of Media Exposure," American Political Science Review, Cambridge University Press, vol. 87(2), pages 267-285, June.
    14. Aprajit Mahajan, 2006. "Identification and Estimation of Regression Models with Misclassification," Econometrica, Econometric Society, vol. 74(3), pages 631-665, May.
    15. Imai, Kosuke & Soneji, Samir, 2007. "On the Estimation of Disability-Free Life Expectancy: Sullivan's Method and Its Extension," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1199-1211, December.
    16. Yusaku Horiuchi & Kosuke Imai & Naoko Taniguchi, 2007. "Designing and Analyzing Randomized Experiments: Application to a Japanese Election Survey Experiment," American Journal of Political Science, John Wiley & Sons, vol. 51(3), pages 669-687, July.
    17. Raymond J. Carroll & David Ruppert & Ciprian M. Crainiceanu & Tor D. Tosteson & Margaret R. Karagas, 2004. "Nonlinear and Nonparametric Regression and Instrumental Variables," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 736-750, January.
    18. Achen, Christopher H., 1975. "Mass Political Attitudes and the Survey Response," American Political Science Review, Cambridge University Press, vol. 69(4), pages 1218-1231, December.
    19. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    20. Klepper, Steven, 1988. "Bounding the effects of measurement error in regressions involving dichotomous variables," Journal of Econometrics, Elsevier, vol. 37(3), pages 343-359, March.
    21. Macartan Humphreys & William Masters & Martin Sandbu, 2006. "The role of leadership in democratic deliberations: Results from a field experiment in sao tome and principe," Natural Field Experiments 00303, The Field Experiments Website.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matthew Blackwell & James Honaker & Gary King, 2017. "A Unified Approach to Measurement Error and Missing Data: Overview and Applications," Sociological Methods & Research, , vol. 46(3), pages 303-341, August.
    2. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    3. Devin Caughey & Sara Chatfield, 2020. "Causal inference and American political development: contrasts and complementarities," Public Choice, Springer, vol. 185(3), pages 359-376, December.
    4. Christina L. Boyd & Lee Epstein & Andrew D. Martin, 2010. "Untangling the Causal Effects of Sex on Judging," American Journal of Political Science, John Wiley & Sons, vol. 54(2), pages 389-411, April.
    5. Elsayed, Mahmoud A.A., 2016. "The Impact of Education Tax Benefits on College Completion," Economics of Education Review, Elsevier, vol. 53(C), pages 16-30.
    6. Millimet, Daniel L. & Parmeter, Christopher F., 2022. "Accounting for Skewed or One-Sided Measurement Error in the Dependent Variable," Political Analysis, Cambridge University Press, vol. 30(1), pages 66-88, January.
    7. Takahide Yanagi, 2019. "Inference on local average treatment effects for misclassified treatment," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 938-960, September.
    8. Di Shu & Grace Y. Yi, 2018. "Estimation of Causal Effect Measures in the Presence of Measurement Error in Confounders," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 10(1), pages 233-254, April.
    9. Zhang, Han, 2021. "How Using Machine Learning Classification as a Variable in Regression Leads to Attenuation Bias and What to Do About It," SocArXiv 453jk, Center for Open Science.
    10. Kosuke Imai & Zhichao Jiang, 2020. "Identification and sensitivity analysis of contagion effects in randomized placebo‐controlled trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1637-1657, October.
    11. Santiago Acerenza, 2021. "Partial Identification of Marginal Treatment Effects with discrete instruments and misreported treatment," Papers 2110.06285, arXiv.org, revised Mar 2023.
    12. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    2. Hu, Yingyao, 2008. "Identification and estimation of nonlinear models with misclassification error using instrumental variables: A general solution," Journal of Econometrics, Elsevier, vol. 144(1), pages 27-61, May.
    3. Takahide Yanagi, 2019. "Inference on local average treatment effects for misclassified treatment," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 938-960, September.
    4. Chen, Xiaohong & Hu, Yingyao & Lewbel, Arthur, 2008. "A note on the closed-form identification of regression models with a mismeasured binary regressor," Statistics & Probability Letters, Elsevier, vol. 78(12), pages 1473-1479, September.
    5. Steven J. Haider & Melvin Stephens Jr., 2020. "Correcting for Misclassified Binary Regressors Using Instrumental Variables," NBER Working Papers 27797, National Bureau of Economic Research, Inc.
    6. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    7. Acerenza, Santiago & Ban, Kyunghoon & Kedagni, Desire, 2021. "Marginal Treatment Effects with Misclassified Treatment," ISU General Staff Papers 202106180700001132, Iowa State University, Department of Economics.
    8. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    9. Violeta Misheva & Dinand Webbink & Nicholas G. Martin, 2017. "The effect of child maltreatment on illegal and problematic behaviour: new evidence on the ‘cycle of violence’ using twins data," Journal of Population Economics, Springer;European Society for Population Economics, vol. 30(4), pages 1035-1067, October.
    10. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).
    11. Erich Battistin & Barbara Sianesi, 2006. "Misreported schooling and returns to education: evidence from the UK," CeMMAP working papers CWP07/06, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    12. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature," PIER Working Paper Archive 15-037, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 02 Nov 2015.
    13. Denni Tommasi & Arthur Lewbel & Rossella Calvi, 2017. "LATE with Mismeasured or Misspecified Treatment: An application to Women's Empowerment in India," Working Papers ECARES ECARES 2017-27, ULB -- Universite Libre de Bruxelles.
    14. Molinari, Francesca, 2008. "Partial identification of probability distributions with misclassified data," Journal of Econometrics, Elsevier, vol. 144(1), pages 81-117, May.
    15. Seoyun Hong & Chang Sik Kim & Hyunchul Kim, 2022. "Measuring the Effects of Bid-Rigging on Prices with Binary Misclassification," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 61(3), pages 319-339, November.
    16. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Second Version," PIER Working Paper Archive 15-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 11 Nov 2015.
    17. Akanksha Negi & Digvijay Singh Negi, 2022. "Difference-in-Differences with a Misclassified Treatment," Papers 2208.02412, arXiv.org.
    18. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Third Version," PIER Working Paper Archive 15-040, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 24 Nov 2015.
    19. Francis J. DiTraglia & Camilo Garcia-Jimeno, 2020. "Identifying the effect of a mis-classified, binary, endogenous regressor," Papers 2011.07272, arXiv.org.
    20. Adele Bergin, 2015. "Employer Changes and Wage Changes: Estimation with Measurement Error in a Binary Variable," LABOUR, CEIS, vol. 29(2), pages 194-223, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:amposc:v:54:y:2010:i:2:p:543-560. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1540-5907 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.