IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22621.html
   My bibliography  Save this paper

A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models

Author

Listed:
  • Francis DiTraglia
  • Camilo García-Jimeno

Abstract

To estimate causal effects from observational data, an applied researcher must impose beliefs. The instrumental variables exclusion restriction, for example, represents the belief that the instrument has no direct effect on the outcome of interest. Yet beliefs about instrument validity do not exist in isolation. Applied researchers often discuss the likely direction of selection and the potential for measurement error in their papers but at present lack formal tools for incorporating this information into their analyses. As such they not only leave money on the table, by failing to use all relevant information, but more importantly run the risk of reasoning to a contradiction by expressing mutually incompatible beliefs. In this paper we characterize the sharp identified set relating instrument invalidity, treatment endogeneity, and measurement error in a workhorse linear model, showing how beliefs over these three dimensions are mutually constrained. We consider two cases: in the first the treatment is continuous and subject to classical measurement error; in the second it is binary and subject to non-differential measurement error. In each, we propose a formal Bayesian framework to help researchers elicit their beliefs, incorporate them into estimation, and ensure their mutual coherence. We conclude by illustrating the usefulness of our proposed methods on a variety of examples from the empirical microeconomics literature.

Suggested Citation

  • Francis DiTraglia & Camilo García-Jimeno, 2016. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models," NBER Working Papers 22621, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22621
    Note: DEV EH LS PE POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22621.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sascha O. Becker & Ludger Woessmann, 2009. "Was Weber Wrong? A Human Capital Theory of Protestant Economic History," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 531-596.
    2. Aviv Nevo & Adam M. Rosen, 2012. "Identification With Imperfect Instruments," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 659-671, August.
    3. Jonas E. Arias & Juan Rubio-Ramirez & Daniel F. Waggoner, 2013. "Inference Based on SVARs Identied with Sign and Zero Restrictions: Theory and Applications," Working Papers 2013-24, FEDEA.
    4. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.
    5. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    6. Thomas J. Kane & Cecilia Elena Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," NBER Working Papers 7235, National Bureau of Economic Research, Inc.
    7. Pooyan Amir-Ahmadi & Thorsten Drautzburg, 2017. "Identification Through Heterogeneity," Working Papers 17-11, Federal Reserve Bank of Philadelphia.
    8. Chou, Shin-Yi & Grossman, Michael & Saffer, Henry, 2004. "An economic analysis of adult obesity: results from the Behavioral Risk Factor Surveillance System," Journal of Health Economics, Elsevier, vol. 23(3), pages 565-587, May.
    9. Chou, Shin-Yi & Grossman, Michael & Saffer, Henry, 2006. "Reply to Jonathan Gruber and Michael Frakes," Journal of Health Economics, Elsevier, vol. 25(2), pages 389-393, March.
    10. Bollinger, Christopher R., 1996. "Bounding mean regressions when a binary regressor is mismeasured," Journal of Econometrics, Elsevier, vol. 73(2), pages 387-399, August.
    11. Hu, Yingyao, 2008. "Identification and estimation of nonlinear models with misclassification error using instrumental variables: A general solution," Journal of Econometrics, Elsevier, vol. 144(1), pages 27-61, May.
    12. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    13. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    14. Christiane Baumeister & James D. Hamilton, 2015. "Sign Restrictions, Structural Vector Autoregressions, and Useful Prior Information," Econometrica, Econometric Society, vol. 83(5), pages 1963-1999, September.
    15. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    16. Hyungsik Roger Moon & Frank Schorfheide, 2012. "Bayesian and Frequentist Inference in Partially Identified Models," Econometrica, Econometric Society, vol. 80(2), pages 755-782, March.
    17. Stacy Berg Dale & Alan B. Krueger, 2002. "Estimating the Payoff to Attending a More Selective College: An Application of Selection on Observables and Unobservables," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1491-1527.
    18. Gruber, Jonathan & Frakes, Michael, 2006. "Does falling smoking lead to rising obesity?," Journal of Health Economics, Elsevier, vol. 25(2), pages 183-197, March.
    19. P. Richard Hahn & Jared S. Murray & Ioanna Manolopoulou, 2016. "A Bayesian Partial Identification Approach to Inferring the Prevalence of Accounting Misconduct," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 14-26, March.
    20. repec:fth:prinin:419 is not listed on IDEAS
    21. Courtemanche, Charles & Tchernis, Rusty & Ukert, Benjamin, 2018. "The effect of smoking on obesity: Evidence from a randomized trial," Journal of Health Economics, Elsevier, vol. 57(C), pages 31-44.
    22. Frazis, Harley & Loewenstein, Mark A., 2003. "Estimating linear regressions with mismeasured, possibly endogenous, binary explanatory variables," Journal of Econometrics, Elsevier, vol. 117(1), pages 151-178, November.
    23. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    24. Timothy G. Conley & Christian B. Hansen & Peter E. Rossi, 2012. "Plausibly Exogenous," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 260-272, February.
    25. Dana Burde & Leigh L. Linden, 2013. "Bringing Education to Afghan Girls: A Randomized Controlled Trial of Village-Based Schools," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 27-40, July.
    26. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    27. Moon, Hyungsik Roger & Schorfheide, Frank, 2009. "Estimation with overidentifying inequality moment conditions," Journal of Econometrics, Elsevier, vol. 153(2), pages 136-154, December.
    28. Aprajit Mahajan, 2006. "Identification and Estimation of Regression Models with Misclassification," Econometrica, Econometric Society, vol. 74(3), pages 631-665, May.
    29. Thomas J. Kane & Cecilia Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," Working Papers 798, Princeton University, Department of Economics, Industrial Relations Section..
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    2. Daron Acemoglu & Giuseppe De Feo & Giacomo Davide De Luca, 2020. "Weak States: Causes and Consequences of the Sicilian Mafia," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 537-581.
    3. Pooyan Amir-Ahmadi & Thorsten Drautzburg, 2017. "Identification Through Heterogeneity," Working Papers 17-11, Federal Reserve Bank of Philadelphia.
    4. Alessio Volpicella, 2019. "SVARs Identification through Bounds on the Forecast Error Variance," Working Papers 890, Queen Mary University of London, School of Economics and Finance.
    5. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francis J. DiTraglia & Camilo Garcia-Jimeno, 2020. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models," Papers 2011.07276, arXiv.org.
    2. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models, Third Version," PIER Working Paper Archive 15-030, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 09 Sep 2015.
    3. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models, Second Version," PIER Working Paper Archive 15-028, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 31 Aug 2015.
    4. Francis J. DiTraglia & Camilo Garcia-Jimeno, 2020. "Identifying the effect of a mis-classified, binary, endogenous regressor," Papers 2011.07272, arXiv.org.
    5. Francis J. DiTraglia & Camilo García-Jimeno, 2017. "Mis-classified, Binary, Endogenous Regressors: Identification and Inference," NBER Working Papers 23814, National Bureau of Economic Research, Inc.
    6. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Third Version," PIER Working Paper Archive 15-040, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 24 Nov 2015.
    7. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    8. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).
    9. Steven J. Haider & Melvin Stephens Jr., 2020. "Correcting for Misclassified Binary Regressors Using Instrumental Variables," NBER Working Papers 27797, National Bureau of Economic Research, Inc.
    10. Takahide Yanagi, 2019. "Inference on local average treatment effects for misclassified treatment," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 938-960, September.
    11. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    12. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    13. Denni Tommasi & Arthur Lewbel & Rossella Calvi, 2017. "LATE with Mismeasured or Misspecified Treatment: An application to Women's Empowerment in India," Working Papers ECARES ECARES 2017-27, ULB -- Universite Libre de Bruxelles.
    14. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Second Version," PIER Working Paper Archive 15-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 11 Nov 2015.
    15. Akanksha Negi & Digvijay Singh Negi, 2022. "Difference-in-Differences with a Misclassified Treatment," Papers 2208.02412, arXiv.org.
    16. Martijn van Hasselt & Christopher R. Bollinger & Jeremy W. Bray, 2022. "A Bayesian approach to account for misclassification in prevalence and trend estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 351-367, March.
    17. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.
    18. Hu, Yingyao, 2017. "The Econometrics of Unobservables -- Latent Variable and Measurement Error Models and Their Applications in Empirical Industrial Organization and Labor Economics [The Econometrics of Unobservables]," Economics Working Paper Archive 64578, The Johns Hopkins University,Department of Economics, revised 2021.
    19. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature," PIER Working Paper Archive 15-037, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 02 Nov 2015.
    20. Adele Bergin, 2015. "Employer Changes and Wage Changes: Estimation with Measurement Error in a Binary Variable," LABOUR, CEIS, vol. 29(2), pages 194-223, June.

    More about this item

    JEL classification:

    • B23 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Econometrics; Quantitative and Mathematical Studies
    • B4 - Schools of Economic Thought and Methodology - - Economic Methodology
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C16 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Econometric and Statistical Methods; Specific Distributions
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22621. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.