IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22621.html

A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models

Author

Listed:
  • Francis DiTraglia
  • Camilo García-Jimeno

Abstract

To estimate causal effects from observational data, an applied researcher must impose beliefs. The instrumental variables exclusion restriction, for example, represents the belief that the instrument has no direct effect on the outcome of interest. Yet beliefs about instrument validity do not exist in isolation. Applied researchers often discuss the likely direction of selection and the potential for measurement error in their papers but at present lack formal tools for incorporating this information into their analyses. As such they not only leave money on the table, by failing to use all relevant information, but more importantly run the risk of reasoning to a contradiction by expressing mutually incompatible beliefs. In this paper we characterize the sharp identified set relating instrument invalidity, treatment endogeneity, and measurement error in a workhorse linear model, showing how beliefs over these three dimensions are mutually constrained. We consider two cases: in the first the treatment is continuous and subject to classical measurement error; in the second it is binary and subject to non-differential measurement error. In each, we propose a formal Bayesian framework to help researchers elicit their beliefs, incorporate them into estimation, and ensure their mutual coherence. We conclude by illustrating the usefulness of our proposed methods on a variety of examples from the empirical microeconomics literature.

Suggested Citation

  • Francis DiTraglia & Camilo García-Jimeno, 2016. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models," NBER Working Papers 22621, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22621
    Note: DEV EH LS PE POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22621.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sascha O. Becker & Ludger Woessmann, 2009. "Was Weber Wrong? A Human Capital Theory of Protestant Economic History," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 531-596.
    2. Xiaohong Chen & Timothy Christensen & Keith O’Hara & Elie Tamer, 2016. "MCMC Confidence sets for Identified Sets," Cowles Foundation Discussion Papers 2037R, Cowles Foundation for Research in Economics, Yale University, revised Jul 2016.
    3. P. Richard Hahn & Jared S. Murray & Ioanna Manolopoulou, 2016. "A Bayesian Partial Identification Approach to Inferring the Prevalence of Accounting Misconduct," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 14-26, March.
    4. repec:fth:prinin:419 is not listed on IDEAS
    5. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    6. Kreider, Brent & Pepper, John V., 2007. "Disability and Employment: Reevaluating the Evidence in Light of Reporting Errors," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 432-441, June.
    7. Pooyan Amir-Ahmadi & Thorsten Drautzburg, 2017. "Identification Through Heterogeneity," Working Papers 17-11, Federal Reserve Bank of Philadelphia.
    8. Jonas E. Arias & Juan Rubio-Ramirez & Daniel F. Waggoner, 2013. "Inference Based on SVARs Identied with Sign and Zero Restrictions: Theory and Applications," Working Papers 2013-24, FEDEA.
    9. Gundersen, Craig & Kreider, Brent & Pepper, John, 2012. "The impact of the National School Lunch Program on child health: A nonparametric bounds analysis," Journal of Econometrics, Elsevier, vol. 166(1), pages 79-91.
    10. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.
    11. Frazis, Harley & Loewenstein, Mark A., 2003. "Estimating linear regressions with mismeasured, possibly endogenous, binary explanatory variables," Journal of Econometrics, Elsevier, vol. 117(1), pages 151-178, November.
    12. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    13. Krasker, William S & Pratt, John W, 1986. "Bounding the Effects of Proxy Variables on Regression Coefficients," Econometrica, Econometric Society, vol. 54(3), pages 641-655, May.
    14. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    15. Thomas J. Kane & Cecilia Elena Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," NBER Working Papers 7235, National Bureau of Economic Research, Inc.
    16. Timothy G. Conley & Christian B. Hansen & Peter E. Rossi, 2012. "Plausibly Exogenous," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 260-272, February.
    17. Klepper, Steven & Leamer, Edward E, 1984. "Consistent Sets of Estimates for Regressions with Errors in All Variables," Econometrica, Econometric Society, vol. 52(1), pages 163-183, January.
    18. Chou, Shin-Yi & Grossman, Michael & Saffer, Henry, 2006. "Reply to Jonathan Gruber and Michael Frakes," Journal of Health Economics, Elsevier, vol. 25(2), pages 389-393, March.
    19. Bollinger, Christopher R., 1996. "Bounding mean regressions when a binary regressor is mismeasured," Journal of Econometrics, Elsevier, vol. 73(2), pages 387-399, August.
    20. Brent Kreider & John V. Pepper & Craig Gundersen & Dean Jolliffe, 2012. "Identifying the Effects of SNAP (Food Stamps) on Child Health Outcomes When Participation Is Endogenous and Misreported," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 958-975, September.
    21. Jonas E. Arias & Juan F. Rubio‐Ramírez & Daniel F. Waggoner, 2018. "Inference Based on Structural Vector Autoregressions Identified With Sign and Zero Restrictions: Theory and Applications," Econometrica, Econometric Society, vol. 86(2), pages 685-720, March.
    22. Dana Burde & Leigh L. Linden, 2013. "Bringing Education to Afghan Girls: A Randomized Controlled Trial of Village-Based Schools," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 27-40, July.
    23. Hu, Yingyao, 2008. "Identification and estimation of nonlinear models with misclassification error using instrumental variables: A general solution," Journal of Econometrics, Elsevier, vol. 144(1), pages 27-61, May.
    24. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    25. van Hasselt, Martijn & Bollinger, Christopher R., 2012. "Binary misclassification and identification in regression models," Economics Letters, Elsevier, vol. 115(1), pages 81-84.
    26. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    27. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    28. Christopher R. Bollinger, 2003. "Measurement Error in Human Capital and the Black-White Wage Gap," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 578-585, August.
    29. Christiane Baumeister & James D. Hamilton, 2015. "Sign Restrictions, Structural Vector Autoregressions, and Useful Prior Information," Econometrica, Econometric Society, vol. 83(5), pages 1963-1999, September.
    30. Moon, Hyungsik Roger & Schorfheide, Frank, 2009. "Estimation with overidentifying inequality moment conditions," Journal of Econometrics, Elsevier, vol. 153(2), pages 136-154, December.
    31. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    32. Leamer, Edward E, 1987. "Errors in Variables in Linear Systems," Econometrica, Econometric Society, vol. 55(4), pages 893-909, July.
    33. Hyungsik Roger Moon & Frank Schorfheide, 2012. "Bayesian and Frequentist Inference in Partially Identified Models," Econometrica, Econometric Society, vol. 80(2), pages 755-782, March.
    34. Aprajit Mahajan, 2006. "Identification and Estimation of Regression Models with Misclassification," Econometrica, Econometric Society, vol. 74(3), pages 631-665, May.
    35. Bekker, Paul & Kapteyn, Arie & Wansbeek, Tom, 1987. "Consistent Sets of Estimates for Regressions with Correlated or Uncorrelated Measurement Errors in Arbitrary Subsets of All Variables," Econometrica, Econometric Society, vol. 55(5), pages 1223-1230, September.
    36. Pooyan Amir‐Ahmadi & Thorsten Drautzburg, 2021. "Identification and inference with ranking restrictions," Quantitative Economics, Econometric Society, vol. 12(1), pages 1-39, January.
    37. Thomas J. Kane & Cecilia Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," Working Papers 798, Princeton University, Department of Economics, Industrial Relations Section..
    38. Stacy Berg Dale & Alan B. Krueger, 2002. "Estimating the Payoff to Attending a More Selective College: An Application of Selection on Observables and Unobservables," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1491-1527.
    39. Courtemanche, Charles & Tchernis, Rusty & Ukert, Benjamin, 2018. "The effect of smoking on obesity: Evidence from a randomized trial," Journal of Health Economics, Elsevier, vol. 57(C), pages 31-44.
    40. Gruber, Jonathan & Frakes, Michael, 2006. "Does falling smoking lead to rising obesity?," Journal of Health Economics, Elsevier, vol. 25(2), pages 183-197, March.
    41. Aviv Nevo & Adam M. Rosen, 2012. "Identification With Imperfect Instruments," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 659-671, August.
    42. Chou, Shin-Yi & Grossman, Michael & Saffer, Henry, 2004. "An economic analysis of adult obesity: results from the Behavioral Risk Factor Surveillance System," Journal of Health Economics, Elsevier, vol. 23(3), pages 565-587, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ratbek Dzhumashev & Ainura Tursunalieva, 2025. "A test for instrumental variable validity using a correlation restriction," Monash Economics Working Papers 2025-06, Monash University, Department of Economics.
    2. Lars Boerner & Battista Severgnini, 2026. "Time for Growth," American Economic Journal: Macroeconomics, American Economic Association, vol. 18(2), pages 523-560, April.
    3. Daron Acemoglu & Giuseppe De Feo & Giacomo Davide De Luca, 2020. "Weak States: Causes and Consequences of the Sicilian Mafia," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 537-581.
    4. Pooyan Amir-Ahmadi & Thorsten Drautzburg, 2017. "Identification Through Heterogeneity," Working Papers 17-11, Federal Reserve Bank of Philadelphia.
    5. Jonah M Rexer, 2022. "The Brides of Boko Haram: Economic Shocks, Marriage Practices, and Insurgency in Nigeria," The Economic Journal, Royal Economic Society, vol. 132(645), pages 1927-1977.
    6. Alessio Volpicella, 2022. "SVARs Identification Through Bounds on the Forecast Error Variance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1291-1301, June.
    7. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    8. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.
    9. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francis J. DiTraglia & Camilo García-Jimeno, 2017. "Mis-classified, Binary, Endogenous Regressors: Identification and Inference," NBER Working Papers 23814, National Bureau of Economic Research, Inc.
    2. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    3. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models, Third Version," PIER Working Paper Archive 15-030, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 09 Sep 2015.
    4. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Third Version," PIER Working Paper Archive 15-040, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 24 Nov 2015.
    5. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models, Second Version," PIER Working Paper Archive 15-028, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 31 Aug 2015.
    6. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    7. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Second Version," PIER Working Paper Archive 15-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 11 Nov 2015.
    8. Akanksha Negi & Digvijay S. Negi, 2025. "Difference‐in‐Differences With a Misclassified Treatment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(4), pages 411-423, June.
    9. Steven J. Haider & Melvin Stephens, 2025. "Correcting for Misclassified Binary Regressors Using Instrumental Variables," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 43(3), pages 592-602, July.
    10. Martijn van Hasselt & Christopher R. Bollinger & Jeremy W. Bray, 2022. "A Bayesian approach to account for misclassification in prevalence and trend estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 351-367, March.
    11. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).
    12. Denni Tommasi & Arthur Lewbel & Rossella Calvi, 2017. "LATE with Mismeasured or Misspecified Treatment: An application to Women's Empowerment in India," Working Papers ECARES ECARES 2017-27, ULB -- Universite Libre de Bruxelles.
    13. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.
    14. Orville Mondal & Rui Wang, 2024. "Partial Identification of Binary Choice Models with Misreported Outcomes," Papers 2401.17137, arXiv.org.
    15. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    16. Battistin, Erich & De Nadai, Michele & Sianesi, Barbara, 2014. "Misreported schooling, multiple measures and returns to educational qualifications," Journal of Econometrics, Elsevier, vol. 181(2), pages 136-150.
    17. Seoyun Hong & Chang Sik Kim & Hyunchul Kim, 2022. "Measuring the Effects of Bid-Rigging on Prices with Binary Misclassification," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 61(3), pages 319-339, November.
    18. Hu, Yingyao, 2006. "Bounding parameters in a linear regression model with a mismeasured regressor using additional information," Journal of Econometrics, Elsevier, vol. 133(1), pages 51-70, July.
    19. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.
    20. Nguyen, Lam, 2025. "Bayesian inference in proxy SVARs with incomplete identification: Re-evaluating the validity of monetary policy instruments," Journal of Monetary Economics, Elsevier, vol. 155(C).

    More about this item

    JEL classification:

    • B23 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Econometrics; Quantitative and Mathematical Studies
    • B4 - Schools of Economic Thought and Methodology - - Economic Methodology
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C16 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Econometric and Statistical Methods; Specific Distributions
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22621. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.