IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2011.07276.html

A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models

Author

Listed:
  • Francis J. DiTraglia

    (Department of Economics University of Oxford)

  • Camilo Garcia-Jimeno

    (Federal Reserve Bank of Chicago)

Abstract

To estimate causal effects from observational data, an applied researcher must impose beliefs. The instrumental variables exclusion restriction, for example, represents the belief that the instrument has no direct effect on the outcome of interest. Yet beliefs about instrument validity do not exist in isolation. Applied researchers often discuss the likely direction of selection and the potential for measurement error in their articles but lack formal tools for incorporating this information into their analyses. Failing to use all relevant information not only leaves money on the table; it runs the risk of leading to a contradiction in which one holds mutually incompatible beliefs about the problem at hand. To address these issues, we first characterize the joint restrictions relating instrument invalidity, treatment endogeneity, and non-differential measurement error in a workhorse linear model, showing how beliefs over these three dimensions are mutually constrained by each other and the data. Using this information, we propose a Bayesian framework to help researchers elicit their beliefs, incorporate them into estimation, and ensure their mutual coherence. We conclude by illustrating our framework in a number of examples drawn from the empirical microeconomics literature.

Suggested Citation

  • Francis J. DiTraglia & Camilo Garcia-Jimeno, 2020. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models," Papers 2011.07276, arXiv.org.
  • Handle: RePEc:arx:papers:2011.07276
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2011.07276
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sascha O. Becker & Ludger Woessmann, 2009. "Was Weber Wrong? A Human Capital Theory of Protestant Economic History," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 531-596.
    2. Xiaohong Chen & Timothy Christensen & Keith O’Hara & Elie Tamer, 2016. "MCMC Confidence sets for Identified Sets," Cowles Foundation Discussion Papers 2037R, Cowles Foundation for Research in Economics, Yale University, revised Jul 2016.
    3. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    4. van Hasselt, Martijn & Bollinger, Christopher R., 2012. "Binary misclassification and identification in regression models," Economics Letters, Elsevier, vol. 115(1), pages 81-84.
    5. P. Richard Hahn & Jared S. Murray & Ioanna Manolopoulou, 2016. "A Bayesian Partial Identification Approach to Inferring the Prevalence of Accounting Misconduct," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 14-26, March.
    6. repec:fth:prinin:419 is not listed on IDEAS
    7. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    8. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    9. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    10. Thomas J. Kane & Cecilia E. Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," Working Papers 798, Princeton University, Department of Economics, Industrial Relations Section..
    11. Kreider, Brent & Pepper, John V., 2007. "Disability and Employment: Reevaluating the Evidence in Light of Reporting Errors," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 432-441, June.
    12. Pooyan Amir-Ahmadi & Thorsten Drautzburg, 2017. "Identification Through Heterogeneity," Working Papers 17-11, Federal Reserve Bank of Philadelphia.
    13. Jonas E. Arias & Juan Rubio-Ramirez & Daniel F. Waggoner, 2013. "Inference Based on SVARs Identied with Sign and Zero Restrictions: Theory and Applications," Working Papers 2013-24, FEDEA.
    14. Gundersen, Craig & Kreider, Brent & Pepper, John, 2012. "The impact of the National School Lunch Program on child health: A nonparametric bounds analysis," Journal of Econometrics, Elsevier, vol. 166(1), pages 79-91.
    15. Christopher R. Bollinger, 2003. "Measurement Error in Human Capital and the Black-White Wage Gap," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 578-585, August.
    16. Christiane Baumeister & James D. Hamilton, 2015. "Sign Restrictions, Structural Vector Autoregressions, and Useful Prior Information," Econometrica, Econometric Society, vol. 83(5), pages 1963-1999, September.
    17. Brent Kreider & John V. Pepper & Craig Gundersen & Dean Jolliffe, 2012. "Identifying the Effects of SNAP (Food Stamps) on Child Health Outcomes When Participation Is Endogenous and Misreported," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 958-975, September.
    18. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.
    19. Frazis, Harley & Loewenstein, Mark A., 2003. "Estimating linear regressions with mismeasured, possibly endogenous, binary explanatory variables," Journal of Econometrics, Elsevier, vol. 117(1), pages 151-178, November.
    20. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    21. Moon, Hyungsik Roger & Schorfheide, Frank, 2009. "Estimation with overidentifying inequality moment conditions," Journal of Econometrics, Elsevier, vol. 153(2), pages 136-154, December.
    22. Krasker, William S & Pratt, John W, 1986. "Bounding the Effects of Proxy Variables on Regression Coefficients," Econometrica, Econometric Society, vol. 54(3), pages 641-655, May.
    23. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    24. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    25. Timothy G. Conley & Christian B. Hansen & Peter E. Rossi, 2012. "Plausibly Exogenous," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 260-272, February.
    26. Leamer, Edward E, 1987. "Errors in Variables in Linear Systems," Econometrica, Econometric Society, vol. 55(4), pages 893-909, July.
    27. Hyungsik Roger Moon & Frank Schorfheide, 2012. "Bayesian and Frequentist Inference in Partially Identified Models," Econometrica, Econometric Society, vol. 80(2), pages 755-782, March.
    28. Aprajit Mahajan, 2006. "Identification and Estimation of Regression Models with Misclassification," Econometrica, Econometric Society, vol. 74(3), pages 631-665, May.
    29. Pooyan Amir‐Ahmadi & Thorsten Drautzburg, 2021. "Identification and inference with ranking restrictions," Quantitative Economics, Econometric Society, vol. 12(1), pages 1-39, January.
    30. Bekker, Paul & Kapteyn, Arie & Wansbeek, Tom, 1987. "Consistent Sets of Estimates for Regressions with Correlated or Uncorrelated Measurement Errors in Arbitrary Subsets of All Variables," Econometrica, Econometric Society, vol. 55(5), pages 1223-1230, September.
    31. Klepper, Steven & Leamer, Edward E, 1984. "Consistent Sets of Estimates for Regressions with Errors in All Variables," Econometrica, Econometric Society, vol. 52(1), pages 163-183, January.
    32. Thomas J. Kane & Cecilia Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," Working Papers 798, Princeton University, Department of Economics, Industrial Relations Section..
    33. Stacy Berg Dale & Alan B. Krueger, 2002. "Estimating the Payoff to Attending a More Selective College: An Application of Selection on Observables and Unobservables," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1491-1527.
    34. Chou, Shin-Yi & Grossman, Michael & Saffer, Henry, 2006. "Reply to Jonathan Gruber and Michael Frakes," Journal of Health Economics, Elsevier, vol. 25(2), pages 389-393, March.
    35. Bollinger, Christopher R., 1996. "Bounding mean regressions when a binary regressor is mismeasured," Journal of Econometrics, Elsevier, vol. 73(2), pages 387-399, August.
    36. Courtemanche, Charles & Tchernis, Rusty & Ukert, Benjamin, 2018. "The effect of smoking on obesity: Evidence from a randomized trial," Journal of Health Economics, Elsevier, vol. 57(C), pages 31-44.
    37. Gruber, Jonathan & Frakes, Michael, 2006. "Does falling smoking lead to rising obesity?," Journal of Health Economics, Elsevier, vol. 25(2), pages 183-197, March.
    38. Jonas E. Arias & Juan F. Rubio‐Ramírez & Daniel F. Waggoner, 2018. "Inference Based on Structural Vector Autoregressions Identified With Sign and Zero Restrictions: Theory and Applications," Econometrica, Econometric Society, vol. 86(2), pages 685-720, March.
    39. Aviv Nevo & Adam M. Rosen, 2012. "Identification With Imperfect Instruments," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 659-671, August.
    40. Dana Burde & Leigh L. Linden, 2013. "Bringing Education to Afghan Girls: A Randomized Controlled Trial of Village-Based Schools," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 27-40, July.
    41. Hu, Yingyao, 2008. "Identification and estimation of nonlinear models with misclassification error using instrumental variables: A general solution," Journal of Econometrics, Elsevier, vol. 144(1), pages 27-61, May.
    42. Chou, Shin-Yi & Grossman, Michael & Saffer, Henry, 2004. "An economic analysis of adult obesity: results from the Behavioral Risk Factor Surveillance System," Journal of Health Economics, Elsevier, vol. 23(3), pages 565-587, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pooyan Amir-Ahmadi & Thorsten Drautzburg, 2017. "Identification Through Heterogeneity," Working Papers 17-11, Federal Reserve Bank of Philadelphia.
    2. Daron Acemoglu & Giuseppe De Feo & Giacomo Davide De Luca, 2020. "Weak States: Causes and Consequences of the Sicilian Mafia," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 537-581.
    3. Alessio Volpicella, 2022. "SVARs Identification Through Bounds on the Forecast Error Variance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1291-1301, June.
    4. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    5. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.
    6. Ratbek Dzhumashev & Ainura Tursunalieva, 2025. "A test for instrumental variable validity using a correlation restriction," Monash Economics Working Papers 2025-06, Monash University, Department of Economics.
    7. Jonah M Rexer, 2022. "The Brides of Boko Haram: Economic Shocks, Marriage Practices, and Insurgency in Nigeria," The Economic Journal, Royal Economic Society, vol. 132(645), pages 1927-1977.
    8. Lars Boerner & Battista Severgnini, 2026. "Time for Growth," American Economic Journal: Macroeconomics, American Economic Association, vol. 18(2), pages 523-560, April.
    9. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francis J. DiTraglia & Camilo García-Jimeno, 2017. "Mis-classified, Binary, Endogenous Regressors: Identification and Inference," NBER Working Papers 23814, National Bureau of Economic Research, Inc.
    2. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    3. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models, Third Version," PIER Working Paper Archive 15-030, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 09 Sep 2015.
    4. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Third Version," PIER Working Paper Archive 15-040, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 24 Nov 2015.
    5. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "A Framework for Eliciting, Incorporating, and Disciplining Identification Beliefs in Linear Models, Second Version," PIER Working Paper Archive 15-028, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 31 Aug 2015.
    6. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    7. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Second Version," PIER Working Paper Archive 15-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 11 Nov 2015.
    8. Akanksha Negi & Digvijay S. Negi, 2025. "Difference‐in‐Differences With a Misclassified Treatment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(4), pages 411-423, June.
    9. Steven J. Haider & Melvin Stephens, 2025. "Correcting for Misclassified Binary Regressors Using Instrumental Variables," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 43(3), pages 592-602, July.
    10. Martijn van Hasselt & Christopher R. Bollinger & Jeremy W. Bray, 2022. "A Bayesian approach to account for misclassification in prevalence and trend estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 351-367, March.
    11. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).
    12. Denni Tommasi & Arthur Lewbel & Rossella Calvi, 2017. "LATE with Mismeasured or Misspecified Treatment: An application to Women's Empowerment in India," Working Papers ECARES ECARES 2017-27, ULB -- Universite Libre de Bruxelles.
    13. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.
    14. Orville Mondal & Rui Wang, 2024. "Partial Identification of Binary Choice Models with Misreported Outcomes," Papers 2401.17137, arXiv.org.
    15. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    16. Battistin, Erich & De Nadai, Michele & Sianesi, Barbara, 2014. "Misreported schooling, multiple measures and returns to educational qualifications," Journal of Econometrics, Elsevier, vol. 181(2), pages 136-150.
    17. Seoyun Hong & Chang Sik Kim & Hyunchul Kim, 2022. "Measuring the Effects of Bid-Rigging on Prices with Binary Misclassification," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 61(3), pages 319-339, November.
    18. Hu, Yingyao, 2006. "Bounding parameters in a linear regression model with a mismeasured regressor using additional information," Journal of Econometrics, Elsevier, vol. 133(1), pages 51-70, July.
    19. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.
    20. Nguyen, Lam, 2025. "Bayesian inference in proxy SVARs with incomplete identification: Re-evaluating the validity of monetary policy instruments," Journal of Monetary Economics, Elsevier, vol. 155(C).

    More about this item

    JEL classification:

    • B23 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Econometrics; Quantitative and Mathematical Studies
    • B4 - Schools of Economic Thought and Methodology - - Economic Methodology
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C16 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Econometric and Statistical Methods; Specific Distributions
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2011.07276. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.