IDEAS home Printed from https://ideas.repec.org/a/tpr/restat/v97y2015i2p387-397.html
   My bibliography  Save this article

Estimating and Testing Models with Many Treatment Levels and Limited Instruments

Author

Listed:
  • Lance Lochner

    (University of Western Ontario and NBER)

  • Enrico Moretti

    (University of California-Berkeley, NBER, CEPR, and IZA)

Abstract

Empirical researchers interested in the causal effect of the endogenous regressor often use instrumental variables. When few valid instruments are available, they typically estimate restricted specifications that impose uniform per unit treatment effects, even when these effects are likely to vary. We show that in these cases, ordinary least squares and instrumental variables estimators identify different weighted averages of all per unit effects, so the traditional Hausman test is uninformative about endogeneity. We develop a new exogeneity test that works even when the true model cannot be estimated using IV methods as long as a single valid instrument is available. We revisit three recent empirical examples to demonstrate the practical value of our test. © 2015 The President and Fellows of Harvard College and the Massachusetts Institute of Technology

Suggested Citation

  • Lance Lochner & Enrico Moretti, 2015. "Estimating and Testing Models with Many Treatment Levels and Limited Instruments," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 387-397, May.
  • Handle: RePEc:tpr:restat:v:97:y:2015:i:2:p:387-397
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/REST_a_00475
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. James J. Heckman & Lance J. Lochner & Petra E. Todd, 2008. "Earnings Functions and Rates of Return," Journal of Human Capital, University of Chicago Press, vol. 2(1), pages 1-31.
    2. Pedro Carneiro & James J. Heckman & Edward Vytlacil, 2010. "Evaluating Marginal Policy Changes and the Average Effect of Treatment for Individuals at the Margin," Econometrica, Econometric Society, vol. 78(1), pages 377-394, January.
    3. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    4. Kling, Jeffrey R, 2001. "Interpreting Instrumental Variables Estimates of the Returns to Schooling," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 358-364, July.
    5. Katrine V. Løken & Magne Mogstad & Matthew Wiswall, 2012. "What Linear Estimators Miss: The Effects of Family Income on Child Outcomes," American Economic Journal: Applied Economics, American Economic Association, vol. 4(2), pages 1-35, April.
    6. Lance Lochner & Enrico Moretti, 2004. "The Effect of Education on Crime: Evidence from Prison Inmates, Arrests, and Self-Reports," American Economic Review, American Economic Association, vol. 94(1), pages 155-189, March.
    7. Mogstad, Magne & Wiswall, Matthew, 2009. "How Much Should We Trust Linear Instrumental Variables Estimators? An Application to Family Size and Children's Education," IZA Discussion Papers 4562, Institute of Labor Economics (IZA).
    8. Daron Acemoglu & Joshua Angrist, 2001. "How Large Are Human Capital Externalities? Evidence from Compulsory Schooling Laws," NBER Chapters, in: NBER Macroeconomics Annual 2000, Volume 15, pages 9-74, National Bureau of Economic Research, Inc.
    9. Hungerford, Thomas & Solon, Gary, 1987. "Sheepskin Effects in the Returns to Education," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 175-177, February.
    10. O. Ashenfelter & D. Card (ed.), 1999. "Handbook of Labor Economics," Handbook of Labor Economics, Elsevier, edition 1, volume 3, number 3.
    11. Jaeger, David A & Page, Marianne E, 1996. "Degrees Matter: New Evidence on Sheepskin Effects in the Returns to Education," The Review of Economics and Statistics, MIT Press, vol. 78(4), pages 733-740, November.
    12. Park, Jin Heum, 1999. "Estimation of sheepskin effects using the old and the new measures of educational attainment in the Current Population Survey," Economics Letters, Elsevier, vol. 62(2), pages 237-240, February.
    13. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    14. Card, David, 1999. "The causal effect of education on earnings," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 30, pages 1801-1863, Elsevier.
    15. Yitzhaki, Shlomo, 1996. "On Using Linear Regressions in Welfare Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(4), pages 478-486, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hisham S. El-Osta, 2018. "Strategies to Manage Risk and their Role in Impacting Economic Performance among Farm Households," Applied Economics and Finance, Redfame publishing, vol. 5(2), pages 49-64, March.
    2. Blemings, Benjamin T. & Bock, Margaret & Scarcioffolo, Alexandre, 2022. "Hoggin' the Road: Negative Road Externalities of Pork Slaughterhouses," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322466, Agricultural and Applied Economics Association.
    3. Gaurab Aryal & Manudeep Bhuller & Fabian Lange, 2022. "Signaling and Employer Learning with Instruments," American Economic Review, American Economic Association, vol. 112(5), pages 1669-1702, May.
    4. Lucija Muehlenbachs & Stefan Staubli & Mark A. Cohen, 2016. "The Impact of Team Inspections on Enforcement and Deterrence," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 3(1), pages 159-204.
    5. Shoya Ishimaru, 2021. "Empirical Decomposition of the IV-OLS Gap with Heterogeneous and Nonlinear Effects," Papers 2101.04346, arXiv.org, revised Jun 2022.
    6. Mario Fiorini & Katrien Stevens, 2021. "Scrutinizing the Monotonicity Assumption in IV and fuzzy RD designs," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(6), pages 1475-1526, December.
    7. Escanciano, Juan Carlos & Li, Wei, 2021. "Optimal Linear Instrumental Variables Approximations," Journal of Econometrics, Elsevier, vol. 221(1), pages 223-246.
    8. Loh, Isaac, 2023. "Nonparametric identification and estimation with discrete instruments and regressors," Journal of Econometrics, Elsevier, vol. 235(2), pages 1257-1279.
    9. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    10. Tymon Sloczynski, 2021. "When Should We (Not) Interpret Linear IV Estimands as LATE?," CESifo Working Paper Series 9064, CESifo.
    11. Francesco Fasani & Tommaso Frattini & Luigi Minale, 2021. "Lift the Ban? Initial Employment Restrictions and Refugee Labour Market Outcomes," Journal of the European Economic Association, European Economic Association, vol. 19(5), pages 2803-2854.
    12. Tymon Sloczynski, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," Working Papers 125, Brandeis University, Department of Economics and International Business School.
    13. Tymon S{l}oczy'nski, 2020. "When Should We (Not) Interpret Linear IV Estimands as LATE?," Papers 2011.06695, arXiv.org, revised Sep 2022.
    14. Cygan-Rehm, Kamila & Wunder, Christoph, 2018. "Do working hours affect health? Evidence from statutory workweek regulations in Germany," Labour Economics, Elsevier, vol. 53(C), pages 162-171.
    15. Firmin Doko Tchatoka & Jean-Marie Dufour, 2016. "Exogeneity tests, weak identification, incomplete models and non-Gaussian distributions: Invariance and finite-sample distributional theory," School of Economics and Public Policy Working Papers 2016-01, University of Adelaide, School of Economics and Public Policy.
    16. Javier Cano-Urbina & Lance Lochner, 2019. "The Effect of Education and School Quality on Female Crime," Journal of Human Capital, University of Chicago Press, vol. 13(2), pages 188-235.
    17. Firmin DOKO TCHATOKA & Jean-Marie DUFOUR, 2016. "Exogeneity Tests, Incomplete Models, Weak Identification and Non-Gaussian Distributions : Invariance and Finite-Sample Distributional Theory," Cahiers de recherche 14-2016, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    18. Kamila Cygam-Rehm & Christoph Wunder, 2018. "Do Working Hours Affect Health? Evidence from Statutory Workweek Regulations in Germany," SOEPpapers on Multidisciplinary Panel Data Research 967, DIW Berlin, The German Socio-Economic Panel (SOEP).
    19. Sergi Jiménez-Martín & Cristina Vilaplana Prieto, 2013. "Informal Care and intergenerational transfers in European Countries," Working Papers 2013-25, FEDEA.
    20. Katrine V. Løken & Magne Mogstad & Matthew Wiswall, 2012. "What Linear Estimators Miss: The Effects of Family Income on Child Outcomes," American Economic Journal: Applied Economics, American Economic Association, vol. 4(2), pages 1-35, April.
    21. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).
    22. Doko Tchatoka, Firmin & Dufour, Jean-Marie, 2020. "Exogeneity tests, incomplete models, weak identification and non-Gaussian distributions: Invariance and finite-sample distributional theory," Journal of Econometrics, Elsevier, vol. 218(2), pages 390-418.
    23. Shoya Ishimaru, 2021. "What Do We Get from Two-Way Fixed Effects Regressions? Implications from Numerical Equivalence," Papers 2103.12374, arXiv.org, revised Jan 2024.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lance Lochner & Enrico Moretti, 2011. "Estimating and Testing Non-Linear Models Using Instrumental Variables," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20112, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
    2. Shoya Ishimaru, 2021. "Empirical Decomposition of the IV-OLS Gap with Heterogeneous and Nonlinear Effects," Papers 2101.04346, arXiv.org, revised Jun 2022.
    3. Pedro Carneiro & Michael Lokshin & Nithin Umapathi, 2017. "Average and Marginal Returns to Upper Secondary Schooling in Indonesia," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 16-36, January.
    4. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    5. Hofmarcher, Thomas, 2021. "The effect of education on poverty: A European perspective," Economics of Education Review, Elsevier, vol. 83(C).
    6. Lance Lochner & Enrico Moretti, 2004. "The Effect of Education on Crime: Evidence from Prison Inmates, Arrests, and Self-Reports," American Economic Review, American Economic Association, vol. 94(1), pages 155-189, March.
    7. Gaurab Aryal & Manudeep Bhuller & Fabian Lange, 2022. "Signaling and Employer Learning with Instruments," American Economic Review, American Economic Association, vol. 112(5), pages 1669-1702, May.
    8. Dee, Thomas S., 2004. "Are there civic returns to education?," Journal of Public Economics, Elsevier, vol. 88(9-10), pages 1697-1720, August.
    9. Katrine V. Løken & Magne Mogstad & Matthew Wiswall, 2012. "What Linear Estimators Miss: The Effects of Family Income on Child Outcomes," American Economic Journal: Applied Economics, American Economic Association, vol. 4(2), pages 1-35, April.
    10. Ana Ferrer & W. Craig Riddell, 2008. "Education, credentials, and immigrant earnings," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(1), pages 186-216, February.
    11. James J. Heckman & Lance J. Lochner & Petra E. Todd, 2008. "Earnings Functions and Rates of Return," Journal of Human Capital, University of Chicago Press, vol. 2(1), pages 1-31.
    12. Jörn-Steffen Pischke & Till von Wachter, 2008. "Zero Returns to Compulsory Schooling in Germany: Evidence and Interpretation," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 592-598, August.
    13. Huebener, Mathias & Marcus, Jan, 2017. "Compressing instruction time into fewer years of schooling and the impact on student performance," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 58, pages 1-14.
    14. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory, 2016. "Dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 191(2), pages 276-292.
    15. Dickson, Matt & Harmon, Colm, 2011. "Economic returns to education: What We Know, What We Don’t Know, and Where We Are Going—Some brief pointers," Economics of Education Review, Elsevier, vol. 30(6), pages 1118-1122.
    16. Takahide Yanagi, 2019. "Inference on local average treatment effects for misclassified treatment," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 938-960, September.
    17. Polachek, Solomon W., 2008. "Earnings Over the Life Cycle: The Mincer Earnings Function and Its Applications," Foundations and Trends(R) in Microeconomics, now publishers, vol. 4(3), pages 165-272, April.
    18. Carneiro, Pedro & Lee, Sokbae, 2009. "Estimating distributions of potential outcomes using local instrumental variables with an application to changes in college enrollment and wage inequality," Journal of Econometrics, Elsevier, vol. 149(2), pages 191-208, April.
    19. Domenico Depalo, 2020. "Explaining the causal effect of adherence to medication on cholesterol through the marginal patient," Health Economics, John Wiley & Sons, Ltd., vol. 29(S1), pages 110-126, October.
    20. Pedro Carneiro & Sokbae (Simon) Lee, 2005. "Ability, sorting and wage inequality," CeMMAP working papers CWP16/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    Keywords

    empirical; causal effect; endogenous regressor; per unit effects; endogeneity;
    All these keywords.

    JEL classification:

    • C00 - Mathematical and Quantitative Methods - - General - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:restat:v:97:y:2015:i:2:p:387-397. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelly McDougall (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.