IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v19y2004i2p203-225.html
   My bibliography  Save this article

Do dropouts suffer from dropping out? Estimation and prediction of outcome gains in generalized selection models

Author

Listed:
  • Mingliang Li

    (Department of Economics, University of California, Irvine, USA)

  • Dale J. Poirier

    (Department of Economics, University of California, Irvine, USA)

  • Justin L. Tobias

    (Department of Economics, University of California, Irvine, USA)

Abstract

In this paper we describe methods for predicting distributions of outcome gains in the framework of a latent variable selection model. We describe such procedures for Student-t selection models and a finite mixture of Gaussian selection models. Importantly, our algorithms for fitting these models are simple to implement in practice, and also permit learning to take place about the non-identified cross-regime correlation parameter. Using data from High School and Beyond, we apply our methods to determine the impact of dropping out of high school on a math test score taken at the senior year of high school. Our results show that selection bias is an important feature of this data, that our beliefs about this non-identified correlation are updated from the data, and that generalized models of selectivity offer an improvement over the 'textbook' Gaussian model. Further, our results indicate that on average dropping out of high school has a large negative impact on senior-year test scores. However, for those individuals who actually drop out of high school, the act of dropping out of high school does not have a significantly negative impact on test scores. This suggests that policies aimed at keeping students in school may not be as beneficial as first thought, since those individuals who must be induced to stay in school are not the ones who benefit significantly (in terms of test scores) from staying in school. Copyright © 2004 John Wiley & Sons, Ltd.

Suggested Citation

  • Mingliang Li & Dale J. Poirier & Justin L. Tobias, 2004. "Do dropouts suffer from dropping out? Estimation and prediction of outcome gains in generalized selection models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(2), pages 203-225.
  • Handle: RePEc:jae:japmet:v:19:y:2004:i:2:p:203-225
    DOI: 10.1002/jae.731
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.731
    File Function: Link to full text; subscription required
    Download Restriction: no

    File URL: http://qed.econ.queensu.ca:80/jae/2004-v19.2/
    File Function: Supporting data files and programs
    Download Restriction: no

    File URL: https://libkey.io/10.1002/jae.731?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    2. Vijverberg, Wim P. M., 1993. "Measuring the unidentified parameter of the extended Roy model of selectivity," Journal of Econometrics, Elsevier, vol. 57(1-3), pages 69-89.
    3. Poirier, Dale J & Tobias, Justin L, 2003. "On the Predictive Distributions of Outcome Gains in the Presence of an Unidentified Parameter," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(2), pages 258-268, April.
    4. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    5. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444606.
    6. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    7. Manski, C.F., 1990. "The Selection Problem," Working papers 90-12, Wisconsin Madison - Social Systems.
    8. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc.
    9. Heckman, James J. & Vytlacil, Edward J., 2000. "The relationship between treatment parameters within a latent variable framework," Economics Letters, Elsevier, vol. 66(1), pages 33-39, January.
    10. Heckman, James J & Honore, Bo E, 1990. "The Empirical Content of the Roy Model," Econometrica, Econometric Society, vol. 58(5), pages 1121-1149, September.
    11. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    12. Dale J. Poirier, 1995. "Intermediate Statistics and Econometrics: A Comparative Approach," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262161494, April.
    13. James Heckman & Justin L. Tobias & Edward Vytlacil, 2003. "Simple Estimators for Treatment Parameters in a Latent-Variable Framework," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 748-755, August.
    14. Heckman, James J, 1990. "Varieties of Selection Bias," American Economic Review, American Economic Association, vol. 80(2), pages 313-318, May.
    15. James J. Heckman & Edward J. Vytlacil, 2000. "Local Instrumental Variables," NBER Technical Working Papers 0252, National Bureau of Economic Research, Inc.
    16. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444590.
    17. Chib, Siddhartha & Hamilton, Barton H., 2002. "Semiparametric Bayes analysis of longitudinal data treatment models," Journal of Econometrics, Elsevier, vol. 110(1), pages 67-89, September.
    18. James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
    19. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    20. Koop, Gary & Poirier, Dale J., 1997. "Learning about the across-regime correlation in switching regression models," Journal of Econometrics, Elsevier, vol. 78(2), pages 217-227, June.
    21. Nobile, Agostino, 2000. "Comment: Bayesian multinomial probit models with a normalization constraint," Journal of Econometrics, Elsevier, vol. 99(2), pages 335-345, December.
    22. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    23. Chib, Siddhartha & Hamilton, Barton H., 2000. "Bayesian analysis of cross-section and clustered data treatment models," Journal of Econometrics, Elsevier, vol. 97(1), pages 25-50, July.
    24. Geweke, J, 1993. "Bayesian Treatment of the Independent Student- t Linear Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 19-40, Suppl. De.
    25. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    26. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    27. Bjorklund, Anders & Moffitt, Robert, 1987. "The Estimation of Wage Gains and Welfare Gains in Self-selection," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 42-49, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chib, Siddhartha & Jacobi, Liana, 2007. "Modeling and calculating the effect of treatment at baseline from panel outcomes," Journal of Econometrics, Elsevier, vol. 140(2), pages 781-801, October.
    2. Li, Mingliang & Tobias, Justin L., 2011. "Bayesian inference in a correlated random coefficients model: Modeling causal effect heterogeneity with an application to heterogeneous returns to schooling," Journal of Econometrics, Elsevier, vol. 162(2), pages 345-361, June.
    3. Chen, Heng & Fan, Yanqin & Wu, Jisong, 2014. "A flexible parametric approach for estimating switching regime models and treatment effect parameters," Journal of Econometrics, Elsevier, vol. 181(2), pages 77-91.
    4. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    5. Tsaneva, Magda, 2017. "Does school Matter? Learning outcomes of Indonesian children after dropping out of school," World Development Perspectives, Elsevier, vol. 6(C), pages 1-10.
    6. Justin Tobias, 2006. "Estimation, Learning and Parameters of Interest in a Multiple Outcome Selection Model," Econometric Reviews, Taylor & Francis Journals, vol. 25(1), pages 1-40.
    7. Murat K. Munkin, 2022. "Count Roy model with finite mixtures," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1160-1181, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James Heckman & Justin L. Tobias & Edward Vytlacil, 2001. "Four Parameters of Interest in the Evaluation of Social Programs," Southern Economic Journal, John Wiley & Sons, vol. 68(2), pages 210-223, October.
    2. James J. Heckman, 2005. "Micro Data, Heterogeneity and the Evaluation of Public Policy Part 2," The American Economist, Sage Publications, vol. 49(1), pages 16-44, March.
    3. Justin Tobias, 2006. "Estimation, Learning and Parameters of Interest in a Multiple Outcome Selection Model," Econometric Reviews, Taylor & Francis Journals, vol. 25(1), pages 1-40.
    4. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    5. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    6. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    7. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.
    8. James J. Heckman & Edward J. Vytlacil, 2000. "Instrumental Variables, Selection Models, and Tight Bounds on the Average Treatment Effect," NBER Technical Working Papers 0259, National Bureau of Economic Research, Inc.
    9. Chen, Heng & Fan, Yanqin & Wu, Jisong, 2014. "A flexible parametric approach for estimating switching regime models and treatment effect parameters," Journal of Econometrics, Elsevier, vol. 181(2), pages 77-91.
    10. Aakvik, Arild & Heckman, James J. & Vytlacil, Edward J., 2005. "Estimating treatment effects for discrete outcomes when responses to treatment vary: an application to Norwegian vocational rehabilitation programs," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 15-51.
    11. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    12. Arild Aakvik & James J. Heckman & Edward J. Vytlacil, 2000. "Treatment Effects for Discrete Outcomes when Responses to Treatment Vary Among Observationally Identical Persons: An Application to Norwegian ..," NBER Technical Working Papers 0262, National Bureau of Economic Research, Inc.
    13. Richard Blundell & Amanda Gosling & Hidehiko Ichimura & Costas Meghir, 2007. "Changes in the Distribution of Male and Female Wages Accounting for Employment Composition Using Bounds," Econometrica, Econometric Society, vol. 75(2), pages 323-363, March.
    14. Carneiro, Pedro & Hansen, Karsten & Heckman, James, 2003. "Estimating distributions of treatment effects with an application to the returns to schooling and measurement of the effects of uncertainty on college choice," Working Paper Series 2003:9, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    15. Anirban Basu & James J. Heckman & Salvador Navarro-Lozano & Sergio Urzua, 2007. "Use of instrumental variables in the presence of heterogeneity and self-selection: an application to treatments of breast cancer patients," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1133-1157.
    16. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    17. Philipp Eisenhauer & James J. Heckman & Edward Vytlacil, 2015. "The Generalized Roy Model and the Cost-Benefit Analysis of Social Programs," Journal of Political Economy, University of Chicago Press, vol. 123(2), pages 413-443.
    18. Manski, Charles F., 2000. "Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice," Journal of Econometrics, Elsevier, vol. 95(2), pages 415-442, April.
    19. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    20. Hidehiko Ichimura & Christopher R. Taber, 2000. "Direct Estimation of Policy Impacts," NBER Technical Working Papers 0254, National Bureau of Economic Research, Inc.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:19:y:2004:i:2:p:203-225. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.