IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v38y2013i5p470-498.html
   My bibliography  Save this article

A Statistical Model for Misreported Binary Outcomes in Clustered RCTs of Education Interventions

Author

Listed:
  • Peter Z. Schochet

    (Mathematica Policy Research, Inc., Princeton, NJ)

Abstract

In education randomized control trials (RCTs), the misreporting of student outcome data could lead to biased estimates of average treatment effects (ATEs) and their standard errors. This article discusses a statistical model that adjusts for misreported binary outcomes for two-level, school-based RCTs, where it is assumed that misreporting could occur for students with truly undesirable outcomes, but not for those with truly desirable outcomes. A latent variable index approach using study baseline data is employed to model both the misreporting and binary outcome decision processes, separately for treatments and controls, using random effects probit models to adjust for school-level clustering. Quasi-Newton maximum likelihood methods are developed to obtain consistent estimates of the ATE parameter and the unobserved misreporting rates. The estimation approach is demonstrated using self-reported arrest data from a large-scale RCT of Job Corps, the nation’s largest residential training program for disadvantaged youths between the ages of 16 and 24.

Suggested Citation

  • Peter Z. Schochet, 2013. "A Statistical Model for Misreported Binary Outcomes in Clustered RCTs of Education Interventions," Journal of Educational and Behavioral Statistics, , vol. 38(5), pages 470-498, October.
    • Handle: RePEc:sae:jedbes:v:38:y:2013:i:5:p:470-498
    DOI: 10.3102/1076998613480393
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998613480393
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998613480393?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jonathan N. Katz & Gabriel Katz, 2010. "Correcting for Survey Misreports Using Auxiliary Information with an Application to Estimating Turnout," American Journal of Political Science, John Wiley & Sons, vol. 54(3), pages 815-835, July.
    2. David Aristei & Luca Pieroni, 2008. "A double-hurdle approach to modelling tobacco consumption in Italy," Applied Economics, Taylor & Francis Journals, vol. 40(19), pages 2463-2476.
    3. Thomas J. Kane & Cecilia Elena Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," NBER Working Papers 7235, National Bureau of Economic Research, Inc.
    4. Butler, J S & Moffitt, Robert, 1982. "A Computationally Efficient Quadrature Procedure for the One-Factor Multinomial Probit Model," Econometrica, Econometric Society, vol. 50(3), pages 761-764, May.
    5. Hausman, J. A. & Abrevaya, Jason & Scott-Morton, F. M., 1998. "Misclassification of the dependent variable in a discrete-response setting," Journal of Econometrics, Elsevier, vol. 87(2), pages 239-269, September.
    6. Deaton, Angus & Irish, Margaret, 1984. "Statistical models for zero expenditures in household budgets," Journal of Public Economics, Elsevier, vol. 23(1-2), pages 59-80.
    7. Jones, Andrew M, 1992. "A Note on Computation of the Double-Hurdle Model with Dependence with an Application to Tobacco Expenditure," Bulletin of Economic Research, Wiley Blackwell, vol. 44(1), pages 67-74, January.
    8. Black, Dan & Sanders, Seth & Taylor, Lowell, 2003. "Measurement of Higher Education in the Census and Current Population Survey," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 545-554, January.
    9. Peter Z. Schochet & John Burghardt & Sheena McConnell, 2008. "Does Job Corps Work? Impact Findings from the National Job Corps Study," American Economic Review, American Economic Association, vol. 98(5), pages 1864-1886, December.
    10. Carol Newman & Maeve Henchion & Alan Matthews, 2003. "A double-hurdle model of Irish household expenditure on prepared meals," Applied Economics, Taylor & Francis Journals, vol. 35(9), pages 1053-1061.
    11. Shew-Jiuan Su & Steven Yen, 2000. "A censored system of cigarette and alcohol consumption," Applied Economics, Taylor & Francis Journals, vol. 32(6), pages 729-737.
    12. repec:fth:prinin:419 is not listed on IDEAS
    13. Cragg, John G, 1971. "Some Statistical Models for Limited Dependent Variables with Application to the Demand for Durable Goods," Econometrica, Econometric Society, vol. 39(5), pages 829-844, September.
    14. repec:mpr:mprres:6097 is not listed on IDEAS
    15. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    16. Blundell, Richard & Meghir, Costas, 1987. "Bivariate alternatives to the Tobit model," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 179-200.
    17. Maki, Atsushi & Nishiyama, Shigeru, 1996. "An analysis of under-reporting for micro-data sets: The misreporting or double-hurdle model," Economics Letters, Elsevier, vol. 52(3), pages 211-220, September.
    18. Lewbel, Arthur, 2000. "Identification Of The Binary Choice Model With Misclassification," Econometric Theory, Cambridge University Press, vol. 16(4), pages 603-609, August.
    19. Jones, Andrew M, 1989. "A Double-Hurdle Model of Cigarette Consumption," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 4(1), pages 23-39, Jan.-Mar..
    20. Thomas J. Kane & Cecilia Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," Working Papers 798, Princeton University, Department of Economics, Industrial Relations Section..
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Aristei & Luca Pieroni, 2008. "A double-hurdle approach to modelling tobacco consumption in Italy," Applied Economics, Taylor & Francis Journals, vol. 40(19), pages 2463-2476.
    2. David Aristei & Federico Perali & Luca Pieroni, 2008. "Cohort, age and time effects in alcohol consumption by Italian households: a double-hurdle approach," Empirical Economics, Springer, vol. 35(1), pages 29-61, August.
    3. Eakins, John, 2016. "An application of the double hurdle model to petrol and diesel household expenditures in Ireland," Transport Policy, Elsevier, vol. 47(C), pages 84-93.
    4. Rong-Chang Jou & Yi-Hao Lu, 2021. "Car/Motorbike Drivers’ Willingness to Use and to Pay for Alcohol Interlock in Taiwan," IJERPH, MDPI, vol. 18(21), pages 1-18, November.
    5. Egemen İPEK, 2019. "An Empirical Study on Alcohol Participation and Consumption Decision in Turkey," Sosyoekonomi Journal, Sosyoekonomi Society, issue 27(41).
    6. David Aristei & Luca Pieroni, 2009. "Addiction, social interactions and gender differences in cigarette consumption," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 36(3), pages 245-272, August.
    7. Bird Chonviharnpan & Phil Lewis, 2018. "The Effects Of Tax Changes On Tobacco Consumption In Thailand," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 63(03), pages 629-646, June.
    8. Federico Perali & David Aristei & Luca Pieroni, 2005. "Cohort analysis of alcohol consumption: a double hurdle approach," CHILD Working Papers wp09_05, CHILD - Centre for Household, Income, Labour and Demographic economics - ITALY.
    9. Brachet, Tanguy, 2008. "Maternal Smoking, Misclassification, and Infant Health," MPRA Paper 21466, University Library of Munich, Germany.
    10. Zhang, Feng & Huang, Chung L. & Lin, Biing-Hwan, 2006. "Modeling Fresh Organic Produce Consumption: A Generalized Double-Hurdle Model Approach," 2006 Annual Meeting, February 5-8, 2006, Orlando, Florida 35435, Southern Agricultural Economics Association.
    11. Rinaldo Brau & M. Lippi Bruni & Am Pinna, 2004. "Public vs private demand for covering long term care expenditures," Working Paper CRENoS 200408, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.
    12. Frank Crowley & John Eakins & Declan Jordan, 2012. "Participation,Expenditure and Regressivity in the Irish Lottery:Evidence from Irish Household Budget Survey 2004/2005," The Economic and Social Review, Economic and Social Studies, vol. 43(2), pages 199-225.
    13. Richard Mussa, 2013. "Rural--urban differences in parental spending on children's primary education in Malawi," Development Southern Africa, Taylor & Francis Journals, vol. 30(6), pages 789-811, December.
    14. Reneé van Eyden, 2012. "Consumer demand for alcoholic beverages and tobacco in Lesotho: A double-hurdle approach," Working Papers 315, Economic Research Southern Africa.
    15. Feng Zhang & Chung L. Huang & Biing-Hwan Lin & James E. Epperson, 2008. "Modeling fresh organic produce consumption with scanner data: a generalized double hurdle model approach," Agribusiness, John Wiley & Sons, Ltd., vol. 24(4), pages 510-522.
    16. Kwamena K. Quagrainie & Jingjie Chu, 2019. "Determinants of Catch Sales in Ghanaian Artisanal Fisheries," Sustainability, MDPI, vol. 11(2), pages 1-10, January.
    17. Mishra, Ashok K. & Williams, Robert P. & Detre, Joshua D., 2009. "Internet Access and Internet Purchasing Patterns of Farm Households," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 38(2), pages 1-18, October.
    18. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    19. Carlin, Paul S. & Flood, Lennart, 1997. "Do children affect the labor supply of Swedish men? Time diary vs. survey data," Labour Economics, Elsevier, vol. 4(2), pages 167-183, June.
    20. Molinari, Francesca, 2008. "Partial identification of probability distributions with misclassified data," Journal of Econometrics, Elsevier, vol. 144(1), pages 81-117, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:38:y:2013:i:5:p:470-498. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.