IDEAS home Printed from https://ideas.repec.org/p/red/sed010/1336.html
   My bibliography  Save this paper

Inference with Imperfect Randomization: The Case of the Perry Preschool Program

Author

Listed:
  • Rodrigo Pinto

    (University of Chicago)

  • Azeem Shaikh

    (University of Chicago)

  • Adam Yavitz

    (University of Chicago)

  • James Heckman

    (University of Chicago)

Abstract

This paper considers the problem of inference about the effect of a program on multiple outcomes when assignment of treatment status is imperfectly randomized. Here, by imperfect randomization we mean that treatment status may have been reassigned after the initial randomization on the basis of observed or unobserved characteristics. We develop our methodology in the context of the High/Scope Perry Preschool program. We find significant effects of the program on a number of different outcomes of interest, including outcomes related to criminal activity for males, even after accounting for the imperfectness of the randomization and the multiplicity of hypotheses. On the other hand, effects of the program on other outcomes of interest, including outcomes related to criminal behavior for females, are no longer significant after more careful scrutiny.

Suggested Citation

  • Rodrigo Pinto & Azeem Shaikh & Adam Yavitz & James Heckman, 2010. "Inference with Imperfect Randomization: The Case of the Perry Preschool Program," 2010 Meeting Papers 1336, Society for Economic Dynamics.
  • Handle: RePEc:red:sed010:1336
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. James J. Heckman & Ganesh Karapakula, 2019. "The Perry Preschoolers at Late Midlife: A Study in Design-Specific Inference," Working Papers 2019-034, Human Capital and Economic Opportunity Working Group.
    2. Heckman, James J. & Moon, Seong Hyeok & Pinto, Rodrigo & Savelyev, Peter A. & Yavitz, Adam, 2010. "The rate of return to the HighScope Perry Preschool Program," Journal of Public Economics, Elsevier, vol. 94(1-2), pages 114-128, February.
    3. Joseph P. Romano & Michael Wolf, 2005. "Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 94-108, March.
    4. James Heckman & Rodrigo Pinto & Peter Savelyev, 2013. "Understanding the Mechanisms through Which an Influential Early Childhood Program Boosted Adult Outcomes," American Economic Review, American Economic Association, vol. 103(6), pages 2052-2086, October.
    5. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.
    6. James Heckman & Seong Hyeok Moon & Rodrigo Pinto & Peter Savelyev & Adam Yavitz, 2010. "Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program," Quantitative Economics, Econometric Society, vol. 1(1), pages 1-46, July.
    7. Joseph P. Romano & Azeem M. Shaikh, 2010. "Inference for the Identified Set in Partially Identified Econometric Models," Econometrica, Econometric Society, vol. 78(1), pages 169-211, January.
    8. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(2), pages 404-447, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2018. "Inference Under Covariate-Adaptive Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1784-1796, October.
    2. Aviva Aron-Dine & Liran Einav & Amy Finkelstein, 2013. "The RAND Health Insurance Experiment, Three Decades Later," Journal of Economic Perspectives, American Economic Association, vol. 27(1), pages 197-222, Winter.
    3. Arouna, Aminou & Michler, Jeffrey D. & Lokossou, Jourdain C., 2021. "Contract farming and rural transformation: Evidence from a field experiment in Benin," Journal of Development Economics, Elsevier, vol. 151(C).
    4. Daniela Del Boca & Christopher Flinn & Matthew Wiswall, 2016. "Transfers to Households with Children and Child Development," Economic Journal, Royal Economic Society, vol. 126(596), pages 136-183, October.
    5. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    6. Sneha Elango & Jorge Luis García & James J. Heckman & Andrés Hojman, 2015. "Early Childhood Education," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 235-297, National Bureau of Economic Research, Inc.
    7. James J. Heckman & Ganesh Karapakula, 2019. "The Perry Preschoolers at Late Midlife: A Study in Design-Specific Inference," Working Papers 2019-034, Human Capital and Economic Opportunity Working Group.
    8. Jeffrey D. Michler & Anna Josephson, 2021. "Recent Developments in Inference: Practicalities for Applied Economics," Papers 2107.09736, arXiv.org.
    9. Azeem M. Shaikh, 2019. "Inference in Experiments with Matched Pairs," CeMMAP working papers CWP19/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Asoni, Andrea, 2011. "Intelligence, Self-confidence and Entrepreneurship," Working Paper Series 887, Research Institute of Industrial Economics.
    11. Filatriau, Olivier & Fougère, Denis & Tô, Maxime, 2013. "Will Sooner Be Better? The Impact of Early Preschool Enrollment on Cognitive and Noncognitive Achievement of Children," CEPR Discussion Papers 9480, C.E.P.R. Discussion Papers.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Doyle, Orla & Harmon, Colm & Heckman, James J. & Logue, Caitriona & Moon, Seong Hyeok, 2017. "Early skill formation and the efficiency of parental investment: A randomized controlled trial of home visiting," Labour Economics, Elsevier, vol. 45(C), pages 40-58.
    2. Ganesh Karapakula & James J. Heckman, 2020. "Using a Satisficing Model of Experimenter Decision-Making to Guide Finite-Sample Inference for Compromised Experiments," Working Papers 2020-063, Human Capital and Economic Opportunity Working Group.
    3. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Yann Algan & Elizabeth Beasley & Frank Vitaro & Richard Tremblay, 2014. "The Impact of Non-Cognitive Skills Training on Academic and Non-academic Trajectories: From Childhood to Early Adulthood," Sciences Po publications info:hdl:2441/6s39gt704s9, Sciences Po.
    5. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    6. James J. Heckman & Stefano Mosso, 2014. "The Economics of Human Development and Social Mobility," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 689-733, August.
    7. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, Oxford University Press, vol. 126(4), pages 1593-1660.
    8. Anthony Bald & Eric Chyn & Justine S. Hastings & Margarita Machelett, 2019. "The Causal Impact of Removing Children from Abusive and Neglectful Homes," Working Papers 2019-001, Human Capital and Economic Opportunity Working Group.
    9. Orla Doyle & Colm Harmon & James J. Heckman & Caitriona Logue & Seong Moon, 2013. "Measuring Investment in Human Capital Formation: An Experimental Analysis of Early Life Outcomes," NBER Working Papers 19316, National Bureau of Economic Research, Inc.
    10. Sandner, Malte & Jungmann, Tanja, 2017. "Gender-specific effects of early childhood intervention: Evidence from a randomized controlled trial," Labour Economics, Elsevier, vol. 45(C), pages 59-78.
    11. Orla Doyle, 2017. "The First 2,000 Days and Child Skills: Evidence from a Randomized Experiment of Home Visiting," Working Papers 2017-054, Human Capital and Economic Opportunity Working Group.
    12. Filatriau, Olivier & Fougère, Denis & Tô, Maxime, 2013. "Will Sooner Be Better? The Impact of Early Preschool Enrollment on Cognitive and Noncognitive Achievement of Children," CEPR Discussion Papers 9480, C.E.P.R. Discussion Papers.
    13. Yann Algan & Elizabeth Beasley & Frank Vitaro & Richard E Tremblay, 2014. "The Impact of Non-Cognitive Skills Training on Academic and Non-academic Trajectories: From Childhood to Early Adulthood," Sciences Po publications info:hdl:2441/6s39gt704s9, Sciences Po.
    14. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    15. Peter A. Savelyev & Kegon T. K. Tan, 2019. "Socioemotional Skills, Education, and Health-Related Outcomes of High-Ability Individuals," American Journal of Health Economics, MIT Press, vol. 5(2), pages 250-280, Spring.
    16. Conti, Gabriella & Heckman, James J., 2012. "The Economics of Child Well-Being," IZA Discussion Papers 6930, Institute of Labor Economics (IZA).
    17. Orla Doyle, 2020. "Can Early Intervention have a Sustained Effect on Human Capital?," Working Papers 202001, Geary Institute, University College Dublin.
    18. John List & Azeem Shaikh & Atom Vayalinkal, 2021. "Multiple Testing with Covariate Adjustment in Experimental Economics," Natural Field Experiments 00732, The Field Experiments Website.
    19. Eiji Yamamura, 2017. "Historical education levels and present-day non-cognitive skills," Journal of Economics and Econometrics, Economics and Econometrics Society, vol. 60(1), pages 28-51.
    20. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.

    More about this item

    JEL classification:

    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • J13 - Labor and Demographic Economics - - Demographic Economics - - - Fertility; Family Planning; Child Care; Children; Youth

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:red:sed010:1336. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/sedddea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christian Zimmermann (email available below). General contact details of provider: https://edirc.repec.org/data/sedddea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.