IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v48y2023i4p387-419.html
   My bibliography  Save this article

A Causal Latent Transition Model With Multivariate Outcomes and Unobserved Heterogeneity: Application to Human Capital Development

Author

Listed:
  • Francesco Bartolucci

    (University of Perugia)

  • Fulvia Pennoni
  • Giorgio Vittadini

    (University of Milano-Bicocca)

Abstract

In order to evaluate the effect of a policy or treatment with pre- and post-treatment outcomes, we propose an approach based on a transition model, which may be applied with multivariate outcomes and accounts for unobserved heterogeneity. This model is based on potential versions of discrete latent variables representing the individual characteristic of interest and may be cast in the hidden (latent) Markov literature for panel data. Therefore, it can be estimated by maximum likelihood in a relatively simple way. The approach extends the difference-in-difference method as it is possible to deal with multivariate outcomes. Moreover, causal effects may be expressed with respect to transition probabilities. The proposal is validated through a simulation study, and it is applied to evaluate educational programs administered to pupils in the sixth and seventh grades during their middle school period. These programs are carried out in an Italian region to improve non-cognitive skills (CSs). We study if they impact also on students’ CSs in Italian and Mathematics in the eighth grade, exploiting the pretreatment test scores available in the fifth grade. The main conclusion is that the educational programs aimed to develop noncognitive abilities help the best students to maintain their higher cognitive abilities over time.

Suggested Citation

  • Francesco Bartolucci & Fulvia Pennoni & Giorgio Vittadini, 2023. "A Causal Latent Transition Model With Multivariate Outcomes and Unobserved Heterogeneity: Application to Human Capital Development," Journal of Educational and Behavioral Statistics, , vol. 48(4), pages 387-419, August.
    • Handle: RePEc:sae:jedbes:v:48:y:2023:i:4:p:387-419
    DOI: 10.3102/10769986221150033
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986221150033
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986221150033?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Karsten T. & Heckman, James J. & Mullen, K.J.Kathleen J., 2004. "The effect of schooling and ability on achievement test scores," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 39-98.
    2. James Heckman & Flavio Cunha, 2007. "The Technology of Skill Formation," American Economic Review, American Economic Association, vol. 97(2), pages 31-47, May.
    3. Valentino Dardanoni & Giuseppe De Luca & Salvatore Modica & Franco Peracchi, 2012. "A generalized missing-indicator approach to regression with imputed covariates," Stata Journal, StataCorp LP, vol. 12(4), pages 575-604, December.
    4. Martins, Pedro S., 2010. "Can Targeted, Non-Cognitive Skills Programs Improve Achievement? Evidence from EPIS," IZA Discussion Papers 5266, Institute of Labor Economics (IZA).
    5. Heckman, James J. & Kautz, Tim, 2012. "Hard evidence on soft skills," Labour Economics, Elsevier, vol. 19(4), pages 451-464.
    6. Per-Anders Edin & Peter Fredriksson & Martin Nybom & Björn Öckert, 2022. "The Rising Return to Noncognitive Skill," American Economic Journal: Applied Economics, American Economic Association, vol. 14(2), pages 78-100, April.
    7. Francesco Bartolucci & Fulvia Pennoni & Giorgio Vittadini, 2016. "Causal Latent Markov Model for the Comparison of Multiple Treatments in Observational Longitudinal Studies," Journal of Educational and Behavioral Statistics, , vol. 41(2), pages 146-179, April.
    8. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    9. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    10. Francesco Bartolucci & Fulvia Pennoni & Giorgio Vittadini, 2011. "Assessment of School Performance Through a Multilevel Latent Markov Rasch Model," Journal of Educational and Behavioral Statistics, , vol. 36(4), pages 491-522, August.
    11. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 473-522, June.
    12. Lee, Myoung-jae, 2016. "Matching, Regression Discontinuity, Difference in Differences, and Beyond," OUP Catalogue, Oxford University Press, number 9780190258740.
    13. Cunha, Flavio & Heckman, James J. & Lochner, Lance, 2006. "Interpreting the Evidence on Life Cycle Skill Formation," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 1, chapter 12, pages 697-812, Elsevier.
    14. Lechner, Michael, 2011. "The Estimation of Causal Effects by Difference-in-Difference Methods," Foundations and Trends(R) in Econometrics, now publishers, vol. 4(3), pages 165-224, November.
    15. Alberto Abadie, 2005. "Semiparametric Difference-in-Differences Estimators," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(1), pages 1-19.
    16. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Rejoinder on: Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 484-486, September.
    17. Puhani, Patrick A., 2012. "The treatment effect, the cross difference, and the interaction term in nonlinear “difference-in-differences” models," Economics Letters, Elsevier, vol. 115(1), pages 85-87.
    18. repec:hal:journl:peer-00815561 is not listed on IDEAS
    19. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    20. Helena Holmlund & Olmo Silva, 2014. "Targeting Noncognitive Skills to Improve Cognitive Outcomes: Evidence from a Remedial Education Intervention," Journal of Human Capital, University of Chicago Press, vol. 8(2), pages 126-160.
    21. Gary S. Becker, 1994. "Human Capital: A Theoretical and Empirical Analysis with Special Reference to Education, Third Edition," NBER Books, National Bureau of Economic Research, Inc, number beck94-1, March.
    22. Dardanoni, Valentino & Modica, Salvatore & Peracchi, Franco, 2011. "Regression with imputed covariates: A generalized missing-indicator approach," Journal of Econometrics, Elsevier, vol. 162(2), pages 362-368, June.
    23. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    24. Flavio Cunha & James J. Heckman, 2008. "Formulating, Identifying and Estimating the Technology of Cognitive and Noncognitive Skill Formation," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    25. Heckman, James J. & Humphries, John Eric & Kautz, Tim (ed.), 2014. "The Myth of Achievement Tests," University of Chicago Press Economics Books, University of Chicago Press, number 9780226100098, September.
    26. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 433-465, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kautz, Tim & Heckman, James J. & Diris, Ron & ter Weel, Bas & Borghans, Lex, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," IZA Discussion Papers 8696, Institute of Labor Economics (IZA).
    2. James Heckman & Tim Kautz, 2013. "Fostering and Measuring Skills: Interventions That Improve Character and Cognition," Working Papers 2013-019, Human Capital and Economic Opportunity Working Group.
    3. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory & Urzua, Sergio, 2014. "Education, Health and Wages," IZA Discussion Papers 8027, Institute of Labor Economics (IZA).
    4. Elke Lüdemann, 2011. "Schooling and the Formation of Cognitive and Non-cognitive Outcomes," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 39.
    5. Daniel Gladwell & Gurleen Popli & Aki Tsuchiya, 2022. "Predictors of becoming not in education, employment or training: A dynamic comparison of the direct and indirect determinants," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S2), pages 485-514, December.
    6. James J. Heckman & Tomáš Jagelka & Timothy D. Kautz, 2019. "Some Contributions of Economics to the Study of Personality," NBER Working Papers 26459, National Bureau of Economic Research, Inc.
    7. Flèche, Sarah & Lekfuangfu, Warn N. & Clark, Andrew E., 2021. "The long-lasting effects of family and childhood on adult wellbeing: Evidence from British cohort data," Journal of Economic Behavior & Organization, Elsevier, vol. 181(C), pages 290-311.
    8. James J. Heckman & Stefano Mosso, 2014. "The Economics of Human Development and Social Mobility," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 689-733, August.
    9. Vittadini, Giorgio & Sturaro, Caterina & Folloni, Giuseppe, 2022. "Non-Cognitive Skills and Cognitive Skills to measure school efficiency," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    10. Hille, Adrian & Schupp, Jürgen, 2015. "How Learning a Musical Instrument Affects the Development of Skills," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 44, pages 56-82.
    11. Thiel, Hendrik & Thomsen, Stephan L., 2013. "Noncognitive skills in economics: Models, measurement, and empirical evidence," Research in Economics, Elsevier, vol. 67(2), pages 189-214.
    12. Heckman, James J. & Kautz, Tim, 2012. "Hard evidence on soft skills," Labour Economics, Elsevier, vol. 19(4), pages 451-464.
    13. Heckman, James J. & Raut, Lakshmi K., 2016. "Intergenerational long-term effects of preschool-structural estimates from a discrete dynamic programming model," Journal of Econometrics, Elsevier, vol. 191(1), pages 164-175.
    14. Elizabeth M. Caucutt & Lance Lochner, 2020. "Early and Late Human Capital Investments, Borrowing Constraints, and the Family," Journal of Political Economy, University of Chicago Press, vol. 128(3), pages 1065-1147.
    15. Flavio Cunha & James J. Heckman, 2009. "The Economics and Psychology of Inequality and Human DEvelopment," Journal of the European Economic Association, MIT Press, vol. 7(2-3), pages 320-364, 04-05.
    16. James J. Heckman, 2008. "Schools, Skills, And Synapses," Economic Inquiry, Western Economic Association International, vol. 46(3), pages 289-324, July.
    17. Francesconi, Marco & Heckman, James J, 2015. "Symposium on Child Development and Parental Investment: Introduction," Economics Discussion Papers 16868, University of Essex, Department of Economics.
    18. Elizabeth M. Caucutt & Lance Lochner & Youngmin Park, 2017. "Correlation, Consumption, Confusion, or Constraints: Why Do Poor Children Perform so Poorly?," Scandinavian Journal of Economics, Wiley Blackwell, vol. 119(1), pages 102-147, January.
    19. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:48:y:2023:i:4:p:387-419. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.