IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2403.16177.html
   My bibliography  Save this paper

The Informativeness of Combined Experimental and Observational Data under Dynamic Selection

Author

Listed:
  • Yechan Park
  • Yuya Sasaki

Abstract

This paper addresses the challenge of estimating the Average Treatment Effect on the Treated Survivors (ATETS; Vikstrom et al., 2018) in the absence of long-term experimental data, utilizing available long-term observational data instead. We establish two theoretical results. First, it is impossible to obtain informative bounds for the ATETS with no model restriction and no auxiliary data. Second, to overturn this negative result, we explore as a promising avenue the recent econometric developments in combining experimental and observational data (e.g., Athey et al., 2020, 2019); we indeed find that exploiting short-term experimental data can be informative without imposing classical model restrictions. Furthermore, building on Chesher and Rosen (2017), we explore how to systematically derive sharp identification bounds, exploiting both the novel data-combination principles and classical model restrictions. Applying the proposed method, we explore what can be learned about the long-run effects of job training programs on employment without long-term experimental data.

Suggested Citation

  • Yechan Park & Yuya Sasaki, 2024. "The Informativeness of Combined Experimental and Observational Data under Dynamic Selection," Papers 2403.16177, arXiv.org.
  • Handle: RePEc:arx:papers:2403.16177
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2403.16177
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Vikström, Johan & Ridder, Geert & Weidner, Martin, 2018. "Bounds on treatment effects on transitions," Journal of Econometrics, Elsevier, vol. 205(2), pages 448-469.
    2. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    3. Charles F. Manski, 1997. "Monotone Treatment Response," Econometrica, Econometric Society, vol. 65(6), pages 1311-1334, November.
    4. Jia, Zhiyang & Vattø, Trine Engh, 2021. "Predicting the path of labor supply responses when state dependence matters," Labour Economics, Elsevier, vol. 71(C).
    5. Andrew Chesher & Adam M. Rosen, 2017. "Generalized Instrumental Variable Models," Econometrica, Econometric Society, vol. 85, pages 959-989, May.
    6. Susan Athey & Raj Chetty & Guido Imbens, 2020. "Combining Experimental and Observational Data to Estimate Treatment Effects on Long Term Outcomes," Papers 2006.09676, arXiv.org.
    7. Card, David & Sullivan, Daniel G, 1988. "Measuring the Effect of Subsidized Training Programs on Movements in and out of Employment," Econometrica, Econometric Society, vol. 56(3), pages 497-530, May.
    8. Yanqin Fan & Robert Sherman & Matthew Shum, 2014. "Identifying Treatment Effects Under Data Combination," Econometrica, Econometric Society, vol. 82(2), pages 811-822, March.
    9. Knights, Stephen & Harris, Mark N & Loundes, Joanne, 2002. "Dynamic Relationships in the Australian Labour Market: Heterogeneity and State Dependence," The Economic Record, The Economic Society of Australia, vol. 78(242), pages 284-298, September.
    10. Jan C. van Ours, 2000. "Do Active Labor Market Policies Help Unemployed Workers to Find and Keep Regular Jobs?," William Davidson Institute Working Papers Series 289, William Davidson Institute at the University of Michigan.
    11. Susan Athey & Raj Chetty & Guido W. Imbens & Hyunseung Kang, 2019. "The Surrogate Index: Combining Short-Term Proxies to Estimate Long-Term Treatment Effects More Rapidly and Precisely," NBER Working Papers 26463, National Bureau of Economic Research, Inc.
    12. Alexander Torgovitsky, 2019. "Nonparametric Inference on State Dependence in Unemployment," Econometrica, Econometric Society, vol. 87(5), pages 1475-1505, September.
    13. Gritz, R. Mark, 1993. "The impact of training on the frequency and duration of employment," Journal of Econometrics, Elsevier, vol. 57(1-3), pages 21-51.
    14. Nathan Kallus & Xiaojie Mao & Angela Zhou, 2022. "Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combination," Management Science, INFORMS, vol. 68(3), pages 1959-1981, March.
    15. Stephen Knights & Mark N. Harris & Joanne Loundes, 2002. "Dynamic Relationships in the Australian Labour Market: Heterogeneity and State Dependence," The Economic Record, The Economic Society of Australia, vol. 78(242), pages 284-298, September.
    16. Ham, John C & LaLonde, Robert J, 1996. "The Effect of Sample Selection and Initial Conditions in Duration Models: Evidence from Experimental Data on Training," Econometrica, Econometric Society, vol. 64(1), pages 175-205, January.
    17. Ridder, G, 1986. "An Event History Approach to the Evaluation of Training, Recruitment and Employment Programmes," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 1(2), pages 109-126, April.
    18. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, September.
    19. Vikström, Johan & Ridder, Geert & Weidner, Martin, 2018. "Bounds on treatment effects on transitions," Journal of Econometrics, Elsevier, vol. 205(2), pages 448-469.
    20. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vikström, Johan & Ridder, Geert & Weidner, Martin, 2018. "Bounds on treatment effects on transitions," Journal of Econometrics, Elsevier, vol. 205(2), pages 448-469.
    2. Arild Aakvik & James J. Heckman & Edward J. Vytlacil, 2000. "Treatment Effects for Discrete Outcomes when Responses to Treatment Vary Among Observationally Identical Persons: An Application to Norwegian ..," NBER Technical Working Papers 0262, National Bureau of Economic Research, Inc.
    3. Johan Vikström & Geert Ridder & Martin Weidner, 2016. "Bounds On Treatment Effects On Transitions," CeMMAP working papers 17/16, Institute for Fiscal Studies.
    4. Johan Vikström & Geert Ridder & Martin Weidner, 2015. "Bounds on treatment effects on transitions," CeMMAP working papers 01/15, Institute for Fiscal Studies.
    5. Van den Berg, Gerard J., 2001. "Duration models: specification, identification and multiple durations," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 55, pages 3381-3460, Elsevier.
    6. Falavigna Falavigna & Elena Ragazzi & Lisa Sella, "undated". "Vocational training and labour market: inclusion or segregation paths? An integrated approach on immigrant trainees in Piedmont," CERIS Working Paper 201425, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    7. Gaure, Simen & Roed, Knut & Zhang, Tao, 2007. "Time and causality: A Monte Carlo assessment of the timing-of-events approach," Journal of Econometrics, Elsevier, vol. 141(2), pages 1159-1195, December.
    8. Jaap Abbring & James Heckman, 2008. "Dynamic policy analysis," CeMMAP working papers CWP05/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Aakvik, Arild & Heckman, James J. & Vytlacil, Edward J., 2005. "Estimating treatment effects for discrete outcomes when responses to treatment vary: an application to Norwegian vocational rehabilitation programs," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 15-51.
    10. Han, Sukjin, 2021. "Identification in nonparametric models for dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 132-147.
    11. Kraus, Florian & Puhani, Patrick A. & Steiner, Viktor, 1997. "Employment Effects of Publicly Financed Training Programs The East German Experience," ZEW Discussion Papers 97-33, ZEW - Leibniz Centre for European Economic Research.
    12. Rodokanakis Stavros, 2009. "Comparing the Probability of Unemployment in Southern Greece Vis-À-Vis the Entire Country," Bulletin of Geography. Socio-economic Series, Sciendo, vol. 12(12), pages 17-43, January.
    13. Picchio, Matteo & van Ours, Jan C., 2013. "Retaining through training even for older workers," Economics of Education Review, Elsevier, vol. 32(C), pages 29-48.
    14. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    15. van Ours, Jan C., 2004. "The locking-in effect of subsidized jobs," Journal of Comparative Economics, Elsevier, vol. 32(1), pages 37-55, March.
    16. Konstantinos Tatsiramos, 2009. "Unemployment Insurance in Europe: Unemployment Duration and Subsequent Employment Stability," Journal of the European Economic Association, MIT Press, vol. 7(6), pages 1225-1260, December.
    17. van Ours, Jan C. & Lalive, Rafael & Arni, Patrick, 2009. "How Effective Are Unemployment Benefit Sanctions?," CEPR Discussion Papers 7541, C.E.P.R. Discussion Papers.
    18. Stavros Rodokanakis, 2010. "A Non-Experimental Evaluation of Unemployment Risk in Crete and the Ionian Islands: Regional Evidence for Greece," Acta Oeconomica Pragensia, Prague University of Economics and Business, vol. 2010(4), pages 44-63.
    19. Rodokanakis Stavros, 2010. "The Dynamics of Regional Labour Markets and Training Programmes: Greek Evidence," European Spatial Research and Policy, Sciendo, vol. 17(1), pages 93-115, June.
    20. F. Alfonso Arellano, 2010. "Do Training Programmes Get The Unemployed Back To Work? A Look At The Spanish Experience," Revista de Economia Aplicada, Universidad de Zaragoza, Departamento de Estructura Economica y Economia Publica, vol. 18(2), pages 39-65, Autumn.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2403.16177. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.