IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp4700.html
   My bibliography  Save this paper

Treatment Evaluation in the Case of Interactions within Markets

Author

Listed:
  • Ferracci, Marc

    (CREST-INSEE)

  • Jolivet, Grégory

    (University of Bristol)

  • van den Berg, Gerard J.

    (University of Groningen)

Abstract

We extend the standard evaluation framework to allow for interactions between individuals within segmented markets. An individual's outcome depends not only on the assigned treatment status but also on (features of) the distribution of the assigned treatments in his market. To evaluate how the distribution of treatments within a market causally affects the average effect within the market, averaged over the full population, we develop an identification and estimation method in two steps. The first one focuses on the distribution of the treatment within markets and between individuals and the second step addresses the distribution of the treatment between markets. We apply our method to data on training programs for unemployed workers in France. We use a rich administrative register of unemployment and training spells as well as the information on local labor demand that is used by unemployment agencies to allocate training programs. The results show that the average treatment effect on the employment rate causally decreases with respect to the proportion treated in the market. Our analysis accounts for unobserved heterogeneity between markets (using the longitudinal dimension of the data) and, in a robustness check, between individuals.

Suggested Citation

  • Ferracci, Marc & Jolivet, Grégory & van den Berg, Gerard J., 2010. "Treatment Evaluation in the Case of Interactions within Markets," IZA Discussion Papers 4700, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp4700
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp4700.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
    2. Pierre Cahuc & Bruno Crépon & Julien Guitard & Marc Gurgand, 2008. "Policy Evaluation in Equilibrium The Case of Job Searcg Counseling in France," Working Papers 2008-13, Center for Research in Economics and Statistics.
    3. Jeffrey Smith & Jeremy Lise & Shannon N. Seitz, 2003. "Equilibrium Policy Experiments And The Evaluation Of Social Programs," Working Paper 1012, Economics Department, Queen's University.
    4. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    5. Heckman, James J & Lochner, Lance & Taber, Christopher, 1998. "General-Equilibrium Treatment Effects: A Study of Tuition Policy," American Economic Review, American Economic Association, vol. 88(2), pages 381-386, May.
    6. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    7. Frölich, Markus & Michaelowa, Katharina, 2004. "Peer effects and textbooks in primary education: Evidence from francophone sub-Saharan Africa," HWWA Discussion Papers 311, Hamburg Institute of International Economics (HWWA).
    8. Bruno Crépon & Marc Ferracci & Grégory Jolivet & Gerard J. van den Berg, 2009. "Active Labor Market Policy Effects in a Dynamic Setting," Journal of the European Economic Association, MIT Press, vol. 7(2-3), pages 595-605, 04-05.
    9. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    10. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    11. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, June.
    12. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    13. Bruno Crépon & Marc Ferracci & Denis Fougere, 2012. "Training the Unemployed in France: How Does it Affect Unemployment Duration and Recurrence?," Annals of Economics and Statistics, GENES, issue 107-108, pages 175-199.
    14. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    15. Giorgio Topa, 2001. "Social Interactions, Local Spillovers and Unemployment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 68(2), pages 261-295.
    16. Donald B. Rubin, 1977. "Assignment to Treatment Group on the Basis of a Covariate," Journal of Educational and Behavioral Statistics, , vol. 2(1), pages 1-26, March.
    17. Bhattacharya, Debopam & Dupas, Pascaline, 2012. "Inferring welfare maximizing treatment assignment under budget constraints," Journal of Econometrics, Elsevier, vol. 167(1), pages 168-196.
    18. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    19. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Huber, Martin & Steinmayr, Andreas, 2017. "A Framework for Separating Individual Treatment Effects From Spillover, Interaction, and General Equilibrium Effects," Rationality and Competition Discussion Paper Series 21, CRC TRR 190 Rationality and Competition.
    2. Saez, Emmanuel & Landais, Camille & Michaillat, Pascal, 2010. "Optimal Unemployment Insurance over the Business Cycle," CEPR Discussion Papers 8132, C.E.P.R. Discussion Papers.
    3. Rafael Lalive & Camille Landais & Josef Zweimüller, 2015. "Market Externalities of Large Unemployment Insurance Extension Programs," American Economic Review, American Economic Association, vol. 105(12), pages 3564-3596, December.
    4. Goulas, Eleftherios & Zervoyianni, Athina, 2018. "Active labour-market policies and output growth: Is there a causal relationship?," Economic Modelling, Elsevier, vol. 73(C), pages 1-14.
    5. Ronald Wolthoff, 2014. "It'S About Time: Implications Of The Period Length In An Equilibrium Search Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55(3), pages 839-867, August.
    6. Blasco, Sylvie & Pertold-Gebicka, Barbara, 2013. "Employment policies, hiring practices and firm performance," Labour Economics, Elsevier, vol. 25(C), pages 12-24.
    7. Marios Michaelides & Peter Mueser, 2018. "Are Reemployment Services Effective? Experimental Evidence from the Great Recession," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 37(3), pages 546-570, June.
    8. Pieter Gautier & Paul Muller & Bas van der Klaauw & Michael Rosholm & Michael Svarer, 2018. "Estimating Equilibrium Effects of Job Search Assistance," Journal of Labor Economics, University of Chicago Press, vol. 36(4), pages 1073-1125.
    9. Jesse Rothstein & Till von Wachter, 2016. "Social Experiments in the Labor Market," NBER Working Papers 22585, National Bureau of Economic Research, Inc.
    10. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    11. Dayanand S. Manoli & Marios Michaelides & Ankur Patel, 2018. "Long-Term and Heterogeneous Effects of Job-Search Assistance," NBER Working Papers 24422, National Bureau of Economic Research, Inc.
    12. Marco Caliendo & Steffen Künn, 2015. "Getting back into the labor market: the effects of start-up subsidies for unemployed females," Journal of Population Economics, Springer;European Society for Population Economics, vol. 28(4), pages 1005-1043, October.
    13. Bruno Crepon & Marc Ferracci & Grégory Jolivet & Gerard Van Den Berg, 2010. "Analyzing the Anticipation of Treatments with Data on Notification Dates," Working Papers 2010-41, Center for Research in Economics and Statistics.
    14. Andrew C. Johnston & Alexandre Mas, 2018. "Potential Unemployment Insurance Duration and Labor Supply: The Individual and Market-Level Response to a Benefit Cut," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2480-2522.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Gerard J. van den Berg & Petyo Bonev & Enno Mammen, 2020. "Nonparametric Instrumental Variable Methods for Dynamic Treatment Evaluation," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 355-367, May.
    3. Volpe Martincus, Christian & Carballo, Jerónimo, 2010. "Beyond the average effects: The distributional impacts of export promotion programs in developing countries," Journal of Development Economics, Elsevier, vol. 92(2), pages 201-214, July.
    4. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    5. Volpe Martincus, Christian & Carballo, Jerónimo, 2010. "Beyond the average effects: The distributional impacts of export promotion programs in developing countries," Journal of Development Economics, Elsevier, vol. 92(2), pages 201-214, July.
    6. Aderonke Osikominu, 2013. "Quick Job Entry or Long-Term Human Capital Development? The Dynamic Effects of Alternative Training Schemes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(1), pages 313-342.
    7. Stephan, Gesine & Pahnke, André, 2008. "The Relative Effectiveness of Selected Active Labour Market Programmes and the Common Support Problem," IZA Discussion Papers 3767, Institute of Labor Economics (IZA).
    8. Andersson, Fredrik W. & Holzer, Harry J. & Lane, Julia & Rosenblum, David & Smith, Jeffrey A., 2013. "Does Federally-Funded Job Training Work? Nonexperimental Estimates of WIA Training Impacts Using Longitudinal Data on Workers and Firms," IZA Discussion Papers 7621, Institute of Labor Economics (IZA).
    9. Christian Volpe Martincus, 2010. "Odyssey in International Markets: An Assessment of the Effectiveness of Export Promotion in Latin America and the Caribbean," IDB Publications (Books), Inter-American Development Bank, number 16458, February.
    10. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    11. Muller, Paul & van der Klaauw, Bas & Heyma, Arjan, 2017. "Comparing Econometric Methods to Empirically Evaluate Job-Search Assistance," IZA Discussion Papers 10531, Institute of Labor Economics (IZA).
    12. Andrea Morescalchi, 2021. "A new career in a new town. Job search methods and regional mobility of unemployed workers," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 20(2), pages 223-272, May.
    13. Rafael Perez Ribas & Fabio Veras Soares & Clarissa Teixeira & Elydia Silva & Guilherme Hirata, 2011. "Externality and Behavioural Change Effects of a Non-randomised CCT Programme: Heterogeneous Impact on the Demand for Health and Education," Working Papers PIERI 2011-19, PEP-PIERI.
    14. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    15. Rafael Perez Ribas & Fabio Veras Soares & Clarissa Gondim Teixeira & Elydia Silva & Guilherme Issamu Hirata, 2010. "Beyond Cash: Assessing Externality and Behaviour Effects of Non-Experimental Cash Transfers," Working Papers 65, International Policy Centre for Inclusive Growth.
    16. Zeqin Liu & Zongwu Cai & Ying Fang & Ming Lin, 2019. "Statistical Analysis and Evaluation of Macroeconomic Policies: A Selective Review," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201904, University of Kansas, Department of Economics, revised Mar 2019.
    17. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    18. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc.
    19. Rodríguez-Planas, Núria, 2007. "What Works Best for Getting the Unemployed Back to Work: Employment Services or Small-Business Assistance Programmes? Evidence from Romania," IZA Discussion Papers 3051, Institute of Labor Economics (IZA).
    20. Pieter Gautier & Paul Muller & Bas van der Klaauw & Michael Rosholm & Michael Svarer, 2018. "Estimating Equilibrium Effects of Job Search Assistance," Journal of Labor Economics, University of Chicago Press, vol. 36(4), pages 1073-1125.

    More about this item

    Keywords

    treatment evaluation; equilibrium effects; matching estimators;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp4700. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.