IDEAS home Printed from https://ideas.repec.org/p/csa/wpaper/2020-20.html

An Adaptive Targeted Field Experiment: Job Search Assistance for Refugees in Jordan

Author

Listed:
  • A. Stefano Caria
  • Grant Gordon
  • Maximilian Kasy
  • Simon Quinn
  • Soha Shami
  • Alexander Teytelboym

Abstract

We introduce a novel adaptive targeted treatment assignment methodology for field experiments. Our Tempered Thompson Algorithm balances the goals of maximiz¬ing the precision of treatment effect estimates and maximizing the welfare of exper¬imental participants. A hierarchical Bayesian model allows us to adaptively target treatments. We implement our methodology in Jordan, testing policies to help Syr¬ian refugees and local jobseekers to find work. The immediate employment impacts of a small cash grant, information and psychological support are close to zero, but targeting raises employment by 1 percentage-point (20%). After four months, cash has a sizable effect on employment and earnings of Syrians.

Suggested Citation

  • A. Stefano Caria & Grant Gordon & Maximilian Kasy & Simon Quinn & Soha Shami & Alexander Teytelboym, 2020. "An Adaptive Targeted Field Experiment: Job Search Assistance for Refugees in Jordan," CSAE Working Paper Series 2020-20, Centre for the Study of African Economies, University of Oxford.
    • Handle: RePEc:csa:wpaper:2020-20
    as

    Download full text from publisher

    File URL: https://ora.ox.ac.uk/objects/uuid:a66e11df-36ae-4413-9460-b4f345ebadb0
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    2. David McKenzie, 2017. "How Effective Are Active Labor Market Policies in Developing Countries? A Critical Review of Recent Evidence," The World Bank Research Observer, World Bank, vol. 32(2), pages 127-154.
    3. Kasy, Maximilian, 2018. "Optimal taxation and insurance using machine learning — Sufficient statistics and beyond," Journal of Public Economics, Elsevier, vol. 167(C), pages 205-219.
    4. Clare Balboni & Oriana Bandiera & Robin Burgess & Maitreesh Ghatak & Anton Heil, 2023. "Why Do People Stay Poor?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(2), pages 785-844.
    5. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    6. Susan Athey & Raj Chetty & Guido W. Imbens & Hyunseung Kang, 2019. "The Surrogate Index: Combining Short-Term Proxies to Estimate Long-Term Treatment Effects More Rapidly and Precisely," NBER Working Papers 26463, National Bureau of Economic Research, Inc.
    7. Martin Abel & Rulof Burger & Eliana Carranza & Patrizio Piraino, 2019. "Bridging the Intention-Behavior Gap? The Effect of Plan-Making Prompts on Job Search and Employment," American Economic Journal: Applied Economics, American Economic Association, vol. 11(2), pages 284-301, April.
    8. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández-Val, 2018. "Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, with an Application to Immunization in India," NBER Working Papers 24678, National Bureau of Economic Research, Inc.
    9. Matthew Groh & David McKenzie & Tara Vishwanath, 2015. "Reducing Information Asymmetries in the Youth Labor Market of Jordan with Psychometrics and Skill Based Tests," The World Bank Economic Review, World Bank, vol. 29(suppl_1), pages 106-117.
    10. Angus Deaton, 2020. "Randomization in the Tropics Revisited: a Theme and Eleven Variations," NBER Working Papers 27600, National Bureau of Economic Research, Inc.
    11. Steven L. Scott, 2010. "A modern Bayesian look at the multi‐armed bandit," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 26(6), pages 639-658, November.
    12. Banerjee, Abhijit V & Newman, Andrew F, 1993. "Occupational Choice and the Process of Development," Journal of Political Economy, University of Chicago Press, vol. 101(2), pages 274-298, April.
    13. Simon Franklin, 2018. "Location, Search Costs and Youth Unemployment: Experimental Evidence from Transport Subsidies," Economic Journal, Royal Economic Society, vol. 128(614), pages 2353-2379, September.
    14. Sequeira, Sandra & Banerjee, Abhijit, 2020. "Spatial Mismatches and Imperfect Information in the Job Search," CEPR Discussion Papers 14414, C.E.P.R. Discussion Papers.
    15. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    16. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    17. Livia Alfonsi & Oriana Bandiera & Vittorio Bassi & Robin Burgess & Imran Rasul & Munshi Sulaiman & Anna Vitali, 2020. "Tackling Youth Unemployment: Evidence From a Labor Market Experiment in Uganda," Econometrica, Econometric Society, vol. 88(6), pages 2369-2414, November.
    18. Jessica Hagen‐Zanker & Martina Ulrichs & Rebecca Holmes, 2018. "What are the effects of cash transfers for refugees in the context of protracted displacement? Findings from Jordan," International Social Security Review, John Wiley & Sons, vol. 71(2), pages 57-77, April.
    19. Stefano DellaVigna & M. Daniele Paserman, 2005. "Job Search and Impatience," Journal of Labor Economics, University of Chicago Press, vol. 23(3), pages 527-588, July.
    20. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504, January.
    21. Battisti, Michele & Giesing, Yvonne & Laurentsyeva, Nadzeya, 2019. "Can job search assistance improve the labour market integration of refugees? Evidence from a field experiment," Labour Economics, Elsevier, vol. 61(C).
    22. Lorenzo Caliendo & Maximiliano Dvorkin & Fernando Parro, 2015. "The Impact of Trade on Labor Market Dynamics," NBER Working Papers 21149, National Bureau of Economic Research, Inc.
    23. Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
    24. Meager, Rachael, 2019. "Understanding the average impact of microcredit expansions: a Bayesian hierarchical analysis of seven randomized experiments," LSE Research Online Documents on Economics 88190, London School of Economics and Political Science, LSE Library.
    25. Matthew Groh & David McKenzie & Nour Shammout & Tara Vishwanath, 2015. "Testing the importance of search frictions and matching through a randomized experiment in Jordan," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-20, December.
    26. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    27. Kyle Herkenhoff & Gordon Phillips & Ethan Cohen-Cole, 2016. "How Credit Constraints Impact Job Finding Rates, Sorting & Aggregate Output," NBER Working Papers 22274, National Bureau of Economic Research, Inc.
    28. Chiara Gigliarano & Paolo Verme & Christina Wieser & Kerren Hedlund & Marc Petzoldt & Marco Santacroce, 2016. "The Welfare of Syrian Refugees," World Bank Publications - Books, The World Bank Group, number 23228, April.
    29. Caliendo, Marco & Cobb-Clark, Deborah A. & Hennecke, Juliane & Uhlendorff, Arne, 2019. "Locus of control and internal migration," Regional Science and Urban Economics, Elsevier, vol. 79(C).
    30. Maximilian Kasy & Anja Sautmann, 2021. "Adaptive Treatment Assignment in Experiments for Policy Choice," Econometrica, Econometric Society, vol. 89(1), pages 113-132, January.
    31. Maximilian Kasy, 2016. "Partial Identification, Distributional Preferences, and the Welfare Ranking of Policies," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 111-131, March.
    32. Girum Abebe & A Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn, 2021. "Anonymity or Distance? Job Search and Labour Market Exclusion in a Growing African City [Endogenous Stratification in Randomized Experiments]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1279-1310.
    33. Marco Caliendo & Deborah A. Cobb-Clark & Arne Uhlendorff, 2015. "Locus of Control and Job Search Strategies," The Review of Economics and Statistics, MIT Press, vol. 97(1), pages 88-103, March.
    34. Ghosal,Subhashis & van der Vaart,Aad, 2017. "Fundamentals of Nonparametric Bayesian Inference," Cambridge Books, Cambridge University Press, number 9780521878265, January.
    35. Kluve, Jochen & Puerto, Susana & Robalino, David & Romero, Jose M. & Rother, Friederike & Stöterau, Jonathan & Weidenkaff, Felix & Witte, Marc, 2019. "Do youth employment programs improve labor market outcomes? A quantitative review," World Development, Elsevier, vol. 114(C), pages 237-253.
    36. Fallah, Belal & Krafft, Caroline & Wahba, Jackline, 2019. "The impact of refugees on employment and wages in Jordan," Journal of Development Economics, Elsevier, vol. 139(C), pages 203-216.
    37. Maximilian Kasy & Alexander Teytelboym, 0. "Adaptive targeted infectious disease testing," Oxford Review of Economic Policy, Oxford University Press, vol. 36(Supplemen), pages 77-93.
    38. Johannes Haushofer & Jeremy Shapiro, 2016. "The Short-term Impact of Unconditional Cash Transfers to the Poor: ExperimentalEvidence from Kenya," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1973-2042.
    39. Kirsten Schuettler, 2020. "Jobs Interventions for Refugees and Internally Displaced Persons," World Bank Publications - Reports 34767, The World Bank Group.
    40. Xavier Devictor & Quy-Toan Do, 2017. "How Many Years Have Refugees Been in Exile?," Population and Development Review, The Population Council, Inc., vol. 43(2), pages 355-369, June.
    41. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    42. Abhijit V. Banerjee & Rema Hanna & Gabriel E. Kreindler & Benjamin A. Olken, 2017. "Debunking the Stereotype of the Lazy Welfare Recipient: Evidence from Cash Transfer Programs," The World Bank Research Observer, World Bank, vol. 32(2), pages 155-184.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davide Viviano & Jess Rudder, 2020. "Policy design in experiments with unknown interference," Papers 2011.08174, arXiv.org, revised May 2024.
    2. Sam Jones & Kunal Sen, 2022. "Labour market effects of digital matching platforms: Experimental evidence from sub-Saharan Africa," WIDER Working Paper Series wp-2022-69, World Institute for Development Economic Research (UNU-WIDER).
    3. Banerjee, Abhijit V. & Chiplunkar, Gaurav, 2024. "How important are matching frictions in the labor market? Experimental & non-experimental evidence from a large Indian firm," Journal of Development Economics, Elsevier, vol. 171(C).
    4. Chakravorty, Bhaskar & Arulampalam, Wiji & Bhatiya, Apurav Yash & Imbert, Clément & Rathelot, Roland, 2024. "Can information about jobs improve the effectiveness of vocational training? Experimental evidence from India," Journal of Development Economics, Elsevier, vol. 169(C).
    5. Armand, Alex & Carneiro, Pedro & Tagliati, Federico & Xia, Yiming, 2026. "Can subsidized employment tackle long-term unemployment? Experimental evidence from North Macedonia," Journal of Development Economics, Elsevier, vol. 178(C).
    6. Tsegay Tekleselassie & Marc Witte & Jonas Radbruch & Lukas Hensel & Ingo E. Isphording, 2025. "Feedback, Confidence and Job Search Behavior," CRC TR 224 Discussion Paper Series crctr224_2025_668, University of Bonn and University of Mannheim, Germany.
    7. Andrea Kiss & Robert Garlick & Kate Orkin & Luke Hensel, 2023. "Jobseekers’ Beliefs about Comparative Advantage and (Mis)Directed Search," Upjohn Working Papers 23-388, W.E. Upjohn Institute for Employment Research.
    8. Kondylis,Florence & Loeser,John Ashton, 2021. "Intervention Size and Persistence," Policy Research Working Paper Series 9769, The World Bank.
    9. Allemand,Mathias & Kirchberger,Martina & Sveta Milusheva & Newman,Carol Frances & Roberts,Brent & Thorne,Vincent, 2023. "Conscientiousness and Labor Market Returns : Evidence from a Field Experiment in West Africa," Policy Research Working Paper Series 10378, The World Bank.
    10. Takuya Ishihara & Toru Kitagawa, 2021. "Evidence Aggregation for Treatment Choice," Papers 2108.06473, arXiv.org, revised Jul 2024.
    11. Araujo,Caridad & Baird,Sarah Jane & Das,Saini & Ozler,Berk & Parisotto,Luca & Woldehanna,Tassew, 2024. "Social Protection and Youth," Policy Research Working Paper Series 10832, The World Bank.
    12. Girum Abebe & Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn & Forhad Shilpi, 2023. "Matching Frictions and Distorted Beliefs:Evidence from a Job Fair Experiment," Working Papers 958, Queen Mary University of London, School of Economics and Finance.
    13. McIntosh, Craig & Zeitlin, Andrew, 2022. "Using household grants to benchmark the cost effectiveness of a USAID workforce readiness program," Journal of Development Economics, Elsevier, vol. 157(C).
    14. Girum Abebe & A Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn, 2021. "Anonymity or Distance? Job Search and Labour Market Exclusion in a Growing African City [Endogenous Stratification in Randomized Experiments]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1279-1310.
    15. Blattman, Christopher & Dercon, Stefan & Franklin, Simon, 2022. "Impacts of industrial and entrepreneurial jobs on youth: 5-year experimental evidence on factory job offers and cash grants in Ethiopia," Journal of Development Economics, Elsevier, vol. 156(C).
    16. Abramovsky, Laura & Augsburg, Britta & Lührmann, Melanie & Oteiza, Francisco & Rud, Juan Pablo, 2023. "Community matters: Heterogeneous impacts of a sanitation intervention," World Development, Elsevier, vol. 165(C).
    17. Oriana Bandiera & Robin Burgess & Erika Deserranno & Ricardo Morel & Imran Rasul & Munshi Sulaiman & Jack Thiemel, 2022. "Microfinance and Diversification," Economica, London School of Economics and Political Science, vol. 89(S1), pages 239-275, June.
    18. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    19. Clare Balboni & Oriana Bandiera & Robin Burgess & Maitreesh Ghatak & Anton Heil, 2023. "Why Do People Stay Poor?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(2), pages 785-844.
    20. Abhijit Banerjee & Emily Breza & Esther Duflo & Cynthia Kinnan, 2019. "Can Microfinance Unlock a Poverty Trap for Some Entrepreneurs?," Discussion Papers Series, Department of Economics, Tufts University 0832, Department of Economics, Tufts University.

    More about this item

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • J60 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - General
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:csa:wpaper:2020-20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Julia Coffey (email available below). General contact details of provider: https://edirc.repec.org/data/csaoxuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.