IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/15359.html
   My bibliography  Save this paper

An Adaptive Targeted Field Experiment: Job Search Assistance for Refugees in Jordan

Author

Listed:
  • Quinn, Simon
  • Caria, Stefano
  • Gordon, Grant
  • Kasy, Maximilian
  • Shami, Soha
  • Teytelboym, Alexander

Abstract

We introduce a novel adaptive targeted treatment assignment methodology for field experiments. Our Tempered Thompson Algorithm balances the goals of maximizing the precision of treatment effect estimates and maximizing the welfare of experimental participants. A hierarchical Bayesian model allows us to adaptively target treatments. We implement our methodology in Jordan, testing policies to help Syrian refugees and local jobseekers to find work. The immediate employment impacts of a small cash grant, information and psychological support are close to zero, but targeting raises employment by 1 percentage-point (20%). After four months, cash has a sizable effect on employment and earnings of Syrians.

Suggested Citation

  • Quinn, Simon & Caria, Stefano & Gordon, Grant & Kasy, Maximilian & Shami, Soha & Teytelboym, Alexander, 2020. "An Adaptive Targeted Field Experiment: Job Search Assistance for Refugees in Jordan," CEPR Discussion Papers 15359, C.E.P.R. Discussion Papers.
    • Handle: RePEc:cpr:ceprdp:15359
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP15359
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    2. David McKenzie, 2017. "How Effective Are Active Labor Market Policies in Developing Countries? A Critical Review of Recent Evidence," The World Bank Research Observer, World Bank, vol. 32(2), pages 127-154.
    3. Girum Abebe & A Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn, 2021. "Anonymity or Distance? Job Search and Labour Market Exclusion in a Growing African City [Endogenous Stratification in Randomized Experiments]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1279-1310.
    4. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    5. Kasy, Maximilian, 2018. "Optimal taxation and insurance using machine learning — Sufficient statistics and beyond," Journal of Public Economics, Elsevier, vol. 167(C), pages 205-219.
    6. Clare Balboni & Oriana Bandiera & Robin Burgess & Maitreesh Ghatak & Anton Heil, 2023. "Why Do People Stay Poor?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(2), pages 785-844.
    7. Marco Caliendo & Deborah A. Cobb-Clark & Arne Uhlendorff, 2015. "Locus of Control and Job Search Strategies," The Review of Economics and Statistics, MIT Press, vol. 97(1), pages 88-103, March.
    8. Kyle Herkenhoff & Gordon Phillips & Ethan Cohen-Cole, 2016. "How Credit Constraints Impact Job Finding Rates, Sorting & Aggregate Output," Working Papers 16-25, Center for Economic Studies, U.S. Census Bureau.
    9. Maximilian Kasy, 2016. "Partial Identification, Distributional Preferences, and the Welfare Ranking of Policies," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 111-131, March.
    10. Susan Athey & Raj Chetty & Guido W. Imbens & Hyunseung Kang, 2019. "The Surrogate Index: Combining Short-Term Proxies to Estimate Long-Term Treatment Effects More Rapidly and Precisely," NBER Working Papers 26463, National Bureau of Economic Research, Inc.
    11. Martin Abel & Rulof Burger & Eliana Carranza & Patrizio Piraino, 2019. "Bridging the Intention-Behavior Gap? The Effect of Plan-Making Prompts on Job Search and Employment," American Economic Journal: Applied Economics, American Economic Association, vol. 11(2), pages 284-301, April.
    12. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández-Val, 2018. "Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, with an Application to Immunization in India," NBER Working Papers 24678, National Bureau of Economic Research, Inc.
    13. Matthew Groh & David McKenzie & Tara Vishwanath, 2015. "Reducing Information Asymmetries in the Youth Labor Market of Jordan with Psychometrics and Skill Based Tests," The World Bank Economic Review, World Bank, vol. 29(suppl_1), pages 106-117.
    14. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    15. Angus Deaton, 2020. "Randomization in the Tropics Revisited: a Theme and Eleven Variations," NBER Working Papers 27600, National Bureau of Economic Research, Inc.
    16. Steven L. Scott, 2010. "A modern Bayesian look at the multi‐armed bandit," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 26(6), pages 639-658, November.
    17. Schuettler, Kirsten & Caron, Laura, 2020. "Jobs Interventions for Refugees and Internally Displaced Persons," Jobs Group Papers, Notes, and Guides 32152447, The World Bank.
    18. Banerjee, Abhijit V & Newman, Andrew F, 1993. "Occupational Choice and the Process of Development," Journal of Political Economy, University of Chicago Press, vol. 101(2), pages 274-298, April.
    19. Livia Alfonsi & Oriana Bandiera & Vittorio Bassi & Robin Burgess & Imran Rasul & Munshi Sulaiman & Anna Vitali, 2020. "Tackling Youth Unemployment: Evidence From a Labor Market Experiment in Uganda," Econometrica, Econometric Society, vol. 88(6), pages 2369-2414, November.
    20. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    21. Simon Franklin, 2018. "Location, Search Costs and Youth Unemployment: Experimental Evidence from Transport Subsidies," Economic Journal, Royal Economic Society, vol. 128(614), pages 2353-2379, September.
    22. Sequeira, Sandra & Banerjee, Abhijit, 2020. "Spatial Mismatches and Imperfect Information in the Job Search," CEPR Discussion Papers 14414, C.E.P.R. Discussion Papers.
    23. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    24. Jessica Hagen‐Zanker & Martina Ulrichs & Rebecca Holmes, 2018. "What are the effects of cash transfers for refugees in the context of protracted displacement? Findings from Jordan," International Social Security Review, John Wiley & Sons, vol. 71(2), pages 57-77, April.
    25. Stefano DellaVigna & M. Daniele Paserman, 2005. "Job Search and Impatience," Journal of Labor Economics, University of Chicago Press, vol. 23(3), pages 527-588, July.
    26. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504.
    27. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    28. Battisti, Michele & Giesing, Yvonne & Laurentsyeva, Nadzeya, 2019. "Can job search assistance improve the labour market integration of refugees? Evidence from a field experiment," Labour Economics, Elsevier, vol. 61(C).
    29. Lorenzo Caliendo & Maximiliano Dvorkin & Fernando Parro, 2015. "The Impact of Trade on Labor Market Dynamics," NBER Working Papers 21149, National Bureau of Economic Research, Inc.
    30. Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
    31. Meager, Rachael, 2019. "Understanding the average impact of microcredit expansions: a Bayesian hierarchical analysis of seven randomized experiments," LSE Research Online Documents on Economics 88190, London School of Economics and Political Science, LSE Library.
    32. Matthew Groh & David McKenzie & Nour Shammout & Tara Vishwanath, 2015. "Testing the importance of search frictions and matching through a randomized experiment in Jordan," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-20, December.
    33. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    34. Paolo Verme & Chiara Gigliarano & Christina Wieser & Kerren Hedlund & Marc Petzoldt & Marco Santacroce, 2016. "The Welfare of Syrian Refugees," World Bank Publications - Books, The World Bank Group, number 23228, December.
    35. Caliendo, Marco & Cobb-Clark, Deborah A. & Hennecke, Juliane & Uhlendorff, Arne, 2019. "Locus of control and internal migration," Regional Science and Urban Economics, Elsevier, vol. 79(C).
    36. Maximilian Kasy & Anja Sautmann, 2021. "Adaptive Treatment Assignment in Experiments for Policy Choice," Econometrica, Econometric Society, vol. 89(1), pages 113-132, January.
    37. Xavier Devictor & Quy-Toan Do, 2017. "How Many Years Have Refugees Been in Exile?," Population and Development Review, The Population Council, Inc., vol. 43(2), pages 355-369, June.
    38. Ghosal,Subhashis & van der Vaart,Aad, 2017. "Fundamentals of Nonparametric Bayesian Inference," Cambridge Books, Cambridge University Press, number 9780521878265.
    39. Fallah, Belal & Krafft, Caroline & Wahba, Jackline, 2019. "The impact of refugees on employment and wages in Jordan," Journal of Development Economics, Elsevier, vol. 139(C), pages 203-216.
    40. Kluve, Jochen & Puerto, Susana & Robalino, David & Romero, Jose M. & Rother, Friederike & Stöterau, Jonathan & Weidenkaff, Felix & Witte, Marc, 2019. "Do youth employment programs improve labor market outcomes? A quantitative review," World Development, Elsevier, vol. 114(C), pages 237-253.
    41. Maximilian Kasy & Alexander Teytelboym, 0. "Adaptive targeted infectious disease testing," Oxford Review of Economic Policy, Oxford University Press, vol. 36(Supplemen), pages 77-93.
    42. Johannes Haushofer & Jeremy Shapiro, 2016. "The Short-term Impact of Unconditional Cash Transfers to the Poor: ExperimentalEvidence from Kenya," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1973-2042.
    43. Abhijit V. Banerjee & Rema Hanna & Gabriel E. Kreindler & Benjamin A. Olken, 2017. "Debunking the Stereotype of the Lazy Welfare Recipient: Evidence from Cash Transfer Programs," The World Bank Research Observer, World Bank, vol. 32(2), pages 155-184.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shamsuddin,Mrittika & Acosta,Pablo Ariel & Battaglin Schwengber,Rovane & Fix,Jedediah Rooney & Pirani,Nikolas, 2021. "Integration of Venezuelan Refugees and Migrants in Brazil," Policy Research Working Paper Series 9605, The World Bank.
    2. Henrique, 2024. "The Power of Dialogue: Forced Displacement and Social Integration amid an Islamist Insurgency in Mozambique," HiCN Working Papers 405, Households in Conflict Network.
    3. Xiaoxue Sherry Gao & Glenn W. Harrison & Rusty Tchernis, 2020. "Behavioral Welfare Economics and Risk Preferences: A Bayesian Approach," NBER Working Papers 27685, National Bureau of Economic Research, Inc.
    4. Keisuke Hirano & Jack R. Porter, 2023. "Asymptotic Representations for Sequential Decisions, Adaptive Experiments, and Batched Bandits," Papers 2302.03117, arXiv.org.
    5. Sonan Memon, 2021. "Machine Learning for Economists: An Introduction," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 60(2), pages 201-211.
    6. Bahety, Girija & Bauhoff, Sebastian & Patel, Dev & Potter, James, 2021. "Texts don’t nudge: An adaptive trial to prevent the spread of COVID-19 in India," Journal of Development Economics, Elsevier, vol. 153(C).
    7. Özler, Berk & Çelik, Çiğdem & Cunningham, Scott & Cuevas, P. Facundo & Parisotto, Luca, 2021. "Children on the move: Progressive redistribution of humanitarian cash transfers among refugees," Journal of Development Economics, Elsevier, vol. 153(C).
    8. Max Cytrynbaum, 2021. "Optimal Stratification of Survey Experiments," Papers 2111.08157, arXiv.org, revised Aug 2023.
    9. Samantha Horn & Sabina J. Sloman, 2022. "A Comparison of Methods for Adaptive Experimentation," Papers 2207.00683, arXiv.org.
    10. Maximilian Kasy & Alexander Teytelboym, 2023. "Matching with semi-bandits," The Econometrics Journal, Royal Economic Society, vol. 26(1), pages 45-66.
    11. Xiaoxue Sherry Gao & Glenn W. Harrison & Rusty Tchernis, 2023. "Behavioral welfare economics and risk preferences: a Bayesian approach," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 273-303, April.
    12. Saskia Opitz & Dirk Sliwka & Timo Vogelsang & Tom Zimmermann, 2022. "The Targeted Assignment of Incentive Schemes," ECONtribute Discussion Papers Series 187, University of Bonn and University of Cologne, Germany.
    13. Danielle Li & Lindsey R. Raymond & Peter Bergman, 2020. "Hiring as Exploration," NBER Working Papers 27736, National Bureau of Economic Research, Inc.
    14. Danutė Krapavickaitė, 2022. "Impact of Stratum Composition Changes on the Accuracy of the Estimates in a Sample Survey," Mathematics, MDPI, vol. 10(7), pages 1-21, March.
    15. Susan Athey & Undral Byambadalai & Vitor Hadad & Sanath Kumar Krishnamurthy & Weiwen Leung & Joseph Jay Williams, 2022. "Contextual Bandits in a Survey Experiment on Charitable Giving: Within-Experiment Outcomes versus Policy Learning," Papers 2211.12004, arXiv.org.
    16. Esposito Acosta,Bruno Nicola & Sautmann,Anja, 2022. "Adaptive Experiments for Policy Choice : Phone Calls for Home Reading in Kenya," Policy Research Working Paper Series 10098, The World Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mathias Allemand & Martina Kirchberger & Sveta Milusheva & Carol Newman & Brent Roberts & Vincent Thorne, 2023. "Conscientiousness and Labor Market Returns: Evidence from a Field Experiment in West Africa," Trinity Economics Papers tep0123, Trinity College Dublin, Department of Economics.
    2. McIntosh, Craig & Zeitlin, Andrew, 2022. "Using household grants to benchmark the cost effectiveness of a USAID workforce readiness program," Journal of Development Economics, Elsevier, vol. 157(C).
    3. Carneiro, Pedro & Armand, Alex & Tagliati, Federico & Xia, Yiming, 2020. "Can Subsidized Employment Tackle Long-Term Unemployment? Experimental Evidence from North Macedonia," CEPR Discussion Papers 15192, C.E.P.R. Discussion Papers.
    4. Kiss, Andrea & Garlick, Robert & Orkin, Kate & Hensel, Lukas, 2023. "Jobseekers' Beliefs about Comparative Advantage and (Mis)Directed Search," IZA Discussion Papers 16522, Institute of Labor Economics (IZA).
    5. Davide Viviano & Jess Rudder, 2020. "Policy design in experiments with unknown interference," Papers 2011.08174, arXiv.org, revised Dec 2023.
    6. Sam Jones & Kunal Sen, 2022. "Labour market effects of digital matching platforms: Experimental evidence from sub-Saharan Africa," WIDER Working Paper Series wp-2022-69, World Institute for Development Economic Research (UNU-WIDER).
    7. Chakravorty, Bhaskar & Arulampalam, Wiji & Bhatiya, Apurav Yash & Imbert, Clement & Rathelot, Roland, 2021. "Can information about jobs improve the effectiveness of vocational training? Experimental evidence from India," CAGE Online Working Paper Series 567, Competitive Advantage in the Global Economy (CAGE).
    8. Dennis Egger & Johannes Haushofer & Edward Miguel & Paul Niehaus & Michael Walker, 2022. "General Equilibrium Effects of Cash Transfers: Experimental Evidence From Kenya," Econometrica, Econometric Society, vol. 90(6), pages 2603-2643, November.
    9. Kondylis,Florence,Loeser,John Ashton, 2021. "Intervention Size and Persistence," Policy Research Working Paper Series 9769, The World Bank.
    10. Takuya Ishihara & Toru Kitagawa, 2021. "Evidence Aggregation for Treatment Choice," Papers 2108.06473, arXiv.org.
    11. Abhijit Banerjee & Emily Breza & Esther Duflo & Cynthia Kinnan, 2019. "Can Microfinance Unlock a Poverty Trap for Some Entrepreneurs?," NBER Working Papers 26346, National Bureau of Economic Research, Inc.
    12. Daniel Bjorkegren & Joshua Blumenstock & Omowunmi Folajimi-Senjobi & Jacqueline Mauro & Suraj R. Nair, 2022. "Instant Loans Can Lift Subjective Well-Being: A Randomized Evaluation of Digital Credit in Nigeria," Papers 2202.13540, arXiv.org.
    13. Girum Abebe & A Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn, 2021. "Anonymity or Distance? Job Search and Labour Market Exclusion in a Growing African City [Endogenous Stratification in Randomized Experiments]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1279-1310.
    14. Clare Balboni & Oriana Bandiera & Robin Burgess & Maitreesh Ghatak & Anton Heil, 2023. "Why Do People Stay Poor?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(2), pages 785-844.
    15. Ali, Ayesha & Qazi, Ihsan Ayyub, 2023. "Countering misinformation on social media through educational interventions: Evidence from a randomized experiment in Pakistan," Journal of Development Economics, Elsevier, vol. 163(C).
    16. Oriana Bandiera & Ahmed Elsayed & Andrea Smurra & Céline Zipfel, 2022. "Young Adults and Labor Markets in Africa," Journal of Economic Perspectives, American Economic Association, vol. 36(1), pages 81-100, Winter.
    17. Pushkar Maitra & Sandip Mitra & Dilip Mookherjee & Sujata Visaria, 2020. "Decentralized Targeting of Agricultural Credit Programs: Private versus Political Intermediaries," HKUST IEMS Working Paper Series 2020-70, HKUST Institute for Emerging Market Studies, revised Jan 2020.
    18. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    19. Girum Abebe & Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn & Forhad Shilpi, 2023. "Matching Frictions and Distorted Beliefs:Evidence from a Job Fair Experiment," Working Papers 958, Queen Mary University of London, School of Economics and Finance.
    20. Chowdhury, Shyamal & Smits, Joeri & Sun, Qigang, 2020. "Contract structure, time preference, and technology adoption," GLO Discussion Paper Series 633, Global Labor Organization (GLO).

    More about this item

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • J60 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - General
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:15359. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.