IDEAS home Printed from https://ideas.repec.org/p/crm/wpaper/26091.html

A Job I Like or a Job I Can Get: Designing Job Recommender Systems Using Field Experiments

Author

Listed:
  • Guillaume Bied
  • Philippe Caillou
  • Bruno Crépon
  • Christophe Gaillac
  • Elia Pérennes
  • Michèle Sebag

Abstract

Recommendation systems (RSs) are increasingly used to guide job seekers on online platforms, yet the algorithms currently deployed are typically optimized for predictive objectives such as clicks, applications, or hires, rather than job seekers' welfare. We develop a job-search model with an application stage in which the value of a vacancy depends on two dimensions: the utility it delivers to the worker and the probability that an application succeeds. The model implies that welfare-optimal RSs rank vacancies by an expected-surplus index combining both, and shows why rankings based solely on utility, hiring probabilities, or observed application behavior are generically suboptimal, an instance of the inversion problem between behavior and welfare. We test these predictions and quantify their practical importance through two randomized field experiments conducted with the French public employment service. The first experiment, comparing existing algorithms and their combinations, provides behavioral evidence that both dimensions shape application decisions. Guided by the model and these results, the second experiment extends the comparison to an RS designed to approximate the welfare-optimal ranking. The experiments generate exogenous variation in the vacancies shown to job seekers, allowing us to estimate the model, validate its behavioral predictions, and construct a welfare metric. Algorithms informed by the model-implied optimal ranking substantially outperform existing approaches and perform close to the welfare-optimal benchmark. Our results show that embedding predictive tools within a simple job-search framework and combining it with experimental evidence yields recommendation rules with substantial welfare gains in practice.

Suggested Citation

  • Guillaume Bied & Philippe Caillou & Bruno Crépon & Christophe Gaillac & Elia Pérennes & Michèle Sebag, 2026. "A Job I Like or a Job I Can Get: Designing Job Recommender Systems Using Field Experiments," RFBerlin Discussion Paper Series 26091, ROCKWOOL Foundation Berlin (RFBerlin).
  • Handle: RePEc:crm:wpaper:26091
    as

    Download full text from publisher

    File URL: https://www.rfberlin.com/wp-content/uploads/2026/03/26091.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:oup:qjecon:v:136:y:2021:i:1:p:381-426. is not listed on IDEAS
    2. Gunter J. Hitsch & Ali Hortaçsu & Dan Ariely, 2010. "Matching and Sorting in Online Dating," American Economic Review, American Economic Association, vol. 100(1), pages 130-163, March.
    3. John J. Horton, 2017. "The Effects of Algorithmic Labor Market Recommendations: Evidence from a Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 35(2), pages 345-385.
    4. Michèle Belot & Philipp Kircher & Paul Muller, 2019. "Providing Advice to Jobseekers at Low Cost: An Experimental Study on Online Advice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(4), pages 1411-1447.
    5. Behaghel, Luc & Dromundo, Sofia & Gurgand, Marc & Hazard, Yagan & Zuber, Thomas, 2024. "The Potential of Recommender Systems for Directing Job Search: A Large-Scale Experiment," IZA Discussion Papers 16781, IZA Network @ LISER.
    6. Ingvild Almås & Orazio Attanasio & Pamela Jervis, 2023. "Economics and Measurement: New measures to model decision making," NBER Working Papers 30839, National Bureau of Economic Research, Inc.
    7. Sendhil Mullainathan, 2025. "Economics in the Age of Algorithms," AEA Papers and Proceedings, American Economic Association, vol. 115, pages 1-23, May.
    8. Altmann, Steffen & Glenny, Anita Marie & Mahlstedt, Robert & Sebald, Alexander, 2022. "The Direct and Indirect Effects of Online Job Search Advice," IZA Discussion Papers 15830, IZA Network @ LISER.
    9. Ioana Marinescu & Daphné Skandalis, 2021. "Unemployment Insurance and Job Search Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(2), pages 887-931.
    10. Amanda Y. Agan & Diag Davenport & Jens Ludwig & Sendhil Mullainathan, 2023. "Automating Automaticity: How the Context of Human Choice Affects the Extent of Algorithmic Bias," NBER Working Papers 30981, National Bureau of Economic Research, Inc.
    11. Kuan‐Ming Chen & Yu‐Wei Hsieh & Ming‐Jen Lin, 2023. "Reducing Recommendation Inequality Via Two‐Sided Matching: A Field Experiment Of Online Dating," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 1201-1221, August.
    12. Laura K. Gee, 2019. "The More You Know: Information Effects on Job Application Rates in a Large Field Experiment," Management Science, INFORMS, vol. 67(5), pages 2077-2094, May.
    13. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jeremias Klaeui, 2026. "When to Broaden, When to Focus: Job Search and Market Tightness," CESifo Working Paper Series 12744, CESifo.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guillaume Bied & Philippe Caillou & Bruno Cr'epon & Christophe Gaillac & Elia P'erennes & Mich`ele Sebag, 2026. "A Job I Like or a Job I Can Get: Designing Job Recommender Systems Using Field Experiments," Papers 2603.21699, arXiv.org.
    2. Elisabeth Leduc & Ilan Tojerow, 2025. "Closing the Mismatch: Encouraging Jobseekers to Reskill for Shortage Occupations," Tinbergen Institute Discussion Papers 25-014/V, Tinbergen Institute.
    3. Steffen Altmann & Robert Mahlstedt & Malte Jacob Rattenborg & Alexander Sebald & Sonja Settele & Johannes Wohlfart, 2026. "Wage Expectations and Job Search," ECONtribute Discussion Papers Series 386, University of Bonn and University of Cologne, Germany.
    4. Tobias Lehmann & Camille Terrier & Rafael Lalive, 2023. "Costs and Benefits of Congestion in Two-Sided Markets: Evidence from the Dating Market," Working Papers 964, Queen Mary University of London, School of Economics and Finance.
    5. Cairo, Sofie & Mahlstedt, Robert, 2023. "The disparate effects of information provision: A field experiment on the work incentives of social welfare," Journal of Public Economics, Elsevier, vol. 226(C).
    6. Jeremy Zuchuat, 2025. "Estimating Duration Dependence in Job Search: the Within-Estimation Duration Bias," Papers 2512.06928, arXiv.org.
    7. Mitchell Hoffman & Christopher T. Stanton, 2024. "People, Practices, and Productivity: A Review of New Advances in Personnel Economics," NBER Working Papers 32849, National Bureau of Economic Research, Inc.
    8. Dabed, Diego & Genz, Sabrina & Rademakers, Emilie, 2025. "Equalising the effects of automation? The role of task overlap for job finding," Labour Economics, Elsevier, vol. 96(C).
    9. Bart de Koning & Paul Muller & Michèle Belot & Yvonne Engels & Didier Fouarge & Mario Keer & Philipp Kircher & Sandra Phlippen, 2026. "Online Buddies for Job Seekers: A Field Experiment," NBER Working Papers 34912, National Bureau of Economic Research, Inc.
    10. Andrea Kiss & Robert Garlick & Kate Orkin & Luke Hensel, 2023. "Jobseekers’ Beliefs about Comparative Advantage and (Mis)Directed Search," Upjohn Working Papers 23-388, W.E. Upjohn Institute for Employment Research.
    11. Joshua B. Gilbert & Zachary Himmelsbach & James Soland & Mridul Joshi & Benjamin W. Domingue, 2024. "Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory," Papers 2405.00161, arXiv.org, revised Jan 2025.
    12. Mallory Avery & Andreas Leibbrandt & Joseph Vecci, 2023. "Does Artificial Intelligence Help or Hurt Gender Diversity? Evidence from Two Field Experiments on Recruitment in Tech," Monash Economics Working Papers 2023-09, Monash University, Department of Economics.
    13. Mimansa Bairathi & Xu Zhang & Anja Lambrecht, 2025. "The Value of Platform Endorsement," Marketing Science, INFORMS, vol. 44(1), pages 84-101, January.
    14. Laurel Wheeler & Robert Garlick & Eric Johnson & Patrick Shaw & Marissa Gargano, 2022. "LinkedIn(to) Job Opportunities: Experimental Evidence from Job Readiness Training," American Economic Journal: Applied Economics, American Economic Association, vol. 14(2), pages 101-125, April.
    15. Altmann, Steffen & Mahlstedt, Robert & Rattenborg, Malte Jacob & Sebald, Alexander, 2023. "Which Occupations Do Unemployed Workers Target? Insights from Online Job Search Profiles," IZA Discussion Papers 16696, IZA Network @ LISER.
    16. Adams-Prassl, Abi & Boneva, Teodora & Golin, Marta & Rauh, Christopher, 2023. "Perceived returns to job search," Labour Economics, Elsevier, vol. 80(C).
    17. Andrey Fradkin & Monica Bhole & John J. Horton, 2026. "Competition Avoidance vs. Herding in Job Search: Evidence from Large-Scale Field Experiments on an Online Job Board," Management Science, INFORMS, vol. 72(2), pages 1305-1323, February.
    18. Tiemen M. Woutersen & John Ham, 2013. "Calculating confidence intervals for continuous and discontinuous functions of parameters," CeMMAP working papers CWP23/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Brenčič, Vera, 2024. "Terms of use and network size: Evidence from online job boards and CV banks in the U.S," Information Economics and Policy, Elsevier, vol. 67(C).
    20. Leduc, Elisabeth & Tojerow, Ilan, 2025. "Closing the Mismatch: Encouraging Jobseekers to Reskill for Shortage Occupations," IZA Discussion Papers 17731, IZA Network @ LISER.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search
    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy
    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software
    • C78 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Bargaining Theory; Matching Theory
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crm:wpaper:26091. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Moritz Lubczyk or Matthew Nibloe (email available below). General contact details of provider: https://edirc.repec.org/data/cmucluk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.