IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2603.21699.html

A Job I Like or a Job I Can Get: Designing Job Recommender Systems Using Field Experiments

Author

Listed:
  • Guillaume Bied
  • Philippe Caillou
  • Bruno Cr'epon
  • Christophe Gaillac
  • Elia P'erennes
  • Mich`ele Sebag

Abstract

Recommendation systems (RSs) are increasingly used to guide job seekers on online platforms, yet the algorithms currently deployed are typically optimized for predictive objectives such as clicks, applications, or hires, rather than job seekers' welfare. We develop a job-search model with an application stage in which the value of a vacancy depends on two dimensions: the utility it delivers to the worker and the probability that an application succeeds. The model implies that welfare-optimal RSs rank vacancies by an expected-surplus index combining both, and shows why rankings based solely on utility, hiring probabilities, or observed application behavior are generically suboptimal, an instance of the inversion problem between behavior and welfare. We test these predictions and quantify their practical importance through two randomized field experiments conducted with the French public employment service. The first experiment, comparing existing algorithms and their combinations, provides behavioral evidence that both dimensions shape application decisions. Guided by the model and these results, the second experiment extends the comparison to an RS designed to approximate the welfare-optimal ranking. The experiments generate exogenous variation in the vacancies shown to job seekers, allowing us to estimate the model, validate its behavioral predictions, and construct a welfare metric. Algorithms informed by the model-implied optimal ranking substantially outperform existing approaches and perform close to the welfare-optimal benchmark. Our results show that embedding predictive tools within a simple job-search framework and combining it with experimental evidence yields recommendation rules with substantial welfare gains in practice.

Suggested Citation

  • Guillaume Bied & Philippe Caillou & Bruno Cr'epon & Christophe Gaillac & Elia P'erennes & Mich`ele Sebag, 2026. "A Job I Like or a Job I Can Get: Designing Job Recommender Systems Using Field Experiments," Papers 2603.21699, arXiv.org.
  • Handle: RePEc:arx:papers:2603.21699
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2603.21699
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:oup:qjecon:v:136:y:2021:i:1:p:381-426. is not listed on IDEAS
    2. Gunter J. Hitsch & Ali Hortaçsu & Dan Ariely, 2010. "Matching and Sorting in Online Dating," American Economic Review, American Economic Association, vol. 100(1), pages 130-163, March.
    3. Kuan‐Ming Chen & Yu‐Wei Hsieh & Ming‐Jen Lin, 2023. "Reducing Recommendation Inequality Via Two‐Sided Matching: A Field Experiment Of Online Dating," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 1201-1221, August.
    4. Laura K. Gee, 2019. "The More You Know: Information Effects on Job Application Rates in a Large Field Experiment," Management Science, INFORMS, vol. 67(5), pages 2077-2094, May.
    5. John J. Horton, 2017. "The Effects of Algorithmic Labor Market Recommendations: Evidence from a Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 35(2), pages 345-385.
    6. Michèle Belot & Philipp Kircher & Paul Muller, 2019. "Providing Advice to Jobseekers at Low Cost: An Experimental Study on Online Advice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(4), pages 1411-1447.
    7. Sendhil Mullainathan, 2025. "Economics in the Age of Algorithms," AEA Papers and Proceedings, American Economic Association, vol. 115, pages 1-23, May.
    8. Altmann, Steffen & Glenny, Anita Marie & Mahlstedt, Robert & Sebald, Alexander, 2022. "The Direct and Indirect Effects of Online Job Search Advice," IZA Discussion Papers 15830, IZA Network @ LISER.
    9. Mirjam Bächli & Rafael Lalive & Michele Pellizzari, 2025. "Helping jobseekers with recommendations based on skill profiles or past experience: Evidence from a randomized intervention," RFBerlin Discussion Paper Series 2589, ROCKWOOL Foundation Berlin (RFBerlin).
    10. Ioana Marinescu & Daphné Skandalis, 2021. "Unemployment Insurance and Job Search Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(2), pages 887-931.
    11. Ingvild Almås & Orazio Attanasio & Pamela Jervis, 2023. "Economics and Measurement: New measures to model decision making," NBER Working Papers 30839, National Bureau of Economic Research, Inc.
    12. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    13. Amanda Y. Agan & Diag Davenport & Jens Ludwig & Sendhil Mullainathan, 2023. "Automating Automaticity: How the Context of Human Choice Affects the Extent of Algorithmic Bias," NBER Working Papers 30981, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Koning, Bart & Muller, Paul & Belot, Michèle & Engels, Yvonne & Fouarge, Didier & Keer, Mario & Kircher, Philipp & Phlippen, Sandra, 2026. "Online Buddies for Job Seekers: A Field Experiment," IZA Discussion Papers 18437, IZA Network @ LISER.
    2. Michèle Belot & Bart K. de Koning & Didier Fouarge & Philipp Kircher & Paul Muller & Sandra Phlippen, 2025. "Advising Job Seekers in Occupations with Poor Prospects: A Field Experiment," NBER Working Papers 33819, National Bureau of Economic Research, Inc.
    3. Steffen Altmann & Robert Mahlstedt & Malte Jacob Rattenborg & Alexander Sebald & Sonja Settele & Johannes Wohlfart, 2026. "Wage Expectations and Job Search," ECONtribute Discussion Papers Series 386, University of Bonn and University of Cologne, Germany.
    4. Tobias Lehmann & Camille Terrier & Rafael Lalive, 2023. "Costs and Benefits of Congestion in Two-Sided Markets: Evidence from the Dating Market," Working Papers 964, Queen Mary University of London, School of Economics and Finance.
    5. Mirjam Bächli & Hélène Benghalem & Doriana Tinello & Damaris Aschwanden & Sascha Zuber & Matthias Kliegel & Michele Pellizzari & Rafael Lalive, 2024. "Ranking occupations by their proximity to workers’ profiles," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 160(1), pages 1-17, December.
    6. Cairo, Sofie & Mahlstedt, Robert, 2023. "The disparate effects of information provision: A field experiment on the work incentives of social welfare," Journal of Public Economics, Elsevier, vol. 226(C).
    7. Apostolos Filippas & John J. Horton & Richard J. Zeckhauser, 2020. "Owning, Using, and Renting: Some Simple Economics of the “Sharing Economy”," Management Science, INFORMS, vol. 66(9), pages 4152-4172, September.
    8. Jeremy Zuchuat, 2025. "Estimating Duration Dependence in Job Search: the Within-Estimation Duration Bias," Papers 2512.06928, arXiv.org.
    9. Gomez-Herrera, Estrella & Mueller-Langer, Frank, 2024. "Does information disclosure affect the gender gap in bidding behavior? Empirical evidence from a natural experiment on a large online labor platform," Labour Economics, Elsevier, vol. 90(C).
    10. Mitchell Hoffman & Christopher T. Stanton, 2024. "People, Practices, and Productivity: A Review of New Advances in Personnel Economics," NBER Working Papers 32849, National Bureau of Economic Research, Inc.
    11. Dabed, Diego & Genz, Sabrina & Rademakers, Emilie, 2025. "Equalising the effects of automation? The role of task overlap for job finding," Labour Economics, Elsevier, vol. 96(C).
    12. Ni Huang & Gordon Burtch & Yili Hong & Paul A. Pavlou, 2020. "Unemployment and Worker Participation in the Gig Economy: Evidence from an Online Labor Market," Information Systems Research, INFORMS, vol. 31(2), pages 431-448, June.
    13. repec:osf:socarx:p82fk_v1 is not listed on IDEAS
    14. Belot, Michèle & Kircher, Philipp & Muller, Paul, 2022. "Do the Long-term Unemployed Benefit from Automated Occupational Advice during Online Job Search?," CEPR Discussion Papers 17513, Centre for Economic Policy Research.
    15. Altmann, Steffen & Cairo, Sofie & Mahlstedt, Robert & Sebald, Alexander, 2022. "Do Job Seekers Understand the UI Benefit System (And Does It Matter)?," IZA Discussion Papers 15747, IZA Network @ LISER.
    16. Andrea Kiss & Robert Garlick & Kate Orkin & Luke Hensel, 2023. "Jobseekers’ Beliefs about Comparative Advantage and (Mis)Directed Search," Upjohn Working Papers 23-388, W.E. Upjohn Institute for Employment Research.
    17. Itai Ashlagi & Mark Braverman & Yash Kanoria & Peng Shi, 2020. "Clearing Matching Markets Efficiently: Informative Signals and Match Recommendations," Management Science, INFORMS, vol. 66(5), pages 2163-2193, May.
    18. Joshua B. Gilbert & Zachary Himmelsbach & James Soland & Mridul Joshi & Benjamin W. Domingue, 2024. "Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory," Papers 2405.00161, arXiv.org, revised Jan 2025.
    19. Altmann, Steffen & Glenny, Anita Marie & Mahlstedt, Robert & Sebald, Alexander, 2022. "The Direct and Indirect Effects of Online Job Search Advice," IZA Discussion Papers 15830, IZA Network @ LISER.
    20. Diego Dabed Sitnisky & Sabrina Genz & Emilie Rademakers, 2023. "Resilience to Automation: The Role of Task Overlap for Job Finding," Working Papers 2312, Utrecht School of Economics.
    21. Philippe, Arnaud & Skandalis, Daphné, 2023. "Motherhood and the Cost of Job Search," IZA Discussion Papers 16669, IZA Network @ LISER.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2603.21699. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.