IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v328y2026i2p680-693.html

Anticipating delays in recruitment: Explainable machine learning for the prediction of hard-to-fill online job vacancies

Author

Listed:
  • Dossche, Wouter
  • Vansteenkiste, Sarah
  • Baesens, Bart
  • Lemahieu, Wilfried

Abstract

Online job vacancy (OJV) platforms have transformed the labor market by enabling employers to advertise jobs to a wide audience. Particularly in tight labor markets, quickly identifying vacancies likely to suffer prolonged durations is crucial. This study utilizes data from the Flemish public employment service's OJV platform to examine the effectiveness of machine learning in predicting hard-to-fill vacancies. We achieve notable predictive performance with XGBoost in forecasting recruitment delays and demonstrate the importance of capturing non-linear patterns in OJV data. SHAP (SHapley Additive exPlanations) values reveal that the textual content of vacancies and latent company characteristics are key predictors of hiring delays. Counterfactual-SHAP insights provide practical guidance for refining recruitment strategies, enhancing labor market forecasts, and informing targeted policies.

Suggested Citation

  • Dossche, Wouter & Vansteenkiste, Sarah & Baesens, Bart & Lemahieu, Wilfried, 2026. "Anticipating delays in recruitment: Explainable machine learning for the prediction of hard-to-fill online job vacancies," European Journal of Operational Research, Elsevier, vol. 328(2), pages 680-693.
  • Handle: RePEc:eee:ejores:v:328:y:2026:i:2:p:680-693
    DOI: 10.1016/j.ejor.2025.06.027
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221725004990
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2025.06.027?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Henna Nivalainen, 2014. "Internet-Based Employer Search and Vacancy Duration: Evidence from Finland," LABOUR, CEIS, vol. 28(1), pages 112-140, March.
    2. Charles Holt & Martin David, 1966. "The Concept of Job Vacancies in a Dynamic Theory of the Labor Market," NBER Chapters, in: The Measurement and Interpretation of Job Vacancies, pages 73-110, National Bureau of Economic Research, Inc.
    3. R. Jason Faberman & Marianna Kudlyak, 2019. "The Intensity of Job Search and Search Duration," American Economic Journal: Macroeconomics, American Economic Association, vol. 11(3), pages 327-357, July.
    4. Mortensen, Dale T. & Pissarides, Christopher A., 1999. "New developments in models of search in the labor market," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 39, pages 2567-2627, Elsevier.
    5. Gunnarsson, Björn Rafn & vanden Broucke, Seppe & Baesens, Bart & Óskarsdóttir, María & Lemahieu, Wilfried, 2021. "Deep learning for credit scoring: Do or don’t?," European Journal of Operational Research, Elsevier, vol. 295(1), pages 292-305.
    6. Mai, Feng & Tian, Shaonan & Lee, Chihoon & Ma, Ling, 2019. "Deep learning models for bankruptcy prediction using textual disclosures," European Journal of Operational Research, Elsevier, vol. 274(2), pages 743-758.
    7. M. J. Andrews & S. Bradley & D. Stott & R. Upward, 2008. "Successful Employer Search? An Empirical Analysis of Vacancy Duration Using Micro Data," Economica, London School of Economics and Political Science, vol. 75(299), pages 455-480, August.
    8. Philipp Borchert & Kristof Coussement & Arno de Caigny & Jochen de Weerdt, 2023. "Extending business failure prediction models with textual website content using deep learning," Post-Print hal-03976762, HAL.
    9. James Albrecht & Bruno Decreuse & Susan Vroman, 2023. "Directed Search With Phantom Vacancies," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(2), pages 837-869, May.
    10. Peter Kuhn & Hani Mansour, 2014. "Is Internet Job Search Still Ineffective?," Economic Journal, Royal Economic Society, vol. 124(581), pages 1213-1233, December.
    11. Peter Kuhn, 2014. "The internet as a labor market matchmaker," World of Labour, LISER, pages 1-18, May.
    12. John Adams & Malcolm Greig & Ronald W. McQuaid, 2002. "Mismatch in Local Labour Markets in Central Scotland: The Neglected Role of Demand," Urban Studies, Urban Studies Journal Limited, vol. 39(8), pages 1399-1416, July.
    13. Oleksii Romanko & Mary O'Mahony, 2022. "The Use of Online Job Sites for Measuring Skills and Labour Market Trends: A Review," Economic Statistics Centre of Excellence (ESCoE) Technical Reports ESCOE-TR-19, Economic Statistics Centre of Excellence (ESCoE).
    14. Borchert, Philipp & Coussement, Kristof & De Caigny, Arno & De Weerdt, Jochen, 2023. "Extending business failure prediction models with textual website content using deep learning," European Journal of Operational Research, Elsevier, vol. 306(1), pages 348-357.
    15. Andreas I Mueller & Damian Osterwalder & Josef Zweimüller & Andreas Kettemann, 2024. "Vacancy Durations and Entry Wages: Evidence from Linked Vacancy–Employer–Employee Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(3), pages 1807-1841.
    16. Brad Hershbein & Lisa B. Kahn, 2018. "Do Recessions Accelerate Routine-Biased Technological Change? Evidence from Vacancy Postings," American Economic Review, American Economic Association, vol. 108(7), pages 1737-1772, July.
    17. repec:iza:izawol:journl:y:2014:p:18 is not listed on IDEAS
    18. Jed Devaro, 2005. "Employer Recruitment Strategies and the Labor Market Outcomes of New Hires," Economic Inquiry, Western Economic Association International, vol. 43(2), pages 263-282, April.
    19. van Ours, J C & Ridder, G, 1993. "Vacancy Durations: Search or Selection?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 55(2), pages 187-198, May.
    20. Vera Brenčič & John B. Norris, 2012. "Employers' On‐Line Recruitment And Screening Practices," Economic Inquiry, Western Economic Association International, vol. 50(1), pages 94-111, January.
    21. Steven J. Davis & R. Jason Faberman & John C. Haltiwanger, 2013. "The Establishment-Level Behavior of Vacancies and Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 581-622.
    22. repec:eee:labchp:v:3:y:1999:i:pb:p:2567-2627 is not listed on IDEAS
    23. Ioana Marinescu & Ronald Wolthoff, 2020. "Opening the Black Box of the Matching Function: The Power of Words," Journal of Labor Economics, University of Chicago Press, vol. 38(2), pages 535-568.
    24. David Deming & Lisa B. Kahn, 2018. "Skill Requirements across Firms and Labor Markets: Evidence from Job Postings for Professionals," Journal of Labor Economics, University of Chicago Press, vol. 36(S1), pages 337-369.
    25. R. Jason Faberman & Marianna Kudlyak, 2016. "What Does Online Job Search Tell Us about the Labor Market?," Economic Perspectives, Federal Reserve Bank of Chicago, issue 1, pages 1-15.
    26. Carrizosa, Emilio & Ramírez-Ayerbe, Jasone & Romero Morales, Dolores, 2024. "Mathematical optimization modelling for group counterfactual explanations," European Journal of Operational Research, Elsevier, vol. 319(2), pages 399-412.
    27. Jennifer Brown & David A. Matsa, 2016. "Boarding a Sinking Ship? An Investigation of Job Applications to Distressed Firms," Journal of Finance, American Finance Association, vol. 71(2), pages 507-550, April.
    28. Michèle Belot & Philipp Kircher & Paul Muller, 2019. "Providing Advice to Jobseekers at Low Cost: An Experimental Study on Online Advice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(4), pages 1411-1447.
    29. Mangan, John & Trendle, Bernard, 2017. "Hard-to-fill vacancies: An analysis of demand side responses in the Australian state of Queensland," Economic Analysis and Policy, Elsevier, vol. 54(C), pages 49-56.
    30. Ian Burn & Patrick Button & Luis Munguia Corella & David Neumark, 2022. "Does Ageist Language in Job Ads Predict Age Discrimination in Hiring?," Journal of Labor Economics, University of Chicago Press, vol. 40(3), pages 613-667.
    31. Carlos Carrillo-Tudela & Hermann Gartner & Leo Kaas, 2023. "Recruitment Policies, Job-Filling Rates, and Matching Efficiency," Journal of the European Economic Association, European Economic Association, vol. 21(6), pages 2413-2459.
    32. Wei, Yu-Chen & Chang, Chao-Ching & Lin, Liang-Yang & Liang, Shih-Chen, 2016. "A fit perspective approach in linking corporate image and intention-to-apply," Journal of Business Research, Elsevier, vol. 69(6), pages 2220-2225.
    33. Katsafados, Apostolos G. & Leledakis, George N. & Pyrgiotakis, Emmanouil G. & Androutsopoulos, Ion & Fergadiotis, Manos, 2024. "Machine learning in bank merger prediction: A text-based approach," European Journal of Operational Research, Elsevier, vol. 312(2), pages 783-797.
    34. John Adams & Malcolm Greig & Ronald W McQuaid, 2000. "Mismatch Unemployment and Local Labour-Market Efficiency: The Role of Employer and Vacancy Characteristics," Environment and Planning A, , vol. 32(10), pages 1841-1856, October.
    35. Brencic, Vera & Norris, John B., 2010. "Do employers change job offers in their online job ads to facilitate search?," Economics Letters, Elsevier, vol. 108(1), pages 46-48, July.
    36. Burdett, Kenneth & Cunningham, Elizabeth J, 1998. "Toward a Theory of Vacancies," Journal of Labor Economics, University of Chicago Press, vol. 16(3), pages 445-478, July.
    37. De Bock, Koen W. & Coussement, Kristof & Caigny, Arno De & Słowiński, Roman & Baesens, Bart & Boute, Robert N. & Choi, Tsan-Ming & Delen, Dursun & Kraus, Mathias & Lessmann, Stefan & Maldonado, Sebast, 2024. "Explainable AI for Operational Research: A defining framework, methods, applications, and a research agenda," European Journal of Operational Research, Elsevier, vol. 317(2), pages 249-272.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bhuller, Manudeep & Kostøl, Andreas & Vigtel, Trond Christian, 2019. "How Broadband Internet Affects Labor Market Matching," Memorandum 10/2019, Oslo University, Department of Economics.
    2. He, Chuan & Mau, Karsten & Xu, Mingzhi, 2021. "Trade Shocks and Firms Hiring Decisions: Evidence from Vacancy Postings of Chinese Firms in the Trade War," Labour Economics, Elsevier, vol. 71(C).
    3. Potter, Tristan, 2024. "Destabilizing search technology," Journal of Monetary Economics, Elsevier, vol. 145(C).
    4. Bagger, Jesper & Fontaine, Francois & Galenianos, Manolis & Trapeznikova, Ija, 2022. "Vacancies, employment outcomes and firm growth: Evidence from Denmark," Labour Economics, Elsevier, vol. 75(C).
    5. Hayato Kanayama & Suguru Otani, 2024. "Nonparametric Estimation of Matching Efficiency and Elasticity in a Spot Gig Work Platform: 2019-2023," Papers 2412.19024, arXiv.org, revised Mar 2025.
    6. Andreas I Mueller & Damian Osterwalder & Josef Zweimüller & Andreas Kettemann, 2024. "Vacancy Durations and Entry Wages: Evidence from Linked Vacancy–Employer–Employee Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(3), pages 1807-1841.
    7. Suguru Otani, 2024. "Nonparametric Estimation of Matching Efficiency and Elasticity on a Private On-the-Job Search Platform: Evidence from Japan, 2014-2024," Papers 2410.17011, arXiv.org, revised Nov 2025.
    8. Kircher, Philipp A.T., 2020. "Search design and online job search – new avenues for applied and experimental research," Labour Economics, Elsevier, vol. 64(C).
    9. Henna Nivalainen, 2014. "Internet-Based Employer Search and Vacancy Duration: Evidence from Finland," LABOUR, CEIS, vol. 28(1), pages 112-140, March.
    10. Faberman, R. Jason & Menzio, Guido, 2018. "Evidence on the relationship between recruiting and the starting wage," Labour Economics, Elsevier, vol. 50(C), pages 67-79.
    11. Maciej Berk{e}sewicz & Herman Cherniaiev & Robert Pater, 2021. "Estimating the number of entities with vacancies using administrative and online data," Papers 2106.03263, arXiv.org.
    12. Pater, Robert & Szkola, Jaroslaw & Kozak, Marcin, 2019. "A method for measuring detailed demand for workers' competences," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy, vol. 13, pages 1-30.
    13. Schwab, Brandon & Kriebel, Johannes, 2026. "Mitigating adversarial attacks on transformer models in credit scoring," European Journal of Operational Research, Elsevier, vol. 328(1), pages 309-323.
    14. Meisenbacher, Stephen & Nestorov, Svetlozar & Norlander, Peter, 2025. "Extracting O*NET Features from the NLx Corpus to Build Public Use Aggregate Labor Market Data," MPRA Paper 126336, University Library of Munich, Germany.
    15. Brenčič, Vera, 2024. "Distribution of vacancies and new hires across employers: Implications for job offers, skill requirements, and employers’ search outcomes," Labour Economics, Elsevier, vol. 91(C).
    16. Angelica Bertucci & Emilio Colombo & Patrizio Tirelli, 2025. "Broadband Internet and Labour Market Dynamism," DISEIS - Quaderni del Dipartimento di Economia internazionale, delle istituzioni e dello sviluppo dis2506, Università Cattolica del Sacro Cuore, Dipartimento di Economia internazionale, delle istituzioni e dello sviluppo (DISEIS).
    17. Furukawa, Kakuho & Hogen, Yoshihiko & Kido, Yosuke, 2025. "Labor market of regular workers in Japan: A perspective from job advertisement data," Journal of the Japanese and International Economies, Elsevier, vol. 75(C).
    18. Conny Wunsch & Felix Rochlitz & Patrick Arni, 2025. "Jobseekers’ skills and job search behaviour," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 161(1), pages 1-31, December.
    19. Oyer, Paul & Schaefer, Scott, 2011. "Personnel Economics: Hiring and Incentives," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 20, pages 1769-1823, Elsevier.
    20. Lochner, Benjamin & Merkl, Christian & Stüber, Heiko & Gürtzgen, Nicole, 2021. "Recruiting intensity and hiring practices: Cross-sectional and time-series evidence," Labour Economics, Elsevier, vol. 68(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:328:y:2026:i:2:p:680-693. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.