IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v67y2021i7p4362-4383.html
   My bibliography  Save this article

Demand-Aware Career Path Recommendations: A Reinforcement Learning Approach

Author

Listed:
  • Marios Kokkodis

    (Carroll School of Management, Boston College, Chestnut Hill, Massachusetts 02467)

  • Panagiotis G. Ipeirotis

    (Leonard N. Stern School of Business, New York University, New York, New York 10012)

Abstract

A skill’s value depends on dynamic market conditions. To remain marketable, contractors need to keep reskilling themselves continuously. But choosing new skills to learn is an inherently hard task: Contractors have very little information about current and future market conditions, which often results in poor learning choices. Recommendation frameworks could reduce uncertainty in learning choices. However, conventional approaches would likely be inefficient; they would model previous (often poor) observed contractor learning behaviors to provide future career path recommendations while ignoring current market trends. This work proposes a framework that combines reinforcement learning, Bayesian inference, and gradient boosting to provide recommendations on how contractors should behave when choosing new skills to learn. Compared with standard recommender systems, this framework does not learn from previous (often poor) behaviors to make future recommendations. Instead, it relies on a Markov decision process to operate on a graph of feasible actions and dynamically recommend profitable career paths. The framework uses market information to identify current trends and project future wages. Based on this information, it recommends feasible, relevant actions that a contractor can take to learn new, in-demand skills. Evaluation of the framework on 1.73 million job applications from an online labor market shows that its implementation could increase (1) the marketplace’s revenue by up to 6%, (2) contractors’ wages by 22%, and (3) the diversity of new skill acquisitions by 47%. A comparison with alternative recommender systems highlights the limitations of approaches that make recommendations based on previously observed learning behaviors.

Suggested Citation

  • Marios Kokkodis & Panagiotis G. Ipeirotis, 2021. "Demand-Aware Career Path Recommendations: A Reinforcement Learning Approach," Management Science, INFORMS, vol. 67(7), pages 4362-4383, July.
  • Handle: RePEc:inm:ormnsc:v:67:y:2021:i:7:p:4362-4383
    DOI: 10.1287/mnsc.2020.3727
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3727
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3727?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Niels Bosma & Mirjam van Praag & Roy Thurik & Gerrit de Wit, 2004. "The Value of Human and Social Capital Investments for the Business Performance of Startups," Small Business Economics, Springer, vol. 23(3), pages 227-236, October.
    2. Terrance Odean., 1996. "Volume, Volatility, Price and Profit When All Trader Are Above Average," Research Program in Finance Working Papers RPF-266, University of California at Berkeley.
    3. Gary S. Becker, 1962. "Investment in Human Capital: A Theoretical Analysis," NBER Chapters, in: Investment in Human Beings, pages 9-49, National Bureau of Economic Research, Inc.
    4. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    5. Daniel Fleder & Kartik Hosanagar, 2009. "Blockbuster Culture's Next Rise or Fall: The Impact of Recommender Systems on Sales Diversity," Management Science, INFORMS, vol. 55(5), pages 697-712, May.
    6. Erik Brynjolfsson & Yu (Jeffrey) Hu & Duncan Simester, 2011. "Goodbye Pareto Principle, Hello Long Tail: The Effect of Search Costs on the Concentration of Product Sales," Management Science, INFORMS, vol. 57(8), pages 1373-1386, August.
    7. Richard Blundell & Lorraine Dearden & Costas Meghir & Barbara Sianesi, 1999. "Human capital investment: the returns from education and training to the individual, the firm and the economy," Fiscal Studies, Institute for Fiscal Studies, vol. 20(1), pages 1-23, March.
    8. Dominic D. P. Johnson & James H. Fowler, 2011. "The evolution of overconfidence," Nature, Nature, vol. 477(7364), pages 317-320, September.
    9. Hema Yoganarasimhan, 2013. "The Value of Reputation in an Online Freelance Marketplace," Marketing Science, INFORMS, vol. 32(6), pages 860-891, November.
    10. Edward P. Lazear, 2009. "Firm-Specific Human Capital: A Skill-Weights Approach," Journal of Political Economy, University of Chicago Press, vol. 117(5), pages 914-940, October.
    11. Marios Kokkodis & Panagiotis G. Ipeirotis, 2016. "Reputation Transferability in Online Labor Markets," Management Science, INFORMS, vol. 62(6), pages 1687-1706, June.
    12. Erik Brynjolfsson & Michael D. Smith, 2000. "Frictionless Commerce? A Comparison of Internet and Conventional Retailers," Management Science, INFORMS, vol. 46(4), pages 563-585, April.
    13. Cooper, Arnold C. & Woo, Carolyn Y. & Dunkelberg, William C., 1988. "Entrepreneurs' perceived chances for success," Journal of Business Venturing, Elsevier, vol. 3(2), pages 97-108.
    14. Antonio Moreno & Christian Terwiesch, 2014. "Doing Business with Strangers: Reputation in Online Service Marketplaces," Information Systems Research, INFORMS, vol. 25(4), pages 865-886, December.
    15. Daniel L. Chen & John J. Horton, 2016. "Research Note—Are Online Labor Markets Spot Markets for Tasks? A Field Experiment on the Behavioral Response to Wage Cuts," Information Systems Research, INFORMS, vol. 27(2), pages 403-423, June.
    16. Peter Kuhn & Mikal Skuterud, 2004. "Internet Job Search and Unemployment Durations," American Economic Review, American Economic Association, vol. 94(1), pages 218-232, March.
    17. Chen, Daniel L. & Horton, John J., 2016. "Are Online Labor Markets Spot Markets for Tasks?: A Field Experiment on the Behavioral Response to Wage Cuts," TSE Working Papers 16-675, Toulouse School of Economics (TSE).
    18. Anandasivam Gopal & Konduru Sivaramakrishnan & M. S. Krishnan & Tridas Mukhopadhyay, 2003. "Contracts in Offshore Software Development: An Empirical Analysis," Management Science, INFORMS, vol. 49(12), pages 1671-1683, December.
    19. Sundararajan, Arun, 2016. "The Sharing Economy: The End of Employment and the Rise of Crowd-Based Capitalism," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262034573, December.
    20. Debabrata Dey & Ming Fan & Conglei Zhang, 2010. "Design and Analysis of Contracts for Software Outsourcing," Information Systems Research, INFORMS, vol. 21(1), pages 93-114, March.
    21. Rajiv D. Banker & Iny Hwang, 2008. "Importance of Measures of Past Performance: Empirical Evidence on Quality of e†Service Providers," Contemporary Accounting Research, John Wiley & Sons, vol. 25(2), pages 307-337, June.
    22. David H. Autor, 2001. "Wiring the Labor Market," Journal of Economic Perspectives, American Economic Association, vol. 15(1), pages 25-40, Winter.
    23. Gary S. Becker, 1994. "Human Capital: A Theoretical and Empirical Analysis with Special Reference to Education, Third Edition," NBER Books, National Bureau of Economic Research, Inc, number beck94-1, March.
    24. Glomm, Gerhard & Ravikumar, B, 1992. "Public versus Private Investment in Human Capital Endogenous Growth and Income Inequality," Journal of Political Economy, University of Chicago Press, vol. 100(4), pages 818-834, August.
    25. David H. Autor & Lawrence F. Katz & Alan B. Krueger, 1998. "Computing Inequality: Have Computers Changed the Labor Market?," The Quarterly Journal of Economics, Oxford University Press, vol. 113(4), pages 1169-1213.
    26. Terrance Odean, 1998. "Volume, Volatility, Price, and Profit When All Traders Are Above Average," Journal of Finance, American Finance Association, vol. 53(6), pages 1887-1934, December.
    27. Berinsky, Adam J. & Huber, Gregory A. & Lenz, Gabriel S., 2012. "Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk," Political Analysis, Cambridge University Press, vol. 20(3), pages 351-368, July.
    28. Smith, Gerald E. & Venkatraman, Meera P. & Dholakia, Ruby Roy, 1999. "Diagnosing the search cost effect: Waiting time and the moderating impact of prior category knowledge," Journal of Economic Psychology, Elsevier, vol. 20(3), pages 285-314, June.
    29. Johnson, Thomas, 1970. "Returns from Investment in Human Capital," American Economic Review, American Economic Association, vol. 60(4), pages 546-560, September.
    30. Wiltbank, Robert & Read, Stuart & Dew, Nicholas & Sarasvathy, Saras D., 2009. "Prediction and control under uncertainty: Outcomes in angel investing," Journal of Business Venturing, Elsevier, vol. 24(2), pages 116-133, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marios Kokkodis, 2023. "Adjusting Skillset Cohesion in Online Labor Markets: Reputation Gains and Opportunity Losses," Information Systems Research, INFORMS, vol. 34(3), pages 1245-1258, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marios Kokkodis, 2023. "Adjusting Skillset Cohesion in Online Labor Markets: Reputation Gains and Opportunity Losses," Information Systems Research, INFORMS, vol. 34(3), pages 1245-1258, September.
    2. Marios Kokkodis, 2021. "Dynamic, Multidimensional, and Skillset-Specific Reputation Systems for Online Work," Information Systems Research, INFORMS, vol. 32(3), pages 688-712, September.
    3. Marios Kokkodis & Sam Ransbotham, 2023. "Learning to Successfully Hire in Online Labor Markets," Management Science, INFORMS, vol. 69(3), pages 1597-1614, March.
    4. Irfan Kanat & Yili Hong & T. S. Raghu, 2018. "Surviving in Global Online Labor Markets for IT Services: A Geo-Economic Analysis," Information Systems Research, INFORMS, vol. 29(4), pages 893-909, December.
    5. Mingfeng Lin & Yong Liu & Siva Viswanathan, 2018. "Effectiveness of Reputation in Contracting for Customized Production: Evidence from Online Labor Markets," Management Science, INFORMS, vol. 64(1), pages 345-359, January.
    6. Jason Chan & Jing Wang, 2018. "Hiring Preferences in Online Labor Markets: Evidence of a Female Hiring Bias," Management Science, INFORMS, vol. 64(7), pages 2973-2994, July.
    7. Seifried, Mareike, 2021. "Transitions from offline to online labor markets: The relationship between freelancers' prior offline and online work experience," ZEW Discussion Papers 21-101, ZEW - Leibniz Centre for European Economic Research.
    8. Panos Constantinides & Ola Henfridsson & Geoffrey G. Parker, 2018. "Introduction—Platforms and Infrastructures in the Digital Age," Information Systems Research, INFORMS, vol. 29(2), pages 381-400, June.
    9. Karl Taeuscher, 2019. "Uncertainty kills the long tail: demand concentration in peer-to-peer marketplaces," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(4), pages 649-660, December.
    10. Lu, Xin & Shang, Jennifer & Wu, Shin-yi & Hegde, Gajanan G. & Vargas, Luis & Zhao, Daozhi, 2015. "Impacts of supplier hubris on inventory decisions and green manufacturing endeavors," European Journal of Operational Research, Elsevier, vol. 245(1), pages 121-132.
    11. Kazakova, E. & Sandomirskaia, M. & Suvorov, A. & Khazhgerieva, A. & Shavshin, R., 2023. "Platforms, online labor markets, and crowdsourcing. Part 1. Traditional online labor market," Journal of the New Economic Association, New Economic Association, vol. 60(3), pages 120-148.
    12. Apostolos Filippas & John Horton & Joseph M. Golden, 2017. "Reputation in the Long-Run," CESifo Working Paper Series 6750, CESifo.
    13. Evangelos Mourelatos & Nicholas Giannakopoulos & Manolis Tzagarakis, 2022. "Personality traits and performance in online labour markets," Behaviour and Information Technology, Taylor & Francis Journals, vol. 41(3), pages 468-484, February.
    14. Yili Hong & Paul A. Pavlou, 2017. "On Buyer Selection of Service Providers in Online Outsourcing Platforms for IT Services," Information Systems Research, INFORMS, vol. 28(3), pages 547-562, September.
    15. Mueller-Langer, Frank & Gómez-Herrera, Estrella, 2022. "Mobility restrictions and the substitution between on-site and remote work: Empirical evidence from a European online labour market," Information Economics and Policy, Elsevier, vol. 58(C).
    16. Kevin J. Boudreau, 2018. "Amateurs Crowds & Professional Entrepreneurs as Platform Complementors," NBER Working Papers 24512, National Bureau of Economic Research, Inc.
    17. Hilal Atasoy & Rajiv D. Banker & Paul A. Pavlou, 2021. "Information Technology Skills and Labor Market Outcomes for Workers," Information Systems Research, INFORMS, vol. 32(2), pages 437-461, June.
    18. Apostolos Filippas & John J. Horton & Joseph M. Golden, 2019. "Reputation Inflation," NBER Working Papers 25857, National Bureau of Economic Research, Inc.
    19. Mourelatos, Evangelos, 2021. "Personality and Ethics on Online Labor Markets: How mood influences ethical perceptions," EconStor Preprints 244735, ZBW - Leibniz Information Centre for Economics.
    20. Zhijuan Hong & Ruhai Wu & Yan Sun & Kunxiang Dong, 2020. "Buyer preferences for auction pricing rules in online outsourcing markets: fixed price vs. open price," Electronic Markets, Springer;IIM University of St. Gallen, vol. 30(1), pages 163-179, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:67:y:2021:i:7:p:4362-4383. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.