IDEAS home Printed from https://ideas.repec.org/p/cor/louvco/2025004.html

Transfer Reinforcement Learning for Pricing, Driver Repositioning and Customer Admission in Ride-Hailing Networks

Author

Listed:
  • De Munck, Thomas

    (Université catholique de Louvain, LIDAM/CORE, Belgium)

  • Tancrez, Jean-Sébastien

    (Université catholique de Louvain, LIDAM/CORE, Belgium)

  • Chevalier, Philippe

    (Université catholique de Louvain, LIDAM/CORE, Belgium)

Abstract

We consider the problem of a ride-hailing platform (e.g., Uber, Lyft) that connects supply with demand over a network of locations. To this aim, the platform makes pricing, driver repositioning, and customer admission decisions. Customers are impatient and have distinct willingness to pay. Drivers can be repositioned by the platform, or can choose to relocate to other locations by themselves. We formulate this problem as a discrete-time Markov decision process and propose a transfer learning approach to find an efficient policy. Our approach first derives a rolling-horizon strategy by repeatedly solving a deterministic optimization problem. Then, two neural networks are pretrained to replicate the strategy and learn the associated value function. Finally, the policy is further improved through deep reinforcement learning (DRL). Using data from New York City, we apply our approach to networks of up to 20 locations. The results show that our approach outperforms alternative DRL algorithms and rolling-horizon strategies while reducing computation time and stabilizing learning. We also explore the interplay between pricing, driver repositioning, and customer admission, providing insights into their respective roles.

Suggested Citation

  • De Munck, Thomas & Tancrez, Jean-Sébastien & Chevalier, Philippe, 2025. "Transfer Reinforcement Learning for Pricing, Driver Repositioning and Customer Admission in Ride-Hailing Networks," LIDAM Discussion Papers CORE 2025004, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  • Handle: RePEc:cor:louvco:2025004
    as

    Download full text from publisher

    File URL: https://dial.uclouvain.be/pr/boreal/en/object/boreal%3A299747/datastream/PDF_01/view
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Li, Sen & Yang, Hai & Poolla, Kameshwar & Varaiya, Pravin, 2021. "Spatial pricing in ride-sourcing markets under a congestion charge," Transportation Research Part B: Methodological, Elsevier, vol. 152(C), pages 18-45.
    2. De Moor, Bram J. & Gijsbrechts, Joren & Boute, Robert N., 2022. "Reward shaping to improve the performance of deep reinforcement learning in perishable inventory management," European Journal of Operational Research, Elsevier, vol. 301(2), pages 535-545.
    3. Jiaru Bai & Kut C. So & Christopher S. Tang & Xiqun (Michael) Chen & Hai Wang, 2019. "Coordinating Supply and Demand on an On-Demand Service Platform with Impatient Customers," Manufacturing & Service Operations Management, INFORMS, vol. 21(3), pages 556-570, July.
    4. De Munck, Thomas & Chevalier, Philippe & Tancrez, Jean-Sébastien, 2023. "Managing priorities on on-demand service platforms with waiting time differentiation," International Journal of Production Economics, Elsevier, vol. 266(C).
    5. Sun, Luoyi & Teunter, Ruud H. & Babai, M. Zied & Hua, Guowei, 2019. "Optimal pricing for ride-sourcing platforms," European Journal of Operational Research, Elsevier, vol. 278(3), pages 783-795.
    6. Kostas Bimpikis & Ozan Candogan & Daniela Saban, 2019. "Spatial Pricing in Ride-Sharing Networks," Operations Research, INFORMS, vol. 67(3), pages 744-769, May.
    7. Wang, Hai & Yang, Hai, 2019. "Ridesourcing systems: A framework and review," Transportation Research Part B: Methodological, Elsevier, vol. 129(C), pages 122-155.
    8. Siddhartha Banerjee & Daniel Freund & Thodoris Lykouris, 2022. "Pricing and Optimization in Shared Vehicle Systems: An Approximation Framework," Operations Research, INFORMS, vol. 70(3), pages 1783-1805, May.
    9. Nourinejad, Mehdi & Ramezani, Mohsen, 2020. "Ride-Sourcing modeling and pricing in non-equilibrium two-sided markets," Transportation Research Part B: Methodological, Elsevier, vol. 132(C), pages 340-357.
    10. Al-Kanj, Lina & Nascimento, Juliana & Powell, Warren B., 2020. "Approximate dynamic programming for planning a ride-hailing system using autonomous fleets of electric vehicles," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1088-1106.
    11. David Silver & Aja Huang & Chris J. Maddison & Arthur Guez & Laurent Sifre & George van den Driessche & Julian Schrittwieser & Ioannis Antonoglou & Veda Panneershelvam & Marc Lanctot & Sander Dieleman, 2016. "Mastering the game of Go with deep neural networks and tree search," Nature, Nature, vol. 529(7587), pages 484-489, January.
    12. Yash Kanoria & Pengyu Qian, 2024. "Blind Dynamic Resource Allocation in Closed Networks via Mirror Backpressure," Management Science, INFORMS, vol. 70(8), pages 5445-5462, August.
    13. Boute, Robert N. & Gijsbrechts, Joren & van Jaarsveld, Willem & Vanvuchelen, Nathalie, 2022. "Deep reinforcement learning for inventory control: A roadmap," European Journal of Operational Research, Elsevier, vol. 298(2), pages 401-412.
    14. Anton Braverman & J. G. Dai & Xin Liu & Lei Ying, 2019. "Empty-Car Routing in Ridesharing Systems," Operations Research, INFORMS, vol. 67(5), pages 1437-1452, September.
    15. Zhu, Zheng & Ke, Jintao & Wang, Hai, 2021. "A mean-field Markov decision process model for spatial-temporal subsidies in ride-sourcing markets," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 540-565.
    16. Yan, Pengyu & Yu, Kaize & Chao, Xiuli & Chen, Zhibin, 2023. "An online reinforcement learning approach to charging and order-dispatching optimization for an e-hailing electric vehicle fleet," European Journal of Operational Research, Elsevier, vol. 310(3), pages 1218-1233.
    17. Nicholas D. Kullman & Martin Cousineau & Justin C. Goodson & Jorge E. Mendoza, 2022. "Dynamic Ride-Hailing with Electric Vehicles," Transportation Science, INFORMS, vol. 56(3), pages 775-794, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mo, Dong & Wang, Hai & Cai, Zeen & Szeto, W.Y. & Chen, Xiqun (Michael), 2024. "Modeling and regulating a ride-sourcing market integrated with vehicle rental services," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 192(C).
    2. Meijian Yang & Enjun Xia, 2021. "A Systematic Literature Review on Pricing Strategies in the Sharing Economy," Sustainability, MDPI, vol. 13(17), pages 1-28, August.
    3. Lei, Zengxiang & Ukkusuri, Satish V., 2023. "Scalable reinforcement learning approaches for dynamic pricing in ride-hailing systems," Transportation Research Part B: Methodological, Elsevier, vol. 178(C).
    4. Chen, Junlin & Xiong, Jinghong & Chen, Guobao & Liu, Xin & Yan, Peng & Jiang, Hai, 2024. "Optimal instant discounts of multiple ride options at a ride-hailing aggregator," European Journal of Operational Research, Elsevier, vol. 314(2), pages 718-734.
    5. De Munck, Thomas & Chevalier, Philippe & Tancrez, Jean-Sébastien, 2023. "Managing priorities on on-demand service platforms with waiting time differentiation," International Journal of Production Economics, Elsevier, vol. 266(C).
    6. Liu, Yang & Li, Sen, 2023. "An economic analysis of on-demand food delivery platforms: Impacts of regulations and integration with ride-sourcing platforms," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 171(C).
    7. Zhong, Yuanguang & Lan, Yibo & Chen, Zhi & Yang, Jiazi, 2023. "On-demand ride-hailing platforms with heterogeneous quality-sensitive customers: Dedicated system or pooling system?," Transportation Research Part B: Methodological, Elsevier, vol. 173(C), pages 247-266.
    8. Yining Liu & Yanfeng Ouyang, 2022. "Planning ride-pooling services with detour restrictions for spatially heterogeneous demand: A multi-zone queuing network approach," Papers 2208.02219, arXiv.org, revised Jun 2023.
    9. Di Ao & Jing Gao & Zhijie Lai & Sen Li, 2021. "Regulating Transportation Network Companies with a Mixture of Autonomous Vehicles and For-Hire Human Drivers," Papers 2112.07218, arXiv.org, revised Dec 2023.
    10. Ji, Yuxiong & Zhou, Minhang & Zheng, Yujing & Shen, Yu & Du, Yuchuan, 2024. "Urban passenger-and-package sharing transportation by e-hailing taxis: A simulation-based pricing analysis in shanghai," Transport Policy, Elsevier, vol. 156(C), pages 138-151.
    11. Huang, Yunping & Zhu, Pengbo & Zhong, Renxin & Geroliminis, Nikolas, 2024. "A bi-level approach for optimal vehicle relocating in Mobility-On-Demand systems with approximate dynamic programming and coverage control," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 192(C).
    12. Xu, Zhengtian & Yin, Yafeng & Chao, Xiuli & Zhu, Hongtu & Ye, Jieping, 2021. "A generalized fluid model of ride-hailing systems," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 587-605.
    13. Liu, Yining & Ouyang, Yanfeng, 2023. "Planning ride-pooling services with detour restrictions for spatially heterogeneous demand: A multi-zone queuing network approach," Transportation Research Part B: Methodological, Elsevier, vol. 174(C).
    14. Yan, Rui & Chen, Yuwen & Liu, Baolong & Wang, Xuege, 2025. "Promoting carpooling on car-hailing platforms: Order allocation and motivating subsidy," Transportation Research Part B: Methodological, Elsevier, vol. 199(C).
    15. Zhang, Kenan & Nie, Yu (Marco), 2022. "Mitigating traffic congestion induced by transportation network companies: A policy analysis," Transportation Research Part A: Policy and Practice, Elsevier, vol. 159(C), pages 96-118.
    16. Xu, Yu & Ling, Liuyi & Wu, Jie & Xu, Shengshuo, 2024. "On-demand ride-hailing platforms under green mobility: Pricing strategies and government regulation," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 189(C).
    17. Zhong, Yuanguang & Zillmann, Stefan & Zhang, Ruijie & Zhou, Yong-Wu & Xie, Wei, 2023. "Vehicle repositioning for a ride-sourcing network system providing differentiated services," Transportation Research Part B: Methodological, Elsevier, vol. 170(C), pages 221-243.
    18. Liang, Jian & Zhao, Ya & Wang, Hai & Yang, Linchuan & Ke, Jintao, 2025. "Understanding order cancellation behavior in on-demand delivery services," Transportation Research Part A: Policy and Practice, Elsevier, vol. 198(C).
    19. Hu, Xinru & Zhou, Shuiyin & Luo, Xiaomeng & Li, Jianbin & Zhang, Chi, 2024. "Optimal pricing strategy of an on-demand platform with cross-regional passengers," Omega, Elsevier, vol. 122(C).
    20. Zhu, Zheng & Xu, Ailing & He, Qiao-Chu & Yang, Hai, 2021. "Competition between the transportation network company and the government with subsidies to public transit riders," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 152(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cor:louvco:2025004. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alain GILLIS (email available below). General contact details of provider: https://edirc.repec.org/data/coreebe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.