IDEAS home Printed from https://ideas.repec.org/a/eee/transb/v202y2025ics0191261525001845.html

A dynamic drone routing problem with uncertain demand and energy consumption

Author

Listed:
  • Chagas, Guilherme O.
  • Coelho, Leandro C.
  • Laganà, Demetrio
  • Beraldi, Patrizia

Abstract

This work addresses a drone routing problem with an identical fleet performing same-day deliveries in a dynamic and uncertain environment. We model the problem as a Markov Decision Process to capture the stochastic nature of customer demand and the uncertainty in energy consumption due to varying payloads and weather conditions. To tackle this problem, we propose an approximate dynamic algorithm that integrates routing planning, drone usage, and battery management. Uncertainty in energy consumption is dealt with the chance constraints ensuring that drone trips are completed safely, preventing premature returns to the depot. The proposed approach features a cost function approximation policy that accounts for a restricted number of trips to be assigned to drones. This ensures that the drones are ready at the depot to fulfill new requests that may arise during the day. Extensive computational experiments on 300 instances validate the effectiveness of our method, demonstrating its superiority over a myopic strategy, a policy function approximation approach, and an oracle method, thus highlighting its potential for practical applications.

Suggested Citation

  • Chagas, Guilherme O. & Coelho, Leandro C. & Laganà, Demetrio & Beraldi, Patrizia, 2025. "A dynamic drone routing problem with uncertain demand and energy consumption," Transportation Research Part B: Methodological, Elsevier, vol. 202(C).
  • Handle: RePEc:eee:transb:v:202:y:2025:i:c:s0191261525001845
    DOI: 10.1016/j.trb.2025.103335
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0191261525001845
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.trb.2025.103335?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Chen, Xinwei & Wang, Tong & Thomas, Barrett W. & Ulmer, Marlin W., 2023. "Same-day delivery with fair customer service," European Journal of Operational Research, Elsevier, vol. 308(2), pages 738-751.
    2. Chun Cheng & Yossiri Adulyasak & Louis-Martin Rousseau, 2024. "Robust Drone Delivery with Weather Information," Manufacturing & Service Operations Management, INFORMS, vol. 26(4), pages 1402-1421, July.
    3. Zhang, Jian & Woensel, Tom Van, 2023. "Dynamic vehicle routing with random requests: A literature review," International Journal of Production Economics, Elsevier, vol. 256(C).
    4. Zhao, Lei & Bi, Xinhua & Li, Gendao & Dong, Zhaohui & Xiao, Ni & Zhao, Anni, 2022. "Robust traveling salesman problem with multiple drones: Parcel delivery under uncertain navigation environments," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 168(C).
    5. Yin, Yunqiang & Yang, Yongjian & Yu, Yugang & Wang, Dujuan & Cheng, T.C.E., 2023. "Robust vehicle routing with drones under uncertain demands and truck travel times in humanitarian logistics," Transportation Research Part B: Methodological, Elsevier, vol. 174(C).
    6. Warren B. Powell, 2016. "Perspectives of approximate dynamic programming," Annals of Operations Research, Springer, vol. 241(1), pages 319-356, June.
    7. Stoia, Sara & Laganà, Demetrio & Ohlmann, Jeffrey W., 2025. "Dynamic pickup-and-delivery for collaborative platforms with time-dependent travel and crowdshipping," European Journal of Operational Research, Elsevier, vol. 322(1), pages 70-84.
    8. Cheng, Chun & Adulyasak, Yossiri & Rousseau, Louis-Martin, 2020. "Drone routing with energy function: Formulation and exact algorithm," Transportation Research Part B: Methodological, Elsevier, vol. 139(C), pages 364-387.
    9. Marlin Ulmer & Martin Savelsbergh, 2020. "Workforce Scheduling in the Era of Crowdsourced Delivery," Transportation Science, INFORMS, vol. 54(4), pages 1113-1133, July.
    10. Yang, Yu & Yan, Chiwei & Cao, Yufeng & Roberti, Roberto, 2023. "Planning robust drone-truck delivery routes under road traffic uncertainty," European Journal of Operational Research, Elsevier, vol. 309(3), pages 1145-1160.
    11. Marlin W. Ulmer & Barrett W. Thomas & Ann Melissa Campbell & Nicholas Woyak, 2021. "The Restaurant Meal Delivery Problem: Dynamic Pickup and Delivery with Deadlines and Random Ready Times," Transportation Science, INFORMS, vol. 55(1), pages 75-100, 1-2.
    12. Soeffker, Ninja & Ulmer, Marlin W. & Mattfeld, Dirk C., 2022. "Stochastic dynamic vehicle routing in the light of prescriptive analytics: A review," European Journal of Operational Research, Elsevier, vol. 298(3), pages 801-820.
    13. Luigi Di Puglia Pugliese & Francesca Guerriero & Maria Grazia Scutellá, 2021. "The Last-Mile Delivery Process with Trucks and Drones Under Uncertain Energy Consumption," Journal of Optimization Theory and Applications, Springer, vol. 191(1), pages 31-67, October.
    14. Chen, Xinwei & Ulmer, Marlin W. & Thomas, Barrett W., 2022. "Deep Q-learning for same-day delivery with vehicles and drones," European Journal of Operational Research, Elsevier, vol. 298(3), pages 939-952.
    15. Marlin W. Ulmer & Justin C. Goodson & Dirk C. Mattfeld & Marco Hennig, 2019. "Offline–Online Approximate Dynamic Programming for Dynamic Vehicle Routing with Stochastic Requests," Service Science, INFORMS, vol. 53(1), pages 185-202, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Jian & Woensel, Tom Van, 2023. "Dynamic vehicle routing with random requests: A literature review," International Journal of Production Economics, Elsevier, vol. 256(C).
    2. He, Qingying & Liu, Wei & Liu, Tian-Liang & Tian, Qiong, 2025. "Robust coordinated path planning for unmanned aerial vehicles and unmanned surface vehicles in maritime monitoring with travel time uncertainty," Transportation Research Part B: Methodological, Elsevier, vol. 199(C).
    3. Cui, Haipeng & Li, Keyu & Jia, Shuai & Meng, Qiang, 2024. "Dynamic collaborative truck-drone delivery with en-route synchronization and random requests," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 192(C).
    4. Bosse, Alexander & Ulmer, Marlin W. & Manni, Emanuele & Mattfeld, Dirk C., 2023. "Dynamic priority rules for combining on-demand passenger transportation and transportation of goods," European Journal of Operational Research, Elsevier, vol. 309(1), pages 399-408.
    5. Stoia, Sara & Laganà, Demetrio & Ohlmann, Jeffrey W., 2025. "Dynamic pickup-and-delivery for collaborative platforms with time-dependent travel and crowdshipping," European Journal of Operational Research, Elsevier, vol. 322(1), pages 70-84.
    6. Barzanjeh, Shakoor & Ahmadizar, Fardin & Arkat, Jamal, 2025. "Logic-based benders decomposition algorithm for robust parallel drone scheduling problem considering uncertain travel times for drones," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 193(C).
    7. Yuanyuan Li & Claudia Archetti & Ivana Ljubić, 2024. "Reinforcement Learning Approaches for the Orienteering Problem with Stochastic and Dynamic Release Dates," Transportation Science, INFORMS, vol. 58(5), pages 1143-1165, September.
    8. Shi, Yong & Zhang, Keyi & Zhang, Jian & Chen, Miao & Yang, Junhao & Guo, Haixiang, 2026. "Dynamic truck-drone cooperative delivery of emergency supplies considering secondary disasters," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 206(C).
    9. Gal Neria & Michal Tzur, 2024. "The Dynamic Pickup and Allocation with Fairness Problem," Transportation Science, INFORMS, vol. 58(4), pages 821-840, July.
    10. Peng, Wenhao & Wang, Dujuan & Yin, Yunqiang & Cheng, T.C.E., 2025. "Multi-agent deep reinforcement learning-based truck-drone collaborative routing with dynamic emergency response," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 195(C).
    11. Chen, Xinwei & Wang, Tong & Thomas, Barrett W. & Ulmer, Marlin W., 2023. "Same-day delivery with fair customer service," European Journal of Operational Research, Elsevier, vol. 308(2), pages 738-751.
    12. Fleckenstein, David & Klein, Robert & Steinhardt, Claudius, 2023. "Recent advances in integrating demand management and vehicle routing: A methodological review," European Journal of Operational Research, Elsevier, vol. 306(2), pages 499-518.
    13. Lin, Ziru & Demir, Emrah & Xu, Xiaofeng & Laporte, Gilbert, 2025. "An advanced hybrid approach for emergency healthcare pickup and delivery with unmanned aerial vehicles under a stochastic environment," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 204(C).
    14. Florentin D. Hildebrandt & Žiga Lesjak & Arne Strauss & Marlin W. Ulmer, 2026. "Integrated Fleet and Demand Control for On-Demand Meal Delivery Platforms," Management Science, INFORMS, vol. 72(2), pages 932-954, February.
    15. Paul, Aditya & Levin, Michael W. & Waller, S. Travis & Rey, David, 2025. "Data-driven optimization for drone delivery service planning with online demand," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 198(C).
    16. Li, Meng & Cai, Kaiquan & Zhao, Peng, 2025. "Optimizing same-day delivery with vehicles and drones: A hierarchical deep reinforcement learning approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 193(C).
    17. Mousavi, Kianoush & Bodur, Merve & Cevik, Mucahit & Roorda, Matthew J., 2024. "Approximate dynamic programming for pickup and delivery problem with crowd-shipping," Transportation Research Part B: Methodological, Elsevier, vol. 187(C).
    18. Paradiso, Rosario & Roberti, Roberto & Ulmer, Marlin, 2025. "Lookahead scenario relaxation for dynamic time window assignment in service routing," Transportation Research Part B: Methodological, Elsevier, vol. 192(C).
    19. Nikola Mardešić & Tomislav Erdelić & Tonči Carić & Marko Đurasević, 2023. "Review of Stochastic Dynamic Vehicle Routing in the Evolving Urban Logistics Environment," Mathematics, MDPI, vol. 12(1), pages 1-44, December.
    20. Liu, Zeyu & Li, Xueping & Khojandi, Anahita, 2022. "The flying sidekick traveling salesman problem with stochastic travel time: A reinforcement learning approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 164(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transb:v:202:y:2025:i:c:s0191261525001845. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/548/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.