IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v337y2024i2d10.1007_s10479-023-05597-8.html
   My bibliography  Save this article

Shortening the project schedule: solving multimode chance-constrained critical chain buffer management using reinforcement learning

Author

Listed:
  • Claudio Szwarcfiter

    (Holon Institute of Technology)

  • Yale T. Herer

    (Technion—Israel Institute of Technology)

  • Avraham Shtub

    (Technion—Israel Institute of Technology)

Abstract

Critical chain buffer management (CCBM) has been extensively studied in recent years. This paper investigates a new formulation of CCBM, the multimode chance-constrained CCBM problem. A flow-based mixed-integer linear programming model is described and the chance constraints are tackled using a scenario approach. A reinforcement learning (RL)-based algorithm is proposed to solve the problem. A factorial experiment is conducted and the results of this study indicate that solving the chance-constrained problem produces shorter project durations than the traditional approach that inserts time buffers into a baseline schedule generated by solving the deterministic problem. This paper also demonstrates that our RL method produces competitive schedules compared to established benchmarks. The importance of solving the chance-constrained problem and obtaining a project buffer tailored to the desired probability of completing the project on schedule directly from the solution is highlighted. Because of its potential for generating shorter schedules with the same on-time probabilities as the traditional approach, this research can be a useful aid for decision makers.

Suggested Citation

  • Claudio Szwarcfiter & Yale T. Herer & Avraham Shtub, 2024. "Shortening the project schedule: solving multimode chance-constrained critical chain buffer management using reinforcement learning," Annals of Operations Research, Springer, vol. 337(2), pages 565-592, June.
    • Handle: RePEc:spr:annopr:v:337:y:2024:i:2:d:10.1007_s10479-023-05597-8
    DOI: 10.1007/s10479-023-05597-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-023-05597-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-023-05597-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Junguang Zhang & Xiwei Song & Hongyu Chen & Ruixia (Sandy) Shi, 2015. "Optimisation of critical chain sequencing based on activities’ information flow interactions," International Journal of Production Research, Taylor & Francis Journals, vol. 53(20), pages 6231-6241, October.
    2. Van Peteghem, Vincent & Vanhoucke, Mario, 2014. "An experimental investigation of metaheuristics for the multi-mode resource-constrained project scheduling problem on new dataset instances," European Journal of Operational Research, Elsevier, vol. 235(1), pages 62-72.
    3. Junguang Zhang & Xiwei Song & Hongyu Chen & Ruixia (Sandy) Shi, 2016. "Determination of critical chain project buffer based on information flow interactions," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(9), pages 1146-1157, September.
    4. Wendi Tian & Erik Demeulemeester, 2014. "Railway scheduling reduces the expected project makespan over roadrunner scheduling in a multi-mode project scheduling environment," Annals of Operations Research, Springer, vol. 213(1), pages 271-291, February.
    5. Farnaz Torabi Yeganeh & Seyed Hessameddin Zegordi, 2020. "A multi-objective optimization approach to project scheduling with resiliency criteria under uncertain activity duration," Annals of Operations Research, Springer, vol. 285(1), pages 161-196, February.
    6. Junguang Zhang & Xiwei Song & Estrella Díaz, 2017. "Critical chain project buffer sizing based on resource constraints," International Journal of Production Research, Taylor & Francis Journals, vol. 55(3), pages 671-683, February.
    7. She, Bingling & Chen, Bo & Hall, Nicholas G., 2021. "Buffer sizing in critical chain project management by network decomposition," Omega, Elsevier, vol. 102(C).
    8. Claudio Szwarcfiter & Yale T. Herer & Avraham Shtub, 2022. "Project scheduling in a lean environment to maximize value and minimize overruns," Journal of Scheduling, Springer, vol. 25(2), pages 177-190, April.
    9. Weibo Zheng & Zhengwen He & Nengmin Wang & Tao Jia, 2018. "Proactive and reactive resource-constrained max-NPV project scheduling with random activity duration," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 69(1), pages 115-126, January.
    10. Kolisch, Rainer, 1996. "Serial and parallel resource-constrained project scheduling methods revisited: Theory and computation," European Journal of Operational Research, Elsevier, vol. 90(2), pages 320-333, April.
    11. Gutjahr, Walter J., 2015. "Bi-Objective Multi-Mode Project Scheduling Under Risk Aversion," European Journal of Operational Research, Elsevier, vol. 246(2), pages 421-434.
    12. Yan Zhao & Nanfang Cui & Wendi Tian, 2020. "A two-stage approach for the critical chain project rescheduling," Annals of Operations Research, Springer, vol. 285(1), pages 67-95, February.
    13. Morteza Davari & Erik Demeulemeester, 2019. "Important classes of reactions for the proactive and reactive resource-constrained project scheduling problem," Annals of Operations Research, Springer, vol. 274(1), pages 187-210, March.
    14. Mario Vanhoucke, 2016. "Integrated Project Management Sourcebook," Springer Books, Springer, edition 1, number 978-3-319-27373-0, December.
    15. Hadi Moradi & Shahram Shadrokh, 2019. "A robust scheduling for the multi-mode project scheduling problem with a given deadline under uncertainty of activity duration," International Journal of Production Research, Taylor & Francis Journals, vol. 57(10), pages 3138-3167, May.
    16. Olivier Lambrechts & Erik Demeulemeester & Willy Herroelen, 2011. "Time slack-based techniques for robust project scheduling subject to resource uncertainty," Annals of Operations Research, Springer, vol. 186(1), pages 443-464, June.
    17. Min Tian & Ren Jing Liu & Guang Jun Zhang, 2020. "Solving the resource-constrained multi-project scheduling problem with an improved critical chain method," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 71(8), pages 1243-1258, August.
    18. Morteza Davari & Erik Demeulemeester, 2019. "A novel branch-and-bound algorithm for the chance-constrained resource-constrained project scheduling problem," International Journal of Production Research, Taylor & Francis Journals, vol. 57(4), pages 1265-1282, February.
    19. Cui, Nanfang & Demeulemeester, Erik & Bie, Li, 2016. "Incorporation of activity sensitivity measures into buffer management to manage project schedule riskAuthor-Name: Hu, Xuejun," European Journal of Operational Research, Elsevier, vol. 249(2), pages 717-727.
    20. Shengkai Chen & Shuiliang Fang & Renzhong Tang, 2019. "A reinforcement learning based approach for multi-projects scheduling in cloud manufacturing," International Journal of Production Research, Taylor & Francis Journals, vol. 57(10), pages 3080-3098, May.
    21. Junguang Zhang & Saike Jia & Estrella Diaz, 2018. "Dynamic monitoring and control of a critical chain project based on phase buffer allocation," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 69(12), pages 1966-1977, December.
    22. T Wauters & K Verbeeck & G Vanden Berghe & P De Causmaecker, 2011. "Learning agents for the multi-mode project scheduling problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(2), pages 281-290, February.
    23. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    24. Hongbo Li & Erik Demeulemeester, 2016. "A genetic algorithm for the robust resource leveling problem," Journal of Scheduling, Springer, vol. 19(1), pages 43-60, February.
    25. Xuejun Hu & Erik Demeulemeester & Nanfang Cui & Jianjiang Wang & Wendi Tian, 2017. "Improved critical chain buffer management framework considering resource costs and schedule stability," Flexible Services and Manufacturing Journal, Springer, vol. 29(2), pages 159-183, June.
    26. Zhang, Junguang & Song, Xiwei & Díaz, Estrella, 2016. "Project buffer sizing of a critical chain based on comprehensive resource tightness," European Journal of Operational Research, Elsevier, vol. 248(1), pages 174-182.
    27. Seyed Ashkan Zarghami & Indra Gunawan & Graciela Corral de Zubielqui & Bassam Baroudi, 2020. "Incorporation of resource reliability into critical chain project management buffer sizing," International Journal of Production Research, Taylor & Francis Journals, vol. 58(20), pages 6130-6144, October.
    28. Wei Chen & Ying Zhao & Yangqing Yu & Kaiman Chen & Mehrdad Arashpour, 2020. "Collaborative Scheduling of On-Site and Off-Site Operations in Prefabrication," Sustainability, MDPI, vol. 12(21), pages 1-21, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Öncü Hazir & Gündüz Ulusoy, 2020. "A classification and review of approaches and methods for modeling uncertainty in projects," Post-Print hal-02898162, HAL.
    2. Hazır, Öncü & Ulusoy, Gündüz, 2020. "A classification and review of approaches and methods for modeling uncertainty in projects," International Journal of Production Economics, Elsevier, vol. 223(C).
    3. Xuejun Hu & Jianjiang Wang & Kaijun Leng, 2019. "The Interaction Between Critical Chain Sequencing, Buffer Sizing, and Reactive Actions in a CC/BM Framework," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 36(03), pages 1-22, June.
    4. Wuliang Peng & Xuejun Lin, 2023. "A heuristic for the critical chain scheduling problem based on left shifts of activities," Flexible Services and Manufacturing Journal, Springer, vol. 35(4), pages 1313-1336, December.
    5. Junguang Zhang & Dan Wan, 2021. "Determination of early warning time window for bottleneck resource buffer," Annals of Operations Research, Springer, vol. 300(1), pages 289-305, May.
    6. Seyed Ashkan Zarghami, 2024. "Project schedule contingency planning: Building on von Bertalanffy's open systems theory and critical systems practice," Systems Research and Behavioral Science, Wiley Blackwell, vol. 41(2), pages 247-261, March.
    7. Guofeng Ma & Jianyao Jia & Tiancheng Zhu & Shan Jiang, 2019. "A Critical Design Structure Method for Project Schedule Development under Rework Risks," Sustainability, MDPI, vol. 11(24), pages 1-20, December.
    8. Hongbo Li & Linwen Zheng & Hanyu Zhu, 2023. "Resource leveling in projects with flexible structures," Annals of Operations Research, Springer, vol. 321(1), pages 311-342, February.
    9. Mengqi Zhao & Xiaoling Wang & Jia Yu & Lei Bi & Yao Xiao & Jun Zhang, 2020. "Optimization of Construction Duration and Schedule Robustness Based on Hybrid Grey Wolf Optimizer with Sine Cosine Algorithm," Energies, MDPI, vol. 13(1), pages 1-17, January.
    10. She, Bingling & Chen, Bo & Hall, Nicholas G., 2021. "Buffer sizing in critical chain project management by network decomposition," Omega, Elsevier, vol. 102(C).
    11. Farnaz Torabi Yeganeh & Seyed Hessameddin Zegordi, 2020. "A multi-objective optimization approach to project scheduling with resiliency criteria under uncertain activity duration," Annals of Operations Research, Springer, vol. 285(1), pages 161-196, February.
    12. Junguang Zhang & Xiwei Song & Estrella Díaz, 2017. "Critical chain project buffer sizing based on resource constraints," International Journal of Production Research, Taylor & Francis Journals, vol. 55(3), pages 671-683, February.
    13. Maziar Khoshsirat & Seyed Meysam Mousavi, 2024. "A new proactive and reactive approach for resource-constrained project scheduling problem under activity and resource disruption: a scenario-based robust optimization approach," Annals of Operations Research, Springer, vol. 338(1), pages 597-643, July.
    14. Paraskevopoulos, Dimitris C. & Laporte, Gilbert & Repoussis, Panagiotis P. & Tarantilis, Christos D., 2017. "Resource constrained routing and scheduling: Review and research prospects," European Journal of Operational Research, Elsevier, vol. 263(3), pages 737-754.
    15. Behrad Barghi & Shahram Shadrokh Sikari, 2022. "Meta-heuristic Solution with Considering Setup Time for Multi-Skilled Project Scheduling Problem," SN Operations Research Forum, Springer, vol. 3(1), pages 1-23, March.
    16. Ilia Tarasov & Alain Haït & Alexander Lazarev & Olga Battaïa, 2024. "Metric estimation approach for managing uncertainty in resource leveling problem," Annals of Operations Research, Springer, vol. 338(1), pages 645-673, July.
    17. Arben Ahmeti & Nysret Musliu, 2025. "Hybridizing constraint programming and meta-heuristics for multi-mode resource-constrained multiple projects scheduling Problem," Journal of Heuristics, Springer, vol. 31(1), pages 1-37, March.
    18. Kellenbrink, Carolin & Helber, Stefan, 2015. "Scheduling resource-constrained projects with a flexible project structure," European Journal of Operational Research, Elsevier, vol. 246(2), pages 379-391.
    19. Asadabadi, Mehdi Rajabi & Zwikael, Ofer, 2021. "Integrating risk into estimations of project activities' time and cost: A stratified approach," European Journal of Operational Research, Elsevier, vol. 291(2), pages 482-490.
    20. Maryam Sadeghloo & Saeed Emami & Ali Divsalar, 2024. "A Benders decomposition algorithm for the multi-mode resource-constrained multi-project scheduling problem with uncertainty," Annals of Operations Research, Springer, vol. 339(3), pages 1637-1677, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:337:y:2024:i:2:d:10.1007_s10479-023-05597-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.