IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i11p4544-d1402992.html

Low-Carbon Flexible Job Shop Scheduling Problem Based on Deep Reinforcement Learning

Author

Listed:
  • Yimin Tang

    (School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China)

  • Lihong Shen

    (School of Science, Zhejiang Sci-Tech University, Hangzhou 310018, China)

  • Shuguang Han

    (School of Science, Zhejiang Sci-Tech University, Hangzhou 310018, China)

Abstract

As the focus on environmental sustainability sharpens, the significance of low-carbon manufacturing and energy conservation continues to rise. While traditional flexible job shop scheduling strategies are primarily concerned with minimizing completion times, they often overlook the energy consumption of machines. To address this gap, this paper introduces a novel solution utilizing deep reinforcement learning. The study begins by defining the Low-carbon Flexible Job Shop Scheduling problem (LC-FJSP) and constructing a disjunctive graph model. A sophisticated representation, based on the Markov Decision Process (MDP), incorporates a low-carbon graph attention network featuring multi-head attention modules and graph pooling techniques, aimed at boosting the model’s generalization capabilities. Additionally, Bayesian optimization is employed to enhance the solution refinement process, and the method is benchmarked against conventional models. The empirical results indicate that our algorithm markedly enhances scheduling efficiency by 5% to 12% and reduces carbon emissions by 3% to 8%. This work not only contributes new insights and methods to the realm of low-carbon manufacturing and green production but also underscores its considerable theoretical and practical implications.

Suggested Citation

  • Yimin Tang & Lihong Shen & Shuguang Han, 2024. "Low-Carbon Flexible Job Shop Scheduling Problem Based on Deep Reinforcement Learning," Sustainability, MDPI, vol. 16(11), pages 1-23, May.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:11:p:4544-:d:1402992
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/11/4544/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/11/4544/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Da Col, Giacomo & Teppan, Erich C., 2022. "Industrial-size job shop scheduling with constraint programming," Operations Research Perspectives, Elsevier, vol. 9(C).
    2. S. S. Panwalkar & Wafik Iskander, 1977. "A Survey of Scheduling Rules," Operations Research, INFORMS, vol. 25(1), pages 45-61, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anurag Agarwal & Varghese S. Jacob & Hasan Pirkul, 2006. "An Improved Augmented Neural-Network Approach for Scheduling Problems," INFORMS Journal on Computing, INFORMS, vol. 18(1), pages 119-128, February.
    2. Binzi Xu & Kai Xu & Baolin Fei & Dengchao Huang & Liang Tao & Yan Wang, 2024. "Automatic Design of Energy-Efficient Dispatching Rules for Multi-Objective Dynamic Flexible Job Shop Scheduling Based on Dual Feature Weight Sets," Mathematics, MDPI, vol. 12(10), pages 1-24, May.
    3. Parlakturk, Ali & Kumar, Sunil, 2004. "Self-Interested Routing in Queueing Networks," Research Papers 1782r, Stanford University, Graduate School of Business.
    4. Zoghby, Jeriad & Wesley Barnes, J. & Hasenbein, John J., 2005. "Modeling the reentrant job shop scheduling problem with setups for metaheuristic searches," European Journal of Operational Research, Elsevier, vol. 167(2), pages 336-348, December.
    5. Soares, Ricardo & Marques, Alexandra & Amorim, Pedro & Parragh, Sophie N., 2024. "Synchronisation in vehicle routing: Classification schema, modelling framework and literature review," European Journal of Operational Research, Elsevier, vol. 313(3), pages 817-840.
    6. Jain, A. S. & Meeran, S., 1999. "Deterministic job-shop scheduling: Past, present and future," European Journal of Operational Research, Elsevier, vol. 113(2), pages 390-434, March.
    7. Guinet, Alain & Legrand, Marie, 1998. "Reduction of job-shop problems to flow-shop problems with precedence constraints," European Journal of Operational Research, Elsevier, vol. 109(1), pages 96-110, August.
    8. Monaci, Marta & Agasucci, Valerio & Grani, Giorgio, 2024. "An actor-critic algorithm with policy gradients to solve the job shop scheduling problem using deep double recurrent agents," European Journal of Operational Research, Elsevier, vol. 312(3), pages 910-926.
    9. Chen, Haoxun & Luh, Peter B., 2003. "An alternative framework to Lagrangian relaxation approach for job shop scheduling," European Journal of Operational Research, Elsevier, vol. 149(3), pages 499-512, September.
    10. Land, Martin & Gaalman, Gerard, 1996. "Workload control concepts in job shops A critical assessment," International Journal of Production Economics, Elsevier, vol. 46(1), pages 535-548, December.
    11. Drexl, Andreas & Salewski, Frank, 1996. "Distribution Requirements and Compactness Constraints in School Timetabling. Part II: Methods," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 384, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.
    12. Böttcher, Jan & Drexl, Andreas & Kolisch, Rainer & Salewski, Frank, 1996. "Project scheduling under partially renewable resource constraints," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 398, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.
    13. Branke, Juergen & Pickardt, Christoph W., 2011. "Evolutionary search for difficult problem instances to support the design of job shop dispatching rules," European Journal of Operational Research, Elsevier, vol. 212(1), pages 22-32, July.
    14. F. Guerriero, 2008. "Hybrid Rollout Approaches for the Job Shop Scheduling Problem," Journal of Optimization Theory and Applications, Springer, vol. 139(2), pages 419-438, November.
    15. Reményi, Christoph & Staudacher, Stephan, 2014. "Systematic simulation based approach for the identification and implementation of a scheduling rule in the aircraft engine maintenance," International Journal of Production Economics, Elsevier, vol. 147(PA), pages 94-107.
    16. Beemsterboer, Bart & Land, Martin & Teunter, Ruud & Bokhorst, Jos, 2017. "Integrating make-to-order and make-to-stock in job shop control," International Journal of Production Economics, Elsevier, vol. 185(C), pages 1-10.
    17. Seifert, Ralf W. & Morito, Susumu, 2001. "Cooperative dispatching - exploiting the flexibility of an FMS by means of incremental optimization," European Journal of Operational Research, Elsevier, vol. 129(1), pages 116-133, February.
    18. Heng Zhang & Utpal Roy, 2019. "A semantics-based dispatching rule selection approach for job shop scheduling," Journal of Intelligent Manufacturing, Springer, vol. 30(7), pages 2759-2779, October.
    19. repec:dgr:rugsom:95a42 is not listed on IDEAS
    20. Tzafestas, Spyros & Triantafyllakis, Alekos, 1993. "Deterministic scheduling in computing and manufacturing systems: a survey of models and algorithms," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 35(5), pages 397-434.
    21. Kolisch, Rainer & Hempel, Kai, 1996. "Finite scheduling capabilities of commercial project management systems," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 397, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:11:p:4544-:d:1402992. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.