IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i22p10025-d1522793.html

Research on Sustainable Scheduling of Material-Handling Systems in Mixed-Model Assembly Workshops Based on Deep Reinforcement Learning

Author

Listed:
  • Beixin Xia

    (School of Management, Shanghai University, Shanghai 200444, China)

  • Yuan Li

    (School of Management, Shanghai University, Shanghai 200444, China)

  • Jiayi Gu

    (School of Management, Shanghai University, Shanghai 200444, China)

  • Yunfang Peng

    (School of Management, Shanghai University, Shanghai 200444, China)

Abstract

In order to dynamically respond to changes in the state of the assembly line and effectively balance the production efficiency and energy consumption of mixed-model assembly, this paper proposes a deep reinforcement learning sustainable scheduling model based on the Deep Q network. According to the particularity of the workshop material-handling system, the action strategy and reward and punishment function are designed, and the neural network structure, parameter update method, and experience pool selection method of the original Deep Q network dual neural network are improved. Prioritized experience replay is adopted to form a real-time scheduling method for workshop material handling based on the Prioritized Experience Replay Deep Q network. The simulation results demonstrate that compared with other scheduling methods, this deep reinforcement learning approach significantly optimizes material-handling scheduling in mixed-flow assembly workshops, effectively reducing handling distance while ensuring timely delivery to the assembly line, ultimately achieving maximum output with sustainable considerations.

Suggested Citation

  • Beixin Xia & Yuan Li & Jiayi Gu & Yunfang Peng, 2024. "Research on Sustainable Scheduling of Material-Handling Systems in Mixed-Model Assembly Workshops Based on Deep Reinforcement Learning," Sustainability, MDPI, vol. 16(22), pages 1-15, November.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:10025-:d:1522793
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/22/10025/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/22/10025/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wenjiao Zai & Junjie Wang & Guohui Li, 2023. "A Drone Scheduling Method for Emergency Power Material Transportation Based on Deep Reinforcement Learning Optimized PSO Algorithm," Sustainability, MDPI, vol. 15(17), pages 1-29, August.
    2. Marcel Panzer & Benedict Bender, 2022. "Deep reinforcement learning in production systems: a systematic literature review," International Journal of Production Research, Taylor & Francis Journals, vol. 60(13), pages 4316-4341, July.
    3. Renke Liu & Rajesh Piplani & Carlos Toro, 2022. "Deep reinforcement learning for dynamic scheduling of a flexible job shop," International Journal of Production Research, Taylor & Francis Journals, vol. 60(13), pages 4049-4069, July.
    4. Emde, Simon & Boysen, Nils, 2012. "Optimally routing and scheduling tow trains for JIT-supply of mixed-model assembly lines," European Journal of Operational Research, Elsevier, vol. 217(2), pages 287-299.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marcel Panzer & Norbert Gronau, 2024. "Designing an adaptive and deep learning based control framework for modular production systems," Journal of Intelligent Manufacturing, Springer, vol. 35(8), pages 4113-4136, December.
    2. Benjamin Heinbach & Peter Burggräf & Johannes Wagner, 2024. "gym-flp: A Python Package for Training Reinforcement Learning Algorithms on Facility Layout Problems," SN Operations Research Forum, Springer, vol. 5(1), pages 1-26, March.
    3. Daria Battini & Nils Boysen & Simon Emde, 2013. "Just-in-Time supermarkets for part supply in the automobile industry," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 24(2), pages 209-217, July.
    4. Simon Emde, 2017. "Scheduling the replenishment of just-in-time supermarkets in assembly plants," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 39(1), pages 321-345, January.
    5. Yufan Huang & Binghai Zhou, 2025. "A Tabu-Bi-label hybridized branch and price algorithm for just-in-time material handling scheduling problems of mixed-model assembly lines with electric vehicle recharging requirements," Journal of Heuristics, Springer, vol. 31(3), pages 1-34, September.
    6. Diefenbach, Heiko & Emde, Simon & Glock, Christoph H., 2020. "Loading tow trains ergonomically for just-in-time part supply," European Journal of Operational Research, Elsevier, vol. 284(1), pages 325-344.
    7. Minhyeok Lee, 2023. "Game-Theoretical Analysis of Reviewer Rewards in Peer-Review Journal Systems: Analysis and Experimental Evaluation using Deep Reinforcement Learning," Papers 2305.12088, arXiv.org.
    8. Du, Yu & Li, Jun-qing, 2024. "A deep reinforcement learning based algorithm for a distributed precast concrete production scheduling," International Journal of Production Economics, Elsevier, vol. 268(C).
    9. Ebenezer Olatunde Adenipekun & Veronique Limère & Nico André Schmid, 2025. "Part Feeding and Internal Transportation Decision Making for a Machinery Manufacturer," Interfaces, INFORMS, vol. 55(2), pages 154-177, March.
    10. Emde, Simon & Gendreau, Michel, 2017. "Scheduling in-house transport vehicles to feed parts to automotive assembly lines," European Journal of Operational Research, Elsevier, vol. 260(1), pages 255-267.
    11. Ziqing Wang & Wenzhu Liao, 2024. "Smart scheduling of dynamic job shop based on discrete event simulation and deep reinforcement learning," Journal of Intelligent Manufacturing, Springer, vol. 35(6), pages 2593-2610, August.
    12. Boysen, Nils & Emde, Simon & Hoeck, Michael & Kauderer, Markus, 2015. "Part logistics in the automotive industry: Decision problems, literature review and research agenda," European Journal of Operational Research, Elsevier, vol. 242(1), pages 107-120.
    13. Funing Li & Sebastian Lang & Yuan Tian & Bingyuan Hong & Benjamin Rolf & Ruben Noortwyck & Robert Schulz & Tobias Reggelin, 2025. "A transformer-based deep reinforcement learning approach for dynamic parallel machine scheduling problem with family setups," Journal of Intelligent Manufacturing, Springer, vol. 36(7), pages 4735-4768, October.
    14. Ajay Kumar Pandey & Yash Daultani & Saurabh Pratap & Andrew W. H. Ip & Fuli Zhou, 2025. "Analyzing Industry 4.0 Adoption Enablers for Supply Chain Flexibility: Impacts on Resilience and Sustainability," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 26(1), pages 1-24, March.
    15. Sternatz, Johannes, 2015. "The joint line balancing and material supply problem," International Journal of Production Economics, Elsevier, vol. 159(C), pages 304-318.
    16. Liu, Xuan & Zhou, Min & Dong, Hairong, 2025. "Joint rescheduling for timetable and platform assignment of High-Speed Railways via graph neural network-based Deep Reinforcement Learning," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 202(C).
    17. Hanson, Robin & Finnsgård, Christian, 2014. "Impact of unit load size on in-plant materials supply efficiency," International Journal of Production Economics, Elsevier, vol. 147(PA), pages 46-52.
    18. Alberto Loffredo & Marvin Carl May & Andrea Matta & Gisela Lanza, 2024. "Reinforcement learning for sustainability enhancement of production lines," Journal of Intelligent Manufacturing, Springer, vol. 35(8), pages 3775-3791, December.
    19. Ding, Yi & Deng, Ming & Ke, Ginger Y. & Shen, Yingjun & Zhang, Lianmin, 2025. "Scheduling intelligent charging robots for electric vehicle: A deep reinforcement learning approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 200(C).
    20. Stefan Helber & Carolin Kellenbrink & Insa Südbeck, 2024. "Evaluation of stochastic flow lines with provisioning of auxiliary material," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 46(3), pages 669-708, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:10025-:d:1522793. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.