IDEAS home Printed from https://ideas.repec.org/a/eee/proeco/v255y2023ics0925527322002432.html
   My bibliography  Save this article

Markov decision process for multi-manned mixed-model assembly lines with walking workers

Author

Listed:
  • Hashemi-Petroodi, S. Ehsan
  • Thevenin, Simon
  • Kovalev, Sergey
  • Dolgui, Alexandre

Abstract

Product customization and frequent market changes force manufacturing companies to employ mixed-model instead of simple assembly lines. To well adjust the line’s capacity to production requirements, the line can benefit from the concept of reconfigurability. Our study deals with a reconfigurable mixed-model assembly line where tasks can be dynamically assigned to stations at each takt, workers can move among stations at the end of each takt, and the order of entering product models is infinite and unknown. The equipment assignment to stations occurs at the line design stage, and equipment duplication is allowed. The dynamic task assignment and workers’ movements among stations is a Markov Decision Process (MDP) that can be translated as a Linear Program (LP). As a result, the line design problem is formulated as a Mixed-Integer Linear Program (MILP) that integrates the MDP model. We propose some reduction rules and a decomposed transition process to reduce the model. The new MILP models taking into account stochastic parameters are built to solve the stochastic and robust problems, with the objectives of expected total cost minimization in all takts and total cost minimization in the worst takt, respectively. Computational experiments with benchmark and generated instances demonstrate the performance of the proposed MDP models. The managerial insights provided in the paper show the superiority of the dynamic task assignment over the model-dependent and fixed assignments usually studied in the literature.

Suggested Citation

  • Hashemi-Petroodi, S. Ehsan & Thevenin, Simon & Kovalev, Sergey & Dolgui, Alexandre, 2023. "Markov decision process for multi-manned mixed-model assembly lines with walking workers," International Journal of Production Economics, Elsevier, vol. 255(C).
  • Handle: RePEc:eee:proeco:v:255:y:2023:i:c:s0925527322002432
    DOI: 10.1016/j.ijpe.2022.108661
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0925527322002432
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijpe.2022.108661?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michels, Adalberto Sato & Lopes, Thiago Cantos & Sikora, Celso Gustavo Stall & Magatão, Leandro, 2019. "A Benders’ decomposition algorithm with combinatorial cuts for the multi-manned assembly line balancing problem," European Journal of Operational Research, Elsevier, vol. 278(3), pages 796-808.
    2. Lopes, Thiago Cantos & Pastre, Giuliano Vidal & Michels, Adalberto Sato & Magatão, Leandro, 2020. "Flexible multi-manned assembly line balancing problem: Model, heuristic procedure, and lower bounds for line length minimization," Omega, Elsevier, vol. 95(C).
    3. Giard, Vincent & Jeunet, Jully, 2010. "Optimal sequencing of mixed models with sequence-dependent setups and utility workers on an assembly line," International Journal of Production Economics, Elsevier, vol. 123(2), pages 290-300, February.
    4. repec:dau:papers:123456789/2861 is not listed on IDEAS
    5. Dolgui, Alexandre & Kovalev, Sergey & Kovalyov, Mikhail Y. & Malyutin, Sergey & Soukhal, Ameur, 2018. "Optimal workforce assignment to operations of a paced assembly line," European Journal of Operational Research, Elsevier, vol. 264(1), pages 200-211.
    6. Salari, Nooshin & Makis, Viliam, 2017. "Comparison of two maintenance policies for a multi-unit system considering production and demand rates," International Journal of Production Economics, Elsevier, vol. 193(C), pages 381-391.
    7. Tiacci, Lorenzo, 2015. "Simultaneous balancing and buffer allocation decisions for the design of mixed-model assembly lines with parallel workstations and stochastic task times," International Journal of Production Economics, Elsevier, vol. 162(C), pages 201-215.
    8. Murat Şahin & Talip Kellegöz, 2019. "Balancing Multi-Manned Assembly Lines With Walking Workers: Problem Definition, Mathematical Formulation, and an Electromagnetic Field Optimisation Algorithm," International Journal of Production Research, Taylor & Francis Journals, vol. 57(20), pages 6487-6505, October.
    9. Pâmela M.C. Cortez & Alysson M. Costa, 2015. "Sequencing mixed-model assembly lines operating with a heterogeneous workforce," International Journal of Production Research, Taylor & Francis Journals, vol. 53(11), pages 3419-3432, June.
    10. Lauren N. Steimle & Vinayak S. Ahluwalia & Charmee Kamdar & Brian T. Denton, 2021. "Decomposition methods for solving Markov decision processes with multiple models of the parameters," IISE Transactions, Taylor & Francis Journals, vol. 53(12), pages 1295-1310, December.
    11. Serena Finco & Mohammed-Amine Abdous & Martina Calzavara & Daria Battini & Xavier Delorme, 2021. "A bi-objective model to include workers’ vibration exposure in assembly line design," International Journal of Production Research, Taylor & Francis Journals, vol. 59(13), pages 4017-4032, July.
    12. Ullah Saif & Zailin Guan & Li Zhang & Fei Zhang & Baoxi Wang & Jahanzaib Mirza, 2019. "Multi-objective artificial bee colony algorithm for order oriented simultaneous sequencing and balancing of multi-mixed model assembly line," Journal of Intelligent Manufacturing, Springer, vol. 30(3), pages 1195-1220, March.
    13. Kucukkoc, Ibrahim & Zhang, David Z., 2014. "Mathematical model and agent based solution approach for the simultaneous balancing and sequencing of mixed-model parallel two-sided assembly lines," International Journal of Production Economics, Elsevier, vol. 158(C), pages 314-333.
    14. Atiya Al-Zuheri & Lee Luong & Ke Xing, 2016. "Developing a multi-objective genetic optimisation approach for an operational design of a manual mixed-model assembly line with walking workers," Journal of Intelligent Manufacturing, Springer, vol. 27(5), pages 1049-1065, October.
    15. Bahman Naderi & Ahmed Azab & Katayoun Borooshan, 2019. "A realistic multi-manned five-sided mixed-model assembly line balancing and scheduling problem with moving workers and limited workspace," International Journal of Production Research, Taylor & Francis Journals, vol. 57(3), pages 643-661, February.
    16. Scholl, Armin & Becker, Christian, 2006. "State-of-the-art exact and heuristic solution procedures for simple assembly line balancing," European Journal of Operational Research, Elsevier, vol. 168(3), pages 666-693, February.
    17. Kucukkoc, Ibrahim & Li, Zixiang & Karaoglan, Aslan D. & Zhang, David Z., 2018. "Balancing of mixed-model two-sided assembly lines with underground workstations: A mathematical model and ant colony optimization algorithm," International Journal of Production Economics, Elsevier, vol. 205(C), pages 228-243.
    18. Boysen, Nils & Fliedner, Malte & Scholl, Armin, 2008. "Assembly line balancing: Which model to use when," International Journal of Production Economics, Elsevier, vol. 111(2), pages 509-528, February.
    19. Hashemi-Petroodi, S. Ehsan & Thevenin, Simon & Kovalev, Sergey & Dolgui, Alexandre, 2022. "Model-dependent task assignment in multi-manned mixed-model assembly lines with walking workers," Omega, Elsevier, vol. 113(C).
    20. Tiacci, Lorenzo & Mimmi, Mario, 2018. "Integrating ergonomic risks evaluation through OCRA index and balancing/sequencing decisions for mixed model stochastic asynchronous assembly lines," Omega, Elsevier, vol. 78(C), pages 112-138.
    21. Sikora, Celso Gustavo Stall & Lopes, Thiago Cantos & Magatão, Leandro, 2017. "Traveling worker assembly line (re)balancing problem: Model, reduction techniques, and real case studies," European Journal of Operational Research, Elsevier, vol. 259(3), pages 949-971.
    22. Battaïa, Olga & Delorme, Xavier & Dolgui, Alexandre & Hagemann, Johannes & Horlemann, Anika & Kovalev, Sergey & Malyutin, Sergey, 2015. "Workforce minimization for a mixed-model assembly line in the automotive industry," International Journal of Production Economics, Elsevier, vol. 170(PB), pages 489-500.
    23. Becker, Christian & Scholl, Armin, 2009. "Balancing assembly lines with variable parallel workplaces: Problem definition and effective solution procedure," European Journal of Operational Research, Elsevier, vol. 199(2), pages 359-374, December.
    24. Battaïa, Olga & Dolgui, Alexandre, 2013. "A taxonomy of line balancing problems and their solutionapproaches," International Journal of Production Economics, Elsevier, vol. 142(2), pages 259-277.
    25. Qiu, Huaxin & Wang, Sutong & Yin, Yunqiang & Wang, Dujuan & Wang, Yanzhang, 2022. "A deep reinforcement learning-based approach for the home delivery and installation routing problem," International Journal of Production Economics, Elsevier, vol. 244(C).
    26. Delorme, Xavier & Dolgui, Alexandre & Kovalev, Sergey & Kovalyov, Mikhail Y., 2019. "Minimizing the number of workers in a paced mixed-model assembly line," European Journal of Operational Research, Elsevier, vol. 272(1), pages 188-194.
    27. Otto, Alena & Otto, Christian & Scholl, Armin, 2013. "Systematic data generation and test design for solution algorithms on the example of SALBPGen for assembly line balancing," European Journal of Operational Research, Elsevier, vol. 228(1), pages 33-45.
    28. Alexander Biele & Lars Mönch, 2018. "Hybrid approaches to optimize mixed-model assembly lines in low-volume manufacturing," Journal of Heuristics, Springer, vol. 24(1), pages 49-81, February.
    29. Yu, Xinlian & Gao, Song & Hu, Xianbiao & Park, Hyoshin, 2019. "A Markov decision process approach to vacant taxi routing with e-hailing," Transportation Research Part B: Methodological, Elsevier, vol. 121(C), pages 114-134.
    30. Lopes, Thiago Cantos & Michels, Adalberto Sato & Sikora, Celso Gustavo Stall & Molina, Rafael Gobbi & Magatão, Leandro, 2018. "Balancing and cyclically sequencing synchronous, asynchronous, and hybrid unpaced assembly lines," International Journal of Production Economics, Elsevier, vol. 203(C), pages 216-224.
    31. C. Page Moreau & Kelly B. Herd, 2010. "To Each His Own? How Comparisons with Others Influence Consumers' Evaluations of Their Self-Designed Products," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 36(5), pages 806-819, February.
    32. Ahiska, S. Sebnem & Appaji, Samyuktha R. & King, Russell E. & Warsing, Donald P., 2013. "A Markov decision process-based policy characterization approach for a stochastic inventory control problem with unreliable sourcing," International Journal of Production Economics, Elsevier, vol. 144(2), pages 485-496.
    33. Bukchin, Yossi & Rabinowitch, Ithai, 2006. "A branch-and-bound based solution approach for the mixed-model assembly line-balancing problem for minimizing stations and task duplication costs," European Journal of Operational Research, Elsevier, vol. 174(1), pages 492-508, October.
    34. John Miltenburg, 1989. "Level Schedules for Mixed-Model Assembly Lines in Just-In-Time Production Systems," Management Science, INFORMS, vol. 35(2), pages 192-207, February.
    35. Li, Mengyu & Carter, Alix & Goldstein, Judah & Hawco, Terence & Jensen, Jan & Vanberkel, Peter, 2021. "Determining ambulance destinations when facing offload delays using a Markov decision process," Omega, Elsevier, vol. 101(C).
    36. Karimi-Mamaghan, Maryam & Mohammadi, Mehrdad & Meyer, Patrick & Karimi-Mamaghan, Amir Mohammad & Talbi, El-Ghazali, 2022. "Machine learning at the service of meta-heuristics for solving combinatorial optimization problems: A state-of-the-art," European Journal of Operational Research, Elsevier, vol. 296(2), pages 393-422.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Severino, Gonzalo & Rivera, José & Parot, Roberto & Otaegui, Ernesto & Fuentes, Andrés & Reszka, Pedro, 2024. "Workforce and task optimization to guarantee oxygen bottling under a COVID-19 pandemic scenario: A Chilean case study," International Journal of Production Economics, Elsevier, vol. 271(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hashemi-Petroodi, S. Ehsan & Thevenin, Simon & Kovalev, Sergey & Dolgui, Alexandre, 2022. "Model-dependent task assignment in multi-manned mixed-model assembly lines with walking workers," Omega, Elsevier, vol. 113(C).
    2. Battaïa, Olga & Dolgui, Alexandre, 2022. "Hybridizations in line balancing problems: A comprehensive review on new trends and formulations," International Journal of Production Economics, Elsevier, vol. 250(C).
    3. Boysen, Nils & Schulze, Philipp & Scholl, Armin, 2022. "Assembly line balancing: What happened in the last fifteen years?," European Journal of Operational Research, Elsevier, vol. 301(3), pages 797-814.
    4. Lopes, Thiago Cantos & Pastre, Giuliano Vidal & Michels, Adalberto Sato & Magatão, Leandro, 2020. "Flexible multi-manned assembly line balancing problem: Model, heuristic procedure, and lower bounds for line length minimization," Omega, Elsevier, vol. 95(C).
    5. Michels, Adalberto Sato & Lopes, Thiago Cantos & Magatão, Leandro, 2020. "An exact method with decomposition techniques and combinatorial Benders’ cuts for the type-2 multi-manned assembly line balancing problem," Operations Research Perspectives, Elsevier, vol. 7(C).
    6. Sikora, Celso Gustavo Stall, 2024. "Balancing mixed-model assembly lines for random sequences," European Journal of Operational Research, Elsevier, vol. 314(2), pages 597-611.
    7. Murat Şahin & Talip Kellegöz, 2023. "Benders’ decomposition based exact solution method for multi-manned assembly line balancing problem with walking workers," Annals of Operations Research, Springer, vol. 321(1), pages 507-540, February.
    8. Thiago Cantos Lopes & Celso Gustavo Stall Sikora & Adalberto Sato Michels & Leandro Magatão, 2020. "Mixed-model assembly lines balancing with given buffers and product sequence: model, formulation comparisons, and case study," Annals of Operations Research, Springer, vol. 286(1), pages 475-500, March.
    9. Sternatz, Johannes, 2015. "The joint line balancing and material supply problem," International Journal of Production Economics, Elsevier, vol. 159(C), pages 304-318.
    10. Andreu-Casas, Enric & García-Villoria, Alberto & Pastor, Rafael, 2022. "Multi-manned assembly line balancing problem with dependent task times: a heuristic based on solving a partition problem with constraints," European Journal of Operational Research, Elsevier, vol. 302(1), pages 96-116.
    11. Minghai Yuan & Hongyan Yu & Jinting Huang & Aimin Ji, 2019. "Reconfigurable assembly line balancing for cloud manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 30(6), pages 2391-2405, August.
    12. Lopes, Thiago Cantos & Michels, Adalberto Sato & Sikora, Celso Gustavo Stall & Molina, Rafael Gobbi & Magatão, Leandro, 2018. "Balancing and cyclically sequencing synchronous, asynchronous, and hybrid unpaced assembly lines," International Journal of Production Economics, Elsevier, vol. 203(C), pages 216-224.
    13. Battaïa, Olga & Dolgui, Alexandre, 2013. "A taxonomy of line balancing problems and their solutionapproaches," International Journal of Production Economics, Elsevier, vol. 142(2), pages 259-277.
    14. Borba, Leonardo & Ritt, Marcus & Miralles, Cristóbal, 2018. "Exact and heuristic methods for solving the Robotic Assembly Line Balancing Problem," European Journal of Operational Research, Elsevier, vol. 270(1), pages 146-156.
    15. Sikora, Celso Gustavo Stall & Lopes, Thiago Cantos & Magatão, Leandro, 2017. "Traveling worker assembly line (re)balancing problem: Model, reduction techniques, and real case studies," European Journal of Operational Research, Elsevier, vol. 259(3), pages 949-971.
    16. Otto, Alena & Li, Xiyu, 2020. "Product sequencing in multiple-piece-flow assembly lines," Omega, Elsevier, vol. 91(C).
    17. Kucukkoc, Ibrahim & Li, Zixiang & Karaoglan, Aslan D. & Zhang, David Z., 2018. "Balancing of mixed-model two-sided assembly lines with underground workstations: A mathematical model and ant colony optimization algorithm," International Journal of Production Economics, Elsevier, vol. 205(C), pages 228-243.
    18. Michels, Adalberto Sato & Lopes, Thiago Cantos & Sikora, Celso Gustavo Stall & Magatão, Leandro, 2019. "A Benders’ decomposition algorithm with combinatorial cuts for the multi-manned assembly line balancing problem," European Journal of Operational Research, Elsevier, vol. 278(3), pages 796-808.
    19. Christian Weckenborg & Karsten Kieckhäfer & Christoph Müller & Martin Grunewald & Thomas S. Spengler, 2020. "Balancing of assembly lines with collaborative robots," Business Research, Springer;German Academic Association for Business Research, vol. 13(1), pages 93-132, April.
    20. Walter, Rico & Schulze, Philipp & Scholl, Armin, 2021. "SALSA: Combining branch-and-bound with dynamic programming to smoothen workloads in simple assembly line balancing," European Journal of Operational Research, Elsevier, vol. 295(3), pages 857-873.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:proeco:v:255:y:2023:i:c:s0925527322002432. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijpe .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.