IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v282y2020i2p530-544.html
   My bibliography  Save this article

Stochastic mixed-model assembly line sequencing problem: Mathematical modeling and Q-learning based simulated annealing hyper-heuristics

Author

Listed:
  • Mosadegh, H.
  • Fatemi Ghomi, S.M.T.
  • Süer, G.A.

Abstract

This paper presents a mixed-model sequencing problem with stochastic processing times (MMSPSP) in a multi-station assembly line. A new mixed-integer nonlinear programing model is developed to minimize weighted sum of expected total work-overload and idleness, which is converted into a mixed-integer linear programming model to deal with small-sized instances optimally. Due to the NP-hardness of the problem, this paper develops a novel hyper simulated annealing (HSA). The HSA employs a Q-learning algorithm to select appropriate heuristics through its search process. Numerical results are presented on several test instances and benchmark problems from the related literature. The results of statistical analysis indicate that the HSA is quite competitive in comparison with optimization software packages, and is significantly superior to several SA-based algorithms. The results highlight the advantages of the MMSPSP in comparison with traditional deterministic approaches in mixed-model sequencing contexts.

Suggested Citation

  • Mosadegh, H. & Fatemi Ghomi, S.M.T. & Süer, G.A., 2020. "Stochastic mixed-model assembly line sequencing problem: Mathematical modeling and Q-learning based simulated annealing hyper-heuristics," European Journal of Operational Research, Elsevier, vol. 282(2), pages 530-544.
    • Handle: RePEc:eee:ejores:v:282:y:2020:i:2:p:530-544
    DOI: 10.1016/j.ejor.2019.09.021
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221719307611
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2019.09.021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pâmela M.C. Cortez & Alysson M. Costa, 2015. "Sequencing mixed-model assembly lines operating with a heterogeneous workforce," International Journal of Production Research, Taylor & Francis Journals, vol. 53(11), pages 3419-3432, June.
    2. Prandtstetter, Matthias & Raidl, Günther R., 2008. "An integer linear programming approach and a hybrid variable neighborhood search for the car sequencing problem," European Journal of Operational Research, Elsevier, vol. 191(3), pages 1004-1022, December.
    3. Golle, Uli & Rothlauf, Franz & Boysen, Nils, 2014. "Car sequencing versus mixed-model sequencing: A computational study," European Journal of Operational Research, Elsevier, vol. 237(1), pages 50-61.
    4. Edmund K Burke & Michel Gendreau & Matthew Hyde & Graham Kendall & Gabriela Ochoa & Ender Özcan & Rong Qu, 2013. "Hyper-heuristics: a survey of the state of the art," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(12), pages 1695-1724, December.
    5. Delorme, Xavier & Dolgui, Alexandre & Kovalev, Sergey & Kovalyov, Mikhail Y., 2019. "Minimizing the number of workers in a paced mixed-model assembly line," European Journal of Operational Research, Elsevier, vol. 272(1), pages 188-194.
    6. Xiaobo Zhao & Jianyong Liu & Katsuhisa Ohno & Shigenori Kotani, 2007. "Modeling and analysis of a mixed‐model assembly line with stochastic operation times," Naval Research Logistics (NRL), John Wiley & Sons, vol. 54(6), pages 681-691, September.
    7. Boysen, Nils & Fliedner, Malte & Scholl, Armin, 2009. "Sequencing mixed-model assembly lines: Survey, classification and model critique," European Journal of Operational Research, Elsevier, vol. 192(2), pages 349-373, January.
    8. Bautista, Joaquín & Cano, Alberto, 2011. "Solving mixed model sequencing problem in assembly lines with serial workstations with work overload minimisation and interruption rules," European Journal of Operational Research, Elsevier, vol. 210(3), pages 495-513, May.
    9. Mansouri, S. Afshin, 2005. "A Multi-Objective Genetic Algorithm for mixed-model sequencing on JIT assembly lines," European Journal of Operational Research, Elsevier, vol. 167(3), pages 696-716, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Masood Fathi & Morteza Ghobakhloo, 2020. "Enabling Mass Customization and Manufacturing Sustainability in Industry 4.0 Context: A Novel Heuristic Algorithm for in-Plant Material Supply Optimization," Sustainability, MDPI, vol. 12(16), pages 1-15, August.
    2. Geng, Sunyue & Liu, Sifeng & Fang, Zhigeng, 2022. "An agent-based algorithm for dynamic routing in service networks," European Journal of Operational Research, Elsevier, vol. 303(2), pages 719-734.
    3. Si, Guojin & Xia, Tangbin & Gebraeel, Nagi & Wang, Dong & Pan, Ershun & Xi, Lifeng, 2022. "A reliability-and-cost-based framework to optimize maintenance planning and diverse-skilled technician routing for geographically distributed systems," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    4. Janis Brammer & Bernhard Lutz & Dirk Neumann, 2022. "Stochastic mixed model sequencing with multiple stations using reinforcement learning and probability quantiles," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 44(1), pages 29-56, March.
    5. Karimi-Mamaghan, Maryam & Mohammadi, Mehrdad & Jula, Payman & Pirayesh, Amir & Ahmadi, Hadi, 2020. "A learning-based metaheuristic for a multi-objective agile inspection planning model under uncertainty," European Journal of Operational Research, Elsevier, vol. 285(2), pages 513-537.
    6. Li, Zixiang & Kucukkoc, Ibrahim & Zhang, Zikai, 2020. "Branch, bound and remember algorithm for two-sided assembly line balancing problem," European Journal of Operational Research, Elsevier, vol. 284(3), pages 896-905.
    7. Karimi-Mamaghan, Maryam & Mohammadi, Mehrdad & Meyer, Patrick & Karimi-Mamaghan, Amir Mohammad & Talbi, El-Ghazali, 2022. "Machine learning at the service of meta-heuristics for solving combinatorial optimization problems: A state-of-the-art," European Journal of Operational Research, Elsevier, vol. 296(2), pages 393-422.
    8. Karimi-Mamaghan, Maryam & Mohammadi, Mehrdad & Pasdeloup, Bastien & Meyer, Patrick, 2023. "Learning to select operators in meta-heuristics: An integration of Q-learning into the iterated greedy algorithm for the permutation flowshop scheduling problem," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1296-1330.
    9. Angel A. Juan & Peter Keenan & Rafael Martí & Seán McGarraghy & Javier Panadero & Paula Carroll & Diego Oliva, 2023. "A review of the role of heuristics in stochastic optimisation: from metaheuristics to learnheuristics," Annals of Operations Research, Springer, vol. 320(2), pages 831-861, January.
    10. Marcelo Becerra-Rozas & Felipe Cisternas-Caneo & Broderick Crawford & Ricardo Soto & José García & Gino Astorga & Wenceslao Palma, 2022. "Embedded Learning Approaches in the Whale Optimizer to Solve Coverage Combinatorial Problems," Mathematics, MDPI, vol. 10(23), pages 1-18, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. H. Mosadegh & S.M.T. Fatemi Ghomi & G.A. Süer, 2017. "Heuristic approaches for mixed-model sequencing problem with stochastic processing times," International Journal of Production Research, Taylor & Francis Journals, vol. 55(10), pages 2857-2880, May.
    2. Boysen, Nils & Scholl, Armin & Wopperer, Nico, 2012. "Resequencing of mixed-model assembly lines: Survey and research agenda," European Journal of Operational Research, Elsevier, vol. 216(3), pages 594-604.
    3. Janis Brammer & Bernhard Lutz & Dirk Neumann, 2022. "Stochastic mixed model sequencing with multiple stations using reinforcement learning and probability quantiles," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 44(1), pages 29-56, March.
    4. Karim Aroui & Gülgün Alpan & Yannick Frein, 2017. "Minimising work overload in mixed-model assembly lines with different types of operators: a case study from the truck industry," International Journal of Production Research, Taylor & Francis Journals, vol. 55(21), pages 6305-6326, November.
    5. Bautista, Joaquín & Alfaro, Rocío & Batalla, Cristina, 2015. "Modeling and solving the mixed-model sequencing problem to improve productivity," International Journal of Production Economics, Elsevier, vol. 161(C), pages 83-95.
    6. Ioanna Makarouni & John Psarras & Eleftherios Siskos, 2015. "Interactive bicriterion decision support for a large scale industrial scheduling system," Annals of Operations Research, Springer, vol. 227(1), pages 45-61, April.
    7. Battaïa, Olga & Dolgui, Alexandre, 2022. "Hybridizations in line balancing problems: A comprehensive review on new trends and formulations," International Journal of Production Economics, Elsevier, vol. 250(C).
    8. Hashemi-Petroodi, S. Ehsan & Thevenin, Simon & Kovalev, Sergey & Dolgui, Alexandre, 2023. "Markov decision process for multi-manned mixed-model assembly lines with walking workers," International Journal of Production Economics, Elsevier, vol. 255(C).
    9. Masoud Rabbani & Mahdi Mokhtarzadeh & Neda Manavizadeh & Azadeh Farsi, 2021. "Solving a bi-objective mixed-model assembly-line sequencing using metaheuristic algorithms considering ergonomic factors, customer behavior, and periodic maintenance," OPSEARCH, Springer;Operational Research Society of India, vol. 58(3), pages 513-539, September.
    10. Raidl, Günther R., 2015. "Decomposition based hybrid metaheuristics," European Journal of Operational Research, Elsevier, vol. 244(1), pages 66-76.
    11. Uli Golle & Franz Rothlauf & Nils Boysen, 2015. "Iterative beam search for car sequencing," Annals of Operations Research, Springer, vol. 226(1), pages 239-254, March.
    12. Kucukkoc, Ibrahim & Zhang, David Z., 2014. "Mathematical model and agent based solution approach for the simultaneous balancing and sequencing of mixed-model parallel two-sided assembly lines," International Journal of Production Economics, Elsevier, vol. 158(C), pages 314-333.
    13. Otto, Alena & Li, Xiyu, 2020. "Product sequencing in multiple-piece-flow assembly lines," Omega, Elsevier, vol. 91(C).
    14. Parames Chutima & Sathaporn Olarnviwatchai, 2018. "A multi-objective car sequencing problem on two-sided assembly lines," Journal of Intelligent Manufacturing, Springer, vol. 29(7), pages 1617-1636, October.
    15. F. Tanhaie & M. Rabbani & N. Manavizadeh, 2020. "Applying available-to-promise (ATP) concept in mixed-model assembly line sequencing problems in a Make-To-Order (MTO) environment: problem extension, model formulation and Lagrangian relaxation algori," OPSEARCH, Springer;Operational Research Society of India, vol. 57(2), pages 320-346, June.
    16. Bautista, Joaquín & Cano, Alberto & Alfaro, Rocío, 2012. "Models for MMSP-W considering workstation dependencies: A case study of Nissan’s Barcelona plant," European Journal of Operational Research, Elsevier, vol. 223(3), pages 669-679.
    17. Sadeghi, Parisa & Rebelo, Rui Diogo & Ferreira, José Soeiro, 2021. "Using variable neighbourhood descent and genetic algorithms for sequencing mixed-model assembly systems in the footwear industry," Operations Research Perspectives, Elsevier, vol. 8(C).
    18. Hashemi-Petroodi, S. Ehsan & Thevenin, Simon & Kovalev, Sergey & Dolgui, Alexandre, 2022. "Model-dependent task assignment in multi-manned mixed-model assembly lines with walking workers," Omega, Elsevier, vol. 113(C).
    19. Elahi, Mirza M. Lutfe & Rajpurohit, Karthik & Rosenberger, Jay M. & Zaruba, Gergely & Priest, John, 2015. "Optimizing real-time vehicle sequencing of a paint shop conveyor system," Omega, Elsevier, vol. 55(C), pages 61-72.
    20. Andrzej Kozik, 2017. "Handling precedence constraints in scheduling problems by the sequence pair representation," Journal of Combinatorial Optimization, Springer, vol. 33(2), pages 445-472, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:282:y:2020:i:2:p:530-544. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.