IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v320y2023i2d10.1007_s10479-021-04142-9.html
   My bibliography  Save this article

A review of the role of heuristics in stochastic optimisation: from metaheuristics to learnheuristics

Author

Listed:
  • Angel A. Juan

    (Universitat Oberta de Catalunya)

  • Peter Keenan

    (University College Dublin)

  • Rafael Martí

    (Universidad de Valencia)

  • Seán McGarraghy

    (University College Dublin)

  • Javier Panadero

    (Universitat Oberta de Catalunya)

  • Paula Carroll

    (University College Dublin)

  • Diego Oliva

    (Universidad de Guadalajara)

Abstract

In the context of simulation-based optimisation, this paper reviews recent work related to the role of metaheuristics, matheuristics (combinations of exact optimisation methods with metaheuristics), simheuristics (hybridisation of simulation with metaheuristics), biased-randomised heuristics for ‘agile’ optimisation via parallel computing, and learnheuristics (combination of statistical/machine learning with metaheuristics) to deal with NP-hard and large-scale optimisation problems in areas such as transport and logistics, manufacturing and production, smart cities, telecommunication networks, finance and insurance, sustainable energy consumption, health care, military and defence, e-marketing, or bioinformatics. The manuscript provides the main related concepts and updated references that illustrate the applications of these hybrid optimisation–simulation–learning approaches in solving rich and real-life challenges under dynamic and uncertainty scenarios. A numerical analysis is also included to illustrate the benefits that these approaches can offer across different application fields. Finally, this work concludes by highlighting open research lines on the combination of these methodologies to extend the concept of simulation-based optimisation.

Suggested Citation

  • Angel A. Juan & Peter Keenan & Rafael Martí & Seán McGarraghy & Javier Panadero & Paula Carroll & Diego Oliva, 2023. "A review of the role of heuristics in stochastic optimisation: from metaheuristics to learnheuristics," Annals of Operations Research, Springer, vol. 320(2), pages 831-861, January.
    • Handle: RePEc:spr:annopr:v:320:y:2023:i:2:d:10.1007_s10479-021-04142-9
    DOI: 10.1007/s10479-021-04142-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-021-04142-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-021-04142-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gendreau, Michel & Laporte, Gilbert & Seguin, Rene, 1996. "Stochastic vehicle routing," European Journal of Operational Research, Elsevier, vol. 88(1), pages 3-12, January.
    2. Vidal, Thibaut & Laporte, Gilbert & Matl, Piotr, 2020. "A concise guide to existing and emerging vehicle routing problem variants," European Journal of Operational Research, Elsevier, vol. 286(2), pages 401-416.
    3. Jesica Armas & Angel A. Juan & Joan M. Marquès & João Pedro Pedroso, 2017. "Solving the deterministic and stochastic uncapacitated facility location problem: from a heuristic to a simheuristic," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(10), pages 1161-1176, October.
    4. Jack P. C. Kleijnen, 2015. "Simulation Optimization," International Series in Operations Research & Management Science, in: Design and Analysis of Simulation Experiments, edition 2, chapter 6, pages 241-300, Springer.
    5. Ying, Cheng-shuo & Chow, Andy H.F. & Chin, Kwai-Sang, 2020. "An actor-critic deep reinforcement learning approach for metro train scheduling with rolling stock circulation under stochastic demand," Transportation Research Part B: Methodological, Elsevier, vol. 140(C), pages 210-235.
    6. Lee A Evans & Ki-Hwan G Bae, 2019. "US Army performance appraisal policy analysis: a simulation optimization approach," The Journal of Defense Modeling and Simulation, , vol. 16(2), pages 191-205, April.
    7. Javier Panadero & Angel A. Juan & Christopher Bayliss & Christine Currie, 2020. "Maximising reward from a team of surveillance drones: a simheuristic approach to the stochastic team orienteering problem," European Journal of Industrial Engineering, Inderscience Enterprises Ltd, vol. 14(4), pages 485-516.
    8. Jesica Armas & Peter Keenan & Angel A. Juan & Seán McGarraghy, 2019. "Solving large-scale time capacitated arc routing problems: from real-time heuristics to metaheuristics," Annals of Operations Research, Springer, vol. 273(1), pages 135-162, February.
    9. Michel Gendreau & Gilbert Laporte & René Séguin, 1996. "A Tabu Search Heuristic for the Vehicle Routing Problem with Stochastic Demands and Customers," Operations Research, INFORMS, vol. 44(3), pages 469-477, June.
    10. Rabbani, M. & Heidari, R. & Yazdanparast, R., 2019. "A stochastic multi-period industrial hazardous waste location-routing problem: Integrating NSGA-II and Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 272(3), pages 945-961.
    11. Puca Huachi Vaz Penna & Anand Subramanian & Luiz Satoru Ochi & Thibaut Vidal & Christian Prins, 2019. "A hybrid heuristic for a broad class of vehicle routing problems with heterogeneous fleet," Annals of Operations Research, Springer, vol. 273(1), pages 5-74, February.
    12. Angel Juan & Javier Faulin & Josep Jorba & Jose Caceres & Joan Marquès, 2013. "Using parallel & distributed computing for real-time solving of vehicle routing problems with stochastic demands," Annals of Operations Research, Springer, vol. 207(1), pages 43-65, August.
    13. Mosadegh, H. & Fatemi Ghomi, S.M.T. & Süer, G.A., 2020. "Stochastic mixed-model assembly line sequencing problem: Mathematical modeling and Q-learning based simulated annealing hyper-heuristics," European Journal of Operational Research, Elsevier, vol. 282(2), pages 530-544.
    14. Claudia Archetti & Natashia Boland & Grazia Speranza, 2017. "A Matheuristic for the Multivehicle Inventory Routing Problem," INFORMS Journal on Computing, INFORMS, vol. 29(3), pages 377-387, August.
    15. Alex Grasas & Angel A Juan & Helena R Lourenço, 2016. "SimILS: a simulation-based extension of the iterated local search metaheuristic for stochastic combinatorial optimization," Journal of Simulation, Taylor & Francis Journals, vol. 10(1), pages 69-77, February.
    16. Sergio Gonzalez-Martin & Angel A. Juan & Daniel Riera & Monica G. Elizondo & Juan J. Ramos, 2018. "A simheuristic algorithm for solving the arc routing problem with stochastic demands," Journal of Simulation, Taylor & Francis Journals, vol. 12(1), pages 53-66, January.
    17. Dimitris Bertsimas & Nathan Kallus, 2020. "From Predictive to Prescriptive Analytics," Management Science, INFORMS, vol. 66(3), pages 1025-1044, March.
    18. Claudia Archetti & Luca Bertazzi & Alain Hertz & M. Grazia Speranza, 2012. "A Hybrid Heuristic for an Inventory Routing Problem," INFORMS Journal on Computing, INFORMS, vol. 24(1), pages 101-116, February.
    19. Corne, David & Dhaenens, Clarisse & Jourdan, Laetitia, 2012. "Synergies between operations research and data mining: The emerging use of multi-objective approaches," European Journal of Operational Research, Elsevier, vol. 221(3), pages 469-479.
    20. Diego Oliva & Pedro Copado & Salvador Hinojosa & Javier Panadero & Daniel Riera & Angel A. Juan, 2020. "Fuzzy Simheuristics: Solving Optimization Problems under Stochastic and Uncertainty Scenarios," Mathematics, MDPI, vol. 8(12), pages 1-19, December.
    21. Daniele Ferone & Aljoscha Gruler & Paola Festa & Angel A. Juan, 2019. "Enhancing and extending the classical GRASP framework with biased randomisation and simulation," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 70(8), pages 1362-1375, August.
    22. Canan G. Corlu & Rocio de la Torre & Adrian Serrano-Hernandez & Angel A. Juan & Javier Faulin, 2020. "Optimizing Energy Consumption in Transportation: Literature Review, Insights, and Research Opportunities," Energies, MDPI, vol. 13(5), pages 1-33, March.
    23. Doering, Jana & Kizys, Renatas & Juan, Angel A. & Fitó, Àngels & Polat, Onur, 2019. "Metaheuristics for rich portfolio optimisation and risk management: Current state and future trends," Operations Research Perspectives, Elsevier, vol. 6(C).
    24. Jorge E. Mendoza & Louis-Martin Rousseau & Juan G. Villegas, 2016. "A hybrid metaheuristic for the vehicle routing problem with stochastic demand and duration constraints," Journal of Heuristics, Springer, vol. 22(4), pages 539-566, August.
    25. Lam, Chiou-Peng & Masek, Martin & Kelly, Luke & Papasimeon, Michael & Benke, Lyndon, 2019. "A simheuristic approach for evolving agent behaviour in the exploration for novel combat tactics," Operations Research Perspectives, Elsevier, vol. 6(C).
    26. Christian Fikar & Angel A. Juan & Enoc Martinez & Patrick Hirsch, 2016. "A discrete-event driven metaheuristic for dynamic home service routing with synchronised trip sharing," European Journal of Industrial Engineering, Inderscience Enterprises Ltd, vol. 10(3), pages 323-340.
    27. Oliveira, Beatriz Brito & Carravilla, Maria Antónia & Oliveira, José Fernando, 2018. "Integrating pricing and capacity decisions in car rental: A matheuristic approach," Operations Research Perspectives, Elsevier, vol. 5(C), pages 334-356.
    28. Aljoscha Gruler & Carlos L. Quintero-Araújo & Laura Calvet & Angel A. Juan, 2017. "Waste collection under uncertainty: a simheuristic based on variable neighbourhood search," European Journal of Industrial Engineering, Inderscience Enterprises Ltd, vol. 11(2), pages 228-255.
    29. Crespo-Vazquez, Jose L. & Carrillo, C. & Diaz-Dorado, E. & Martinez-Lorenzo, Jose A. & Noor-E-Alam, Md., 2018. "A machine learning based stochastic optimization framework for a wind and storage power plant participating in energy pool market," Applied Energy, Elsevier, vol. 232(C), pages 341-357.
    30. Bektaş, Tolga & Gouveia, Luis & Martínez-Sykora, Antonio & Salazar-González, Juan-José, 2019. "Balanced vehicle routing: Polyhedral analysis and branch-and-cut algorithm," European Journal of Operational Research, Elsevier, vol. 273(2), pages 452-463.
    31. Nadia Chaudry & Ingunn Vermedal & Kjetil Fagerholt & Maria Fleischer Fauske & Magnus Stålhane, 2020. "A decomposition solution approach to the troops-to-tasks assignment in military peacekeeping operations," The Journal of Defense Modeling and Simulation, , vol. 17(4), pages 357-371, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lei Liu & Marcello Urgo, 2024. "Robust scheduling in a two-machine re-entrant flow shop to minimise the value-at-risk of the makespan: branch-and-bound and heuristic algorithms based on Markovian activity networks and phase-type dis," Annals of Operations Research, Springer, vol. 338(1), pages 741-764, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yagmur S. Gök & Silvia Padrón & Maurizio Tomasella & Daniel Guimarans & Cemalettin Ozturk, 2023. "Constraint-based robust planning and scheduling of airport apron operations through simheuristics," Annals of Operations Research, Springer, vol. 320(2), pages 795-830, January.
    2. Mohammad Peyman & Pedro J. Copado & Rafael D. Tordecilla & Leandro do C. Martins & Fatos Xhafa & Angel A. Juan, 2021. "Edge Computing and IoT Analytics for Agile Optimization in Intelligent Transportation Systems," Energies, MDPI, vol. 14(19), pages 1-26, October.
    3. Victor Abu-Marrul & Rafael Martinelli & Silvio Hamacher & Irina Gribkovskaia, 2023. "Simheuristic algorithm for a stochastic parallel machine scheduling problem with periodic re-planning assessment," Annals of Operations Research, Springer, vol. 320(2), pages 547-572, January.
    4. Laura Calvet & Rocio de la Torre & Anita Goyal & Mage Marmol & Angel A. Juan, 2020. "Modern Optimization and Simulation Methods in Managerial and Business Economics: A Review," Administrative Sciences, MDPI, vol. 10(3), pages 1-23, July.
    5. Mohammed Bazirha & Abdeslam Kadrani & Rachid Benmansour, 2023. "Stochastic home health care routing and scheduling problem with multiple synchronized services," Annals of Operations Research, Springer, vol. 320(2), pages 573-601, January.
    6. Arnau, Quim & Barrena, Eva & Panadero, Javier & de la Torre, Rocio & Juan, Angel A., 2022. "A biased-randomized discrete-event heuristic for coordinated multi-vehicle container transport across interconnected networks," European Journal of Operational Research, Elsevier, vol. 302(1), pages 348-362.
    7. Luo, Zhixing & Qin, Hu & Zhang, Dezhi & Lim, Andrew, 2016. "Adaptive large neighborhood search heuristics for the vehicle routing problem with stochastic demands and weight-related cost," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 85(C), pages 69-89.
    8. Almeder, Christian & Hartl, Richard F., 2013. "A metaheuristic optimization approach for a real-world stochastic flexible flow shop problem with limited buffer," International Journal of Production Economics, Elsevier, vol. 145(1), pages 88-95.
    9. Felipe, Angel & Teresa Ortuño, M. & Tirado, Gregorio, 2011. "Using intermediate infeasible solutions to approach vehicle routing problems with precedence and loading constraints," European Journal of Operational Research, Elsevier, vol. 211(1), pages 66-75, May.
    10. Albareda-Sambola, Maria & Fernandez, Elena & Laporte, Gilbert, 2007. "Heuristic and lower bound for a stochastic location-routing problem," European Journal of Operational Research, Elsevier, vol. 179(3), pages 940-955, June.
    11. Prasanna Balaprakash & Mauro Birattari & Thomas Stützle & Marco Dorigo, 2015. "Estimation-based metaheuristics for the single vehicle routing problem with stochastic demands and customers," Computational Optimization and Applications, Springer, vol. 61(2), pages 463-487, June.
    12. Diabat, Ali & Bianchessi, Nicola & Archetti, Claudia, 2024. "On the zero-inventory-ordering policy in the inventory routing problem," European Journal of Operational Research, Elsevier, vol. 312(3), pages 1024-1038.
    13. Van Woensel, T. & Kerbache, L. & Peremans, H. & Vandaele, N., 2008. "Vehicle routing with dynamic travel times: A queueing approach," European Journal of Operational Research, Elsevier, vol. 186(3), pages 990-1007, May.
    14. Majid Salavati-Khoshghalb & Michel Gendreau & Ola Jabali & Walter Rei, 2019. "A hybrid recourse policy for the vehicle routing problem with stochastic demands," EURO Journal on Transportation and Logistics, Springer;EURO - The Association of European Operational Research Societies, vol. 8(3), pages 269-298, September.
    15. Karels, Vincent C.G. & Rei, Walter & Veelenturf, Lucas P. & Van Woensel, Tom, 2024. "A vehicle routing problem with multiple service agreements," European Journal of Operational Research, Elsevier, vol. 313(1), pages 129-145.
    16. Yao, Yu & Zhu, Xiaoning & Dong, Hongyu & Wu, Shengnan & Wu, Hailong & Carol Tong, Lu & Zhou, Xuesong, 2019. "ADMM-based problem decomposition scheme for vehicle routing problem with time windows," Transportation Research Part B: Methodological, Elsevier, vol. 129(C), pages 156-174.
    17. Soumia Ichoua & Michel Gendreau & Jean-Yves Potvin, 2006. "Exploiting Knowledge About Future Demands for Real-Time Vehicle Dispatching," Transportation Science, INFORMS, vol. 40(2), pages 211-225, May.
    18. Jorge Oyola & Halvard Arntzen & David L. Woodruff, 2017. "The stochastic vehicle routing problem, a literature review, Part II: solution methods," EURO Journal on Transportation and Logistics, Springer;EURO - The Association of European Operational Research Societies, vol. 6(4), pages 349-388, December.
    19. Shukla, Nagesh & Choudhary, A.K. & Prakash, P.K.S. & Fernandes, K.J. & Tiwari, M.K., 2013. "Algorithm portfolios for logistics optimization considering stochastic demands and mobility allowance," International Journal of Production Economics, Elsevier, vol. 141(1), pages 146-166.
    20. Gambardella, L.M. & Montemanni, R. & Weyland, D., 2012. "Coupling ant colony systems with strong local searches," European Journal of Operational Research, Elsevier, vol. 220(3), pages 831-843.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:320:y:2023:i:2:d:10.1007_s10479-021-04142-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.