IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v320y2023i2d10.1007_s10479-021-04142-9.html
   My bibliography  Save this article

A review of the role of heuristics in stochastic optimisation: from metaheuristics to learnheuristics

Author

Listed:
  • Angel A. Juan

    (Universitat Oberta de Catalunya)

  • Peter Keenan

    (University College Dublin)

  • Rafael Martí

    (Universidad de Valencia)

  • Seán McGarraghy

    (University College Dublin)

  • Javier Panadero

    (Universitat Oberta de Catalunya)

  • Paula Carroll

    (University College Dublin)

  • Diego Oliva

    (Universidad de Guadalajara)

Abstract

In the context of simulation-based optimisation, this paper reviews recent work related to the role of metaheuristics, matheuristics (combinations of exact optimisation methods with metaheuristics), simheuristics (hybridisation of simulation with metaheuristics), biased-randomised heuristics for ‘agile’ optimisation via parallel computing, and learnheuristics (combination of statistical/machine learning with metaheuristics) to deal with NP-hard and large-scale optimisation problems in areas such as transport and logistics, manufacturing and production, smart cities, telecommunication networks, finance and insurance, sustainable energy consumption, health care, military and defence, e-marketing, or bioinformatics. The manuscript provides the main related concepts and updated references that illustrate the applications of these hybrid optimisation–simulation–learning approaches in solving rich and real-life challenges under dynamic and uncertainty scenarios. A numerical analysis is also included to illustrate the benefits that these approaches can offer across different application fields. Finally, this work concludes by highlighting open research lines on the combination of these methodologies to extend the concept of simulation-based optimisation.

Suggested Citation

  • Angel A. Juan & Peter Keenan & Rafael Martí & Seán McGarraghy & Javier Panadero & Paula Carroll & Diego Oliva, 2023. "A review of the role of heuristics in stochastic optimisation: from metaheuristics to learnheuristics," Annals of Operations Research, Springer, vol. 320(2), pages 831-861, January.
  • Handle: RePEc:spr:annopr:v:320:y:2023:i:2:d:10.1007_s10479-021-04142-9
    DOI: 10.1007/s10479-021-04142-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-021-04142-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-021-04142-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gendreau, Michel & Laporte, Gilbert & Seguin, Rene, 1996. "Stochastic vehicle routing," European Journal of Operational Research, Elsevier, vol. 88(1), pages 3-12, January.
    2. Angel Juan & Javier Faulin & Josep Jorba & Jose Caceres & Joan Marquès, 2013. "Using parallel & distributed computing for real-time solving of vehicle routing problems with stochastic demands," Annals of Operations Research, Springer, vol. 207(1), pages 43-65, August.
    3. Mosadegh, H. & Fatemi Ghomi, S.M.T. & Süer, G.A., 2020. "Stochastic mixed-model assembly line sequencing problem: Mathematical modeling and Q-learning based simulated annealing hyper-heuristics," European Journal of Operational Research, Elsevier, vol. 282(2), pages 530-544.
    4. Claudia Archetti & Natashia Boland & Grazia Speranza, 2017. "A Matheuristic for the Multivehicle Inventory Routing Problem," INFORMS Journal on Computing, INFORMS, vol. 29(3), pages 377-387, August.
    5. Lam, Chiou-Peng & Masek, Martin & Kelly, Luke & Papasimeon, Michael & Benke, Lyndon, 2019. "A simheuristic approach for evolving agent behaviour in the exploration for novel combat tactics," Operations Research Perspectives, Elsevier, vol. 6(C).
    6. Dimitris Bertsimas & Nathan Kallus, 2020. "From Predictive to Prescriptive Analytics," Management Science, INFORMS, vol. 66(3), pages 1025-1044, March.
    7. Vidal, Thibaut & Laporte, Gilbert & Matl, Piotr, 2020. "A concise guide to existing and emerging vehicle routing problem variants," European Journal of Operational Research, Elsevier, vol. 286(2), pages 401-416.
    8. Corne, David & Dhaenens, Clarisse & Jourdan, Laetitia, 2012. "Synergies between operations research and data mining: The emerging use of multi-objective approaches," European Journal of Operational Research, Elsevier, vol. 221(3), pages 469-479.
    9. Christian Fikar & Angel A. Juan & Enoc Martinez & Patrick Hirsch, 2016. "A discrete-event driven metaheuristic for dynamic home service routing with synchronised trip sharing," European Journal of Industrial Engineering, Inderscience Enterprises Ltd, vol. 10(3), pages 323-340.
    10. Canan G. Corlu & Rocio de la Torre & Adrian Serrano-Hernandez & Angel A. Juan & Javier Faulin, 2020. "Optimizing Energy Consumption in Transportation: Literature Review, Insights, and Research Opportunities," Energies, MDPI, vol. 13(5), pages 1-33, March.
    11. Jesica Armas & Angel A. Juan & Joan M. Marquès & João Pedro Pedroso, 2017. "Solving the deterministic and stochastic uncapacitated facility location problem: from a heuristic to a simheuristic," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(10), pages 1161-1176, October.
    12. Doering, Jana & Kizys, Renatas & Juan, Angel A. & Fitó, Àngels & Polat, Onur, 2019. "Metaheuristics for rich portfolio optimisation and risk management: Current state and future trends," Operations Research Perspectives, Elsevier, vol. 6(C).
    13. Jack P. C. Kleijnen, 2015. "Simulation Optimization," International Series in Operations Research & Management Science, in: Design and Analysis of Simulation Experiments, edition 2, chapter 6, pages 241-300, Springer.
    14. Oliveira, Beatriz Brito & Carravilla, Maria Antónia & Oliveira, José Fernando, 2018. "Integrating pricing and capacity decisions in car rental: A matheuristic approach," Operations Research Perspectives, Elsevier, vol. 5(C), pages 334-356.
    15. Aljoscha Gruler & Carlos L. Quintero-Araújo & Laura Calvet & Angel A. Juan, 2017. "Waste collection under uncertainty: a simheuristic based on variable neighbourhood search," European Journal of Industrial Engineering, Inderscience Enterprises Ltd, vol. 11(2), pages 228-255.
    16. Alex Grasas & Angel A Juan & Helena R Lourenço, 2016. "SimILS: a simulation-based extension of the iterated local search metaheuristic for stochastic combinatorial optimization," Journal of Simulation, Taylor & Francis Journals, vol. 10(1), pages 69-77, February.
    17. Diego Oliva & Pedro Copado & Salvador Hinojosa & Javier Panadero & Daniel Riera & Angel A. Juan, 2020. "Fuzzy Simheuristics: Solving Optimization Problems under Stochastic and Uncertainty Scenarios," Mathematics, MDPI, vol. 8(12), pages 1-19, December.
    18. Ying, Cheng-shuo & Chow, Andy H.F. & Chin, Kwai-Sang, 2020. "An actor-critic deep reinforcement learning approach for metro train scheduling with rolling stock circulation under stochastic demand," Transportation Research Part B: Methodological, Elsevier, vol. 140(C), pages 210-235.
    19. Michel Gendreau & Gilbert Laporte & René Séguin, 1996. "A Tabu Search Heuristic for the Vehicle Routing Problem with Stochastic Demands and Customers," Operations Research, INFORMS, vol. 44(3), pages 469-477, June.
    20. Lee A Evans & Ki-Hwan G Bae, 2019. "US Army performance appraisal policy analysis: a simulation optimization approach," The Journal of Defense Modeling and Simulation, , vol. 16(2), pages 191-205, April.
    21. Claudia Archetti & Luca Bertazzi & Alain Hertz & M. Grazia Speranza, 2012. "A Hybrid Heuristic for an Inventory Routing Problem," INFORMS Journal on Computing, INFORMS, vol. 24(1), pages 101-116, February.
    22. Javier Panadero & Angel A. Juan & Christopher Bayliss & Christine Currie, 2020. "Maximising reward from a team of surveillance drones: a simheuristic approach to the stochastic team orienteering problem," European Journal of Industrial Engineering, Inderscience Enterprises Ltd, vol. 14(4), pages 485-516.
    23. Jorge E. Mendoza & Louis-Martin Rousseau & Juan G. Villegas, 2016. "A hybrid metaheuristic for the vehicle routing problem with stochastic demand and duration constraints," Journal of Heuristics, Springer, vol. 22(4), pages 539-566, August.
    24. Nadia Chaudry & Ingunn Vermedal & Kjetil Fagerholt & Maria Fleischer Fauske & Magnus Stålhane, 2020. "A decomposition solution approach to the troops-to-tasks assignment in military peacekeeping operations," The Journal of Defense Modeling and Simulation, , vol. 17(4), pages 357-371, October.
    25. Jesica Armas & Peter Keenan & Angel A. Juan & Seán McGarraghy, 2019. "Solving large-scale time capacitated arc routing problems: from real-time heuristics to metaheuristics," Annals of Operations Research, Springer, vol. 273(1), pages 135-162, February.
    26. Rabbani, M. & Heidari, R. & Yazdanparast, R., 2019. "A stochastic multi-period industrial hazardous waste location-routing problem: Integrating NSGA-II and Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 272(3), pages 945-961.
    27. Crespo-Vazquez, Jose L. & Carrillo, C. & Diaz-Dorado, E. & Martinez-Lorenzo, Jose A. & Noor-E-Alam, Md., 2018. "A machine learning based stochastic optimization framework for a wind and storage power plant participating in energy pool market," Applied Energy, Elsevier, vol. 232(C), pages 341-357.
    28. Daniele Ferone & Aljoscha Gruler & Paola Festa & Angel A. Juan, 2019. "Enhancing and extending the classical GRASP framework with biased randomisation and simulation," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 70(8), pages 1362-1375, August.
    29. Sergio Gonzalez-Martin & Angel A. Juan & Daniel Riera & Monica G. Elizondo & Juan J. Ramos, 2018. "A simheuristic algorithm for solving the arc routing problem with stochastic demands," Journal of Simulation, Taylor & Francis Journals, vol. 12(1), pages 53-66, January.
    30. Puca Huachi Vaz Penna & Anand Subramanian & Luiz Satoru Ochi & Thibaut Vidal & Christian Prins, 2019. "A hybrid heuristic for a broad class of vehicle routing problems with heterogeneous fleet," Annals of Operations Research, Springer, vol. 273(1), pages 5-74, February.
    31. Bektaş, Tolga & Gouveia, Luis & Martínez-Sykora, Antonio & Salazar-González, Juan-José, 2019. "Balanced vehicle routing: Polyhedral analysis and branch-and-cut algorithm," European Journal of Operational Research, Elsevier, vol. 273(2), pages 452-463.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yagmur S. Gök & Silvia Padrón & Maurizio Tomasella & Daniel Guimarans & Cemalettin Ozturk, 2023. "Constraint-based robust planning and scheduling of airport apron operations through simheuristics," Annals of Operations Research, Springer, vol. 320(2), pages 795-830, January.
    2. Mohammad Peyman & Pedro J. Copado & Rafael D. Tordecilla & Leandro do C. Martins & Fatos Xhafa & Angel A. Juan, 2021. "Edge Computing and IoT Analytics for Agile Optimization in Intelligent Transportation Systems," Energies, MDPI, vol. 14(19), pages 1-26, October.
    3. Victor Abu-Marrul & Rafael Martinelli & Silvio Hamacher & Irina Gribkovskaia, 2023. "Simheuristic algorithm for a stochastic parallel machine scheduling problem with periodic re-planning assessment," Annals of Operations Research, Springer, vol. 320(2), pages 547-572, January.
    4. Laura Calvet & Rocio de la Torre & Anita Goyal & Mage Marmol & Angel A. Juan, 2020. "Modern Optimization and Simulation Methods in Managerial and Business Economics: A Review," Administrative Sciences, MDPI, vol. 10(3), pages 1-23, July.
    5. Mohammed Bazirha & Abdeslam Kadrani & Rachid Benmansour, 2023. "Stochastic home health care routing and scheduling problem with multiple synchronized services," Annals of Operations Research, Springer, vol. 320(2), pages 573-601, January.
    6. Arnau, Quim & Barrena, Eva & Panadero, Javier & de la Torre, Rocio & Juan, Angel A., 2022. "A biased-randomized discrete-event heuristic for coordinated multi-vehicle container transport across interconnected networks," European Journal of Operational Research, Elsevier, vol. 302(1), pages 348-362.
    7. Luo, Zhixing & Qin, Hu & Zhang, Dezhi & Lim, Andrew, 2016. "Adaptive large neighborhood search heuristics for the vehicle routing problem with stochastic demands and weight-related cost," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 85(C), pages 69-89.
    8. Goodson, Justin C. & Ohlmann, Jeffrey W. & Thomas, Barrett W., 2012. "Cyclic-order neighborhoods with application to the vehicle routing problem with stochastic demand," European Journal of Operational Research, Elsevier, vol. 217(2), pages 312-323.
    9. Lars M. Hvattum & Arne Løkketangen & Gilbert Laporte, 2006. "Solving a Dynamic and Stochastic Vehicle Routing Problem with a Sample Scenario Hedging Heuristic," Transportation Science, INFORMS, vol. 40(4), pages 421-438, November.
    10. Almeder, Christian & Hartl, Richard F., 2013. "A metaheuristic optimization approach for a real-world stochastic flexible flow shop problem with limited buffer," International Journal of Production Economics, Elsevier, vol. 145(1), pages 88-95.
    11. Chiang, Wen-Chyuan & Russell, Robert & Xu, Xiaojing & Zepeda, David, 2009. "A simulation/metaheuristic approach to newspaper production and distribution supply chain problems," International Journal of Production Economics, Elsevier, vol. 121(2), pages 752-767, October.
    12. Bertazzi, Luca & Chua, Geoffrey A. & Laganà, Demetrio & Paradiso, Rosario, 2022. "Analysis of effective sets of routes for the split-delivery periodic inventory routing problem," European Journal of Operational Research, Elsevier, vol. 298(2), pages 463-477.
    13. Jinil Han & Chungmok Lee & Sungsoo Park, 2014. "A Robust Scenario Approach for the Vehicle Routing Problem with Uncertain Travel Times," Transportation Science, INFORMS, vol. 48(3), pages 373-390, August.
    14. Gambella, Claudio & Ghaddar, Bissan & Naoum-Sawaya, Joe, 2021. "Optimization problems for machine learning: A survey," European Journal of Operational Research, Elsevier, vol. 290(3), pages 807-828.
    15. Felipe, Angel & Teresa Ortuño, M. & Tirado, Gregorio, 2011. "Using intermediate infeasible solutions to approach vehicle routing problems with precedence and loading constraints," European Journal of Operational Research, Elsevier, vol. 211(1), pages 66-75, May.
    16. Song, Ruidian & Zhao, Lei & Van Woensel, Tom & Fransoo, Jan C., 2019. "Coordinated delivery in urban retail," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 126(C), pages 122-148.
    17. Albareda-Sambola, Maria & Fernandez, Elena & Laporte, Gilbert, 2007. "Heuristic and lower bound for a stochastic location-routing problem," European Journal of Operational Research, Elsevier, vol. 179(3), pages 940-955, June.
    18. Prasanna Balaprakash & Mauro Birattari & Thomas Stützle & Marco Dorigo, 2015. "Estimation-based metaheuristics for the single vehicle routing problem with stochastic demands and customers," Computational Optimization and Applications, Springer, vol. 61(2), pages 463-487, June.
    19. Diabat, Ali & Bianchessi, Nicola & Archetti, Claudia, 2024. "On the zero-inventory-ordering policy in the inventory routing problem," European Journal of Operational Research, Elsevier, vol. 312(3), pages 1024-1038.
    20. Van Woensel, T. & Kerbache, L. & Peremans, H. & Vandaele, N., 2008. "Vehicle routing with dynamic travel times: A queueing approach," European Journal of Operational Research, Elsevier, vol. 186(3), pages 990-1007, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:320:y:2023:i:2:d:10.1007_s10479-021-04142-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.