IDEAS home Printed from https://ideas.repec.org/a/spr/joheur/v30y2024i3d10.1007_s10732-024-09526-1.html
   My bibliography  Save this article

Metaheuristics and machine learning: an approach with reinforcement learning assisting neural architecture search

Author

Listed:
  • Sandra Mara Scós Venske

    (UTFPR
    UNICENTRO)

  • Carolina Paula Almeida

    (UNICENTRO)

  • Myriam Regattieri Delgado

    (UTFPR)

Abstract

Methaheuristics (MHs) are techniques widely used for solving complex optimization problems. In recent years, the interest in combining MH and machine learning (ML) has grown. This integration can occur mainly in two ways: ML-in-MH and MH-in-ML. In the present work, we combine the techniques in both ways—ML-in-MH-in-ML, providing an approach in which ML is considered to improve the performance of an evolutionary algorithm (EA), whose solutions encode parameters of an ML model—artificial neural network (ANN). Our approach called TS $$_{in}$$ in EA $$_{in}$$ in ANN employs a reinforcement learning neighborhood (RLN) mutation based on Thompson sampling (TS). TS is a parameterless reinforcement learning method, used here to boost the EA performance. In the experiments, every candidate ANN solves a regression problem known as protein structure prediction deviation. We consider two protein datasets, one with 16,382 and the other with 45,730 samples. The results show that TS $$_{in}$$ in EA $$_{in}$$ in ANN performs significantly better than a canonical genetic algorithm (GA $$_{in}$$ in ANN) and the evolutionary algorithm without reinforcement learning (EA $$_{in}$$ in ANN). Analyses of the parameter’s frequency are also performed comparing the approaches. Finally, comparisons with the literature show that except for one particular case in the largest dataset, TS $$_{in}$$ in EA $$_{in}$$ in ANN outperforms other approaches considered the state of the art for the addressed datasets.

Suggested Citation

  • Sandra Mara Scós Venske & Carolina Paula Almeida & Myriam Regattieri Delgado, 2024. "Metaheuristics and machine learning: an approach with reinforcement learning assisting neural architecture search," Journal of Heuristics, Springer, vol. 30(3), pages 199-224, August.
  • Handle: RePEc:spr:joheur:v:30:y:2024:i:3:d:10.1007_s10732-024-09526-1
    DOI: 10.1007/s10732-024-09526-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10732-024-09526-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10732-024-09526-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Karimi-Mamaghan, Maryam & Mohammadi, Mehrdad & Meyer, Patrick & Karimi-Mamaghan, Amir Mohammad & Talbi, El-Ghazali, 2022. "Machine learning at the service of meta-heuristics for solving combinatorial optimization problems: A state-of-the-art," European Journal of Operational Research, Elsevier, vol. 296(2), pages 393-422.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philippe Racette & Frédéric Quesnel & Andrea Lodi & François Soumis, 2024. "Gaining insight into crew rostering instances through ML-based sequential assignment," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(3), pages 537-578, October.
    2. Tingting Li & Wangtu Xu, 2024. "Reliable multiple allocation hub location problem under disruptions," Flexible Services and Manufacturing Journal, Springer, vol. 36(4), pages 1503-1529, December.
    3. Bootaki, Behrang & Zhang, Guoqing, 2024. "A location-production-routing problem for distributed manufacturing platforms: A neural genetic algorithm solution methodology," International Journal of Production Economics, Elsevier, vol. 275(C).
    4. Camur, Mustafa C. & Sharkey, Thomas C. & Vogiatzis, Chrysafis, 2023. "The stochastic pseudo-star degree centrality problem," European Journal of Operational Research, Elsevier, vol. 308(2), pages 525-539.
    5. Filom, Siyavash & Amiri, Amir M. & Razavi, Saiedeh, 2022. "Applications of machine learning methods in port operations – A systematic literature review," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 161(C).
    6. Hashemi-Petroodi, S. Ehsan & Thevenin, Simon & Kovalev, Sergey & Dolgui, Alexandre, 2023. "Markov decision process for multi-manned mixed-model assembly lines with walking workers," International Journal of Production Economics, Elsevier, vol. 255(C).
    7. Samah Jomah & Aji S, 2024. "Meta-Heuristic Scheduling: A Review on Swarm Intelligence and Hybrid Meta-Heuristics Algorithms for Cloud Computing," SN Operations Research Forum, Springer, vol. 5(4), pages 1-42, December.
    8. Sarkar, Puja & Khanapuri, Vivekanand B. & Tiwari, Manoj Kumar, 2025. "Integration of prediction and optimization for smart stock portfolio selection," European Journal of Operational Research, Elsevier, vol. 321(1), pages 243-256.
    9. Haoqi Xie & Daniela Ambrosino, 2025. "Operations Research, Machine Learning, and Integrated Techniques for Decision Problems in the Seaside Area of Container Terminals," SN Operations Research Forum, Springer, vol. 6(2), pages 1-51, June.
    10. Fang, Chao & Han, Zonglei & Wang, Wei & Zio, Enrico, 2023. "Routing UAVs in landslides Monitoring: A neural network heuristic for team orienteering with mandatory visits," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 175(C).
    11. Laporte, Gilbert, 2024. "Fifty years of operational research: 1972–2022," European Journal of Operational Research, Elsevier, vol. 319(2), pages 347-360.
    12. Mohammadi, Mehrdad & Dehghan, Milad & Pirayesh, Amir & Dolgui, Alexandre, 2022. "Bi‐objective optimization of a stochastic resilient vaccine distribution network in the context of the COVID‐19 pandemic," Omega, Elsevier, vol. 113(C).
    13. Eduardo Guzman & Beatriz Andres & Raul Poler, 2022. "A Decision-Making Tool for Algorithm Selection Based on a Fuzzy TOPSIS Approach to Solve Replenishment, Production and Distribution Planning Problems," Mathematics, MDPI, vol. 10(9), pages 1-28, May.
    14. Fajemisin, Adejuyigbe O. & Maragno, Donato & den Hertog, Dick, 2024. "Optimization with constraint learning: A framework and survey," European Journal of Operational Research, Elsevier, vol. 314(1), pages 1-14.
    15. Lagos, Felipe & Pereira, Jordi, 2024. "Multi-armed bandit-based hyper-heuristics for combinatorial optimization problems," European Journal of Operational Research, Elsevier, vol. 312(1), pages 70-91.
    16. Carolina Saavedra Sueldo & Ivo Perez Colo & Mariano Paula & Sebastián A. Villar & Gerardo G. Acosta, 2025. "Simulation-based metaheuristic optimization algorithm for material handling," Journal of Intelligent Manufacturing, Springer, vol. 36(3), pages 1689-1709, March.
    17. de Oliveira, Raphael Mazzine Barbosa & Sörensen, Kenneth & Martens, David, 2024. "A model-agnostic and data-independent tabu search algorithm to generate counterfactuals for tabular, image, and text data," European Journal of Operational Research, Elsevier, vol. 317(2), pages 286-302.
    18. Lin, Yun Hui & Yin, Xiao Feng & Tian, Qingyun, 2024. "Unlocking efficiency: End-to-end optimization learning for recurrent facility operational planning," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 189(C).
    19. Marcelo Becerra-Rozas & Felipe Cisternas-Caneo & Broderick Crawford & Ricardo Soto & José García & Gino Astorga & Wenceslao Palma, 2022. "Embedded Learning Approaches in the Whale Optimizer to Solve Coverage Combinatorial Problems," Mathematics, MDPI, vol. 10(23), pages 1-18, November.
    20. Martí, Rafael & Sevaux, Marc & Sörensen, Kenneth, 2025. "Fifty years of metaheuristics," European Journal of Operational Research, Elsevier, vol. 321(2), pages 345-362.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joheur:v:30:y:2024:i:3:d:10.1007_s10732-024-09526-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.