IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i16p1839-d608235.html
   My bibliography  Save this article

Q-Learnheuristics: Towards Data-Driven Balanced Metaheuristics

Author

Listed:
  • Broderick Crawford

    (Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile)

  • Ricardo Soto

    (Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile)

  • José Lemus-Romani

    (Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile)

  • Marcelo Becerra-Rozas

    (Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile)

  • José M. Lanza-Gutiérrez

    (Departamento de Ciencias de la Computación, Escuela Politécnica Superior, Universidad de Alcalá, 28805 Alcalá de Henares, Spain)

  • Nuria Caballé

    (Departamento de Física y Matemáticas, Facultad de Ciencias, Universidad de Alcalá, 28802 Alcalá de Henares, Spain)

  • Mauricio Castillo

    (Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile)

  • Diego Tapia

    (Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile)

  • Felipe Cisternas-Caneo

    (Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile)

  • José García

    (Escuela de Ingeniería en Construcción, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2147, Valparaíso 2362804, Chile)

  • Gino Astorga

    (Escuela de Negocios Internacionales, Universidad de Valparaíso, Alcalde Prieto Nieto 452, Viña del Mar 2572048, Chile)

  • Carlos Castro

    (Departamento de Informática, Universidad Técnica Federico Santa María, Avenida España 1680, Valparaíso 2390123, Chile)

  • José-Miguel Rubio

    (Escuela de Computación e Informática, Universidad Bernardo O’Higgins, Av. Viel 1497, Santiago 8370993, Chile)

Abstract

One of the central issues that must be resolved for a metaheuristic optimization process to work well is the dilemma of the balance between exploration and exploitation. The metaheuristics (MH) that achieved this balance can be called balanced MH, where a Q-Learning (QL) integration framework was proposed for the selection of metaheuristic operators conducive to this balance, particularly the selection of binarization schemes when a continuous metaheuristic solves binary combinatorial problems. In this work the use of this framework is extended to other recent metaheuristics, demonstrating that the integration of QL in the selection of operators improves the exploration-exploitation balance. Specifically, the Whale Optimization Algorithm and the Sine-Cosine Algorithm are tested by solving the Set Covering Problem, showing statistical improvements in this balance and in the quality of the solutions.

Suggested Citation

  • Broderick Crawford & Ricardo Soto & José Lemus-Romani & Marcelo Becerra-Rozas & José M. Lanza-Gutiérrez & Nuria Caballé & Mauricio Castillo & Diego Tapia & Felipe Cisternas-Caneo & José García & Gino , 2021. "Q-Learnheuristics: Towards Data-Driven Balanced Metaheuristics," Mathematics, MDPI, vol. 9(16), pages 1-26, August.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:16:p:1839-:d:608235
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/16/1839/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/16/1839/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fred Glover & Michele Samorani, 2019. "Intensification, Diversification and Learning in metaheuristic optimization," Journal of Heuristics, Springer, vol. 25(4), pages 517-520, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.

      Corrections

      All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:16:p:1839-:d:608235. See general information about how to correct material in RePEc.

      If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

      If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

      If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

      For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

      Please note that corrections may take a couple of weeks to filter through the various RePEc services.

      IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.