IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v82y2022i3d10.1007_s10898-021-01085-0.html
   My bibliography  Save this article

Review and comparison of algorithms and software for mixed-integer derivative-free optimization

Author

Listed:
  • Nikolaos Ploskas

    (University of Western Macedonia)

  • Nikolaos V. Sahinidis

    (Georgia Institute of Technology
    Georgia Institute of Technology)

Abstract

This paper reviews the literature on algorithms for solving bound-constrained mixed-integer derivative-free optimization problems and presents a systematic comparison of available implementations of these algorithms on a large collection of test problems. Thirteen derivative-free optimization solvers are compared using a test set of 267 problems. The testbed includes: (i) pure-integer and mixed-integer problems, and (ii) small, medium, and large problems covering a wide range of characteristics found in applications. We evaluate the solvers according to their ability to find a near-optimal solution, find the best solution among currently available solvers, and improve a given starting point. Computational results show that the ability of all these solvers to obtain good solutions diminishes with increasing problem size, but the solvers evaluated collectively found optimal solutions for 93% of the problems in our test set. The open-source solvers MISO and NOMAD were the best performers among all solvers tested. MISO outperformed all other solvers on large and binary problems, while NOMAD was the best performer on mixed-integer, non-binary discrete, small, and medium-sized problems.

Suggested Citation

  • Nikolaos Ploskas & Nikolaos V. Sahinidis, 2022. "Review and comparison of algorithms and software for mixed-integer derivative-free optimization," Journal of Global Optimization, Springer, vol. 82(3), pages 433-462, March.
    • Handle: RePEc:spr:jglopt:v:82:y:2022:i:3:d:10.1007_s10898-021-01085-0
    DOI: 10.1007/s10898-021-01085-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-021-01085-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10898-021-01085-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Angelo Ciccazzo & Vittorio Latorre & Giampaolo Liuzzi & Stefano Lucidi & Francesco Rinaldi, 2015. "Derivative-Free Robust Optimization for Circuit Design," Journal of Optimization Theory and Applications, Springer, vol. 164(3), pages 842-861, March.
    2. Juliane Müller & Christine Shoemaker & Robert Piché, 2014. "SO-I: a surrogate model algorithm for expensive nonlinear integer programming problems including global optimization applications," Journal of Global Optimization, Springer, vol. 59(4), pages 865-889, August.
    3. Manuel Laguna & Francisco Gortázar & Micael Gallego & Abraham Duarte & Rafael Martí, 2014. "A black-box scatter search for optimization problems with integer variables," Journal of Global Optimization, Springer, vol. 58(3), pages 497-516, March.
    4. Kleijnen, J.P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2008. "Constrained Optimization in Simulation : A Novel Approach," Other publications TiSEM e49ba0fc-853c-4a13-b564-d, Tilburg University, School of Economics and Management.
    5. Giampaolo Liuzzi & Stefano Lucidi & Francesco Rinaldi, 2015. "Derivative-Free Methods for Mixed-Integer Constrained Optimization Problems," Journal of Optimization Theory and Applications, Springer, vol. 164(3), pages 933-965, March.
    6. G. Liuzzi & S. Lucidi & F. Rinaldi, 2012. "Derivative-free methods for bound constrained mixed-integer optimization," Computational Optimization and Applications, Springer, vol. 53(2), pages 505-526, October.
    7. Socha, Krzysztof & Dorigo, Marco, 2008. "Ant colony optimization for continuous domains," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1155-1173, March.
    8. Eric Newby & M. Ali, 2015. "A trust-region-based derivative free algorithm for mixed integer programming," Computational Optimization and Applications, Springer, vol. 60(1), pages 199-229, January.
    9. Sriver, Todd A. & Chrissis, James W. & Abramson, Mark A., 2009. "Pattern search ranking and selection algorithms for mixed variable simulation-based optimization," European Journal of Operational Research, Elsevier, vol. 198(3), pages 878-890, November.
    10. Kleijnen, Jack P.C. & Beers, Wim van & Nieuwenhuyse, Inneke van, 2010. "Constrained optimization in expensive simulation: Novel approach," European Journal of Operational Research, Elsevier, vol. 202(1), pages 164-174, April.
    11. Martin Schlüter & Matthias Gerdts, 2010. "The oracle penalty method," Journal of Global Optimization, Springer, vol. 47(2), pages 293-325, June.
    12. Jianfeng Liu & Nikolaos Ploskas & Nikolaos V. Sahinidis, 2019. "Tuning BARON using derivative-free optimization algorithms," Journal of Global Optimization, Springer, vol. 74(4), pages 611-637, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Boukouvala, Fani & Misener, Ruth & Floudas, Christodoulos A., 2016. "Global optimization advances in Mixed-Integer Nonlinear Programming, MINLP, and Constrained Derivative-Free Optimization, CDFO," European Journal of Operational Research, Elsevier, vol. 252(3), pages 701-727.
    2. Ubaldo M. García Palomares, 2023. "Convergence of derivative-free nonmonotone Direct Search Methods for unconstrained and box-constrained mixed-integer optimization," Computational Optimization and Applications, Springer, vol. 85(3), pages 821-856, July.
    3. Zheng, Liang & Xue, Xinfeng & Xu, Chengcheng & Ran, Bin, 2019. "A stochastic simulation-based optimization method for equitable and efficient network-wide signal timing under uncertainties," Transportation Research Part B: Methodological, Elsevier, vol. 122(C), pages 287-308.
    4. Osorio, Carolina, 2019. "High-dimensional offline origin-destination (OD) demand calibration for stochastic traffic simulators of large-scale road networks," Transportation Research Part B: Methodological, Elsevier, vol. 124(C), pages 18-43.
    5. Kleijnen, Jack P.C. & Mehdad, Ehsan, 2014. "Multivariate versus univariate Kriging metamodels for multi-response simulation models," European Journal of Operational Research, Elsevier, vol. 236(2), pages 573-582.
    6. Tommaso Giovannelli & Giampaolo Liuzzi & Stefano Lucidi & Francesco Rinaldi, 2022. "Derivative-free methods for mixed-integer nonsmooth constrained optimization," Computational Optimization and Applications, Springer, vol. 82(2), pages 293-327, June.
    7. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    8. Strang, Kenneth David, 2012. "Importance of verifying queue model assumptions before planning with simulation software," European Journal of Operational Research, Elsevier, vol. 218(2), pages 493-504.
    9. Arreola-Risa, Antonio & Giménez-García, Víctor M. & Martínez-Parra, José Luis, 2011. "Optimizing stochastic production-inventory systems: A heuristic based on simulation and regression analysis," European Journal of Operational Research, Elsevier, vol. 213(1), pages 107-118, August.
    10. Kleijnen, Jack P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2011. "Expected Improvement in Efficient Global Optimization Through Bootstrapped Kriging - Replaces CentER DP 2010-62," Discussion Paper 2011-015, Tilburg University, Center for Economic Research.
    11. Kleijnen, Jack P.C. & Mehdad, E., 2012. "Kriging in Multi-response Simulation, including a Monte Carlo Laboratory (Replaced by 2014-012)," Other publications TiSEM cf311469-5f8c-4c1e-ad4f-6, Tilburg University, School of Economics and Management.
    12. Dhahri, Akrem & Gharbi, Ali & Ouhimmou, Mustapha, 2022. "Integrated production-delivery control policy for an unreliable manufacturing system and multiple retailers," International Journal of Production Economics, Elsevier, vol. 245(C).
    13. Kleijnen, Jack P.C., 2013. "Simulation-Optimization via Kriging and Bootstrapping : A Survey (Revision of CentER DP 2011-064)," Other publications TiSEM 6ac4e049-ad86-447f-aeec-a, Tilburg University, School of Economics and Management.
    14. Kabirian, Alireza & Ólafsson, Sigurdur, 2011. "Continuous optimization via simulation using Golden Region search," European Journal of Operational Research, Elsevier, vol. 208(1), pages 19-27, January.
    15. Othmane Benmoussa, 2022. "Improving Replenishment Flows Using Simulation Results: A Case Study," Logistics, MDPI, vol. 6(2), pages 1-26, May.
    16. Kleijnen, Jack P.C. & Mehdad, E., 2014. "Multivariate Versus Univariate Kriging Metamodels for Multi-Response Simulation Models (Revision of 2012-039)," Discussion Paper 2014-012, Tilburg University, Center for Economic Research.
    17. Carolina Osorio & Michel Bierlaire, 2013. "A Simulation-Based Optimization Framework for Urban Transportation Problems," Operations Research, INFORMS, vol. 61(6), pages 1333-1345, December.
    18. Carolina Osorio & Linsen Chong, 2015. "A Computationally Efficient Simulation-Based Optimization Algorithm for Large-Scale Urban Transportation Problems," Transportation Science, INFORMS, vol. 49(3), pages 623-636, August.
    19. Miranda, Rafael de Carvalho & Montevechi, José Arnaldo Barra & da Silva, Aneirson Francisco & Marins, Fernando Augusto Silva, 2017. "Increasing the efficiency in integer simulation optimization: Reducing the search space through data envelopment analysis and orthogonal arrays," European Journal of Operational Research, Elsevier, vol. 262(2), pages 673-681.
    20. Hernandez, Andres F. & Grover, Martha A., 2013. "Error estimation properties of Gaussian process models in stochastic simulations," European Journal of Operational Research, Elsevier, vol. 228(1), pages 131-140.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:82:y:2022:i:3:d:10.1007_s10898-021-01085-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.