IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v60y2014i3p575-594.html
   My bibliography  Save this article

Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization

Author

Listed:
  • Ivo Couckuyt
  • Dirk Deschrijver
  • Tom Dhaene

Abstract

The use of surrogate based optimization (SBO) is widely spread in engineering design to reduce the number of computational expensive simulations. However, “real-world” problems often consist of multiple, conflicting objectives leading to a set of competitive solutions (the Pareto front). The objectives are often aggregated into a single cost function to reduce the computational cost, though a better approach is to use multiobjective optimization methods to directly identify a set of Pareto-optimal solutions, which can be used by the designer to make more efficient design decisions (instead of weighting and aggregating the costs upfront). Most of the work in multiobjective optimization is focused on multiobjective evolutionary algorithms (MOEAs). While MOEAs are well-suited to handle large, intractable design spaces, they typically require thousands of expensive simulations, which is prohibitively expensive for the problems under study. Therefore, the use of surrogate models in multiobjective optimization, denoted as multiobjective surrogate-based optimization, may prove to be even more worthwhile than SBO methods to expedite the optimization of computational expensive systems. In this paper, the authors propose the efficient multiobjective optimization (EMO) algorithm which uses Kriging models and multiobjective versions of the probability of improvement and expected improvement criteria to identify the Pareto front with a minimal number of expensive simulations. The EMO algorithm is applied on multiple standard benchmark problems and compared against the well-known NSGA-II, SPEA2 and SMS-EMOA multiobjective optimization methods. Copyright Springer Science+Business Media New York 2014

Suggested Citation

  • Ivo Couckuyt & Dirk Deschrijver & Tom Dhaene, 2014. "Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization," Journal of Global Optimization, Springer, vol. 60(3), pages 575-594, November.
  • Handle: RePEc:spr:jglopt:v:60:y:2014:i:3:p:575-594
    DOI: 10.1007/s10898-013-0118-2
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10898-013-0118-2
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10898-013-0118-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Edwin R. van Dam & Bart Husslage & Dick den Hertog & Hans Melissen, 2007. "Maximin Latin Hypercube Designs in Two Dimensions," Operations Research, INFORMS, vol. 55(1), pages 158-169, February.
    2. Beume, Nicola & Naujoks, Boris & Emmerich, Michael, 2007. "SMS-EMOA: Multiobjective selection based on dominated hypervolume," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1653-1669, September.
    3. Johannes Bader & Kalyanmoy Deb & Eckart Zitzler, 2010. "Faster Hypervolume-Based Search Using Monte Carlo Sampling," Lecture Notes in Economics and Mathematical Systems, in: Matthias Ehrgott & Boris Naujoks & Theodor J. Stewart & Jyrki Wallenius (ed.), Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems, pages 313-326, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Duro, João A. & Ozturk, Umud Esat & Oara, Daniel C. & Salomon, Shaul & Lygoe, Robert J. & Burke, Richard & Purshouse, Robin C., 2023. "Methods for constrained optimization of expensive mixed-integer multi-objective problems, with application to an internal combustion engine design problem," European Journal of Operational Research, Elsevier, vol. 307(1), pages 421-446.
    2. Mehdad, E. & Kleijnen, Jack P.C., 2014. "Global Optimization for Black-box Simulation via Sequential Intrinsic Kriging," Discussion Paper 2014-063, Tilburg University, Center for Economic Research.
    3. Dawei Zhan & Jiachang Qian & Yuansheng Cheng, 2017. "Pseudo expected improvement criterion for parallel EGO algorithm," Journal of Global Optimization, Springer, vol. 68(3), pages 641-662, July.
    4. Jixiang Qing & Ivo Couckuyt & Tom Dhaene, 2023. "A robust multi-objective Bayesian optimization framework considering input uncertainty," Journal of Global Optimization, Springer, vol. 86(3), pages 693-711, July.
    5. Lee, Juseong & Mitici, Mihaela, 2022. "Multi-objective design of aircraft maintenance using Gaussian process learning and adaptive sampling," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    6. Kaifeng Yang & Michael Emmerich & André Deutz & Thomas Bäck, 2019. "Efficient computation of expected hypervolume improvement using box decomposition algorithms," Journal of Global Optimization, Springer, vol. 75(1), pages 3-34, September.
    7. Dawei Zhan & Jiachang Qian & Yuansheng Cheng, 2017. "Balancing global and local search in parallel efficient global optimization algorithms," Journal of Global Optimization, Springer, vol. 67(4), pages 873-892, April.
    8. Paul Feliot & Julien Bect & Emmanuel Vazquez, 2017. "A Bayesian approach to constrained single- and multi-objective optimization," Journal of Global Optimization, Springer, vol. 67(1), pages 97-133, January.
    9. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.
    10. Prashant Singh & Ivo Couckuyt & Khairy Elsayed & Dirk Deschrijver & Tom Dhaene, 2017. "Multi-objective Geometry Optimization of a Gas Cyclone Using Triple-Fidelity Co-Kriging Surrogate Models," Journal of Optimization Theory and Applications, Springer, vol. 175(1), pages 172-193, October.
    11. Jesús Martínez-Frutos & David Herrero-Pérez, 2016. "Kriging-based infill sampling criterion for constraint handling in multi-objective optimization," Journal of Global Optimization, Springer, vol. 64(1), pages 97-115, January.
    12. Jolan Wauters & Andy Keane & Joris Degroote, 2020. "Development of an adaptive infill criterion for constrained multi-objective asynchronous surrogate-based optimization," Journal of Global Optimization, Springer, vol. 78(1), pages 137-160, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joshua Q. Hale & Helin Zhu & Enlu Zhou, 2020. "Domination Measure: A New Metric for Solving Multiobjective Optimization," INFORMS Journal on Computing, INFORMS, vol. 32(3), pages 565-581, July.
    2. Rennen, G. & Husslage, B.G.M. & van Dam, E.R. & den Hertog, D., 2009. "Nested Maximin Latin Hypercube Designs," Discussion Paper 2009-06, Tilburg University, Center for Economic Research.
    3. Liagkouras, Konstantinos & Metaxiotis, Konstantinos, 2021. "Improving multi-objective algorithms performance by emulating behaviors from the human social analogue in candidate solutions," European Journal of Operational Research, Elsevier, vol. 292(3), pages 1019-1036.
    4. Gong, Wenyin & Cai, Zhihua, 2009. "An improved multiobjective differential evolution based on Pareto-adaptive [epsilon]-dominance and orthogonal design," European Journal of Operational Research, Elsevier, vol. 198(2), pages 576-601, October.
    5. Andrea Ponti & Antonio Candelieri & Ilaria Giordani & Francesco Archetti, 2023. "Intrusion Detection in Networks by Wasserstein Enabled Many-Objective Evolutionary Algorithms," Mathematics, MDPI, vol. 11(10), pages 1-14, May.
    6. David Quintana & Roman Denysiuk & Sandra García-Rodríguez & Antonio Gaspar-Cunha, 2017. "Portfolio implementation risk management using evolutionary multiobjective optimization," Post-Print hal-01881379, HAL.
    7. Yunsong Han & Hong Yu & Cheng Sun, 2017. "Simulation-Based Multiobjective Optimization of Timber-Glass Residential Buildings in Severe Cold Regions," Sustainability, MDPI, vol. 9(12), pages 1-18, December.
    8. Laumanns, Marco & Zenklusen, Rico, 2011. "Stochastic convergence of random search methods to fixed size Pareto front approximations," European Journal of Operational Research, Elsevier, vol. 213(2), pages 414-421, September.
    9. Nondy, J. & Gogoi, T.K., 2021. "Performance comparison of multi-objective evolutionary algorithms for exergetic and exergoenvironomic optimization of a benchmark combined heat and power system," Energy, Elsevier, vol. 233(C).
    10. Christian Lücken & Benjamín Barán & Carlos Brizuela, 2014. "A survey on multi-objective evolutionary algorithms for many-objective problems," Computational Optimization and Applications, Springer, vol. 58(3), pages 707-756, July.
    11. Derbel, Bilel & Humeau, Jérémie & Liefooghe, Arnaud & Verel, Sébastien, 2014. "Distributed localized bi-objective search," European Journal of Operational Research, Elsevier, vol. 239(3), pages 731-743.
    12. Sergio Cabello, 2023. "Faster distance-based representative skyline and k-center along pareto front in the plane," Journal of Global Optimization, Springer, vol. 86(2), pages 441-466, June.
    13. Sven Schulz & Udo Buscher & Liji Shen, 2020. "Multi-objective hybrid flow shop scheduling with variable discrete production speed levels and time-of-use energy prices," Journal of Business Economics, Springer, vol. 90(9), pages 1315-1343, November.
    14. Lourdes Uribe & Johan M Bogoya & Andrés Vargas & Adriana Lara & Günter Rudolph & Oliver Schütze, 2020. "A Set Based Newton Method for the Averaged Hausdorff Distance for Multi-Objective Reference Set Problems," Mathematics, MDPI, vol. 8(10), pages 1-29, October.
    15. Jing Zhang & Jin Xu & Kai Jia & Yimin Yin & Zhengming Wang, 2019. "Optimal Sliced Latin Hypercube Designs with Slices of Arbitrary Run Sizes," Mathematics, MDPI, vol. 7(9), pages 1-16, September.
    16. Houssem R. E. H. Bouchekara & Yusuf A. Sha’aban & Mohammad S. Shahriar & Makbul A. M. Ramli & Abdullahi A. Mas’ud, 2023. "Wind Farm Layout Optimization/Expansion with Real Wind Turbines Using a Multi-Objective EA Based on an Enhanced Inverted Generational Distance Metric Combined with the Two-Archive Algorithm 2," Sustainability, MDPI, vol. 15(3), pages 1-32, January.
    17. Edwin Dam & Bart Husslage & Dick Hertog, 2010. "One-dimensional nested maximin designs," Journal of Global Optimization, Springer, vol. 46(2), pages 287-306, February.
    18. Yugong Dang & Hongen Ma & Jun Wang & Zhigang Zhou & Zhidong Xu, 2022. "An Improved Multi-Objective Optimization Decision Method Using NSGA-III for a Bivariate Precision Fertilizer Applicator," Agriculture, MDPI, vol. 12(9), pages 1-23, September.
    19. Rennen, G., 2008. "Subset Selection from Large Datasets for Kriging Modeling," Discussion Paper 2008-26, Tilburg University, Center for Economic Research.
    20. Taimoor Akhtar & Christine Shoemaker, 2016. "Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection," Journal of Global Optimization, Springer, vol. 64(1), pages 17-32, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:60:y:2014:i:3:p:575-594. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.