IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v292y2021i2p397-422.html

Performance indicators in multiobjective optimization

Author

Listed:
  • Audet, Charles
  • Bigeon, Jean
  • Cartier, Dominique
  • Le Digabel, Sébastien
  • Salomon, Ludovic

Abstract

In recent years, the development of new algorithms for multiobjective optimization has considerably grown. A large number of performance indicators has been introduced to measure the quality of Pareto front approximations produced by these algorithms. In this work, we propose a review of a total of 63 performance indicators partitioned into four groups according to their properties: cardinality, convergence, distribution and spread. Applications of these indicators are presented as well.

Suggested Citation

  • Audet, Charles & Bigeon, Jean & Cartier, Dominique & Le Digabel, Sébastien & Salomon, Ludovic, 2021. "Performance indicators in multiobjective optimization," European Journal of Operational Research, Elsevier, vol. 292(2), pages 397-422.
    • Handle: RePEc:eee:ejores:v:292:y:2021:i:2:p:397-422
    DOI: 10.1016/j.ejor.2020.11.016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221720309620
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2020.11.016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    2. Guerreiro, Andreia P. & Fonseca, Carlos M., 2020. "An analysis of the Hypervolume Sharpe-Ratio Indicator," European Journal of Operational Research, Elsevier, vol. 283(2), pages 614-629.
    3. Paul Feliot & Julien Bect & Emmanuel Vazquez, 2017. "A Bayesian approach to constrained single- and multi-objective optimization," Journal of Global Optimization, Springer, vol. 67(1), pages 97-133, January.
    4. Michael Emmerich & Kaifeng Yang & André Deutz & Hao Wang & Carlos M. Fonseca, 2016. "A Multicriteria Generalization of Bayesian Global Optimization," Springer Optimization and Its Applications, in: Panos M. Pardalos & Anatoly Zhigljavsky & Julius Žilinskas (ed.), Advances in Stochastic and Deterministic Global Optimization, pages 229-242, Springer.
    5. Günter Rudolph & Oliver Schütze & Christian Grimme & Christian Domínguez-Medina & Heike Trautmann, 2016. "Optimal averaged Hausdorff archives for bi-objective problems: theoretical and numerical results," Computational Optimization and Applications, Springer, vol. 64(2), pages 589-618, June.
    6. Beume, Nicola & Naujoks, Boris & Emmerich, Michael, 2007. "SMS-EMOA: Multiobjective selection based on dominated hypervolume," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1653-1669, September.
    7. Deb, Kalyanmoy & Tiwari, Santosh, 2008. "Omni-optimizer: A generic evolutionary algorithm for single and multi-objective optimization," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1062-1087, March.
    8. Margaret M. Wiecek & Matthias Ehrgott & Alexander Engau, 2016. "Continuous Multiobjective Programming," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 739-815, Springer.
    9. Audet, Charles & Savard, Gilles & Zghal, Walid, 2010. "A mesh adaptive direct search algorithm for multiobjective optimization," European Journal of Operational Research, Elsevier, vol. 204(3), pages 545-556, August.
    10. Dächert, Kerstin & Klamroth, Kathrin & Lacour, Renaud & Vanderpooten, Daniel, 2017. "Efficient computation of the search region in multi-objective optimization," European Journal of Operational Research, Elsevier, vol. 260(3), pages 841-855.
    11. Luís M. S. Russo & Alexandre P. Francisco, 2016. "Extending quick hypervolume," Journal of Heuristics, Springer, vol. 22(3), pages 245-271, June.
    12. Taimoor Akhtar & Christine Shoemaker, 2016. "Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection," Journal of Global Optimization, Springer, vol. 64(1), pages 17-32, January.
    13. Eric Bradford & Artur M. Schweidtmann & Alexei Lapkin, 2018. "Correction to: Efficient multiobjective optimization employing Gaussian processes, spectral sampling and a genetic algorithm," Journal of Global Optimization, Springer, vol. 71(2), pages 439-440, June.
    14. Eric Bradford & Artur M. Schweidtmann & Alexei Lapkin, 2018. "Efficient multiobjective optimization employing Gaussian processes, spectral sampling and a genetic algorithm," Journal of Global Optimization, Springer, vol. 71(2), pages 407-438, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liagkouras, Konstantinos & Metaxiotis, Konstantinos, 2021. "Improving multi-objective algorithms performance by emulating behaviors from the human social analogue in candidate solutions," European Journal of Operational Research, Elsevier, vol. 292(3), pages 1019-1036.
    2. Guerreiro, Andreia P. & Fonseca, Carlos M., 2020. "An analysis of the Hypervolume Sharpe-Ratio Indicator," European Journal of Operational Research, Elsevier, vol. 283(2), pages 614-629.
    3. C. P. Brás & A. L. Custódio, 2020. "On the use of polynomial models in multiobjective directional direct search," Computational Optimization and Applications, Springer, vol. 77(3), pages 897-918, December.
    4. Wenyu Wang & Christine A. Shoemaker, 2023. "Reference Vector Assisted Candidate Search with Aggregated Surrogate for Computationally Expensive Many Objective Optimization Problems," INFORMS Journal on Computing, INFORMS, vol. 35(2), pages 318-334, March.
    5. Angel E. Rodriguez-Fernandez & Hao Wang & Oliver Schütze, 2025. "Reference Set Generator: A Method for Pareto Front Approximation and Reference Set Generation," Mathematics, MDPI, vol. 13(10), pages 1-28, May.
    6. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.
    7. Kaifeng Yang & Michael Emmerich & André Deutz & Thomas Bäck, 2019. "Efficient computation of expected hypervolume improvement using box decomposition algorithms," Journal of Global Optimization, Springer, vol. 75(1), pages 3-34, September.
    8. Hwang, Junhyeok & Kim, Jeongnam & Lee, Hee Won & Na, Jonggeol & Ahn, Byoung Sung & Lee, Sang Deuk & Kim, Hoon Sik & Lee, Hyunjoo & Lee, Ung, 2019. "An experimental based optimization of a novel water lean amine solvent for post combustion CO2 capture process," Applied Energy, Elsevier, vol. 248(C), pages 174-184.
    9. Baklouti, Ahmad & Dammak, Khalil & El Hami, Abdelkhalak, 2022. "Optimum reliable design of rolling element bearings using multi-objective optimization based on C-NSGA-II," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    10. Menghua Deng & Zhiqi Li & Feifei Tao, 2022. "Rainstorm Disaster Risk Assessment and Influence Factors Analysis in the Yangtze River Delta, China," IJERPH, MDPI, vol. 19(15), pages 1-16, August.
    11. Jamie A. Manson & Thomas W. Chamberlain & Richard A. Bourne, 2021. "MVMOO: Mixed variable multi-objective optimisation," Journal of Global Optimization, Springer, vol. 80(4), pages 865-886, August.
    12. Menghua Deng & Junfei Chen & Feifei Tao & Jiulong Zhu & Min Wang, 2022. "On the Coupling and Coordination Development between Environment and Economy: A Case Study in the Yangtze River Delta of China," IJERPH, MDPI, vol. 19(1), pages 1-20, January.
    13. David Stenger & Robert Ritschel & Felix Krabbes & Rick Voßwinkel & Hendrik Richter, 2023. "What Is the Best Way to Optimally Parameterize the MPC Cost Function for Vehicle Guidance?," Mathematics, MDPI, vol. 11(2), pages 1-19, January.
    14. Thebelt, Alexander & Tsay, Calvin & Lee, Robert M. & Sudermann-Merx, Nathan & Walz, David & Tranter, Tom & Misener, Ruth, 2022. "Multi-objective constrained optimization for energy applications via tree ensembles," Applied Energy, Elsevier, vol. 306(PB).
    15. He Liu & Xueming Li, 2022. "Understanding the Driving Factors for Urban Human Settlement Vitality at Street Level: A Case Study of Dalian, China," Land, MDPI, vol. 11(5), pages 1-20, April.
    16. Wenyu Wang & Taimoor Akhtar & Christine A. Shoemaker, 2022. "Integrating $$\varepsilon $$ ε -dominance and RBF surrogate optimization for solving computationally expensive many-objective optimization problems," Journal of Global Optimization, Springer, vol. 82(4), pages 965-992, April.
    17. G. Liuzzi & S. Lucidi, 2026. "A derivative-free approach to mixed integer constrained multiobjective nonsmooth black-box optimization," Computational Optimization and Applications, Springer, vol. 93(3), pages 921-966, April.
    18. Jean Bigeon & Sébastien Le Digabel & Ludovic Salomon, 2024. "Handling of constraints in multiobjective blackbox optimization," Computational Optimization and Applications, Springer, vol. 89(1), pages 69-113, September.
    19. Akosah, Nana Kwame & Alagidede, Imhotep Paul & Schaling, Eric, 2020. "Testing for asymmetry in monetary policy rule for small-open developing economies: Multiscale Bayesian quantile evidence from Ghana," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    20. Cui, Xueting & Zhu, Shushang & Sun, Xiaoling & Li, Duan, 2013. "Nonlinear portfolio selection using approximate parametric Value-at-Risk," Journal of Banking & Finance, Elsevier, vol. 37(6), pages 2124-2139.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:292:y:2021:i:2:p:397-422. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.