IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v216y2012i1p33-46.html
   My bibliography  Save this article

Differential Evolution algorithm with Separated Groups for multi-dimensional optimization problems

Author

Listed:
  • Piotrowski, Adam P.
  • Napiorkowski, Jaroslaw J.
  • Kiczko, Adam

Abstract

The classical Differential Evolution (DE) algorithm, one of population-based Evolutionary Computation methods, proved to be a successful approach for relatively simple problems, but does not perform well for difficult multi-dimensional non-convex functions. A number of significant modifications of DE have been proposed in recent years, including very few approaches referring to the idea of distributed Evolutionary Algorithms. The present paper presents a new algorithm to improve optimization performance, namely DE with Separated Groups (DE-SG), which distributes population into small groups, defines rules of exchange of information and individuals between the groups and uses two different strategies to keep balance between exploration and exploitation capabilities. The performance of DE-SG is compared to that of eight algorithms belonging to the class of Evolutionary Strategies (Covariance Matrix Adaptation ES), Particle Swarm Optimization (Comprehensive Learning PSO and Efficient Population Utilization Strategy PSO), Differential Evolution (Distributed DE with explorative-exploitative population families, Self-adaptive DE, DE with global and local neighbours and Grouping Differential Evolution) and multi-algorithms (AMALGAM). The comparison is carried out for a set of 10-, 30- and 50-dimensional rotated test problems of varying difficulty, including 10- and 30-dimensional composition functions from CEC2005. Although slow for simple functions, the proposed DE-SG algorithm achieves a great success rate for more difficult 30- and 50-dimensional problems.

Suggested Citation

  • Piotrowski, Adam P. & Napiorkowski, Jaroslaw J. & Kiczko, Adam, 2012. "Differential Evolution algorithm with Separated Groups for multi-dimensional optimization problems," European Journal of Operational Research, Elsevier, vol. 216(1), pages 33-46.
  • Handle: RePEc:eee:ejores:v:216:y:2012:i:1:p:33-46
    DOI: 10.1016/j.ejor.2011.07.038
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221711006709
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2011.07.038?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Omran, Mahamed G.H. & Engelbrecht, Andries P. & Salman, Ayed, 2009. "Bare bones differential evolution," European Journal of Operational Research, Elsevier, vol. 196(1), pages 128-139, July.
    2. Salman, Ayed & Engelbrecht, Andries P. & Omran, Mahamed G.H., 2007. "Empirical analysis of self-adaptive differential evolution," European Journal of Operational Research, Elsevier, vol. 183(2), pages 785-804, December.
    3. Mishra, SK, 2006. "Global Optimization by Differential Evolution and Particle Swarm Methods: Evaluation on Some Benchmark Functions," MPRA Paper 1005, University Library of Munich, Germany.
    4. Hedar, Abdel-Rahman & Fukushima, Masao, 2006. "Tabu Search directed by direct search methods for nonlinear global optimization," European Journal of Operational Research, Elsevier, vol. 170(2), pages 329-349, April.
    5. Kaelo, P. & Ali, M.M., 2006. "A numerical study of some modified differential evolution algorithms," European Journal of Operational Research, Elsevier, vol. 169(3), pages 1176-1184, March.
    6. Beynon, Malcolm J. & Andrews, Rhys & Boyne, George A., 2010. "Evidence-based modelling of strategic fit: An introduction to RCaRBS," European Journal of Operational Research, Elsevier, vol. 207(2), pages 886-896, December.
    7. Zhang, Jingqiao & Avasarala, Viswanath & Subbu, Raj, 2010. "Evolutionary optimization of transition probability matrices for credit decision-making," European Journal of Operational Research, Elsevier, vol. 200(2), pages 557-567, January.
    8. Al-Anzi, Fawaz S. & Allahverdi, Ali, 2007. "A self-adaptive differential evolution heuristic for two-stage assembly scheduling problem to minimize maximum lateness with setup times," European Journal of Operational Research, Elsevier, vol. 182(1), pages 80-94, October.
    9. Cruz, F.R.B. & van Woensel, T. & MacGregor Smith, J. & Lieckens, K., 2010. "On the system optimum of traffic assignment in M/G/c/c state-dependent queueing networks," European Journal of Operational Research, Elsevier, vol. 201(1), pages 183-193, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. du Plessis, Mathys C. & Engelbrecht, Andries P., 2012. "Using Competitive Population Evaluation in a differential evolution algorithm for dynamic environments," European Journal of Operational Research, Elsevier, vol. 218(1), pages 7-20.
    2. Wang, Lin & He, Jing & Wu, Desheng & Zeng, Yu-Rong, 2012. "A novel differential evolution algorithm for joint replenishment problem under interdependence and its application," International Journal of Production Economics, Elsevier, vol. 135(1), pages 190-198.
    3. Mariani, Viviana Cocco & Coelho, Leandro dos Santos, 2011. "A hybrid shuffled complex evolution approach with pattern search for unconstrained optimization," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 81(9), pages 1901-1909.
    4. Tsafarakis, Stelios & Zervoudakis, Konstantinos & Andronikidis, Andreas & Altsitsiadis, Efthymios, 2020. "Fuzzy self-tuning differential evolution for optimal product line design," European Journal of Operational Research, Elsevier, vol. 287(3), pages 1161-1169.
    5. Fan, Qinqin & Yan, Xuefeng & Zhang, Yilian, 2018. "Auto-selection mechanism of differential evolution algorithm variants and its application," European Journal of Operational Research, Elsevier, vol. 270(2), pages 636-653.
    6. B. Sriman Pankaj & M. Naveen Naidu & A. Vasan & Murari RR Varma, 2020. "Self-Adaptive Cuckoo Search Algorithm for Optimal Design of Water Distribution Systems," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 34(10), pages 3129-3146, August.
    7. Sotirios K. Goudos & Margot Deruyck & David Plets & Luc Martens & Wout Joseph, 2017. "Optimization of Power Consumption in 4G LTE Networks Using a Novel Barebones Self-adaptive Differential Evolution Algorithm," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 66(1), pages 109-120, September.
    8. S. K. Mishra, 2010. "(Computer Algorithms) The Most Representative Composite Rank Ordering of Multi-Attribute Objects by the Particle Swarm Optimization Method," Journal of Quantitative Economics, The Indian Econometric Society, vol. 8(2), pages 165-200.
    9. Ivorra, Benjamin & Mohammadi, Bijan & Manuel Ramos, Angel, 2015. "A multi-layer line search method to improve the initialization of optimization algorithms," European Journal of Operational Research, Elsevier, vol. 247(3), pages 711-720.
    10. Schlereth, Christian & Stepanchuk, Tanja & Skiera, Bernd, 2010. "Optimization and analysis of the profitability of tariff structures with two-part tariffs," European Journal of Operational Research, Elsevier, vol. 206(3), pages 691-701, November.
    11. Narang, Nitin & Dhillon, J.S. & Kothari, D.P., 2012. "Multiobjective fixed head hydrothermal scheduling using integrated predator-prey optimization and Powell search method," Energy, Elsevier, vol. 47(1), pages 237-252.
    12. Keliang Wang & Leonardo Lozano & Carlos Cardonha & David Bergman, 2023. "Optimizing over an Ensemble of Trained Neural Networks," INFORMS Journal on Computing, INFORMS, vol. 35(3), pages 652-674, May.
    13. Niloy J. Mukherjee & Subhash C. Sarin & Daniel A. Neira, 2023. "Lot streaming for a two-stage assembly system in the presence of handling costs," Journal of Scheduling, Springer, vol. 26(4), pages 335-351, August.
    14. Hvattum, Lars Magnus & Glover, Fred, 2009. "Finding local optima of high-dimensional functions using direct search methods," European Journal of Operational Research, Elsevier, vol. 195(1), pages 31-45, May.
    15. M. Bierlaire & M. Thémans & N. Zufferey, 2010. "A Heuristic for Nonlinear Global Optimization," INFORMS Journal on Computing, INFORMS, vol. 22(1), pages 59-70, February.
    16. Chang-Yong Lee & Dongju Lee, 2014. "Determination of initial temperature in fast simulated annealing," Computational Optimization and Applications, Springer, vol. 58(2), pages 503-522, June.
    17. M. Ali & W. Zhu, 2013. "A penalty function-based differential evolution algorithm for constrained global optimization," Computational Optimization and Applications, Springer, vol. 54(3), pages 707-739, April.
    18. Hirsch, M.J. & Pardalos, P.M. & Resende, M.G.C., 2010. "Speeding up continuous GRASP," European Journal of Operational Research, Elsevier, vol. 205(3), pages 507-521, September.
    19. S.-C. Horng & S.-Y. Lin, 2009. "Ordinal Optimization of G/G/1/K Polling Systems with k-Limited Service Discipline," Journal of Optimization Theory and Applications, Springer, vol. 140(2), pages 213-231, February.
    20. Sudhanshu K MISHRA, 2009. "Representation-Constrained Canonical Correlation-Analysis: A Hybridization Of Canonical Correlation And Principal Component Analysis," Journal of Applied Economic Sciences, Spiru Haret University, Faculty of Financial Management and Accounting Craiova, vol. 4(1(7)_ Spr).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:216:y:2012:i:1:p:33-46. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.