IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v287y2020i1p1-18.html
   My bibliography  Save this article

Parallel computational optimization in operations research: A new integrative framework, literature review and research directions

Author

Listed:
  • Schryen, Guido

Abstract

Solving optimization problems with parallel algorithms has a long tradition in OR. Its future relevance for solving hard optimization problems in many fields, including finance, logistics, production and design, is leveraged through the increasing availability of powerful computing capabilities. Acknowledging the existence of several literature reviews on parallel optimization, we did not find reviews that cover the most recent literature on the parallelization of both exact and (meta)heuristic methods. However, in the past decade substantial advancements in parallel computing capabilities have been achieved and used by OR scholars so that an overview of modern parallel optimization in OR that accounts for these advancements is beneficial. Another issue from previous reviews results from their adoption of different foci so that concepts used to describe and structure prior literature differ. This heterogeneity is accompanied by a lack of unifying frameworks for parallel optimization across methodologies, application fields and problems, and it has finally led to an overall fragmented picture of what has been achieved and still needs to be done in parallel optimization in OR. This review addresses the aforementioned issues with three contributions: First, we suggest a new integrative framework of parallel computational optimization across optimization problems, algorithms and application domains. The framework integrates the perspectives of algorithmic design and computational implementation of parallel optimization. Second, we apply the framework to synthesize prior research on parallel optimization in OR, focusing on computational studies published in the period 2008–2017. Finally, we suggest research directions for parallel optimization in OR.

Suggested Citation

  • Schryen, Guido, 2020. "Parallel computational optimization in operations research: A new integrative framework, literature review and research directions," European Journal of Operational Research, Elsevier, vol. 287(1), pages 1-18.
    • Handle: RePEc:eee:ejores:v:287:y:2020:i:1:p:1-18
    DOI: 10.1016/j.ejor.2019.11.033
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221719309440
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2019.11.033?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Angel Juan & Javier Faulin & Josep Jorba & Jose Caceres & Joan Marquès, 2013. "Using parallel & distributed computing for real-time solving of vehicle routing problems with stochastic demands," Annals of Operations Research, Springer, vol. 207(1), pages 43-65, August.
    2. Pagès-Bernaus, Adela & Pérez-Valdés, Gerardo & Tomasgard, Asgeir, 2015. "A parallelised distributed implementation of a Branch and Fix Coordination algorithm," European Journal of Operational Research, Elsevier, vol. 244(1), pages 77-85.
    3. Teodor Crainic, 2019. "Parallel Metaheuristics and Cooperative Search," International Series in Operations Research & Management Science, in: Michel Gendreau & Jean-Yves Potvin (ed.), Handbook of Metaheuristics, edition 3, chapter 0, pages 419-451, Springer.
    4. Dhananjay Thiruvady & Andreas T. Ernst & Gaurav Singh, 2016. "Parallel ant colony optimization for resource constrained job scheduling," Annals of Operations Research, Springer, vol. 242(2), pages 355-372, July.
    5. Aldasoro, Unai & Escudero, Laureano F. & Merino, María & Pérez, Gloria, 2017. "A parallel Branch-and-Fix Coordination based matheuristic algorithm for solving large sized multistage stochastic mixed 0–1 problems," European Journal of Operational Research, Elsevier, vol. 258(2), pages 590-606.
    6. Lahrichi, Nadia & Crainic, Teodor Gabriel & Gendreau, Michel & Rei, Walter & Crişan, Gloria Cerasela & Vidal, Thibaut, 2015. "An integrative cooperative search framework for multi-decision-attribute combinatorial optimization: Application to the MDPVRP," European Journal of Operational Research, Elsevier, vol. 246(2), pages 400-412.
    7. He, Junliang & Chang, Daofang & Mi, Weijian & Yan, Wei, 2010. "A hybrid parallel genetic algorithm for yard crane scheduling," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 46(1), pages 136-155, January.
    8. Bernard Gendron & Teodor Gabriel Crainic, 1994. "Parallel Branch-and-Branch Algorithms: Survey and Synthesis," Operations Research, INFORMS, vol. 42(6), pages 1042-1066, December.
    9. Remigijus Paulavičius & Julius Žilinskas, 2009. "Parallel Branch and Bound Algorithm with Combination of Lipschitz Bounds over Multidimensional Simplices for Multicore Computers," Springer Optimization and Its Applications, in: Parallel Scientific Computing and Optimization, pages 93-102, Springer.
    10. Martín Ravetti & Carlos Riveros & Alexandre Mendes & Mauricio Resende & Panos Pardalos, 2012. "Parallel hybrid heuristics for the permutation flow shop problem," Annals of Operations Research, Springer, vol. 199(1), pages 269-284, October.
    11. Hemmelmayr, Vera C., 2015. "Sequential and parallel large neighborhood search algorithms for the periodic location routing problem," European Journal of Operational Research, Elsevier, vol. 243(1), pages 52-60.
    12. Jianhua Qu & Xiyu Liu & Minghe Sun & Feng Qi, 2017. "GPU-Based Parallel Particle Swarm Optimization Methods for Graph Drawing," Discrete Dynamics in Nature and Society, Hindawi, vol. 2017, pages 1-15, July.
    13. Juana L. Redondo & Alfredo Marín & Pilar M. Ortigosa, 2016. "A parallelized Lagrangean relaxation approach for the discrete ordered median problem," Annals of Operations Research, Springer, vol. 246(1), pages 253-272, November.
    14. Jörg Homberger, 2008. "A Parallel Genetic Algorithm for the Multilevel Unconstrained Lot-Sizing Problem," INFORMS Journal on Computing, INFORMS, vol. 20(1), pages 124-132, February.
    15. Dias, Bruno Henriques & Tomim, Marcelo Aroca & Marcato, André Luís Marques & Ramos, Tales Pulinho & Brandi, Rafael Bruno S. & Junior, Ivo Chaves da Silva & Filho, João Alberto Passos, 2013. "Parallel computing applied to the stochastic dynamic programming for long term operation planning of hydrothermal power systems," European Journal of Operational Research, Elsevier, vol. 229(1), pages 212-222.
    16. Unai Aldasoro & Laureano Escudero & María Merino & Juan Monge & Gloria Pérez, 2015. "On parallelization of a stochastic dynamic programming algorithm for solving large-scale mixed 0–1 problems under uncertainty," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 703-742, October.
    17. Chris Groër & Bruce Golden & Edward Wasil, 2011. "A Parallel Algorithm for the Vehicle Routing Problem," INFORMS Journal on Computing, INFORMS, vol. 23(2), pages 315-330, May.
    18. Figueira, J.R. & Liefooghe, A. & Talbi, E.-G. & Wierzbicki, A.P., 2010. "A parallel multiple reference point approach for multi-objective optimization," European Journal of Operational Research, Elsevier, vol. 205(2), pages 390-400, September.
    19. Marco A. Boschetti & Vittorio Maniezzo & Francesco Strappaveccia, 2016. "Using GPU Computing for Solving the Two-Dimensional Guillotine Cutting Problem," INFORMS Journal on Computing, INFORMS, vol. 28(3), pages 540-552, August.
    20. Derbel, Bilel & Humeau, Jérémie & Liefooghe, Arnaud & Verel, Sébastien, 2014. "Distributed localized bi-objective search," European Journal of Operational Research, Elsevier, vol. 239(3), pages 731-743.
    21. Juan F. R. Herrera & José M. G. Salmerón & Eligius M. T. Hendrix & Rafael Asenjo & Leocadio G. Casado, 2017. "On parallel Branch and Bound frameworks for Global Optimization," Journal of Global Optimization, Springer, vol. 69(3), pages 547-560, November.
    22. Vallada, Eva & Ruiz, Rubén, 2009. "Cooperative metaheuristics for the permutation flowshop scheduling problem," European Journal of Operational Research, Elsevier, vol. 193(2), pages 365-376, March.
    23. Eskandarpour, Majid & Zegordi, Seyed Hessameddin & Nikbakhsh, Ehsan, 2013. "A parallel variable neighborhood search for the multi-objective sustainable post-sales network design problem," International Journal of Production Economics, Elsevier, vol. 145(1), pages 117-131.
    24. Abdelhakim AitZai & Mourad Boudhar, 2013. "Parallel branch-and-bound and parallel PSO algorithms for job shop scheduling problem with blocking," International Journal of Operational Research, Inderscience Enterprises Ltd, vol. 16(1), pages 14-37.
    25. Jens Hübner & Martin Schmidt & Marc C. Steinbach, 2017. "A Distributed Interior-Point KKT Solver for Multistage Stochastic Optimization," INFORMS Journal on Computing, INFORMS, vol. 29(4), pages 612-630, November.
    26. Mabrouk, Bchira Ben & Hasni, Hamadi & Mahjoub, Zaher, 2009. "On a parallel genetic-tabu search based algorithm for solving the graph colouring problem," European Journal of Operational Research, Elsevier, vol. 197(3), pages 1192-1201, September.
    27. Jin, Jianyong & Crainic, Teodor Gabriel & Løkketangen, Arne, 2012. "A parallel multi-neighborhood cooperative tabu search for capacitated vehicle routing problems," European Journal of Operational Research, Elsevier, vol. 222(3), pages 441-451.
    28. B Yu & Z-Z Yang & J-X Xie, 2011. "A parallel improved ant colony optimization for multi-depot vehicle routing problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(1), pages 183-188, January.
    29. A. Ferreiro & J. García & J. López-Salas & C. Vázquez, 2013. "An efficient implementation of parallel simulated annealing algorithm in GPUs," Journal of Global Optimization, Springer, vol. 57(3), pages 863-890, November.
    30. Kerkhove, L.-P. & Vanhoucke, M., 2017. "A parallel multi-objective scatter search for optimising incentive contract design in projects," European Journal of Operational Research, Elsevier, vol. 261(3), pages 1066-1084.
    31. Jun Luo & L. Jeff Hong & Barry L. Nelson & Yang Wu, 2015. "Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments," Operations Research, INFORMS, vol. 63(5), pages 1177-1194, October.
    32. Sławomir Bąk & Jacek Błażewicz & Grzegorz Pawlak & Maciej Płaza & Edmund K. Burke & Graham Kendall, 2011. "A Parallel Branch-and-Bound Approach to the Rectangular Guillotine Strip Cutting Problem," INFORMS Journal on Computing, INFORMS, vol. 23(1), pages 15-25, February.
    33. James, Tabitha & Rego, Cesar & Glover, Fred, 2009. "A cooperative parallel tabu search algorithm for the quadratic assignment problem," European Journal of Operational Research, Elsevier, vol. 195(3), pages 810-826, June.
    34. Y. Xu & T. K. Ralphs & L. Ladányi & M. J. Saltzman, 2009. "Computational Experience with a Software Framework for Parallel Integer Programming," INFORMS Journal on Computing, INFORMS, vol. 21(3), pages 383-397, August.
    35. Lei, Deming & Guo, Xiuping, 2015. "A parallel neighborhood search for order acceptance and scheduling in flow shop environment," International Journal of Production Economics, Elsevier, vol. 165(C), pages 12-18.
    36. Richard S. Barr & Betty L. Hickman, 1993. "Feature Article—Reporting Computational Experiments with Parallel Algorithms: Issues, Measures, and Experts' Opinions," INFORMS Journal on Computing, INFORMS, vol. 5(1), pages 2-18, February.
    37. Bäumelt, Zdeněk & Dvořák, Jan & Šůcha, Přemysl & Hanzálek, Zdeněk, 2016. "A novel approach for nurse rerostering based on a parallel algorithm," European Journal of Operational Research, Elsevier, vol. 251(2), pages 624-639.
    38. I.M. Coelho & P.L.A. Munhoz & L.S. Ochi & M.J.F. Souza & C. Bentes & R. Farias, 2016. "An integrated CPU--GPU heuristic inspired on variable neighbourhood search for the single vehicle routing problem with deliveries and selective pickups," International Journal of Production Research, Taylor & Francis Journals, vol. 54(4), pages 945-962, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aldasoro, Unai & Escudero, Laureano F. & Merino, María & Pérez, Gloria, 2017. "A parallel Branch-and-Fix Coordination based matheuristic algorithm for solving large sized multistage stochastic mixed 0–1 problems," European Journal of Operational Research, Elsevier, vol. 258(2), pages 590-606.
    2. Stripinis, Linas & Žilinskas, Julius & Casado, Leocadio G. & Paulavičius, Remigijus, 2021. "On MATLAB experience in accelerating DIRECT-GLce algorithm for constrained global optimization through dynamic data structures and parallelization," Applied Mathematics and Computation, Elsevier, vol. 390(C).
    3. Rommel G. Regis & Christine A. Shoemaker, 2009. "Parallel Stochastic Global Optimization Using Radial Basis Functions," INFORMS Journal on Computing, INFORMS, vol. 21(3), pages 411-426, August.
    4. Escudero, Laureano F. & Monge, Juan F. & Rodríguez-Chía, Antonio M., 2020. "On pricing-based equilibrium for network expansion planning. A multi-period bilevel approach under uncertainty," European Journal of Operational Research, Elsevier, vol. 287(1), pages 262-279.
    5. Vidal, Thibaut & Crainic, Teodor Gabriel & Gendreau, Michel & Prins, Christian, 2013. "Heuristics for multi-attribute vehicle routing problems: A survey and synthesis," European Journal of Operational Research, Elsevier, vol. 231(1), pages 1-21.
    6. Jan Gmys, 2022. "Exactly Solving Hard Permutation Flowshop Scheduling Problems on Peta-Scale GPU-Accelerated Supercomputers," INFORMS Journal on Computing, INFORMS, vol. 34(5), pages 2502-2522, September.
    7. Guido Schryen & Natalia Kliewer & Andreas Fink, 2018. "Call for Papers Issue 1/2020," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 60(5), pages 439-440, October.
    8. Goeke, Dominik, 2019. "Granular tabu search for the pickup and delivery problem with time windows and electric vehicles," European Journal of Operational Research, Elsevier, vol. 278(3), pages 821-836.
    9. Dawei Zhan & Jiachang Qian & Yuansheng Cheng, 2017. "Pseudo expected improvement criterion for parallel EGO algorithm," Journal of Global Optimization, Springer, vol. 68(3), pages 641-662, July.
    10. Hemmelmayr, Vera C., 2015. "Sequential and parallel large neighborhood search algorithms for the periodic location routing problem," European Journal of Operational Research, Elsevier, vol. 243(1), pages 52-60.
    11. Alberto Santini & Michael Schneider & Thibaut Vidal & Daniele Vigo, 2023. "Decomposition Strategies for Vehicle Routing Heuristics," INFORMS Journal on Computing, INFORMS, vol. 35(3), pages 543-559, May.
    12. Guido Schryen & Natalia Kliewer & Andreas Fink, 2020. "High Performance Business Computing," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 62(1), pages 1-3, February.
    13. Cem P. Cetinkaya & Mert Can Gunacti, 2018. "Multi-Criteria Analysis of Water Allocation Scenarios in a Water Scarce Basin," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 32(8), pages 2867-2884, June.
    14. Xiao, Yiyong & Kaku, Ikou & Zhao, Qiuhong & Zhang, Renqian, 2011. "A reduced variable neighborhood search algorithm for uncapacitated multilevel lot-sizing problems," European Journal of Operational Research, Elsevier, vol. 214(2), pages 223-231, October.
    15. Y. Xu & T. K. Ralphs & L. Ladányi & M. J. Saltzman, 2009. "Computational Experience with a Software Framework for Parallel Integer Programming," INFORMS Journal on Computing, INFORMS, vol. 21(3), pages 383-397, August.
    16. Maher, Stephen J., 2021. "Implementing the branch-and-cut approach for a general purpose Benders’ decomposition framework," European Journal of Operational Research, Elsevier, vol. 290(2), pages 479-498.
    17. Xu, Jiuping & Song, Xiaoling & Wu, Yimin & Zeng, Ziqiang, 2015. "GIS-modelling based coal-fired power plant site identification and selection," Applied Energy, Elsevier, vol. 159(C), pages 520-539.
    18. Majid Eskandarpour & Pierre Dejax & Olivier Péton, 2019. "Multi-Directional Local Search for Sustainable Supply Chain Network Design," Post-Print hal-02407741, HAL.
    19. Cristina Ticala & Ioana Zelina & Camelia-M. Pintea, 2020. "Admissible Perturbation of Demicontractive Operators within Ant Algorithms for Medical Images Edge Detection," Mathematics, MDPI, vol. 8(6), pages 1-13, June.
    20. Dumez, Dorian & Lehuédé, Fabien & Péton, Olivier, 2021. "A large neighborhood search approach to the vehicle routing problem with delivery options," Transportation Research Part B: Methodological, Elsevier, vol. 144(C), pages 103-132.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:287:y:2020:i:1:p:1-18. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.