IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v67y2017i1d10.1007_s10898-015-0376-2.html
   My bibliography  Save this article

Global optimization of general constrained grey-box models: new method and its application to constrained PDEs for pressure swing adsorption

Author

Listed:
  • Fani Boukouvala

    (Texas A&M University
    Texas A&M University)

  • M. M. Faruque Hasan

    (Texas A&M University
    Texas A&M University)

  • Christodoulos A. Floudas

    (Texas A&M University
    Texas A&M University)

Abstract

This paper introduces a novel methodology for the global optimization of general constrained grey-box problems. A grey-box problem may contain a combination of black-box constraints and constraints with a known functional form. The novel features of this work include (i) the selection of initial samples through a subset selection optimization problem from a large number of faster low-fidelity model samples (when a low-fidelity model is available), (ii) the exploration of a diverse set of interpolating and non-interpolating functional forms for representing the objective function and each of the constraints, (iii) the global optimization of the parameter estimation of surrogate functions and the global optimization of the constrained grey-box formulation, and (iv) the updating of variable bounds based on a clustering technique. The performance of the algorithm is presented for a set of case studies representing an expensive non-linear algebraic partial differential equation simulation of a pressure swing adsorption system for $$\hbox {CO}_{2}$$ CO 2 . We address three significant sources of variability and their effects on the consistency and reliability of the algorithm: (i) the initial sampling variability, (ii) the type of surrogate function, and (iii) global versus local optimization of the surrogate function parameter estimation and overall surrogate constrained grey-box problem. It is shown that globally optimizing the parameters in the parameter estimation model, and globally optimizing the constrained grey-box formulation has a significant impact on the performance. The effect of sampling variability is mitigated by a two-stage sampling approach which exploits information from reduced-order models. Finally, the proposed global optimization approach is compared to existing constrained derivative-free optimization algorithms.

Suggested Citation

  • Fani Boukouvala & M. M. Faruque Hasan & Christodoulos A. Floudas, 2017. "Global optimization of general constrained grey-box models: new method and its application to constrained PDEs for pressure swing adsorption," Journal of Global Optimization, Springer, vol. 67(1), pages 3-42, January.
  • Handle: RePEc:spr:jglopt:v:67:y:2017:i:1:d:10.1007_s10898-015-0376-2
    DOI: 10.1007/s10898-015-0376-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-015-0376-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10898-015-0376-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Felipe Viana & Raphael Haftka & Layne Watson, 2013. "Efficient global optimization algorithm assisted by multiple surrogate techniques," Journal of Global Optimization, Springer, vol. 56(2), pages 669-689, June.
    2. Regis, Rommel G. & Shoemaker, Christine A., 2007. "Parallel radial basis function methods for the global optimization of expensive functions," European Journal of Operational Research, Elsevier, vol. 182(2), pages 514-535, October.
    3. Kleijnen, Jack P.C., 2009. "Kriging metamodeling in simulation: A review," European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
    4. Kleijnen, J.P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2008. "Constrained Optimization in Simulation : A Novel Approach," Other publications TiSEM e49ba0fc-853c-4a13-b564-d, Tilburg University, School of Economics and Management.
    5. Rommel Regis & Christine Shoemaker, 2013. "A quasi-multistart framework for global optimization of expensive functions using response surface models," Journal of Global Optimization, Springer, vol. 56(4), pages 1719-1753, August.
    6. Ruth Misener & Christodoulos Floudas, 2014. "ANTIGONE: Algorithms for coNTinuous / Integer Global Optimization of Nonlinear Equations," Journal of Global Optimization, Springer, vol. 59(2), pages 503-526, July.
    7. Rommel G. Regis & Christine A. Shoemaker, 2007. "A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions," INFORMS Journal on Computing, INFORMS, vol. 19(4), pages 497-509, November.
    8. Juliane Müller & Christine Shoemaker, 2014. "Influence of ensemble surrogate models and sampling strategy on the solution quality of algorithms for computationally expensive black-box global optimization problems," Journal of Global Optimization, Springer, vol. 60(2), pages 123-144, October.
    9. Rommel Regis & Christine Shoemaker, 2005. "Constrained Global Optimization of Expensive Black Box Functions Using Radial Basis Functions," Journal of Global Optimization, Springer, vol. 31(1), pages 153-171, January.
    10. Kleijnen, Jack P.C. & Beers, Wim van & Nieuwenhuyse, Inneke van, 2010. "Constrained optimization in expensive simulation: Novel approach," European Journal of Operational Research, Elsevier, vol. 202(1), pages 164-174, April.
    11. Ning Quan & Jun Yin & Szu Ng & Loo Lee, 2013. "Simulation optimization via kriging: a sequential search using expected improvement with computing budget constraints," IISE Transactions, Taylor & Francis Journals, vol. 45(7), pages 763-780.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bukh, A.V. & Kashtanova, S.V. & Shepelev, I.A., 2023. "Complex error minimization algorithm with adaptive change rate," Chaos, Solitons & Fractals, Elsevier, vol. 176(C).
    2. Burcu Beykal & Styliani Avraamidou & Ioannis P. E. Pistikopoulos & Melis Onel & Efstratios N. Pistikopoulos, 2020. "DOMINO: Data-driven Optimization of bi-level Mixed-Integer NOnlinear Problems," Journal of Global Optimization, Springer, vol. 78(1), pages 1-36, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Boukouvala, Fani & Misener, Ruth & Floudas, Christodoulos A., 2016. "Global optimization advances in Mixed-Integer Nonlinear Programming, MINLP, and Constrained Derivative-Free Optimization, CDFO," European Journal of Operational Research, Elsevier, vol. 252(3), pages 701-727.
    2. Juliane Müller & Christine Shoemaker, 2014. "Influence of ensemble surrogate models and sampling strategy on the solution quality of algorithms for computationally expensive black-box global optimization problems," Journal of Global Optimization, Springer, vol. 60(2), pages 123-144, October.
    3. Juliane Müller & Joshua D. Woodbury, 2017. "GOSAC: global optimization with surrogate approximation of constraints," Journal of Global Optimization, Springer, vol. 69(1), pages 117-136, September.
    4. Kleijnen, Jack P.C., 2013. "Simulation-Optimization via Kriging and Bootstrapping : A Survey (Revision of CentER DP 2011-064)," Discussion Paper 2013-064, Tilburg University, Center for Economic Research.
    5. Zhe Zhou & Fusheng Bai, 2018. "An adaptive framework for costly black-box global optimization based on radial basis function interpolation," Journal of Global Optimization, Springer, vol. 70(4), pages 757-781, April.
    6. Taimoor Akhtar & Christine Shoemaker, 2016. "Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection," Journal of Global Optimization, Springer, vol. 64(1), pages 17-32, January.
    7. Tipaluck Krityakierne & Taimoor Akhtar & Christine A. Shoemaker, 2016. "SOP: parallel surrogate global optimization with Pareto center selection for computationally expensive single objective problems," Journal of Global Optimization, Springer, vol. 66(3), pages 417-437, November.
    8. Juliane Müller & Marcus Day, 2019. "Surrogate Optimization of Computationally Expensive Black-Box Problems with Hidden Constraints," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 689-702, October.
    9. Juliane Müller, 2017. "SOCEMO: Surrogate Optimization of Computationally Expensive Multiobjective Problems," INFORMS Journal on Computing, INFORMS, vol. 29(4), pages 581-596, November.
    10. Krityakierne, Tipaluck & Baowan, Duangkamon, 2020. "Aggregated GP-based Optimization for Contaminant Source Localization," Operations Research Perspectives, Elsevier, vol. 7(C).
    11. Strang, Kenneth David, 2012. "Importance of verifying queue model assumptions before planning with simulation software," European Journal of Operational Research, Elsevier, vol. 218(2), pages 493-504.
    12. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.
    13. Zan Yang & Haobo Qiu & Liang Gao & Chen Jiang & Jinhao Zhang, 2019. "Two-layer adaptive surrogate-assisted evolutionary algorithm for high-dimensional computationally expensive problems," Journal of Global Optimization, Springer, vol. 74(2), pages 327-359, June.
    14. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    15. Dawei Zhan & Jiachang Qian & Yuansheng Cheng, 2017. "Pseudo expected improvement criterion for parallel EGO algorithm," Journal of Global Optimization, Springer, vol. 68(3), pages 641-662, July.
    16. M Laguna & J Molina & F Pérez & R Caballero & A G Hernández-Díaz, 2010. "The challenge of optimizing expensive black boxes: a scatter search/rough set theory approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(1), pages 53-67, January.
    17. Andrea Cassioli & Fabio Schoen, 2013. "Global optimization of expensive black box problems with a known lower bound," Journal of Global Optimization, Springer, vol. 57(1), pages 177-190, September.
    18. Zheng, Liang & Xue, Xinfeng & Xu, Chengcheng & Ran, Bin, 2019. "A stochastic simulation-based optimization method for equitable and efficient network-wide signal timing under uncertainties," Transportation Research Part B: Methodological, Elsevier, vol. 122(C), pages 287-308.
    19. Juliane Müller & Christine Shoemaker & Robert Piché, 2014. "SO-I: a surrogate model algorithm for expensive nonlinear integer programming problems including global optimization applications," Journal of Global Optimization, Springer, vol. 59(4), pages 865-889, August.
    20. Kabirian, Alireza & Ólafsson, Sigurdur, 2011. "Continuous optimization via simulation using Golden Region search," European Journal of Operational Research, Elsevier, vol. 208(1), pages 19-27, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:67:y:2017:i:1:d:10.1007_s10898-015-0376-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.