IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v81y2021i1d10.1007_s10898-020-00912-0.html
   My bibliography  Save this article

Surrogate optimization of deep neural networks for groundwater predictions

Author

Listed:
  • Juliane Müller

    (Lawrence Berkeley National Laboratory)

  • Jangho Park

    (Lawrence Berkeley National Laboratory)

  • Reetik Sahu

    (Lawrence Berkeley National Laboratory)

  • Charuleka Varadharajan

    (Lawrence Berkeley National Laboratory)

  • Bhavna Arora

    (Lawrence Berkeley National Laboratory)

  • Boris Faybishenko

    (Lawrence Berkeley National Laboratory)

  • Deborah Agarwal

    (Lawrence Berkeley National Laboratory)

Abstract

Sustainable management of groundwater resources under changing climatic conditions require an application of reliable and accurate predictions of groundwater levels. Mechanistic multi-scale, multi-physics simulation models are often too hard to use for this purpose, especially for groundwater managers who do not have access to the complex compute resources and data. Therefore, we analyzed the applicability and performance of four modern deep learning computational models for predictions of groundwater levels. We compare three methods for optimizing the models’ hyperparameters, including two surrogate model-based algorithms and a random sampling method. The models were tested using predictions of the groundwater level in Butte County, California, USA, taking into account the temporal variability of streamflow, precipitation, and ambient temperature. Our numerical study shows that the optimization of the hyperparameters can lead to reasonably accurate performance of all models (root mean squared errors of groundwater predictions of 2 meters or less), but the “simplest” network, namely a multilayer perceptron (MLP) performs overall better for learning and predicting groundwater data than the more advanced long short-term memory or convolutional neural networks in terms of prediction accuracy and time-to-solution, making the MLP a suitable candidate for groundwater prediction.

Suggested Citation

  • Juliane Müller & Jangho Park & Reetik Sahu & Charuleka Varadharajan & Bhavna Arora & Boris Faybishenko & Deborah Agarwal, 2021. "Surrogate optimization of deep neural networks for groundwater predictions," Journal of Global Optimization, Springer, vol. 81(1), pages 203-231, September.
  • Handle: RePEc:spr:jglopt:v:81:y:2021:i:1:d:10.1007_s10898-020-00912-0
    DOI: 10.1007/s10898-020-00912-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-020-00912-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10898-020-00912-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Regis, Rommel G. & Shoemaker, Christine A., 2007. "Parallel radial basis function methods for the global optimization of expensive functions," European Journal of Operational Research, Elsevier, vol. 182(2), pages 514-535, October.
    2. Juliane Müller & Marcus Day, 2019. "Surrogate Optimization of Computationally Expensive Black-Box Problems with Hidden Constraints," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 689-702, October.
    3. Rommel G. Regis & Christine A. Shoemaker, 2007. "A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions," INFORMS Journal on Computing, INFORMS, vol. 19(4), pages 497-509, November.
    4. Audet, Charles & Savard, Gilles & Zghal, Walid, 2010. "A mesh adaptive direct search algorithm for multiobjective optimization," European Journal of Operational Research, Elsevier, vol. 204(3), pages 545-556, August.
    5. Juliane Müller & Joshua D. Woodbury, 2017. "GOSAC: global optimization with surrogate approximation of constraints," Journal of Global Optimization, Springer, vol. 69(1), pages 117-136, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Laurens Bliek, 2022. "A Survey on Sustainable Surrogate-Based Optimisation," Sustainability, MDPI, vol. 14(7), pages 1-19, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Belmiro P. M. Duarte & Anthony C. Atkinson & Satya P. Singh & Marco S. Reis, 2023. "Optimal design of experiments for hypothesis testing on ordered treatments via intersection-union tests," Statistical Papers, Springer, vol. 64(2), pages 587-615, April.
    2. Wenyu Wang & Christine A. Shoemaker, 2023. "Reference Vector Assisted Candidate Search with Aggregated Surrogate for Computationally Expensive Many Objective Optimization Problems," INFORMS Journal on Computing, INFORMS, vol. 35(2), pages 318-334, March.
    3. Juliane Müller & Marcus Day, 2019. "Surrogate Optimization of Computationally Expensive Black-Box Problems with Hidden Constraints," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 689-702, October.
    4. Juliane Müller, 2017. "SOCEMO: Surrogate Optimization of Computationally Expensive Multiobjective Problems," INFORMS Journal on Computing, INFORMS, vol. 29(4), pages 581-596, November.
    5. Juliane Müller & Christine Shoemaker & Robert Piché, 2014. "SO-I: a surrogate model algorithm for expensive nonlinear integer programming problems including global optimization applications," Journal of Global Optimization, Springer, vol. 59(4), pages 865-889, August.
    6. Zhe Zhou & Fusheng Bai, 2018. "An adaptive framework for costly black-box global optimization based on radial basis function interpolation," Journal of Global Optimization, Springer, vol. 70(4), pages 757-781, April.
    7. Liu, Haoxiang & Wang, David Z.W., 2017. "Locating multiple types of charging facilities for battery electric vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 103(C), pages 30-55.
    8. Taimoor Akhtar & Christine Shoemaker, 2016. "Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection," Journal of Global Optimization, Springer, vol. 64(1), pages 17-32, January.
    9. Liu, Haoxiang & Szeto, W.Y. & Long, Jiancheng, 2019. "Bike network design problem with a path-size logit-based equilibrium constraint: Formulation, global optimization, and matheuristic," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 127(C), pages 284-307.
    10. Krityakierne, Tipaluck & Baowan, Duangkamon, 2020. "Aggregated GP-based Optimization for Contaminant Source Localization," Operations Research Perspectives, Elsevier, vol. 7(C).
    11. Logan Mathesen & Giulia Pedrielli & Szu Hui Ng & Zelda B. Zabinsky, 2021. "Stochastic optimization with adaptive restart: a framework for integrated local and global learning," Journal of Global Optimization, Springer, vol. 79(1), pages 87-110, January.
    12. Richard T. Lyons & Richard C. Peralta & Partha Majumder, 2020. "Comparing Single-Objective Optimization Protocols for Calibrating the Birds Nest Aquifer Model—A Problem Having Multiple Local Optima," IJERPH, MDPI, vol. 17(3), pages 1-10, January.
    13. Duarte, Belmiro P.M. & Atkinson, Anthony C. & P. Singh, Satya & S. Reis, Marco, 2023. "Optimal design of experiments for hypothesis testing on ordered treatments via intersection-union tests," LSE Research Online Documents on Economics 115187, London School of Economics and Political Science, LSE Library.
    14. Juliane Müller & Christine Shoemaker, 2014. "Influence of ensemble surrogate models and sampling strategy on the solution quality of algorithms for computationally expensive black-box global optimization problems," Journal of Global Optimization, Springer, vol. 60(2), pages 123-144, October.
    15. Chen, Mingjie & Tompson, Andrew F.B. & Mellors, Robert J. & Abdalla, Osman, 2015. "An efficient optimization of well placement and control for a geothermal prospect under geological uncertainty," Applied Energy, Elsevier, vol. 137(C), pages 352-363.
    16. Juliane Müller & Joshua D. Woodbury, 2017. "GOSAC: global optimization with surrogate approximation of constraints," Journal of Global Optimization, Springer, vol. 69(1), pages 117-136, September.
    17. Charles Audet & Edward Hallé-Hannan & Sébastien Le Digabel, 2023. "A General Mathematical Framework for Constrained Mixed-variable Blackbox Optimization Problems with Meta and Categorical Variables," SN Operations Research Forum, Springer, vol. 4(1), pages 1-37, March.
    18. Siem, A.Y.D. & den Hertog, D., 2007. "Kriging Models That Are Robust With Respect to Simulation Errors," Other publications TiSEM fe73dc8b-20d6-4f50-95eb-f, Tilburg University, School of Economics and Management.
    19. Hau T. Mai & Jaewook Lee & Joowon Kang & H. Nguyen-Xuan & Jaehong Lee, 2022. "An Improved Blind Kriging Surrogate Model for Design Optimization Problems," Mathematics, MDPI, vol. 10(16), pages 1-19, August.
    20. Chow, Joseph Y.J. & Regan, Amelia C., 2011. "Network-based real option models," Transportation Research Part B: Methodological, Elsevier, vol. 45(4), pages 682-695, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:81:y:2021:i:1:d:10.1007_s10898-020-00912-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.