IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v64y2023i6d10.1007_s00362-022-01370-4.html
   My bibliography  Save this article

Sequential design of multi-fidelity computer experiments with effect sparsity

Author

Listed:
  • Hui Chen

    (Nanjing University of Science and Technology)

  • Linhan Ouyang

    (Nanjing University of Aeronautics and Astronautics)

  • Lijun Liu

    (Nanjing University of Science and Technology)

  • Yizhong Ma

    (Nanjing University of Science and Technology)

Abstract

A growing area of focus is using multi-fidelity(MF) simulations to predict the behavior of complex physical systems. In order to adequately utilize the popular sequential designs to improve the effectiveness of the MF method, two challenges involving good projection properties in the presence of effect sparsity and the sample allocation between the high-fidelity(HF) and low-fidelity (LF) codes remain to be addressed. Unfortunately, no systematic study has hitherto been done to deal with these two key issues simultaneously. This article develops a sequential nested design for MF experiments that pays attention to both the space-filling properties in all subsets of factors and the best combination between the two levels of accuracy. For the first issue, we propose a weighted maximum projection criterion combining the uniformity metrics of the HF and LF experiments to select HF points, where the weights are totally data-driven. Note that the obtained HF data is also executed in LF codes to form a nested structure. On the other hand, those samples that only appear in the LF simulation are obtained by the original maximum projection design. The second issue is directly connected with deciding which code to run in the next iteration. We use the entropy theory to score the execution of fidelity for each version, such that the one who has a greater potential to improve the model accuracy will be selected. The performance of the proposed approach is illustrated through several numerical examples. The results demonstrate that the proposed approach outperforms the other three methods in terms of both the prediction accuracy of the final surrogate model and the uniformity in all subspaces of the two codes.

Suggested Citation

  • Hui Chen & Linhan Ouyang & Lijun Liu & Yizhong Ma, 2023. "Sequential design of multi-fidelity computer experiments with effect sparsity," Statistical Papers, Springer, vol. 64(6), pages 2057-2080, December.
  • Handle: RePEc:spr:stpapr:v:64:y:2023:i:6:d:10.1007_s00362-022-01370-4
    DOI: 10.1007/s00362-022-01370-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-022-01370-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00362-022-01370-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Haifeng Xia & Yu Ding & Bani Mallick, 2011. "Bayesian hierarchical model for combining misaligned two-resolution metrology data," IISE Transactions, Taylor & Francis Journals, vol. 43(4), pages 242-258.
    2. V. Roshan Joseph & Evren Gul & Shan Ba, 2015. "Maximum projection designs for computer experiments," Biometrika, Biometrika Trust, vol. 102(2), pages 371-380.
    3. Mostafa Reisi Gahrooei & Kamaran Paynabar & Massimo Pacella & Bianca Maria Colosimo, 2019. "An adaptive fused sampling approach of high-accuracy data in the presence of low-accuracy data," IISE Transactions, Taylor & Francis Journals, vol. 51(11), pages 1251-1264, November.
    4. Mu, Weiyan & Xiong, Shifeng, 2018. "A class of space-filling designs and their projection properties," Statistics & Probability Letters, Elsevier, vol. 141(C), pages 129-134.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Leurent, Martin & Jasserand, Frédéric & Locatelli, Giorgio & Palm, Jenny & Rämä, Miika & Trianni, Andrea, 2017. "Driving forces and obstacles to nuclear cogeneration in Europe: Lessons learnt from Finland," Energy Policy, Elsevier, vol. 107(C), pages 138-150.
    2. Francisco Castillo-Zunino & Pinar Keskinocak, 2021. "Bi-criteria multiple knapsack problem with grouped items," Journal of Heuristics, Springer, vol. 27(5), pages 747-789, October.
    3. Song-Nan Liu & Min-Qian Liu & Jin-Yu Yang, 2023. "Construction of Column-Orthogonal Designs with Two-Dimensional Stratifications," Mathematics, MDPI, vol. 11(6), pages 1-27, March.
    4. Xueru Zhang & Dennis K. J. Lin & Lin Wang, 2023. "Digital Triplet: A Sequential Methodology for Digital Twin Learning," Mathematics, MDPI, vol. 11(12), pages 1-16, June.
    5. Romina Dastoorian & Lee J. Wells, 2023. "A hybrid off-line/on-line quality control approach for real-time monitoring of high-density datasets," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 669-682, February.
    6. Parker, J.D. & Lucas, T.W. & Carlyle, W.M., 2024. "Sequentially extending space-filling experimental designs by optimally permuting and stacking columns of the design matrix," European Journal of Operational Research, Elsevier, vol. 319(2), pages 600-610.
    7. Guo, Hongqiang & Lu, Silong & Hui, Hongzhong & Bao, Chunjiang & Shangguan, Jinyong, 2019. "Receding horizon control-based energy management for plug-in hybrid electric buses using a predictive model of terminal SOC constraint in consideration of stochastic vehicle mass," Energy, Elsevier, vol. 176(C), pages 292-308.
    8. Wang, Chunyan & Lin, Dennis K.J., 2024. "Strong orthogonal Latin hypercubes for computer experiments," Computational Statistics & Data Analysis, Elsevier, vol. 198(C).
    9. Tonghui Pang & Yan Wang & Jian-Feng Yang, 2022. "Asymptotically optimal maximin distance Latin hypercube designs," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(4), pages 405-418, May.
    10. Pengnan Li & Chunjie Wang & Bochuan Jiang, 2025. "Group strong orthogonal arrays and their construction methods," Statistical Papers, Springer, vol. 66(3), pages 1-30, April.
    11. Roy, Pamphile T. & Jofre, Lluís & Jouhaud, Jean-Christophe & Cuenot, Bénédicte, 2020. "Versatile sequential sampling algorithm using Kernel Density Estimation," European Journal of Operational Research, Elsevier, vol. 284(1), pages 201-211.
    12. Weiyan Mu & Chengxin Liu & Shifeng Xiong, 2023. "Nested Maximum Entropy Designs for Computer Experiments," Mathematics, MDPI, vol. 11(16), pages 1-12, August.
    13. Yue Huan & Yubin Tian & Dianpeng Wang, 2022. "A Weighted Surrogate Model for Spatio-Temporal Dynamics with Multiple Time Spans: Applications for the Pollutant Concentration of the Bai River," Mathematics, MDPI, vol. 10(19), pages 1-16, October.
    14. Mu, Weiyan & Xiong, Shifeng, 2018. "A class of space-filling designs and their projection properties," Statistics & Probability Letters, Elsevier, vol. 141(C), pages 129-134.
    15. Guillaume Perrin & Christian Soize, 2020. "Adaptive method for indirect identification of the statistical properties of random fields in a Bayesian framework," Computational Statistics, Springer, vol. 35(1), pages 111-133, March.
    16. Arvind Krishna & Huan Tran & Chaofan Huang & Rampi Ramprasad & V. Roshan Joseph, 2024. "Adaptive Exploration and Optimization of Materials Crystal Structures," INFORMS Joural on Data Science, INFORMS, vol. 3(1), pages 68-83, April.
    17. Liwen Wang & Yongda Wang & Shifeng Xiong & Jiankui Yang, 2025. "Some aspects of nonlinear dimensionality reduction," Computational Statistics, Springer, vol. 40(2), pages 883-906, February.
    18. Mostafa Reisi Gahrooei & Hao Yan & Kamran Paynabar, 2020. "Comments on: On Active Learning Methods for Manifold Data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(1), pages 38-41, March.
    19. Yang You & Guang Jin & Zhengqiang Pan & Rui Guo, 2021. "MP-CE Method for Space-Filling Design in Constrained Space with Multiple Types of Factors," Mathematics, MDPI, vol. 9(24), pages 1-13, December.
    20. Yuxin Sun & Wenjun Liu & Ye Tian, 2024. "Projection-Uniform Subsampling Methods for Big Data," Mathematics, MDPI, vol. 12(19), pages 1-16, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:64:y:2023:i:6:d:10.1007_s00362-022-01370-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.