IDEAS home Printed from https://ideas.repec.org/a/sae/joudef/v18y2021i4p273-284.html

Creating surrogate models for an air and missile defense simulation using design of experiments and neural networks

Author

Listed:
  • Brian M Wade

Abstract

This paper demonstrates a method of constructing multiple linked surrogate models of a high-fidelity air and missile defense simulation using design of experiments to generate labeled data for neural network models. The surrogate models are used to predict the number of incoming missiles destroyed and the number of interceptors launched from a multi-layered defense composed of three different air defense systems intercepting both ballistic and cruise missiles without the need for time intensive simulation runs. A single model that predicts all outcomes was first attempted, but was shown to have inadequate prediction capabilities. The working setup uses multiple surrogate models that are linked to allow information to pass between each model. The paper demonstrates how to develop the surrogate models using a notional example, and how to link these surrogate models together using time to impact for the missiles. The same methodology also allows the same surrogate model to switch between ballistic and cruise missile engagements. When run on a desktop computer, a 30 Monte Carlo set of the notional example took several minutes to complete; however, this proof of principal implementation of the surrogate models was able to predict the mean number missiles destroyed or the mean number of interceptors fired to within one missile nearly instantaneously.

Suggested Citation

  • Brian M Wade, 2021. "Creating surrogate models for an air and missile defense simulation using design of experiments and neural networks," The Journal of Defense Modeling and Simulation, , vol. 18(4), pages 273-284, October.
  • Handle: RePEc:sae:joudef:v:18:y:2021:i:4:p:273-284
    DOI: 10.1177/1548512919877987
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1548512919877987
    Download Restriction: no

    File URL: https://libkey.io/10.1177/1548512919877987?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fasihul M. Alam & Ken R. McNaught & Trevor J. Ringrose, 2006. "An Artificial Neural Network Based Metamodel for Analysing a Stochastic Combat Simulation," International Journal of Enterprise Information Systems (IJEIS), IGI Global Scientific Publishing, vol. 2(4), pages 38-57, October.
    2. Jack P. C. Kleijnen & Susan M. Sanchez & Thomas W. Lucas & Thomas M. Cioppa, 2005. "State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation Experiments," INFORMS Journal on Computing, INFORMS, vol. 17(3), pages 263-289, August.
    3. Fernandes, Jose A. & Irigoien, Xabier & Goikoetxea, Nerea & Lozano, Jose A. & Inza, Iñaki & Pérez, Aritz & Bode, Antonio, 2010. "Fish recruitment prediction, using robust supervised classification methods," Ecological Modelling, Elsevier, vol. 221(2), pages 338-352.
    4. Bornatico, Raffaele & Hüssy, Jonathan & Witzig, Andreas & Guzzella, Lino, 2013. "Surrogate modeling for the fast optimization of energy systems," Energy, Elsevier, vol. 57(C), pages 653-662.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen Shi & Xi Chen & Jennifer Shang, 2019. "An Efficient Morris Method-Based Framework for Simulation Factor Screening," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 745-770, October.
    2. Chiang, Wen-Chyuan & Russell, Robert & Xu, Xiaojing & Zepeda, David, 2009. "A simulation/metaheuristic approach to newspaper production and distribution supply chain problems," International Journal of Production Economics, Elsevier, vol. 121(2), pages 752-767, October.
    3. Wang, Lixiao & Jing, Z.X. & Zheng, J.H. & Wu, Q.H. & Wei, Feng, 2018. "Decentralized optimization of coordinated electrical and thermal generations in hierarchical integrated energy systems considering competitive individuals," Energy, Elsevier, vol. 158(C), pages 607-622.
    4. Shi, Wen & Liu, Zhixue & Shang, Jennifer & Cui, Yujia, 2013. "Multi-criteria robust design of a JIT-based cross-docking distribution center for an auto parts supply chain," European Journal of Operational Research, Elsevier, vol. 229(3), pages 695-706.
    5. Dellino, Gabriella & Kleijnen, Jack P.C. & Meloni, Carlo, 2010. "Robust optimization in simulation: Taguchi and Response Surface Methodology," International Journal of Production Economics, Elsevier, vol. 125(1), pages 52-59, May.
    6. Abokersh, Mohamed Hany & Vallès, Manel & Cabeza, Luisa F. & Boer, Dieter, 2020. "A framework for the optimal integration of solar assisted district heating in different urban sized communities: A robust machine learning approach incorporating global sensitivity analysis," Applied Energy, Elsevier, vol. 267(C).
    7. Liu, Quan & Rioseco, Ernesto Meneses & Weiland, Finn & Huang, Mu & Pärisch, Peter & Ptak, Thomas, 2025. "A surrogate-based computational framework for optimizing thermal strategies in large multi-subsystem borehole heat exchanger sites," Energy, Elsevier, vol. 322(C).
    8. Mert Edali, 2022. "Pattern‐oriented analysis of system dynamics models via random forests," System Dynamics Review, System Dynamics Society, vol. 38(2), pages 135-166, April.
    9. Ahmed Al Amoodi & Elie Azar, 2018. "Impact of Human Actions on Building Energy Performance: A Case Study in the United Arab Emirates (UAE)," Sustainability, MDPI, vol. 10(5), pages 1-19, May.
    10. Perera, A.T.D. & Wickramasinghe, P.U. & Nik, Vahid M. & Scartezzini, Jean-Louis, 2019. "Machine learning methods to assist energy system optimization," Applied Energy, Elsevier, vol. 243(C), pages 191-205.
    11. Jin, Ding & Hedtrich, Johannes & Henning, Christian, 2018. "Applying Meta modeling for extended CGE-modeling: Sample techniques and potential application," Conference papers 332947, Purdue University, Center for Global Trade Analysis, Global Trade Analysis Project.
    12. Cheng Yan & Jianfeng Zhu & Xiuli Shen & Jun Fan & Dong Mi & Zhengming Qian, 2020. "Ensemble of Regression-Type and Interpolation-Type Metamodels," Energies, MDPI, vol. 13(3), pages 1-20, February.
    13. Xin, Yong-Lin & Zhao, Tian & Sun, Qing-Han & Chen, Qun, 2024. "An efficient yet accurate optimization algorithm for thermal systems integrating heat current method and generalized Benders decomposition," Energy, Elsevier, vol. 304(C).
    14. Kleijnen, J.P.C., 2008. "Design of Experiments : An Overview," Discussion Paper 2008-70, Tilburg University, Center for Economic Research.
    15. Du, Han & Zhou, Xinlei & Nord, Natasa & Carden, Yale & Cui, Ping & Ma, Zhenjun, 2025. "Development of a robust data-driven surrogate model to improve energy flexibility of an integrated district heating system with a thermal storage system," Energy, Elsevier, vol. 336(C).
    16. Mert Edali & Gönenç Yücel, 2020. "Analysis of an individual‐based influenza epidemic model using random forest metamodels and adaptive sequential sampling," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(6), pages 936-958, November.
    17. Shi, Wen & Shang, Jennifer & Liu, Zhixue & Zuo, Xiaolu, 2014. "Optimal design of the auto parts supply chain for JIT operations: Sequential bifurcation factor screening and multi-response surface methodology," European Journal of Operational Research, Elsevier, vol. 236(2), pages 664-676.
    18. Ben Ali, M. & D’Amours, S. & Gaudreault, J. & Carle, M-A., 2018. "Configuration and evaluation of an integrated demand management process using a space-filling design and Kriging metamodeling," Operations Research Perspectives, Elsevier, vol. 5(C), pages 45-58.
    19. Kleijnen, J.P.C., 2009. "Sensitivity Analysis of Simulation Models," Discussion Paper 2009-11, Tilburg University, Center for Economic Research.
    20. Kleijnen, J.P.C., 2006. "Regression Models and Experimental Designs : A Tutorial for Simulation Analaysts," Discussion Paper 2006-10, Tilburg University, Center for Economic Research.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:joudef:v:18:y:2021:i:4:p:273-284. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.