IDEAS home Printed from https://ideas.repec.org/a/inm/orinte/v48y2018i2p130-146.html
   My bibliography  Save this article

Improving U.S. Navy Campaign Analyses with Big Data

Author

Listed:
  • Brian L. Morgan

    (Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Harrison C. Schramm

    (CANA Advisors, Pacific Grove, California 93950)

  • Jerry R. Smith, Jr.

    (Naval Surface Warfare Center, Bethesda, Maryland 20817)

  • Thomas W. Lucas

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Mary L. McDonald

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Paul J. Sánchez

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Susan M. Sanchez

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

  • Stephen C. Upton

    (SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943)

Abstract

Decisions and investments made today determine the assets and capabilities of the U.S. Navy for decades to come. The nation has many options about how best to equip, organize, supply, maintain, train, and employ our naval forces. These decisions involve large sums of money and impact our national security. Navy leadership uses simulation-based campaign analysis to measure risk for these investment options. Campaign simulations, such as the Synthetic Theater Operations Research Model (STORM), are complex models that generate enormous amounts of data. Finding causal threads and consistent trends within campaign analysis is inherently a big data problem. We outline the business and technical approach used to quantify the various investment risks for senior decision makers. Specifically, we present the managerial approach and controls used to generate studies that withstand scrutiny and maintain a strict study timeline. We then describe STORMMiner, a suite of automated postprocessing tools developed to support campaign analysis, and provide illustrative results from a notional STORM training scenario. This new approach has yielded tangible benefits. It substantially reduces the time and cost of campaign analysis studies, reveals insights that were previously difficult for analysts to detect, and improves the testing and vetting of the study. Consequently, the resulting risk assessment and recommendations are more useful to leadership. The managerial approach has also improved cooperation and coordination between the Navy and its analytic partners.

Suggested Citation

  • Brian L. Morgan & Harrison C. Schramm & Jerry R. Smith, Jr. & Thomas W. Lucas & Mary L. McDonald & Paul J. Sánchez & Susan M. Sanchez & Stephen C. Upton, 2018. "Improving U.S. Navy Campaign Analyses with Big Data," Interfaces, INFORMS, vol. 48(2), pages 130-146, April.
  • Handle: RePEc:inm:orinte:v:48:y:2018:i:2:p:130-146
    DOI: 10.1287/inte.2017.0900
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/inte.2017.0900
    Download Restriction: no

    File URL: https://libkey.io/10.1287/inte.2017.0900?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. James S. Hodges, 1991. "Six (Or So) Things You Can Do with a Bad Model," Operations Research, INFORMS, vol. 39(3), pages 355-365, June.
    2. M Kress & I Talmor, 1999. "A new look at the 3:1 rule of combat through Markov Stochastic Lanchester models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(7), pages 733-744, July.
    3. Jack P.C. Kleijnen, 2015. "Design and Analysis of Simulation Experiments," International Series in Operations Research and Management Science, Springer, edition 2, number 978-3-319-18087-8, September.
    4. Thomas W. Lucas & W. David Kelton & Paul J. Sánchez & Susan M. Sanchez & Ben L. Anderson, 2015. "Changing the paradigm: Simulation, now a method of first resort," Naval Research Logistics (NRL), John Wiley & Sons, vol. 62(4), pages 293-303, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Justin L Anderson & Jessica M Astudillo & Zachary E Butcher & Matthew D Cornman & Anthony J Correale & James B Crumpacker & Nathaniel C Dennie & Alex R Gaines & Mark A Gallagher & John C Goodwill & Em, 2023. "Stochastic preemptive goal programming of Air Force weapon systems mix," The Journal of Defense Modeling and Simulation, , vol. 20(2), pages 147-158, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rennen, G. & Husslage, B.G.M. & van Dam, E.R. & den Hertog, D., 2009. "Nested Maximin Latin Hypercube Designs," Discussion Paper 2009-06, Tilburg University, Center for Economic Research.
    2. Hachicha, Wafik & Ammeri, Ahmed & Masmoudi, Faouzi & Chachoub, Habib, 2010. "A comprehensive literature classification of simulation optimisation methods," MPRA Paper 27652, University Library of Munich, Germany.
    3. Ehsan Mehdad & Jack P. C. Kleijnen, 2018. "Efficient global optimisation for black-box simulation via sequential intrinsic Kriging," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 69(11), pages 1725-1737, November.
    4. Dellino, Gabriella & Kleijnen, Jack P.C. & Meloni, Carlo, 2010. "Robust optimization in simulation: Taguchi and Response Surface Methodology," International Journal of Production Economics, Elsevier, vol. 125(1), pages 52-59, May.
    5. Kleijnen, Jack P.C. & Mehdad, E., 2014. "Multivariate Versus Univariate Kriging Metamodels for Multi-Response Simulation Models (Revision of 2012-039)," Discussion Paper 2014-012, Tilburg University, Center for Economic Research.
    6. Matthieu Petelet & Bertrand Iooss & Olivier Asserin & Alexandre Loredo, 2010. "Latin hypercube sampling with inequality constraints," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 94(4), pages 325-339, December.
    7. Wen Shi & Xi Chen & Jennifer Shang, 2019. "An Efficient Morris Method-Based Framework for Simulation Factor Screening," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 745-770, October.
    8. Kleijnen, Jack P.C., 2011. "Ethical issues in engineering models : An operations researcher's reflections," Other publications TiSEM 88caba9e-1d78-47d7-9a0b-b, Tilburg University, School of Economics and Management.
    9. Mustafa Hekimoğlu & Yaman Barlas & Luis Luna-Reyes, 2016. "Sensitivity analysis for models with multiple behavior modes: a method based on behavior pattern measures," System Dynamics Review, System Dynamics Society, vol. 32(3-4), pages 332-362, July.
    10. Tim Voigt & Martin Kohlhase & Oliver Nelles, 2021. "Incremental DoE and Modeling Methodology with Gaussian Process Regression: An Industrially Applicable Approach to Incorporate Expert Knowledge," Mathematics, MDPI, vol. 9(19), pages 1-26, October.
    11. Moallemi, Enayat A. & Elsawah, Sondoss & Ryan, Michael J., 2020. "Robust decision making and Epoch–Era analysis: A comparison of two robustness frameworks for decision-making under uncertainty," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    12. Upham, Paul & Virkamäki, Venla & Kivimaa, Paula & Hildén, Mikael & Wadud, Zia, 2015. "Socio-technical transition governance and public opinion: The case of passenger transport in Finland," Journal of Transport Geography, Elsevier, vol. 46(C), pages 210-219.
    13. Tian, Wei & Song, Jitian & Li, Zhanyong & de Wilde, Pieter, 2014. "Bootstrap techniques for sensitivity analysis and model selection in building thermal performance analysis," Applied Energy, Elsevier, vol. 135(C), pages 320-328.
    14. Sander Hoog, 2019. "Surrogate Modelling in (and of) Agent-Based Models: A Prospectus," Computational Economics, Springer;Society for Computational Economics, vol. 53(3), pages 1245-1263, March.
    15. S Robinson, 2008. "Conceptual modelling for simulation Part I: definition and requirements," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(3), pages 278-290, March.
    16. Kleijnen, J.P.C. & Mehdad, Ehsan, 2015. "Estimating the Variance of the Predictor in Stochastic Kriging," Other publications TiSEM dbbd2fa2-eccf-4f71-be9b-c, Tilburg University, School of Economics and Management.
    17. Zhang, Wei & (Ato) Xu, Wangtu, 2017. "Simulation-based robust optimization for the schedule of single-direction bus transit route: The design of experiment," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 106(C), pages 203-230.
    18. Shi, Wen & Kleijnen, Jack P.C. & Liu, Zhixue, 2014. "Factor screening for simulation with multiple responses: Sequential bifurcation," European Journal of Operational Research, Elsevier, vol. 237(1), pages 136-147.
    19. Kleijnen, Jack P.C., 2009. "Kriging metamodeling in simulation: A review," European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
    20. Shi, Wen & Liu, Zhixue & Shang, Jennifer & Cui, Yujia, 2013. "Multi-criteria robust design of a JIT-based cross-docking distribution center for an auto parts supply chain," European Journal of Operational Research, Elsevier, vol. 229(3), pages 695-706.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orinte:v:48:y:2018:i:2:p:130-146. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.