IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v39y2019i9p1899-1912.html

Assessing Engineering Resilience for Systems with Multiple Performance Measures

Author

Listed:
  • Eric Specking
  • Bobby Cottam
  • Gregory Parnell
  • Edward Pohl
  • Matthew Cilli
  • Randy Buchanan
  • Zephan Wade
  • Colin Small

Abstract

Recently, efforts to model and assess a system's resilience to disruptions due to environmental and adversarial threats have increased substantially. Researchers have investigated resilience in many disciplines, including sociology, psychology, computer networks, and engineering systems, to name a few. When assessing engineering system resilience, the resilience assessment typically considers a single performance measure, a disruption, a loss of performance, the time required to recover, or a combination of these elements. We define and use a resilient engineered system definition that separates system resilience into platform and mission resilience. Most complex systems have multiple performance measures; this research proposes using multiple objective decision analysis to assess system resilience for systems with multiple performance measures using two distinct methods. The first method quantifies platform resilience and includes resilience and other “ilities” directly in the value hierarchy, while the second method quantifies mission resilience and uses the “ilities” in the calculation of the expected mission performance for every performance measure in the value hierarchy. We illustrate the mission resilience method using a transportation systems‐of‐systems network with varying levels of resilience due to the level of connectivity and autonomy of the vehicles and platform resilience by using a notional military example. Our analysis found that it is necessary to quantify performance in context with specific mission(s) and scenario(s) under specific threat(s) and then use modeling and simulation to help determine the resilience of a system for a given set of conditions. The example demonstrates how incorporating system mission resilience can improve performance for some performance measures while negatively affecting others.

Suggested Citation

  • Eric Specking & Bobby Cottam & Gregory Parnell & Edward Pohl & Matthew Cilli & Randy Buchanan & Zephan Wade & Colin Small, 2019. "Assessing Engineering Resilience for Systems with Multiple Performance Measures," Risk Analysis, John Wiley & Sons, vol. 39(9), pages 1899-1912, September.
  • Handle: RePEc:wly:riskan:v:39:y:2019:i:9:p:1899-1912
    DOI: 10.1111/risa.13395
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/risa.13395
    Download Restriction: no

    File URL: https://libkey.io/10.1111/risa.13395?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Erin T. Ryan & David R. Jacques & John M. Colombi, 2013. "An ontological framework for clarifying flexibility‐related terminology via literature survey," Systems Engineering, John Wiley & Sons, vol. 16(1), pages 99-110, March.
    2. Hosseini, Seyedmohsen & Barker, Kash & Ramirez-Marquez, Jose E., 2016. "A review of definitions and measures of system resilience," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 47-61.
    3. Horia-Nicolai L. Teodorescu, 2015. "Defining resilience using probabilistic event trees," Environment Systems and Decisions, Springer, vol. 35(2), pages 279-290, June.
    4. Henry, Devanandham & Emmanuel Ramirez-Marquez, Jose, 2012. "Generic metrics and quantitative approaches for system resilience as a function of time," Reliability Engineering and System Safety, Elsevier, vol. 99(C), pages 114-122.
    5. Sabrina Larkin & Cate Fox-Lent & Daniel A. Eisenberg & Benjamin D. Trump & Sean Wallace & Colin Chadderton & Igor Linkov, 2015. "Benchmarking agency and organizational practices in resilience decision making," Environment Systems and Decisions, Springer, vol. 35(2), pages 185-195, June.
    6. Bilal M. Ayyub, 2014. "Systems Resilience for Multihazard Environments: Definition, Metrics, and Valuation for Decision Making," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 340-355, February.
    7. Igor Linkov & Sabrina Larkin & James H. Lambert, 2015. "Concepts and approaches to resilience in a variety of governance and regulatory domains," Environment Systems and Decisions, Springer, vol. 35(2), pages 183-184, June.
    8. Yacov Y. Haimes, 2009. "On the Definition of Resilience in Systems," Risk Analysis, John Wiley & Sons, vol. 29(4), pages 498-501, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jesse M. Keenan & Benjamin D. Trump & William Hynes & Igor Linkov, 2021. "Exploring the Convergence of Resilience Processes and Sustainable Outcomes in Post-COVID, Post-Glasgow Economies," Sustainability, MDPI, vol. 13(23), pages 1-12, December.
    2. Geng, Sunyue & Yang, Ming & Mitici, Mihaela & Liu, Sifeng, 2023. "A resilience assessment framework for complex engineered systems using graphical evaluation and review technique (GERT)," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    3. S. E. Galaitsi & Jeffrey M. Keisler & Benjamin D. Trump & Igor Linkov, 2021. "The Need to Reconcile Concepts that Characterize Systems Facing Threats," Risk Analysis, John Wiley & Sons, vol. 41(1), pages 3-15, January.
    4. Adel Mottahedi & Farhang Sereshki & Mohammad Ataei & Ali Nouri Qarahasanlou & Abbas Barabadi, 2021. "The Resilience of Critical Infrastructure Systems: A Systematic Literature Review," Energies, MDPI, vol. 14(6), pages 1-32, March.
    5. Cai, Baoping & Zhang, Yanping & Wang, Haifeng & Liu, Yonghong & Ji, Renjie & Gao, Chuntan & Kong, Xiangdi & Liu, Jing, 2021. "Resilience evaluation methodology of engineering systems with dynamic-Bayesian-network-based degradation and maintenance," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    6. Nicholas Shallcross & Gregory S. Parnell & Ed Pohl & Eric Specking, 2020. "Set‐based design: The state‐of‐practice and research opportunities," Systems Engineering, John Wiley & Sons, vol. 23(5), pages 557-578, September.
    7. Yu, Yaocheng & Shuai, Bin & Huang, Wencheng, 2024. "Resilience evaluation of train control on-board system based on multi-dimensional continuous-time Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 246(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mottahedi, Adel & Sereshki, Farhang & Ataei, Mohammad & Qarahasanlou, Ali Nouri & Barabadi, Abbas, 2021. "Resilience estimation of critical infrastructure systems: Application of expert judgment," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    2. Liu, Xing & Fang, Yi-Ping & Zio, Enrico, 2021. "A Hierarchical Resilience Enhancement Framework for Interdependent Critical Infrastructures," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    3. Adel Mottahedi & Farhang Sereshki & Mohammad Ataei & Ali Nouri Qarahasanlou & Abbas Barabadi, 2021. "The Resilience of Critical Infrastructure Systems: A Systematic Literature Review," Energies, MDPI, vol. 14(6), pages 1-32, March.
    4. Payuna Uday & Karen Marais, 2015. "Designing Resilient Systems‐of‐Systems: A Survey of Metrics, Methods, and Challenges," Systems Engineering, John Wiley & Sons, vol. 18(5), pages 491-510, October.
    5. Uday, Payuna & Chandrahasa, Rakshit & Marais, Karen, 2019. "System Importance Measures: Definitions and Application to System-of-Systems Analysis," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    6. Jesse M. Keenan, 2018. "Regional resilience trust funds: an exploratory analysis for leveraging insurance surcharges," Environment Systems and Decisions, Springer, vol. 38(1), pages 118-139, March.
    7. MacKenzie, Cameron A. & Hu, Chao, 2019. "Decision making under uncertainty for design of resilient engineered systems," Reliability Engineering and System Safety, Elsevier, vol. 192(C).
    8. Dui, Hongyan & Liu, Meng & Song, Jiaying & Wu, Shaomin, 2023. "Importance measure-based resilience management: Review, methodology and perspectives on maintenance," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    9. Das, Laya & Munikoti, Sai & Natarajan, Balasubramaniam & Srinivasan, Babji, 2020. "Measuring smart grid resilience: Methods, challenges and opportunities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    10. Cassottana, Beatrice & Shen, Lijuan & Tang, Loon Ching, 2019. "Modeling the recovery process: A key dimension of resilience," Reliability Engineering and System Safety, Elsevier, vol. 190(C), pages 1-1.
    11. Hossain, Niamat Ullah Ibne & Jaradat, Raed & Hosseini, Seyedmohsen & Marufuzzaman, Mohammad & Buchanan, Randy K., 2019. "A framework for modeling and assessing system resilience using a Bayesian network: A case study of an interdependent electrical infrastructure system," International Journal of Critical Infrastructure Protection, Elsevier, vol. 25(C), pages 62-83.
    12. Mohammad Najarian & Gino J. Lim, 2019. "Design and Assessment Methodology for System Resilience Metrics," Risk Analysis, John Wiley & Sons, vol. 39(9), pages 1885-1898, September.
    13. Shital A. Thekdi & Joost Santos, 2019. "Decision‐Making Analytics Using Plural Resilience Parameters for Adaptive Management of Complex Systems," Risk Analysis, John Wiley & Sons, vol. 39(4), pages 871-889, April.
    14. Varajão, João & Fernandes, Gabriela & Amaral, António & Gonçalves, A. Manuela, 2021. "Team Resilience Model: An Empirical Examination of Information Systems Projects," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    15. Charani Shandiz, Saeid & Foliente, Greg & Rismanchi, Behzad & Wachtel, Amanda & Jeffers, Robert F., 2020. "Resilience framework and metrics for energy master planning of communities," Energy, Elsevier, vol. 203(C).
    16. Chatterjee, Abheek & Layton, Astrid, 2020. "Mimicking nature for resilient resource and infrastructure network design," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    17. Zhu, Chunli & Wu, Jianping & Liu, Mingyu & Luan, Jianlin & Li, Tingting & Hu, Kezhen, 2020. "Cyber-physical resilience modelling and assessment of urban roadway system interrupted by rainfall," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    18. Adrian J. Hickford & Simon P. Blainey & Alejandro Ortega Hortelano & Raghav Pant, 2018. "Resilience engineering: theory and practice in interdependent infrastructure systems," Environment Systems and Decisions, Springer, vol. 38(3), pages 278-291, September.
    19. Zeng, Zhiguo & Fang, Yi-Ping & Zhai, Qingqing & Du, Shijia, 2021. "A Markov reward process-based framework for resilience analysis of multistate energy systems under the threat of extreme events," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    20. Poulin, Craig & Kane, Michael B., 2021. "Infrastructure resilience curves: Performance measures and summary metrics," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:39:y:2019:i:9:p:1899-1912. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.