IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v51y2003i3p354-370.html
   My bibliography  Save this article

Programmatic Risk Analysis for Critical Engineering Systems Under Tight Resource Constraints

Author

Listed:
  • Robin L. Dillon

    (McDonough School of Business, Georgetown University, Washington, DC 20057)

  • M. Elisabeth Paté-Cornell

    (Department of Management Science and Engineering, Stanford University, Stanford, California 94305)

  • Seth D. Guikema

    (Department of Management Science and Engineering, Stanford University, Stanford, California 94305)

Abstract

Managers of complex engineering development projects face a challenge when deciding how to allocate scarce resources to minimize the risks of project failure. As resource constraints become tighter, balancing these failure risks is more critical, less intuitive, and can benefit from the power of quantitative analysis. This paper describes the Advanced Programmatic Risk Analysis and Management model (APRAM), a decision-support framework for the management of the risk of failures of dependent engineering projects within programs. Our goal is to guide the management of the design, the development, and the budget of dependent projects. Considering first a single project, our approach is to optimize the use of the budget reserves and of the funds dedicated to the system itself for each possible budget allocation. This phase involves separate optimizations of the system design and a strategy for resolving development problems based on a chosen objective function. The model also allows checking that specified thresholds of maximum acceptable risks are met, and if not, indicates how much is required to satisfy them. It is then extended to include project dependencies within a program. Finally, it allows checking that the level of resources available is appropriate by computing the shadow “risk cost” of the budget constraint. The NASA Jet Propulsion Laboratory has supported the development of this model, so each step of APRAM is illustrated by the schematic case of an unmanned space program involving two dependent projects. Also, where applicable, we discuss our experiences working with the APRAM concepts for the management of unmanned space missions.

Suggested Citation

  • Robin L. Dillon & M. Elisabeth Paté-Cornell & Seth D. Guikema, 2003. "Programmatic Risk Analysis for Critical Engineering Systems Under Tight Resource Constraints," Operations Research, INFORMS, vol. 51(3), pages 354-370, June.
    • Handle: RePEc:inm:oropre:v:51:y:2003:i:3:p:354-370
    DOI: 10.1287/opre.51.3.354.14961
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.51.3.354.14961
    Download Restriction: no
    File URL: https://libkey.io/10.1287/opre.51.3.354.14961?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Donald L. Keefer & F. Beckley Smith & Harry B. Back, 1991. "Development and Use of a Modeling System to Aid a Major Oil Company in Allocating Bidding Capital," Operations Research, INFORMS, vol. 39(1), pages 28-41, February.
    2. B. John Garrick, 1984. "Recent Case Studies and Advancements in Probabilistic Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 4(4), pages 267-279, December.
    3. Ralph L. Keeney & Timothy L. McDaniels & Cary Swoveland, 1995. "Evaluating Improvements in Electric Utility Reliability at British Columbia Hydro," Operations Research, INFORMS, vol. 43(6), pages 933-947, December.
    4. Ralph L. Keeney, 1994. "Using Values in Operations Research," Operations Research, INFORMS, vol. 42(5), pages 793-813, October.
    5. James S. Dyer & Ralph F. Miles, 1976. "An Actual Application of Collective Choice Theory to the Selection of Trajectories for the Mariner Jupiter/Saturn 1977 Project," Operations Research, INFORMS, vol. 24(2), pages 220-244, April.
    6. Carl S. Spetzler & Carl-Axel S. Staël Von Holstein, 1975. "Exceptional Paper--Probability Encoding in Decision Analysis," Management Science, INFORMS, vol. 22(3), pages 340-358, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guikema, Seth D., 2009. "Natural disaster risk analysis for critical infrastructure systems: An approach based on statistical learning theory," Reliability Engineering and System Safety, Elsevier, vol. 94(4), pages 855-860.
    2. Russ Garber & Elisabeth Paté‐Cornell, 2012. "Shortcuts in Complex Engineering Systems: A Principal‐Agent Approach to Risk Management," Risk Analysis, John Wiley & Sons, vol. 32(5), pages 836-854, May.
    3. Qian Zhou & James H. Lambert & Christopher W. Karvetski & Jeffrey M. Keisler & Igor Linkov, 2012. "Flood Protection Diversification to Reduce Probabilities of Extreme Losses," Risk Analysis, John Wiley & Sons, vol. 32(11), pages 1873-1887, November.
    4. Emanuele Borgonovo & William Castaings & Stefano Tarantola, 2011. "Moment Independent Importance Measures: New Results and Analytical Test Cases," Risk Analysis, John Wiley & Sons, vol. 31(3), pages 404-428, March.
    5. Emanuele Borgonovo, 2010. "A Methodology for Determining Interactions in Probabilistic Safety Assessment Models by Varying One Parameter at a Time," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 385-399, March.
    6. E. Borgonovo & C. L. Smith, 2011. "A Study of Interactions in the Risk Assessment of Complex Engineering Systems: An Application to Space PSA," Operations Research, INFORMS, vol. 59(6), pages 1461-1476, December.
    7. Cameron A. MacKenzie & Hiba Baroud & Kash Barker, 2016. "Static and dynamic resource allocation models for recovery of interdependent systems: application to the Deepwater Horizon oil spill," Annals of Operations Research, Springer, vol. 236(1), pages 103-129, January.
    8. Daniel Suarez & Camilo Gomez & Andrés L. Medaglia & Raha Akhavan-Tabatabaei & Sthefania Grajales, 2024. "Integrated Decision Support for Disaster Risk Management: Aiding Preparedness and Response Decisions in Wildfire Management," Information Systems Research, INFORMS, vol. 35(2), pages 609-628, June.
    9. Jesus Palomo & David Rios Insua & Fabrizio Ruggeri, 2007. "Modeling External Risks in Project Management," Risk Analysis, John Wiley & Sons, vol. 27(4), pages 961-978, August.
    10. Dadsena, Krishna Kumar & Sarmah, S.P. & Naikan, V.N.A. & Jena, Sarat Kumar, 2019. "Optimal budget allocation for risk mitigation strategy in trucking industry: An integrated approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 121(C), pages 37-55.
    11. Cameron MacKenzie & Hiba Baroud & Kash Barker, 2016. "Static and dynamic resource allocation models for recovery of interdependent systems: application to the Deepwater Horizon oil spill," Annals of Operations Research, Springer, vol. 236(1), pages 103-129, January.
    12. Robin L. Dillon & M. Elisabeth Paté‐Cornell, 2005. "Including technical and security risks in the management of information systems: A programmatic risk management model," Systems Engineering, John Wiley & Sons, vol. 8(1), pages 15-28.
    13. Hanif D. Sherali & Evrim Dalkiran & Theodore S. Glickman, 2011. "Selecting Optimal Alternatives and Risk Reduction Strategies in Decision Trees," Operations Research, INFORMS, vol. 59(3), pages 631-647, June.
    14. Dean A. Shepherd & Melissa S. Cardon, 2009. "Negative Emotional Reactions to Project Failure and the Self‐Compassion to Learn from the Experience," Journal of Management Studies, Wiley Blackwell, vol. 46(6), pages 923-949, September.
    15. D. K. Choudhury, 2019. "Standard Critical Path and Selection of Most Economic and Quality Contractors for Construction of Thermal Power Plant: A Case Study in NTPC," Metamorphosis: A Journal of Management Research, , vol. 18(2), pages 103-118, December.
    16. Emanuele Borgonovo & Alessandra Cillo, 2017. "Deciding with Thresholds: Importance Measures and Value of Information," Risk Analysis, John Wiley & Sons, vol. 37(10), pages 1828-1848, October.
    17. Michael Felix Pacevicius & Marilia Ramos & Davide Roverso & Christian Thun Eriksen & Nicola Paltrinieri, 2022. "Managing Heterogeneous Datasets for Dynamic Risk Analysis of Large-Scale Infrastructures," Energies, MDPI, vol. 15(9), pages 1-40, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Donald L. Keefer & Craig W. Kirkwood & James L. Corner, 2004. "Perspective on Decision Analysis Applications, 1990–2001," Decision Analysis, INFORMS, vol. 1(1), pages 4-22, March.
    2. Thomas W. Keelin & Bradford W. Powley, 2011. "Quantile-Parameterized Distributions," Decision Analysis, INFORMS, vol. 8(3), pages 206-219, September.
    3. Simone Cerroni & Sandra Notaro & W. Douglass Shaw, 2011. "Do Monetary Incentives and Chained Questions Affect the Validity of Risk Estimates Elicited via the Exchangeability Method? An Experimental Investigation," Department of Economics Working Papers 1110, Department of Economics, University of Trento, Italia.
    4. Kleijnen, J.P.C., 1978. "Economic framework for information systems," Other publications TiSEM 45d15745-54b7-49ee-8b4e-d, Tilburg University, School of Economics and Management.
    5. Hiba Baroud & Jose E. Ramirez‐Marquez & Kash Barker & Claudio M. Rocco, 2014. "Stochastic Measures of Network Resilience: Applications to Waterway Commodity Flows," Risk Analysis, John Wiley & Sons, vol. 34(7), pages 1317-1335, July.
    6. Camerer, Colin & Weber, Martin, 1992. "Recent Developments in Modeling Preferences: Uncertainty and Ambiguity," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 325-370, October.
    7. M Tavana & M A Sodenkamp, 2010. "A fuzzy multi-criteria decision analysis model for advanced technology assessment at Kennedy Space Center," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(10), pages 1459-1470, October.
    8. Dimitrios Gouglas & Kendall Hoyt & Elizabeth Peacocke & Aristidis Kaloudis & Trygve Ottersen & John-Arne Røttingen, 2019. "Setting Strategic Objectives for the Coalition for Epidemic Preparedness Innovations: An Exploratory Decision Analysis Process," Service Science, INFORMS, vol. 49(6), pages 430-446, November.
    9. Jason R. W. Merrick & J. Rene van Dorp & Jack Harrald & Thomas Mazzuchi & John E. Spahn & Martha Grabowski, 2000. "A systems approach to managing oil transportation risk in Prince William Sound," Systems Engineering, John Wiley & Sons, vol. 3(3), pages 128-142.
    10. Ormerod, Richard J. & Ulrich, Werner, 2013. "Operational research and ethics: A literature review," European Journal of Operational Research, Elsevier, vol. 228(2), pages 291-307.
    11. Anil Gaba & W. Kip Viscusi, 1998. "Differences in Subjective Risk Thresholds: Worker Groups as an Example," Management Science, INFORMS, vol. 44(6), pages 801-811, June.
    12. Melvin Novick, 1980. "Statistics as psychometrics," Psychometrika, Springer;The Psychometric Society, vol. 45(4), pages 411-424, December.
    13. Salo, Ahti A., 1995. "Interactive decision aiding for group decision support," European Journal of Operational Research, Elsevier, vol. 84(1), pages 134-149, July.
    14. Petersen, Elizabeth H. & Fraser, Rob W., 2000. "Grower perceptions of the impact of protein premiums and discounts for wheat," 2000 Conference (44th), January 23-25, 2000, Sydney, Australia 123725, Australian Agricultural and Resource Economics Society.
    15. Peter Kurrild-Klitgaard, 2014. "Empirical social choice: an introduction," Public Choice, Springer, vol. 158(3), pages 297-310, March.
    16. Fan Liu & Ning Ma, 2019. "Multicriteria ABC Inventory Classification Using the Social Choice Theory," Sustainability, MDPI, vol. 12(1), pages 1-19, December.
    17. Insua, Insua Rios & Rios, Jesus & Banks, David, 2009. "Adversarial Risk Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 841-854.
    18. Keeney, Ralph L., 1996. "Value-focused thinking: Identifying decision opportunities and creating alternatives," European Journal of Operational Research, Elsevier, vol. 92(3), pages 537-549, August.
    19. Aven, Terje, 2020. "Three influential risk foundation papers from the 80s and 90s: Are they still state-of-the-art?," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    20. Baker, Erin & Keisler, Jeffrey M., 2011. "Cellulosic biofuels: Expert views on prospects for advancement," Energy, Elsevier, vol. 36(1), pages 595-605.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:51:y:2003:i:3:p:354-370. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.