IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v38y2018i1p99-117.html
   My bibliography  Save this article

How to Design Rating Schemes of Risk Matrices: A Sequential Updating Approach

Author

Listed:
  • Jianping Li
  • Chunbing Bao
  • Dengsheng Wu

Abstract

Risk matrices have been widely used as a risk evaluation tool in many fields due to their simplicity and intuitive nature. Designing a rating scheme, i.e., determining the number of ratings used in a risk matrix and assigning different ratings to different cells, is an essential part of risk matrix construction. However, most of the related literature has focused on applying a risk matrix to various fields, instead of researching how to design risk matrices. Based on the analysis of several current rules, we propose a new approach, namely, the sequential updating approach (SUA), to design the rating scheme of a risk matrix in a reliable way. In this article, we propose three principles and a rating algorithm based on these principles. The three principles, namely, adjusted weak consistency, consistent internality, and continuous screening, characterize a good rating scheme. The resulting rating scheme has been proven to be unique. A global rating algorithm is then proposed to create the design that satisfies the three principles. We then explore the performance of the SUA. An illustrative application is first given to explain the feasibility of our approach. The sensitivity analysis shows that our method captures a resolution‐reliability tradeoff for decisionmakers in choosing an appropriate rating scheme for a risk matrix. Finally, we compare the designs based on the SUA and Cox's axioms, highlighting the advantages of the SUA.

Suggested Citation

  • Jianping Li & Chunbing Bao & Dengsheng Wu, 2018. "How to Design Rating Schemes of Risk Matrices: A Sequential Updating Approach," Risk Analysis, John Wiley & Sons, vol. 38(1), pages 99-117, January.
  • Handle: RePEc:wly:riskan:v:38:y:2018:i:1:p:99-117
    DOI: 10.1111/risa.12810
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/risa.12810
    Download Restriction: no

    File URL: https://libkey.io/10.1111/risa.12810?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Johnson Holt & Adrian W. Leach & Gritta Schrader & Françoise Petter & Alan MacLeod & Dirk Jan van der Gaag & Richard H. A. Baker & John D. Mumford, 2014. "Eliciting and Combining Decision Criteria Using a Limited Palette of Utility Functions and Uncertainty Distributions: Illustrated by Application to Pest Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 34(1), pages 4-16, January.
    2. E.S. Levine, 2012. "Improving risk matrices: the advantages of logarithmically scaled axes," Journal of Risk Research, Taylor & Francis Journals, vol. 15(2), pages 209-222, February.
    3. Eric D. Smith & William T. Siefert & David Drain, 2009. "Risk matrix input data biases," Systems Engineering, John Wiley & Sons, vol. 12(4), pages 344-360, December.
    4. Xin Ruan & Zhiyi Yin & Dan M. Frangopol, 2015. "Risk Matrix Integrating Risk Attitudes Based on Utility Theory," Risk Analysis, John Wiley & Sons, vol. 35(8), pages 1437-1447, August.
    5. Louis Anthony (Tony)Cox, 2008. "What's Wrong with Risk Matrices?," Risk Analysis, John Wiley & Sons, vol. 28(2), pages 497-512, April.
    6. Cameron A. MacKenzie, 2014. "Summarizing Risk Using Risk Measures and Risk Indices," Risk Analysis, John Wiley & Sons, vol. 34(12), pages 2143-2162, December.
    7. David J. Ball & John Watt, 2013. "Further Thoughts on the Utility of Risk Matrices," Risk Analysis, John Wiley & Sons, vol. 33(11), pages 2068-2078, November.
    8. Tim Bedford, 2013. "Decision Making for Group Risk Reduction: Dealing with Epistemic Uncertainty," Risk Analysis, John Wiley & Sons, vol. 33(10), pages 1884-1898, October.
    9. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    10. Louis Iverson & Stephen Matthews & Anantha Prasad & Matthew Peters & Gary Yohe, 2012. "Development of risk matrices for evaluating climatic change responses of forested habitats," Climatic Change, Springer, vol. 114(2), pages 231-243, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Karar, Ahmed Noaman & Labib, Ashraf & Jones, Dylan, 2024. "A resilience-based maintenance optimisation framework using multiple criteria and Knapsack methods," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    2. F. Acebes & J. M. González-Varona & A. López-Paredes & J. Pajares, 2024. "Beyond probability-impact matrices in project risk management: A quantitative methodology for risk prioritisation," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    3. Dengsheng Wu & Xiaoqian Zhu & Jie Wan & Chunbing Bao & Jianping Li, 2019. "A Multiobjective Optimization Approach for Selecting Risk Response Strategies of Software Project: From the Perspective of Risk Correlations," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(01), pages 339-364, January.
    4. Wei, Lu & Jing, Haozhe & Huang, Jie & Deng, Yuqi & Jing, Zhongbo, 2023. "Do textual risk disclosures reveal corporate risk? Evidence from U.S. fintech corporations," Economic Modelling, Elsevier, vol. 127(C).
    5. Žužek Tena & Rihar Lidija & Berlec Tomaž & Kušar Janez, 2020. "Standard Project Risk Analysis Approach," Business Systems Research, Sciendo, vol. 11(2), pages 149-158, October.
    6. Hasibuan, Abdul Muis & Gregg, Daniel & Stringer, Randy, 2020. "Accounting for diverse risk attitudes in measures of risk perceptions: A case study of climate change risk for small-scale citrus farmers in Indonesia," Land Use Policy, Elsevier, vol. 95(C).
    7. Alex de Lima Teodoro da Penha & Samuel Vinícius Bonato & Joana Baleeiro Passos & Eduardo da Silva Fernandes & Cínthia Kulpa & Carla Schwengber ten Caten, 2024. "Navigating the Urgency: An Open Innovation Project of Protective Equipment Development from a Quadruple Helix Perspective," Sustainability, MDPI, vol. 16(4), pages 1-32, February.
    8. Vicki Bier, 2020. "The Role of Decision Analysis in Risk Analysis: A Retrospective," Risk Analysis, John Wiley & Sons, vol. 40(S1), pages 2207-2217, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vicki Bier, 2020. "The Role of Decision Analysis in Risk Analysis: A Retrospective," Risk Analysis, John Wiley & Sons, vol. 40(S1), pages 2207-2217, November.
    2. Shabnam Vatanpour & Steve E. Hrudey & Irina Dinu, 2015. "Can Public Health Risk Assessment Using Risk Matrices Be Misleading?," IJERPH, MDPI, vol. 12(8), pages 1-14, August.
    3. F. Acebes & J. M. González-Varona & A. López-Paredes & J. Pajares, 2024. "Beyond probability-impact matrices in project risk management: A quantitative methodology for risk prioritisation," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    4. E. S. Levine & Julie F. Waters, 2013. "Managing Risk at the Tucson Sector of the U.S. Border Patrol," Risk Analysis, John Wiley & Sons, vol. 33(7), pages 1281-1292, July.
    5. Anna Kosovac & Brian Davidson & Hector Malano, 2019. "Are We Objective? A Study into the Effectiveness of Risk Measurement in the Water Industry," Sustainability, MDPI, vol. 11(5), pages 1-13, February.
    6. Alan J. Card & James R. Ward & P. John Clarkson, 2014. "Trust‐Level Risk Evaluation and Risk Control Guidance in the NHS East of England," Risk Analysis, John Wiley & Sons, vol. 34(8), pages 1469-1481, August.
    7. Gilberto Montibeller & L. Alberto Franco & Ashley Carreras, 2020. "A Risk Analysis Framework for Prioritizing and Managing Biosecurity Threats," Risk Analysis, John Wiley & Sons, vol. 40(11), pages 2462-2477, November.
    8. Roger C. Jensen & Royce L. Bird & Blake W. Nichols, 2022. "Risk Assessment Matrices for Workplace Hazards: Design for Usability," IJERPH, MDPI, vol. 19(5), pages 1-23, February.
    9. Jonathon Mackay & Matthew Pepper & Albert Munoz, 2023. "Disruptions, systems and individual agents—Exploring the intersections," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 43-60, January.
    10. Liangdong Lu & Hong Huang & Jiuchang Wei & Jia Xu, 2020. "Safety Regulations and the Uncertainty of Work‐Related Road Accident Loss: The Triple Identity of Chinese Local Governments Under Principal–Agent Framework," Risk Analysis, John Wiley & Sons, vol. 40(6), pages 1168-1182, June.
    11. Alex de Lima Teodoro da Penha & Samuel Vinícius Bonato & Joana Baleeiro Passos & Eduardo da Silva Fernandes & Cínthia Kulpa & Carla Schwengber ten Caten, 2024. "Navigating the Urgency: An Open Innovation Project of Protective Equipment Development from a Quadruple Helix Perspective," Sustainability, MDPI, vol. 16(4), pages 1-32, February.
    12. Mauricio Moraes Davidovich & William K. Klimack, 2022. "PRISM: improved risk management," SN Business & Economics, Springer, vol. 2(7), pages 1-25, July.
    13. Xin Ruan & Zhiyi Yin & Dan M. Frangopol, 2015. "Risk Matrix Integrating Risk Attitudes Based on Utility Theory," Risk Analysis, John Wiley & Sons, vol. 35(8), pages 1437-1447, August.
    14. David J. Ball & John Watt, 2013. "Further Thoughts on the Utility of Risk Matrices," Risk Analysis, John Wiley & Sons, vol. 33(11), pages 2068-2078, November.
    15. Gulsum Kubra Kaya & James Ward & John Clarkson, 2019. "A Review of Risk Matrices Used in Acute Hospitals in England," Risk Analysis, John Wiley & Sons, vol. 39(5), pages 1060-1070, May.
    16. Shuang Liu & Kirsten Maclean & Cathy Robinson, 2019. "A cost-effective framework to prioritise stakeholder participation options," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 7(3), pages 221-241, November.
    17. Roger C. Jensen & Haley Hansen, 2020. "Selecting Appropriate Words for Naming the Rows and Columns of Risk Assessment Matrices," IJERPH, MDPI, vol. 17(15), pages 1-17, July.
    18. Doumpos, Michalis & Zopounidis, Constantin & Gounopoulos, Dimitrios & Platanakis, Emmanouil & Zhang, Wenke, 2023. "Operational research and artificial intelligence methods in banking," European Journal of Operational Research, Elsevier, vol. 306(1), pages 1-16.
    19. Xingyuan Chen & Yong Deng, 2022. "An Evidential Software Risk Evaluation Model," Mathematics, MDPI, vol. 10(13), pages 1-19, July.
    20. Jaspersen, Johannes G., 2022. "Convex combinations in judgment aggregation," European Journal of Operational Research, Elsevier, vol. 299(2), pages 780-794.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:38:y:2018:i:1:p:99-117. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.