IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v28y2008i2p497-512.html
   My bibliography  Save this article

What's Wrong with Risk Matrices?

Author

Listed:
  • Louis Anthony (Tony)Cox

Abstract

Risk matrices—tables mapping “frequency” and “severity” ratings to corresponding risk priority levels—are popular in applications as diverse as terrorism risk analysis, highway construction project management, office building risk analysis, climate change risk management, and enterprise risk management (ERM). National and international standards (e.g., Military Standard 882C and AS/NZS 4360:1999) have stimulated adoption of risk matrices by many organizations and risk consultants. However, little research rigorously validates their performance in actually improving risk management decisions. This article examines some mathematical properties of risk matrices and shows that they have the following limitations. (a) Poor Resolution. Typical risk matrices can correctly and unambiguously compare only a small fraction (e.g., less than 10%) of randomly selected pairs of hazards. They can assign identical ratings to quantitatively very different risks (“range compression”). (b) Errors. Risk matrices can mistakenly assign higher qualitative ratings to quantitatively smaller risks. For risks with negatively correlated frequencies and severities, they can be “worse than useless,” leading to worse‐than‐random decisions. (c) Suboptimal Resource Allocation. Effective allocation of resources to risk‐reducing countermeasures cannot be based on the categories provided by risk matrices. (d) Ambiguous Inputs and Outputs. Categorizations of severity cannot be made objectively for uncertain consequences. Inputs to risk matrices (e.g., frequency and severity categorizations) and resulting outputs (i.e., risk ratings) require subjective interpretation, and different users may obtain opposite ratings of the same quantitative risks. These limitations suggest that risk matrices should be used with caution, and only with careful explanations of embedded judgments.

Suggested Citation

  • Louis Anthony (Tony)Cox, 2008. "What's Wrong with Risk Matrices?," Risk Analysis, John Wiley & Sons, vol. 28(2), pages 497-512, April.
    • Handle: RePEc:wly:riskan:v:28:y:2008:i:2:p:497-512
    DOI: 10.1111/j.1539-6924.2008.01030.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1539-6924.2008.01030.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1539-6924.2008.01030.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Louis Anthony (Tony) Cox & Djangir Babayev & William Huber, 2005. "Some Limitations of Qualitative Risk Rating Systems," Risk Analysis, John Wiley & Sons, vol. 25(3), pages 651-662, June.
    2. Louis Anthony (Tony) Cox & Douglas A. Popken, 2007. "Some Limitations of Aggregate Exposure Metrics," Risk Analysis, John Wiley & Sons, vol. 27(2), pages 439-445, April.
    3. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    4. Dimitris Bertsimas & José Niño-Mora, 1996. "Conservation Laws, Extended Polymatroids and Multiarmed Bandit Problems; A Polyhedral Approach to Indexable Systems," Mathematics of Operations Research, INFORMS, vol. 21(2), pages 257-306, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Malekipirbazari, Milad & Çavuş, Özlem, 2024. "Index policy for multiarmed bandit problem with dynamic risk measures," European Journal of Operational Research, Elsevier, vol. 312(2), pages 627-640.
    2. Gulsum Kubra Kaya & James Ward & John Clarkson, 2019. "A Review of Risk Matrices Used in Acute Hospitals in England," Risk Analysis, John Wiley & Sons, vol. 39(5), pages 1060-1070, May.
    3. Sofiane Aboura, 2014. "When the U.S. Stock Market Becomes Extreme?," Risks, MDPI, vol. 2(2), pages 1-15, May.
    4. Domagoj Demeterfi & Kathrin Glau & Linus Wunderlich, 2025. "Function approximations for counterparty credit exposure calculations," Papers 2507.09004, arXiv.org.
    5. José Niño-Mora, 2006. "Restless Bandit Marginal Productivity Indices, Diminishing Returns, and Optimal Control of Make-to-Order/Make-to-Stock M/G/1 Queues," Mathematics of Operations Research, INFORMS, vol. 31(1), pages 50-84, February.
    6. Winter, Peter, 2007. "Managerial Risk Accounting and Control – A German perspective," MPRA Paper 8185, University Library of Munich, Germany.
    7. Cui, Xueting & Zhu, Shushang & Sun, Xiaoling & Li, Duan, 2013. "Nonlinear portfolio selection using approximate parametric Value-at-Risk," Journal of Banking & Finance, Elsevier, vol. 37(6), pages 2124-2139.
    8. Jay Cao & Jacky Chen & John Hull & Zissis Poulos, 2021. "Deep Hedging of Derivatives Using Reinforcement Learning," Papers 2103.16409, arXiv.org.
    9. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.
    10. Dimitrios G. Konstantinides & Georgios C. Zachos, 2019. "Exhibiting Abnormal Returns Under a Risk Averse Strategy," Methodology and Computing in Applied Probability, Springer, vol. 21(2), pages 551-566, June.
    11. Iman Khajepour & Geoffrey Pritchard & Danny Ralph & Golbon Zakeri, 2025. "On monotone completion of risk markets: Limit results for incomplete risk markets," Papers 2504.18436, arXiv.org.
    12. Parrini, Alessandro, 2013. "Importance Sampling for Portfolio Credit Risk in Factor Copula Models," MPRA Paper 103745, University Library of Munich, Germany.
    13. Makam, Vaishno Devi & Millossovich, Pietro & Tsanakas, Andreas, 2021. "Sensitivity analysis with χ2-divergences," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 372-383.
    14. Boonen, Tim J. & Liu, Fangda, 2022. "Insurance with heterogeneous preferences," Journal of Mathematical Economics, Elsevier, vol. 102(C).
    15. Arturo Cortés Aguilar, 2011. "Estimación del residual de un bono respaldado por hipotecas mediante un modelo de riesgo crédito: una comparación de resultados de la teoría de cópulas y el modelo IRB de Basilea II en datos del merca," Revista de Administración, Finanzas y Economía (Journal of Management, Finance and Economics), Tecnológico de Monterrey, Campus Ciudad de México, vol. 5(1), pages 50-64.
    16. Furman, Edward & Landsman, Zinoviy, 2010. "Multivariate Tweedie distributions and some related capital-at-risk analyses," Insurance: Mathematics and Economics, Elsevier, vol. 46(2), pages 351-361, April.
    17. Marco Rocco, 2011. "Extreme value theory for finance: a survey," Questioni di Economia e Finanza (Occasional Papers) 99, Bank of Italy, Economic Research and International Relations Area.
    18. Valdez, Emiliano A. & Chernih, Andrew, 2003. "Wang's capital allocation formula for elliptically contoured distributions," Insurance: Mathematics and Economics, Elsevier, vol. 33(3), pages 517-532, December.
    19. Kull, Andreas, 2009. "Sharing Risk – An Economic Perspective," ASTIN Bulletin, Cambridge University Press, vol. 39(2), pages 591-613, November.
    20. Schumacher Johannes M., 2018. "Distortion risk measures, ROC curves, and distortion divergence," Statistics & Risk Modeling, De Gruyter, vol. 35(1-2), pages 35-50, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:28:y:2008:i:2:p:497-512. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.