Risk matrix
A risk is the amount of harm that can be expected to occur during a given time period due to specific harm event (e.g., an accident). Statistically, the level of risk can be calculated as the product of the probability that harm occurs (e.g., that an accident happens) multiplied by the severity of that harm (i.e., the average amount of harm or more conservatively the maximum credible amount of harm). In practice, the amount of risk is usually categorized into a small number of levels because neither the probability nor harm severity can typically be estimated with accuracy and precision.
A Risk matrix is a matrix that is used during risk assessment to define the various levels of risk as the product of the harm probability categories and harm severity categories. This is a simple mechanism to increase visibility of risks and assist management decision making.
Although many standard risk matrices exist in different contexts (US DoD, NASA, ISO),[1][2][3] individual projects and organizations may need to create their own or tailor an existing risk matrix.
For example, the harm severity can be categorized as:
- Catastrophic – Multiple Deaths
- Critical – One Death or Multiple Severe Injuries
- Marginal – One Severe Injury or Multiple Minor Injuries
- Negligible – One Minor Injury
The probability of harm occurring might be categorized as 'Certain', 'Likely', 'Possible', 'Unlikely' and 'Rare'. However it must be considered that very low probabilities may not be very reliable.
The resulting Risk Matrix could be:
| Negligible | Marginal | Critical | Catastrophic | |
|---|---|---|---|---|
| Certain | High | High | Extreme | Extreme |
| Likely | Moderate | High | High | Extreme |
| Possible | Low | Moderate | High | Extreme |
| Unlikely | Low | Low | Moderate | Extreme |
| Rare | Low | Low | Moderate | High |
The company or organization then would calculate what levels of Risk they can take with different events. This would be done by weighing up the risk of an event occurring against the cost to implement safety and the benefit gained from it.
An example
The following is an example risk matrix with particular accidents allocated to appropriate cells within the matrix:
| Negligible | Marginal | Critical | Catastrophic | |
|---|---|---|---|---|
| Certain | Stubbing Toe | |||
| Likely | Fall | |||
| Possible | Major Car Accident | |||
| Unlikely | Aircraft Crash | |||
| Rare | Major Tsunami |
Problems
In his article 'What's Wrong with Risk Matrices?',[4] Tony Cox argues that risk matrices experience several problematic mathematical features making it harder to assess risks. These are:
- Poor Resolution. Typical risk matrices can correctly and unambiguously compare only a small fraction (e.g., less than 10%) of randomly selected pairs of hazards. They can assign identical ratings to quantitatively very different risks ("range compression").
- Errors. Risk matrices can mistakenly assign higher qualitative ratings to quantitatively smaller risks. For risks with negatively correlated frequencies and severities, they can be "worse than useless," leading to worse-than-random decisions.
- Suboptimal Resource Allocation. Effective allocation of resources to risk-reducing countermeasures cannot be based on the categories provided by risk matrices.
- Ambiguous Inputs and Outputs. Categorizations of severity cannot be made objectively for uncertain consequences. Inputs to risk matrices (e.g., frequency and severity categorizations) and resulting outputs (i.e., risk ratings) require subjective interpretation, and different users may obtain opposite ratings of the same quantitative risks. These limitations suggest that risk matrices should be used with caution, and only with careful explanations of embedded judgments.
Thomas, Bratvold, and Bickel[5] demonstrate that risk matrices produce arbitrary risk rankings. Rankings depend upon the design of the risk matrix itself, such as how large the bins are and whether or not one uses an increasing or decreasing scale. In other words, changing the scale can change the answer.
Douglas W. Hubbard and Richard Seiersen take the general research from Cox, Thomas, Bratvold, and Bickel, and provide specific discussion in the realm of cybersecurity risk. They point at that since 61% of cybersecurity professionals use some form of risk matrix, this can be a serious problem. Hubbard and Seiersen consider these problems in the context of other measured human errors and conclude that “The errors of the experts are simply further exacerbated by the additional errors introduced by the scales and matrices themselves. We agree with the solution proposed by Thomas et al. There is no need for cybersecurity (or other areas of risk analysis that also use risk matrices) to reinvent well-established quantitative methods used in many equally complex problems.”[6]
References
- ↑ United States Department of Defense, Risk Management Guide for DoD Acquisition, August 2006
- ↑ Goddard Space Flight Center, NASA, Risk Management Reporting, GSFC-STD-0002, 8 May 2009
- ↑ International Organization for Standardization, Space Systems Risk Management, ISO 17666,
- ↑ Cox, L.A. Jr., 'What's Wrong with Risk Matrices?', Risk Analysis, Vol. 28, No. 2, 2008, doi:10.1111/j.1539-6924.2008.01030.x
- ↑ Thomas, Philip, Reidar Bratvold, and J. Eric Bickel, 'The Risk of Using Risk Matrices,' SPE Economics & Management, Vol. 6, No. 2, pp. 56-66, 2014, doi:10.2118/166269-PA.
- ↑ Hubbard, Douglas W.; Seiersen, Richard (2016). How to Measure Anything in Cybersecurity Risk. Wiley. pp. Kindle Locations 2636–2639.