Another potential strong shortcoming of AHP

In the last twenty years many features of Saaty's Analytical Hierarchy Process (AHP) have been criticised, especially the additive hierarchical composition of conventional AHP, which leads to the possibility of occurrence of the Rank Reversal phenomenon (adding an irrelevant alternative may cause a reversal in the ranking at the top). In the context of a variable number of alternatives this rank reversal possibility is likely to be a shortcoming of the aggregation method, since the global priorities obtained and the corresponding rankings can be seen, to some extent, as arbitrary. In this paper we show another feature of AHP which may be, and in many application contexts will indeed be, an even stronger shortcoming of the method. It consists in the fact that the addition of indifferent criteria (for which all alternatives perform equally) causes a significant alteration of the aggregated priorities of alternatives, with important consequences. Although not in three-level hierarchies, in more complex hierarchies rank reversal may happen. Since in almost all applications of AHP the set of criteria is not fixed ex-ante but is variable and is constructed in accordance with reasons of relevance and simplicity, almost all applications of AHP are potentially flawed.