A modified axiomatic foundation of the analytic hierarchy process
Abstract
This paper reports a modified axiomatic foundation of the analytic hierarchy process (AHP), where the reciprocal property of paired comparisons is broken. The novel concept of reciprocal symmetry breaking is proposed to characterize the considered situation without reciprocal property. It is found that the uncertainty experienced by the decision maker can be naturally incorporated into the modified axioms. Some results are derived from the new axioms involving the new concept of approximate consistency and the method of eliciting priorities. The phenomenon of ranking reversal is revisited from a theoretical viewpoint under the modified axiomatic foundation. The situations without ranking reversal are addressed and called ranking equilibrium. The likelihood of ranking reversal is captured by introducing a possibility degree index based on the Kendall’s coefficient of concordance. The modified axioms and the derived facts form a novel operational basis of the AHP choice model under some uncertainty. The observations reveal that a more flexible expression of decision information could be accepted as compared to the judgments with reciprocal property.
keywords:
Analytic hierarchy process (AHP), modified axiomatic foundation, reciprocal symmetry breaking, ranking equilibrium, possibility degree1 Introduction
Since the Analytic Hierarchy Process (AHP) was developed as a choice model by [21, 22], it has been more than forty years. As shown in the AHP model, the decomposition principle is applied to construct a hierarchy of criteria, subcriteria and alternatives when faced with a complex decision making problem. The comparison technique of paired alternatives is used to construct a series of pairwise comparison matrices. The priorities of alternatives are elicited from the obtained matrices by a synthesis mechanism; then the optimal solution is reached. One can see that the investigations involving the theory and applications of the AHP choice model are never stopped [11, 30, 9, 1, 4, 26, 25, 17].

It is worth noting that one of the important issues is the axiomatic foundation of the AHP model; and the existing one contains four axioms [23]. The basic one of the four axioms is the reciprocal property of pairwise comparisons. For convenience, we assume that there is a finite set of alternatives in a decision-making problem. The reciprocal property means that when the relative importance of over is determined as the relative importance of over is automatically obtained as for [21, 11, 4]. It is obvious that the reciprocal relation is based on the mathematical intuition [12]. We want to ask whether the relation is really satisfied, when the comparison ratios and in relative measurement are determined by evaluating the preference intensity of the alternatives over and over respectively. For example, as shown in [25], we compare the areas of the five figures in Figure 1 by eyeballing them. If the reciprocal property is not assumed in advance, it seems difficult to obtain the reciprocal relation of pairwise comparisons. The underlying reason could be attributed to the fact that various cognitive distortions of the decision maker could affect the evaluation of her/his ratio judgements [19, 18, 5]. One can find that although the reciprocal property is in agreement with the mathematical intuition, it may be not always satisfied in a practical case. In other words, the reciprocal property is a strict mathematical relation under an ideal case, and there is some deviation from the flexible expression of human-originated information. Motivated by the above consideration, we attempt to analyze the case without the reciprocal property to form a novel axiomatic foundation of the AHP model. The concept of reciprocal symmetry breaking is introduced to capture the flexible case without reciprocal property such that the uncertainty experienced by the decision maker can be naturally coped with.
Moreover, it is noted that the AHP model has also incurred some criticisms [2, 3, 6, 7, 31]. One of the criticisms comes with the phenomenon of ranking reversal. This means that when adding or deleting an alternative and/or a criterion, the ranking of the old or the remaining alternatives could be changed. That is, the ranking of alternatives is sensitive to the actions of adding and/or deleting an alternative and/or a criterion, even if the comparison ratios are all consistent. The AHP model was criticized as an arbitrary method and it should be corrected by synthesizing the concepts of multi-attribute utility theory or the others [6, 7]. The defenders considered that the phenomenon of ranking reversal is acceptable in a practical case and exhibits the structural dependence [27, 12, 13, 24]. A further comment showed that the situation of applying the AHP method should be identified by comparing the multi-attribute utility theory and carrying out an example in the field of voting [20]. It seems that there does not exist a widely accepted conclusion for the serious controversy [32, 10]. Fortunately, it has shown that the decision-making procedure based on the AHP model is reliable according to the recent results [4]. Moreover, from the existing discussions about the ranking reversal phenomenon, numerical examples are always carried out and it is a lack of a formally theoretical analysis except for the finding by [28]. In this study, we revisit the phenomenon of ranking reversal through a theoretical investigation under the modified axiomatic foundation. The concept of ranking equilibrium is introduced to characterize the situations without ranking reversal. The likelihood of ranking reversal is quantified by proposing a possibility degree index such that the decision maker can be reminded for the occurrence of ranking reversal in terms of a percentage.
The structure of the paper is organized as follows. In section 2, the axiomatic foundations of the AHP model are focused on. The novelty comes with the modified axioms and the concept of reciprocal symmetry breaking of pairwise comparisons. Section 3 gives some interesting results derived from the modified axioms. Some important issues are addressed such as the properties of reciprocal symmetry breaking, the approximate consistency of pairwise comparison matrices and the priorities of alternatives. Section 4 offers a theoretical analysis for the phenomenon of ranking reversal. The novel concept of ranking equilibrium is proposed to describe the ideal cases without ranking reversal. The breaking degree of ranking equilibrium is captured by introducing a measurement index. In section 5, a practical case of decision making is restudied and some comparisons are offered to show the difference from the typical AHP model. The main conclusions are covered in Section 6.
2 Axiomatic foundations of the AHP model
In this section, we first recall the existing axioms of the AHP model proposed by [23]. Then it is an attempt to modify the basic one such that some uncertainty of human-originated information can be captured naturally. It is considered that there are a finite set of alternatives and a criterion in a decision-making problem. The binary relation of alternatives with respect to can be quantified by defining a mapping as follows:
(1) |
where stands for the set of positive real numbers. Then the fundamental scale in relative measurement satisfies the following rules [23]:
- (I)
-
- (II)
-
if is strictly preferred to under the criterion or
- (III)
-
if is equivalent to under the criterion or
with In particular, one has since is equivalent to Some discussions about the existence of the ratio scales have been widely made [21, 6, 4]. Here we follow the observations in [4] that the ratio scales could be derived according to the modern theory of subjective measurement.
2.1 The initial axiomatic foundation
In the following, let us recall the four axioms defined by [23] in terms of the above primitive notions. The basic one is the reciprocal property of pairwise comparisons:
Axiom 2.1 (Axiom 1.).
(Reciprocal property) The preference intensities between the alternatives and satisfy the following relation:
(2) |
When explaining the reciprocal property (2), [23] stated that ”if one stone is judged to be five times heavier than another, then the other is automatically one fifth as heavy as the first because it participated in making the first judgment.” It is seen that the reciprocal property is mainly based on the mathematical intuition. Moreover, from the theory of subjective measurement in mathematical psychology [4], the reciprocal property is not necessarily satisfied. The main reason is based on the fact that when separately evaluating the preference intensities and some uncertainty could be existing from the viewpoint of human psychology. In addition, to cope with the uncertainty experienced by the decision maker, the interval judgements have been proposed by [29] to evaluate pairwise comparisons. In this study, it will be proved that the pairwise comparisons without reciprocal property are equivalent to the interval judgements in a sense. Therefore, when the reciprocal property is considered to be not necessary, the axiomatic foundation of the AHP model should be modified.
On the other hand, within the framework of the AHP model, a complex decision making problem is decomposed as a hierarchy structure with criteria, subcriteria and alternatives. The hierarchic axioms form the bases of the hierarchy structure. First, the concept of a partially ordered set should be mentioned:
Definition 2.2.
A set with a binary relation is partially ordered, when the following conditions are satisfied:
-
•
Reflexive: for
-
•
Transitive: If and then for
-
•
Antisymmetric: If and then for
Then the boundedness, the supremum and the infimum of a partially ordered set can be further defined. Following the concept of the partially ordered set, the definition of a hierarchy is given as follows [23]:
Definition 2.3.
A hierarchy satisfies the following conditions:
-
•
is a finite partially ordered set with the largest element
-
•
can be partitioned as subsets called levels with
-
•
If one has and where the symbol stands for ”less preferred than.”
In connect with the AHP model, the second axiom is given as the following form:
Axiom 2.4 (Axiom 2.).
(-homogeneity) Assume that is a positive real number and is a hierarchy. is of -homogeneity with respect to for under the following condition:
(3) |
The -homogeneity characterizes the comparability of similar things belonging to the same level. When the reciprocal property is not necessary, the condition (3) should be changed correspondingly.
Furthermore, it is seen that the dependence of different levels should be considered by extending the notions of the fundamental scale. The concepts of outer dependent and inner dependent are introduced as follows:
Definition 2.5.
A set is outer dependent on the set if one can define a fundamental scale on with respect to each
Definition 2.6.
Assume that is outer dependent on the set The elements in are inner dependent with respect to if for some is outer dependent on
The relation between the levels and should satisfy the following axiom:
Axiom 2.7 (Axiom 3.).
(Dependence) Let () be the levels of a hierarchy Then and () have the following dependence relations:
-
•
is outer dependent on
-
•
is not inner dependent with respect to all
-
•
is not outer dependent on
Axiom 3 is not related to the reciprocal property; and it holds when pairwise comparisons are not reciprocal.
At the end, it is considered that the decision maker usually has an expectation about the outcome of a decision-making problem. The constructed hierarchy should be compatible with the expectation. Hence, the fourth axiom is expressed as follows:
Axiom 2.8 (Axiom 4.).
(Expectation) The constructed hierarchy includes all criteria and alternatives; and the derived priorities are compatible with the expectations represented in the hierarchical structure.
The above four axioms provide the theoretical basis of the typical AHP choice model [23]. In what follows, we mainly modify the first axiom about the reciprocal property of pairwise comparisons to establish a new axiomatic foundation of the AHP model under uncertainty.
2.2 A modified axiomatic foundation
As shown in [12], Axiom 1 is based on the mathematical intuition where the relations of and should be simultaneously satisfied for However, the reciprocal property (2) could not always hold for a practical case, which can be explained from the two views of point. One is based on the paired technique of comparing alternatives. When the decision maker evaluates the preference intensities of the alternatives over and over the uncertainty could be experienced [29]. In fact, the reciprocal property (2) reflects the strict logical relation between and which is incompatible with the uncertainty being experienced by the decision maker. The other comes with the subjective measurement of the ratio scales [4]. Some cognitive distortions of the decision maker could affect the evaluation of her/his ratio judgements. Therefore, the reciprocal property (2) should be relaxed to naturally capture the uncertainty exhibited in paired comparisons.
When softening the equality (2), there are two situations to be considered. One is and the other is For the two considered situations, we can introduce a factor such that Hence the concept of reciprocal symmetry breaking is proposed in the following definition:
Definition 2.9.
Suppose that there are a finite set of alternatives The symbols and stand for the preference intensities of over and over respectively. If there exist a pair of preference intensities and such that
(4) |
the pairwise comparisons on are of reciprocal symmetry breaking.
In general, we can consider that the reciprocal symmetry breaking reflects some uncertainty in pairwisely comparing alternatives. In addition, it is interesting to recall the interval-valued comparison matrix provided by [29]:
Definition 2.10.
An interval-valued comparison matrix is represented as:
(5) |
Hereafter means that the preference intensity of over is located between and The values satisfy and for

Definition 2.10 shows the following relations:
(6) |
Moreover, letting
(7) |
we have
(8) |
As shown in Figure 2, the mirror mechanism has been built for the transformation between the cases of and In other words, when we give and with by comparing and the comparison ratios and with have been determined by using the relation This means that it is sufficient to consider one of the two cases with and where the reciprocal symmetry (8) is satisfied. In order to form an axiomatic foundation of the AHP model under some uncertainty, Axiom 1 is modified as follows:
Axiom 2.11 (Axiom 1′.).
(Reciprocal symmetry breaking) The preference intensities of the alternatives over and over satisfy the following relation:
(9) |
Clearly, Axiom 1 is the particular case of Axiom 1′ with reciprocal property. In a similar manner, Axiom 2 should be further adjusted and we give the following axiom:
Axiom 2.12 (Axiom 2′.).
(-homogeneity) Let and be a positive real number and a hierarchy, respectively. is of -homogeneity with respect to for and the following conditions:
(10) |
As compared to Axiom 2, the pairwise comparisons and are all considered in Axiom 2′. Furthermore, since Axiom 3 is only related to the fundamental scale satisfying the three rules (I)-(III), it does not need to be modified. Additionally, Axiom 4 holds, even when the irrational behavior of the decision maker emerges [23]. In a word, Axioms 1′, 2′, 3 and 4 form the modified axiomatic foundation of the AHP model under some uncertainty.
3 Results from the modified axioms
It is noted from the results in [23] that the reciprocal property is the necessary condition of a consistent binary relation. When the reciprocal property is broken, the pairwise comparisons must be inconsistent. This implies that the inconsistency is the natural property of pairwise comparisons according to Axiom 1′. The above observation is in agreement with the practical situation, since one always provides inconsistent judgements when pairwisely comparing alternatives [22]. In the following, we derive some interesting results from the modified axiomatic foundation.
3.1 Properties of reciprocal symmetry breaking
It is convenient to propose the concept of pairwise comparison matrices with reciprocal symmetry breaking.
Definition 3.1.
A pairwise comparison matrix is of reciprocal symmetry breaking, if the derived matrix
(11) |
where () and stands for the matrix whose entries are all ones.
Hereafter, when we say pairwise comparison matrices, it means that the reciprocal property could be breaking. In terms of (11), it gives (), meaning that the constructed matrix is symmetrical. When the matrix is with reciprocal property. This implies that the matrix characterizes the reciprocal property of a pairwise comparison matrix. For the sake of distinguishing, we give the following definition:
Definition 3.2.
If a pairwise comparison matrix is with reciprocal property, it is called a multiplicative reciprocal matrix.
Moreover, the degree of reciprocal symmetry breaking of a pairwise comparison matrix can be quantified by using the matrix We define the following index:
Definition 3.3.
Suppose that is a pairwise comparison matrix. The degree of reciprocal symmetry breaking is defined by the following equality:
(12) |
where for
In addition, the index of has the property as follows:
Theorem 3.4.
The degree of reciprocal symmetry breaking of a pairwise comparison matrix satisfies the relation of is a multiplicative reciprocal matrix if and only if
Proof.
Proof of Theorem 3.4. In terms of Axiom 1′ and Definition 3.3, it follows and for We further have
(13) |
If then for and In virtue of and one has meaning that is a multiplicative reciprocal matrix (Definition 8). On the other hand, if is with reciprocal property, then The application of (12) leads to ∎
Under Axiom 1′, the proposed index reflects the breaking degree of reciprocal property of a pairwise comparison matrix. The more the value of the less the breaking degree of reciprocal property is. It can be further explained as the subjective probability to give a pairwise comparison matrix with reciprocal property from the viewpoint of the philosophical discussion. In other words, when it implies that the subjective probability of giving a pairwise comparison matrix with reciprocal property is 1. With the decreasing of the value of the subjective probability of providing a multiplicative reciprocal matrix is decreasing. Furthermore, since an interval-valued comparison matrix can be used to capture the uncertainty experienced by the decision maker [29], the following result is achieved:
Theorem 3.5.
A pairwise comparison matrix with reciprocal symmetry breaking is equivalent to an interval-valued comparison matrix
Proof.
Proof of Theorem 3.5. If is with reciprocal symmetry breaking, we have under Axiom 1′ for and according to Definition 3.1. Then it follows
(14) |
Letting
and
one obtains the interval-valued comparison matrix
On the contrary, when an interval-valued comparison matrix with is given, the pairwise comparison matrix with reciprocal symmetry breaking is derived by assuming for under the consideration of Axiom 1′.
∎
The equivalence shown in Theorem 2 reveals that the uncertainty exhibited in an interval-valued comparison matrix can be equivalently captured by a pairwise comparison matrix with reciprocal symmetry breaking. In addition, following the idea in Definition 3.3, an uncertainty index of can be constructed as
(15) |
Then the following result is obtained:
Theorem 3.6.
Assume that is an interval-valued comparison matrix with for degenerates to a multiplicative reciprocal matrix if and only if the value of the constructed uncertainty index is equal to 1.
Proof.
Proof of Theorem 3.6. On the one hand, if degenerates to a multiplicative reciprocal matrix, then and for Using the formula (15), one has On the other hand, if the result of Theorem 3.4 shows that the matrix is a multiplicative reciprocal matrix. This means that and That is, degenerates to a multiplicative reciprocal matrix
∎
It is seen from the above observations that the uncertainty experienced by the decision maker has been naturally incorporated into Axiom 1′. Therefore, the modified axiomatic foundation can be considered as the basis of the AHP model under some uncertainty.
3.2 Approximate consistency of pairwise comparison matrices
It is worth noting that the concept of consistent pairwise comparison matrices is important and it is recalled as follows [22, 23]:
Definition 3.7.
A pairwise comparison matrix is consistent if
(16) |
In this study, it is noted that a pairwise comparison matrix could be with the breaking of reciprocal property. Hence, the consistency is only a particular property of a pairwise comparison matrix and a softened version of consistency should be further developed. It is noted that the concept of approximate consistency has been proposed to characterize the consistency property of interval-valued comparison matrices [16]. Following the idea in [16], the concept of approximate consistency of a pairwise comparison matrix is proposed:
Definition 3.8.
A pairwise comparison matrix is approximately consistent, if the same ranking of alternatives can be obtained by using each row and column vectors in
In Definition 3.8, the restrictive quantitative relation among paired comparisons in Definition 3.7 has been neglected and the ranking of alternatives is directly used. For example, let us consider a pairwise comparison matrix as follows [25]:
It is easy to determine the same ranking of alternatives as by using each row and column vectors in meaning that is of approximate consistency according to Definition 3.8. In addition, one can see that is with reciprocal property. For the purpose of agreeing with Axiom 1′, we further modify the matrix as:
where The determined ranking of alternatives by using each row and column in still is meaning that is also a pairwise comparison matrix with approximate consistency. Hence, due to the breaking of reciprocal property in the concept of approximate consistency is a softened version of consistency, and it is compatible with Axiom 1′. According to the standard of choosing the best alternative, the two matrices and are equivalent. Furthermore, we have the following property:
Theorem 3.9.
Let be a pairwise comparison matrix with approximate consistency. There is a permutation such that has the following properties:
-
(1)
is a pairwise comparison matrix with approximate consistency;
-
(2)
The elements in each row of are ranked by the ascending order;
-
(3)
The elements in each column of are ranked by the descending order.
Proof.
Proof of Theorem 3.9. (1) Suppose that is with approximate consistency. For any permutation there is a unique number such that for When is obtained by applying a permutation to the entries in the th row or the th column belonging to are changed to the th row or the column in This means that the ranking of alternatives determined by a row or column of is not changed with respect to the permutation Therefore, is of approximate consistency.
(2) For with approximate consistency, it is assumed that the determined ranking of alternatives is where the permutation is given. Then applying the permutation to to give we have for when the ranking is obtained by using the row vectors. This means that the elements in each row of are ranked by the ascending order.
(3) Based on the findings in (2), when the ranking of is determined by using the column vectors, it follows for That is, the elements in each column of are ranked by the descending order.
∎
Theorem 3.9 can be verified by adjusting as the following form:
It is easy to see that the matrix is in agreement with Theorem 3.9. In addition, we have the following observation:
Theorem 3.10.
Proof.
Proof of Theorem 3.10. Suppose that is a consistent matrix. Then one has and all rows of are identical except for a constant factor [23]. That is, when a row of is used to obtain the ranking of alternatives, the other rows can be used to determine the same ranking of alternatives. Similarly, when considering the columns of the same result can be found. Furthermore, due to the reciprocal property of a consistent matrix, the rankings of alternatives using the rows and columns are identical. Therefore, a consistent pairwise comparison matrix is with approximate consistency.
∎
The above observations show that a consistent pairwise comparison matrix is the ideal case under the typical and modified axiomatic foundations of the AHP model. A pairwise comparison matrix with approximate consistency can be considered as the ideal case of the modified axiomatic foundation of the AHP model under some uncertainty.
3.3 Priorities of alternatives
Another important problem is how to elicit the priorities of alternatives from a pairwise comparison matrix in the AHP model. Following the idea in [22], let us assume that there is a mapping given as follows:
(17) |
where denotes the set of pairwise comparison matrices and stands for the -fold Cartesian product of For convenience, the priority vector of alternatives is expressed as with The methods should be studied for deriving the priority vector of alternatives from a pairwise comparison matrix. As shown in [22, 23], the eigenvalue method has been carefully discussed, especially for consistent pairwise comparison matrices. Here we mainly focus on the method of deriving the priority vector from a pairwise comparison matrix with approximate consistency.
Suppose that the set of pairwise comparison matrices with approximate consistency is written as The following result is given:
Theorem 3.11.
Let be obtained by pairwise comparing alternatives in There exists a mapping:
such that
-
(I)
with for
-
(II)
For any two alternatives and if and only if for
Proof.
Proof of Theorem 3.11. For there is a permutation such that the derived matrix satisfies Theorem 3.9. Without loss of generality, it is assumed that and satisfies Theorem 3.9. This means that along with and for Therefore, there exists a weight for the alternative with such that Moreover, a pairwise comparison matrix can be constructed as follows:
(18) |
Letting
we have
In terms of Axiom 1′, it gives then the results (I) and (II) follow.
∎
In what follows, we prove that the eigenvalue method still is feasible to derive the priority vector from a pairwise comparison matrix with approximate consistency. It is convenient to recall a lemma as follows:
Lemma 3.12.
Let be a pairwise comparison matrix and be a permutation of is determined by applying to Then the eigenvalues of and are identical. The corresponding eigenvectors of are obtained by applying to those of
The proof of Lemma 3.12 can be completed by using the matrix theory [14] and the known finding [17]. The detail procedure has been neglected here. Furthermore, we have the following result:
Theorem 3.13.
Let be expressed as (18) and be a consistent pairwise comparison matrix. The principal right eigenvector of is written as where denotes the transposition. The principal right eigenvector of corresponding to the principal eigenvalue is calculated as A permutation is applied to and to get and respectively. Then there is a permutation such that and are satisfied simultaneously.
Proof.
Proof of Theorem 3.13. Since there is a permutation such that with the following relations:
(19) |
where Theorem 3.9 has been used. Making use of Lemma 3.12, we have
(20) |
This means that
(21) |
In virtue of (19), it follows Moreover, by rewriting as the matrix in (18), the application of Theorem 3.11 yields
∎
As shown in Theorem 3.13, the eigenvalue method can be used as the method of eliciting the properties of alternatives from a pairwise comparison matrix with approximate consistency. For example, the pairwise comparison matrix with approximate consistency is utilized for numerical computations. The largest eigenvalue and the corresponding eigenvector can be determined as and respectively. This means that the ranking of alternatives is which is in agreement with the existing result. In addition, it is noted that the largest eigenvalue is less than the order of the matrix. The observation is attributed to the breaking of reciprocal symmetry and different from the result of [23].
4 Ranking reversal phenomenon
The phenomenon of ranking reversal has been discussed widely within the framework of the AHP model. However, in the open literature, numerical examples are always offered to illustrate the ranking reversal phenomenon and the theoretical investigation is little made except for the finding in [28]. Here we attempt to give a theoretical analysis and to reach a general result according to the modified axiomatic foundation.
4.1 Single criterion case
When a single criterion is considered to compare alternatives in pairs, the rank preservation has been studied in [28]. It can be resulted that when the pairwise comparison matrix is consistent, the ranking of alternatives is not changed by the action of adding or deleting an alternative [23]. In other words, the ranking reversal phenomenon should not appear when the judgements of the decision maker are consistent. Now we consider the case that the pairwise comparison matrix is of approximate consistency in terms of Definition 3.8.
Theorem 4.1.
Let When deleting an alternative, the obtained pairwise comparison matrix is written as We have and the ranking of the remaining alternatives holds the same as that determined by
Proof.
Proof of Theorem 4.1. Since is a pairwise comparison matrix with approximate consistency, there is a permutation such that
(22) |
When deleting any an alternative, the corresponding comparison ratios are deleted. The remaining entries are used to construct and their rankings are still kept as (22), meaning Based on Theorems 3.11 and 3.13, the ranking of the remaining alternatives is not changed.
∎
Theorem 4.2.
Let A new pairwise comparison matrix is determined as when adding an alternative. If the ranking of the old alternatives is the same as that obtained by
Proof.
Proof of Theorem 4.2. For there exists a permutation such that
(23) |
with
(24) |
When adding an alternative and there is a permutation such that
(25) |
∎
It is convenient to reconsider the matrix For example, deleting the alternative it gives
where the elements corresponding to in have been deleted. The ranking of alternatives is by using which is identical with that given by When adding an alternative to give the matrix with approximate consistency as:
it is easy to obtain the ranking of alternatives as where the ranking of is not changed. Although pairwise comparison matrices with the breaking of reciprocal property are inconsistent in nature, the ranking reversal phenomenon does not occur under approximate consistency. As compared to the results of [28], the present finding is based on the modified axioms. Furthermore, it should be pointed out that when a pairwise comparison matrix is not of approximate consistency, the ranking reversal phenomenon may not occur. For instance, we change the value of an entry in to get
with It is seen that is not of approximate consistency. But when eliminating an alternative, the ranking of the remaining alternatives can be kept by using the eigenvalue method. This means that the results in Theorems 4.1 and 4.2 give some ideal cases and the occurrence of ranking reversal should be further investigated.
4.2 Multi-criteria case
When the multiple criteria should be considered in a decision making problem, a complex and disordered state about the ranking of alternatives may occur after adding or deleting an alternative. In the single criterion case, the effects of the inner dependence of alternatives on the ranking reversal have been addressed. It can be considered that the dependence of the elements in the same level may cause the ranking reversal phenomenon. In the multi-criteria case, of much importance is to investigate the effects of the dependence of different levels in a hierarchy structure on the ranking reversal. Therefore, it is interesting to discuss the particular case where all the pairwise comparison matrices are of approximate consistency. Suppose that there are a set of criteria and a set of alternatives The weights of criteria with respect to the goal are written as and the weights of alternatives with respect to are expressed as For convenience, the following matrix is determined:
(26) |
Following [23], the final weights of alternatives are computed by using the following formula:
(27) |
Without loss of generality, it is further assumed that Then we have the following results:
Theorem 4.3.
Let the weights of criteria and alternatives be expressed as the matrix The rankings of alternatives with respect to all criteria are assumed to be identical. When deleting an alternative or a criterion, the final ranking of the remaining alternatives is not changed.
Proof.
Proof of Theorem 4.3. It is convenient to assume
(28) |
Then we have and by using (27) and When deleting an alternative, the ranking of the remaining alternatives with respect to any a criterion is not changed according to Theorem 4.1. This means that the ranking of the remaining alternatives holds by using (27). In addition, when deleting a criterion, the ranking of the remaining criteria is still kept. The final ranking of the alternatives is not changed in terms of (27).
∎
Theorem 4.4.
The weights of criteria and alternatives are assumed to be expressed as the matrix and there is the same ranking of alternatives with respect to all criteria. When adding an alternative if the rankings of alternatives are identical with respect to all criteria, the ranking of the old alternatives is not changed. When adding a criterion if the ranking of the alternatives with respect to is the same as the previous one, the final ranking of alternatives is not changed.
Proof.
Proof of Theorem 4.4. Following Theorem 4.2 and (27), the results are satisfied and the detail procedure has been omitted here.
∎
The above observations show some ideal cases without the ranking reversal. As an example, we consider the following matrix:
It is seen from that for all criteria. If adding an alternative and giving the new matrix:
we can obtain the ranking of meaning that the ranking of holds.
4.3 Likelihood of ranking reversal
The findings in Theorems 4.1-4.4 have revealed some basic facts related to the ranking reversal phenomenon. For convenience, we propose the following concept:
Definition 4.5.
If the ranking of alternatives in a hierarchy structure is not changed by the actions of adding or deleting an alternative and/or a criterion, the hierarchy structure is called to be with the ranking equilibrium.
The concept of ranking equilibrium describes the fundamental state of a hierarchy structure without ranking reversal. As compared to the concepts of consistency in [22] and approximate consistency in Definition 3.8, the meaning of ranking equilibrium is intuitive and easily accessible. Theorems 4.1-4.4 can be considered as the basic cores of the ranking equilibrium. When there is a difference among the rankings of the alternatives with respect to different row/column vectors in a pairwise comparison matrix or different criteria, the ranking equilibrium begins to be broken. In order to quantify the breaking degree of ranking equilibrium, we introduce the Kendall’s coefficient of concordance [15, 8].
Definition 4.6.
Assume that is an -dimensional vector. The rank of the element is defined as:
(29) |
where stands for the following indicator function:
(30) |
Then the vector is called the rank vector of
For example, the rank vector of can be determined as Hereafter, the first method is used to deal with the case with the same entries such that the rank vector of an -dimensional vector is a permutation of The first method obeys the following two rules:
-
•
The rank vector should be kept as a permutation of
-
•
For the two same entries, the rank of the entry in the first order is less than that of the second one.
In what follows, we always assume that the rank vector of an -dimensional vector is a permutation of Moreover, the rank matrix can be defined as:
Definition 4.7.
is called the rank matrix of where is the rank of the entry in the column vector
Then, let us define the following quantity:
(31) |
The mean value and the variance are computed as:
(32) |
After some computations, we further have the following results:
(33) |
It is found that the maximum value of can be obtained as
(34) |
when the rankings of the entries of each column in the rank matrix are identical. Now the Kendall’s coefficient of concordance of is defined as:
(35) |
Obviously, it follows When the column and row vectors of are an identical permutation of The case of means that the elements in a row vector of are the same. In the following, the cases with single criterion and multiple criteria are investigated, respectively.
(I) The case of a single criterion
First, let us consider the effects of the dependence of the elements in the same level on ranking reversal. That is, when there is only a single criterion, a pairwise comparison matrix should be considered. Under the consideration of the reciprocal symmetry breaking, the Kendall’s coefficient of concordance of should be derived by using the row and column vectors. The corresponding rank matrices are written as:
where and stand for the rank matrices obtained by using the row and column vectors, respectively. The Kendall’s coefficient of concordance in (35) should be rewritten as
(36) |
where
with
Here and are the ranks of in the row and column vectors, respectively. We further obtain the following result:
Theorem 4.8.
Given a pairwise comparison matrix if and only if the value of in (36) is equal to 1.
Proof.
Proof of Theorem 4.8. When the rankings of alternatives are identical according to all row and column vectors in This means that each column in is the same permutation of and each row in is the same permutation of It can be computed that then
On the contrary, if it follows and are satisfied simultaneously. Then all column vectors in are identical and all row vectors in are the same. In what follows, we prove that the same ranking of alternatives can be obtained by using each column and row vectors of The proof can be achieved by using mathematical induction.
-
1.
Let meaning that
with under Axiom 1′. Without loss of generality, letting it must have because the column vectors and give the same ranking of alternatives This results and implying that the application of the row vectors yields the same ranking of That is, the matrix is of approximate consistency.
-
2.
It is assumed that when the matrix is of approximate consistency. Let us say with
(37) -
3.
When the matrix is given as
By considering the same ranking of alternatives according to the column vectors of and the first relation in (37), it is supposed that for which yields the ranking of Then in the th column of one has In virtue of the th row of and the second equality in (37), it follows Moreover, it is seen that the row vectors of should give the same ranking of alternatives according to the rank matrix Hence, we always have for meaning that by using each row of
The above procedure shows that under the condition of
∎
Now the possibility degree of ranking reversal is defined as follows:
Definition 4.9.
Let be a pairwise comparison matrix. The possibility degree of ranking reversal can be quantified by using the following index:
(38) |
When along with we have Based on Theorem 4.1 the phenomenon of ranking reversal does not occur when deleting an alternative. Under Theorem 4.2, if a pairwise comparison matrix with approximate consistency is produced by adding an alternative, there is not the phenomenon of ranking reversal. The more the value of the more the likelihood of ranking reversal is. For example, let us investigate the matrix and arrive at:
It is easy to compute that together with meaning that the hierarchy structure is of ranking equilibrium. Moreover, we consider the following matrix:
and obtain the rank matrices as:
The possibility degree of ranking reversal can be calculated as This means that when adding or deleting an alternative, the possibility of ranking reversal is about
(II) The case of multiple criteria
Second, we investigate the effects of the dependence of different levels on ranking reversal. For the case with multiple criteria, the matrix in (26) only needs to be investigated here. Then the rank matrix can be written as:
(39) |
Similar to Theorem 4.8, the following result is given:
Theorem 4.10.
Assume that the weights of alternatives with respect to criteria are written as the matrix in (26). The rankings of alternatives are identical according to all columns in if and only if
Proof.
Proof of Theorem 4.10. It is supposed that the rankings of alternatives based on all columns in are identical. It is no loss of generality to assume meaning that for Then we have by using (35). On the other hand, let which leads to in (35). That is, the rankings of the elements in all columns of should be identical. Hence, the rankings of alternatives determined by applying all columns in (26) are the same.
∎
The Kendall’s coefficient of concordance is used to define the possibility degree of ranking reversal.
Definition 4.11.
Assume that all pairwise comparison matrices are of approximate consistency. The derived matrix with the priorities of alternatives and criteria is shown as in (26). The possibility degree of ranking reversal is computed as
(40) |
It is noted that the conditions in Theorems 4.3 and 4.4 correspond to the case of with The less the value of the less the possibility occurring the ranking reversal phenomenon is. For example, let us consider the following matrix [6]:
The corresponding rank matrix is given as:
Then the Kendall’s coefficient of concordance is calculated as That is, the possibility degree of ranking reversal is meaning that the likelihood of ranking reversal is about when adding or deleting an alternative. The above result is in accordance with the known finding to some extent [6].
(III) General case of a hierarchy structure
In general, the ranking reversal phenomenon could occur due to the dependence of the elements in the same level and different levels in a hierarchy structure. In other words, for a general case, the above two cases should be combined to consider. Then we define the possibility degree of ranking reversal as follows:
Definition 4.12.
Let a hierarchy structure have a set of criteria and a set of alternatives The pairwise comparisons of criteria construct the matrix With respect to a criterion the pairwise comparisons of alternatives form the matrices The relation between the levels of criteria and alternatives is expressed as the matrix The average possibility degree of ranking reversal is computed as:
(41) |
where for and
Definition 4.12 shows that the ranking equilibrium of a hierarchy structure is based on all pairwise comparison matrices and the structural dependence. If there is a matrix such that the ranking equilibrium is easily broken, the ranking reversal phenomenon could occur. When all pairwise comparison matrices are of approximate consistency, the ranking equilibrium could be broken by the dependence of different levels. The formula in (41) can be used to remind the decision maker notice the likelihood of ranking reversal in terms of a percentage.
5 Comparison and discussion

For the sake of comparison, a practical case is investigated in the following. In order to choose the best car among three alternatives of Acura TL, Toyota Camry and Honda Civic, four criteria with prestige, price, miles per gallon (MPG) and comfort are taken into consideration [25]. The hierarchy structure is shown in Figure 3 and the corresponding pairwise comparison matrices are presented in Tables 1-5, respectively. Using the eigenvalue method, the priorities of criteria and alternatives are computed. It is assumed that the final weights of three alternatives are written as and respectively. The obtained results are determined as This means that the best car is the Honda Civic [25].
Goal | Prestige | Price | MPG | Comfort | Priorities |
---|---|---|---|---|---|
Prestige | 1 | 1/4 | 1/3 | 1/2 | 0.0987 |
Price | 4 | 1 | 3 | 3/2 | 0.4250 |
MPG | 3 | 1/3 | 1 | 1/3 | 0.1686 |
Comfort | 2 | 2/3 | 3 | 1 | 0.3078 |
Prestige | Acura TL | Toyota Camry | Honda Civic | Priorities |
---|---|---|---|---|
Acura TL | 1 | 8 | 4 | 0.7071 |
Toyota Camry | 1/8 | 1 | 1/4 | 0.0702 |
Honda Civic | 1/4 | 4 | 1 | 0.2227 |
Price | Acura TL | Toyota Camry | Honda Civic | Priorities |
---|---|---|---|---|
Acura TL | 1 | 1/4 | 1/9 | 0.0633 |
Toyota Camry | 4 | 1 | 1/5 | 0.1939 |
Honda Civic | 9 | 5 | 1 | 0.7429 |
MPG | Acura TL | Toyota Camry | Honda Civic | Priorities |
---|---|---|---|---|
Acura TL | 1 | 2/3 | 1/3 | 0.1818 |
Toyota Camry | 3/2 | 1 | 1/2 | 0.2727 |
Honda Civic | 3 | 2 | 1 | 0.5455 |
Comfort | Acura TL | Toyota Camry | Honda Civic | Priorities |
---|---|---|---|---|
Acura TL | 1 | 4 | 7 | 0.7049 |
Toyota Camry | 1/4 | 1 | 3 | 0.2109 |
Honda Civic | 1/7 | 1/3 | 1 | 0.0841 |
The above solution procedure is typical with the loss of some flexibility about reciprocal property. Here the uncertainty experienced by the decision maker is considered and some comparison ratios are assumed to be with the breaking of reciprocal property. For example, the comparison ratios of criteria are changed and shown in Table 6. It is seen from Table 6 that the order of the four criteria has been rearranged. In terms of Definition 3.8, the judgements in Table 6 are not of approximate consistency. One can further find that there is a possible ”mistake”, since the values of and in the column are not descending. This phenomenon can be used to remind the decision maker notice the possible unreasonable behavior. The final weights of alternatives can be computed as and the Honda Civic is still the best choice. Here we want to point out that the uncertainty could yield the inconsistency and the breaking of reciprocal reciprocity. The feedback mechanism of reminding the decision maker could be more important than an inconsistent opinion in a practical case, since people are bound to make mistakes.
Goal | Price | Comfort | MPG | Prestige | Priorities |
---|---|---|---|---|---|
Price | 1 | 3/2 | 3 | 3.8 | 0.4292 |
Comfort | 2/3 | 1 | 3 | 1.5 | 0.3018 |
MPG | 1/3 | 1/3 | 1 | 2.8 | 0.1683 |
Prestige | 1/4 | 1/2 | 1/3 | 1 | 0.1007 |
At the end, we analyze the likelihood of ranking reversal. The comparison ratios in Table 6 are first considered and the rank matrices are determined as:
In terms of the formula (38), the possibility degree of ranking reversal is Moreover, we investigate the effect of the structural dependence on ranking reversal. The rank matrix is shown as follows:
After some computations, it follows In addition, it is found that the possibility degrees of pairwise comparison matrices with respect to any criterion is When choosing in the formula (41), the average possibility degree of ranking reversal is computed as:
This implies that the possibility degree of ranking reversal is about when adding or deleting an alternative and/or a criterion. From the above analysis, it is found that the contribution of the structural dependence to ranking reversal is much bigger than the dependence of criteria. This means that if adding a criterion, the ranking of alternatives may not be changed. However, if adding a new car to choose, the ranking of the old alternatives could be changed.
6 Conclusions
The investigations of the AHP choice model have been made for over forty years since it was developed by [21, 22]. There are two important problems in addressing the theory and applications of the AHP model. One is how to derive the ratio scale in relative measurement, and the other is the phenomenon of ranking reversal. The recent work related to the former has shown that the decision-making procedure based on the AHP model is reliable [4]. For the latter, numerical examples are always carried out and a theoretical analysis is lacking except for the observation in [28]. Here it is noticed that the reciprocal property in the axiomatic foundation of the AHP model is based on the mathematical intuition. From the viewpoints of subjective measurement and the uncertainty of human-originated information, a more flexible expression of decision information is requisite. Therefore, the concept of reciprocal symmetry breaking is proposed to allow the decision information without reciprocal property. A modified axiomatic foundation of the AHP model under uncertainty has been formed. Some interesting facts derived from the modified axioms have shown that the uncertainty experienced by the decision maker has been incorporated naturally. Moreover, the ranking reversal phenomenon has been reinvestigated according to the proposed axiomatic foundation. A novel concept of ranking equilibrium has been introduced to characterize the state without ranking reversal. The likelihood of ranking reversal has been quantified by providing an index to reflect the possibility occurring ranking reversal when adding or deleting an alternative and/or a criterion. The decision maker can be reminded by using a percentage for the ranking reversal phenomenon. The observations support the conclusion that a flexible expression of decision information with the breaking of reciprocal property could be allowed to some degree in the AHP choice model.
Acknowledgements
The work was supported by the National Natural Science Foundation of China (Nos. 71871072, 71571054), 2017 Guangxi high school innovation team and outstanding scholars plan, and the Guangxi Natural Science Foundation for Distinguished Young Scholars (No. 2016GXNSFFA380004).
References
- Altuzarra et al. [2010] Altuzarra A, Moreno-Jiménez JM, Salvador M (2010) Consensus building in AHP-group decision making: A Bayesian approach. Oper. Res. 58(6):1755–1773.
- Belton and Gear [1983] Belton V, Gear T (1983) On a shortcoming of Saaty’s method of analytic hierarchies. Omega 11(3):228–230.
- Belton and Gear [1985] Belton V, Gear T (1985) The legitimacy of rank reversal-A comment. Omega 13(3):143–144.
- Bernasconi et al. [2010] Bernasconi M, Choirat C, Seri R (2010) The Analytic Hierarchy Process and the theory of measurement. Management Sci. 56(4):699–711.
- Bernasconi et al. [2008] Bernasconi M, Choirat C, Seri R (2008) Measurement by subjective estimation: Testing for separable representations. J. Math. Psych. 52:184–201.
- Dyer [1990a] Dyer JS (1990a) Remarks on the analytic hierarchy process. Management Sci. 36:249–258.
- Dyer [1990b] Dyer JS (1990b) A clarification of “Remarks on the analytic hierarchy process”. Management Sci. 36:274–275.
- Field [2005] Field AP (2005) Kendall’s Coefficient of Concordance. (John Wiley & Sons, New York.)
- Forman and Gass [2001] Forman EH, Gass SI (2001) The analytic hierarchy process–An exposition. Oper. Res. 49(4):469–486.
- Gass [2005] Gass SI (2005) Model world: The great debate-MAUT versus AHP. Interfaces 35(4):308–312.
- Genest and Zhang [1996] Genest C, Zhang SS (1996) A graphical analysis of ratio-scaled paired comparison data. Management Sci. 42(3):335–349.
- Harker and Vargas [1987] Harker PT, Vargas LG (1987) The theory of ratio scale estimation: Saaty’s analytic hierarchy process. Management Sci. 33(11): 1383–1403, 1511.
- Harker and Vargas [1990] Harker PT, Vargas LG (1990) Reply to “Remarks on the analytic hierarch process” by J.S. Dyer. Management Sci. 36 269–273.
- Horn and Johnson [1985] Horn RA, Johnson CR (1985) Matrix Analysis. (Cambridge University Press, Cambridge.)
- Kendall [1970] Kendall MG (1970) Rank Correlation Methods (Fourth Version). (Griffin, London.)
- Liu et al. [2017] Liu F, Pedrycz W, Zhang WG (2017) Limited rationality and its quantification through the interval number judgments with permutations. IEEE Trans. Cybern. 47(12):4025–4037.
- Liu et al. [2020] Liu F, Zhang JW, Zhang WG, Pedrycz W (2020) Decision making with a sequential modeling of pairwise comparison process. Knowl. Based Syst. 195:105642.
- Luce [2002] Luce RD (2002) A psychophysical theory of intensity proportions, joint presentations, and matches. Psych. Rev. 109(3):520–532.
- Narens [1996] Narens L (1996) A theory of ratio magnitude estimation. J. Math. Psych. 40(2):109–129.
- Pérez [1995] Pérez J (1995) Some comments on Saaty’s AHP. Management Sci. 41(6):1091–1095.
- Saaty [1977] Saaty TL (1977) A scalilng method for priorities in hierarchical structures. J. Math. Psych. 15:234–281.
- Saaty [1980] Saaty TL (1980) The Analytic Hierarchy Process. (McGraw-Hill, New York).
- Saaty [1986] Saaty TL (1986) Axiomatic foundation of the analytic hierarchy process. Management Sci. 32 (7):841–855.
- Saaty [1990] Saaty TL (1990) An exposition of the AHP in reply to the paper “Remarks on the analytic hierarchy process”. Management Sci. 36:259–268.
- Saaty [2013] Saaty TL (2013) The modern science of multicriteria decision making and its practical applications: The AHP/ANP approach. Oper. Res. 61(5):1101–1118.
- Saaty and Shang [2011] Saaty TL, Shang JS (2011) An innovative orders-of-magnitude approach to AHP-based mutli-criteria decision making: Prioritizing divergent intangible humane acts. Eur. J. Oper. Res. 214:703–715.
- Saaty and Vargas [1984a] Saaty TL, Vargas LG (1984a) The legitimacy of rank reversal. Omega 12(5): 513–516.
- Saaty and Vargas [1984b] Saaty TL, Vargas LG (1984b) Comparison of eigenvalue, logarithmic least squares and least squares methods in estimating ratios. Math. Modelling 5:309–324.
- Saaty and Vargas [1987] Saaty TL, Vargas LG (1987) Uncertainty and rank order in the analytic hierarchy process, Eur. J. Oper. Res. 32(1):107–117.
- Saaty and Vargas [1998] Saaty TL, Vargas LG (1998) Diagnosis with dependent symptoms: Bayes theorem and the analytic hierarchy process. Oper. Res. 46(4):491–502.
- Simth and von Winterfeldt [2004] Smith JE, von Winterfeldt D (2004) Decision analysis in Management Science. Management Sci. 50(5):561–574.
- Winkler [1990] Winkler RL (1990) Decision modeling and rational choice: AHP and utility theory. Management Sci. 36(3):247–248.