Département d’informatique et de recherche opérationnelle, Université de Montréal, Montréal, Québec, H3T 1J4, [email protected]://orcid.org/0000-0002-4347-8931 Département d’informatique et de recherche opérationnelle, Université de Montréal, Montréal, Québec, H3T 1J4, [email protected] https://orcid.org/ 0000-0002-8941-2284Supported by NSERC through an Individual Discovery Grant RGPIN-2016-04576 \CopyrightX. K. Phung and S. Hamel \ccsdesc[100]Theory of computation Theory and algorithms for application domains; Applied computing Law, social and behavioral sciences; Mathematics of computing discrete mathematics \ccsdesc[100]Theory of computation Theory and algorithms for application domains; Applied computing Law, social and behavioral sciences; Mathematics of computing discrete mathematics
Space reduction techniques for the -wise Kemeny problem
Abstract
Kemeny’s rule is one of the most studied and well-known voting schemes with various important applications in computational social choice and biology [3, 4, 6, 8]. Recently, Kemeny’s rule was generalized via a set-wise approach by Gilbert et. al. in [13, 14]. This paradigm presents interesting advantages in comparison with Kemeny’s rule since not only pairwise comparisons but also the discordance between the winners of subsets of three alternatives are also taken into account in the definition of the -wise Kendall-tau distance between two rankings. In spite of the NP-hardness of the 3-wise Kemeny problem which consists of computing the set of -wise consensus rankings, namely rankings whose total -wise Kendall-tau distance to a given voting profile is minimized, we establish in this paper several generalizations of the Major Order Theorems, as obtained by Milosz and Hamel [19] for Kemeny’s rule, for the -wise Kemeny voting schemes to achieve a substantial search space reduction by efficiently determining in polynomial time the relative orders of pairs of alternatives. Essentially, our theorems quantify precisely the nontrivial property that if the preference for an alternative over another one in an election is strong enough, not only in the head-to-head competition but even when taking into account one or two more alternatives, then the relative order of these two alternatives in all -wise consensus rankings must be as expected. As an application, we also obtain an improvement of the Major Order Theorems for Kememy’s rule. Moreover, we show that the well-known -majority rule of Betzler et al. [6] for Kemeny’s rule is only valid in general for elections with no more than alternatives with respect to the -wise Kemeny scheme. Several simulations and tests of our algorithms on real-world and uniform data are provided.
keywords:
Kemeny problem, Kendall-tau distance, Kemeny rule, median permutation, computational social theorycategory:
\relatedversionkeywords:
Kemeny problem, Kendall-tau distance, Kemeny rule, Median permutation, Computational social choice, Major Order Theorems, Consensus ranking, Generalized Kemeny rulecategory:
\relatedversion1 Introduction
In this article, an election is a finite collection of alternatives together with a voting profile consisting of a finite number of (not necessarily distinct) votes. A ranking or a vote is simply a complete and strict total ordering which we identify with a permutation of also denoted by . Here, means that the alternative is ranked before the alternative . The space of all rankings, for fixed , can be equipped with several natural distances, for example, the Kendall-tau distance which counts the number of order disagreements between pairs of elements in two permutations, namely, the bubble-sort distance between two permutations, or more generally the -wise Kendall-tau distance [14] (see Equation (2.1)). The important Kemeny problem (cf. [15], [16], [26]) consists of finding the set of -wise medians of a given election, i.e., permutations whose total distance to the voting profile is minimized with respect to the -wise Kendall-tau distance. In other words, a median is a ranking that agrees the most with the voting profile.
By taking into consideration not only pairwise comparisons but also the discordance between the winners of subsets of three alternatives, the -wise Kemeny voting scheme seems to be more resistant to coalitional manipulation than the classical -wise Kemeny rule: it is much more difficult for an alternative to win an election or even to simply win another specific alternative in an election under the -wise Kemeny voting scheme. In fact, most of the best-known space reduction results for Kemeny’s rule fail in the -wise setting (see [21, Table 1]), including the powerful Major Order Theorems discovered in [19] (see Example 5.1) and the Condorcet criterion. It was shown in [21] that even the majority in every duel is not enough to guarantee that an alternative will win an election according to the -wise Kemeny voting scheme. This phenomenon is in stark contrast to the Condorcet criterion where a Condorcet winner, namely an alternative which is preferred by more voters than any others, must be the unique winner of the election. Nevertheless, we know that an alternative obtaining a majority in every duel must be the unique winner in the -wise Kemeny voting scheme [21].
In many situations, the -wise Kemeny rule is also more suitable than Kemeny’s rule since it puts more weight on alternatives which are more frequently ranked in top positions in the votes. Indeed, Kemeny’s rule puts equal weight on the head-to-head competition of two alternatives when in a particular vote, is the winner followed by and when in another vote, and occupy the last two position in that order. However, it is reasonable to assume that typical voters only pay attention to a shortlist of their favorite alternatives and put a rather random order for the rest of the alternatives. Such undesirable behavior creates noises that can alter the Kemeny median ranking while the problem can be solved effectively using the -wise Kemeny voting scheme in specific instances (see Example 5.1 and Appendix B). The above limitation of the Kemeny rule leads to the notion of weighted Kendall tau distances introduced by Kumar and Vassilvitskii [17] as well as the notion of set-wise Kemeny distance of Gilbert et. al. [14].
Motivated by the above potential and interesting features of the -wise Kemeny rule as well as the NP-hardness of the various Kemeny problems (see [arrow], [12], [14]), our main goal is to formulate new quantitative results concerning the majority rules in -wise Kemeny voting schemes associated with the -wise Kendall-tau distance introduced recently in [14], which provide much more refined space reductions to the Kemeny problem in comparison to existing techniques in the literature. Our first result (cf. Theorem 3.1) shows that the fundamental -majority rule of Betzler et al. [6] for the classical Kemeny rule is also applicable for all elections with no more than alternatives with respect to the -wise Kemeny scheme. However, the -majority rule fails in general as soon as there are at least alternatives. Note that without restriction on the number of alternatives, the -majority rule obtained in [21] serves as the -wise counterpart of the -majority rule.
The second and central result of the paper is the Major Order Theorem for the -wise voting scheme, denoted 3MOT (Theorem 5.4), and its improved version, denoted Iterated 3MOT (Theorem 6.2), which, to the limit of our knowledge, are the most efficient space reduction techniques for the -wise Kemeny rule in the literature. In essence, our Major Order Theorems show that if the preference for an alternative over another alternative in an election is strong enough, as measured quantitatively not only in the head-to-head competition but also when taking into account the interactions with one or two more other alternatives, then must be ranked before in all -wise medians of the election. The corresponding algorithms not only function efficiently in polynomial time , where is the number of alternatives and is size of the voting profile, but also drastically reduce the search space of -wise medians. To get an idea on the efficiency and interests of our results, let be the proportion of pairs of alternatives solved by 3MOT or Iterated 3MOT out of the total of pairs. Then the original search space consisting of all possible rankings would be reduced by a factor (reduction rate) at least equal to (cf. [linear-extension-2018, Lemma 2, Lemma 4], see also Table 2)
(1.1) |
On real-world data, especially for political elections and competitions where there exists a high similarity between the votes, our algorithms prove to be particularly useful as usually ranges from to after only a few iterations of Iterated 3MOT (see Table 2 and also Appendix C.1 for some concrete examples). The performance is also very encouraging even on the hard case of uniformly generated data where, for example when , the -wise Major Order Theorems can determine the relative rankings of approximately pairs of alternatives on average when and approximately when .
Our results not only extend and improve the important -wise Major Order Theorem of [19] (see Section 2.4 and Theorem 7.1) but also provide a unified approach and technique which should pave the way for the research of more refined algorithms and quantitative properties of -wise Kemeny voting schemes for . It is worth comparing our method to the space reduction method based on a -wise majority digraph introduced in [14, Theorem 3] whose vertices are the alternatives. While we can obtain, under some assumptions on the -wise digraph of an election, a set of rankings which contains some -wise median using [14, Theorem 3], our -wise Major Order Theorems provide, for all pairs of alternatives , easy-to-compute and mild sufficient conditions so that in all -wise medians. In fact, by relaxing the conditions in our Major Order Theorems, we can determine more relative orderings of a pair of alternatives in some 3-wise median (see Theorem 8.1). Another major difference is that [14, Theorem 3] only considers the strength of the preference for over in the presence of one other alternative while the -wise Major Order Theorems quantify the preference for over not only in the head-to-head competition but even when taking into account one or two more alternatives, which should provide a more refined space reduction method (see Example 6.4). In any case, the constraints on all -wise medians found by our 3-wise Major Order Theorems should greatly accelerate other complementary space reduction methods and vice versa, nontrivial constraints obtained by other methods can serve as the inputs to boost our algorithms, especially Iterated 3MOT. Table 1 below summarizes our results and some well-known space reduction criteria for the classical and -wise Kemeny voting schemes.
Criterion | Kemeny rule | -wise Kemeny rule |
---|---|---|
Extended Always theorem (Pareto efficiency, unanimity) | Phung & Hamel [21, Theorem 3] | Phung & Hamel [21] (Theorem C.4) |
-majority rule (Section 2.3) | Betzler et al. [6] | Valid only for elections of alternatives or less, Theorem 3.1 |
Extended -majority rule | Phung & Hamel [21, Section 4] | Valid if [21, Section 8] |
Major Order Theorems | Milosz & Hamel [19] (Section 2.4) Improved Iterated MOT (Theorem 7.1) | Not valid, see Example 5.1 |
-wise Major Order Theorems | Theorems 5.4, 6.2, 8.1. |
To illustrate the utility of our obtained algorithms, we performed several simulations and tests on real-world and uniform data. Table 3 and Table 4 in Appendix C record the approximate average proportion of pairs with relative order solved by the -wise Extended Always Theorem obtained in [21] (see Theorem C.4) and the 3-wise Major Order Theorems over 100 000 uniformly generated instances. Several concrete examples with real-world data (elections with a dozen and up to 250 alternatives) taken from PREFLIB [18] are described in Appendix C.1 (see also Table 2). A direct implementation shows that for voting profiles with , the list of all pairs of alternatives with relative order in all -wise medians determined by 3MOT, resp. Iterated 3MOT, can be obtained in approximately less than 2.5 seconds, resp. 1 minute, with an M1 MacBook Air 16GB RAM. More optimized implementation can definitely improve the running time of the algorithms.
Finally, we explain how to apply our results and the set-wise Kemeny rule to deal with incomplete votes in Section 9 and propose the usage of the proportion of pairs whose relative order are determined by the -wise Major Order Theorems as a meaningful measure of the consensus level of the electorates (see Appendix A).
2 Preliminaries
We recall in this section the classical 2-wise Major Order Theorems, the -majority rule as well as the definition of -wise medians and -wise Kendall-tau distance.
2.1 The -wise Kemeny rule
Let be an integer and let be a finite set of alternatives. Let be the set of all rankings of . Let be the collection of all subsets of which contain no more than elements. By counting the number of winner disagreements on all subsets taken from , the -wise Kendall-tau distance between two rankings of is defined by (cf. [14]):
(2.1) |
where and denotes the highest ranked element of the restriction of to . The -wise Kendall-tau distance between a ranking of and a collection of rankings of is . Given a voting profile over , we say that a ranking of is a median with respect to the -wise Kemeny rule or a -wise median if . For , we recover the Kendall-tau distance . It was shown in [14] that the decision variant of the -wise Kemeny problem is NP-complete for every .
2.2 Transitivity lemma
Definition 2.1.
Let be alternatives in an election with voting profile and let . When is ranked before in a vote , we denote or simply when there is no possible confusion. We write , resp. , if in at least, resp. in more than, votes.
The following simple but very useful observation serves as a weak transitivity property.
Lemma 2.2.
Let be three distinct alternatives in an election with voting profile . If and for some , then in at least votes, we have , i.e., and .
Proof 2.3.
Let be the sets of votes in which and respectively. Since and , we deduce that and . Consequently, from the set equality , we obtain the following estimation . Since in every vote , we have , the conclusion thus follows.
2.3 The -majority rule
Following [6], a non-dirty pair of alternatives in an election with respect to a threshold is a pair such that either is ranked before in at least votes, or ranked before in at least votes. Then we say that an alternative is non-dirty if is a non-dirty pair with respect to the threshold for every other alternative . An election with a certain voting rule satisfies the -majority rule if for every non-dirty candidate with respect to the threshold and every other candidate , the relative positions of the pair in every median is determined by the head-to-head majority rule. By pioneering results in [6], every election satisfies the -majority rule with respect to the -wise Kemeny voting scheme. We shall prove in Section 3 that with respect to the -wise Kemeny voting scheme, the -majority rule holds for all elections with no more than alternatives but fails in general otherwise.
2.4 The classical -wise Major Order Theorems
Since the scattered foundational works of Condorcet [11] in 1785, of Truchon [24] in 1990, of Kemeny [15] in 1959, of Young-Levenglick [25] in 1978, and of Young [26] in 1988, only the last two decades have witnessed the most important discoveries in the NP-hardness complexity (Bachmeier et al. [arrow], Dwork et al. [12]), in heuristic and approximation algorithms (Ailon et al. [1], Ali-Meilă [2], Nishimura-Simjour [20], Schalekamp-van Zuylen [22]), in lower bounds (Cotnizer et al. [9], Davenport-Kalagnanam [10]), and in exact space reduction techniques (Betzler et al. [6], Blin et al. [7], Milosz-Hamel [19], Phung-Hamel [21]) of the Kemeny problem. Among the space reduction techniques, the Major Order Theorems obtained in [19] provide some of the most efficient known algorithms. Such theorems are based on the observation that if two alternatives are close enough in all votes they will have the tendency to be placed in their major order in any consensus ranking. To state the theorems, let be two alternatives of an election with voting profile over a set of alternatives . Let denotes the difference between the number of votes in which and respectively in which . Let (called the interference set) be the multiset containing all alternatives such that in some vote where the multiplicity of is the number of votes in which .
Theorem 2.4 (MOT, [19]).
Suppose that in more than half of the votes and . Then is ranked before in every -wise median of the election.
If we iterate Theorem 2.4 by eliminating from the interference set all alternatives which have been found to rank before (or after) both and by previous iterations to obtain the trimmed interference set , we obtain an iterated version of Theorem MOT (see Corollary 7.3 for another formulation).
Theorem 2.5 (Iterated MOT, [19]).
If in more than half of the votes and for some , then is ranked before in every -wise median of the election.
Over uniformly distributed elections with alternatives and votes, Iterated MOT can solve on average more than 50 of possible relative orders of all pairs of alternatives [19].
3 The -wise -majority rule for elections with no more than 5 alternatives
In this section, we shall prove that for the -wise Kemeny voting scheme, the -majority rule holds in general only for elections of at most alternatives.
Theorem 3.1.
Let be an integer. The -majority rule holds for all elections of alternatives with respect to the -wise Kemeny voting scheme if and only if .
Theorem 3.1 results directly from Lemma 3.2 and Lemma 3.4 below which prove each of the two implications in Theorem 3.1.
Lemma 3.2.
For every , the -majority rule fails for some elections consisting of alternatives with respect to the -wise Kemeny voting scheme.
Proof 3.3.
Let be an integer. Let denote the ranking . Let us consider the following voting profile consisting of votes over alternatives
Let be a -wise median of the above election. Then by the -wise Extended Always theorem [21], the first positions in is given by . Hence, we can write where is a ranking of the alternatives . It is then clear from the definition of that is a -wise median if and only if is a -wise median of the following induced election :
The only -wise medians of are and . Consequently, or where and . Therefore, the election admits as a non-dirty alternative according to the threshold since , , and for all . However, is ranked after in both and . Thus, the -majority rule fails for all -wise medians of .
Lemma 3.4.
The -majority rule holds for all elections of at most alternatives with respect to the -wise Kemeny voting scheme.
Lemma 3.5.
Let be a set of 4 alternatives in an election such that , and , and . Then the contribution of the pair of subsets and to is at most .
Proof 3.6.
Let be the number of votes. Then by the definition of , the maximal contribution (divided by ) of the pair of subsets and to is the optimal objective value of following maximization problem over variables where denotes a strict ranking of the alternatives :
maximize: | ||||
subject to: |
Here, represents the number of votes in with ranking and , , , represent respectively the positions of in . Since the optimal objective value of the above optimization problem is (a Python code is available at https://github.com/XKPhung), the proof is complete.
Generalizing the usage of linear programming in the above lemma 3.5, we obtain the following proof of Lemma 3.4 which shows that the -wise -majority rule holds for all elections with no more than alternatives.
Proof 3.7 (Proof of Lemma 3.4).
Let us fix a positive integer and a set of alternatives. Let denotes the set of all rankings over with the convention that denotes the position of the alternative in the ranking .
Then observe that the -wise -majority rule fails for some election with exactly alternatives if and only if there exist {romanenumerate}
a voting profile over consisting of votes with ranking for each ;
a non-dirty alternative with respect to and the threshold where, up to renumbering the alternatives, we can assume that for all and for all ;
a "bad" ranking with respect to the -majority rule, i.e., for some ; such that is at least as good as a -wise consensus as any "good" ranking , i.e., for all . In other words, for every good ranking , we have:
(3.1) |
Let be respectively the set of all bad rankings and the set of all good rankings. By homogeneity, we can furthermore suppose that for each and . Consequently, the existence of the data in (i), (ii), and (iii) satisfying the relation (3.1) is equivalence to the existence of , and the satisfiability of the following system of linear constraints on the variables :
where the constants are defined as follows {alphaenumerate}
if and otherwise;
.
It is immediate that the conditions for all translate the property that is a non-dirty alternative satisfying (ii). Moreover, we have:
Thus, the conditions for all altogether translate the property (3.1) for all . We can check by a direct implementation with linear programming (see, e.g., a python code at https://github.com/XKPhung) that the system does not admit a solution for any value of and as long as . Therefore, we can conclude that the 3-wise -majority rule holds for all elections with no more than alternatives.
4 Some weak versions of the 3-wise 3/4-majority rule
For elections with alternatives, we have the following weak form of the -wise -majority rule.
Theorem 4.1.
Let be a set of alternatives. Suppose that in an election over , we have a partition where such that for all and for all . Then the election satisfies the -wise -majority rule.
Proof 4.2.
The proof follows immediately by using a similar translation procedure to a problem in linear programming as described in detail in the above proof of Lemma 3.4.
By results in [21], the -wise -majority holds for all non-dirty alternatives which win every duel by the ratio . For non-dirty alternatives which lose the head-to-head competition to exactly one other alternative, we have the following useful results. We drop the symbol in a ranking for simplicity.
Theorem 4.3.
Let be a partition of the set of alternatives of an election such that and for all . Then the following properties hold:
-
(a)
For all partitions where are ordered sets with , we have:
-
(b)
For all partitions where are ordered sets with , we have:
-
(c)
For all partitions where are ordered sets with , , we have:
Proof 4.4.
For (a), let us consider the rankings and where is a partition with ordered sets. Then the only subsets that can contribute to
are and where . Since and , we have in at least half of the votes (Lemma 2.2). It follows that the contribution of every subset to is at most . Likewise, the contribution of the subset to is at most . Therefore, and (a) follows by an immediate induction.
For (b), let and let us consider two rankings and where is a partition with ordered sets. Then the only subsets that can contribute to
are , , and , for all . Since and , we have (Lemma 2.2). Hence, the pair contributes at most to and the pair contributes at most to .
Lemma 3.5 shows that for every , the pair of subsets and contributes at most to . To summarize, we have proved that . It is then clear that (b) follows by an immediate induction.
For (c), the only subsets that can contribute to
are , , , and for all and . Since , the contribution of the pair to is at most
Since and for all , we have by Lemma 2.2 and thus the contribution of all such pairs is at most .
Let . Under the assumption that and , linear programming (see, e.g., https://github.com/XKPhung) shows that the contribution of the subset to is at most . Hence, the total contribution of such subsets () to is at most
Similarly, under the assumption that and , linear programming (a Python code is available at https://github.com/XKPhung) shows that for all and , the contribution of the subset to is at most . Hence, the total contribution of such subsets is at most
To summarize, we deduce the following estimation:
Since and , by substituting all possible values of , we deduce that and the proof of (c) is complete.
5 -wise Major Order Theorem and applications
5.1 Major Order Theorems fail for the -wise Kemeny voting scheme
The example below shows that all the Major Order Theorems established in [19] fail for the -wise Kemeny voting scheme. The discussion following Example 5.1 also explains why the -wise Kemeny voting scheme is more suitable than the Kemeny rule to avoid manipulations.
Example 5.1.
Let us consider the example taken from [21]. Let be a set of 4 alternatives and consider the voting profile :
Then is the unique -wise median of the election. Note that the Major Order Theorems in [19] do not hold for the pair of alternatives in the above election with respect to the -wise Kemeny voting scheme. Indeed, in a majority of the votes and the multiset consisting of alternatives with in a vote is empty so that the conditions in the Major Order Theorems are satisfied. However, we have in the unique -wise median of the election.
5.2 -wise Major Order Theorem
Definition 5.2.
Let be a voting profile. Let be some alternatives of the election. Then we denote by or simply the number of votes in in which the relative orders of is . For two alternatives , we also define . If , we say that the major order and the minor order of the pair are respectively and .
Definition 5.3.
For alternatives of an election with voting profile , we define
The underlying idea is that the quantity captures the preference of the alternative over the alternative in the presence of the alternatives , . On the other hand, and are certain measures of the preference of over when comes into play. Note that (see Lemma 5.8 below). Hence, the intuition is that if the preference for over in the election is strong enough, not only in the head-to-head competition but even when taking into consideration one or two more alternatives, then and tend to be positive while should be negative. To quantify the above intuition and the interplay between the quantities , , and , we establish the following -wise Major Order Theorem in the vein of the various Major Order Theorems [19] for the classical Kemeny rule.
Theorem 5.4 (3MOT).
Let be two alternatives of an election with voting profile over a set of alternatives . Suppose that is the major order and
-
(i)
for all ,
-
(ii)
.
Then is ranked before in every -wise median of the election.
The following observation is clear.
Lemma 5.5.
The theoretical time complexity of the corresponding algorithm of 3MOT to determine the relative order of pairs of alternatives is where is the number of alternatives and is the number of votes. ∎
For the proof of 3MOT, we need to establish a series of auxiliary results. The first lemma is the following simple but useful observation.
Lemma 5.6.
Given distinct alternatives in an election, the following relations hold:
where the quantities , , , etc. are defined in Definition 5.2.
Proof 5.7.
For the relation , it suffices to observe that for each vote where , we have exactly three mutually exclusive possibilities according to three possible relative positions of with respect to and , namely, or or . A similar argument shows that .
The next lemma describes the relation between the quantities and , .
Lemma 5.8.
For all distinct alternatives in an election, we have
Proof 5.9.
By direct computation, we infer from Lemma 5.6 and the definition of , , , , and that:
Therefore, and the proof is complete.
The next lemma allows us to express the quantity as a sum of , , and , .
Lemma 5.10.
For all distinct alternatives in an election, we have:
Proof 5.11.
Therefore, we obtain
(5.1) |
and the proof is thus complete.
We can now state the following key technical lemma in the proof of 3MOT. The main point is that Lemma 5.12, using only the quantities of the form , , , , allows us to compare simultaneously two potential consensus rankings with a given ranking where one would like to switch the relative order of a certain pair of alternatives.
Lemma 5.12.
Let , , and be three rankings of an election where are linearly ordered sets of alternatives. For , let . Then we have:
(5.2) |
Proof 5.13.
By the definition of , , and the -wise Kendall-tau distance , we find that:
and similarly
Hence, we deduce that:
(5.3) |
On the one hand, we have and for all distinct alternatives by Lemma 5.10. Therefore,
(5.4) |
On the other hand, since for all distinct alternatives by Lemma 5.8, we deduce that:
(5.5) |
We can finally give the proof of 3MOT.
Proof 5.14 (Proof of Theorem 5.4).
Suppose on the contrary that is a -wise median of the election where are ordered sets of alternatives. We will show that for the rankings and , there exists such that
Indeed, by Lemma 5.12 on the differences and , we find that:
(5.6) |
We deduce that by conditions (i) and (ii). Note that the inequality is strict by condition (ii). Therefore, there exists such that . In other words, would then be a strictly better -wise Kemeny consensus than , which contradicts the hypothesis that is a -wise median of the election. Therefore, the alternative must be ranked before in every -wise median of the election.
Example 5.15.
In Example 5.1 where the Major Order Theorems [19] fail with respect to the -wise Kemeny voting scheme, the -wise Major Order Theorem 5.4 tells us that in every -wise median, we have and . Therefore, in every -wise median and we only need to determine the position of the alternative , i.e., to check which of the following 4 rankings is the -wise median:
The research space is thus reduced by times. Note that is the unique -wise median.
5.3 Applications on consecutive alternatives in a median
As an immediate consequence of the above proof of Theorem 5.4, we obtain the following criteria for the ranking of two consecutive alternatives in a -wise median which extends the corresponding criteria for the classical Kemeny rule [7].
Theorem 5.17.
Let be two consecutive alternatives in a -wise median ranking of an election. Suppose that . Then must be ranked before in .
Proof 5.18.
Suppose on the contrary that where are ordered sets of alternatives. Let , we denote
Corollary 5.19.
Let be two consecutive alternatives in a -wise median of an election. If is the major order and for every alternative , then must be ranked before in .
Proof 5.20.
Since for every alternative , we have thus and . Hence, as is the major order, we deduce that
and the result follows from Theorem 5.17.
6 Iterated -wise Major Order Theorem
Developing the ideas of the classical Iterated MOT (Theorem 2.5), we can strengthen even further the -wise Major Order Theorem 5.4 based on the following two observations. The first one is the transitivity of preferences in a single ranking as used in the proof of Theorem 2.5. Suppose that and are ordered pairs of alternatives found by the -wise Major Order Theorem 5.4 such that and in every -wise median. Then by transitivity, we also have in every -wise median.
The second observation is similar but slightly more sophisticated. Suppose that we know and in every -wise median. Then it is clear that a -wise median of the election must be of the form or where are ordered set of alternatives such that . Then we can completely ignore such an alternative in conditions (i) and (ii) in the -wise Major Order Theorem 5.4. Similarly, if we know that and in every -wise median, then we can ignore the alternative in condition (ii) in the outermost summation. In fact, Theorem 6.2 shows that we can even further relax conditions (i) and (ii) by a more careful analysis.
We can obviously iterate in parallel the above two processes corresponding to the two observations to obtain larger and larger sets consisting of constraints determined by ordered pairs of alternatives until these sets stabilize. Hence, we obtain the following iterated version of the -wise Major Order Theorem.
Definition 6.1.
Let be an election. Let be an anti-symmetric set consisting of ordered pairs of distinct alternatives in the election with no two pairs violating the transitivity property, i.e.,
-
(a)
whenever ,
-
(b)
whenever .
We denote by the transitive closure of : if then . We define also
Theorem 6.2 (Iterated 3MOT).
Let be an election over a set of alternatives . Let and for , we define inductively as the set of ordered pairs of distinct alternatives such that
-
(i)
for all ,
-
(ii)
where and . Then for every integer , we have . Moreover, if for some , the alternative is ranked before in every -wise median of the election.
Proof 6.3.
Since , we have trivially. Note that is exactly the set consisting of ordered pairs of distinct alternatives satisfying Theorem 5.4. The first assertion for all is then clear by an immediate induction on using the definition of conditions (i) and (ii) and the obvious properties , , and for all .
Consider the second assertion that is ranked before in every -wise median of the election whenever for some . The case results directly from Theorem 5.4. Assume that the second assertion of Theorem 6.2 holds for some and let . Suppose on the contrary that is a -wise median of the election where are ordered sets of alternatives. Consider the rankings and as in the proof of Theorem 5.4. Then for
we also have (cf. Lemma 5.12):
(6.1) |
By our induction hypothesis, we have and . Consequently, we find that
(6.2) | ||||
We deduce that either or . Thus, either or is a strictly better -wise consensus than , which is a contradiction to the choice of . Hence, must be ranked before in every -wise median whenever . As every -wise median of is a linear, strict, and complete ranking of the set of alternatives, it follows from the transitivity that must be ranked before in every -wise median whenever . The proof is complete.
In practice, Theorem 6.2 requires 3 to 6 iterations. We now compare Theorem 6.2 with the 3-wise majority digraph method of Gilbert et al. [14, Theorem 3] on the voting profile taken from [14, Example 5].
Example 6.4.
Consider the following voting profile over a set of 6 alternatives:
By [14, Theorem 3], there is some 3-wise median of among the 4 rankings , , , and . On the other hand, Iterated 3MOT (Theorem 6.2) obtains (after 4 iterations) the following constraints and in all 3-wise medians of . Consequently, Iterated 3MOT implies that every 3-wise median must be one of the following 3 rankings , , and . Note that the only 3-wise median of is .
7 Improved Iterated MOT
As a byproduct of our technique, we also obtain the following net improvement of Iterated MOT of Milosz and Hamel (Theorem 2.5) for classical Kemeny voting scheme.
Theorem 7.1.
Let be an election over a set of alternatives . Let and for every , we define inductively as the set of ordered pairs of distinct alternatives such that where . Suppose that for some . Then is ranked before in every -wise median of the election.
Indeed, in Theorem 7.1, if we replace by a larger set
for all then we obtain as a consequence Iterated MOT (see Corollary 7.3 and Lemma 7.5). Therefore, in comparison with Iterated MOT, Theorem 7.1 will either find more constraints on the relative orders of pairs of alternatives in all 2-wise medians or reduce the number of required iterations otherwise.
Proof 7.2 (Proof of Theorem 7.1).
We proceed by induction on as in the proof of Theorem 6.2. The case is trivial since . Assume that the conclusion holds for some integer and let . Suppose on the contrary that is a -wise median of the election where are ordered sets of alternatives. Let and . Let where . We find by a direct inspection that:
By our induction hypothesis, we have and . Therefore,
Consequently, since , we deduce that
Hence, for some and is a strictly better -wise consensus than , which contradicts the choice of . Thus, is ranked before in every -wise median whenever . By transitivity, must be ranked before in every -wise median whenever . The proof is complete.
As a direct consequence of Theorem 7.1, we obtain the following weaker result which turns out to be equivalent to Iterated MOT (Theorem 2.5).
Corollary 7.3.
Let be an election over a set of alternatives . Let and for every , we define inductively as the set of ordered pairs of distinct alternatives such that where . Suppose that for some . Then is ranked before in every -wise median of the election.
Proof 7.4.
By an immediate induction on , it is clear that and for all integers . Indeed, the case is trivial. For the induction step, it suffices to use the the induction hypothesis and observe that (cf. Definition 6.1)
which subsequently imply and thus .
Lemma 7.5.
Proof 7.6.
Let be an election over a finite set of alternatives and let the notations be as in Theorem 2.5 and Corollary 7.3. Then for all distinct alternatives , it is not hard to see that and . Similarly, let then for all , we have and . Moreover, we infer from Lemma 5.6 that
Therefore, for every , the condition in Theorem 2.5 is equivalent to the condition in Corollary 7.3. The proof is thus complete.
8 -wise Major Order Theorem with equality
In the case when we are only interested in obtaining the relative ordering of a pair of alternatives in some -wise median (and thus not necessarily in every -median), we can apply the following augmented version of the -wise Major Order Theorem 5.4.
Theorem 8.1 (3MOTe).
Let be two alternatives of an election with voting profile over a set of alternatives . Suppose that and
-
(i)
for all ,
-
(ii)
.
Then is ranked before in some -wise median of the election.
Proof 8.2.
The proof is the same, mutatis mutandis, as the proof of Theorem 5.4 where we notice that the inequality (cf. (5.6)) is no longer strict but it is enough to conclude that either the ranking or is at least as good as as a -wise consensus of the election. The conclusion follows since in the rankings and , we have .
9 Concluding remarks with extended set-wise Kemeny schemes
In real-life data, we can occasionally encounter incomplete rankings of alternatives, notably in surveys and political elections using for example the Single transferable vote method. These particular situations correspond very well to the reasonable assumption that typical voters only pay attention to the ranking of a shortlist of their favorite alternatives and put a rather random order for the rest of the alternatives in complete votes or simply do not indicate any preferences on such alternatives. To deal with such a situation using the -wise Kemeny voting scheme, we shall suppose that in an incomplete vote, all the alternatives which are not ranked will equally occupy the last position. The -wise Kendall-tau distance can still apply for such incomplete rankings as well as the notion of the -wise median, or more generally, -wise median for every . The above method clearly increases the range of applicability of set-wise Kemeny voting schemes. See Appendix C.1 and Table 2 for some examples with real elections. We also observe that -wise Kemeny voting scheme can be applied for committee elections where we would like to select a shortlist consisting of an arbitrarily fixed number of best alternatives according to certain criteria.
Appendix A -wise Major Order Theorem as a measure of consensus
We can observe that in an election, the proportion of pairs whose relative order are determined by the -wise Major Order Theorems (Theorem 5.4 and Theorem 6.2) can be used as a good measure of the consensus level of the electorates. Hence, a high percentage of such pairs means that the electorates, as a whole, agree on the relative rankings of a high percentage of pairs of alternatives, since every -wise median admits the same relative rankings on such pairs. We thus arrive as the following definition.
Definition A.1.
Let be an election over alternatives and let be the number of pairs which satisfy conditions (i) and (ii) in Theorem 5.4, and let be the number of pairs in in Theorem 6.2. Then the -consensus level of the election is defined by:
(A.1) |
Similarly, the -consensus level of the election is defined by:
(A.2) |
In particular, if the consensus levels , of an election are high, then we have a lot of restrictions on the possibilities of -wise medians and thus the total number of possible -wise medians is small. Clearly, a small number of -wise medians of an election is a good indicator that the voters in the electorate tend to agree with each other. See Table 2 for the consensus level and of several real-world elections recorded in PREFLIB [18] and Table 3, Table 4 for the average consensus level of random elections for several different values of the numbers of alternatives and votes.
Appendix B -wise scheme can be more resistant to manipulation
Note that the unique -wise median of the election in Example 5.1 is . Therefore, the unique -wise winner is while arguably, the more convincing winner should be instead. Indeed, consider the following imaginary election over the same 4 alternatives representing 4 different political parties. Assume that the electorate consists of 11 million voters and the preferences of 10 million voters are fixed as follows.
Suppose that the remaining group of 1 million voters prefer and in that order and simply ignore the alternatives . Hence, we can reasonably assume that among these voters, roughly half of them chose (see ) and the other half chose (see ). Consider the following voting profile where exactly half of the group prefer over :
Then the only -wise medians of the election are and . Moreover, if more than half of the group prefer over then is the unique -wise median. Similarly, if more than half of the group prefer over then is the unique -wise median. In other words, the group ultimately decides or by the majority rule as the unique -wise winner. Consequently, if more than half of the group chose , for example by strategic voting or under the influence of manipulative forces and even bribery of the political party of , the ranking will be the unique -wise median where surpasses and emerges as the unique -wise winner. On the other hand, the ranking remains the unique -wise median and thus is the indisputable -wise winner of the election regardless of the preferences between and of voters in the group (by the computation with the voting profile ), even if all the voters in chose . Therefore, we conclude that in such situations, the -wise Kemeny voting scheme should be preferred over the classical Kemeny rule to avoid undesirable outcomes and manipulations.
Appendix C Simulations on real-world and uniform data and applications
C.1 Examples with real-world data from PREFLIB
Example C.1.
To illustrate, consider the 2007 Glasgow City Council elections which were held by Ward (cf. [18, Dataset 00008] and the data available on Wikipedia). Out of the total 21 Wards, the EastCentre Ward was allocated 4 seats in the city council which were chosen using the Single transferable vote method among 13 alternatives by 9078 valid votes. The alternatives are:
-
1)
Jim Adams
-
2)
Patricia Chalmers
-
3)
Elaine Cooper
-
4)
Drew Dickie
-
5)
Frank Docherty
-
6)
Jennifer Dunn
-
7)
Stuart Grieve
-
8)
David Johnston
-
9)
John Kerr
-
10)
Elaine Mcdougall
-
11)
William Mclachlan
-
12)
Daniel O’Donnell
-
13)
Randle Wilson
We shall identify each alternative with the order given above. Under the above described extended -wise Kemeny voting scheme, the -wise Major Order Theorem 5.4 determines 67 pairs (out of 78 possible pairs) of the relative order of the form , which means that in every -wise median:
Therefore, in every -wise median, we have
Hence, according to the -wise Kemeny scheme, the alternatives 2,5,6,10, namely, Patricia Chalmers, Frank Docherty, Jennifer Dunn, and Elaine Mcdougall, must win the Ward election. It turns out that the above -wise election result coincides with the official result using the Single transferable vote method used in the 2007 Glasgow City Council elections.
Similarly, for the Shettleston Ward, there were 8803 valid votes to determine 4 seats from 11 alternatives:
-
1)
Mick Eyre
-
2)
Walter Hamilton
-
3)
Wheatley Harris
-
4)
David Jackson
-
5)
Gordon Kirker
-
6)
Catherine Maguire
-
7)
Tom Mckeown
-
8)
John F. Mclaughlin
-
9)
Euan Mcleod
-
10)
George Ryan
-
11)
Alex White
The -wise Major Order Theorem 5.4 determines the relative order of 45 pairs (out of 55 possible pairs) from which we deduce that:
in every -wise median. Hence, if we were to follow the -wise Kemeny voting scheme, the 4 seats would belong to Tom Mckeown, John F. Mclaughlin, Euan Mcleod, and George Ryan, which is exactly the same official result of the election using the Single transferable vote method.
The Newlands Ward has 3 seats to be determined from 8654 valid votes among 9 alternatives:
-
1)
Kay Allan
-
2)
Charlie Baillie
-
3)
Eamonn Coyle
-
4)
Stephen Curran
-
5)
Colin Deans
-
6)
Robert Mcelroy
-
7)
Jim Mcnally
-
8)
Gordon Morgan
-
9)
Robert W Stewart
The -wise Major Order Theorem 5.4 implies that in every -wise Kemeny. Hence, Stephen Curran, Colin Deans, and Jim Mcnally win according to the -wise Kemeny rule. Again, the same official result holds using the Single transferable vote method.
Our next example concerns one of the most important elections conducted with the Instant Runoff Voting (IRV) method.
Example C.2.
Consider the UK Labor Party Leadership election in 2010 (see [18, Dataset 00030] and ) whose valid electorate consists of 266 voters to vote for the following 5 alternatives identified with their number:
-
1)
Diane Abbott
-
2)
Ed Balls
-
3)
Andy Burnham
-
4)
David Miliband
-
5)
Ed Miliband.
While the number of pairs of the form , which means that in every median, determined by the Unanimity property is zero, the Extended -wise Always Theorem [21] applies and finds 6 such pairs out of 10 pairs in total, namely, , , , , , . Hence, we deduce that and in every -wise median of the UK Labor Leadership election in 2010. In fact, by the -wise Major Order Theorem (Theorem 2.4), the unique -wise median of the election is .
With respect to the -wise Kemeny rule, the -wise Extended Always Theorem [21] (Theorem C.4) determines the preferences of each pair (in the given order) , , , . Therefore, we have in every -wise median that .
On the other hand, the 3MOT (Theorem 5.4) determines 9 out of the total 10 pairs:
The remaining pair is found by Iterated 3MOT (Theorem 6.2) after two iterations and thus the unique -wise median of the election is given by
which coincides with the unique -wise median. Consequently, the unique -wise winner is David Miliband, who is also the winner with plain plurality (first-past-the-post), a method used in a preceding election in 1994. Note that the official winner (under the IRV method) is Ed Miliband, who won only by a small margin against David Miliband.
Example C.3.
Table 2 describes the efficiency of the -wise Major Order Theorems on real-world examples taken from PREFLIB of elections with a medium or large number of alternatives in various domains ranging from sport competitions, web search, and university rankings to food and music preferences. The Python codes for Table 2 are available at https://github.com/XKPhung.
Dataset number | n | m | n(n - 1)/2 | 3MOT | Iterated 3MOT | Reduction rate |
---|---|---|---|---|---|---|
00056-00003990.soc | 256 | 17 | 32640 | 60.82 | 60.82 | |
00015-00000002.soc | 240 | 5 | 28680 | 56.86 | 56.86 | |
00015-00000023.soc | 142 | 4 | 10011 | 45.71 | 45.71 | |
00056-00003986.soc | 130 | 5 | 8385 | 87.67 | 87.67 | |
00015-00000033.soc | 128 | 4 | 8128 | 45.14 | 45.14 | |
00015-00000018.soc | 115 | 4 | 6555 | 46.90 | 48.88 (3 iter.) | |
00014-00000002.soi | 100 | 5000 | 4950 | 85.17 | 85.17 | |
00015-00000069.soc | 81 | 4 | 3240 | 52.65 | 59.14 (10 iter.) | |
00049-00000010.soi | 64 | 11 | 2016 | 72.47 | 93.80 (19 iter.) | |
00049-00000049.soi | 55 | 27 | 1485 | 40.60 | 43.43 (4 iter.) | |
00049-000000114.soi | 40 | 40 | 780 | 64.49 | 73.97 (4 iter.) | |
00049-00000083.soi | 38 | 38 | 703 | 57.75 | 64.01 (4 iter.) | |
00049-00000116.soi | 29 | 45 | 406 | 64.29 | 70.44 (3 iter.) | |
00006-00000028.soc | 24 | 9 | 276 | 89.86 | 97.46 (3 iter.) | |
00052-00000070.soc | 20 | 21 | 190 | 62.63 | 94.74 (5 iter.) | |
00053-00000362.soi | 19 | 68 | 171 | 78.36 | 96.49 (4 iter.) | |
00053-00000383.soi | 17 | 50 | 136 | 67.65 | 92.65 (4 iter.) | |
00035-00000002.soc | 15 | 42 | 105 | 50.48 | 68.57 (4 iter.) | |
00035-00000003.soc | 15 | 42 | 105 | 71.43 | 90.48 (4 iter.) | |
00035-00000004.soc | 15 | 42 | 105 | 41.90 | 79.05 (5 iter.) | |
00035-00000005.soc | 15 | 42 | 105 | 35.24 | 72.38 (5 iter.) | |
00035-00000006.soc | 15 | 42 | 105 | 48.57 | 88.57 (5 iter.) | |
00035-00000007.soc | 15 | 42 | 105 | 66.67 | 91.43 (4 iter.) | |
00001-00000003.soi | 14 | 6481 | 91 | 79.12 | 92.31 (2 iter.) |
C.2 Tests on uniform data
For the hard case of uniformly generated data, we shall compare the performance of our -wise Major Order Theorems with the following two theoretical space reduction results recently found in [21]. The first one is the -wise Extended Always theorem which generalizes the unanimity property [14, Proposition 5] also known as the Pareto efficiency and the second one is the -majority rule which is the -wise counterpart of the well-known -majority rule of Betzler et al. [6].
Theorem C.4 (3AT, [21]).
Let be candidates in an election with candidates. Suppose that for some such that
Then in every -wise median of the election.
Theorem C.5 (5/6-majority rule, [21]).
Let be a non-dirty candidate in an election with respect to the -majority rule and let . Let be a -wise median such that in for all . Suppose that . Then for every candidate with , we have in .
The simulation results are given Table 3 and Table 4 below. Observe that in general, the performance of the -wise Major Order Theorems is better when the number of votes is odd than when the number of votes (with a comparable size) is even. This phenomenon is explained by the property that unlike the case when is odd, the probability that is strictly higher than 0 when is even, which reduces the applicability of the -wise Major Order Theorems. Moreover, as for the classical -majority rule of Betzler et al. [6], the applicability of the -wise majority rule drops quickly to almost on average for elections with at least alternatives and at least votes. Hence, for ease of reading, we only report the simulation results for the -wise Extended Always Theorem [21] and the 3-wise Major Order Theorems 5.4, 6.2, and 8.1. The Python codes for Table 3, Table 4 are available at https://github.com/XKPhung. Note also that for each pair with , the approximate average maximal number of iterations of Iterated 3MOT ranges from 2 to 6. For Kemeny’s rule, due to lack of time, we do not provide similar complete comparison between the performance of Theorem 7.1 and Theorem 2.5 on uniformly generated data. However, by realizing several quick simulations, we find that for , Theorem 7.1 can solve approximately from 2 to 7 more pairs than Theorem 2.5.
n | m | 3AT | 3MOT | 3MOTe | Iterated 3MOT |
3 | 3 | 25.11% | 86.14% | 94.50% | 94.46% |
- | 4 | 12.44% | 61.39% | 98.30% | 64.48% |
- | 5 | 37.57% | 86.16% | 86.16% | 94.63% |
- | 6 | 21.76% | 65.42% | 97.56% | 68.55% |
- | 7 | 12.51% | 83.17% | 86.05% | 93.75% |
- | 8 | 7.00% | 68.10% | 93.36% | 71.76% |
- | 9 | 18.03% | 81.91% | 84.82% | 91.90% |
- | 10 | 11.04% | 68.79% | 92.30% | 73.15% |
- | 15 | 3.51% | 81.13% | 82.85% | 90.92% |
4 | 3 | 24.93% | 75.62% | 81.44% | 89.63% |
- | 4 | 12.44% | 59.35% | 80.53% | 64.42% |
- | 5 | 6.26% | 72.59% | 75.12% | 88.37% |
- | 6 | 3.10% | 60.55% | 78.52% | 65.75% |
- | 7 | 1.52% | 70.10% | 73.96% | 86.20% |
- | 8 | 0.78% | 61.55% | 75.45% | 68.14% |
- | 9 | 3.87% | 69.40% | 72.11% | 84.19% |
- | 10 | 2.12% | 61.75% | 74.95% | 68.99% |
- | 15 | 0.10% | 68.02% | 69.03% | 82.21% |
5 | 3 | 25.05% | 66.46% | 71.34% | 85.20% |
- | 4 | 12.52% | 54.90% | 68.96% | 60.90% |
- | 5 | 6.26% | 62.58% | 65.63% | 81.97% |
- | 6 | 3.15% | 55.43% | 66.53% | 62.12% |
- | 7 | 1.59% | 60.46% | 64.13% | 78.60% |
- | 8 | 0.80% | 55.34% | 64.00% | 63.77% |
- | 9 | 0.40% | 59.85% | 62.29% | 76.85% |
- | 10 | 0.21% | 55.23% | 63.52% | 64.17% |
- | 15 | 0.10% | 58.57% | 60.35% | 74.49% |
n | m | 3AT | 3MOT | 3MOTe | Iterated 3MOT |
8 | 3 | 24.93% | 48.97% | 52.10% | 72.12% |
- | 4 | 12.52% | 43.22% | 48.86% | 50.57% |
- | 5 | 6.25% | 43.97% | 46.71% | 64.33% |
- | 6 | 3.12% | 41.71% | 46.00% | 50.82% |
- | 7 | 1.56% | 42.45% | 44.93% | 59.95% |
- | 8 | 0.79% | 40.91% | 44.35% | 51.15% |
- | 9 | 0.39% | 41.94% | 43.76% | 58.32% |
- | 10 | 0.19% | 40.38% | 43.57% | 50.83% |
- | 15 | 0.01% | 40.57% | 41.92% | 55.65% |
10 | 3 | 24.97% | 42.83% | 45.14% | 65.00% |
- | 4 | 12.51% | 37.37% | 41.14% | 45.24% |
- | 5 | 6.23% | 36.64% | 38.85% | 54.17% |
- | 6 | 3.13% | 35.14% | 38.01% | 41.44% |
- | 7 | 1.55% | 35.21% | 37.17% | 50.60% |
- | 8 | 0.79% | 34.18% | 36.52% | 44.02% |
- | 9 | 0.39% | 34.59% | 36.08% | 50.07 % |
- | 10 | 0.20% | 33.62% | 35.75% | 43.48% |
- | 15 | 0.01% | 33.22% | 34.34% | 46.74% |
15 | 3 | 24.99% | 35.20% | 36.43% | 51.36% |
- | 4 | 12.49% | 28.14% | 30.01% | 35.45% |
- | 5 | 6.27% | 25.92% | 27.32% | 38.54% |
- | 6 | 3.12% | 24.72% | 26.22% | 32.62% |
- | 7 | 1.57% | 24.19% | 25.41% | 34.56% |
- | 8 | 0.78% | 23.76% | 25.01% | 31.90% |
- | 9 | 0.39% | 23.5% | 24.51% | 33.16% |
- | 10 | 0.20% | 23.17% | 24.28% | 30.82% |
- | 15 | 0.01% | 22.25% | 22.98% | 30.91% |
20 | 3 | 25.38% | 32.07% | 32.81% | 42.90% |
- | 4 | 12.40% | 23.04% | 24.13% | 28.65% |
- | 5 | 6.06% | 19.77% | 20.74% | 28.11% |
- | 6 | 3.16% | 18.89% | 19.88% | 25.16% |
- | 7 | 1.56% | 18.33% | 19.16% | 25.68% |
- | 8 | 0.77% | 17.69% | 18.50% | 23.76% |
- | 9 | 0.39% | 17.14% | 17.87% | 24.27% |
- | 10 | 0.19% | 17.12% | 17.87% | 23.30% |
- | 15 | 0.01% | 16.29% | 16.82% | 22.44% |
References
- [1] N. Ailon, M. Charikar, and A. Newman. Aggregating inconsistent information: Ranking and clustering. J. ACM, 55(5):1–27, 2008.
- [2] A. Ali and M. Meilă. Experiments with Kemeny ranking: What works when? Mathematical Social Science, 64:28–40, 2012.
- [3] P. Andrieu, B. Brancotte, L. Bulteau, S. Cohen-Boulakia, A. Denise, A. Pierrot, and S. Vialette. Efficient, robust and effective rank aggregation for massive biological datasets. Future Generation Computer Systems, 124:406–421, 2021.
- [4] K. Arrow, A. Sen, and K. Suzumura. Handbook of Social Choice and Welfare, volume 1. Elsevier, 2002.
- [5] K.J. Arrow. k-majority digraphs and the hardness of voting with a constant number of voters. Journal of Computer and System Sciences, 105:130–157, 2019.
- [6] N. Betzler, R. Bredereck, and R. Niedermeier. Theoretical and empirical evaluation of data reduction for exact Kemeny Rank Aggregation. Auton Agent Multi-Agent Syst, 28:721–748, 2014. doi:https://doi.org/10.1007/s10458-013-9236-y.
- [7] G. Blin, M. Crochemore, S. Hamel, and S. Vialette. Median of an odd number of permutations. Pure Mathematics and Applications, 21(2):161–175, 2010.
- [8] B. Brancotte, B. Rance, A. Denise, and S. Cohen-Boulakia. ConQuR-Bio: Consensus ranking with query reformulation for biological data. Data Integration in the Life Sciences, pages 128–142, 2014.
- [9] V. Conitzer, A. Davenport, and J. Kalagnanam. Improved bounds for computing Kemeny rankings. Proceedings of the 21st conference on Artificial intelligence, AAAI’06, 1:620–626, 2006.
- [10] A. Davenport and J. Kalagnanam. A Computational Study of the Kemeny Rule for Preference Aggregation. AAAI’04: Proceedings of the 19th national conference on Artifical intelligence, pages 697–702, 2004.
- [11] Marquis de Condorcet. Essai sur l’application de l’analyse à la probabilité des décisions rendues à la pluralité des voix. Imprimerie Royale, Paris (1785). Translated in English in I. McLean and E. Hewitt, eds., Condorcet: Foundations of Social Choice and Political Theory (Edward Elgar, Aldershot, England) pp. 120–158 (1994).
- [12] C. Dwork, R. Kumar, M. Naor, and D. Sivakumar. Rank aggregation methods for the web. WWW ’01: Proceedings of the 10th international conference on World Wide Web, May 2001, pages 613–622. doi:https://doi.org/10.1145/371920.372165.
- [13] H. Gilbert, T. Portoleau, and O. Spanjaard. Beyond Pairwise Comparisons in Social Choice: A Setwise Kemeny Aggregation Problem. Proceedings of the AAAI Conference on Artificial Intelligence, 34(02):1982–1989, 2020. doi:https://doi.org/10.1609/aaai.v34i02.5569.
- [14] H. Gilbert, T. Portoleau, and O. Spanjaard. Beyond pairwise comparisons in social choice: A setwise Kemeny aggregation problem. Theoretical Computer Science, 904:27–47, 2022. doi:https://doi.org/10.1016/j.tcs.2021.07.004.
- [15] J. Kemeny. Mathematics without numbers. Daedalus, 88:577–591, 1959.
- [16] J. Kemeny and L. Snell. Mathematical Models in the Social Sciences. Ginn, Boston, 1960.
- [17] R. Kumar and S. Vassilvitskii. Generalized distances between rankings. in: Proceedings of the 19th International Conference on World Wide Web, WWW 2010, Raleigh, North Carolina, USA, April 26-30, 2010, pages 571–580, 2010.
- [18] N. Mattei and T. Walsh. PREFLIB: A Library for Preferences http://www.preflib.org. In: Perny, P., Pirlot, M., Tsoukiàs, A. (eds) Algorithmic Decision Theory. ADT 2013. Lecture Notes in Computer Science, 8176. doi:https://doi.org/10.1007/978-3-642-41575-3_20.
- [19] R. Milosz and S. Hamel. Space reduction constraints for the median of permutations problem. Discrete Applied Mathematics, 280:201–213, 2020. doi:https://doi.org/10.1016/j.dam.2018.03.076.
- [20] N. Nishimura and N. Simjour. Parameterized Enumeration of (Locally-) Optimal Aggregations. In: Dehne, F., Solis-Oba, R., Sack, JR. (eds) Algorithms and Data Structures. WADS 2013. Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, 8037, 2013. doi:https://doi.org/10.1007/978-3-642-40104-6_44.
- [21] X.K. Phung and S. Hamel. Optimal majority rules and quantitative Condorcet properties of setwise Kemeny voting schemes. Preprint, available on arXiv from May 1st 2023.
- [22] F. Schalekamp and A. van Zuylen. Rank aggregation: Together we’re strong. pages 38–51. doi:10.1137/1.9781611972894.4.
- [23] J. H. Smith. Aggregation of preferences with variable electorate. Econometrica, 41:1027–1041, 1973.
- [24] M. Truchon. An Extension of the Condorcet Criterion and Kemeny orders. Technical report, cahier 98–15 du Centre de Recherche en Économie et Finance Appliquées, Université Laval, Québec, Canada.
- [25] H. P. Young and A. Levenglick. A Consistent Extension of Condorcet’s Election Principle. SIAM Journal on Applied Mathematics, 35(2):285–300, 1978.
- [26] H.P. Young. Condorcet’s Theory of Voting. American Political Science Rev., 82(4):1231–1244, 1988.