Convergence of Multi-Issue Iterative Voting under Uncertainty
Abstract
We study the effect of strategic behavior in iterative voting for multiple issues under uncertainty. We introduce a model synthesizing simultaneous multi-issue voting with Meir et al. (2014)’s local dominance theory and determine its convergence properties. After demonstrating that local dominance improvement dynamics may fail to converge, we present two sufficient model refinements that guarantee convergence from any initial vote profile for binary issues: constraining agents to have -legal preferences and endowing agents with less uncertainty about issues they are modifying than others. Our empirical studies demonstrate that although cycles are common when agents have no uncertainty, introducing uncertainty makes convergence almost guaranteed in practice.
1 Introduction
Consider a wedding planner who is deciding a wedding’s banquet and wants to accommodate the party invitees’ preferences. Suppose they have three issues: the main course (chicken, beef, or salmon), the paired wine (red or white), and the dessert cake’s flavor (chocolate or vanilla). How should the planner proceed? On the one hand, the planner could request each attendee’s (agent’s) full preference ranking over the possibilities (alternatives), for issues with candidates each. However, this is computationally prohibitive and imposes a high cognitive cost for agents.
On the other hand, the planner could only request agents’ most preferred alternatives and decide each issue simultaneously. Although simpler, this option admits multiple election paradoxes whereby agents can collectively select each of their least favored outcomes. For example, suppose three agents prefer , , and first respectively on three binary issues and all prefer last Lacy and Niou (2000). Then the agents select ) by majority rule on each issue independently.
A third approach is to decide the issues in sequence and have agents vote for their preferred alternative on the current issue given the previously chosen outcomes Lang and Xia (2009); Xia et al. (2011). Still, the joint outcome may depend on the voting agenda and agents may be uneasy voting on the current issue if their preference depends on the outcomes of later issues Conitzer et al. (2009).
In this work, we study iterative voting (IV) as a different yet natural method for deciding multiple issues Meir et al. (2010). We elicit agents’ most preferred alternatives and, given information about others’ votes, allow agents to update their reports before finalizing the group decision. This approach combines the efficiency of simultaneous voting with the dynamics of sequential voting, thus incorporating information about agents’ lower-ranked preferences without directly eliciting them. Like the former approach, agents only report their most preferred alternative. Like the latter approach, agents only update one issue at a time but are unrestricted in the order of improvements.
IV is an effective framework for its adaptability to various information and behavioral schemes. For example, agents may be fully aware of each other’s votes, such as in online Doodle polls Zou et al. (2015), and update to the myopic best response of all others. Alternatively, agents may only have partial information, such as from imprecise opinion polls Reijngoud and Endriss (2012) or latency if they can only periodically retrieve vote counts on a networked system. We then take a strict uncertainty approach in which agents assume that any vote profile in a set is possible without assigning probabilities to them. Agents update to votes that locally dominate their prior reports Meir et al. (2014).
We ask two primary questions: (1) Under what conditions does multi-issue IV converge? (2) How does introducing and increasing uncertainty affect the rate of convergence?
The conclusion from previous research regarding convergence in single-issue IV is mixed, as the plurality and veto voting rules have strong guarantees, yet many other rules admit cycles Meir et al. (2017). This leaves us with mixed hope that multi-issue IV can converge, and if so, that it can solve other problems like multiple election paradoxes Xia et al. (2011). Furthermore, in contrast to the single-issue setting Meir (2015), uncertainty for multiple issues plays a double role. First, like the single-issue case, agents consider themselves as possibly pivotal on any issue that is sufficiently close to a tie. Second—and this part is new—agents may be uncertain regarding their own preferences on a particular issue, as this may depend on the outcomes of other uncertain issues.
1.1 Our Contribution
On the conceptual side, we introduce a model that synthesizes prior work in local dominance strategic behavior, iterative voting, and simultaneous voting over multiple issues. This generalized model naturally captures both types of uncertainty discussed above.
On the technical side, we first show that IV for either best response, without uncertainty, or local dominance improvement dynamics, with uncertainty, may not converge. We then present two model refinements that prove sufficient to guarantee convergence for binary issues: restricting agent preferences to be -legal converges because agents’ preferences on issues are not interdependent; alternating uncertainty, in which agents are more certain about the current issue than others, converges because fewer preference rankings yield improvement steps in this case. These convergence results do not extend to the multi-candidate issues setting, as LDI plurality dynamics may cycle if agents have partial order preference information.
Our convergence results for binary issues also hold for a nonatomic variant of IV, in which agents are part of a very large population and arbitrary subsets of agents may change their vote simultaneously, establishing more general convergence results (see Appendix C).
We conclude with empirical evidence corroborating our findings that introducing uncertainty eliminates almost all cycles in IV for multiple binary issues. Our experiments further suggest IV improves the quality of equilibrium vote profiles relative to their respective truthful profiles, thus reducing multiple election paradoxes. Increasing uncertainty yields faster convergence but degrades this welfare improvement.
1.2 Related Work
Our model pulls insights from research across multi-issue voting, IV, and local dominance strategic behavior. Multi-issue voting is an extensively studied problem in economics and computer science with applications in direct democracy referendums, group planning and committee elections (see e.g., Lang and Xia (2016) for a survey). Our work follows research in agent strategic behavior by Lang (2007), Lang and Xia (2009), Conitzer et al. (2009), Xia et al. (2011).
Single-issue IV was initially studied by Meir et al. (2010) for best response dynamics and the plurality social choice rule, whose authors bounded its guaranteed convergence rate. Subsequent work demonstrated that iterative veto converges Reyhani and Wilson (2012); Lev and Rosenschein (2012), although many other voting rules do not Koolyk et al. (2017) unless agents are additionally restricted in their behavior Reijngoud and Endriss (2012); Grandi et al. (2013); Obraztsova et al. (2015); Endriss et al. (2016).
This review already narrows down the possibility of convergence in the multi-issue setting. We therefore restrict our attention to plurality, extending the models of Meir et al. (2014), Meir (2015). Their research finds broad conditions for voting equilibrium to exist and guaranteed convergence for iterative plurality. In particular, Meir (2015) studies a nonatomic model variation where agents have negligible impact on the outcome but multiple agents update their votes simultaneously, greatly simplifying the dynamics.
Bowman et al. (2014) and Grandi et al. (2020) empirically show for multiple binary issues that IV improves the social welfare of voting outcomes using computer simulations and human experiments respectively. Our work augments this research by characterizing convergence in settings where agents do not have complete information.
A related line of research studies strategic behavior in epistemic voting games, when agents have uncertainty about the preferences or votes of others (see e.g., Meir (2018) for a survey). Notably, Chopra et al. (2004), Conitzer et al. (2011), Reijngoud and Endriss (2012), Van Ditmarsch et al. (2013) each study the susceptibility and computational complexity of voting rules to local dominance improvement steps. Game-theoretic properties of strategic behavior for Gibbard-Satterthwaite games were studied by Myerson and Weber (1993), Grandi et al. (2019), Elkind et al. (2020). Other forms of IV include work from Airiau and Endriss (2009), Desmedt and Elkind (2010), Xia and Conitzer (2010).
2 Preliminaries
Basic model.
Let be the set of issues over the joint domain , where is the finite value domain of candidates for issue . We call the issues binary if for each or multi-candidate otherwise. Each of agents is endowed with a preference ranking , the set of strict linear orders over the alternatives. We call the collection of agents’ preferences a preference profile and each agent’s most preferred alternative their truthful vote. A vote profile is a collection of votes, where collects agent ’s single-candidate vote per issue. A resolute voting rule maps vote profiles to a unique outcome. We call and for an alternative or outcome synonymously.
Simultaneous plurality voting.
A local voting rule, applied to each issue independently, is simultaneous if issues’ outcomes are revealed to agents at the same time. It is sequential according to the order if outcomes of each issue are revealed to agents prior to voting on the next issue Lacy and Niou (2000). We focus on simultaneous plurality voting and adapt the framework of Xia et al. (2011).
The plurality rule applied to vote profile on issue only depends on the total number of votes for each of its candidates. We thus take the score of a candidate as and define the score tuple as a collection of score vectors . We use the plurality rule , where , breaking ties lexicographically on each issue. We often use , , and interchangeably for ease of notation.
Let denote the vote profile without agent and the profile by replacing ’s vote with the prospective vote . Then and denote the corresponding adjusted score tuples.
Preferential dependence.
A preference ranking is called separable if its relative ordering of candidates in , for each issue , are consistent across all outcomes of the other issues. This has the advantage that such agents may express their preferences for any issue without knowing other issues’ outcomes and avoid multiple-election paradoxes (see e.g., Xia et al. (2011)), but it is a very demanding assumption Hodge (2002). Relaxing agents preferences to be -legal maintains representation compactness without permitting arbitrary preferential dependencies Lang and Xia (2009).
Formally, for some order over the issues, the preference ranking is called -legal if, given the outcomes of the prior issues , the relative ordering of candidates in is constant for any combination of outcomes of the later issues . Hence, the ranking of candidates in depends only, if at all, on the outcomes of issues prior to it in .
The preference profile is called -legal if every ranking is -legal for the same order . Thus, the ranking is separable if it is -legal for any order .
Example 1.
Let there be binary issues and agents with preferences such that:
,
, and
.
The truthful vote profile consists of each agent’s most preferred alternative. The score tuple is then , so with plurality .
Note that is -legal for : the agent always prefers on the second issue, yet their preference for the first issue depends on . is separable, as the agent prefers on each issue independent of the other issue’s outcome. is neither separable nor -legal for any .
Finally, agent can improve the outcome for themselves by voting for instead of . The adjusted score tuple is , so and .
Improvement dynamics.
We implement the iterative voting (IV) model introduced by Meir et al. (2010) and refined for uncertainty by Meir et al. (2014), Meir (2015). Given agents’ truthful preferences and an initial vote profile , we consider an iterative process of vote profiles that describe agents’ reported votes over time . For each round , a scheduler chooses an agent to make an improvement step over their prior vote by applying a specified response function . Each agent’s response implicitly depends on their preferences and belief about the current real vote profile, but they are not aware of others’ private preferences. All other votes besides ’s remain unchanged.
A scheduler is broadly defined as a mapping from sequences of vote profiles to an agent with an improvement step in the latest vote profile Apt and Simon (2015). An improvement step must be selected if one exists, and a vote profile where no improvement step exists (i.e., ) is called an equilibrium. The literature on game dynamics considers different types of response functions, schedulers, initial profiles, and other assumptions (see e.g., Fudenberg and Levine (2009), Marden et al. (2007), Bowling (2005), Young (1993)). This means that there are multiple levels in which a voting rule may guarantee convergence to an equilibrium Meir et al. (2017). In this work, we study two response functions: best response (BR), without uncertainty, and local dominance improvements (LDI), with uncertainty. For both dynamics, we restrict agents to only changing their vote on a single current issue per round, as determined by the scheduler . We therefore have the following form of convergence, as described by Kukushkin (2011), Monderer and Shapley (1996), Milchtaich (1996):
Definition 1.
An IV dynamic has the restricted-finite improvement property if every improvement sequence is finite from any initial vote profile for a given response function.
Under BR dynamics, agents know the real score tuple .
Definition 2 (Best response).
Given the vote profile , which yields agent ’s most preferred outcome of the set , defaulting as if the best outcome is the same.
LDI dynamics are based on the notions of strict uncertainty and local dominance Conitzer et al. (2011); Reijngoud and Endriss (2012). Let be a set of score tuples that, informally, describes agent ’s uncertainty about the real score tuple . An LDI step to a prospective vote is (1) weakly better off than their original for every , (2) strictly better off for some tuple in , and (3) not worse off for any . This is formally defined as follows.
Definition 3.
The vote -beats if there is at least one score tuple such that . The vote -dominates if both (I) -beats ; and (II) does not -beat .
Definition 4 (Local dominance improvement).
Given the vote profile and agent , let be the set of votes that -dominate , only differ from on the issue, and are not themselves -dominated by votes differing from only on the issue. Then if and otherwise.
This definition distinguishes from (weak) LDI in Meir (2015), in that agents may change their votes consecutively but only on different issues. Note that -dominance is transitive and antisymmetric, but not complete, so an agent may not have an improvement step. To fully define the model, we need to specify for every . For example, if and each has no uncertainty about the real score tuple, then LDI coincides with BR and an equilibrium coincides with Nash equilibrium. Therefore, LDI broadens BR dynamics.
Distance-based uncertainty.
Agents in the single-issue model constructed their uncertainty sets using distance-based uncertainty, in which all score vectors close enough to the current profile were believed possible Meir et al. (2014); Meir (2015). We adapt this to the multi-issue setting by assuming agents uphold candidate-wise distance-based uncertainty over score vectors for each issue independently.
For any issue , let be a distance measure for score vectors for any vote profile . This measure is candidate-wise if it can be written as for some monotone function . For example, the multiplicative distance (where ) and the metric (where ) are candidate-wise.
Given the vote profile and issue , we model agent ’s uncertainty about the adjusted score vector by the uncertainty score set with an uncertainty parameter . That is, given all other agents’ votes , agent is not sure what the real score vector is . We take for , and drop the parameters if the context is clear.
Example 2.
Let there be binary issues and agents. Define the vote profile such that and for some agent . Suppose uses the uncertainty metric with . Then the uncertainty score set without ’s vote is:
Consider the prospective vote . Then the set of possible outcomes is
Remark.
Notice that in any vote profile reachable via BR or LDI dynamics from the truthful vote profile, no agent with fully separable preferences will have an improvements step. This follows from the definitions of BR and LDI.
3 Best-Response Dynamics
Given the vote profile , consider agent changing their vote on issue to the prospective vote . Under BR dynamics, without uncertainty, changes their vote only if they can feasibly improve the outcome to one more favorable with respect to . This happens under two conditions. First, must be pivotal on the issue, meaning that changing their vote will necessarily change the outcome. Second, must be preferential to change by voting for over given the outcomes of the other issues . Agent ’s preferences are always well-defined since they know every issue’s real outcome. Thus BR dynamics behave similar to the single-issue setting, which we recall converges Meir et al. (2010). However, in the multi-issue setting, agents’ preferences on each issue may change as other issues’ outcomes change. This entails the possibility of a cycle, as declared in the following proposition and proved with the subsequent example.
Proposition 1.
BR dynamics for multiple issues may not converge, even if issues are binary.
Example 3.
Let there be binary issues and agents without uncertainty and the following preferences:
,
, and
.
Agent | ||||
Table 1 demonstrates a cycle generated by BR dynamics from the truthful vote profile . The order of improvement steps is . No other BR step is possible from any profile in the cycle, demonstrating that no agent scheduler can lead to convergence. Notice that agent never changes their vote since their ranking is fully separable.
4 Local Dominance Improvement Dynamics
4.1 Non-Convergence
LDI dynamics broadens best-response, but it is initially unclear how increasing agents’ uncertainty parameters will affect their improvement steps and whether this eliminates the possibility of cycles. Under LDI dynamics, with uncertainty, agent changes their vote on issue to the prospective vote from vote profile with two conditions similar to BR dynamics: if they (I) believe they may be pivotal and (II) can improve the outcome with respect to (corresponding to -dominance). First, intuitively, it would seem that uncertainty over ’s current issue affects whether they believe they can change ’s outcome. Notice that if issue has a unique winning candidate and no runner-up, then has no best-response but may have an LDI step only if their uncertainty parameter is large enough. Second, unlike BR dynamics and the single-issue setting Meir et al. (2014); Meir (2015), ’s preference over candidates of issue may depend on the outcomes of other issues, which may be uncertain about. It stands to reason that the more uncertainty has over other issues, the less clarity the agent has over their own preference for issue ’s candidates.
Despite these two apparent parallels, we observe for multi-candidate issues that the relationship between uncertainty parameter and existence of LDI steps is not monotonic. Example 5 in Appendix B demonstrates that different sets of prospective votes in the same vote profile are non-comparable for the same agent with different uncertainty parameters. On the other hand, LDI dynamics have the aforementioned structure with binary issues, as we prove in Theorem 1. Still, this relationship has counter-acting forces: increasing uncertainty on issue may only add LDI steps over issue but may only eliminate steps on all other issues.
Theorem 1.
Given binary issues, consider agent changing their vote on issue in vote profile with one of three uncertainty parameters: , , or . The parameters and only differ on issue such that ; and only differ on issue such that . Let , , and denote ’s possible LDI steps according to each of the parameters. Then .
We prove the theorem in two parts by demonstrating that if a vote -dominates , then it must -dominates ; likewise, this implies that -dominates . Each of these relationships arise as a result of and . For binary issues, this is sufficient and we do not need to show that is not - or -dominated. This may not be the case for multi-candidate issues, as previously stated in Example 5. The full proof may be found in Appendix A.
In sum, we find that enabling agents to have uncertainty over issues does not eliminate the possibility of a cycle, unlike the single-issue setting, as declared in the following proposition and proved with Example 6 in Appendix B.
Proposition 2.
LDI dynamics with multiple issues may not converge, even if agents have the same constant uncertainty parameters and issues are binary.
4.2 Strategic responses and -legal preferences
We next present two model refinements that prove sufficient to guarantee convergence for binary issues: -legal preferences and a specific form of dynamic uncertainty.
We are motivated by observing in Examples 3 and 6 that cycles appear due to agents’ interdependent preferences among the issues. For simplicity, consider two issues and in which no agent has an LDI step on issue . LDI steps on issue may change the set of possible winning candidates (see Definition 5), thus transforming agents’ preferences over the candidates in . This enables agents to have LDI steps over issue , even if they may no longer have improvement steps over . It stands to reason that eliminating interdependent preferences by restricting agents to have -legal preference rankings would guarantee convergence.
We prove this is the case in Theorem 2. We first introduce a characterization about agents’ strategic responses, extending a lemma from Meir (2015) to the multi-issue setting.
Definition 5.
Agent believes a candidate on issue is a possible winner if there is some score vector where wins. Formally,
.
In contrast, calls a potential winner if there is some score vector in which they can vote to make win:
.
The set of real potential winners is denoted: .
By this definition, . 111 Without uncertainty, (or if adding a vote to makes it win) is also known as the chasing set (excluding ) Rabinovich et al. (2015) or potential winner set (including ) Kavner and Xia (2021) on issue . coincides with Meir et al. (2014) and Meir (2015)’s definition of a possible winner “.” Denote by the set of possible winning candidates on all issues besides , from agent ’s perspective with uncertainty parameter .
Lemma 1.
Consider an LDI step over issue from vote profile by agent with uncertainty parameter . Then either (1) ; or for every combination of possible winners in , either (2) for all ; or (3) , and .
Theorem 2.
Suppose all agents have -legal preferences for the common order over binary issues. Then LDI dynamics converge.
Proof.
Fix an initial vote profile . Suppose for contradiction that there is a cycle among the vote profiles , where and is reachable from via LDI dynamics. Let be the highest order issue in for which any agent changes their vote in .
Let be the first round that some agent takes an LDI step on issue , where from vote profile ; let be the last round that switches their vote on back to . It must be the case that , since issues are binary and otherwise, and would not have an improvement step. Hence by Lemma 1, for every combination of possible winners in . Likewise, on round , for every combination of possible winners in . Thus for some issue and outcomes , , we have and .
Since has -legal preferences, must be prior to issue in the order . However, no agent changed their vote on issue between rounds and so it must be that , even if ’s uncertainty parameters changed. This forms a contradiction, so no such cycle can exist.
∎
The intuition behind Theorem 2 is that as an LDI sequence develops, there is some “foremost” issue in which no LDI step takes place on any issue prior to in the order . Agents’ relative preferences for the candidates in are fixed because their preferences are -legal: score vectors for issues prior to in do not change scores of issues afterward do not affect agents’ preferences for . Hence, agents’ improvement steps over the issue converge, whereas any cycle must have a sub-sequence of vote profile whose votes for issue cycles.
Note that -legality is not necessary for convergence, as BR dynamics induced from the truthful vote profile in Example 1 converge. Although -legality is a strict assumption, loosening this even slightly may lead to cycles. Example 3 demonstrates a cycle in which each agent has an -legal ranking but orders differ between agents.
Furthermore, the theorem describes that LDI steps over the issue eventually terminate, thus enabling each subsequent issue in to converge. This seems to suggest that IV under -legal preferences is the same as truthful sequential voting, where agents vote for their preferred alternative on each issue given the known previous outcomes of Lang and Xia (2009). Although the procedures’ outcomes could be the same, there are two notable differences. First, the initial vote profile could have an issue with a single possible winning candidate that differs from the truthful sequential outcome; then no agent has an improvement step on that issue. Second, based on the scheduler, there may be a round with multiple possible winning candidates but no subsequent improvement steps on an issue. This may terminate IV with outcomes different than the truthful sequential vote.
This convergence result does not extend to the multi-candidate case, as declared in the following proposition and proved with the subsequent example.
Proposition 3.
LDI dynamics may not converge for multiple issues, even if agents have the same constant uncertainty parameters and -legal preferences for the common order .
Example 4.
Let there be issues and agents who each use the uncertainty metric with common fixed uncertainty parameters . Label the candidates and respectively. Agent has preferences: if then on the second issue; otherwise . Agent always prefers on the second issue. These preferences are -legal for .
Define so and . There are four LDI steps involved in this cycle: (i) , (ii) , (iii) , and (iv) . We prove these steps are valid in Appendix B.
Note that and . In contrast to the single-issue setting (see Lemma 4 of Meir (2015)), agent takes LDI steps to candidates not in the potential winning set. This results from ’s uncertainty over whether or is most-preferred, even as both are preferable to and . Hence, we get the following corollary:
Corollary 1.
LDI dynamics may not converge for plurality over a single issue for agents with partial order preferences.
4.3 Alternating Uncertainty
In Theorem 1 we found that for binary issues, agents may have fewer LDI steps over an issue if that issue has less uncertainty and other issues have more. This suggests that LDI steps occur from a relative lack of information about the current issue’s score vector than for other issues. If agents can gather more information about the current issue before changing their vote, thereby decreasing its uncertainty relative to other issues, then they may not have an LDI step.
We therefore consider a specific form of dynamics over agents’ uncertainty parameters where agents can gather this information and consider themselves pivotal only with respect to the lowered uncertainty. Agents are assumed to subsequently forget this relative information since it may be outdated by the time they change their vote again. We show in the following theorem that this eliminates cycles.
Definition 6.
(Alternating Uncertainty.) Fix two parameters , for each agent such that . Define each agent ’s uncertainty parameters such that whenever they are scheduled to change their vote on issue , ’s uncertainty for is and for each other issue is .
Theorem 3.
Given binary issues, LDI dynamics converges for agents with alternating uncertainty.
Proof.
Fix an initial vote profile and uncertainty parameters for each agent . Suppose for contradiction that there is a cycle among the vote profiles , where and is reachable from via LDI dynamics. Without loss of generality, suppose all issues and agents are involved in the cycle.
Consider the agent with the largest . Let be the first round that takes an LDI step on issue , where from vote profile ; let be the last round that switches their vote on back to . It must be the case that , since issues are binary and otherwise, and would not have an improvement step. Hence by Lemma 1, for every combination of possible winners in . Likewise, on round , for every combination of possible winners in . Thus for some issue and outcomes , , we have and .
Let be the first round since that some agent changes their vote on issue . Then . Since and distance functions are candidate-wise, . This entails by definition of alternating uncertainty, which contradicts the assertion that is the agent with the largest .
∎
This convergence result does not extend to the multi-candidate case, as Example 4 also covers this setting.
5 Experiments

increases.


increases; 95% CI (too small to show).

increases; 95% CI (too small to show).
Our computational experiments investigate the effects of uncertainty, number of issues, and number of agents on LDI dynamics. Specifically, we ask how often truthful vote profiles are themselves in equilibrium, how often LDI dynamics does not converge, and the path length to equilibrium when it converges. Our inquiry focuses on whether cycles are commonplace in practice even as convergence is not guaranteed.
We answer these questions for a broad cross-section of inputs, with agents, binary issues, and uncertainty that is constant for all agents, issues, and rounds. We generate preference profiles for each combination by sampling agents’ preferences uniformly and independently at random. We simulate LDI dynamics from the truthful vote profile using a scheduler that selects profiles uniformly at random from the set of valid LDI steps from all agents and issues. If there are no such steps, we say the sequence has converged. Otherwise, we take rounds as a sufficiently large stopping condition to declare the sequence has cycled.
Our results are presented in Figures 4 – 4 with respect to and for . We find that as uncertainty is introduced and increases, the availability of LDI steps diminishes significantly (Figure 4) to the point of eliminating (almost) all cycles and shortening the path length to convergence (Figure 4). Figure 4 presents the number of profiles whose LDI sequence cycles for no uncertainty, while only of our sampled profiles’ sequences cycle. Therefore, cycles with uncertainty are the exception rather than the norm.
These findings corroborate our theoretical analysis. As uncertainty increases, more issues are perceived by agents to have more than one possible winner. Since issues are interdependent for many preference rankings, fewer agents have LDI steps. On the other hand, as increases, more agents have rankings without these interdependencies, thus increasing the availability of LDI steps.
As an additional inquiry, we studied how IV affects the quality of outcomes by comparing the social welfare of equilibrium to truthful vote profiles.222Measured by the percent change in Borda welfare. The Borda utility of outcome for ranking is minus the index of ’s position in ; the Borda welfare is the sum of utilities across agents. We find in Figure 4 that IV improves average welfare, but at a rate decreasing in . This finding agrees with experiments by Bowman et al. (2014), Grandi et al. (2020), suggesting that IV may reduce multiple-election paradoxes by helping agents choose better outcomes. However, further work will be needed to generalize this conclusion, as it contrasts experiments of single-issue IV by Meir et al. (2020), Koolyk et al. (2017).
6 Discussion and Open Questions
We have introduced a novel model of strategic behavior in IV for multiple issues under uncertainty. We find that for binary issues, the existence of cycles hinges on the interdependence of issues in agents’ preference rankings. Specifically, once an agent takes an LDI step on an issue , they only subsequently revert their vote when their preference for changes. This occurs when the set of possible winning candidates of other issues, that affect ’s preference for , have changed.
Without this interdependence, agents’ preference over issues change a finite number of times, so LDI dynamics converge (Theorem 2). As uncertainty increases over issues other than the one agents are changing, fewer preference rankings admit LDI steps which eliminates cycles (Theorem 3). Convergence does not extend to multi-candidate issues, as LDI plurality dynamics may cycle if agents only have partial order preference information (Corollary 1). Our experiments confirm that convergence is practically guaranteed with uncertainty, despite its possibility, and suggests IV improves agents’ social welfare over their truthful vote outcome.
There are several open directions for future work. First, our empirical study was limited by assuming agents’ preferences were sampled from the impartial culture preference distribution and had additive social welfare (see e.g., Tsetlin et al. (2003), Sen (1999)). Proving IV’s welfare properties for more realistic preference distributions and welfare functions may follow the dynamic price of anarchy work of Brânzei et al. (2013), Kavner and Xia (2021) and smoothed analysis techniques of Xia (2020).
Second, IV is useful, in part, for protecting agents’ privacy, as they do not explicitly reveal their truthful preferences. However, agents that make improvement steps implicitly reveal partial preference information. Studying IV when agents account for others’ preferences based on current information is an interesting open direction. A third direction is to detail the properties, such as anonymity and Condorcet-consistency, of multi-issue IV rules that may be inherited by the decision rule used locally on each issue, as studied for sequential voting rules by Xia et al. (2011).
References
- Airiau and Endriss [2009] Stéphane Airiau and Ulle Endriss. Iterated majority voting. In International Conference on Algorithmic Decision Theory, pages 38–49. Springer, 2009.
- Apt and Simon [2015] Krzysztof R Apt and Sunil Simon. A classification of weakly acyclic games. Theory and Decision, 78(4):501–524, 2015.
- Bowling [2005] Michael Bowling. Convergence and no-regret in multiagent learning. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS), pages 209–216, Vancouver, Canada, 2005.
- Bowman et al. [2014] Clark Bowman, Jonathan K Hodge, and Ada Yu. The potential of iterative voting to solve the separability problem in referendum elections. Theory and decision, 77(1):111–124, 2014.
- Brânzei et al. [2013] Simina Brânzei, Ioannis Caragiannis, Jamie Morgenstern, and Ariel D. Procaccia. How bad is selfish voting? In Proceedings of the 27th AAAI Conference on Artificial Intelligence, pages 138–144, 2013.
- Chopra et al. [2004] Samir Chopra, Eric Pacuit, and Rohit Parikh. Knowledge-theoretic properties of strategic voting. In European Workshop on Logics in Artificial Intelligence, pages 18–30. Springer, 2004.
- Conitzer et al. [2009] Vincent Conitzer, Jérôme Lang, and Lirong Xia. How hard is it to control sequential elections via the agenda? In Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence (IJCAI), pages 103–108, Pasadena, CA, USA, 2009.
- Conitzer et al. [2011] Vincent Conitzer, Toby Walsh, and Lirong Xia. Dominating manipulations in voting with partial information. In Proceedings of the National Conference on Artificial Intelligence (AAAI), pages 638–643, San Francisco, CA, USA, 2011.
- Desmedt and Elkind [2010] Yvo Desmedt and Edith Elkind. Equilibria of plurality voting with abstentions. In Proceedings of the 11th ACM conference on Electronic commerce, pages 347–356, 2010.
- Elkind et al. [2020] Edith Elkind, Umberto Grandi, Francesca Rossi, and Arkadii Slinko. Cognitive hierarchy and voting manipulation in k-approval voting. Mathematical Social Sciences, 108:193–205, 2020.
- Endriss et al. [2016] Ulle Endriss, Svetlana Obraztsova, Maria Polukarov, and Jeffrey S. Rosenschein. Strategic voting with incomplete information. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI’16, page 236–242. AAAI Press, 2016.
- Fudenberg and Levine [2009] Drew Fudenberg and David K Levine. Learning and equilibrium. Annu. Rev. Econ., 1(1):385–420, 2009.
- Grandi et al. [2013] Umberto Grandi, Andrea Loreggia, Francesca Rossi, Kristen Brent Venable, and Toby Walsh. Restricted manipulation in iterative voting: Condorcet efficiency and borda score. In International Conference on Algorithmic Decision Theory, pages 181–192. Springer, 2013.
- Grandi et al. [2019] Umberto Grandi, Daniel Hughes, Francesca Rossi, and Arkadii Slinko. Gibbard–satterthwaite games for k-approval voting rules. Mathematical Social Sciences, 99:24–35, 2019.
- Grandi et al. [2020] Umberto Grandi, Jérôme Lang, Ali Ozkes, and Stéphane Airiau. Voting behavior in one-shot and iterative multiple referenda. Available at SSRN, 2020.
- Hodge [2002] Jonathan K Hodge. Separable preference orders. Western Michigan University, 2002.
- Kavner and Xia [2021] Joshua Kavner and Lirong Xia. Strategic behavior is bliss: Iterative voting improves social welfare. In Proceedings of NeurIPS, 2021.
- Koolyk et al. [2017] Aaron Koolyk, Tyrone Strangway, Omer Lev, and Jeffrey S. Rosenschein. Convergence and quality of iterative voting under non-scoring rules. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, pages 273–279, 2017.
- Kukushkin [2011] Nikolai S Kukushkin. Acyclicity of improvements in finite game forms. International Journal of Game Theory, 40(1):147–177, 2011.
- Lacy and Niou [2000] D. Lacy and E. Niou. A problem with referenda. Journal of Theoretical Politics, 12(1):5–31, 2000.
- Lang [2007] Jérôme Lang. Vote and aggregation in combinatorial domains with structured preferences. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI), pages 1366–1371, Hyderabad, India, 2007.
- Lang and Xia [2009] Jérôme Lang and Lirong Xia. Sequential composition of voting rules in multi-issue domains. Mathematical Social Sciences, 57(3):304–324, 2009.
- Lang and Xia [2016] Jérôme Lang and Lirong Xia. Voting in Combinatorial Domains. In Felix Brandt, Vincent Conitzer, Ulle Endriss, Jérôme Lang, and Ariel Procaccia, editors, Handbook of Computational Social Choice, chapter 9. Cambridge University Press, 2016.
- Lev and Rosenschein [2012] Omer Lev and Jeffrey S Rosenschein. Convergence of iterative voting. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems-Volume 2, pages 611–618, 2012.
- Marden et al. [2007] Jason R. Marden, Gürdal Arslan, and Jeff S. Shamma. Regret based dynamics: Convergence in weakly acyclic games. In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’07, New York, NY, USA, 2007. Association for Computing Machinery. ISBN 9788190426275. doi: 10.1145/1329125.1329175. URL https://doi.org/10.1145/1329125.1329175.
- Meir [2015] Reshef Meir. Plurality Voting under Uncertainty. In Proceedings of the 29th AAAI on Artificial Intelligence, 2015.
- Meir [2018] Reshef Meir. Strategic Voting. Synthesis Lectures on Artificial Intelligence and Machine Learning. Morgan&Claypool, 2018.
- Meir et al. [2010] Reshef Meir, Maria Polukarov, Jeffrey S. Rosenschein, and Nicholas R. Jennings. Convergence to Equilibria of Plurality Voting. In Proceedings of the National Conference on Artificial Intelligence (AAAI), pages 823–828, Atlanta, GA, USA, 2010.
- Meir et al. [2014] Reshef Meir, Omer Lev, and Jeffrey S. Rosenschein. A Local-Dominance Theory of Voting Equilibria. In Proceedings of the 15th ACM Conference on Electronic Commerce, pages 313–330, Palo Alto, CA, USA, 2014.
- Meir et al. [2017] Reshef Meir, Maria Polukarov, Jeffrey S Rosenschein, and Nicholas R Jennings. Iterative voting and acyclic games. Artificial Intelligence, 252:100–122, 2017.
- Meir et al. [2020] Reshef Meir, Kobi Gal, and Maor Tal. Strategic voting in the lab: compromise and leader bias behavior. Autonomous Agents and Multi-Agent Systems, 34(1):1–37, 2020.
- Milchtaich [1996] Igal Milchtaich. Congestion games with player-specific payoff functions. Games and economic behavior, 13(1):111–124, 1996.
- Monderer and Shapley [1996] Dov Monderer and Lloyd S. Shapley. Potential games. Games and Economic Behavior, 14(1):124–143, 1996.
- Myerson and Weber [1993] Roger B Myerson and Robert J Weber. A theory of voting equilibria. American Political science review, 87(1):102–114, 1993.
- Obraztsova et al. [2015] Svetlana Obraztsova, Evangelos Markakis, Maria Polukarov, Zinovi Rabinovich, and Nicholas R. Jennings. On the convergence of iterative voting: How restrictive should restricted dynamics be? In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI’15, page 993–999, 2015.
- Rabinovich et al. [2015] Zinovi Rabinovich, Svetlana Obraztsova, Omer Lev, Evangelos Markakis, and Jeffrey Rosenschein. Analysis of equilibria in iterative voting schemes. In Proceedings of the 29th AAAI Conference on Artificial Intelligence. AAAI Press, 2015.
- Reijngoud and Endriss [2012] Annemieke Reijngoud and Ulle Endriss. Voter response to iterated poll information. In Proceedings of the Eleventh International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), volume 1, pages 635–644, 06 2012.
- Reyhani and Wilson [2012] Reyhaneh Reyhani and Mark C. Wilson. Best reply dynamics for scoring rules. In Proceedings of the 20th European Conference on Artificial Intelligence, ECAI’12, page 672–677, NLD, 2012. IOS Press.
- Sen [1999] Amartya Sen. The Possibility of Social Choice. American Economic Review, 89(3):349–378, 1999.
- Tsetlin et al. [2003] Ilia Tsetlin, Michel Regenwetter, and Bernard Grofman. The impartial culture maximizes the probability of majority cycles. Social Choice and Welfare, 21(3):387–398, 2003.
- Van Ditmarsch et al. [2013] Hans Van Ditmarsch, Jérôme Lang, and Abdallah Saffidine. Strategic voting and the logic of knowledge. arXiv preprint arXiv:1310.6436, 2013.
- Xia [2020] Lirong Xia. The Smoothed Possibility of Social Choice. In Proceedings of NeurIPS, 2020.
- Xia and Conitzer [2010] Lirong Xia and Vincent Conitzer. Stackelberg voting games: Computational aspects and paradoxes. In Proceedings of the National Conference on Artificial Intelligence (AAAI), pages 921–926, Atlanta, GA, USA, 2010.
- Xia et al. [2011] Lirong Xia, Vincent Conitzer, and Jérôme Lang. Strategic sequential voting in multi-issue domains and multiple-election paradoxes. In Proceedings of the ACM Conference on Electronic Commerce (EC), pages 179–188, San Jose, CA, USA, 2011.
- Young [1993] H Peyton Young. The Evolution of Conventions. Econometrica, 61(1):57–84, January 1993.
- Zou et al. [2015] James Zou, Reshef Meir, and David Parkes. Strategic voting behavior in doodle polls. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW ’15, page 464–472, New York, NY, USA, 2015.
Appendix
Appendix A Deferred Proofs
Theorem 1.
Given binary issues, consider agent changing their vote on issue in vote profile with one of three uncertainty parameters: , , or . The parameters and only differ on issue such that ; and only differ on issue such that . Let , , and denote ’s possible LDI steps according to each of the parameters. Then .
Proof.
We prove the theorem by proving a weaker claim that holds for the more general multi-candidate issues setting. Specifically, let , , and denote the set of votes that -dominate and only differ on the issue, corresponding to , , or respectively. We show that . The theorem follows because (respectively, and ) for binary issues.
(Part 1: .) Without loss of generality let . Suppose . Then -dominates , entailing:
-
1.
such that , and
-
2.
such that .
First, by construction of the uncertainty sets, and for all ; therefore . It follows that such that by point (2) above. Hence, does not -beat .
Second, define a score tuple such that for each and arbitrarily. It is the case that since for all . Since and for all , we have . It follows from the above argument that . Therefore -beats and .
(Part 2: .) Without loss of generality let . Suppose . Then -dominates , entailing:
-
1.
such that , and
-
2.
such that .
By construction of the uncertainty sets, and for all ; therefore . It immediately follows that , so -beats . Furthermore, such that by point (2) above. Hence, does not -beat . Therefore , concluding our proof.
∎
Lemma 1.
Consider an LDI step over issue from vote profile by agent with uncertainty parameter . Then either (1) ; or for every combination of possible winners in , either (2) for all ; or (3) , and .
Proof.
The proof follows that of Lemma 3 in Meir [2015]. Suppose that and whenever some combination of possible winners wins (i.e., (1) and (2) are violated). Assume first that . By Lemma 2 of Meir [2015], such that:
-
•
have maximal score (possibly with other candidates), strictly above , in ;
-
•
for each , is such that wins.
W.l.o.g. assume is prior to in tie-breaking (otherwise adjust so that ). Thus while . Since given , this implies -beats .
The remaining case is where and whenever some wins. Then in where are tied and wins, it is better for to vote for .
In both cases we get , which is a contradiction. ∎
Appendix B Supplementary Examples
Example 4.
(Cont’d.) Recall the agents and with the following preferences:
-
•
If then prefers on the second issue;
-
•
if then prefers on the second issue;
-
•
agent prefers on the second issue regardless of the first issue’s outcome.
Initialize the vote profile such that and . There are four LDI steps involved in this cycle: (i) , (ii) , (iii) , and (iv) . We will prove that these are valid LDI steps in turn, demonstrating that (i) the new vote -beats the old vote, (ii) the old vote does not -beat the new vote, and (iii) the new vote is not -dominated. For any candidate , denote the vote switching the second candidate to by . Recall that ties are broken in lexicographical order.
(Step 1: .) Since and , we have .
(i) Let . Then , so -beats .
(ii) For any , we have that if then ; otherwise, if then . Hence, it is never preferable for to vote for than .
(iii) Neither nor -dominate since for and it is preferable for to vote for than and , respectively.
(Step 2: .) Since and , we have .
(i) Let . Then , so -beats .
(ii) For any , we have that if then ; otherwise . Hence, it is never preferable for to vote for than .
(iii) Neither nor -dominate since for (the same as in (i)), it is preferable for to vote for than either or .
(Step 3: .) Since and , we have .
(i) Let . Then , so -beats .
(ii) For any , we have that if then ; otherwise, if then . Hence, it is never preferable for to vote for than .
(iii) Neither nor -dominate since for and it is preferable for to vote for than and , respectively.
(Step 4: .) Since and , we have .
(i) Let . Then , so -beats .
(ii) For any , we have that if then ; otherwise . Hence, it is never preferable for to vote for than .
(iii) Neither nor -dominate since for (the same as in (i)), it is preferable for to vote for than either or .
Example 5.
Consider issues with three candidates each, labeled for . Let agent have uncertainty metric and -legal preferences that satisfy:
-
•
If , then over issue :
-
•
If , then over issue :
-
•
If , then over issue :
Suppose in vote profile with score tuple .
(Part 1: increasing .) This part of the example is motivated by Lemma 3b of Meir [2015].
If then it is easy to see that has no BR steps: the unique winner is and, although can make win, they prefer when . Hence .
If then
First, when , it is preferable for to vote for either or instead of . Recall that ties are broken by lexicographical order. Hence both and -beat . Second, it is easy to see that there is no where it is preferable for to vote for instead of either or . Thus, does not -beat either or . Third, we notice that -dominates , which which follows from whenever . It is easy to see that is not -dominated. Thus .
Now consider . Then
Since , both and still -beat . However, as we have , so -beats both and . Hence, .
(Part 2: increasing .) Recall that when , we found that -dominated , while -dominated and -dominated ; thus .
If , then
For it is preferable for to vote for rather than , whereas for it is preferable for to vote for rather than . Then both and -dominate but neither are -dominated. Therefore .
If , then
Then there are score vectors where , so that neither nor -dominate . Thus .
Example 6.
Let there be binary issues and agents who each use the uncertainty metric with common fixed uncertainty parameters . Suppose that agents’ preferences abide by the following four types:
-
•
(Type 1) three agents have rankings: ;
-
•
(Type 2) five agents have rankings: ;
-
•
(Type 3) four agents have rankings: ; and
-
•
(Type 4) one agent has ranking: .
There is a cycle passing through the four vote profiles (which is truthful), , , and listed in Table 2, in which every agent of the same type has the same vote. There are four parts of the cycle between these profiles:
-
•
between and , all agents of Type 1 make LDI steps on the first issue ;
-
•
between and , all agents of Type 2 make LDI steps on the second issue ;
-
•
between and , all agents of Type 1 make LDI steps on the first issue ;
-
•
between and , all agents of Type 2 make LDI steps on the second issue .
Notice that no agent of Types 3 and 4 make LDI steps since they are voting truthfully and have separable preferences.
Agent Type | ||||
---|---|---|---|---|
We claim these are valid LDI steps as follows. For any vote profile in , let be the number of Type 1 agents who have made LDI steps. Then and for any Type 1 agent who has not made their first LDI step yet,
Define . Then , so and -beats . It is easy to see that does not -beat and that is not -dominated since issues are binary. Thus .
The other LDI steps follow similar reasoning, yielding the cycle presented in the table. It can be verified that this represents all possible LDI sequences from the truthful vote profile.
Appendix C Nonatomic model
Each of the results presented for binary issues and atomic agents, where each agent contributes one unit of influence to the population of votes, also generalize to a nonatomic variant of IV, in which agents are part of a very large population and have negligible influence over the outcome. Our model extends Meir [2015]’s iterative plurality voting for nonatomic agents to the multi-issue setting. Like this setting, our convergence results permit arbitrary subsets of agents to change their vote simultaneously. This differs from the finite case which may not converge if multiple agents change their votes simultaneously Meir et al. [2010].
In this section, we provide the necessary definitions for the nonatomic model, using our existing notation wherever possible. There are two major differences: (i) with the identify of an agent, and (ii) with the uncertainty score set. First, rather than treating each agent individually, there are groups of identical agents with mass; “an agent of type ” then refers to a representative agent in this group. Second, as agents have negligible influence, type agents consider any score tuple in possible; all agents agree of the same type agree what real score tuples are possible. Lemma 1 and Theorems 1, 2, and 3 are each upheld after applying this model redefinition. Similar non-convergence results also apply for the nonatomic variant of IV.
Basic notations.
We do not have a finite set of agents. Rather, a preference profile is a distribution over rankings that specifies the fraction of agents for each . We only consider moves by subsets of agents since each agent has negligible influence. To avoid infinite improvement sequence paths of sequentially smaller subsets of agents, we assume there is a minimum resolution , such that sets of agents of the same type with mass always move together (although in an uncoordinated manner; see Appendix IX of Meir [2015]). We denote the collection of these sets by . Since all agents in set are indistinguishable, we refer to “agent ” as an arbitrary agent in the set . Then is the preference, is the uncertainty parameter, and is the vote of an arbitrary agent in the set of vote profile .
Winner determination.
For any issue , we define the score vector induced by the vote profile such that . Winner determination is exactly as in the atomic model with lexicographical tie-breaking.
Uncertainty and local dominance.
We assume agents utilize the same candidate-wise distance uncertainty as the atomic model. Like the atomic model, each agent of type selected by the scheduler to change their vote has uncertainty parameters . Unlike the atomic model, agents have negligible influence in the score vector. Hence, they take their uncertainty score sets with respect to the real score tuple: . As before, .
Given , we define to be the outcome an agent of type expects by voting for according to score vector . That is, for each issue , the extra vote decides the winner if several candidates are tied with maximal score in , overriding the default tie-breaker (see Appendix X of Meir [2015]).
The definition of a local dominance improvement (LDI) step for a nonatomic agent of type from vote to on issue then is the same as in the atomic model of Definitions 3 and 4, applying this redefinition and using in lieu of . The response function is also the same, except that its domain (all possible profiles) is now rather than . The definition of equilibrium does not change.