This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

Fast Consensus Topology Design via Minimizing Laplacian Energy

Susie Lu         Ji Liu J. Liu is with the Department of Electrical and Computer Engineering at Stony Brook University ([email protected]). S. Lu is with Stanford Online High School ([email protected]).
Abstract

This paper characterizes the graphical properties of an optimal topology with minimal Laplacian energy under the constraint of fixed numbers of vertices and edges, and devises an algorithm to construct such connected optimal graphs. These constructed graphs possess maximum vertex and edge connectivity, and more importantly, exhibit large algebraic connectivity of an optimal order provided they are not sparse. These properties guarantee fast and resilient consensus processes over these graphs.

I Introduction

Over the past two decades, consensus has achieved great success and attracted significant attention [1, 2, 3, 4], being applied to a wide range of distributed control and computation problems [5, 6, 7, 8].

A continuous-time linear consensus process over a simple connected graph 𝔾\mathbb{G} can be typically modeled by a linear differential equation of the form x˙(t)=Lx(t)\dot{x}(t)=-Lx(t), where x(t)x(t) is a vector in IRn{\rm I\!R}^{n} and LL is the “Laplacian matrix” of 𝔾\mathbb{G}. For any simple graph 𝔾\mathbb{G} with nn vertices, we use D(𝔾)D(\mathbb{G}) and A(𝔾)A(\mathbb{G}) to denote its degree matrix and adjacency matrix, respectively. Specifically, D(𝔾)D(\mathbb{G}) is an n×nn\times n diagonal matrix whose iith diagonal entry equals the degree of vertex ii, and A(𝔾)A(\mathbb{G}) is an n×nn\times n matrix whose ijijth entry equals 1 if (i,j)(i,j) is an edge in 𝔾\mathbb{G} and otherwise equals 0. The Laplacian matrix of 𝔾\mathbb{G} is defined as L(𝔾)=D(𝔾)A(𝔾)L(\mathbb{G})=D(\mathbb{G})-A(\mathbb{G}). It is easy to see that any Laplacian matrix is symmetric and thus has a real spectrum. It is well known that L(𝔾)L(\mathbb{G}) is positive-semidefinite, its smallest eigenvalue equals 0, and its second smallest eigenvalue, called the algebraic connectivity of 𝔾\mathbb{G} and denoted as a(𝔾)a(\mathbb{G}), is positive if and only if 𝔾\mathbb{G} is connected [9]. It has been shown that the convergence rate of continuous-time linear consensus is determined by the algebraic connectivity, in that the larger the algebraic connectivity is, the faster the consensus can be reached [2].

With the preceding facts in mind, a natural and fundamental research problem is how to design network topology to achieve faster or even the fastest consensus. The problem has been studied for many years [10, 11, 12, 13, 14, 15], to name a few. Notwithstanding these developments, the following question is still largely unsolved: Given a fixed number of vertices and edges, what are the optimal graphs that achieve maximal algebraic connectivity?

The above question presents a challenging combinatorial optimization problem, and thus, it was only partially answered for some special cases in [15]. Even though a powerful computer can execute such a combinatorial search, identifying the graphical properties of optimal graphs with maximal algebraic connectivity remains a mystery, not to mention the associated computational complexity.

In this paper, we propose approximating the maximal algebraic connectivity by minimizing the “Laplacian energy” defined as follows.

Definition 1

The Laplacian energy of a simple graph 𝔾\mathbb{G} with nn vertices is E(𝔾)=i=1nλi2E(\mathbb{G})=\sum_{i=1}^{n}\lambda_{i}^{2}, where λi\lambda_{i}, i{1,,n}i\in\{1,\ldots,n\} are eigenvalues of the Laplacian matrix of 𝔾\mathbb{G}.

The above concept was first proposed in [16] and finds applications/connections to ordinary energy for π\pi-electron energy in molecules [17] and the first Zagreb index [18]. It is worth mentioning that there have been various mathematical definitions for network energy [19], including the earliest version of Laplacian energy [20].

We are motivated to appeal to the concept of Laplacian energy for designing fast/optimal consensus network topologies due to the following observations: We list all maximal algebraic connectivity graphs under the constraint of fixed numbers of vertices and edges for the cases where the vertex number nn ranges from 4 to 7. These are respectively given in Figures 1 through 4.111The maximal algebraic connectivity graphs depicted in Figures 2 through 4 are sourced from [15]. We omit the case of n=3n=3 as well as some complete graphs, as these graphs are unique. For n8n\geq 8, it will be very computationally expensive to go through all possible graphs. For each of these graphs, we list its corresponding Laplacian energy EE, and for each pair of vertex number nn and edge number mm, we list the minimal Laplacian energy EminE_{{\rm min}} among all possible graphs. It is readily apparent that among all simple graphs with a fixed number of vertices and edges, maximal algebraic connectivity and minimal Laplacian energy coincide in most cases. The non-matching cases, highlighted in orange, are always centered in sparse cases and occasionally scattered in medium-density cases. This suggests that we may design fast consensus topologies by minimizing Laplacian energy for most scenarios. It turns out that, given a fixed number of vertices and edges, minimizing Laplacian energy is a much easier task and considerably more computationally efficient.

Refer to caption
Figure 1: Maximal algebraic connectivity graphs with 4 vertices
Refer to caption
Figure 2: Maximal algebraic connectivity graphs with 5 vertices
Refer to caption
Figure 3: Maximal algebraic connectivity graphs with 6 vertices
Refer to caption
Figure 4: Maximal algebraic connectivity graphs with 7 vertices

In this paper, we first characterize the degree distribution properties of minimal Laplacian energy graphs under the constraint of fixed numbers of vertices and edges, and then devise an algorithm to construct such connected optimal graphs (cf. Section II). Next, we show that the minimal Laplacian energy graphs generated by the proposed algorithm exhibit strong resilience, featuring maximum vertex and edge connectivity (cf. Section III). Finally, we investigate the spectral properties of the Laplacian matrices of these generated minimal Laplacian energy graphs, and show that they possess large algebraic connectivity of optimal order, provided they are not sparse (cf. Section IV). Overall, we propose a computationally efficient approach to designing fast and resilient consensus topologies by minimizing Laplacian energy.

II Minimal Laplacian Energy

It has been proved in [16] that E(𝔾)=i=1n(di2+di)E(\mathbb{G})=\sum_{i=1}^{n}(d_{i}^{2}+d_{i}), where did_{i} denotes the degree of vertex ii. It immediately implies that the Laplacian energy of a simple graph will increase after adding any additional edge. Thus, the Laplacian energy of an nn-vertex graph achieves its maximum value, n2(n1)n^{2}(n-1), when the graph is complete. Various upper and lower bounds on E(𝔾)E(\mathbb{G}) have been established [21]. There has been an effort in the literature to identify optimal topologies that minimize the Laplacian energy for certain types of graphs. For example, among all nn-vertex connected graphs, the Laplacian energy achieves its minimum value when the graph is the path [16]. Another example is that among all connected graphs with chromatic number χ\chi, the Laplacian energy achieves its minimum value, χ2(χ1)\chi^{2}(\chi-1), by the χ\chi-vertex complete graph [22]. Notwithstanding these results, the following question has never been studied: Given a fixed number of vertices and edges, what are the optimal graphs that achieve minimal Laplacian energy?

This section solves the above open problem. To state our main results, we use \lfloor\cdot\rfloor to denote the floor function.

Theorem 1

Among all simple graphs with nn vertices and mm edges, the minimal Laplacian energy is (k+1)(4mnk)(k+1)(4m-nk) with k=2mnk=\lfloor\frac{2m}{n}\rfloor, which is achieved if, and only if, n(k+1)2mn(k+1)-2m vertices are of degree kk and the remaining 2mnk2m-nk vertices are of degree k+1k+1.

The theorem states that the sequence of vertex degrees, arranged in descending order, follows the following pattern:

(d1,,dn)=(k+1,,k+12mnk,k,,kn(k+1)2m)(d_{1},\ldots,d_{n})=(\;\underbrace{k+1,\ldots,k+1}_{2m-nk},\underbrace{k,\ldots,k}_{n(k+1)-2m}) (1)

In the special case when 2mn\frac{2m}{n} is an integer, all nn vertices are of degree k=2mnk=\frac{2m}{n}. Thus, Theorem 1 implies that minimal Laplacian energy graphs have an (almost) uniform degree distribution, which is intuitive from the fact that E(𝔾)=i=1n(di2+di)=i=1ndi2+2mE(\mathbb{G})=\sum_{i=1}^{n}(d_{i}^{2}+d_{i})=\sum_{i=1}^{n}d_{i}^{2}+2m. Such a graph, whose degree difference is at most 1, is called almost regular graph. Such a graph, in which the degree difference is at most 1, is called an almost regular graph [23].

It is easy to check that the total degree sum of a minimal Laplacian energy graph specified by Theorem 1 equals k(n(k+1)2m)+(k+1)(2mnk)=2mk(n(k+1)-2m)+(k+1)(2m-nk)=2m, which is consistent with the assumption of mm edges. Moreover, it can be proved that such a degree distribution always admits a graph using the Erdős-Gallai theorem [24, 25].

To prove Theorem 1, we need the following results.

Lemma 1

(Theorem 3 in [16]) For any simple graph 𝔾\mathbb{G} with nn vertices, E(𝔾)=i=1n(di2+di)E(\mathbb{G})=\sum_{i=1}^{n}(d_{i}^{2}+d_{i}).

Lemma 2

(Erdős-Gallai Theorem [24, 25]) A nonincreasing sequence of nonnegative integers d1,,dnd_{1},\ldots,d_{n} constitutes the degree sequence of an nn-vertex simple graph if, and only if, i=1ndi\sum_{i=1}^{n}d_{i} is even and i=1jdij(j1)+i=j+1nmin{j,di}\sum_{i=1}^{j}d_{i}\leq j(j-1)+\sum_{i=j+1}^{n}\min\{j,d_{i}\} for all j{1,,n}j\in\{1,\ldots,n\}.

Proof of Theorem 1: From Lemma 1, E(𝔾)=i=1n(di2+di)E(\mathbb{G})=\sum_{i=1}^{n}(d_{i}^{2}+d_{i}). Since i=1ndi=2m\sum_{i=1}^{n}d_{i}=2m, minimizing E(𝔾)E(\mathbb{G}) is equivalent to minimizing i=1ndi2\sum_{i=1}^{n}d_{i}^{2}. Without loss of generality, assume that d1d2dnd_{1}\geq d_{2}\geq\cdots\geq d_{n}.

We first minimize i=1ndi2\sum_{i=1}^{n}d_{i}^{2} without considering the constraint that d1,,dnd_{1},\ldots,d_{n} form the degree sequence of a simple graph. Since all did_{i} are integers and their summation i=1ndi\sum_{i=1}^{n}d_{i} is a fixed constant, it is easy to see that i=1ndi2\sum_{i=1}^{n}d_{i}^{2} is minimized by the unique sequence pattern given in (1), in which kk and 2mnk2m-nk are respectively the unique quotient and remainder of 2m2m divided by nn. With such a degree sequence, E(𝔾)=i=1ndi2+2m=(k+1)2(2mnk)+k2(n(k+1)2m)+2m=(k+1)(4mnk)E(\mathbb{G})=\sum_{i=1}^{n}d_{i}^{2}+2m=(k+1)^{2}(2m-nk)+k^{2}(n(k+1)-2m)+2m=(k+1)(4m-nk).

To prove the theorem, it is now sufficient to show that, given a fixed number of vertices nn and edges mm, there exists a graph with the degree sequence specified in (1). From Lemma 2, it is equivalent to show that (I) i=1ndi\sum_{i=1}^{n}d_{i} is even and (II) i=1jdij(j1)+i=j+1nmin{j,di}\sum_{i=1}^{j}d_{i}\leq j(j-1)+\sum_{i=j+1}^{n}\min\{j,d_{i}\} for all j{1,,n}j\in\{1,\ldots,n\}. First note that i=1ndi=k(n(k+1)2m)+(k+1)(2mnk)=2m\sum_{i=1}^{n}d_{i}=k(n(k+1)-2m)+(k+1)(2m-nk)=2m, which implies that condition (I) holds. Next we will validate condition (II).

Since k=2mnk=\lfloor\frac{2m}{n}\rfloor and m12n(n1)m\leq\frac{1}{2}n(n-1), it follows that kn1k\leq n-1. In the case when k=n1k=n-1, it must be true that m=12n(n1)m=\frac{1}{2}n(n-1), and thus 𝔾\mathbb{G} is a complete graph with all di=n1d_{i}=n-1, which satisfies (1). Therefore, we only need to consider k<n1k<n-1 from here on. To validate condition (II) for all j{1,,n}j\in\{1,\ldots,n\}, we consider jkj\leq k and j>kj>k separately. First, in the case when jkj\leq k, since dikd_{i}\geq k, jdij\leq d_{i} for all ii. Then, j(j1)+i=j+1nmin{j,di}=j(j1)+(nj)j=(n1)jj(j-1)+\sum_{i=j+1}^{n}\min\{j,d_{i}\}=j(j-1)+(n-j)j=(n-1)j. Meanwhile, since dik+1d_{i}\leq k+1 for all ii, i=1jdi(k+1)j\sum_{i=1}^{j}d_{i}\leq(k+1)j. Since k<n1k<n-1, it follows that i=1jdi(k+1)j(n1)j=j(j1)+i=j+1nmin{j,di}\sum_{i=1}^{j}d_{i}\leq(k+1)j\leq(n-1)j=j(j-1)+\sum_{i=j+1}^{n}\min\{j,d_{i}\}. Thus, condition (II) holds for all jkj\leq k.

Next, we consider the case when j>kj>k. Since dik+1d_{i}\leq k+1, jdij\geq d_{i} for all ii, j(j1)+i=j+1nmin{j,di}=j(j1)+i=j+1ndi=j(j1)+2mi=1jdij(j-1)+\sum_{i=j+1}^{n}\min\{j,d_{i}\}=j(j-1)+\sum_{i=j+1}^{n}d_{i}=j(j-1)+2m-\sum_{i=1}^{j}d_{i}, in which we used i=1ndi=2m\sum_{i=1}^{n}d_{i}=2m in the last equality. Then, in this case condition (II) is equivalent to

2i=1jdij(j1)+2m.2\sum_{i=1}^{j}d_{i}\leq j(j-1)+2m. (2)

Recalling the degree sequence given in (1), we will now consider the following two cases.

Case 1: j2mnkj\leq 2m-nk. From (1), i=1jdi=(k+1)j\sum_{i=1}^{j}d_{i}=(k+1)j. Then, inequality (2) is equivalent to j2(2k+3)j+2m0j^{2}-(2k+3)j+2m\geq 0. Let f(x)=x2(2k+3)x+2mf(x)=x^{2}-(2k+3)x+2m, which is a quadratic function of xx and achieves its minimum at x=k+32x=k+\frac{3}{2}. Since jj is an integer in the interval [k+1,2mnk][k+1,2m-nk], the function f(j)=j2(2k+3)j+2mf(j)=j^{2}-(2k+3)j+2m achieves its minimum at j=k+1j=k+1, whose value is f(k+1)=(k+1)2(2k+3)(k+1)+2m=2m(k2+3k+2)f(k+1)=(k+1)^{2}-(2k+3)(k+1)+2m=2m-(k^{2}+3k+2). Since 2mnkk+12m-nk\geq k+1 and k<n1k<n-1, 2m(n+1)k+1(k+3)k+12m\geq(n+1)k+1\geq(k+3)k+1. Since 2m2m is even and (k+3)k+1(k+3)k+1 must be odd, 2m(k+3)k+22m\geq(k+3)k+2, which implies that f(k+1)0f(k+1)\geq 0. Therefore, (2) holds in this case.

Case 2: j>2mnkj>2m-nk. From (1), i=1jdi=(k+1)(2mnk)+k(j2m+nk)=2mnkkj\sum_{i=1}^{j}d_{i}=(k+1)(2m-nk)+k(j-2m+nk)=2m-nk-kj. Then, inequality (2) is equivalent to j2(2k+1)j+2nk2m0j^{2}-(2k+1)j+2nk-2m\geq 0. Let f(x)=x2(2k+1)x+2nk2mf(x)=x^{2}-(2k+1)x+2nk-2m, which is a quadratic function of xx and achieves its minimum at x=k+12x=k+\frac{1}{2}. Recall that j>kj>k is under consideration. Then, jj is an integer in the interval [max{k+1,2mnk+1},n][\max\{k+1,2m-nk+1\},n]. We will consider two scenarios, k>2mnkk>2m-nk and k2mnkk\leq 2m-nk, separately.

First assume k>2mnkk>2m-nk, which is equivalent to k>2mn+1k>\frac{2m}{n+1}. Then, jj is an integer in the interval [k+1,n][k+1,n], and thus the function f(j)=j2(2k+1)j+2nk2mf(j)=j^{2}-(2k+1)j+2nk-2m over this interval achieves its minimum at f(k+1)=k2+(2n1)k2mf(k+1)=-k^{2}+(2n-1)k-2m. Treat this expression as a quadratic function of kk which achieves its maximum at k=n12k=n-\frac{1}{2}. Since kk is an integer in the interval (2mn+1,n1)(\frac{2m}{n+1},n-1), the function over this interval satisfies f(k+1)>f(2mn+1+1)=2m(n+1)2[n(n1)22m]f(k+1)>f(\frac{2m}{n+1}+1)=\frac{2m}{(n+1)^{2}}[n(n-1)-2-2m]. Since k<n1k<n-1, implying n(n1)>2mn(n-1)>2m, and both n(n1)n(n-1) and 2m2m are even, n(n1)22mn(n-1)-2\geq 2m. Therefore, f(k+1)>0f(k+1)>0, and thus (2) holds in this scenario.

Next assume k2mnkk\leq 2m-nk, which is equivalent to k2mn+1k\leq\frac{2m}{n+1}. Then, jj is an integer in the interval [2mnk+1,n][2m-nk+1,n], and thus the function f(j)=j2(2k+1)j+2nk2mf(j)=j^{2}-(2k+1)j+2nk-2m over this interval achieves its minimum at f(2mnk+1)=n(n+2)k2(4mn+4mn+2)k+4m2f(2m-nk+1)=n(n+2)k^{2}-(4mn+4m-n+2)k+4m^{2}. Note that if k=0k=0, this minimum value equals 4m204m^{2}\geq 0, and thus (2) holds. Hence, in the remainder of the proof, we need only consider k1k\geq 1. Also note that with k1k\geq 1, if n=2n=2, for which mm may equal 0 or 1, this minimum value is always positive, and thus (2) holds. Hence, we also need only consider n3n\geq 3 in the remainder of the proof. Treat this expression as a quadratic function of kk which, without any restriction on kk, achieves its minimum value of 16m2+(8n28n16)m(n2)2-16m^{2}+(8n^{2}-8n-16)m-(n-2)^{2} when k=4mn+4mn+22n(n+2)k=\frac{4mn+4m-n+2}{2n(n+2)}. But it has been assumed that k2mn+1k\leq\frac{2m}{n+1}. This minimum value is achievable only if 4mn+4mn+22n(n+2)2mn+1\frac{4mn+4m-n+2}{2n(n+2)}\leq\frac{2m}{n+1}, which is equivalent to m14(n2n2)m\leq\frac{1}{4}(n^{2}-n-2). Also treat this minimum value as a quadratic function of mm which achieves its maximum at m=14(n2n2)m=\frac{1}{4}(n^{2}-n-2). Since k=2mn1k=\lfloor\frac{2m}{n}\rfloor\geq 1, it follows that mn2m\geq\frac{n}{2}. Then, the quadratic function of mm, g(m)=16m2+(8n28n16)m(n2)2g(m)=-16m^{2}+(8n^{2}-8n-16)m-(n-2)^{2} over the interval [n2,14(n2n2)][\frac{n}{2},\frac{1}{4}(n^{2}-n-2)] is always no smaller than g(n2)=4n39n24n4g(\frac{n}{2})=4n^{3}-9n^{2}-4n-4, which can be straightforwardly verified to be greater than 0 for all n3n\geq 3. This implies that (2) holds. On the other hand, if 4mn+4mn+22n(n+2)>2mn+1\frac{4mn+4m-n+2}{2n(n+2)}>\frac{2m}{n+1}, which is equivalent to m>14(n2n2)m>\frac{1}{4}(n^{2}-n-2). Then, the quadratic function of kk, f(2mnk+1)=n(n+2)k2(4mn+4mn+2)k+4m2f(2m-nk+1)=n(n+2)k^{2}-(4mn+4m-n+2)k+4m^{2} over the interval [1,2mn+1][1,\frac{2m}{n+1}], achieves its minimum when k=2mn+1k=\frac{2m}{n+1}, with the corresponding minimum value being 2m(n+1)2)[n(n1)22m]\frac{2m}{(n+1)^{2})}[n(n-1)-2-2m], which was proven to be positive at the end of the last paragraph. Therefore, (2) always holds in this scenario.  

Theorem 1 provides a simple graphical condition, dependent solely on the degree distribution, that characterizes minimal Laplacian energy graphs. The following example shows that such a degree distribution condition does not guarantee connectivity. Consider all simple graphs with 6 vertices and 6 edges (i.e., n=m=6n=m=6), Theorem 1 identifies three minimal Laplacian energy graphs, as illustrated in Figure 5.

Refer to caption
Figure 5: All minimal Laplacian energy graphs with 6 vertices and 6 edges

In many network applications, such as distributed control and optimization [6, 26], connected graphs are often desired. The following theorem states that a connected optimal graph with the same minimal Laplacian energy always exists.

Theorem 2

Among all connected simple graphs with nn vertices and mm edges, the minimal Laplacian energy is (k+1)(4mnk)(k+1)(4m-nk) with k=2mnk=\lfloor\frac{2m}{n}\rfloor, which is achieved if, and only if, n(k+1)2mn(k+1)-2m vertices are of degree kk and the remaining 2mnk2m-nk vertices are of degree k+1k+1.

Proof of Theorem 2: In light of Theorem 1, it is sufficient to show that there exists a connected graph whose degree sequence satisfies (1). Such a graph must indeed exist, as it follows directly from Theorem 3.  

The above theorem implicitly assumes that mn1m\geq n-1, otherwise there is no such connected graph. In a special case when m=n1m=n-1, all connected graphs are trees. It is not hard to see that the following result is a direct consequence of Theorem 2.

Corollary 1

Among all simple trees with nn vertices, the minimal Laplacian energy is 6n86n-8, which is achieved by the path.

For general pairs of nn and mm with m>n1m>n-1, the optimal connected graph may not be unique. For example, for the case when n=6n=6 and m=8m=8, two connected minimal Laplacian energy graphs are illustrated in Figure 6.

Refer to caption
Figure 6: Two minimal Laplacian energy connected graphs with 6 vertices and 8 edges

We next present the following algorithm, which provides a procedure to construct a minimal Laplacian energy graph that is connected and satisfies the degree distribution specified by Theorem 2.

Algorithm 1: Given nn and mm with mn1>0m\geq n-1>0, without loss of generality, label nn vertices from 1 to nn. Set k=2mnk=\lfloor\frac{2m}{n}\rfloor, which implies that nk2m<n(k+1)nk\leq 2m<n(k+1).

Case 1: The integer kk is even.

  1. (1)

    If 2m=nk2m=nk, for each i{1,,n}i\in\{1,\ldots,n\}, connect vertex ii with each of those vertices whose indices are (i+j)modn(i+j)\bmod n, j{±1,,±k2}j\in\{\pm 1,\ldots,\pm\frac{k}{2}\}.

  2. (2)

    If 2m=nk+l2m=nk+l where l[1,n)l\in[1,n) is an even integer, first construct the graph as done in Case 1 (1), and then for each i{1,,l2}i\in\{1,\ldots,\frac{l}{2}\}, connect vertex ii and vertex i+n2i+\lfloor\frac{n}{2}\rfloor.

Case 2: The integer kk is odd.

  1. (1)

    If nn is even and 2m=nk2m=nk, for each i{1,,n}i\in\{1,\ldots,n\}, connect vertex ii with each of those vertices whose indices are (i+j)modn(i+j)\bmod n, j{±1,,±k12,n2}j\in\{\pm 1,\ldots,\pm\frac{k-1}{2},\frac{n}{2}\}.

  2. (2)

    If nn is even and 2m=nk+l2m=nk+l where l[1,n)l\in[1,n) is an even integer, first construct the graph as done in Case 2 (1), and then for each i{1,,l2}i\in\{1,\ldots,\frac{l}{2}\}, connect vertex ii and vertex i+n22i+\frac{n-2}{2}.

  3. (3)

    If nn is odd and 2m=nk+12m=nk+1, first for each i{1,,n}i\in\{1,\ldots,n\}, connect vertex ii with each of those vertices whose indices are (i+j)modn(i+j)\bmod n, j{±1,,±k12}j\in\{\pm 1,\ldots,\pm\frac{k-1}{2}\}, and then for each i{1,,n+12}i\in\{1,\ldots,\frac{n+1}{2}\}, connect vertex ii and vertex i+n12i+\frac{n-1}{2}.

  4. (4)

    If nn is odd and 2m=nk+1+l2m=nk+1+l where l[1,n1)l\in[1,n-1) is an even integer, first construct the graph as done in Case 2 (3), and then for each i{n+32,,n+1+l2}i\in\{\frac{n+3}{2},\ldots,\frac{n+1+l}{2}\}, connect vertex ii and vertex (i+n12)modn(i+\frac{n-1}{2})\bmod n.

Theorem 3

Algorithm 1 constructs a connected simple graph with n(k+1)2mn(k+1)-2m vertices of degree kk and 2mnk2m-nk vertices of degree k+1k+1.

Proof of Theorem 3: First of all, any graph generated by Algorithm 1 must be connected, as each case within the algorithm contains a cycle with a vertex sequence (1,2,,n,1)(1,2,\ldots,n,1). Next, it is straightforward to verify that the graphs generated by each case of the algorithm satisfy the degree sequence specified by (1).  

It can be straightforwardly checked that in the case when n=m=6n=m=6, Algorithm 1 will follow Case 1 (1) and construct the 6-vertex path, which is consistent with Corollary 1. We further present six tailored examples, each corresponding to a distinct case outlined in Algorithm 1, as depicted in Figures 7 to 9. These examples collectively validate Theorem 3.

Refer to caption
Figure 7: Left is the graph with 7 vertices and 14 edges, generated by Algorithm 1 following Case 1 (1); right is the graph with 7 vertices and 16 edges, generated by Algorithm 1 following Case 1 (2).
Refer to caption
Figure 8: Left is the graph with 6 vertices and 9 edges, generated by Algorithm 1 following Case 2 (1); right is the graph with 6 vertices and 11 edges, generated by Algorithm 1 following Case 2 (2).
Refer to caption
Figure 9: Left is the graph with 7 vertices and 11 edges, generated by Algorithm 1 following Case 2 (3); right is the graph with 7 vertices and 13 edges, generated by Algorithm 1 following Case 2 (4).

III Connectivity Resilience

The graphs generated by Algorithm 1 exhibit “optimal” connectivity properties. To see this, we introduce two well-known connectivity concepts in graph theory: vertex connectivity, denoted as v(𝔾)v(\mathbb{G}), which is defined as the minimum number of vertices whose removal would disconnect graph 𝔾\mathbb{G}, and edge connectivity, denoted as e(𝔾)e(\mathbb{G}), which is defined as the minimum number of edges whose removal would disconnect graph 𝔾\mathbb{G}. For the complete graph with nn vertices, it is obvious that its edge connectivity equals n1n-1. However, there is no subset of vertices whose removal disconnects the complete graph. It is conventional to set its vertex connectivity as n1n-1 [27, page 149].

Theorem 4

Let 𝔾\mathbb{G} be the graph generated by Algorithm 1 with nn vertices and mm edges. Then, v(𝔾)=e(𝔾)=2mnv(\mathbb{G})=e(\mathbb{G})=\lfloor\frac{2m}{n}\rfloor.

The theorem implies that the graphs constructed by Algorithm 1 always have the maximum vertex and edge connectivity. To see this, consider any graph 𝔾\mathbb{G} with nn vertices and mm edges. Its minimum degree δ(𝔾)\delta(\mathbb{G}) is at most 2mn\lfloor\frac{2m}{n}\rfloor. Since e(𝔾)δ(𝔾)e(\mathbb{G})\leq\delta(\mathbb{G}) by definition and v(𝔾)e(𝔾)v(\mathbb{G})\leq e(\mathbb{G}) [28, Theorem 5], it follows that v(𝔾)e(𝔾)δ(𝔾)2mnv(\mathbb{G})\leq e(\mathbb{G})\leq\delta(\mathbb{G})\leq\lfloor\frac{2m}{n}\rfloor.

Recall that all graphs generated by Algorithm 1 are almost regular graphs with the degree sequence specified in (1). In general, almost regular graphs do not necessarily have v(𝔾)=e(𝔾)=2mnv(\mathbb{G})=e(\mathbb{G})=\lfloor\frac{2m}{n}\rfloor. To see this, consider two examples in Figure 10. The left almost regular graph has n=6n=6 vertices and m=10m=10 edges, but its vertex connectivity is 2 (by removing vertex 2 and vertex 5), which is smaller than 2mn=3\lfloor\frac{2m}{n}\rfloor=3. The right almost regular graph has n=6n=6 vertices and m=7m=7 edges, but its vertex connectivity is 1 (by removing vertex 6), so is its edge connectivity (by removing the edge between vertex 5 and vertex 6), both being smaller than 2mn=2\lfloor\frac{2m}{n}\rfloor=2.

Refer to caption
Figure 10: Two almost regular graphs

To prove Theorem 4, we need the following notation and lemma. Let 𝒰{\cal U} be a vertex subset of graph 𝔾\mathbb{G}. We use 𝔾𝒰\mathbb{G}\setminus{\cal U} to denote the graph resulting from removing all vertices in 𝒰{\cal U}, along with the edges connecting any vertex in 𝒰{\cal U}, from 𝔾\mathbb{G}.

Lemma 3

Let 𝔾\mathbb{G} be a simple graph with nn vertices and p<np<n be a positive integer. Suppose that for any pair of distinct vertices i,j{𝟏,2,,n}i,j\in\{\mathbf{1},2,\ldots,n\} with |ij|(pmodn)|i-j|\leq(p\bmod n), (i,j)(i,j) is an edge in 𝔾\mathbb{G}. Let 𝒰{\cal U} be any vertex subset of 𝔾\mathbb{G} and u,v{𝟏,2,,n}u,v\in\{\mathbf{1},2,\ldots,n\} be any two vertices in 𝔾\mathbb{G} such that u<vu<v and u,v𝒰u,v\notin{\cal U}. If there are no pp vertices in 𝒰{\cal U} whose indices are consecutive integers in the interval (u,v)(u,v), then there exists a path between uu and vv in 𝔾𝒰\mathbb{G}\setminus{\cal U}.

Proof of Lemma 3: We explicitly construct a such path between uu and vv. Consider a sequence of vertex indices: u0=uu_{0}=u and for any i1i\geq 1,

  • If ui<vpu_{i}<v-p, define ui+1u_{i+1} to be the largest index in [ui+1,ui+p][u_{i}+1,u_{i}+p] such that vertex ui+1u_{i+1} is not in 𝒰{\cal U}. Such ui+1u_{i+1} always exists because there are no pp vertices in 𝒰{\cal U} whose indices are consecutive integers in (u,v)(u,v).

  • Otherwise, the sequence ends.

By construction, vertices uiu_{i} and ui+1u_{i+1} are adjacent. Let uju_{j} be the final term of this sequence. Then vpujvv-p\leq u_{j}\leq v.

  • If uj=vu_{j}=v, we have found the path u=u0u1uj=vu=u_{0}\to u_{1}\to\dots\to u_{j}=v.

  • Otherwise, vertex uju_{j} is adjacent to vv, so we have found the path u=u0u1ujvu=u_{0}\to u_{1}\to\dots\to u_{j}\to v.

Either way, there is a path between uu and vv.  

Proof of Theorem 4: From the preceding discussion, v(𝔾)e(𝔾)k=2mnv(\mathbb{G})\leq e(\mathbb{G})\leq k=\lfloor\frac{2m}{n}\rfloor. Thus, to prove the theorem, it is sufficient to show v(𝔾)kv(\mathbb{G})\geq k.

Graphs constructed in Case 1 (2) are formed by adding edges to graphs in Case 1 (1); graphs constructed in Case 2 (2) are formed by adding edges to graphs in Case 2 (1); graphs constructed in Case 2 (4) are formed by adding edges to graphs in Case 2 (3). Since vertex connectivity is non-decreasing when we add edges, it suffices to check v(𝔾)kv(\mathbb{G})\geq k for graphs from Case 1 (1), Case 2 (1), and Case 2 (3) only.

To prove v(𝔾)kv(\mathbb{G})\geq k, we will equivalently show that for any subset 𝒰{\cal U} of k1k-1 vertices, 𝔾𝒰\mathbb{G}\setminus{\cal U} is connected. Say that a vertex is deleted if it is in 𝒰{\cal U}. Let u,vu,v be two arbitrary non-deleted vertices, where u<vu<v. It suffices to show that there is a path between uu and vv in 𝔾𝒰\mathbb{G}\setminus{\cal U}.

Case 1 (1): From the algorithm description, there is an edge between any two vertices whose indices differ by at most k/2k/2. Since k1k-1 vertices are deleted, we have either

  • There are no k/2k/2 deleted vertices whose indices are consecutive integers in (u,v)(u,v).

  • Or there are no k/2k/2 deleted vertices whose indices are consecutive integers in {1,,u1}{v+1,,n}\{1,\dots,u-1\}\cup\{v+1,\dots,n\}.

In either scenario, Lemma 3 implies that there is a path between uu and vv in 𝔾𝒰\mathbb{G}\setminus{\cal U}.

Case 2 (1): From the algorithm description, there is an edge between any two vertices whose indices differ by at most (k1)/2(k-1)/2 and an edge between any vertex ii and vertex i+n/2i+n/2. If either

  • There are no (k1)/2(k-1)/2 deleted vertices whose indices are consecutive integers in (u,v)(u,v).

  • Or there are no (k1)/2(k-1)/2 deleted vertices whose indices are consecutive integers in {1,,u1}{v+1,,n}\{1,\dots,u-1\}\cup\{v+1,\dots,n\}.

then Lemma 3 implies that there is a path between uu and vv in 𝔾𝒰\mathbb{G}\setminus{\cal U}.

Thus, it remains to consider the case in which there are (k1)/2(k-1)/2 deleted vertices whose indices are consecutive integers in (u,v)(u,v) and (k1)/2(k-1)/2 deleted vertices whose indices are consecutive integers in {1,,u1}{v+1,,n}\{1,\dots,u-1\}\cup\{v+1,\dots,n\}. Let the former set of vertex indices be 𝒜{\cal A} and the latter be {\cal B}. Since |𝒰|=k1|{\cal U}|=k-1, we see that 𝒰=𝒜{\cal U}={\cal A}\cup{\cal B}. Let ={b,,b+(k3)/2}{\cal B}=\{b,\dots,b+(k-3)/2\}, where indices are taken mod nn.

If v=u+n/2v=u+n/2, we directly obtain the path uvu\to v, which is what we wanted to show. Thus, suppose vu+n/2v\neq u+n/2. We will only consider the case v<u+n/2v<u+n/2 because the case v>u+n/2v>u+n/2 is symmetric.

Since 𝒜(u,v){\cal A}\subseteq(u,v), we have vu>(k1)/2v-u>(k-1)/2, so (v+n/2)(u+n/2)>(k1)/2(v+n/2)-(u+n/2)>(k-1)/2. Then the length of the interval (u+n/2,v+n/2)(u+n/2,v+n/2) is greater than |||{\cal B}|.

  • If b>u+n/2b>u+n/2, then {\cal B} does not contain u+n/2u+n/2, so consider the path uu+n/2u+n/21vu\to u+n/2\to u+n/2-1\to\dots\to v. See the left illustration in Figure 11 for this case.

  • Otherwise, bu+n/2b\leq u+n/2. Since the length of the interval (u+n/2,v+n/2)(u+n/2,v+n/2) is greater than |||{\cal B}|, we see that {\cal B} does not contain v+n/2v+n/2. Consider the path uu1v+n/2+1v+n/2vu\to u-1\to\dots\to v+n/2+1\to v+n/2\to v. See the right illustration in Figure 11 for this case.

In both scenarios, we found a path between uu and vv in 𝔾𝒰\mathbb{G}\setminus{\cal U}.

uuu+n/2u+n/2vv𝒜{\cal A}{\cal B}uuvvv+n/2v+n/2𝒜{\cal A}{\cal B}
Figure 11: Illustration of Case 2 (1)

Case 2 (3): From the algorithm description, there is an edge between any two vertices whose indices differ by at most (k1)/2(k-1)/2 and an edge between ii and i+(n1)/2i+(n-1)/2 for any 1in+121\leq i\leq\frac{n+1}{2}.

Using the same argument as in Case 2 (1), Lemma 3 solves all scenarios, except the one where there are (k1)/2(k-1)/2 deleted vertices whose indices are consecutive integers in (u,v)(u,v) and (k1)/2(k-1)/2 deleted vertices whose indices are consecutive integers in {1,,u1}{v+1,,n}\{1,\dots,u-1\}\cup\{v+1,\dots,n\}. Let the former set of vertex indices be 𝒜{\cal A} and the latter be {\cal B}. Since |𝒰|=k1|{\cal U}|=k-1, we see that 𝒰=𝒜{\cal U}={\cal A}\cup{\cal B}. Let ={b,,b+(k3)/2}{\cal B}=\{b,\dots,b+(k-3)/2\}, where indices are taken mod nn.

The condition that there is an edge between ii and i+(n1)/2i+(n-1)/2 for any 1in+121\leq i\leq\frac{n+1}{2} translates to:

  • Vertices with index at most (n1)/2(n-1)/2 are adjacent to i+(n1)/2i+(n-1)/2

  • Vertices with index at least (n+3)/2(n+3)/2 are adjacent to i+(n+1)/2i+(n+1)/2

  • Vertex (n+1)/2(n+1)/2 is adjacent to both (n+1)/2+(n1)/2(n+1)/2+(n-1)/2 and (n+1)/2+(n+1)/2(n+1)/2+(n+1)/2.

Let uu be adjacent to u+(n+εu)/2u+(n+\varepsilon_{u})/2, and vv be adjacent to v+(n+εv)/2v+(n+\varepsilon_{v})/2, where εu,εv{1,1}\varepsilon_{u},\varepsilon_{v}\in\{-1,1\}. We claim that the length of the interval (u+(n+εu)/2,v+(n+εu)/2)(u+(n+\varepsilon_{u})/2,v+(n+\varepsilon_{u})/2) is greater than (k1)/2(k-1)/2.

Since 𝒜(u,v){\cal A}\subseteq(u,v), we have vu(k+1)/2v-u\geq(k+1)/2, so the length of the interval is at least (k1)/2(k-1)/2. For the length to equal (k1)/2(k-1)/2, vertex uu must be adjacent to u+(n+1)/2u+(n+1)/2, and vertex vv must be adjacent to v+(n1)/2v+(n-1)/2. If u,v(n+1)/2u,v\neq(n+1)/2, we immediately reach a contradiction because u<vu<v. If u=(n+1)/2u=(n+1)/2, change εu\varepsilon_{u} to 1-1. If vv equals (n+1)/2(n+1)/2, change εv\varepsilon_{v} to 11. Thus, we can always ensure that the length of the interval is greater than (k1)/2(k-1)/2.

  • If b>u+(n+εu)/2b>u+(n+\varepsilon_{u})/2, then {\cal B} does not contain u+(n+εu)/2u+(n+\varepsilon_{u})/2, so consider the path uu+(n+εu)/2u+(n+εu)/21vu\to u+(n+\varepsilon_{u})/2\to u+(n+\varepsilon_{u})/2-1\to\dots\to v.

  • Otherwise, b<u+(n+εu)/2b<u+(n+\varepsilon_{u})/2. Since the length of the interval (u+(n+εu)/2,v+(n+εu)/2)(u+(n+\varepsilon_{u})/2,v+(n+\varepsilon_{u})/2) is greater than |||{\cal B}|, we see that {\cal B} does not contain v+(n+εv)/2v+(n+\varepsilon_{v})/2, so consider the path uu1v+(n+εv)/2+1v+(n+εv)/2vu\to u-1\to\dots\to v+(n+\varepsilon_{v})/2+1\to v+(n+\varepsilon_{v})/2\to v.

In both scenarios, we found a path between uu and vv in 𝔾𝒰\mathbb{G}\setminus{\cal U}.

In all cases, we have found a path between any two vertices in 𝔾𝒰\mathbb{G}\setminus{\cal U}, so 𝔾𝒰\mathbb{G}\setminus{\cal U} is connected. Thus, v(𝔾)=kv(\mathbb{G})=k, which completes the proof.  

IV Fast Consensus

In this section, we study the algebraic connectivity of the minimal Laplacian energy graphs generated by Algorithm 1. We will show that the generated “dense” graphs possess large algebraic connectivity, while the generated “sparse” graphs do not. This finding is consistent with the observations from the figures in the introduction.

Among all non-complete graphs with nn vertices and mm edges, it is known that a(𝔾)v(𝔾)a(\mathbb{G})\leq v(\mathbb{G}) [9, Theorem 4.1]. From the preceding discussion, it follows that a(𝔾)2mna(\mathbb{G})\leq\lfloor\frac{2m}{n}\rfloor for all non-complete graphs. Theorem 5 gives a lower bound on algebraic connectivity of graphs constructed by Algorithm 1.

Theorem 5

Let 𝔾\mathbb{G} be the graph generated by Algorithm 1 with nn vertices and mnm\geq n edges. Then,

a(𝔾)k¯sin(k¯π/n)sin(π/n),a(\mathbb{G})\geq\bar{k}-\frac{\sin(\bar{k}\pi/n)}{\sin(\pi/n)}, (3)

where k=2mnk=\lfloor\frac{2m}{n}\rfloor and k¯=2k2+1\bar{k}=2\lfloor\frac{k}{2}\rfloor+1, with equality holding if the graph is constructed in Case 1 (1) and Case 2 (1).

Note that k¯k+12mn+1n\bar{k}\leq k+1\leq\frac{2m}{n}+1\leq n. We will use this fact without special mention in the sequel.

To prove Theorem 5, we need the following concept and results. A circulant matrix is a square matrix in which all rows are composed of the same entries and each row is rotated one entry to the right relative to the preceding row. The spectrum of any circulant matrix can be completely determined by its first row entries, as specified in the following lemma:

Lemma 4

(Theorem 6 in [29]) If CC is an n×nn\times n circulant matrix whose first row entries are c0,c1,,cn1c_{0},c_{1},\ldots,c_{n-1}, then its nn eigenvalues are λi=p=0n1cpej2piπn\lambda_{i}=\sum_{p=0}^{n-1}c_{p}e^{\frac{j2pi\pi}{n}}, i{0,1,,n1}i\in\{0,1,\ldots,n-1\}, where jj is the imaginary unit.

Lemma 5

For any integers n2n\geq 2 and 2kn22\leq k\leq n-2,

maxi{1,2,,n1}2p=1k2cos(2piπn)=sin(k¯π/n)sin(π/n)1,\max_{i\in\{1,2,\ldots,n-1\}}2\sum_{p=1}^{\lfloor\frac{k}{2}\rfloor}\cos\bigg{(}\frac{2pi\pi}{n}\bigg{)}=\frac{\sin(\bar{k}\pi/n)}{\sin(\pi/n)}-1,

where k¯=2k2+1\bar{k}=2\lfloor\frac{k}{2}\rfloor+1, and the maximum is achieved if, and only if, i=1i=1 or i=n1i=n-1.

Proof of Lemma 5: From the angle addition and subtraction formulae, 2cosasinb=sin(a+b)sin(ab)2\cos a\sin b=\sin(a+b)-\sin(a-b) for any a,bIRa,b\in{\rm I\!R}. Let a=2piπ/na=2pi\pi/n and b=iπ/nb=i\pi/n. Since sin(iπ/n)>0\sin(i\pi/n)>0 for all integers i{1,2,,n1}i\in\{1,2,\ldots,n-1\}, it follows that for all integers i{1,2,,n1}i\in\{1,2,\ldots,n-1\},

2cos(2piπn)=sin((2p+1)iπ/n)sin((2p1)iπ/n)sin(iπ/n).2\cos\bigg{(}\frac{2pi\pi}{n}\bigg{)}=\frac{\sin((2p+1)i\pi/n)-\sin((2p-1)i\pi/n)}{\sin(i\pi/n)}.

Summing this relation over index pp from 11 to k2\lfloor\frac{k}{2}\rfloor,

2p=1k2cos(2piπn)=sin(k¯iπ/n)sin(iπ/n)1.2\sum_{p=1}^{\lfloor\frac{k}{2}\rfloor}\cos\bigg{(}\frac{2pi\pi}{n}\bigg{)}=\frac{\sin(\bar{k}i\pi/n)}{\sin(i\pi/n)}-1.

It remains to identify the optimal integers ii over the interval [1,n1][1,n-1] that maximize sin(k¯iπ/n)sin(iπ/n)\frac{\sin(\bar{k}i\pi/n)}{\sin(i\pi/n)}. To this end, define a function f(x)=sin(k¯x)sin(x)f(x)=\frac{\sin(\bar{k}x)}{\sin(x)}. Figure 12 provides an example plot. First, we check that f(x)f(x) is symmetric around π/2\pi/2. Since k¯=2k/2+1\bar{k}=2\lfloor k/2\rfloor+1 is odd,

f(πx)=sin(k¯(πx))sin(πx)=sin(πk¯x)sin(πx)=sin(k¯x)sin(x)=f(x).f(\pi-x)=\frac{\sin(\bar{k}(\pi-x))}{\sin(\pi-x)}=\frac{\sin(\pi-\bar{k}x)}{\sin(\pi-x)}=\frac{\sin(\bar{k}x)}{\sin(x)}=f(x).

Thus, it suffices to show f(π/n)f(iπ/n)f(\pi/n)\geq f(i\pi/n) for all integers i(0,n/2]i\in(0,n/2]. Second, we show that in the interval (0,π)(0,\pi), f(x)f(x) attains its maximum of k¯\bar{k} as xx approaches 0 or π\pi. Clearly, limx0f(x)=limxπf(x)=k¯\lim_{x\to 0}f(x)=\lim_{x\to\pi}f(x)=\bar{k}. Meanwhile,

|f(x)|\displaystyle|f(x)| =|ejk¯xejk¯xejxejx|\displaystyle=\bigg{|}\frac{e^{j\bar{k}x}-e^{-j\bar{k}x}}{e^{jx}-e^{-jx}}\bigg{|}
=|ej(k¯1)x+ej(k¯3)x++ej(k¯+1)x|\displaystyle=\big{|}e^{j(\bar{k}-1)x}+e^{j(\bar{k}-3)x}+\dots+e^{j(-\bar{k}+1)x}\big{|}
|ej(k¯1)x|+|ej(k¯3)x|++|ej(k¯+1)x|k¯.\displaystyle\leq\big{|}e^{j(\bar{k}-1)x}\big{|}+\big{|}e^{j(\bar{k}-3)x}\big{|}+\dots+\big{|}e^{j(-\bar{k}+1)x}\big{|}\leq\bar{k}.

Finally, observe that f(x)f(x) has roots at π/k¯,2π/k¯,,(k¯1)π/k¯\pi/\bar{k},2\pi/\bar{k},\dots,(\bar{k}-1)\pi/\bar{k} and has a maximum/minimum in each interval (pπ/k¯,(p+1)π/k¯)(p\pi/\bar{k},(p+1)\pi/\bar{k}), where 0pk¯10\leq p\leq\bar{k}-1. Since kn2k\leq n-2 by assumption, we have k¯n1\bar{k}\leq n-1, so π/n\pi/n is always in the leftmost interval and is closest to xx-coordinate of the global maximum at 0. Hence, f(π/n)f(iπ/n)f(\pi/n)\geq f(i\pi/n) for all integers i(0,n/2]i\in(0,n/2].  

0.50.5111.51.5222.52.5335510101515
Figure 12: Plot of f(x)=sin(k¯x)sin(x)f(x)=\frac{\sin(\bar{k}x)}{\sin(x)} for k¯=19\bar{k}=19

Proof of Theorem 5: Note that for any simple graph with n2n\geq 2 vertices and mnm\geq n edges, k=2mn2k=\lfloor\frac{2m}{n}\rfloor\geq 2. Also, if k=n1k=n-1, the graph is complete, so a(𝔾)=na(\mathbb{G})=n [9] and inequality (3) holds. Thus, we only consider kn2k\leq n-2 in the rest of the proof. Since the algebraic connectivity of a non-complete graph will not decrease after adding an edge [9, Corollary 3.2], it suffices to prove (3) for Case 1 (1), Case 2 (1), and Case 2 (3).

Case 1 (1): From the algorithm description, it is straightforward to verify that the Laplacian matrix of the generated graph is a circulant matrix, with its first row entries being

k,1,,1k/2,0,,0nk1,1,,1k/2k,\;\underbrace{-1,\ldots,-1}_{k/2},\;\underbrace{0,\ldots,0}_{n-k-1},\;\underbrace{-1,\ldots,-1}_{k/2}

From Lemma 4, its nn eigenvalues are

λi\displaystyle\lambda_{i} =kp=1k/2ej2piπnp=nk/2n1ej2piπn\displaystyle=k-\sum_{p=1}^{k/2}e^{\frac{j2pi\pi}{n}}-\sum_{p=n-k/2}^{n-1}e^{\frac{j2pi\pi}{n}}
=kp=1k/2(ej2piπn+ej2(np)iπn)\displaystyle=k-\sum_{p=1}^{k/2}\left(e^{\frac{j2pi\pi}{n}}+e^{\frac{j2(n-p)i\pi}{n}}\right)
=k2p=1k/2cos(2piπn),i{0,1,,n1}.\displaystyle=k-2\sum_{p=1}^{k/2}\cos\bigg{(}\frac{2pi\pi}{n}\bigg{)},\;\;\;i\in\{0,1,\ldots,n-1\}.

It is easy to see that λ0=0\lambda_{0}=0, which is the smallest eigenvalue. Since the generated graph is connected, all other eigenvalues are positive. Since in Case 1, kk is even, and thus k¯=k+1\bar{k}=k+1. From Lemma 5, the maximum among 2p=1k/2cos(2piπn)2\sum_{p=1}^{k/2}\cos\left(\frac{2pi\pi}{n}\right), i{1,2,,n1}i\in\{1,2,\ldots,n-1\} is sin((k+1)π/n)sin(π/n)1\frac{\sin((k+1)\pi/n)}{\sin(\pi/n)}-1. Thus, the second smallest eigenvalue a(𝔾)=k+1sin((k+1)π/n)sin(π/n)a(\mathbb{G})=k+1-\frac{\sin((k+1)\pi/n)}{\sin(\pi/n)}.

Case 2 (1): From the algorithm description, it is straightforward to verify that the Laplacian matrix of the generated graph is a circulant matrix, with its first row entries being

k,1,,1(k1)/2,0,,0(nk1)/2,1,0,,0(nk1)/2,1,,1(k1)/2k,\;\underbrace{-1,\ldots,-1}_{(k-1)/2},\;\underbrace{0,\ldots,0}_{(n-k-1)/2},\;-1,\;\underbrace{0,\ldots,0}_{(n-k-1)/2},\;\underbrace{-1,\ldots,-1}_{(k-1)/2}

From Lemma 4, its nn eigenvalues are

λi\displaystyle\lambda_{i} =kp=1(k1)/2ej2piπn1p=n(k1)/2n1ej2piπn\displaystyle=k-\sum_{p=1}^{(k-1)/2}e^{\frac{j2pi\pi}{n}}-1-\sum_{p=n-(k-1)/2}^{n-1}e^{\frac{j2pi\pi}{n}}
=k1p=1(k1)/2(ej2piπn+ej2(np)iπn)\displaystyle=k-1-\sum_{p=1}^{(k-1)/2}\left(e^{\frac{j2pi\pi}{n}}+e^{\frac{j2(n-p)i\pi}{n}}\right)
=k1p=1(k1)/2(ej2piπn+ej2piπn)\displaystyle=k-1-\sum_{p=1}^{(k-1)/2}\left(e^{\frac{j2pi\pi}{n}}+e^{-\frac{j2pi\pi}{n}}\right)
=k12p=1(k1)/2cos(2piπn),i{0,1,,n1}.\displaystyle=k-1-2\sum_{p=1}^{(k-1)/2}\cos\bigg{(}\frac{2pi\pi}{n}\bigg{)},\;\;\;i\in\{0,1,\ldots,n-1\}.

Since in Case 2, kk is odd, and thus k¯=k\bar{k}=k. Using the same argument as in Case 1 (1), the second smallest eigenvalue a(𝔾)=ksin(kπ/n)sin(π/n)a(\mathbb{G})=k-\frac{\sin(k\pi/n)}{\sin(\pi/n)}.

Case 2 (3): In this case, the Laplacian matrix of the generated graph 𝔾\mathbb{G} is not a circulant matrix. Consider the spanning subgraph of 𝔾\mathbb{G}, denoted as \mathbb{H}, with an edge set defined such that for each pair of i{1,,n}i\in\{1,\ldots,n\} and j{±1,,±k12}j\in\{\pm 1,\dots,\pm\frac{k-1}{2}\}, there is an edge between vertex ii and vertex (i+j)modn(i+j)\bmod n. It is straightforward to verify that \mathbb{H} is connected and its Laplacian matrix is a circulant matrix, with its first row entries being

k,1,,1(k1)/2,0,,0nk,1,,1(k1)/2k,\;\underbrace{-1,\ldots,-1}_{(k-1)/2},\;\underbrace{0,\ldots,0}_{n-k},\;\underbrace{-1,\ldots,-1}_{(k-1)/2}

Using the same argument as in Case 1 (1), the second smallest eigenvalue a()=k+1sin(kπ/n)sin(π/n)a(\mathbb{H})=k+1-\frac{\sin(k\pi/n)}{\sin(\pi/n)}. Since \mathbb{H} is a spanning subgraph of 𝔾\mathbb{G}, a(𝔾)k+1sin(kπ/n)sin(π/n)a(\mathbb{G})\geq k+1-\frac{\sin(k\pi/n)}{\sin(\pi/n)}.  

From Theorem 5, the graphs constructed by Algorithm 1 in Case 1 (1) and Case 2 (1) have an explicit algebraic connectivity expression, a(𝔾)=k¯sin(k¯π/n)sin(π/n)a(\mathbb{G})=\bar{k}-\frac{\sin(\bar{k}\pi/n)}{\sin(\pi/n)}, which can be bounded as follows:

Lemma 6

For any graph 𝔾\mathbb{G} generated by Algorithm 1 in Case 1 (1) or Case 2 (1), π2(0.5k¯3k¯)6n2π2<a(𝔾)<k¯3π26n2\frac{\pi^{2}(0.5\bar{k}^{3}-\bar{k})}{6n^{2}-\pi^{2}}<a(\mathbb{G})<\frac{\bar{k}^{3}\pi^{2}}{6n^{2}}, where k¯=2k2+1\bar{k}=2\lfloor\frac{k}{2}\rfloor+1 and k=2mnk=\lfloor\frac{2m}{n}\rfloor.

Proof of Lemma 6: Using the Taylor series and basic calculus, it is straightforward to show that xx3/6<sinx<xx3/6+x5/120x-x^{3}/6<\sin x<x-x^{3}/6+x^{5}/120 for all x>0x>0. Applying the upper bound in this inequality to sin(k¯π/n)\sin(\bar{k}\pi/n) leads to sin(k¯π/n)<k¯πnk¯3π36n3+k¯5π5120n5\sin(\bar{k}\pi/n)<\frac{\bar{k}\pi}{n}-\frac{\bar{k}^{3}\pi^{3}}{6n^{3}}+\frac{\bar{k}^{5}\pi^{5}}{120n^{5}}, and applying the lower bound to sin(π/n)\sin(\pi/n) leads to sin(π/n)>πnπ36n3\sin(\pi/n)>\frac{\pi}{n}-\frac{\pi^{3}}{6n^{3}}. Then,

a(𝔾)\displaystyle a(\mathbb{G}) >k¯k¯πnk¯3π36n3+k¯5π5120n5πnπ36n3=(k¯3k¯)n2π2120k¯5π46n4n2π2\displaystyle>\bar{k}-\frac{\frac{\bar{k}\pi}{n}-\frac{\bar{k}^{3}\pi^{3}}{6n^{3}}+\frac{\bar{k}^{5}\pi^{5}}{120n^{5}}}{\frac{\pi}{n}-\frac{\pi^{3}}{6n^{3}}}=\frac{(\bar{k}^{3}-\bar{k})n^{2}\pi^{2}-\frac{1}{20}\bar{k}^{5}\pi^{4}}{6n^{4}-n^{2}\pi^{2}}
=(k¯3k¯)π26n2π2120k¯5π46n4n2π2.\displaystyle=\frac{(\bar{k}^{3}-\bar{k})\pi^{2}}{6n^{2}-\pi^{2}}-\frac{\frac{1}{20}\bar{k}^{5}\pi^{4}}{6n^{4}-n^{2}\pi^{2}}.

Since k¯n\bar{k}\leq n, it follows that k¯56n4π2n2k¯36n2π2\frac{\bar{k}^{5}}{6n^{4}-\pi^{2}n^{2}}\leq\frac{\bar{k}^{3}}{6n^{2}-\pi^{2}}. Thus,

a(𝔾)\displaystyle a(\mathbb{G}) >(k¯3k¯)π26n2π2120k¯3π46n2π2>π2(0.5k¯3k¯)6n2π2.\displaystyle>\frac{(\bar{k}^{3}-\bar{k})\pi^{2}}{6n^{2}-\pi^{2}}-\frac{\frac{1}{20}\bar{k}^{3}\pi^{4}}{6n^{2}-\pi^{2}}>\frac{\pi^{2}(0.5\bar{k}^{3}-\bar{k})}{6n^{2}-\pi^{2}}.

Next we apply xx3/6<sinxx-x^{3}/6<\sin x to sin(k¯π/n)\sin(\bar{k}\pi/n), which leads to sin(k¯π/n)>k¯πnk¯3π36n3\sin(\bar{k}\pi/n)>\frac{\bar{k}\pi}{n}-\frac{\bar{k}^{3}\pi^{3}}{6n^{3}}. With this and the fact sin(π/n)<π/n\sin(\pi/n)<\pi/n, it follows that a(𝔾)<k¯3π26n2a(\mathbb{G})<\frac{\bar{k}^{3}\pi^{2}}{6n^{2}}.  

More can be said. Let 2mn6n2/π231\lfloor\frac{2m}{n}\rfloor\leq\sqrt[3]{6n^{2}/\pi^{2}}-1. Then, k¯k+16n2/π23\bar{k}\leq k+1\leq\sqrt[3]{6n^{2}/\pi^{2}}. From Lemma 6, a(𝔾)<1a(\mathbb{G})<1. We have thus proved the following:

Corollary 2

Let 𝔾\mathbb{G} be any graph generated by Algorithm 1 in Case 1 (1) or Case 2 (1). If k=2mn6n2/π231k=\lfloor\frac{2m}{n}\rfloor\leq\sqrt[3]{6n^{2}/\pi^{2}}-1, then a(𝔾)<1a(\mathbb{G})<1.

Let us agree to call a graph with nn vertices and mm edges sparse if its average degree 2mn\frac{2m}{n} is much smaller than O(n)O(n), and dense if 2mn=O(n)\frac{2m}{n}=O(n).

Among all connected graphs with nn vertices and mm edges, it is known that a(𝔾)2e(𝔾)(1cos(π/n))a(\mathbb{G})\geq 2e(\mathbb{G})(1-\cos(\pi/n)) [9, Theorem 4.3]. Since e(𝔾)n1e(\mathbb{G})\leq n-1, it is easy to see that this lower bound of a(𝔾)a(\mathbb{G}) is strictly less than 1 if n9n\geq 9. Corollary 2 implies that when the minimal Laplacian energy graph generated by Algorithm 1 in Case 1 (1) or Case 2 (1) is sparse, its algebraic connectivity is small. This suggests that small/minimal Laplacian energy and large/maximal algebraic connectivity do not match for sparse graphs. This observation is not surprising; for instance, in the special case of tree graphs where m=n1m=n-1, the maximal algebraic connectivity graph is the star, while the minimal Laplacian energy graph is the path, which are opposites. The maximal algebraic connectivity graphs for some special sparse cases were theoretically identified in [15, Theorems 1, 2, 4].

In contrast to sparse graphs, the following result shows that generated dense graphs have large algebraic connectivity.

Corollary 3

Let 𝔾\mathbb{G} be the graph constructed by Algorithm 1 with nn vertices and mm edges. If k=2mnn+12n3k=\lfloor\frac{2m}{n}\rfloor\geq n+1-\sqrt{2n-3}, then a(𝔾)k2k1a(\mathbb{G})\geq k-2\sqrt{k-1}.

Among all connected non-complete graphs with nn vertices and mm edges, it is known that a(𝔾)v(𝔾)a(\mathbb{G})\leq v(\mathbb{G}) [9, Theorem 4.1]. From the discussion in Section III, a(𝔾)v(𝔾)ka(\mathbb{G})\leq v(\mathbb{G})\leq k. Note that n+12n3=O(n)n+1-\sqrt{2n-3}=O(n). Thus, Corollary 3 implies that when the minimal Laplacian energy graph generated by Algorithm 1 is dense, its algebraic connectivity is large. In fact, it is known that a(𝔾)k2k1+O(logkn)1a(\mathbb{G})\leq k-2\sqrt{k-1}+O(\log_{k}n)^{-1} for all connected almost regular graphs with nn vertices and mm edges [30, Theorem 1]. Therefore, the dense graphs generated by Algorithm 1 exhibit nearly optimal algebraic connectivity.

Proof of Corollary 3: From Theorem 5, to prove the corollary, it is sufficient to show k¯sin(k¯π/n)sin(π/n)k2k1\bar{k}-\frac{\sin(\bar{k}\pi/n)}{\sin(\pi/n)}\geq k-\sqrt{2k-1}. In the case when kk is odd, k¯=k\bar{k}=k, and the target inequality simplifies to sin(kπ/n)sin(π/n)2k1\frac{\sin(k\pi/n)}{\sin(\pi/n)}\leq\sqrt{2k-1}. In the case when kk is even, k¯=k+1\bar{k}=k+1, and the target inequality simplifies to sin((k+1)π/n)sin(π/n)12k1\frac{\sin((k+1)\pi/n)}{\sin(\pi/n)}-1\leq\sqrt{2k-1}. Since kk is an integer in the interval [n+12n3,n1][n+1-\sqrt{2n-3},n-1] and it is easy to verify that n/2n+12n3n/2\leq n+1-\sqrt{2n-3}, it follows that n/2n+12n3kn1n/2\leq n+1-\sqrt{2n-3}\leq k\leq n-1. Then, π/2kπ/n<(k+1)π/nπ\pi/2\leq k\pi/n<(k+1)\pi/n\leq\pi. Since the sine function is decreasing on the interval [π/2,π][\pi/2,\pi], sin(kπ/n)>sin((k+1)π/n)\sin(k\pi/n)>\sin((k+1)\pi/n). Thus, it is sufficient to prove sin(kπ/n)sin(π/n)2k1\frac{\sin(k\pi/n)}{\sin(\pi/n)}\leq\sqrt{2k-1} for all even kk in the interval [n+12n3,n1][n+1-\sqrt{2n-3},n-1]. To this end, we define the following function:

f(x)=sin(xπ/n)sin(π/n)2x1,x[n+12n3,n1]f(x)=\frac{\sin(x\pi/n)}{\sin(\pi/n)}-\sqrt{2x-1},\;\;\;x\in[n+1-\sqrt{2n-3},n-1]

We then apply Newton’s method to obtain a bound on the largest root of f(x)f(x) in the interval [n+12n3,n1][n+1-\sqrt{2n-3},n-1]. Figure 13 is a visualization for n=24n=24. Set the initial estimate x0=n1x_{0}=n-1. The first estimation x1x_{1} is the intersection of the tangent line at (x0,f(x0))(x_{0},f(x_{0})) with the xx-axis:

x1\displaystyle x_{1} =x0f(x0)f(x0)=n12n31πncot(πn)+(2n3)12\displaystyle=x_{0}-\frac{f(x_{0})}{f^{\prime}(x_{0})}=n-1-\frac{\sqrt{2n-3}-1}{\frac{\pi}{n}\cot(\frac{\pi}{n})+(2n-3)^{-\frac{1}{2}}}
n12n311+(2n3)12n+12n3.\displaystyle\leq n-1-\frac{\sqrt{2n-3}-1}{1+(2n-3)^{-\frac{1}{2}}}\leq n+1-\sqrt{2n-3}.

Since f(x)f(x) is concave downward on the interval [n+12n3,n1][n+1-\sqrt{2n-3},n-1], the actual largest root must be strictly less than x1x_{1}. Hence, for all xn+12n3x\geq n+1-\sqrt{2n-3}, f(x)f(x) must be nonpositive, which completes the proof.  

5510101515202025255-555101015152020(x0,f(x0))(x_{0},f(x_{0}))(x1,0)(x_{1},0)
Figure 13: Plot of Newton’s method on f(x)f(x) for n=24n=24. The red curve is f(x)f(x), and the blue line is the tangent.

The graphs constructed by Algorithm 1 in Case 1 (1), which actually belong to the so-called regular lattices. A simple graph with n3n\geq 3 vertices is called a dd-regular lattice, with dd being an even integer in the interval [2,n1][2,n-1], if each vertex ii is adjacent to each of those vertices whose indices are (i+j)modn(i+j)\bmod n, j{±1,,±d2}j\in\{\pm 1,\ldots,\pm\frac{d}{2}\} [31]. It is easy to see that any graph with n3n\geq 3 vertices generated by Algorithm 1 in Case 1 (1) is a kk-regular lattice. Lemma 6 immediately implies that the algebraic connectivity of a kk-regular lattice is of the order O(k3/n2)O(k^{3}/n^{2}).

Regular lattices are closely related to Watts-Strogatz small-world networks, which are generated by randomly rewiring edges in a regular lattice. The rewiring procedure involves iterating through each edge, and with probability pp, one endpoint is moved to a new vertex chosen randomly from the lattice. Double edges and self-loops are not allowed in this process, so small-world networks are simple graphs [31].

The work of [32] defines the algebraic connectivity gain, λ2(p)/λ2(0)\lambda_{2}(p)/\lambda_{2}(0), as the algebraic connectivity of the small-world network formed by rewiring with probability pp divided by the algebraic connectivity of the regular lattice [32, Definition 1]. By running simulations with klog(n)k\approx\log(n), the paper conjectures that the maximum λ2(p)/λ2(0)\lambda_{2}(p)/\lambda_{2}(0) is on the order of O(n)O(n) [32, Observation (ii), page 4], which implies that small-world networks can reach consensus significantly faster than regular lattices. Lemma 6 implies that λ2(0)\lambda_{2}(0) is on the order of O(k3/n2)O(k^{3}/n^{2}). Thus, if one can show that λ2(p)\lambda_{2}(p) is on the order of O(k3/n)O(k^{3}/n), then the conjecture in [32] would be mathematically verified. Whether small-world networks can achieve algebraic connectivity of order O(k3/n)O(k^{3}/n) has so far eluded us, but Lemma 6 provides a helpful first step in addressing this question.

V Conclusion

This paper proposes a novel approach to designing fast consensus topologies by minimizing Laplacian energy, marking the first step in this direction. Although both sparse and dense graphs have been analyzed, and the findings are consistent with the observations in the introduction, the scattered non-matching cases for medium-dense graphs (see Figures 3 and 4) have not been addressed. These graphs belong to complete bipartite graphs. A simple graph is called bipartite if its vertices can be partitioned into two classes so that every edge has endpoints in different classes. The complete bipartite graph Kp,npK_{p,n-p} is the bipartite graph with pp vertices in one class, npn-p vertices in the other class, and all p(np)p(n-p) edges between vertices of different classes [33, page 17]. It is worth mentioning that maximal algebraic connectivity graphs were identified as complete bipartite graphs for some special medium-dense graphs [15, Theorem 3, Table I]. Understanding these observations is a direction for future research.

References

  • [1] A. Jadbabaie, J. Lin, and A.S. Morse. Coordination of groups of mobile autonomous agents using nearest neighbor rules. IEEE Transactions on Automatic Control, 48(6):988–1001, 2003.
  • [2] R. Olfati-Saber and R.M. Murray. Consensus problems in networks of agents with switching topology and time-delays. IEEE Transactions on Automatic Control, 49(9):1520–1533, 2004.
  • [3] L. Moreau. Stability of multi-agent systems with time-dependent communication links. IEEE Transactions on Automatic Control, 50(2):169–182, 2005.
  • [4] W. Ren and R.W. Beard. Consensus seeking in multiagent systems under dynamically changing interaction topologies. IEEE Transactions on Automatic Control, 50(5):655–661, 2005.
  • [5] J.A. Fax and R.M. Murray. Information flow and cooperative control of vehicle formations. IEEE Transactions on Automatic Control, 49(9):1465–1476, 2004.
  • [6] R. Olfati-Saber, J.A. Fax, and R.M. Murray. Consensus and cooperation in networked multi-agent systems. Proceedings of the IEEE, 95(1):215–233, 2007.
  • [7] A. Nedić and A. Ozdaglar. Distributed subgradient methods for multi-agent optimization. IEEE Transactions on Automatic Control, 54(1):48–61, 2009.
  • [8] S. Mou, J. Liu, and A.S. Morse. A distributed algorithm for solving a linear algebraic equation. IEEE Transactions on Automatic Control, 60(11):2863–2878, 2015.
  • [9] M. Fiedler. Algebraic connectivity of graphs. Czechoslovak Mathematical Journal, 23(2):298–305, 1973.
  • [10] S. Kar and J.M.F. Moura. Topology for global average consensus. In Proceedings of the 40th Asilomar Conference on Signals, Systems and Computers, pages 276–280, 2006.
  • [11] M. Cao and C.W. Wu. Topology design for fast convergence of network consensus algorithms. In Proceedings of the 2007 IEEE International Symposium on Circuits and Systems, pages 1029–1032, 2007.
  • [12] M. Rafiee and A.M. Bayen. Optimal network topology design in multi-agent systems for efficient average consensus. In Proceedings of the 49th IEEE Conference on Decision and Control, pages 3877–3883, 2010.
  • [13] R. Dai and M. Mesbahi. Optimal topology design for dynamic networks. In Proceedings of the 50th IEEE Conference on Decision and Control, pages 1280–1285, 2011.
  • [14] D. Xue, A. Gusrialdi, and S. Hirche. A distributed strategy for near-optimal network topology design. In Proceedings of the 21st International Symposium on Mathematical Theory of Networks and Systems, pages 7–14, 2014.
  • [15] K. Ogiwara, T. Fukami, and N. Takahashi. Maximizing algebraic connectivity in the space of graphs with a fixed number of vertices and edges. IEEE Transactions on Control of Network Systems, 4(2):359–368, 2017.
  • [16] M. Lazić. On the Laplacian energy of a graph. Czechoslovak Mathematical Journal, 56(131):1207–1213, 2006.
  • [17] I. Gutman. The energy of a graph (in German). Berichte der Mathematisch-Statistischen Sektion im Forschungszentrum Graz, 103:1–22, 1978.
  • [18] I. Gutman and K.C. Das. The first Zagreb index 30 years after. MATCH Communications in Mathematical and in Computer Chemistry, 50:83–92, 2004.
  • [19] W. So, M. Robbiano, N. Abreu, and I. Gutman. Applications of a theorem by Ky Fan in the theory of graph energy. Linear Algebra and its Applications, 432(9):2163–2169, 2010.
  • [20] I. Gutman and B. Zhou. Laplacian energy of a graph. Linear Algebra and its Applications, 414(1):29–37, 2006.
  • [21] B. Zhou. On sum of powers of the Laplacian eigenvalues of graphs. Linear Algebra and its Applications, 429(8–9):2239–2246, 2008.
  • [22] Y. Liu and Y.Q. Sun. On the second Laplacian spectral moment of a graph. Czechoslovak Mathematical Journal, 60(135):401–410, 2010.
  • [23] N. Alon, S. Friedland, and G. Kalai. Regular subgraphs of almost regular graphs. Journal of Combinatorial Theory, 37:79–91, 1984.
  • [24] P. Erdős and T. Gallai. Graphs with prescribed degrees of vertices (in Hungarian). Matematikai Lapok, 11:264–274, 1960.
  • [25] A. Tripathi, S. Venugopalan, and D.B. West. A short constructive proof of the Erdős-Gallai characterization of graphic lists. Discrete Mathematics, 310:843–844, 2009.
  • [26] A. Nedić and J. Liu. Distributed optimization for control. Annual Review of Control, Robotics, and Autonomous Systems, 1:77–103, 2018.
  • [27] D.B. West. Introduction to Graph Theory. Prentice-Hall, second edition, 2000.
  • [28] H. Whitney. Congruent graphs and the connectivity of graphs. American Journal of Mathematics, 54(1):150–168, 1932.
  • [29] I. Kra and S.R. Simanca. On circulant matrices. Notices of the AMS, 59(3):368–377, 2012.
  • [30] A. Nilli. On the second eigenvalue of a graph. Discrete Mathematics, 91:207–210, 1991.
  • [31] D.J. Watts and S.H. Strogatz. Collective dynamics of small-world networks. Nature, 393:440–442, 1998.
  • [32] R. Olfati-Saber. Ultrafast consensus in small-world networks. In Proceedings of the 2005 American Control Conference, pages 2371–2378, 2005.
  • [33] R. Diestel. Graph Theory. Sringer, Berlin, 2005.