On the principal eigenvector of a graph
Abstract.
The principal ratio of a connected graph , , is the ratio between the largest and smallest coordinates of the principal eigenvector of the adjacency matrix of . Over all connected graphs on vertices, ranges from to . Moreover, if and only if is regular. This indicates that can be viewed as an irregularity measure of , as first suggested by Tait and Tobin (El. J. Lin. Alg. 2018). We are interested in how stable this measure is. In particular, we ask how changes when there is a small modification to a regular graph . We show that this ratio is polynomially bounded if we remove an edge belonging to a cycle of bounded length in , while the ratio can jump from to exponential if we join a pair of vertices at distance . We study the connection between the spectral gap of a regular graph and the stability of its principal ratio. A naive bound shows that given a constant multiplicative spectral gap and bounded degree, the ratio remains polynomially bounded if we add or delete an edge. Using results from matrix perturbation theory, we show that given an additive spectral gap greater than , the ratio stays bounded after adding or deleting an edge.
1. Introduction
It is known that the adjacency matrix of every connected graph has a simple largest eigenvalue, and this eigenvalue has an eigenvector with all-positive coordinates, called the principal eigenvector of the graph. It is natural to study how this eigenvector reflects the structure of the graph. Our goal is to obtain asymptotic information as the number of vertices approaches infinity in a family of graphs.
Cioabă and Gregory [6] defined the principal ratio of the graph , , to be the ratio between the largest and smallest coordinates of the principal eigenvector . This ratio is for regular graphs, while it can grow at factorial rate (i.e., for some positive constant ) [6]. Since where equality holds if and only if is regular, it is natural to think of as a measure of the irregularity of . This view was suggested by Tait and Tobin [8].
A basic observation is that, given a connected graph with largest eigenvalue and diameter , the principal ratio satisfies
(1.1) |
We are interested in the stability of , i.e., how a slight change of influences . In particular, given a -regular graph , we ask how changes from the constant if we add or remove one edge in . (We call the resulting graphs and , respectively.) We always assume the edge we remove will not disconnect (i.e., the edge is not a bridge), so that the principal eigenvector of is defined.
In Section 4, we study the cases where the edge we add to or remove from a regular graph is between vertices at bounded distance. We show the following.
-
•
can jump to exponential in when the degree is bounded [Theorem 4.3]. In our example, connects two vertices at distance in . We make use of Chebyshev polynomials in proving this result. We recall some properties of Chebyshev polynomials and show their connection with the principal eigenvectors of certain graphs in Sec. 3.2.
It is easy to infer from (1.1) that boundedness of the degree is necessary here (see Cor. 3.4 and Fact 3.5). -
•
If we remove an edge belonging to a cycle of bounded length in , then is always polynomially bounded regardless of the degree [Theorem 4.11].
We also study the relevance of the spectral gap to the stability of for regular graphs. In Section 5, based on (1.1), we note the following.
-
•
is always polynomially bounded in when is a bounded-degree expander graph, i.e., when the degree is bounded and the spectral gap of is bounded away from zero [Observation 5.3].
In Section 6.2, we put this problem in the more general context of perturbations of matrices. By adapting theorems and proofs from Stewart and Sun’s book [3] to our special case, we show the following.
-
•
If the additive spectral gap is greater than , then is bounded [Theorem 6.1].
This result does not follow from (1.1). Indeed, in Section 6.1 we construct graphs with degree of order and additive spectral gap of order , having diameter of order , for any constant . Similar applications of matrix perturbation theory in link analysis for networks can be found in [5].
The main technical results of this paper are the first and the fourth bullet points.
2. General preliminaries
2.1. Graphs
By a graph we mean what is often called a simple graph (undirected graph with no self-loops and no parallel edges). will always denote a connected graph with vertices. We denote by and the set of vertices and edges of , respectively. We usually identify the set of vertices with the set . We write if vertices are adjacent in . We denote by the set of neighbors of in . We use to denote the degree of vertex in . We write for the complement of . We let denote the distance between vertices and in , and the diameter of .
Let denote the cycle with vertices. Let denote the path with vertices; it has edges. Let denote the clique with vertices; it has edges. Following the notation used in previous papers on this subject, we use to denote the graph obtained by merging the vertex at one end of with one vertex in . So has vertices, edges, and diameter . This has been called a kite graph or a lollipop graph. We will call it a kite graph.
2.2. Matrices, spectra
Orthonormality in refers to the standard dot product. Given a matrix , we write for the entry on the -th row and in the -th column of , and we write .
We use to denote the set of real matrices. We write for the all-ones vector in , and for the all-ones matrix. We omit the dimension when it is clear from context.
For an real matrix , we write for the operator norm of induced by vector norm (),
In the rest of Sec. 2.2, will always denote a real symmetric matrix with eigenvalues .
Definition 2.1.
A multiset based on a set is a function from to positive integers, denoted by . The value is called the multiplicity of the element . For example, . We also expand this notation to . The order in which the elements are listed does not matter. So, for instance,
Definition 2.2.
The spectrum of an matrix is the multiset of its eigenvalues. We denote it by .
Fact 2.3.
The spectrum of the cycle is
.
Notation 2.4.
Let be an matrix and let be a matrix. The Kronecker product of and , , is the matrix
Fact 2.5.
Let and . Let the eigenvalues of be and let the eigenvalues of be . Then
.
2.3. The adjacency operator, principal eigenvector and eigenvalue
We write to denote the adjacency matrix of a graph . We note that is a real symmetric matrix, so its eigenvalues are real. We refer to the eigenvalues and eigenvectors of as the eigenvalues and eigenvectors of the graph , respectively. We write to denote the eigenvalues of .
Fact 2.6.
For every connected graph , the largest eigenvalue is simple, and it has a unique-up-to-scaling all-positive eigenvector (the principal eigenvector). ∎
We write for the principal eigenvector of scaled to have norm . Let denote the coordinate corresponding to vertex in . We write and for the maximum and minimum coordinates of , and and for corresponding vertices. Recall that the principal ratio of is defined as
(2.1) |
In the rest of Sec. 2.3, we fix the graph and omit it from notations.
Observation 2.7.
Given , the -th coordinate of is given by
.
Corollary 2.8.
is an eigenvector of to eigenvalue if and only if
.
Recall that denotes the all-ones vector.
Corollary 2.9.
is an eigenvector of if and only if is regular. ∎
Fact 2.10.
If is connected and is an eigenvector to eigenvalue with all-positive coordinates, then is the largest eigenvalue of .
Proof.
Since is simple, any eigenvector to an eigenvalue other than must be orthogonal to the principal eigenvector. ∎
Fact 2.11.
For a connected -regular graph , . ∎
Let denote , the maximum degree of .
Fact 2.12.
For every graph , we have . For connected graphs, equality holds if and only if is regular. ∎
We denote the quadratic mean of the degrees of vertices by
(2.2) |
Fact 2.13.
For every graph , we have .
Proof.
Immediate using Rayleigh’s principle applied to and the vector. ∎
2.4. Spectral gaps
For a graph , we call the quantity the additive spectral gap of , and the quantity the multiplicative spectral gap of .
We write for the Laplacian of , defined as the matrix
is positive semidefinite; is an eigenvector of to eigenvalue zero. We write for the smallest eigenvalue of restricted to the orthogonal complement of . We note that if and only if is disconnected. is the algebraic connectivity of the graph , as first defined by Fiedler [1].
For a graph , let be the characteristic polynomial of the adjacency matrix, and the characteristic polynomial of the Laplacian. When is a -regular graph, we have
(2.3) |
It follows that
(2.4) |
is the additive spectral gap of , and
(2.5) |
is the multiplicative spectral gap of . We shall discuss spectral gaps for regular graphs only.
In all notation, we omit the graph when it is clear from context.
2.5. Rates of growth
By a family of graphs, we mean an infinite set of non-isomorphic finite graphs.
Let be a family of graphs, and let be the number of vertices of . We say is polynomially bounded if for some constant and all sufficiently large . We say is exponential if for some constant and all sufficiently large . We say has factorial growth if for some positive constant and all sufficiently large .
2.6. Subgraphs, graph products
Fact 2.14.
If is a proper subgraph of a connected graph , i.e., is obtained from by deleting at least one edge and possibly some vertices, then .
Proof.
Immediate using Rayleigh’s principle. ∎
Notation 2.15.
Given a graph and , we denote the induced subgraph of on the set by .
Notation 2.16.
For graphs and , the Cartesian product of and , denoted by , is the graph with the set as vertices, and if and only if and , or and . For each , we call the horizontal layer corresponding to . For each , we call the vertical layer corresponding to . The horizontal layers are copies of and the vertical layers are copies of .
Notation 2.17.
For graphs and , the lexicographic product of and , denoted by , is the graph with the set as vertices, and if and only if either or and . For each we call the vertical layer corresponding to .
Recall that denotes the all-ones matrix.
Observation 2.18.
The adjacency matrix of is . ∎
3. Preliminary results about the principal eigenvector
As previously introduced, will always denote a connected graph. We write for the largest eigenvalue of the adjacency matrix of . We use to mean the principal eigenvector of the adjacency matrix, the all-positive eigenvector to . We assume is scaled to have norm unless otherwise stated. We write for the principal ratio of . We omit from these notations when the graph is clear from context.
3.1. Observations and naive bounds on the ratio
First, we note that reflects the symmetries of .
Fact 3.1.
The principal eigenvector is constant on orbits of , the automorphism group of graph . ∎
Next we note some basic bounds on the ratio between the coordinates of .
Observation 3.2.
For two vertices in , let . Then
Proof.
If , then . If , then by Corollary 2.8 and since all are positive, . Now, suppose and for all vertices at distance from . We know is adjacent to at least one vertex at distance from . Then
Recall that denotes the diameter of the graph.
Corollary 3.3.
For a connected graph of diameter ,
.
Corollary 3.4.
If is bounded for some family of graphs , then is polynomially bounded in . ∎
Since is relevant in bounding the ratio, we introduce a bound on for regular graphs.
Fact 3.5.
Let be a connected -regular graph. Then .
Proof.
Pick in so that . Let be a shortest path from to . Any with cannot have any common neighbors, since otherwise the path will not be a shortest path. Thus
Therefore . ∎
We know for any . The following result shows that , and consequently, also (if still connected), cannot differ from by more than a factor of .
Fact 3.6.
For a connected graph with and ,
Proof.
(Notation: By , where is a path, we mean the distance between and along the path.)
We need to prove that there is a pair of vertices at distance at least in .
Let be such that . If , we are done. Otherwise, let be a shortest path between and in , and a shortest path between and in .
Then must be on . Denote by the endpoint of which is closer to on , and by the other endpoint.
Pick the middle vertex of with . If , we are done. Otherwise, any shortest path in from to must pass through edge . Suppose we go along from to . By the optimality of , we may assume that and overlap from to .
Now we look at the vertex adjacent to on which is closer to than to . We have
(3.1) |
We claim that there is a shortest path in from to that does not pass through . Let be a shortest path in from to that passes through . By the optimality of , we may assume that and overlap from to . Then by the optimality of ,
that is,
Therefore
Thus is equivalent to a path that does not pass through in . As a result, a shortest path between and in is also available in . Then by (3.1),
3.2. Chebyshev polynomials and principal eigenvectors
The Chebyshev polynomials of the first kind, , can be characterized by the recurrence
(3.2) |
with initial values and .
The Chebyshev polynomials of the second kind, , can be characterized by the same recurrence
(3.3) |
with initial values and .
Fact 3.7.
When , the explicit formula for is
(3.4) |
and the explicit formula for is
Proof.
(3.5) |
Fact 3.8.
When , both and are strictly increasing. ∎
Definition 3.9.
A pendant path of length in consists of vertices such that the induced subgraph on them is a path; moreover, one vertex has degree in and vertices have degree in . For example, in the graph , there is a pendant path of length .
Observation 3.10.
Let be a pendant path in where consecutive vertices are adjacent and . Then for ,
Proof.
By Corollary 2.8, and for . Therefore satisfies the initial values and recurrence relation of . ∎
In fact, this occurence was observed by Tait and Tobin [8] when they proved that the maximum principal ratio over all graphs of vertices is attained by a kite graph.
4. Stability of the ratio: adding or removing edges in bounded distance
In this section and the subsequent sections, we are interested in the stability of the ratio with respect to a small change in the graph.
Let be a -regular graph, so . As introduced before, we use to denote the graph obtained by adding an edge to , and to denote the graph obtained by deleting an edge from . We always assume is still connected. We are interested in the possible asymptotic behaviors of and .
We first make two simple observations. For the first one, we do not require to be regular.
Observation 4.1.
If the diameter is bounded, then is polynomially bounded in .
Observation 4.2.
Let be a -regular graph. If is linear in , i.e., is bounded away from , then is polynomially bounded in .
4.1. Adding an edge
We show that if we add an edge between two vertices at distance to a connected regular graph of bounded degree, then can be exponentially large.
Theorem 4.3.
For any and such that is an odd integer, there exists a -regular graph with vertices and an edge between two vertices at distance 2 in , such that
(4.1) |
In particular, when is bounded, is exponential in .
The proof of this theorem will be based on a series of constructions. The graphs produced by Construction 4.6 and Construction 4.7 are the pair of graphs that are used in the proof.
Construction 4.4 ().
Let be a parameter. We label the vertices in from one end to the other end as , , …, , , , …, , . Let . We label the vertical layer corresponding to as . Let , which we will call a “gadget,” be a connected graph with two vertices , of degree and all other vertices of degree , and an automorphism that switches and . We connect with every vertex in and connect with every vertex in . We call the graph obtained .
Observation 4.5.
Let be the subgroup of automorphisms of that fixes the vertical layers and permutes the horizontal layers. The orbits of are the vertical layers. is isomorphic to the symmetric group . This group extends to . The automorphism of that switches and for also extends to . Therefore the coordinates of the principal eigenvector of corresponding to all vertices in are the same. We denote this value by , for .
Construction 4.6.
[] Now we specify the gadget . We take two copies of and call them , . We label the vertices in , from to . We remove the edge from , the edge from , and add the edges and . We find two vertices , in such that in . We remove the edge . Finally, we attach a dangling vertex to , and a dangling vertex to . and are the vertices that connect with and , respectively. For this specific , is a -regular graph on vertices. We write for this graph.
Construction 4.7.
[] We add the edge to .
![[Uncaptioned image]](https://cdn.awesomepapers.org/papers/20335029-00ab-4bee-996d-9e36476c43d2/construction.png)
Proposition 4.8.
Proof.
Lemma 4.9.
, where .
Proof.
4.2. Removing an edge
Let .
We show that in the case of removing the edge when is bounded, is polynomially bounded for all . We make use of the following theorem.
Theorem 4.10 (Cioabă, Gregory, Nikiforov[7]).
If is a connected nonregular graph with vertices, diameter , and maximum degree , then
Theorem 4.11.
For a connected -regular graph and an edge , if where is some constant, then is polynomially bounded in .
Lemma 4.12.
is either or .
Proof.
If corresponds to some vertex with degree , then the average of the coordinates corresponding to the neighbors of would be
which is a contradiction. ∎
5. Stability of the ratio: multiplicative spectral gap
We use a known bound on the diameter of a graph in terms of the spectral gap to show that is polynomially bounded for bounded-degree expanders.
Definition 5.1.
For , a regular graph of degree is an -expander if , i.e., .
We note that this definition implies that an expander graph is connected.
Theorem 5.2 (N. Alon, V. D. Milman[2]).
Let be a connected graph on vertices with maximum degree and let denote the smallest positive eigenvalue of the Laplacian matrix. Then
Corollary 5.3.
For -regular -expander graphs , we have
(5.1) |
In particcular, for expander graphs with bounded degree, is polynomially bounded in .
6. Stability of the ratio: additive spectral gap
We show that a large () additive spectral gap implies that is bounded. Specifically, we prove the following.
Theorem 6.1.
Let be a connected -regular graph. If the additive spectral gap of satisfies for some value , then
To motivate this result, we first point out that graphs with such an additive spectral gap are not necessarily expanders. Indeed, when is greater than , the multiplicative spectral gap of graphs with a additive spectral graph will go to zero. Moreover, the diameter of graphs with such an additive spectral gap can still grow quite fast (polynomially in ), approaching the upper bound derived from Theorem 5.2.
6.1. Existence of graphs with large additive spectral gap and large diameter
Proposition 6.2.
For a regular graph with additive spectral gap , the diameter is .
Proof.
Corollary 6.3.
For a regular graph with an additive spectral gap, the diameter is .
We show that this bound is nearly tight.
Proposition 6.4.
There are connected regular graphs with diameter and an additive spectral gap of where .
We prove a more general statement.
Proposition 6.5.
For any constant , there are connected regular graphs with diameter and an additive spectral gap of where
.
Proof.
6.2. Large additive spectral gap implies bounded ratio
Now we prove Theorem 6.1 which shows that is bounded when has an additive spectral gap of for some . The proof is an adaptation of the theory developed in Chapter V. 2 in Stewart and Sun’s book [3], dealing with perturbation of invariant subspaces. In addition to adapting the proofs to our special case, we fill in some details to make the proof accessible to readers not versed in perturbation theory.
Notation 6.6.
Let be the orthogonal matrix whose columns are eigenvectors of . We can write it as
(6.7) |
where the columns are eigenvectors of corresponding to eigenvalues . Then , and we can assume
(6.8) |
In the context of adding an edge to , we label the two endpoints of to be and , and let have while all other coordinates are zero. In the context of deleting an edge from , we also label the two endpoints of to be and , and let have while all other coordinates are zero. In both cases, is the adjacency matrix of the graph obtained.
6.2.1. Rotating the eigenbasis
We know is not an eigenvector of . We want to know how close is to the principal eigenvector of , in the sense that we want to find a vector with small norm such that is the unit principal eigenvector of .
Proposition 6.7.
Let be a vector in . Let be orthogonal, where is a vector in and is an matrix. Define as , where
(6.9) |
Then is an orthogonal matrix.
Proof.
Therefore
6.2.2. Rotating to be an eigenvector
We want to find such that is the principal eigenvector of .
Notation 6.8.
We define
Observation 6.9.
Since and is orthogonal, .
Proposition 6.10.
If
(6.10) |
then is an eigenvector of .
Proof.
6.2.3. Finding small when the additive spectral gap is large
Notation 6.11.
We define as .
Proposition 6.12.
If for some value , then is non-singular and
(6.11) |
Proof.
Since is a diagonal matrix and is a symmetric matrix, is symmetrix. Recall that . By Rayleigh’s principle and Observation 6.9,
Therefore all eigenvalues of are positive, and
Proposition 6.13.
Proof.
We want to find a solution with small norm to the non-linear equation (6.12). We do this by an iterative construction.
We define a sequence of vectors such that
Then
We claim that the sequence converges. We define
Then . Since , we can prove by induction that is monotone increasing. Let
This function is monotone increasing in , and has a fixed point at . Then . Therefore the sequence converges to . Thus
Next we prove the convergence of . For any ,
Then , where . Therefore is a Cauchy sequence in and has a limit . Thus a solution exists, with norm satisfying (6.13).
∎
6.2.4. Using the bound on to show that is the principal eigenvector
Proposition 6.14.
If for some value , then the principal eigenvector of can be writen in the form
Proof.
We showed that there exists with
such that is an eigenvector of . It remains to show that this is the principal eigenvector. Since and where , and since , all coordinates of are positive. Therefore by Fact 2.10, is the principal eigenvector of . ∎
6.2.5. Completing the proof of Theorem 6.1
Following the argument above, we know the smallest possible coordinate of is , and the largest possible coordinate of is . Therefore the ratio of is as claimed. This completes the proof. ∎
7. Open questions
In Section 4.2, we showed that if we remove a non-bridge edge from a connected regular graph such that the endpoints of are of bounded distance in , then is polynomially bounded. Is there also a polynomial bound when the endpoints of are of unbounded distance in ?
Question 7.1.
If we remove a non-bridge edge from a connected regular graph , is always polynomially bounded?
In Section 4.1, we showed that if we add an edge between two vertices at distance to a connected regular graph of bounded degree, then can be exponential. Can be exponential when is between two vertices of unbounded distance in ?
Question 7.2.
If we add an edge to a connected regular graph with bounded degree , such that the disance between the endpoints of in is unbouneded, can be exponential in ?
In Section 6.2, we showed that for a connected regular graph , an additive spectral gap greater than implies that is bounded (Theorem 6.1). However, this bound ceases to work at all for with an additive spectral gap . Is this a limitaton of the method, or is there really an abrupt change at ?
Question 7.3.
Is there a family of connected regular graphs with an additive spectral gap slightly less than and with not bounded?
Acknowledgments
I am very grateful to Prof. Babai for his guidance and patience, and to Prof. Peter May for organizing the UChicago Math REU.
References
- [1] Miroslav Fiedler. Algebraic connectivity of graphs. Czechoslovak Math. J. (1973), 23(2):298-305. DOI
- [2] Noga Alon, Vitali D. Milman. , isoperimetric inequalities for graphs, and superconcentrators. J. Combinatorial Theory, Series B (1985), 38:73-88. DOI
- [3] Gilbert W. Stewart, Ji-guang Sun. Matrix Perturbation Theory, Academic press, 1990.
- [4] Edwin R. van Dam, Willem H. Haemers. Eigenvalues and the Diameter of Graphs. Linear and Multilinear Algebra (1995), 39:33-44. DOI
- [5] Andrew Y. Ng, Alice X. Zheng, Michael I. Jordan. Link analysis, eigenvectors and stability. In: 17th Internat. Joint Conf. on A. I. (IJCAI’01), vol. 2, pp. 903-910, Morgan Kaufmann, 2001. Author’s website
- [6] Sebastian M. Cioabă, David A. Gregory. Principal eigenvectors of irregular graphs. Electr. J. Linear Algebra (2007), 16:366-379. DOI
- [7] Sebastian M. Cioabă, David A. Gregory, Vladimir Nikiforov. Extreme eigenvalues of nonregular graphs. J. Combinatorial Theory, Series B (2007), 97(3):483-486. DOI
- [8] Michael Tait, Josh Tobin. Characterizing graphs of maximum principal ratio. Electr. J. Linear Algebra (2018), 34:61-70. DOI