This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

Submodular Input Selection for Synchronization in Kuramoto Networks

Dinuka Sahabandu1, Andrew Clark2, Linda Bushnell1, and Radha Poovendran1 1D. Sahabandu, L. Bushnell, and R. Poovendran are with the Department of Electrical and Computer Engineering, University of Washington, Seattle, WA 98195 USA. {sdinuka,lb2,rp3}@uw.edu.2A. Clark is with the Department of Electrical and Computer Engineering, Worcester Polytechnic Institute, Worcester, MA 01609 USA. [email protected].
Abstract

Synchronization is an essential property of engineered and natural networked dynamical systems. The Kuramoto model of nonlinear synchronization has been widely studied in applications including entrainment of clock cells in brain networks and power system stability. Synchronization of Kuramoto networks has been found to be challenging in the presence of signed couplings between oscillators and when the network includes oscillators with heterogeneous natural frequencies. In this paper, we study the problem of minimum-set control input selection for synchronizing signed Kuramoto networks. We first derive sufficient conditions for synchronization in homogeneous as well as heterogeneous Kuramoto networks using a passivity-based framework. We then develop a submodular algorithm for selecting a minimum set of control inputs for a given Kuramoto network. We evaluate our approach through a numerical study on multiple classes of graphs, including undirected, directed, and cycle graphs.

I Introduction

Synchronization of coupled nonlinear oscillators has been extensively studied in engineering, physics, and biology. Applications in engineering include power system stability [1] and clock synchronization in wireless sensor networks [2]. In physics, synchronization has been used to study coupled pendulum clocks [3]. It has been employed in biology to understand the circadian rhythms in networks of bursting neurons [4] and to investigate the synchronous firing of cardiac pacemaker cells [5].

Kuramoto dynamics [6] is a widely accepted model used to study synchronization in networked oscillators due to its ability to capture a variety of real-world synchronization phenomena [7]. Under the Kuramoto model each oscillator’s dynamics consists of two components, its own natural frequency and positively- or negatively-weighted sinusoidal couplings with the neighboring oscillators.

Synchronization in oscillator networks has been studied under two categories: networks with homogeneous natural frequencies (e.g., synchronization of coupled identical pendulum clocks [3]) and networks with heterogeneous natural frequencies (e.g., study of cardiac rhythms [5]). In Kuramoto networks with homogeneous natural frequencies, it is known that all oscillators will converge to the same phase angle (phase synchronization) from any initial condition when the network is undirected and contains only positive couplings [8]. Synchronization, however, may not be realized in homogeneous Kuramoto dynamics on weakly connected directed graphs or under signed couplings [9]. Moreover, even with all positive couplings, heterogeneous Kuramoto networks may fail to achieve synchronization [8]. In [10], a subset of oscillators were chosen to drive a positively coupled Kuramoto network towards synchronization.

Achieving synchronization in any Kuramoto network requires answering the following questions. First, given any Kuramoto network, can we find a mechanism that drives it towards synchronization? Second, what are the conditions to drive a given Kuramoto network towards synchronization?

In this paper we develop an analytical framework for selecting a minimum set of control inputs with constant and identical phases and natural frequencies to drive any given Kuramoto network towards synchronization. To the best of our knowledge, this is the first paper to do so. We make the following contributions.

  • We decompose the Kuramoto model into a negative feedback interconnection between a nonlinear subsystem describing the local node dynamics and a linear subsystem describing the inter-node coupling.

  • We derive sufficient conditions for synchronization in a broad class of networks, including homogeneous and heterogenous oscillators, undirected and directed graphs, and networks with signed coupling.

  • We prove that selecting a minimum set of control inputs to satisfy the sufficient conditions is a submodular optimization problem, and develop a polynomial-time approximate algorithm with provable optimality bounds.

  • We evaluate our approach via a numerical study.

The rest of the paper is organized as follows. Section II presents the related work. Section III provides needed preliminaries. Section IV presents the problem of selecting control inputs. Section V presents the sufficient conditions for synchronization. Section VI presents a submodular algorithm for selecting a minimum set of control inputs. Section VII provides the simulation results. Section VIII presents conclusions.

II Related work

Most of the work in the literature focuses on studying the necessary/sufficient conditions to achieve phase/frequency synchronization in homogeneous/heterogeneous Kuramoto networks with positive couplings [8, 11, 12]. In [8, 11] order parameter and Lyapunov theorem based approach was used to derive conditions for synchronization. In [12], conditions for frequency synchronization in a ring of unidirectionally coupled oscillators were studied by extending Gershgorin’s theorem. A passivity-based decomposition was proposed in [13] to study synchronization in positively coupled, homogeneous Kuramoto networks of undirected graphs. We generalize this approach for deriving synchronization conditions in signed heterogeneous Kuramoto networks under various network topologies.

Recently, synchronization in signed Kuramoto networks with homogeneous/heterogeneous natural frequencies have received attention [14, 15, 16]. In [14] synchronization of Kuramoto oscillators with all-to-all signed couplings were studied. In [15] conditions for frequency synchronization in signed directed networks were derived. In [16] the conditions that ensures the synchronization in signed acyclic directed oriented heterogeneous oscillator networks and signed oriented cyclic homogeneous oscillator networks were analyzed. Yet, the analytical frameworks considered in these papers do not generalize to studying synchronization conditions in signed Kuramoto networks with general undirected and directed graphs.

The effect of a single pacemaker (leader) on synchronization of Kuramoto networks with positive coupling under both homogeneous and heterogeneous natural frequencies are studied in [17, 18]. In [10] a submodular optimization framework for selecting a set of control input nodes in order to achieve synchronization in positively coupled Kuramoto networks was analyzed. A recent work in [19] developed a control strategy for the problem of leader-follower frequency synchronization in positively coupled Kuramoto networks, by exploiting the adaptive control framework. However, these models do not address synchronization of signed Kuramoto networks. A novel passivity-based framework and a submodular input selection algorithm presented in this paper enables deriving sufficient conditions for synchronization and steering a given Kuramoto network towards synchronization.

III Notation and Preliminaries

In this section we first introduce the notation used in this paper. Then we provide the background on passivity and stability results from literature that have been used to derive the theoretical results presented in this paper.

III-A Notation

Let RR be a m×mm\times m matrix. Then [R]ij[R]_{ij} denotes the entry in RR corresponding to ithi^{\text{th}} row and jthj^{\text{th}} column, where i,j{1,,m}i,j\in\{1,\ldots,m\}. Let RTR^{T} denotes the transpose of matrix RR. The notation R>0R>0 implies that RR is a positive definite matrix. Let λmin(R)\lambda_{\min}(R) denote the minimum eigenvalue of matrix RR. The vectors 𝟎\mathbf{0} and 𝟏\mathbf{1} represent the all zeros and all ones vectors with appropriate dimensions, respectively. Let 𝔼(.)\mathbb{E}(.) denote the standard expectation operator. The notations ||.||2||.||_{2} and ||.||||.||_{\infty} denote the two-norm and infinity-norm of vectors.

III-B Passivity and Stability

For a dynamical system Σ\varSigma with input u(t)u(t) and output y(t)y(t), passivity is defined as follows.

Definition 1 (Passivity, [20], Corollary 2.3)

Suppose that there exists a continuously differentiable function V0V\geq 0 and a measurable function dd such that 0td(s)𝑑s0\int_{0}^{t}{d(s)\ ds}\geq 0 for all tt. Then if

V˙(t)yT(t)u(t)d(t)\dot{V}(t)\leq y^{T}(t)u(t)-d(t) (1)

for all tt and all u(t)u(t), the system Σ\varSigma is passive.

Next we introduce the notion of δ\delta-Input Strictly Passive (δ\delta-ISP) system in the following definition.

Definition 2 (δ\delta-Input Strictly Passive (δ\delta-ISP) system)

Assume there exists a continuously differentiable function V()0V(\cdot)\geq 0 and a measurable function β()\beta(\cdot) such that 0tβ(s)𝑑s0\int_{0}^{t}{\beta(s)ds}\geq 0 for all t0t\geq 0. Then a system Σ\varSigma is said to be δ\delta-Input Strictly Passive (δ\delta-ISP) if there exists a δ>0\delta>0 such that

V˙(t)yT(t)u(t)δuT(t)u(t)β(t)\dot{V}(t)\leq y^{T}(t)u(t)-\delta u^{T}(t)u(t)-\beta(t) (2)

for all tt and all u(t)u(t).

The following proposition provides the conditions for 2\mathcal{L}_{2} stability of interconnected subsystems.

Proposition 1 ([20], Corollary 5.3)

Consider two subsystems H1H_{1} and H2H_{2} in a single channel negative feedback interconnection. If H1H_{1} is passive and H2H_{2} is δ\delta-ISP:

  1. 1.

    Closed loop system is 2\mathcal{L}_{2} finite gain stable.

  2. 2.

    There exists a δ>0\delta>0 such that 2\mathcal{L}_{2} gain of the system is bounded above by 1/δ1/\delta .

The next result establishes a synchronization condition for a linear system with time-varying system matrix A(t)A(t).

Proposition 2 ([21], Theorem 1)

Consider the system

x˙(t)=A(t)x(t),\dot{x}(t)=A(t)x(t), (3)

where A(t)A(t) is a bounded and piecewise continuous function of tt. For every tt, A(t)A(t) is Metzler with zero row sums. For any Δ>0\Delta>0 and any matrix BB, let the Δ\Delta digraph to be defined as the digraph where an edge (i,j)(i,j) exists if Bij0B_{ij}\geq 0.

If there is an index k{1,,n}k\in\{1,\ldots,n\}, a threshold value Δ>0\Delta>0 and an interval length T^>0\hat{T}>0 such that for all tt\in\mathbb{R} the Δ\Delta-digraph associated to tt+T^A(τ)𝑑τ\int_{t}^{t+\hat{T}}A(\tau)d\tau has the property that all nodes may be reached from the node kk, then the equilibrium set of synchronized states is uniformly exponentially stable. Solution of Eqn. (3) converge to a common value as tt\rightarrow\infty.

IV Problem Formulation

We consider a directed Kuramoto network of nn oscillators indexed {1,,n}\{1,\ldots,n\} with couplings among the oscillators defined by the edge set E:={1,,m}E:=\{1,\ldots,m\}. An ordered pair (i,j)E(i,j)\in E denotes an edge from oscillator ii to oscillator jj and implies that the oscillator jj is influenced by the oscillator ii. Let the underlying graph structure of the Kurmaoto network is denoted by 𝒢=(V,E)\mathcal{G}=(V,E), where the set VV denotes the set of nodes111In this paper we use the words nodes and oscillators interchangeably. that represent the Kuramoto oscillators. Define a vector of length nn by ω=[ωi]i=1n\omega=\begin{bmatrix}\omega_{i}\end{bmatrix}^{n}_{i=1} where each ωi\omega_{i}\in\mathbb{R} represents the natural frequency associated with the ithi^{\text{th}} oscillator. Let Nin(i):={j:(j,i)E}N_{\text{in}}(i):=\{j:(j,i)\in E\} denote the set of oscillators that have an incoming edge to oscillator ii.

Kuramoto dynamics of the ithi^{\text{th}} oscillator is given by

θ˙i(t)=ωijNin(i)Kjisin(θi(t)θj(t))\dot{\theta}_{i}(t)=\omega_{i}-\sum_{j\in N_{\text{in}}(i)}{{K_{ji}}\sin{(\theta_{i}(t)-\theta_{j}(t))}} (4)

where the coupling coefficients (i.e., edge weights) KjiK_{ji} are nonzero real numbers that characterize the influence of oscillator jj on oscillator ii’s dynamics. We define the n×mn\times m incidence matrix DD by

Die={1,e=(j,i)for some j1,e=(i,j)for some j0,elseD_{ie}=\left\{\begin{array}[]{ll}1,&e=(j,i)\ \mbox{for some }j\\ -1,&e=(i,j)\ \mbox{for some }j\\ 0,&\mbox{else}\end{array}\right.

We define a matrix D^\hat{D} by

D^ie={1,e=(j,i)for some j0,else\hat{D}_{ie}=\left\{\begin{array}[]{ll}1,&e=(j,i)\ \mbox{for some }j\\ 0,&\mbox{else}\end{array}\right.

Next, we define m×mm\times m diagonal matrix KK by Kee=KijK_{ee}=K_{ij} where e=(i,j)e=(i,j). Under these definitions, the dynamics of the network can be written in vector form as

θ˙(t)=ωD^Ksin(DTθ(t))\dot{\theta}(t)=\omega-\hat{D}K\sin{(D^{T}\theta(t))} (5)

where sinθ=(sinθi:i=1,,n)\sin{\theta}=(\sin{\theta_{i}}:i=1,\ldots,n).

We assume that the network operates with a set of inputs, S{1,,n}S\subseteq\{1,\ldots,n\}. Initial phase angles and natural frequencies associated with input nodes are set to zero (i.e, for all iSi\in S, θi(0)=0\theta_{i}(0)=0 and ωi=0\omega_{i}=0). Therefore, input nodes maintain a constant phase of zero regardless of the inputs of their neighbors. In such networks, the non-input node dynamics can be written as

θ˙i(t)=ωijN(i)SKjisinθi(t)jN(i)SKjisin(θi(t)θj(t)),\dot{\theta}_{i}(t)=\omega_{i}-\sum_{j\in N(i)\cap S}{{K_{ji}}\sin{\theta_{i}(t)}}-\sum_{j\in N(i)\setminus S}{{K_{ji}}\sin{(\theta_{i}(t)-\theta_{j}(t))}}, (6)

while θi(t)0\theta_{i}(t)\equiv 0 for all iSi\in S.

Let E(S)E(S) denote the set of edges that are incoming to input nodes. In networks with inputs, we define the (n|S|)×(m|E(S)|)(n-|S|)\times(m-|E(S)|) matrix D(S)D(S) as

D(S)ie={1,iS,e=(j,i) for some j1,iS,e=(i,j) for some jS0,elseD(S)_{ie}=\left\{\begin{array}[]{ll}1,&i\notin S,e=(j,i)\ \mbox{ for some }j\\ -1,&i\notin S,e=(i,j)\ \mbox{ for some }j\notin S\\ 0,&\mbox{else}\end{array}\right.

The effect of SS on DD is to remove all rows of DD related to SS and all columns of DD representing incoming edges to SS. The (n|S|)×(m|E(S)|)(n-|S|)\times(m-|E(S)|) matrix D^(S)\hat{D}(S) is defined as

D^(S)ie={1,iS,e=(j,i) for some j0,else\hat{D}(S)_{ie}=\left\{\begin{array}[]{ll}1,&i\notin S,e=(j,i)\mbox{ for some }j\\ 0,&\mbox{else}\end{array}\right.

Let (m|E(S)|)×(m|E(S)|)(m-|E(S)|)\times(m-|E(S)|) diagonal matrix K(S)K(S) defined by Kee=KjiK_{ee}=K_{ji} where e=(j,i)e=(j,i) and iSi\neq S. Furthermore, with abuse of notation we let ω(S)=[ωi]iS\omega(S)=\begin{bmatrix}\omega_{i}\end{bmatrix}_{i\notin S}. Then Kuramoto model can be written as

θ˙(t)=ω(S)D^(S)K(S)sin(D(S)Tθ(t)).\dot{\theta}(t)=\omega(S)-\hat{D}(S)K(S)\sin{(D(S)^{T}\theta(t))}. (7)

Setting z(t)=D(S)Tθ(t)z(t)=D(S)^{T}\theta(t), we arrive at the following equivalent model that gives the dynamics in terms of the inter oscillator phase angle differences, z(t)z(t).

z˙(t)=D(S)Tω(S)D(S)TD^(S)K(S)sinz(t).\dot{z}(t)=D(S)^{T}\omega(S)-D(S)^{T}\hat{D}(S)K(S)\sin{z(t)}. (8)

Next we define the notion of phase and frequency synchronization in Kuramoto networks.

Definition 3 (Phase synchronization)

Kuramoto network is said to achieve phase synchronization if and only if limtθ(t)cp𝟏\lim_{t\rightarrow\infty}{\theta(t)}\rightarrow c_{p}\mathbf{1}, where cpc_{p}\in\mathbb{R}.

Definition 4 (Frequency synchronization)

Kuramoto network is said to achieve frequency synchronization if and only if limtθ˙(t)=cf𝟏\lim_{t\rightarrow\infty}{\dot{\theta}(t)}=c_{f}\mathbf{1}, where cfc_{f}\in\mathbb{R} or equivalently, limtθ(t)=c¯f\lim_{t\rightarrow\infty}{\theta(t)}=\bar{c}_{f}, where c¯fm\bar{c}_{f}\in\mathbb{R}^{m}.

Moreover, since the input nodes have fixed states of 0, cp=cf=0c_{p}=c_{f}=0. In what follows, we use the word synchronization and frequency synchronization interchangeably.

Problems Studied: Selecting a minimum set of control inputs set to ensure (i) frequency synchronization in Kuramoto networks with homogeneous natural frequencies (Section V-A), (ii) phase synchronization in Kuramoto networks with homogeneous natural frequencies (Section V-B) and (iii) frequency synchronization in Kuramoto networks with heterogeneous natural frequencies (Section V-C).

V Analytical framework for selecting inputs

Below, we present sufficient conditions for synchronization in the settings (i)-(iii) defined above.

V-A Frequency synchronization: Homogeneous case

Under this case, we first derive sufficient conditions for frequency synchronization and present a framework for selecting set of control inputs to drive Kuramoto network with homogeneous natural frequencies (i.e., ωi=ωj\omega_{i}=\omega_{j} for all i,ji,j) to synchronization. First note that, by switching to a rotating frame, it can be shown that we can set ωi0\omega_{i}\equiv 0 for all i{1,,n}i\in\{1,\ldots,n\}, without loss of generality [9].

Let M(S)D(S)TD^(S)K(S)M(S)\triangleq D(S)^{T}\hat{D}(S)K(S) and R(S)M(S)+M(S)T2R(S)\triangleq\frac{M(S)+M(S)^{T}}{2} (Matrices MM and RR are defined similarly by omitting the restriction to the set SS). In order to derive sufficient conditions for synchronization, we represent the homogeneous Kuramoto network by a negative feedback interconnection between two subsystems as shown in Figure 1 (with noting that r(t)=0r(t)=0 when the natural frequencies, ωi0\omega_{i}\equiv 0 for all ii). The advantage of this approach is that H1H_{1} is nonlinear but does not depend on the input set SS, while the bottom block depends on SS but is linear.

Refer to caption
Figure 1: Decomposition of (8) as a single channel negative feedback interconnection with a constant input DT(S)ω(S)D^{T}(S)\omega(S).

In the following we present a sufficient condition for frequency synchronization.

Theorem 1

A homogeneous Kuramoto network achieves frequency synchronization if R(S)>0R(S)>0.

Proof:

Consider the Lyapunov storage function V(z)=eE(1cosze(t)).V(z)=\sum_{e\in E}{(1-\cos{z_{e}(t)})}. This storage function satisfies

V˙(z)=eE[sinze(t)z˙e(t)]=u1(t)Ty1(t).\dot{V}(z)=\sum_{e\in E}{[\sin{z_{e}(t)}\dot{z}_{e}(t)]}=u_{1}(t)^{T}y_{1}(t). (9)

Note that y1(t)=u2(t)y_{1}(t)=u_{2}(t) and u1(t)=y2(t)u_{1}(t)=-y_{2}(t). Therefore,

V˙(z)=u2(t)Ty2(t)=u2(t)TM(S)u2(t)=u2(t)TM(S)+M(S)T2u2(t)=u2(t)TR(S)u2(t)0\begin{split}\dot{V}(z)=&-u_{2}(t)^{T}y_{2}(t)=-u_{2}(t)^{T}M(S)u_{2}(t)\\ =&-u_{2}(t)^{T}\frac{M(S)+M(S)^{T}}{2}u_{2}(t)\\ =&-u_{2}(t)^{T}{R(S)}u_{2}(t)\leq 0\end{split}

since R(S)>0R(S)>0. Hence, by LaSalle’s Invariance Principle, the state z(t)z(t) converges to the set {z:V˙(z)=0}\{z:\dot{V}(z)=0\}. Since V˙(z)\dot{V}(z) is zero if and only if u2(t)=0u_{2}(t)=0 as R(S)>0R(S)>0, this set is equivalent to {z:sinz=0}\{z:\sin{z}=0\}, which is the discrete set of points satisfying [z]e=keπ[z]_{e}=k_{e}\pi for some set of integers {ke:eE}\{k_{e}:e\in E\}. Since the set of zeros of V˙(z)\dot{V}(z) is discrete, the state trajectory z(t)z(t) converges to a single fixed point, and thus limtz˙(t)=0\lim_{t\rightarrow\infty}{\dot{z}(t)}=0, implying synchronization. ∎

In order to develop a mechanism to select control inputs, we re-index the nodes and edges in 𝒢\mathcal{G} as follows. We assume that the set of non-input nodes are indexed in {1,,n|S|}\{1,\ldots,n-|S|\}, and the set of input nodes is are indexed in {n|S|+1,,n}\{n-|S|+1,\ldots,n\}. Let S¯\overline{S} denote the set of non-input nodes. For two distinct sets of nodes, S1S_{1} and S2S_{2}, let E(S1,S2)E(S_{1},S_{2}) denote the set of edges from the nodes in S1S_{1} to the nodes in S2S_{2}. We then partition the edge set as E=E(S¯,S¯)E(S,S¯)E(S¯,S)E(S,S)E=E(\overline{S},\overline{S})\cup E(S,\overline{S})\cup E(\overline{S},S)\cup E(S,S) and assume that the edges are indexed in this order. Furthermore, for a matrix QQ associated with graph 𝒢\mathcal{G} and set of nodes S3S_{3}, S4S_{4} and S5S_{5}, let the matrix notation QS4,S5S3Q^{S_{3}}_{S_{4},S_{5}} denote the rows and columns of QQ restricted to the node set S3S_{3} and edges from the nodes in S4S_{4} to the nodes in S5S_{5}.

Using the new indices, we rewrite MM and M(S)M(S) as

M=((DS¯,S¯S¯)TD^S¯,S¯S¯KS¯,S¯S¯(DS¯,S¯S¯)TD^S,S¯S¯KS,S¯S¯(DS,S¯S¯)TD^S¯,S¯S¯KS¯,S¯S¯(DS,S¯S¯)TD^S,S¯S¯KS,S¯S¯(DS¯,SS¯)TD^S¯,S¯S¯KS¯,S¯S¯(DS¯,SS¯)TD^S,S¯S¯KS,S¯S¯00M=\left(\begin{array}[]{cccc}(D_{\overline{S},\overline{S}}^{\overline{S}})^{T}\hat{D}_{\overline{S},\overline{S}}^{\overline{S}}K_{\overline{S},\overline{S}}^{\overline{S}}&(D_{\overline{S},\overline{S}}^{\overline{S}})^{T}\hat{D}_{S,\overline{S}}^{\overline{S}}K_{S,\overline{S}}^{\overline{S}}\\ (D_{S,\overline{S}}^{\overline{S}})^{T}\hat{D}_{\overline{S},\overline{S}}^{\overline{S}}K_{\overline{S},\overline{S}}^{\overline{S}}&(D_{S,\overline{S}}^{\overline{S}})^{T}\hat{D}_{S,\overline{S}}^{\overline{S}}K_{S,\overline{S}}^{\overline{S}}\\ (D_{\overline{S},S}^{\overline{S}})^{T}\hat{D}_{\overline{S},\overline{S}}^{\overline{S}}K_{\overline{S},\overline{S}}^{\overline{S}}&(D_{\overline{S},S}^{\overline{S}})^{T}\hat{D}_{S,\overline{S}}^{\overline{S}}K_{S,\overline{S}}^{\overline{S}}\\ 0&0\end{array}\right.
00(DS,S¯S)TD^S¯,SSKS¯,SS(DS,S¯S)TD^S,SSKS,SS(DS¯,SS)TD^S¯,SSKS¯,SS(DS¯,SS)TD^S,SSKS,SS(DS,SS)TD^S¯,SSKS¯,SS(DS,S)TD^S,SSKS,SS)\left.\begin{array}[]{cccc}0&0\\ (D_{S,\overline{S}}^{S})^{T}\hat{D}_{\overline{S},S}^{S}K_{\overline{S},S}^{S}&(D_{S,\overline{S}}^{S})^{T}\hat{D}_{S,S}^{S}K_{S,S}^{S}\\ (D_{\overline{S},S}^{S})^{T}\hat{D}_{\overline{S},S}^{S}K_{\overline{S},S}^{S}&(D_{\overline{S},S}^{S})^{T}\hat{D}_{S,S}^{S}K_{S,S}^{S}\\ (D_{S,S}^{S})^{T}\hat{D}_{\overline{S},S}^{S}K_{\overline{S},S}^{S}&(D_{S,S})^{T}\hat{D}_{S,S}^{S}K_{S,S}^{S}\end{array}\right) (10)
M(S)=((DS¯,S¯S¯)TD^S¯,S¯S¯KS¯,S¯S¯(DS¯,S¯S¯)TD^S,S¯S¯KS,S¯S¯(DS,S¯S¯)TD^S¯,S¯S¯KS¯,S¯S¯(DS,S¯S¯)TD^S,S¯KS,S¯S¯)M(S)=\left(\begin{array}[]{cc}(D_{\overline{S},\overline{S}}^{\overline{S}})^{T}\hat{D}_{\overline{S},\overline{S}}^{\overline{S}}K_{\overline{S},\overline{S}}^{\overline{S}}&(D_{\overline{S},\overline{S}}^{\overline{S}})^{T}\hat{D}_{S,\overline{S}}^{\overline{S}}K_{S,\overline{S}}^{\overline{S}}\\ (D_{S,\overline{S}}^{\overline{S}})^{T}\hat{D}_{\overline{S},\overline{S}}^{\overline{S}}K_{\overline{S},\overline{S}}^{\overline{S}}&(D_{S,\overline{S}}^{\overline{S}})^{T}\hat{D}_{S,\overline{S}}K_{S,\overline{S}}^{\overline{S}}\end{array}\right) (11)

Theorem 2 gives a sufficient condition for synchronization via selecting set of control input nodes.

Theorem 2

Removing a subset of rows and columns from matrix RR such that R(S)>0R(S)>0 suffices to drive a homogeneous Kuramoto network to frequency synchronization by selecting a set of control input nodes SS.

Proof:

The matrix M(S)M(S) in Eqn. (11) is equal to the 2×22\times 2 top-left block submatrix of MM in Eq. (10). Hence M(S)M(S) can be obtained from MM by removing a subset of rows and columns. As consequence, the matrix R(S)R(S) can be obtained from the matrix RR by removing a subset of rows and columns. Continuing this removal process until R(S)>0R(S)>0 drives the homogeneous Kuramoto networks towards the synchronization by Theorem 1. ∎

V-B Phase synchronization: Homogeneous case

The following theorem gives a necessary condition for phase synchronization in homogeneous Kuramoto networks.

Theorem 3

Given θi(t)\theta_{i}(t) for all iSi\notin S are initialized around the neighborhood of origin (i.e., 0), homogeneous Kuramoto networks achieve phase synchronization if R(S)>0R(S)>0.

Proof:

Consider the following linearized version of the equivalent system given in (8) (with ω0\omega\equiv 0) at the origin.

z~˙(t)=A~z~(t),\dot{\tilde{z}}(t)=\tilde{A}~{}\tilde{z}(t), (12)

where A~={DTD^Ksinz(t)}z(t)|z(t)=0=M(S).\tilde{A}=\frac{\partial\{-D^{T}\hat{D}K\sin z(t)\}}{\partial{z(t)}}|_{z(t)=0}=-M(S). Then linear time-invariant system in Eqn. (12) is asymptotically stable if and only if all the real parts of the eigenvalues of M(S)M(S) are positive. R(S)>0R(S)>0 ensures this condition. Since the system has a unique fixed point at z~(t)=0\tilde{z}(t)=0, z(t)0z(t)\rightarrow 0 when tt\rightarrow\infty and hence phase synchronization is achieved. ∎

Following the similar arguments as in Theorem 2, when the network is initialized in the neighborhood of the origin, removing a subset of rows and columns from matrix RR such that R(S)>0R(S)>0 suffices to drive a homogeneous Kuramoto network to phase synchronization via selecting a set of control input nodes SS.

V-C Frequency synchronization: Heterogeneous case

In this section we provide the sufficient conditions for attaining frequency synchronization in heterogeneous Kuramoto networks (i.e., ωiωj\omega_{i}\neq\omega_{j} for at least one pair of (i,j)(i,j) such that iji\neq j) via selecting set of control input nodes. In what follows we write DTωD^{T}\omega instead of D(S)Tω(S)D(S)^{T}\omega(S) for simplicity of notation. We discuss how to remove the dependency of SS in DT(S)ω(S)D^{T}(S)\omega(S) after the proof of Theorem 4.

Our approach is based on analyzing the 2\mathcal{L}_{2} stability of the system in Figure 1 via passivity. Passivity of H1H_{1} and δ\delta-ISP of H2H_{2} together with the small gain theorem in Proposition 1, gives the following bound on the 2\mathcal{L}_{2} gain of the system.

Lemma 1

Let δ=λmin(R(S))\delta=\lambda_{min}(R(S)). Then for all tt and any z(0)z(0), we have that

(sinz(t)L2[0,t])21δ2DTω22t.\left(||\sin{z(t)}||_{L_{2}}^{[0,t]}\right)^{2}\leq\frac{1}{\delta^{2}}||D^{T}\omega||_{2}^{2}t.

Proof:

Passivity of H1H_{1} is confirmed via Eqn. (9) by choosing the same storage function given in the proof of Theorem 1.

Next, to show δ\delta-ISP of H2H_{2}, note that

u2(t)Ty2(t)=u2(t)TR(S)u2(t)λmin(R(S))u2(t)Tu2(t).u_{2}(t)^{T}y_{2}(t)=u_{2}(t)^{T}R(S)u_{2}(t)\geq\lambda_{min}(R(S))u_{2}(t)^{T}u_{2}(t).

Thus by choosing V(z)=0V(z)=0, we obtain

V˙(z)=0u2(t)Ty2(t)λmin(R(S))u2(t)Tu2(t),\dot{V}(z)=0\leq u_{2}(t)^{T}y_{2}(t)-\lambda_{min}(R(S))u_{2}(t)^{T}u_{2}(t),

implying δ\delta-ISP with δ=λmin(R(S))\delta={\lambda_{min}(R(S))}.

By Proposition 1, we have that for any input r(t)r(t),

sinz(t)L2[0,T]r(t)L2[0,T]1δ.\frac{||\sin{z(t)}||_{L_{2}}^{[0,T]}}{||r(t)||_{L_{2}}^{[0,T]}}\leq\frac{1}{\delta}.

Choosing r(t)DTωr(t)\equiv D^{T}\omega then yields

sinz(t)L2[0,T]1δ(0TDTω22𝑑t)1/2.||\sin{z(t)}||_{L_{2}}^{[0,T]}\leq\frac{1}{\delta}\left(\int_{0}^{T}{||D^{T}\omega||_{2}^{2}\ dt}\right)^{1/2}.

Squaring both sides and evaluating the integral gives the desired result. ∎

Let zji(t)=θj(t)θi(t)z_{ji}(t)=\theta_{j}(t)-\theta_{i}(t) denote the inter oscillator phase angle differences between oscillator jj and ii. In Lemma 2, we provide a preliminary sufficient condition required for the frequency synchronization in heterogeneous Kuramoto networks222Similar results have been appeared in literature for heterogeneous Kuramoto networks with positive couplings [18, 22].

Lemma 2

Heterogeneous Kuramoto networks achieve frequency synchronization if the phase angles of the oscillators are bounded for all tt such that zji(t)(π/2,3π/2)z_{ji}(t)\in(\pi/2,3\pi/2) for all edges (j,i)(j,i) with Kji<0K_{ji}<0 and zji(t)(π/2,π/2)z_{ji}(t)\in(-\pi/2,\pi/2) for all edges (j,i)(j,i) with Kji>0K_{ji}>0.

Proof:

By taking the time derivative of Eqn. (7), we have

θ¨(t)=D^(S)Kc(S)D(S)Tθ˙(t),\ddot{\theta}(t)=-\hat{D}(S)K_{c}(S)D(S)^{T}\dot{\theta}(t), (13)

where matrix Kc(S)K_{c}(S) is a diagonal matrix with [Kc(S)]ee=Kecos(ze(t))[K_{c}(S)]_{ee}=K_{e}\cos(z_{e}(t)), where e=(j,i)e=(j,i) for each i,j{1,,n}i,j\in\{1,\ldots,n\} and iSi\notin S. Note that matrix D^(S)Kc(S)D(S)T\hat{D}(S)K_{c}(S)D(S)^{T} is the weighted Laplacian matrix of the graph 𝒢(S)={V\S,E\E(S)}\mathcal{G}(S)=\{V\backslash S,E\backslash E(S)\} with time-varying weights Kecos(ze(t))K_{e}\cos(z_{e}(t)).

Furthermore the following hold if each ze(t)z_{e}(t) satisfy the conditions given in theorem statement: (i) for all eEe\in E such that Ke<0K_{e}<0 we have cos(ze(t))<0cos(z_{e}(t))<0 which gives Kecos(ze(t))>0K_{e}cos(z_{e}(t))>0. (ii) for all eEe\in E such that Ke>0K_{e}>0, we have cos(ze(t))>0\cos(z_{e}(t))>0 which gives Kecos(ze(t))>0K_{e}cos(z_{e}(t))>0.

When all the weights, [Kc(S)]ee[K_{c}(S)]_{ee}, are positive for all tt, the matrix D(S)TD^(S)Kc(S)-D(S)^{T}\hat{D}(S)K_{c}(S) has nonnegative off diagonal entries (Metzler) with zero row sums. Then by Proposition 2, θ¨(t)\ddot{\theta}(t) converge to a common value as tt\rightarrow\infty. ∎

Note that the bounds given in Lemma 2 for z(t)z(t) should satisfy for all tt. Therefore, next we explore the initial conditions, zji(0)z_{ji}(0), that will achieve these bounds for all tt.

In what follows we assume that the initial phase angles in Eqn. (8) satisfies the following conditions.

Assumption 1

The initial state z(0)z(0) satisfies zij(0)(π/2,3π/2)z_{ij}(0)\in(\pi/2,3\pi/2) for all edges (i,j)(i,j) with Kji<0K_{ji}<0 and zij(0)(π/2,π/2)z_{ij}(0)\in(-\pi/2,\pi/2) for all edges (i,j)(i,j) with Kji>0K_{ji}>0.

The following theorem establishes the sufficient condition for frequency synchronization in Kuramoto networks with heterogeneous natural frequencies.

The rest of this section is organized as follows. In Theorem 4 we present sufficient conditions for frequency synchronization in heterogeneous Kuramoto networks. Then we present set of additional results in Lemma 3 and Theorem 5 that are required for the proof of Theorem 4. Next, we present the proof of Theorem 4 and discuss frequency synchronization in heterogeneous Kuramoto networks via selecting a minimum set of control inputs. Finally, we wrap-up this section by presenting set of graph structures that enable conditions given in Assumption 1.

Theorem 4

Suppose that the input set SS is chosen such that λmin(R(S))\lambda_{\min}(R(S)) is strictly bounded below by DTω2||D^{T}\omega||_{2}. If Assumption 1 is satisfied then heterogeneous Kuramoto networks achieve frequency synchronization.

In the following lemma we show that a nonnegative continuous function is upper bounded for all tt if its integral and initial conditions are upper bounded.

Lemma 3

Let ff be a nonnegative continuous function. Suppose that, whenever z(0)z(0) satisfies f(z0)Cf(z_{0})\leq C for a constant CC,

0tf(z(τ))𝑑τtC\int_{0}^{t}{f(z(\tau))\ d\tau}\leq tC

for all tt. Then for any z(0)z(0) satisfying f(z(0))Cf(z(0))\leq C, we have f(z(t))Cf(z(t))\leq C for all tt.

Proof:

Suppose the result does not hold. Then there exists zz and tt such that f(z(t))>Cf(z(t))>C for some time tt when z(0)=zz(0)=z. Since the trajectory of z(t)z(t) is continuous, f(z(t))f(z(t)) is continuous as well. Define some notations as follows:

t\displaystyle t^{\ast} =\displaystyle= inf{t:f(z(t))>C}\displaystyle\inf{\{t:f(z(t))>C\}}
t\displaystyle t^{\ast\ast} =\displaystyle= inf{t:f(z(t))C,t>t}\displaystyle\inf{\{t:f(z(t))\leq C,\ t>t^{\ast}\}}
C¯\displaystyle\overline{C} =\displaystyle= sup{f(z(t)):t[t,t]}\displaystyle\sup{\{f(z(t)):t\in[t^{\ast},t^{\ast\ast}]\}}
η\displaystyle\eta =\displaystyle= C¯C\displaystyle\overline{C}-C
t1\displaystyle t_{1} =\displaystyle= inf{t:f(z(t))=C+η/2,t1>t}\displaystyle\inf{\{t:f(z(t))=C+\eta/2,t_{1}>t^{\ast}\}}
t2\displaystyle t_{2} =\displaystyle= inf{t:f(z(t))>C+η/2,t>t1}\displaystyle\inf{\{t:f(z(t))>C+\eta/2,t>t_{1}\}}

For any ϵ>0\epsilon>0, let t0(ϵ)=sup{t:f(z(t))Cϵ,t<t}.t_{0}(\epsilon)=\sup{\{t:f(z(t))\leq C-\epsilon,t<t^{\ast}\}}. Note that (tt0(ϵ))(t^{\ast}-t_{0}(\epsilon)) goes to zero as ϵ\epsilon goes to zero. Then

t0(ϵ)tf(z(t))𝑑τ\displaystyle\int_{t_{0}(\epsilon)}^{t^{\ast\ast}}{f(z(t))\ d\tau} =\displaystyle= t0(ϵ)tf(z(t))𝑑τ+tt1f(z(t))𝑑τ\displaystyle\int_{t_{0}(\epsilon)}^{t^{\ast}}{f(z(t))\ d\tau}+\int_{t^{\ast}}^{t_{1}}{f(z(t))\ d\tau}
+t1t2f(z(t))𝑑τ+t2tf(z(t))𝑑τ\displaystyle+\int_{t_{1}}^{t_{2}}{f(z(t))\ d\tau}+\int_{t_{2}}^{t^{\ast\ast}}{f(z(t))\ d\tau}
>\displaystyle> (tt0(ϵ))(Cϵ)+C(t1t)\displaystyle(t^{\ast}-t_{0}(\epsilon))(C-\epsilon)+C(t_{1}-t^{\ast})
+(C+η2)(t2t1)+C(tt2)\displaystyle+(C+\frac{\eta}{2})(t_{2}-t_{1})+C(t^{\ast\ast}-t_{2})
=\displaystyle= (tt0(ϵ))C+η2(t2t1)\displaystyle(t^{\ast\ast}-t_{0}(\epsilon))C+\frac{\eta}{2}(t_{2}-t_{1})
ϵ(tt0(ϵ))>C(tt0(ϵ)).\displaystyle-\epsilon(t^{\ast}-t_{0}(\epsilon))>C(t^{\ast\ast}-t_{0}(\epsilon)).

for ϵ\epsilon sufficiently small. Let z0=z(t0(ϵ))z_{0}=z(t_{0}(\epsilon)), so that f(z(t))Cf(z(t))\leq C. Set z(0)=z0z(0)=z_{0} and choose t=tt0(ϵ)t=t^{\ast\ast}-t_{0}(\epsilon). By time invariance, 0tf(z(t))𝑑τ>Ct\int_{0}^{t}{f(z(t))\ d\tau}>Ct is a contradiction. ∎

Theorem 5, shows that the function sinz(t)\sin{z(t)} has lower and upper bounds, 1+ϵ-1+\epsilon and 1ϵ1-\epsilon for 0<ϵ<10<\epsilon<1 when Assumption 1 is satisfied and the smallest eigenvalue of R(S)R(S) is strictly bounded below by DTω2||D^{T}\omega||_{2} and z(0)z(0).

Theorem 5

Suppose that the input set SS is chosen such that the λmin\lambda_{\min} is strictly bounded below by DTω2||D^{T}\omega||_{2}. If Assumption 1 is satisfied then sinz(t)<1||\sin{z(t)}||_{\infty}<1 for all tt.

Proof:

Let f(z)=sinz(t)22f(z)=||\sin{z(t)}||_{2}^{2}. Let ϵ\epsilon satisfy DTω22/δ2=1ϵ||D^{T}\omega||_{2}^{2}/\delta^{2}=1-\epsilon. Then from Lemma 1, for all tt,

0Tsinz(t)22𝑑t1δ2DTω22T=(1ϵ)T\displaystyle\int_{0}^{T}{||\sin{z(t)}||_{2}^{2}\ dt}\leq\frac{1}{\delta^{2}}||D^{T}\omega||_{2}^{2}T=(1-\epsilon)T

Then by Lemma 3, sinz(t)2sinz(t)22(1ϵ)||\sin{z(t)}||_{\infty}^{2}\leq||\sin{z(t)}||_{2}^{2}\leq(1-\epsilon). ∎

In the following we provide the proof of Theorem 4 using the results from Lemma 2 and Theorem 5.

Proof of Theorem 4: Let e=(j,i)e=(j,i) for each i,j{1,,n}i,j\in\{1,\ldots,n\} and iSi\notin S. Then using contradiction we first prove that ze(t)z_{e}(t) satisfies the bounds given in Lemma 2 if ze(0)z_{e}(0) satisfies the bounds in Assumption 1.

Suppose ze(t)z_{e}(t) does not satisfies the bounds in Lemma 2 when ze(0)z_{e}(0) satisfies the bounds in Assumption 1. Suppose there exists tt such that ze(t)[π/2,3π/2]z_{e}(t)\notin[\pi/2,3\pi/2] for some ee with Ke<0K_{e}<0. Since ze(0)z_{e}(0) is in this region and zez_{e} is continuous, there exists t<tt^{\ast}<t such that ze(t){π/2,3π/2}z_{e}(t^{\ast})\in\{\pi/2,3\pi/2\}.

This, however, implies sinze(t){1,1}\sin{z_{e}(t^{\ast})}\in\{-1,1\}, contradicting Theorem 5. The contradiction in the case where there exists tt with ze(t)[π/2,π/2]z_{e}(t)\notin[-\pi/2,\pi/2] for some ee with Ke>0K_{e}>0 is similar. Then the result follows from Lemma 2. \hbox{}\hfill{\blacksquare}

Following the similar arguments as in Theorem 2, when a heterogeneous Kuramoto network satisfies conditions in Theorem 4, removing a subset of rows and columns from matrix RR such that λmin(R(S))\lambda_{\min}(R(S)) is bounded below by DTω2||D^{T}\omega||_{2} suffices to attain frequency synchronization via selecting a set of control input nodes SS. We note that DTω2||D^{T}\omega||_{2} depends on the set SS. In order to remove this dependency, we can replace DTω2||D^{T}\omega||_{2} with an uniform upper bound independent of SS. Derivation of one such upper bound is given below.

Theorem 6

Let δ¯\bar{\delta} be defined as

δ¯=(j,i)Emax{(ωjωi)2,ωi2,ωj2}.\bar{\delta}=\sqrt{\sum_{(j,i)\in E}\max\{(\omega_{j}-\omega_{i})^{2},\omega_{i}^{2},\omega_{j}^{2}\}}. (14)

Then maxS{D(S)Tω(S)2}δ¯\max_{S}{\{||D(S)^{T}\omega(S)||_{2}\}}\leq\overline{\delta}.

Proof:

We have that

D(S)Tω(S)22=(j,i)E(S¯,S¯)(ωjωi)2+(j,i)E(S,S¯)ωi2(j,i)Emax{(ωjωi)2,ωi2,ωj2}.\begin{split}||D(S)^{T}\omega(S)||_{2}^{2}&=\sum_{(j,i)\in E(\overline{S},\overline{S})}(\omega_{j}-\omega_{i})^{2}+\sum_{(j,i)\in E(S,\overline{S})}\omega_{i}^{2}\\ &\leq\sum_{(j,i)\in E}\max\{(\omega_{j}-\omega_{i})^{2},\omega_{i}^{2},\omega_{j}^{2}\}.\end{split}

The results follows by taking the square root of the both sides of the above inequality. ∎

The set of conditions in Assumption 1 is not feasible in general for all types of network graphs. For example, a graph with oscillators ii and jj with differently signed couplings between (i,j)(i,j) and (j,i)(j,i) does not satisfy the conditions in Assumption 1. Hence, next we study set of network graph structures that satisfy the conditions given in Assumption 1.

Let Epl(i,j)E_{p}^{l}(i,j) and Enl(i,j)E_{n}^{l}(i,j) denote the number of positive and negative edges in a path ll between the nodes ii and jj in 𝒢\mathcal{G} such that path length is strictly larger than one, respectively. Then the following results in Theorem 7, Corollary 1 and Corollary 2 present set of graphs that satisfy the conditions given in Assumption 1. Proofs of Theorem 7, Corollary 1 and Corollary 2 are given in Appendix.

Theorem 7

Any undirected or directed oriented graph that fulfills one of the following conditions for each (i,j)E(i,j)\in E satisfies Assumption 1.

  1. 1.

    If Kij>0K_{ij}>0, then for a path ll such that (Epl(i,j)Enl(i,j))0(E_{p}^{l}(i,j)-E_{n}^{l}(i,j))\geq 0 requires (Epl(i,j)Enl(i,j))mod4{0,1}(E_{p}^{l}(i,j)-E_{n}^{l}(i,j))\mod 4\in\{0,1\} and for a path ll such that (Enl(i,j)Epl(i,j))0(E_{n}^{l}(i,j)-E_{p}^{l}(i,j))\geq 0 requires (Enl(i,j)Epl(i,j))mod4{1,3}(E_{n}^{l}(i,j)-E_{p}^{l}(i,j))\mod 4\in\{1,3\}

  2. 2.

    If Kij<0K_{ij}<0, then for a path ll such that (Epl(i,j)Enl(i,j))0(E_{p}^{l}(i,j)-E_{n}^{l}(i,j))\geq 0 requires (Epl(i,j)Enl(i,j))mod4{2,3}(E_{p}^{l}(i,j)-E_{n}^{l}(i,j))\mod 4\in\{2,3\} and for a path ll such that (Enl(i,j)Epl(i,j))0(E_{n}^{l}(i,j)-E_{p}^{l}(i,j))\geq 0 requires (Enl(i,j)Epl(i,j))mod4{1,2}(E_{n}^{l}(i,j)-E_{p}^{l}(i,j))\mod 4\in\{1,2\}

Corollary 1

Let EpE_{p} and EnE_{n} denote the number of positive and negative edges in a cycle graph. Then the underlying cycle graph satisfies Assumption 1 if one the following conditions are met.

  1. 1.

    (EpEn)1(E_{p}-E_{n})\geq 1 and (EpEn)mod4{1,2}(E_{p}-E_{n})\mod 4\in\{1,2\}

  2. 2.

    (EnEp)2(E_{n}-E_{p})\geq 2 and (EnEp)mod4{2,3}(E_{n}-E_{p})\mod 4\in\{2,3\}

Corollary 2

Any Tree graph will satisfy Assumption 1.

VI Submodular Algorithm for selecting a minimum set of control inputs

In this section we provide an algorithm for selecting a minimum set of control inputs for phase/frequency synchronization in homogeneous Kuramoto networks and frequency synchronization in heterogeneous Kuramoto networks.

Using the results derived in Section V, we formulate the minimum-set control input selection problem as

min|S|s.t.λmin(R(S))=δ\begin{split}&\min|S|\\ &\text{s.t.}~{}\lambda_{\min}(R(S))=\delta\end{split} (15)

Note that when δ=0\delta=0 phase and frequency synchronization is achieved in homogeneous Kuramoto networks. On the contrary, when δ=δ¯\delta=\bar{\delta} (in Eqn. (14)) frequency synchronization is achieved in heterogeneous Kuramoto networks.

In what follows, we show that Problem 15 can be written as a submodular optimization problem. The formal definition of submodularity of a set function ff is given below.

Definition 5

A set function f:2Vf:2^{V}\rightarrow\mathbb{R} is submodular if and only if, for any STVS\subseteq T\subseteq V and any vTv\notin T,

f(S{v})f(S)f(T{v})f(T),f(S\cup\{v\})-f(S)\geq f(T\cup\{v\})-f(T),

where 2V2^{V} denote the set of all subsets of VV.

The following proposition relates the problem of bounding the minimum eigenvalue of a symmetric matrix RR below by a constant δ>0\delta>0 after removing set of corresponding rows and columns in matrix RR to a function Q(E(S))Q(E(S)) which is increasing and submodular in set E(S)E(S).

Proposition 3 ([23], Lemma 2)

Let E:={1,,m}E:=\{1,\ldots,m\} denote the set of indices related to corresponding rows and columns in a m×mm\times m symmetric matrix RR. Then for any subset, E(S)E{E}(S)\subseteq E and define a diagonal matrix of size m×mm\times m by diag(E(S))\text{{diag}}(E(S)) with [diag(E(S))]ii=1[\text{{diag}}(E(S))]_{ii}=1 for all iE(S)i\in E(S) and [diag(E(S))]ii=0[\text{{diag}}(E(S))]_{ii}=0 for all iE(S)i\notin E(S). Then the following statements are equivalent:

  1. 1.

    λmin(R(E\E(S)))>δ\lambda_{\min}(R(E\backslash{E}(S)))>\delta.

  2. 2.

    There exists a constant α>0\alpha>0 such that

    λmin(R+αdiag(E(S)))>δ.\lambda_{\min}(R+\alpha\text{{diag}}(E(S)))>\delta.
  3. 3.

    If 𝒘\bm{w} is an mm-dimensional Gaussian random vector with mean 0 and covariance matrix II, then

    Q(E(S)):=𝔼(min{wTRw+αiE(S)wi2,δ})=δ.Q(E(S)):=\mathbb{E}\big{(}\min\{w^{T}Rw+\alpha\sum_{i\in E(S)}w_{i}^{2},\delta\}\big{)}=\delta. (16)

Using the results presented in Proposition 3, we rewrite the problem of minimum-set control input selection as follows.

min|S|s.t.Q(E(S))=δ\begin{split}&\min|S|\\ &~{}\text{s.t.}~{}Q(E(S))=\delta\end{split} (17)

Let E(i):={e|e=(j,i)andjNin(i)}{E}(i):=\{e~{}|~{}e=(j,i)~{}\text{and}~{}j\in N_{\text{in}}(i)\} denote the set of edges incoming to oscillator i{1,,n}i\in\{1,\ldots,n\} in the Kuramoto network. Problem (15) leads to the following submodular minimum-set control input selection algorithm. Proposition 4 provides the optimality bounds of Algorithm VI.1.

Algorithm VI.1 Algorithm for selecting a minimum set of control inputs to induce frequency/phase synchronization.
Input: Symmetric Matrix RR,
δ={0,if network is homogeneous δ¯in Eqn.(14),if network is heterogeneous\delta=\begin{cases}0,~{}\text{if network is homogeneous }\\ \bar{\delta}~{}\text{in~{}Eqn}.~{}\eqref{eqn:upper_bound},~{}\text{if network is heterogeneous}\end{cases}
Output: Input node set SS
1:SS\leftarrow\emptyset
2:while Q(E(S))<δQ(E(S))<\delta do
3:     varg max{Q(E(S)E(i)):iS}v^{*}\leftarrow\text{arg max}\{Q(E(S)\cup E(i)):i\notin S\}
4:     S{v}S\leftarrow\{v^{*}\}
5:     Calculate Q(E(S))Q(E(S)) using Eqn. (16) with R=R(S)R=R(S)
6:end while
7:return SS
Proposition 4

Let TT denote the total number of iterations Algorithm VI.1 takes to terminate. Then define STS_{T} and SS^{*} to be the solution returned by the Algorithm VI.1 and optimal solution of the Problem given in (17), respectively. The Algorithm VI.1 has the following optimality bound of logδλmin(R)δQ(E(ST1))\log\frac{\delta-\lambda_{\min}(R)}{\delta-Q(E(S_{T-1}))}, where ST1S_{T-1} denote the set of input nodes returned by algorithm in the iteration T1T-1.

Proof:

Notice that Algorithm VI.1 is a greedy algorithm that solves the submodular set covering problem in (17). From [24] we obtain the following optimality bounds for greedy algorithm that considers the submodular function QQ.

|ST||S||S|logQ(E(ST))Q()Q(E(ST))Q(E(ST1))|S_{T}|-|S^{*}|\leq|S^{*}|\log\frac{Q(E(S_{T}))-Q(\emptyset)}{Q(E(S_{T}))-Q(E(S_{T-1}))} (18)

The result follows by observing Q(E(ST))=δQ(E(S_{T}))=\delta at the convergence of Algorithm VI.1 and Q()=λmin(R)Q(\emptyset)=\lambda_{\min}(R) from Eqn. (16). ∎

VII Numerical Study

In this section we demonstrate the performance of Algorithm VI.1 in selecting a minimum set of control inputs for synchronizing Kuramoto networks.

In what follows, we refer to Algorithm VI.1 by submodular algorithm for the purpose of comparing the performance of Algorithm VI.1 against two other selection algorithms: greedy and random. In each iteration greedy algorithm selects an oscillator i{1,,n}i\in\{1,\ldots,n\} such that removing rows and columns corresponding to the oscillator ii maximizes the λmin(R)\lambda_{\min}(R) until λmin(R(S))>δ\lambda_{\min}(R(S))>\delta. The random algorithm selects an oscillator uniformly at random in each iteration until λmin(R(S))>δ\lambda_{min}(R(S))>\delta. We compare the submodular, random, and greedy algorithms with the exact optimal set of inputs, which is computed via exhaustive search.

The simulations were performed for three types of 10 node graphs, namely, Undirected, directed oriented and directed oriented cycle graphs. Each of the data point in the plots of Figure 2 and Figure 3 corresponds to 100 random realizations of each graph type considered.

In Figure 2, we choose coupling weights of each 𝒢\mathcal{G} randomly from the interval [1,5][1,5] and then set the number of negative edges present in 𝒢\mathcal{G} according to the fraction of negative edges considered. The results suggest that submodular algorithm outperforms the random algorithm in all three graph types compared. The number of control inputs selected by submodular and greedy algorithm are comparable in undirected and directed oriented graph types. However in directed cyclic graphs we observe that submodular algorithm outperforms both greedy and random algorithms. The average difference between the number of control inputs chosen by subbmodular and optimal algorithms is 0.760.76.

Refer to caption

(a)

Refer to caption

(b)

Refer to caption

(c)
Figure 2: For homogeneous Kuramoto networks, number of control input nodes as a function of negative edges for 10 node graphs. We compare performance of submodular, greedy, random and optimal algorithms with each data point averaged over 100 realizations.

In the simulations related to the heterogeneous Kuramoto networks, we use the parameter called Weight-Frequency (WF) parameter which captures the ratio between inter oscillator natural frequency differences (DTω)(D^{T}\omega) and the in-degree (din(i)=(j,i)E(i)Kjid_{\text{in}}(i)=\sum_{(j,i)\in E(i)}K_{ji}) of an oscillator ii. WF parameter is defined as

WF=DTω2/max(din(i)).\text{WF}=||D^{T}\omega||_{2}/\max(d_{\text{in}}(i)). (19)

In Figure 3 to we consider minimum-set control input selection for synchronization in heterogeneous Kuramoto networks. In here we set fraction of negative edges to be 0.30.3 and randomly selects the natural frequencies of oscillators from the interval [0,2][0,2]. The results suggests that the performance of submodular algorithm is very similar to the results observed in homogeneous Kuramoto networks. The average difference between the number of control inputs chosen by submodular and optimal algorithm is 1.391.39.

Refer to caption

(a)

Refer to caption

(b)

Refer to caption

(c)
Figure 3: For heterogeneous Kuramoto networks, number of control input nodes as function of WF parameter defined in Eqn. 19 for 10 node graphs. We compare performance of submodular, greedy, random and optimal algorithms with each data point averaged over 100 realizations.

VIII Conclusions

We studied the problem of minimum-set control input selection for synchronization of Kuramoto networks. We developed a passivity-based analytical framework to obtain sufficient conditions for synchronization. Our framework enables control input selection in homogeneous and heterogeneous Kuramoto networks with signed couplings under various network typologies. We developed a submodular optimization algorithm for selecting a minimum set of control inputs needed to drive Kuramoto networks towards synchronization. We simulated our algorithm on undirected, directed oriented, and directed oriented cycle graphs. Future work includes the design of time-varying input signals associated with a minimum set of control inputs in heterogeneous Kuramoto networks for achieving synchronization.

References

  • [1] F. Dörfler, M. Chertkov, and F. Bullo, “Synchronization in complex oscillator networks and smart grids,” Proceedings of the National Academy of Sciences, vol. 110, no. 6, pp. 2005–2010, 2013.
  • [2] L. Schenato and G. Gamba, “A distributed consensus protocol for clock synchronization in wireless sensor network,” in 46th IEEE Conference on Decision and Control.   IEEE, 2007, pp. 2289–2294.
  • [3] M. Bennett, M. F. Schatz, H. Rockwood, and K. Wiesenfeld, “Huygens’s clocks,” Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, vol. 458, no. 2019, pp. 563–579, 2002.
  • [4] E. D. Herzog, “Neurons and networks in daily rhythms,” Nature Reviews Neuroscience, vol. 8, no. 10, pp. 790–802, 2007.
  • [5] V. Torre, “A theory of synchronization of heart pace-maker cells,” Journal of theoretical biology, vol. 61, no. 1, pp. 55–71, 1976.
  • [6] Y. Kuramoto, “Self-entrainment of a population of coupled non-linear oscillators,” in International symposium on mathematical problems in theoretical physics.   Springer, 1975, pp. 420–422.
  • [7] J. A. Acebrón, L. L. Bonilla, C. J. P. Vicente, F. Ritort, and R. Spigler, “The Kuramoto model: A simple paradigm for synchronization phenomena,” Reviews of modern physics, vol. 77, no. 1, p. 137, 2005.
  • [8] A. Jadbabaie, N. Motee, and M. Barahona, “On the stability of the Kuramoto model of coupled nonlinear oscillators,” in Proceedings of the American Control Conference, vol. 5.   IEEE, 2004, pp. 4296–4301.
  • [9] S. H. Strogatz, “From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators,” Physica D: Nonlinear Phenomena, vol. 143, no. 1-4, pp. 1–20, 2000.
  • [10] A. Clark, B. Alomair, L. Bushnell, and R. Poovendran, “Toward synchronization in networks with nonlinear dynamics: A submodular optimization framework,” IEEE Transactions on Automatic Control, vol. 62, no. 10, pp. 5055–5068, 2017.
  • [11] J. C. Bronski, L. DeVille, and M. Jip Park, “Fully synchronous solutions and the synchronization phase transition for the finite-n Kuramoto model,” Chaos: An Interdisciplinary Journal of Nonlinear Science, vol. 22, no. 3, p. 033133, 2012.
  • [12] J. Rogge and D. Aeyels, “Stability of phase locking in a ring of unidirectionally coupled oscillators,” Journal of Physics A: Mathematical and General, vol. 37, no. 46, p. 11135, 2004.
  • [13] M. Mesbahi and M. Egerstedt, Graph Theoretic Methods in Multiagent Networks.   Princeton University Press, 2010.
  • [14] H. Hong and S. H. Strogatz, “Kuramoto model of coupled oscillators with positive and negative coupling parameters: an example of conformist and contrarian oscillators,” Physical Review Letters, vol. 106, no. 5, p. 054102, 2011.
  • [15] A. El Ati and E. Panteley, “Synchronization of phase oscillators with attractive and repulsive interconnections,” in 2013 18th International Conference on Methods & Models in Automation & Robotics (MMAR).   IEEE, 2013, pp. 22–27.
  • [16] R. Delabays, P. Jacquod, and F. Dorfler, “The Kuramoto model on oriented and signed graphs,” SIAM Journal on Applied Dynamical Systems, vol. 18, no. 1, pp. 458–480, 2019.
  • [17] X. Li and P. Rao, “Synchronizing a weighted and weakly-connected Kuramoto-oscillator digraph with a pacemaker,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 62, no. 3, pp. 899–905, 2015.
  • [18] Y. Wang and F. J. Doyle, “Exponential synchronization rate of Kuramoto oscillators in the presence of a pacemaker,” IEEE transactions on automatic control, vol. 58, no. 4, pp. 989–994, 2012.
  • [19] A. Bosso, I. A. Azzollini, and S. Baldi, “Global frequency synchronization over networks of uncertain second-order Kuramoto oscillators via distributed adaptive tracking,” in IEEE 58th Conference on Decision and Control (CDC).   IEEE, 2019, pp. 1031–1036.
  • [20] B. Brogliato, R. Lozano, B. Maschke, and O. Egeland, Dissipative Systems Analysis and Control.   Springer, 2007, vol. 2.
  • [21] L. Moreau, “Stability of continuous-time distributed consensus algorithms,” in 43rd IEEE conference on decision and control (CDC), vol. 4.   IEEE, 2004, pp. 3998–4003.
  • [22] G. S. Schmidt, A. Papachristodoulou, U. Münz, and F. Allgöwer, “Frequency synchronization and phase agreement in Kuramoto oscillator networks with delays,” Automatica, vol. 48, no. 12, pp. 3008–3017, 2012.
  • [23] A. Clark, Q. Hou, L. Bushnell, and R. Poovendran, “Maximizing the smallest eigenvalue of a symmetric matrix: A submodular optimization approach,” Automatica, vol. 95, pp. 446–454, 2018.
  • [24] L. A. Wolsey, “An analysis of the greedy algorithm for the submodular set covering problem,” Combinatorica, vol. 2, no. 4, pp. 385–393, 1982.

In this section, we provide proofs of Theorem 7, Corollary 1 and Corollary 2.

Proof of Theorem 7: In this proof we let 𝒢\mathcal{G} to be undirected. Notice that solution to the set of inequalities given in Assumption 1 does exists if all the distinct inequalities involving any two nodes ii and jj in 𝒢\mathcal{G} such that (i,j)E(i,j)\in E do not contradict with each other. Also note that the number of distinct inequalities involving any two nodes ii and jj in 𝒢\mathcal{G} is equal to the number of distinct paths between node ii and jj in 𝒢\mathcal{G}.

First consider the condition 1)1) where Kij>0K_{ij}>0 with zij(0)=θi(0)θj(0)z_{ij}(0)=\theta_{i}(0)-\theta_{j}(0). Then from Assumption 1 we have

π/2<zij(0)<π/2.-\pi/2<z_{ij}(0)<\pi/2. (20)

Then by adding all the inequalities defined according to Assumption 1 corresponding to the edges in the path ll between node ii and node jj gives

E(pn)π/2<zij<E(pn)π/2ifE(pn)0E(np)π/2<zij<E(np)3π/2ifE(np)0,\begin{split}-E_{(p-n)}\pi/2<z_{ij}&<E_{(p-n)}\pi/2~{}\text{if}~{}E_{(p-n)}\geq 0\\ E_{(n-p)}\pi/2<z_{ij}&<E_{(n-p)}3\pi/2\text{if}~{}E_{(n-p)}\geq 0,\end{split} (21)

where E(pn)=(Epl(i,j)Enl(i,j))mod4E_{(p-n)}=(E_{p}^{l}(i,j)-E_{n}^{l}(i,j))\mod 4 and E(np)=(Enl(i,j)Epl(i,j))mod4E_{(n-p)}=(E_{n}^{l}(i,j)-E_{p}^{l}(i,j))\mod 4. Hence in this case we require E(pn){0,1}E_{(p-n)}\in\{0,1\} or E(np){1,3}E_{(n-p)}\in\{1,3\} in order for the solutions of the inequalities in Eqns. (20) and (21) to coincide.

Next consider the condition 2)2) where Kij<0K_{ij}<0. Then from Assumption 1 we have

π/2<zij(0)<3π/2.\pi/2<z_{ij}(0)<3\pi/2. (22)

Then similar to the proof of condition one we can obtain the set of inequalities in Eqn. (21) by summing up all the inequalities corresponding to the edges in the path ll between node ii and node jj. Therefore, we require E(pn){2,3}E_{(p-n)}\in\{2,3\} or E(np){1,2}E_{(n-p)}\in\{1,2\} in order for the solutions of the inequalities in Eqns. (21) and (22) to coincide.

Similar arguments follows when the Kuramoto network’s graph structure is a directed oriented graph. \hbox{}\hfill{\blacksquare}

Proof of Corollary 1: Notice that in cycle graphs for each pair of nodes (i,i+1)(i,i+1) for i1,,n1i\in{1,\ldots,n-1} and pair (n,1)(n,1) has exactly one path whose length is greater than one. Then the proof follows form the similar arguments as in the proof of Theorem 7 with l=1l=1. \hbox{}\hfill{\blacksquare}

Proof of Corollary 2: Tree graphs has exactly one path between any pair of nodes (i,j)(i,j). Hence if (i,j)E(i,j)\in E then there exists no other path between node ii and node jj such that path length is greater than one. \hbox{}\hfill{\blacksquare}