This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

Koopman embedding and super-linearization counterexamples with isolated equilibria

Philip Arathoon  and  Matthew D. Kvalheim Department of Mathematics, University of Michigan, Ann Arbor, MI, USA [email protected], [email protected]
Abstract.

A frequently repeated claim in the “applied Koopman operator theory” literature is that a dynamical system with multiple isolated equilibria cannot be linearized in the sense of admitting a smooth embedding as an invariant submanifold of a linear dynamical system. This claim is sometimes made only for the class of super-linearizations, which additionally require that the embedding “contain the state”. We show that both versions of this claim are false by constructing (super-)linearizable smooth dynamical systems on k\mathbb{R}^{k} having any countable (finite) number of isolated equilibria for each k>1k>1.

2020 Mathematics Subject Classification:
Primary 37C15

A linearizing embedding of a nonlinear smooth dynamical system is a global identification of the nonlinear system with an invariant submanifold of a linear dynamical system. Linearizing embeddings have been studied by various communities and are of central importance in the rapidly developing “applied Koopman operator theory” literature [BBKK22]. An oft-repeated claim in that literature is that any dynamical system with multiple isolated equilibria cannot be linearized by a smooth embedding, or at least not by an embedding that “contains the state”. We call the latter type of linearizing embeddings super-linearizations.

The first claim was shown to be false by the authors in [KA23, Ex. 4] if non-Euclidean state spaces are allowed. In the present paper we show that both claims are also false for Euclidean state spaces by constructing for each k>1k>1 (i) linearizable dynamical systems on k\mathbb{R}^{k} having any countable number of isolated equilibria and (ii) super-linearizable dynamical systems on k\mathbb{R}^{k} having any finite number of equilibria. Thus, there are more (super-)linearizable dynamical systems than previously believed.

Super-linearizations are of practical importance for engineering applications since they are invertible in closed form. Our notion of super-linearization is slightly different from that of Belabbas and Chen [BC23] since we consider embeddings into linear rather than affine dynamical systems.

We now proceed more formally. In this paper all manifolds and maps between them are smooth (CC^{\infty}), and embeddings are smooth embeddings [Lee13]. Let MM be a manifold and Φ:×MM\Phi\colon~{}\mathbb{R}\times M\rightarrow M be the flow of a dynamical system. A map f:M1M2f\colon M_{1}\rightarrow M_{2} between two such dynamical systems (M1,Φ1)(M_{1},\Phi_{1}) and (M2,Φ2)(M_{2},\Phi_{2}) is called equivariant (also called a semi-conjugacy) if

(1) Φ2tf=fΦ1t\Phi_{2}^{t}\circ f=f\circ\Phi_{1}^{t}

for all tt\in\mathbb{R}. If ff is a diffeomorphism then we say that (M1,Φ1)(M_{1},\Phi_{1}) and (M2,Φ2)(M_{2},\Phi_{2}) are smoothly conjugate dynamical systems.

A dynamical system (M,Φ)(M,\Phi) admits a linearizing embedding if there exists an equivariant embedding f:Mnf\colon M\to\mathbb{R}^{n} of (M,Φ)(M,\Phi) into (n,Ψ)(\mathbb{R}^{n},\Psi) where Ψt=exp(At)\Psi^{t}=\text{exp}(At) is the flow of a linear system of ordinary differential equations on n\mathbb{R}^{n} generated by some matrix AA. Recall that ff is an embedding if it is a homeomorphism of MM onto its image and if the derivative dfdf is injective [Lee13, p. 85].

From now on we shall assume that MM is an open subset of k\mathbb{R}^{k}. For such systems there is a stronger notion of linearizability: a linearizing embedding f:Mk+mf\colon M\rightarrow\mathbb{R}^{k+m} is a super-linearizing embedding if it is of the form f(x)=(x,p(x))f(x)=(x,p(x)) for some map p:Mmp\colon M\rightarrow\mathbb{R}^{m}. Observe that the image of ff is the graph of pp,

{(x,p(x))|xM}.\{(x,p(x))~{}|~{}x\in M\}.

For this reason it will be helpful for us to refer to embeddings f:Mnf\colon M\rightarrow\mathbb{R}^{n} as graphlike if the image of ff can be written in the form

{x+φ(x)|xN}\{x+\varphi(x)~{}|~{}x\in N\}

where NN is an open subset of some kk-dimensional subspace of n\mathbb{R}^{n} and φ:NU\varphi\colon N\rightarrow U is a smooth map into a complementary subspace UU. Equivalently, ff is graphlike if and only if there exists a linear subspace UnU\subset\mathbb{R}^{n} of codimension kk whose affine translates transversely intersect the image of ff in at most one point. Every super-linearizing embedding is graphlike, and the image of any graphlike linearizing embedding of a dynamical system is the image of a super-linearizing embedding of some smoothly conjugate dynamical system.

Remark 1.

Suppose f:M1M2f\colon M_{1}\rightarrow M_{2} defines a smooth conjugacy between two dynamical systems and gg is a linearizing embedding of (M2,Φ2)(M_{2},\Phi_{2}). Then gfg\circ f is a linearizing embedding of (M1,Φ1)(M_{1},\Phi_{1}). Therefore, the property of admitting a linearizable embedding is well defined on the equivalence classes of smoothly conjugate dynamical systems. However, if gg is a super-linearizing embedding then gfg\circ f need not be. Put differently, unlike linearizability, being super-linearizable is not a manifestly diffeomorphism-invariant attribute of dynamical systems.

Theorem 1.

For any k>1k>1 there exists a super-linearizable dynamical system on k\mathbb{R}^{k} with any given finite number of isolated equilibria.

Example 1 (A linearizing embedding of a planar system with two isolated equilibria).

Consider the linear system on 3\mathbb{R}^{3} given by

(2) ddt(xyz)=(010100000)(xyz).\frac{d}{dt}\begin{pmatrix}x\\ y\\ z\end{pmatrix}=\left(\begin{array}[]{cc|c}0&1&0\\ 1&0&0\\ \hline\cr 0&0&0\end{array}\right)\begin{pmatrix}x\\ y\\ z\end{pmatrix}.

This preserves the planes z=constantz=\text{constant} and generates the standard flow on hyperbolae in xyxy-space. For each z=constantz=\text{constant} the lines y=±xy=\pm x divide the plane into four invariant quadrants. Let AkA_{k} denote the plane z=kz=k with the quadrant containing (x,y)=(1,0)(x,y)=(-1,0) removed. Now let γ\gamma be a smooth curve in the plane y=0y=0 which connects (x,z)=(0,1)(x,z)=(0,1) to the origin as shown in Figure 2 [Lee13, Ch. 2], and let BB denote the set of all orbits of (2) intersecting γ\gamma. Consider the surface

(3) Σ=A1BA0\Sigma=A_{1}\cup B\cup A_{0}

as shown in Figure 1. This surface is smooth and diffeomorphic to the plane, and hence, implicitly defines a linearizing embedding f:23f\colon\mathbb{R}^{2}\hookrightarrow\mathbb{R}^{3} of a planar system with two isolated equilibria as shown in the figure.

Refer to caption
Refer to caption
Figure 1. The phase portrait of a planar system with two isolated equilibria together with the image Σ\Sigma of a linearizing embedding into 3\mathbb{R}^{3}.
Remark 2.

We may extend the previous example to give a planar system with any countable number {}\ell\in\mathbb{N}\cup\{\infty\} of isolated equilibria. We do this by continuing to stack higher planes A2,A3,A4,A_{2},A_{3},A_{4},\dots and alternately removing the quadrants containing (x,y)=(±1,0)(x,y)=(\pm 1,0). The curve γ\gamma must now smoothly snake upwards joining the equilibria together, as shown for instance in Figure 3. We shall denote the surface with exactly l>2l>2 equilibria constructed in this way by Σl\Sigma^{l}.

Remark 3.

We may enlarge such systems on the plane to k\mathbb{R}^{k} for any k2k\geq 2 by writing (x,w)2×k2(x,w)\in\mathbb{R}^{2}\times\mathbb{R}^{k-2} and setting, for instance, w˙=w\dot{w}=w. The map (x,w)(f(x),w)(x,w)\mapsto(f(x),w) now defines a linearizing embedding of a system on k\mathbb{R}^{k} with any desired countable number of isolated equilibria.

The surface Σ\Sigma is not given by a graphlike embedding of 2\mathbb{R}^{2} into 3\mathbb{R}^{3}. However, it might be possible to find an equivariant embedding of 3\mathbb{R}^{3} into some higher dimensional vector space whose restriction to Σ\Sigma is graphlike and hence a super-linearizing embedding of some dynamical system. This is the main idea that we use in our proof of Theorem 1. Before presenting the proof we must first discuss equivariant polynomial maps between vector spaces.

Consider a finite-dimensional vector space VV. The symmetric product SymmV\textnormal{Sym}^{m}V can be interpreted as homogeneous degree-mm polynomials on the dual VV^{*} by taking the evaluation of ηV\eta\in V^{*} on v1vmv_{1}\odot\dots\odot v_{m} to be the product

η,v1η,vm.\langle\eta,v_{1}\rangle\cdots\langle\eta,v_{m}\rangle.

Here ,\langle~{},~{}\rangle denotes the pairing between VV with its dual and \odot is the symmetrized tensor product [FH91, pp. 473–474]. We can then introduce the direct sum

(4) Pm(V)=VSym2VSymmVP^{m}(V^{*})=\mathbb{R}\oplus V\oplus\textnormal{Sym}^{2}V\oplus\cdots\oplus\textnormal{Sym}^{m}V

interpreted as the vector space of all degree-mm polynomials on VV^{*}. The diagonal inclusion VSymmVV\hookrightarrow\textnormal{Sym}^{m}V given by vvvv\mapsto v\odot\cdots\odot v is a GL(V)GL(V)-equivariant degree-mm polynomial map, and by extension we may consider the natural map

(5) Δm:V⸦⟶Pm(V).\Delta^{m}\colon V\lhook\joinrel\longrightarrow P^{m}(V^{*}).

More explicitly, Δm\Delta^{m} sends vVv\in V to the polynomial which when evaluated on ηV\eta\in V^{*} yields

η,v+η,v2++η,vm.\langle\eta,v\rangle+\langle\eta,v\rangle^{2}+\dots+\langle\eta,v\rangle^{m}.

Note that Δm\Delta^{m} is a smooth embedding of VV into Pm(V)P^{m}(V^{*}) and is GL(V)GL(V)-equivariant with respect to the action on polynomials pp given by

(gp)(η)=p(gη)(g\cdot p)(\eta)=p(g^{*}\eta)

for gGL(V)g\in GL(V) and where gg^{*} is the adjoint. Thus, if ff is a linearizing embedding, so is Δmf\Delta^{m}\circ f.

Proposition 1.

Let ff be a smooth embedding of k\mathbb{R}^{k} into a real vector space VV. The composition Δmf:kPm(V)\Delta^{m}\circ f\colon\mathbb{R}^{k}\hookrightarrow P^{m}(V^{*}) is a graphlike embedding if and only if there exist polynomials p1,,pkp_{1},\dots,p_{k} of degree mm on VV for which the fibres of p=(p1,,pk):Vkp=(p_{1},\dots,p_{k})\colon V\rightarrow\mathbb{R}^{k} intersect the image of ff transversely in at most one point.

We will say that the submanifold Im(f)\text{Im}(f) is tamed by the polynomials p1,,pkp_{1},\dots,p_{k}.

Proof.

Recall that an embedding kW\mathbb{R}^{k}\hookrightarrow W is graphlike if and only if there exists a codimension-kk subspace of WW whose affine translates intersect the image of the embedding transversely in at most one point. Equivalently, there exist linear functions η1,,ηkW\eta_{1},\dots,\eta_{k}\in W^{*} for which each fibre of η=(η1,,ηk):Wk\eta=(\eta_{1},\dots,\eta_{k})\colon W\rightarrow\mathbb{R}^{k} intersects the image of the embedding transversely in at most one point. Consequently, Δmf\Delta^{m}\circ f is graphlike if and only if there exist η1,,ηk\eta_{1},\dots,\eta_{k} in (Pm(V))(P^{m}(V^{*}))^{*} with this property. The result follows by noting that linear functions on Pm(V)P^{m}(V^{*}) pull back through Δm\Delta^{m} to polynomials of degree mm on VV. ∎

Example 2 (A super-linearizing embedding of a planar system with two isolated equilibria).

Consider the planar dynamical system with linearizing embedding f:23f\colon\mathbb{R}^{2}\hookrightarrow\mathbb{R}^{3} from Example 1. Using Proposition 1 we will show that this admits a super-linearizing embedding into the much larger 20-dimensional vector space P3(3)P^{3}({\mathbb{R}^{3}}^{*}) by finding two degree-3 polynomials qq and pp on 3\mathbb{R}^{3} which tame the surface Σ\Sigma.

We begin by choosing q(x,y,z)=yq(x,y,z)=y. Now consider the intersections of Σ\Sigma with the planes y=constanty=\text{constant}, as shown for instance in Figure 2 for y=0y=0. For any fixed value of yy, this intersection viewed in the xzxz-plane extends in the negative xx-direction no further than x=1+y2x=-\sqrt{1+y^{2}}, since x2y2x^{2}-y^{2} is constant along orbits. Therefore, the curve

(6) z=κx+(1+y2)+12z=\frac{\kappa}{x+(1+y^{2})}+\frac{1}{2}

for any κ\kappa and for yy fixed, intersects Σ{y=constant}\Sigma\cap\{y=\text{constant}\} transversely in at most one point. Hence, we set p(x,y,z)=(z12)(x+(1+y2))p(x,y,z)=(z-\frac{1}{2})\left(x+(1+y^{2})\right) to establish that qq and pp tame Σ\Sigma as intended.

Refer to caption
Figure 2. The intersection of the surface Σ\Sigma with y=0y=0 is shown in bold. Also shown are contours of the polynomial p(x,y,z)=(1+y2)z+x(z12)p(x,y,z)=(1+y^{2})z+x(z-\frac{1}{2}).
Proof of Theorem 1.

From the previous example we have already established the claim for the case of two isolated equilibria and k=2k=2. By the technique of Remark 3 it suffices to show that the extended surfaces Σl\Sigma^{l} constructed in Remark 2 for finite >2\ell>2 can also be tamed by some degree mm polynomials qq and pp. By Proposition 1 this will imply that Δmf\Delta^{m}\circ f is an equivariant graphlike embedding, and hence, a super-linearizing embedding of some smoothly conjugate dynamical system.

We again set q(x,y,z)=yq(x,y,z)=y and consider the intersections Σl{y=constant}\Sigma^{l}\cap\{y=\text{constant}\} as shown for instance in Figure 3 for l=4l=4. We claim that for any fixed yy, the level sets of

(7) p(x,y,z)=(1+y2)l1Mz+x(z12)(z32)(zl+32)p(x,y,z)=(1+y^{2})^{l-1}Mz+\textstyle x(z-\frac{1}{2})(z-\frac{3}{2})\cdots(z-l+\frac{3}{2})

transversely intersect the curve γ=Σl{y=constant}\gamma=\Sigma^{l}\cap\{y=\text{constant}\}, where MM is any positive constant larger than

max(x,z)Rxddz(z12)(z32)(zl+32)\max_{(x,z)\in R}\left\|x\frac{d}{dz}\textstyle(z-\frac{1}{2})(z-\frac{3}{2})\cdots(z-l+\frac{3}{2})\right\|

and RR is some closed rectangular region in the plane y=0y=0 with |x|<1|x|<1 and which contains all of the turns of γ\gamma, as shown for instance in Figure 3. To see why this is true consider the gradient of pp in the plane y=constanty=\text{constant},

px\displaystyle p_{x} =(z12)(z32)(zl+32)\displaystyle=\textstyle(z-\frac{1}{2})(z-\frac{3}{2})\cdots(z-l+\frac{3}{2})
pz\displaystyle p_{z} =(1+y2)l1M+xddz(z12)(z32)(zl+32).\displaystyle=(1+y^{2})^{l-1}M+x\frac{d}{dz}\textstyle(z-\frac{1}{2})(z-\frac{3}{2})\cdots(z-l+\frac{3}{2}).

For different fixed yy, rectangular regions containing the orbits through the turns of γ\gamma can be chosen to scale in the xx-direction by a factor less than 1+y2\sqrt{1+y^{2}}. Therefore, by construction pz>0p_{z}>0 along the turns of γ\gamma. Furthermore, the sign of pxp_{x} always agrees with the sign of the xx-derivative of γ\gamma. It follows that the derivative of pp along the curve γ\gamma as it moves upwards is positive everywhere. Each joint level set of qq and pp therefore intersects the surface Σl\Sigma^{l} transversely exactly once, as desired. ∎

Refer to caption
Figure 3. The intersection of the surface Σ4\Sigma^{4} with y=0y=0 is shown in bold. Also shown are contours of the polynomial p(x,y,z)=4z(1+y2)3+x(z12)(z32)(z52)p(x,y,z)=4z(1+y^{2})^{3}+x(z-\frac{1}{2})(z-\frac{3}{2})(z-\frac{5}{2}).
Remark 4.

It is tempting to extend this proof to include the surface in Example 2 with countably infinite isolated equilibria. However, a direct generalisation will not work. To see why, consider again the intersection γ=Σ{y=0}\gamma=\Sigma^{\infty}\cap\{y=0\}. This intersection is now a curve which snakes upwards with infinitely many turns. Suppose this curve can be tamed by some polynomial p(x,z)p(x,z). Then the derivative of pp along γ\gamma must be nowhere zero, and hence pxp_{x} must alternate sign infinitely often along the line x=0x=0. This contradicts the Fundamental Theorem of Algebra since px(0,z)p_{x}(0,z) is a polynomial in zz.

Incidentally, the example of γ2\gamma\subset\mathbb{R}^{2} in the previous remark shows that not every embedded submanifold can be tamed by polynomials. If one is interested in applying a polynomial embedding Δm\Delta^{m} to super-linearize a dynamical system, it would be of interest to obtain necessary and sufficient conditions for an embedded submanifold to be tamed by polynomials, and to perhaps bound their degree.

To conclude, we would like to make some comments regarding the relevance of these counterexamples to the study of Koopman eigenmappings. For a dynamical system (M,Φ)(M,\Phi) a Koopman eigenfunction is a function ψ\psi on MM for which

ddtψΦt=λψ\frac{d}{dt}\psi\circ\Phi^{t}=\lambda\psi

for all tt and for some λ\lambda\in\mathbb{R}. If one has multiple Koopman eigenfunctions ψ1,,ψn\psi_{1},\dots,\psi_{n} then x(ψ1(x),,ψn(x))x\mapsto(\psi_{1}(x),\dots,\psi_{n}(x)) defines an equivariant map from MM into a linear dynamical system on n\mathbb{R}^{n}. If one has enough functionally independent Koopman eigenfunctions, then this map will be a smooth immersion, and hence, is very closely related to our notion of a linearizing embedding. Indeed, in Example 1 the three functions x+yx+y, xyx-y, and zz each pull back through the embedding to give Koopman eigenfunctions on a planar dynamical system with multiple isolated equilibria.

As far as we know, these are the first examples of globally defined smooth Koopman eigenfunctions for a dynamical system with multiple isolated equilibria. Furthermore, the linear span of these eigenfunctions seems to be the first known example of a non-trivial finite-dimensional subspace of smooth functions for a dynamical system with multiple isolated equilibria which is invariant under the action of the Koopman operator. Moreover, by using a super-linearizing embedding (as in Example 2) such an invariant subspace additionally “contains the state”.

Finally, we should caution that despite the counterexamples we have presented, there exist many obstructions which prevent the existence of linearizing embeddings for general dynamical systems. The existence of hetero- and homoclinic orbits between equilibria is one such obstruction (since these orbit types are not possible for linear systems), and so too is the presence of multiple asymptotically stable equilibria (see the first footnote in [KA23]). In addition, the main theorem of [LOS23] forbids the existence of linearizing embeddings for systems whose collection of ω\omega-limit set is countable and contains more than one element, and whose forward-orbits are all precompact. We note that this is consistent with our example since it contains unbounded forward-orbits which are not precompact.

References

  • [BBKK22] S L Brunton, M Budišić, E Kaiser, and J N Kutz, Modern Koopman theory for dynamical systems, SIAM Rev. 64 (2022), no. 2, 229–340. MR 4416982
  • [BC23] M-A Belabbas and X Chen, A sufficient condition for the super-linearization of polynomial systems, arXiv preprint arXiv:2301.04048 (2023).
  • [FH91] W Fulton and J Harris, Representation theory, Graduate Texts in Mathematics, vol. 129, Springer-Verlag, New York, 1991, A first course, Readings in Mathematics. MR 1153249
  • [KA23] M D Kvalheim and P Arathoon, Linearizability of flows by embeddings, arXiv preprint arXiv:2305.18288 (2023).
  • [Lee13] J M Lee, Introduction to smooth manifolds, second ed., Graduate Texts in Mathematics, vol. 218, Springer, New York, 2013. MR 2954043
  • [LOS23] Z Liu, N Ozay, and E D Sontag, On the non-existence of immersions for systems with multiple omega-limit sets, IFAC World Congress, Yokohoma, Japan, to appear (2023), preprint retrieved on May 16, 2023 from webpage at http://ftp.eecs.umich.edu/~necmiye/pubs/LiuOS_ifac23.pdf.