Topological Necessary Conditions for Control Dynamics
1 Introduction
Suppose a smooth feedback control has been found so that the controlled dynamics have an asymptotically stable attractor at some point x in state space. Then local Lyapunov functions exist for the dynamics; these functions must all have a unique minimum at the point x, but are otherwise arbitrary. On a compact level set of any such Lyapunov function, the controlled dynamics point inwards, in other words in the direction of the negative of the gradient of the Lyapunov function. As maps to the unit sphere, the two vector fields thus have the same degree. But the degree of the negative gradient vector field is known —it is exactly . Hence the map of the controlled dynamics, restricted to a level set, to the sphere must be onto. This means roughly that all control directions must be available near a point that is to be stabilized by control. In control theory, this is known as the Brockett condition, but such simple de- gree results were widely known before (Krasnosel’skii’s name is mentioned in conjunction with that of Brockett.) Such degree-theoretic arguments have been used for some time in topology and were eventually adopted by control theorists to derive a number of related necessary conditions for design of controlled dynamics using continuous feed- back.
In this paper, we give an account of this theory that has two distinguishing features: first, there is really no reason to limit ourselves to local results: a global theory is straightforward to obtain. Secondly, we point out that such necessary conditions are in some funda- mental sense of limited value; this is because they involve maps from manifolds to spheres of the same dimension. By the Hopf theory, homotopy equivalence classes of such maps are completely classified by a single integer (traditionally called the degree, but better interpreted in terms of homology groups.)
Several comments are in order: generalizations of the Brockett necessary condition have been obtained by Coron and others. These suffer to some extent by the problem mentioned above, but have helped clarify the fact that surjectivity is not enough: the vector field cannot ‘twist’ too much either (examples use the degree maps as part of a control system decomposition.) Moreover, extensions to the case of dynamic feedback have been derived.
Perhaps more importantly, many systems cannot be stabilized using continuous feedback, but can be easily stabilized with discontinuous feedback. The discontinuity is rather mild: it is usually limited to a ‘thin’ subset of state space. Recent work of Sontag, Clarke, Subbotin and others has led to a theory of discontinuous feedback controls and a methodology for obtaining nonsmooth Lyapunov functions. Now it is possible to interpret this theory in a hamiltonian context: The discontinuities correspond to jumps between locally nonsingularly projected lagrangian levels. This way of examining possibly discontinuous feedback controls is conceptually easier to understand and is in step with the philosophy of the book [3] which is to give, as far as is possible, geometric accounts of analytical points.
We begin by giving an outline of the algebraic topological machinery needed for a discussion of necessary conditions. Here, we depart from the practice of delegating mathematical background to an appendix, because we believe that this theory is quite accessible and elegant.
A collection of global necessary conditions is then given, directly based on the topological results. Essentially, it is argued that if certain dynamics are achieved, then index-theoretic conditions can be deduced by counting the equilibrium points and their stability (Euler-type arguments) and degree-theoretic results are obtained by the Hopf theorems using the Gauss maps of the dynamics and the gradient vector field of Lyapunov functions.
Finally, let us point out that this paper by no means exhausts the theory of necessary conditions in control design. Much more crucial limitations on achievable control dynamics arise from the theory of feedback invariant objects, a theory that is developed in the book [3].
2 Some Background and Methods from Algebraic Topology
A thumb-nail sketch of a number of concepts and methods from algebraic topology will now be given. There is no effort to be rigorous, but we do hope to explain enough about the computational methods so that a non-expert reader can use them in concrete situations.
Algebraic topology is based on a simple principle: attach algebraic objects to topological spaces that are invariants of the homotopy type of the space. Thus, more precisely we assign algebraic objects to homotopy equivalence classes of spaces and this assignment is ‘functorial’ in the sense that maps of spaces induce homomorphisms of the algebraic objects. This already gives useful tests: since homotopy equivalent spaces have isomorphic algebraic objects, two spaces are definitely not homotopy equivalent if their algebraic objects are not isomorphic. The bulk of algebraic topology consists of deriving finer and finer such objects so as to be able to better distinguish spaces and in making clever use of its basic constructions to aid the analysis of global aspects of other subjects (such as complex analysis, pdes, geometry etc.)
Singular homology
The easiest algebraic object we can attach to a space is the graded abelian group called the singular homology group of (with integer coefficients.) One can get quite far with only a vague understanding of what the singular homology measures and the reason is that powerful and effective methods for the computation of exist. We outline the Mayer-Vietoris sequence and explain the concept of a long exact sequence of a pair and its relation to excision.
A graded abelian group is a direct sum of groups , , such that the group addition is ‘component-wise’, in other words we add elements belonging to the same graded component together. The notation
for an element of , where is therefore unambiguous.
For a topological space, the th homology group measures in some sense the ‘holes’ of that are like spheres (think of a boundary-less space, like a sphere, that does not actually bound anything itself in .) The th group is equal to if is path connected. (Recall that a -sphere is the boundary of an interval, i.e. the union of two points.) There is a way of defining reduced homology groups so that for a connected space and so that all higher dimensional groups coincide with the non-reduced ones.
Let us give some examples (we omit the zeroth homology group.) The singular homology of the circle is and zero for . Since also, the homology group contains the same information as the fundamental group of the circle. Note the difference in interpretation, though: In the former case (for ), we are thinking of maps from the circle to itself, classifed by the number of net encirclements In the latter, we are thinking of a fixed circle —coinciding in this case with the whole space — as the generator of a free abelian group; in this sense, we can write
For the sphere of dimension , is the only nonzero homology group in positive dimension. Since we also have that the th homotopy group of an sphere is , we have not yet obtained anything new, compared with homotopy theory. This is a little misleading: homotopy is both subtler than homology and far more difficult to compute: we do not, even today, have a complete list of the homotopy groups of spheres. Moreover, may very well be nonzero for some , while always.
The ‘coincidence’ is really due to a nontrivial theorem, the Hurewicz isomorphism that states that homotopy and homology groups are isomorphic at the first level when one, and hence both, are nontrivial (the abelianization of the possibly nonabelian fundamental group is to be considered, if this happens at the first level.)
A quick check that homology theory does indeed give something new is to compute the homology of the torus . We have that even though ! (it may be profitable to spend a minute or two pondering the difference.)
The Mayer-Vietoris sequence
Supose a space is the union of two opne subsets, , with opne and . Then there is a long exact sequence involving the homology groups of the three spaces
(1) |
This gives a surprisingly powerful tool for the computation of homology. Even without knowing what the maps at each stage are (for which we refer the reader to standard accounts such as [2]) the exactness allows the computation in concrete cases, such as that of the spheres. For this, decompose an -sphere into two slightly overlapping hemispheres and so that their intersection is deformable to a sphere of dimension . We can start an induction with dimension and use the Mayer-Vietoris sequence to obtain
(2) |
yielding, for , and since disks have no homology
(3) |
We conclude that , since any exact sequence of the form
implies that the middle map is one-to-one and onto, i.e. an isomorphism.
Long exact sequence of a pair and excision
A second very useful method for the computation of homology comes from considering pairs , where is a subspace. One gets the long exact sequence for the pair
(4) |
where the groups are the relative homology groups. Without giving the exact definition, found in the standard texts, let us mention that in many important cases, these relative groups are isomorphic to the homology groups of the quotient space (see chapter 3 for the definition.) The long exact sequence for a pair is thus extremely useful for the computation of the homological Conley index.
As an example, let us show that the quotient of a closed ball by its bounding sphere has the homology of the -sphere . The long exact sequence of the pair is
(5) |
and so, at , we get
(6) |
hence . Similarly, one finds that, for (and nonzero), .
Maps and homomorphisms
Given a continuous map , there is an induced map in homology, which we shall denote by or
and one checks that homology is a covariant functor from the category Top of topological spaces and continuous maps to the category Ab of abelian groups and homomorphisms between them. Since is graded, the above homomorphism is understood to mean that it consists of homomorphisms at each level of homology:
for all .
In fact, it would be more precise to say that the functor goes from the category hTop of homotopy equivalence classes of spaces and homotopic maps to the category Ab, since
Proposition 1.
If the maps and are homotopic, then the maps in homology coincide: .
and
Proposition 2.
If two spaces and are homotopy equivalent and the map has a homotopy inverse, then is an isomorphism and the homology groups of and , and are isomorphic.
Corollary 1.
If is a homeomorphism of spaces, then is an isomorphism.
When the space is a finite-dimensional manifold, the homology groups are finitely generated; thus, in this case, the basic structure theorem for finitely generated abelian groups is applicable.
Theorem 1 (Structure Theorem).
Any finitely generated abelian group decomposes uniquely as the direct sum
where the abelian group is free and the group is a torsion subgroup.
In fact, one can describe the torsion group is more detail (see, for example, [4].)
The dimension of the free part of the homology group is called the th-Betti number, . The Euler characteristic is the alternating sum of the Betti numbers
3 Collections of topological necessary conditions
The definition of certain Gauss maps is helpful in the statement of our results. We shall assume that or is an open subset of it.
Definition 3.1.
-
1.
Suppose the vector field is nowhere zero in . Then the Gauss map is defined by
-
2.
Suppose that is a submanifold such that the restriction of the vector field to is nowhere zero. Then the Gauss map is obtained by restricting the Gauss map to . Note that this is a map between two manifolds of the same dimension, one of which is a sphere.
-
3.
If the submanifold is orientable, we define the Gauss map by mapping to the unit normal vector to at (where an ‘outward’ direction is fixed by choosing an oriented basis on and completing it to a basis of consistent with an orientation of .) Note again that the Gauss map is a map from an dimensional space to the -sphere.
3.1 Index-Theoretic Necessary Conditions
The topological index of equilibrium points leads to a number of necessary conditions for achieving dynamics with equilibrium points of given stability. These are global results and are rather classical; our only novelty is in trying to use as modern an algebraic topological framework as we can to express them.
If is an isolated equilibrium point of the vector field , take a ball neighborhood of (an open set homeomorphic to a ball) such that is the only equilibrium of in and its boundary is a closed submanifold homeomorphic to a sphere. Then the Gauss map gives a map from the sphere to itself
where is the homeomorphism from to the sphere.
At the level of homology, we thus get a homomorphism from to itself. Since this group is isomorphic to , we get a homomorphism from . Since is a principal ideal domain, such maps are specified by the image of the generator, say . If, say, , then is the topological index of the equilibrium .222Confusingly, we are about to give a theorem where the term ‘degree’ is used instead of ‘toplogical index’; the two terms are equivalent. We shall try use the qualifier ‘topological’ to avoid confusion with other uses of the term index. It does not depend on the precise chosen.
The classical theorem of Hopf describes maps from the sphere to itself.
Theorem 2 (Hopf’s Classification Theorem).
Homotopy equivalence classes of maps from to itself are in a one-to-one correspondence with the integers. For each integer , the class of maps corresponding to it is called the class of maps of degree .
For a hyperbolic equilibrium point of stability index , the topological index (or degree) is equal to . Degree maps are easily obtained from the degenerate equilibria at the origin of the system in complex form: , for .
The Hopf classification of maps from the sphere to itself has a crucial generalization to maps of an arbitrary compact manifold of dimension to a sphere of dimension (see Whitehead, [7], p.244)
Theorem 3 (Hopf-Whitney).
The homotopy equivalence classes of maps of an -dimensional compact manifold to the sphere are in one-to-one correspondence with the elements of the cohomology group .
Corollary 2.
If is orientable, then the homotopy equivalence classes of maps from to are in one-to-one correspondence with the integers; they are thus again classified by ‘degree.’
This is, of course, because, for any orientable manifold, . If is not orientable, then this group is and two maps are homotopic iff they have the same mod- degree.
The global version of the Hopf index classification result is the following theorem of Poincaré-Hopf
Theorem 4 (Poincaré-Hopf).
-
1.
Suppose is a compact subset with nonempty interior such that its boundary is an -dimensional submanifold of . Suppose is a vector field on that is nowhere zero on the boundary and has a finite set of equilibrium points . Then
(7) -
2.
Suppose is a compact manifold and is a vector field on with a finite number of isolated equilibria. If the boundary of is not empty, we require the vector field to point inwards at all points. The we have
(8) where is the Euler characteristic of the manifold and is the set of equilibrium points.
In particular, the sum of the topological indices of the equilibria is a topological invariant of the manifold and thus is independent of the vector field chosen.
-
3.
Suppose is any submanifold of , with . Consider a tubular neighborhood so that is an -dimensional submanifold of . If is any vector field on such that, on , has a finite number of nondegenerate equilibria, then
(9)
We have collected different versions of this important theorem to help the reader find the most convenient form for extracting topological information in applications. Milnor [5] proves versions (2) and (3) and contains a nice discussion.
Remark.
The index already contains considerable topological information for the purposes of extracting necessary conditions. For the case of an asymptotically attracting equilibrium, for example, the topological index is equal to , which means that the generator of is mapped to itself or its negative, depending on the parity of . As a result, the Gauss map is an isomorphism in homology and we conclude that it must then be surjective and injective. The surjectivity is essentially the Krasnosel’skii-Brockett condition and the injectivity was derived by Coron. The form we have given is, however, considerably more general.
Remark.
It must be emphasized that the index is ‘blind’ to all other dynamical features except equilibria. Looking at the same point from the other side of the equalities in Theorem 4, the topological type of the Gauss map in the large (on the boundary of an enclosing set) affects the configuration of equilibria inside—and fixes the sum of their indices.
A few examples as simple illustrations of the statements of the theorem:
Example 1.
In , a ball with a vector field pointing inwards at the boundary must contain equilibria whose index sum is . If these are all hyperbolic, then the options are
-
•
A single attracting equilibrium.
-
•
Two attractors and a one-saddle.
-
•
If is even, a single repeller is not ruled out; notice that the two cases can be distinguished using the Conley index, since the exit set differs for the two cases.
-
•
Any other configuration of equilibria with the same net index sum.
Example 2.
In , an embedded torus gives possible Gauss maps of arbitrary degree, since its top homology is equal to . If, however, we know that there are no enclosed equilibria, as for example in the case where the torus isolates a limit cycle, then the degree must be zero, by part (1) of Theorem 4, independently of the stability type of the limit cycle.
This means that the Gauss map is homotopic to the constant map and hence does not have to be onto (it is not onto in general, for a small enough torus around the limit cycle). Thus, no necessary condition is derivable in this case, whether the limit cycle is stable or not.
Example 3.
On the torus we have, by part (2) of the Theorem, that any vector field must have total index sum equal to zero, since the Euler characteristic of the torus is zero. Thus, vector fields that everywhere nonzero are permissible topologically, as are vector fields with one attractor and one saddle, one repeller and a saddle, one attractor, one repeller and two saddles etc.
3.2 Necessary conditions using the topological index
It should be clear from the examples how to derive necessary conditions for achieving global dynamics from the index theorems.
Suppose given a Morse specification of gradient type, , with Morse-lyapunov functions . In the state space manifold, any choice of an oriented hypersurface that avoids has a Gauss map degree fixed by the sum of the indices of the enclosed ‘equilibria’. If this is non-zero, this implies that there must exist control sections such that the controlled dynamics give a Gauss map with the desired property. In particular, if the index sum is equal to plus or minus one, then the Gauss map is onto. Let us remark that the conditions obtained can iether be used locally to check, for example, local stabilizability by requiring the map to have degree for an arbitrarily small neighborhood of the equilibrium, or globally, since the only relevant information is the position and stability of the desired equilibria and hence the index/degree results hold for any compact hypersurface avoiding .
A more elegant algebraic topological way of checking simultaneously all necessary conditions is the following (this does not make it easier to check in concrete cases):
We do first the case of local asymptotic stabilizability.
Suppose a control section is found that locally stabilizes the origin in some neighborhood ; it will be helpful to consider the set, for ,
and the sequence
where , is the inclusion map, is the Gauss map and is the obvious projection in the trivial local sphere bundle.
Since is an isolated equilibrium of , in and the above is well-defined.
3.3 A reinterpretation of Coron’s condition
With the tools we have at our disposal, it is now easy to give a more geometric interpretation of the necessary condition for local feedback stabilization given in [1]: We start by noticing that, if is a ball neighborhood of the equilibrium , is homotopically equivalent to (it actually retracts to the sphere). Thus the composed map defined by the above sequence, call it ,
has a well-defined degree, since is asymptotically stable for and this degree is equal to . This means that, at the level of, for example, homology (or homotopy), the generator, call it , of is in the image of . In other words, if is LAS, then there is some local section such that the degree of the above map is defined and the image of the corresponding homomorphism at the level of homology is the whole of . This is essentially Coron’s result: Consider the commutative diagram
(10) |
where the vertical map is inclusion and the map from to will be denoted also by and is given by the composition . We have that
Theorem 5 (Coron, 1990).
If the system is locally asymptotically stabilizable, then
3.4 Generalizations
The simple reasoning that led to Coron’s result can be generalized to equilibrium points that are not attractors, but have a well-defined stability index.
Theorem 6.
Let be an equilibrium of the state dynamics of the control pair . If there is a continuous local feedback that yields dynamics with an equilibrium of index , then
Finally, necessary conditions applicable to an arbitrary compact, connected IIS , isolated by the set can be given. More explicitly, we assume that there is a local feedback such that has an IIS , whose dynamical structure is known (for example, as a set consists of a number of equilibria and limit cycles and their connecting orbits.) Notice that in .
Lemma 1.
Endow with a Riemannian metric. There is a function defined on such that its gradient vector field is topologically equivalent to and such that the Gauss maps of and induce the same homomorphisms on homology, both and mapping
Now, as we did for the case of local stabilization, we have the map defined by the composite map below
(11) |
which induces the map in homology
We now have the result
Theorem 7.
If the control pair can achieve dynamics with IIS isolated by the set , then the images of the maps and in coincide.
4 Homotopy equivalence and homotopic results
An elementary, but fundamental result forms the key to an alternative approach to the derivation of necessary conditions. It concerns the Gauss maps of a gradient vector field of a Lyapunov function for the dynamics and the Gauss map of the dynamics on level sets of the Lyapunov function.
Theorem 8.
Let be a compact regular level set of some Lyapunov function for the dynamics on . Then, the Gauss maps and os the vector field and of the gradient vector field of with respect to any riemannian metric are homotopy equivalent.
Proof.
Decompose the tangent space into the tangent space of and the span of the gradient vector field . If is the projection of to the span of ,we have that is nowhere zero on .
Consider the isotopy of vector field
We have that and .
Now notice that this gives an isotopy for the corresponding Gauss maps as well: this is because on and for all . To see this, write as
and notice that the vector field is orthogonal to , which is everywhere nonzero.
Define the Gauss maps parametrized by
Since is everywhere nonzero, this is well defined and gives an isotopy between
and
∎
For reference purposes, let us denote the set of homotopy equivalence classes of maps between two spaces and by
according to the standard notation. Given a map , we write for its equivalence classs. We thus have, in this notation, that
Relations to the index
Since the spaces involved are of the same dimension and the target space is a sphere, we have, by the Hopf theory, that these homotopy equivalence classes are classified by degree.
Limit Cycles
In the case of a limit cycle , we saw that the Gauss map always has degree zero. Additional necessary conditions are obtained by examining the Gauss map in more detail.
Theorem 9.
Suppose is a limit cycle for the dynamics on . then
-
1.
For any , there is a neighborhood such that
-
2.
The image is not contained in any hemisphere: in other words, for any hyperplane , . Moreover, for generic , is even (here the bars denote cadinality of a finite set.)
Proof.
The first part is proved by continuity and the long flow box (see [6].)
The second part is by contradiction: suppose there exists a hyperplane , for some and is such that . Since any hyperplane separates into two parts, we must have that is of uniform sign, say negative, for all .
Choose a basis of such that is the dual basis vector of , i.e. and for all . Write for the coordinates in this basis.
Claim.
The function is a Lyapunov function for in some open neighhborhood of .
This is shown by computing . We have
and, since , this is just .
The claim now establishes a contradiction that proves the theorem, since is a closed curve. The last part also follows from this fact and an elementary transversality argument. ∎
Theorem 9 says roughly that, even though the image of the Gauss map of a limt cycle is ‘thin,’ still it must curve sufficiently in the target sphere so as to intersect all possible hyperplanes.
As for the Lyapunov level sets near a limit cycle, we have
Theorem 10.
Suppose is a stable limit cycle for some controlled dynamics. then, on each level set of a Lyapunov function near , each direction (i.e. element of the unit sphere) appears at least twice, in other words, for each ,
(The proof is a basic topolgical facts about tori and is omitted.) Thus, even though the Gauss map of the gradient vector field of Lyapunov functions is of degree zero on any level (as it should be by the Poincaré-Hopf theorem 4), it covers the unit sphere at least twice.
We see, therefore, that members of the same homotopy equivalence class of maps can have widely different Gauss images. The trick, as far as control is concerned, is to find a representative arising from a control section (see [3].)
5 Summary
We have presented ways of deriving collections of necessary conditions for achieving dynamics of a given type and we also pointed out the limitations of such topological conditions (due to the simplicity of the Hopf theory of maps to a sphere.) The basic aim of any analysis is, of course, to arrive at constructive methodologies. In the treatment of this subject in [3], we find that conditions that are both necessary and sufficient can be found for achieving dynamics in a certain class. In this light, the fundamental source of necessary conditions is the class of control-transverse sections and the resulting feedback-invariant dynamics.
References
- [1] J. M. Coron. A necessary condition for feedback stabilization. System and Control Letters, 14:227–232, 1990.
- [2] M. Greenberg and J. Harper. Algebraic topology: a first course. Benjamin/Cummins, Reading, Mass., 1981.
- [3] E. Kappos. Global Controlled Dynamics. Draft Manuscript, 2007.
- [4] S. Lang. Algebra. Addison-Wesley, Reading, Mass., 1971.
- [5] John W. Milnor. Topology from a Differentiable Viewpoint. The University Press of Virginia, Charlottsville, 1965.
- [6] J. Palis and W. de Melo. Geometric theory of dynamical systems: an introduction. Springer-Verlag, 1982.
- [7] George W. Whitehead. Elements of homotopy theory, volume 61 of Graduate Texts in Mathematics. Springer-Verlag, 1978.