Bilinear optimal stabilization of a non-homogeneous Fokker-Planck equation
Abstract
In this work, we study the bilinear optimal stabilization of a non-homogeneous Fokker-Planck equation. We first study the problem of optimal control in a finite-time interval and then focus on the case of the infinite time horizon. We further show that the obtained optimal control guarantees the strong stability of the system at hand. An illustrating numerical example is given.
Index Terms:
Quadratic cost, optimal control, feedback stabilization, bilinear systems, Fokker-Planck equationI Introduction
In this paper we consider the following non-homogeneous bilinear system:
(1) |
where , is an open and bounded domain of , and . Here, design the controls and the corresponding mild solution of the system (1).
In term of applications, equation like (1) may for instance describe the situation where some physical quantities (particles, energy,…) are transferred inside a system due to diffusion and convection processes, and the control can be seen as the velocity field that the quantity is moving with. For our special case, system (1) describes a deterministic Fokker–Planck equation for the time-dependent probability density of a stochastic variable of the Langevin equation, which enables us to study many types of fluctuations in physical and biological systems (see e.g. [19]).
The goal of this paper is to study the problem of stability by an optimal control in the infinite time-horizon for the non-homogeneous bilinear system (1). The main difficulty in solving a quadratic optimal control for general bilinear systems is the non-convexity of the cost function. In the case of a bounded control operator, the question of bilinear optimal control problem has been widely studied in the literature (see [6, 11, 15, 20, 27, 28]). However, the modeling may give rise to the unboundedness aspect of the operator of control of the obtained bilinear model (see [1, 3, 7, 14, 16]), which is the case of equation (1) where the control is acting in the coefficient of the divergence term. In [1], the authors have considered the homogeneous version of the system (1) (i.e. ), for which they characterized the optimal control for a finite time horizon. Moreover, the author in [3, 14] has studied the same problem in the presence of a time and state-dependent perturbation for finite time horizon.
The paper is organized as follows: In Section II we give a preliminary. In Section III, we first solve the optimal control problem in a finite time-horizon for the system (1), and then proceed to the case of infinite time horizon in which context we give a stabilization result by optimal control. Finally, in Section 4, we present a numerical example.
II Setting of the problem and some a priori estimates
Let us consider the following spaces: and , and let us introduce the following operators :
-
•
which is a linear continuous operator,
-
•
the linear continuous operator , is defined by , here is the vector .
For all and , we have
Thus the system (1) can be rewritten in the form
(2) |
The quadratic cost function to be minimized is defined by
(3) |
where , and is the respective solution to system (2) .
Then, the optimal control problem may be stated as follows
(4) |
For the wellposedness of the system (2), let us consider the following system
(5) |
where , and let us introduce the following functional space
Now, we recall the following existence result with some a priory estimates (see [1, 3, 14]).
Lemma 1
For all , there exists a unique solution of the system (5), which is such that
Moreover, the following estimates hold
(6) |
(7) |
(8) | ||||
where is such that , for all .
III Characterization of the optimal control
III-A Existence of an optimal control
Theorem 2
For any , the problem (4) has at least one solution.
Proof 1
Since the set is not empty and is bounded from below, it admits a lower bound .
Let be a minimizing sequence such that .
Then the sequence is bounded, so it admits a sub-sequence denoted by as well, which weakly converges to .
Let be the sequence of solutions of (2) corresponding to .
According to Lemma 1, the sequences
and
are bounded, so admits a sub-sequence, also denoted by , such that
In addition to this, the linear operator
is continuous, from which it follows that
Then since the embedding is compact, admits a sub-sequence, still denoted by , for which we have
(9) |
Taking into account that the operator is linear and continuous, we deduce that
Now, by taking the limit we deduce that
In other words, is the solution of the system (2) corresponding to control .
Using that the norm is lower semi-continuous, it follows from the strong convergence of the sequence to in that
III-B Expression of the optimal control for finite time-horizon
In this subsection, we will provide informations about the optimal control.
Theorem 3
Proof 2
First, let us show that the mapping
is Fréchet differentiable and that its derivative at , for a given , is the unique solution of the following system
(13) |
Let and let be the corresponding solution of the system (2). We claim that the linear mapping is continuous. Indeed, using the estimate (7) for the system (13), we can find some such that
Let us denote by the solution of the system (2) corresponding to , and let be the solution of the system (13) corresponding to . Taking , we can see that is the solution of the following system
(14) |
So, according to (7) in Lemma 1, the following estimates hold for some
(15) | ||||
Let us set . Then is the solution of the following system
(16) |
Applying Lemma 1, the following estimates hold for some
(17) | ||||
Then using (15) and (17) and taking into account that the mapping is continuous, we conclude that for some , we have
and hence the mapping is Fréchet differentiable from to , and that the derivative at is given by the system (13).
Since the mappings and are Fréchet differentiable, we deduce that is Fréchet differentiable as well, and we have
(18) |
The well-posedness of the system (12) is guaranteed by Lemma 1, after the following change of variables
III-C Optimal control and strong stabilization
Let us consider the following quadratic cost function :
where and is the corresponding mild solution of the system (2).
The optimal control problem may be stated as follows
(22) |
Our goal in this part is to give a solution of the problem (22). For this end, we consider the sequence of controls solutions of the problem (4) on for an increasing sequence such that . Let us denote by the solution on of the system (2), and by the solution of the adjoint system (12).
We have the following result.
Theorem 4
Proof 3
Let us first observe that , as here the solution of the system (2) corresponding to is exponentially stable.
Let be the functional (3) in and let us define the following sequence of globally defined controls:
Since it follows that . Let us consider the mapping :
Let be fixed. Since is a solution of the problem (4) in , it comes that
Thus is bounded and so is . We deduce that the sequence admits a subsequence, still denoted by , which weakly converges to .
Similarly to the proof of Theorem 2, we deduce that there exists a subsequence of , (which can be also denoted by ) such that
where is the mild solution of the system (2) corresponding to in infinite time-horizon (i.e. ). Then we conclude that
(24) |
The continuity of the mapping implies the lower semi-continuity w.r.t to the weak topology (see Corollary III.8 in [13]). We deduce that
(25) |
Observing that
(26) |
Let us show that the sequence converges to . For this end, we will show that the sequence is increasing and upper bounded by . We have
from which it comes
(27) |
Combining (26) and (27), we conclude that
Keeping in mind that is the solution of the problem (4) on , we conclude that:
Thus letting , we get
This shows that is a solution of the problem (22). Let be the solution of the adjoint system (12) corresponding to . By the change of variables given by (19), is solution of the following system
So, by the estimate (6) in Lemma 1, we have
and Then the boundedness of implies that of in . So, we can deduce that the sequence admits a subsequence, still denoted by , which weakly converges to .
Using the fact that in , in and in , we conclude by Theorem 3 that
IV A numerical example
Here, we will present simulations in which we show numerically the strong stability of the optimal trajectory and we further compare numerically the optimal control w.r.t some controls in terms of energy consumption.
Let us consider the following parameters: , , , and .
Then reporting the states norm of the system for both controls and in Figure 1, we can see that performs slightly better than the zero control.
This tendency is confirmed in the table below regarding the states norm and the energy consumed by the system under the optimal control and constant controls.

Time (t) | 0.2 | 0.3 | 0.6 |
---|---|---|---|
Remark 5
Note that the stabilization problem of non-homogeneous distributed bilinear systems has been only considered for bounded control operator (see [2, 9, 10, 17]). Thus the existing results from the above literature are not applicable as here, the control operator is unbounded. Moreover, even in the homogeneous case (i.e ), the existing results for unbounded operator (see [4, 8]) are not applicable as here, the operator is skew adjoint. In particular, the observation inequality is not verified. Now, if we formally consider the feedback control used in [4, 8], then we find as involves the term which is null when is skew-adjoint.
V Conclusion
In this work, we studied the quadratic optimal control problem for a class of non-homogeneous bilinear Fokker-Planck equation. Both finite and infinite horizon cases are considered. It is further showed that the infinite horizon optimal control leads to a stabilized state of the system in closed-loop. This study provided a stabilization result which does not require the observation assumption. The result of Theorem 5 is promising. Indeed one can be inspired by it to investigate the optimal stabilization of a general unbounded bilinear system.
References
- [1] A. Addou and A. Benbrik.(2002) Existence and uniqueness of optimal control for a distributed parameter bilinear system, J. Dyn. Control Syst., 8, 141–152.
- [2] M, Akkouchi, & A. Bounabat (2003). Weak stabilizability of a nonautonomous and non-linear system. Mathematica Pannonica, 55, 61.
- [3] M. S. Aronna, & F. Tröltzsch (2021). First and second-order optimality conditions for the control of Fokker-Planck equations. ESAIM: Control, Optimisation and Calculus of Variations, 27, 15.
- [4] R. E. Ayadi, M. Ouzahra, & A. Boutoulout. (2012) Strong stabilisation and decay estimate for unbounded bilinear systems. International journal of control, 85(10), 1497-1505.
- [5] J. M. Ball, J. E. Marsden and M. Slemrod. (1982) Controllability for distributed bilinear systems, SIAM J. Control Optim., 20, 575–597.
- [6] S. Banks and M. Yew. (1985) On a class of suboptimal controls for infinite-dimensional bilinear systems, Systems and Control Letters, 5, 327–333.
- [7] L. Berrahmoune. (2009) A note on admissibility for unbounded bilinear control systems, Bulletin of the Belgian Mathematical Society-Simon Stevin, 16 , 193–204.
- [8] L. Berrahmoune. (2010). Stabilization of unbounded bilinear control systems in Hilbert space. Journal of mathematical analysis and applications, 372(2), 645-655.
- [9] H. Bounit, & H. Hammouri. (1999). Feedback stabilization for a class of distributed semilinear control systems. Nonlinear Analysis: Theory, Methods & Applications, 37(8), 953-969.
- [10] H. Bounit. (2003) Comments on the feedback stabilization for bilinear control systems. Applied mathematics letters, 16(6), 847-851.
- [11] M. E. Bradly and S. Lenhart. (1994) Bilinear optimal control of a Kirchhoff plate, Syst. Control Lett., 22, 27–38.
- [12] A. Bensoussan, G. Da Prato, M.C. Delfour and S.K. Mitter. (2007)Representation and Control of Infinite Dimensional Systems, Birkhaüser, Boston.
- [13] H. Brezis (1987) Analyse fonctionnelle : Théorie et applications, Paris, Masson.
- [14] J. M. Clérin. (2009) Problèmes de contrôle optimal du type bilinéaire gouvernés par des équations aux dérivées partielles d’évolution, Doctoral dissertation.
- [15] N. El Alami.(1986) Analyse et commande optimale des systèmes bilinéaires distribués, application aux procédés energétiques, Doctorat d’Etat-I.M.P. Perpignan, 1986.
- [16] A. Fleig and R. Guglielmi. (2016) Bilinear optimal control of the Fokker-Planck equation, IFAC-PapersOnLine, 49, 254–259.
- [17] Z. Hamidi, & M. Ouzahra. (2018). Partial stabilisation of non-homogeneous bilinear systems. International Journal of Control, 91(6), 1251-1258.
- [18] R. E. Kalman. (1960) Contributions to the theory of optimal control, Bol. Soc. Mat. Mexicano, 2, 102–119.
- [19] N. A. Krall, & A. W. Trivelpiece. (1973). Principles of plasma physics. American Journal of Physics, 41(12), 1380-1381.
- [20] X. Li and J. Yong. (2012) Optimal control theory for infinite dimensional systems, Springer Science Business Media.
- [21] M. Ouzahra. (2007) Stabilization with Decay Estimate for a Class of Distributed Bilinear Systems, European Journal of Control, 5 509–515.
- [22] A. Pazy. (1983) Semi-groups of Linear Operators and Applications to Partial Differential Equations, Springer-Verlag, New York.
- [23] L. S. Pontryagin, V. G. Boltanski, R. V. Gamkrelidze and E. F. Mischenko (1962) Mathematical theory of optimal processes, Wiley, New York.
- [24] J.P. Quinn. (1982) Stabilization of bilinear systems by quadratic feedback control, J. Math. Anal. Appl, 75 66–80.
- [25] E. P. Ryan. (1984) Optimal feedback control of bilinear systems, Journal of Optimization Theory and Applications, 44 333–362.
- [26] C. S. Chen. (2009) Quadratic optimal neural fuzzy control for synchronization of uncertain chaotic systems, Expert Systems with Applications, 36 11827–11835.
- [27] S. Yahyaoui and M. Ouzahra. (2021) Quadratic optimal control and feedback stabilization of bilinear systems, Optimal Control Applications and Methods, https://doi.org/10.1002/oca.2704.
- [28] E. Zerrik and N. El Boukhari. (2019) Regional optimal control for a class of semilinear systems with distributed controls, International Journal of Control, 92 896–907
- [29] E. Zerrik and N. El Boukhari. (2018) Constrained optimal control for a class of semilinear infinite dimensional Systems, Journal of Dynamical and Control Systems, 24 65–81.