On A Notion of Stochastic Zeroing Barrier Function
Abstract
This note examines the safety verification of the solution of Ito’s stochastic differential equations (SDE) using the notion of stochastic zeroing barrier function (SZBF). It is shown that an extension of the recently developed zeroing barrier function concept in deterministic systems can be derived to provide an SZBF based safety verification method for Itó’s SDE sample paths. The main tools in the proposed method include Itó’s calculus and stochastic invariance concept.
I Introduction
The fast developments and advances in sensor, computational and communication technologies have recently stimulated a growing interests in cyber-physical systems (CPS) framework for control systems design and implementation purposes [1, 2, 3]. In such a framework, a network of computers are often used to automatically manage the plant-sensor-controller-actuator interactions and data exchange via dedicated or suitable communication networks. The resulting CPS thus often contains tight interactions between physical, computational and communication processes, resulting in complex dynamics that are often not well understood. Among others, one of the frequently encountered challenges in CPS design are concerning the safety implementation of such CPS to guarantee the fulfillment of their safety-critical operational requirements. While a large number of results have so far been established, issues related to safety verification of CPS remain open problems.
In order to examine and verify the safety property of CPS, researchers in systems and control areas have recently proposed a framework based on the use of the so-called barrier function (BF). Being essentially a certificate-based strategy akin with the well-known Lyapunov’s stability analysis method, the BF approach verifies the safety property of CPS by finding some invariant set over which the considered safety property is fulfilled [4, 5, 6]. When compared to the more conventional simulation- or reachability-based methods, the BF based methods are arguably more computationally efficient as they do not require the exhaustive enumerations or simulations of the systems trajectories/paths for deciding the safety properties in questions. These have become the motivating reasons for the currently active research for further developments on both theoretical and application aspects of the BF methods in such areas as deterministic [7], hybrid [8], and stochastic systems [9] (see also e.g. [10] and the references therein).
With regard to stochastic systems, the development of BF based safety verification method was first formulated in [9] as an exit problem. More specifically, the safety property is defined as the probability of the sample paths of Itó SDE leaving a predefined safe set when initialized from a subset of that safe set. The approach in [9] essentially search for a BF in the form of a supermartingale of the process’ sample path that can be used to upper bound such an exit probability. The supermartingale requirement in [9] for the BF was later relaxed in [11] whereby it is only required to be a martingale (cf. e.g. [12]). Akin to the idea for finite-time stability characterization developed in [13], such a relaxation is shown in [11] to be useful for characterizing the finite-time regional safety properties of Itó type SDE sample paths.
The aim of this note is to examine an extension of the recently developed BF based method introduced in [14] to the stochastic systems’ case. Specifically, we propose a stochastic analogue of the zeroing barrier function (ZBF) based method developed in [14] to allows for the safety verification of the solution of Itó’s SDE to be done using what we refer to in this paper as a stochastic ZBF (SZBF). We show in this note that, similar to the development of stochastic stability methods based on Lyapunov’s stability analysis in deterministic systems, the extension of ZBF based method in deterministic systems can be extended to derive a SZBF based method for safety verification of Itó’s SDE.
Section II formulates the problem setup and the considered SDE model. Section III presents the main result of the paper regarding SZBF-based invariance and stability property analyses of Itó’s SDE. Section IV concludes the note.
Notation: and denote the set of real numbers and the -dimensional Euclidean space, respectively. We use to denote a real-valued -dimensional vector with an Euclidean norm . The expected value of a random variable and the probability of a random event to occur are denoted as and , respectively. The family of all continuous strictly increasing functions for some is denoted as class function. A continuous function is said to belong to the extended class function if it is strictly increasing and satisfies . The family of all continuous functions is denoted as class function for some if for each fixed , the mapping belongs to the class function with respect to and for each fixed , the mapping is decreasing with respect to and as . denotes the family of all functions that are continuously twice differentiable in with compact support.
II Setup & Preliminaries
II-A System Description
Assume a complete probability space and consider a standard valued Wiener process defined on this space. Let be the right continuous filtration generated by , i.e. in which denotes the class of all negligible sets. We consider a stochastic process which evolves on this space according to the stochastic differential equation (SDE) of the form
(1) |
with initial value at time .
In (1), both and with are functional mappings from into which satisfy Assumption 1 below.
Assumption 1
For and in (1):
-
1.
there exists a nonnegative constant such that for all , the following holds.
(2) -
2.
for any , the following holds.
(3)
Under Assumption 1, a unique strong solution of the SDE (1) is known to exist in Itô’s sense and is given by [15, 16]
(4) |
where is given. In what follows, for any and , we use to denote the solution of (1) of the form (4) at time when initialized from .
To the solution in (4), we associate the infinitesimal generator which is defined by an operator acting on a function of the form
(5) |
Here, we consider to be twice continuously differentiable on with compact support (denote this class of functions as ) such that (5) becomes [16]
(6) |
Furthermore, for any function and the solution (4) of the SDE (1), Itó’s lemma [17] states that the following holds for .
(7) |
where is defined as in (1), while and for any with being a dirac delta function, are used as a convention for (7).
II-B Problem Formulation
Given the SDE in (1), the objective of this paper is to examine the safety verification of the strong solution of (1) defined in (4). In particular, such a verification is done by characterizing the stochastic invariance property of a particular set with respect to (wrt.) the SDE (1). In this regard, we consider by construction the following closed set (which is a subset of ) defined by a function .
(8a) | ||||
(8b) | ||||
(8c) |
in which and denote the boundary and interior of , respectively.
Given the SDE in (1) and the closed set in (8), the main objective of this paper is to establish conditions on the defining function that will guarantee the set to be invariant under the evolution of the SDE (1)’s strong solution in (4). Following the framework developed in [14] for characterizing the invariant set of deterministic systems dynamics, our approach is based on the stochastic version of the notion of zeroing barrier function. To this end, we recall in Definition 1 below the corresponding notion of stochastic invariant set to be used in this paper.
III Main Results
This section proposes the notion of stochastic zeroing barrier function that can be used to establish the invariance of a closed set wrt. the strong solution of SDE (1) in (4).
III-A Stochastic Invariance Under SZBF Existence
In this subsection, we show that the existence of a SZBF ensure the stochastic invariance of a certain subset of wrt. the SDE in (1). To begin with, we first state the following notion of stochastic zeroing barrier function (SZBF).
Definition 2 (SZBF)
We now present the main result of this paper which essentially states that the existence of a SZBF as per Definition 2 implies the invariance of a closed set defined in (8) wrt. the solution of the SDE (1) in (4).
Proposition 1
Proof:
By Itó’s lemma, then the function satisfies
(10) |
Expanding the right-hand side of (III-A) and using the convention as stated following (7), we have that
(11) |
which, by the construction in (6), simplifies to
(12) |
Now if is a SZBF, then it must satisfies condition (9) in Definition 2. This implies that (12) may be rewritten as
(13) |
for some . Using similar argument as in the proof of [14, Proposition 1], we have for any . By Nagumo’s theorem [18, 19, 20], we conclude that the set in (8) is stochastically invariant. ∎
One important aspect of the result stated in Proposition 1 is that it allows one to determine the connection between the ZBF (when exists) of the diffusion-free part of (1) and the SZBF of the SDE (1). Specifically, if the set defined by is invariant wrt. the diffusion-free part of (1), the conditions for to be stochastically invariant wrt. the SDE (1) is stated in Lemma 1 below.
Lemma 1
Proof:
Note that (III-A) is of the form
(14) |
Since is a ZBF for the diffusion-free part of (1), we have by [14, Proposition 1] that in which . Combining this and conditions (i)-(ii) in Lemma 1, we have and which by Definition 2 implies is a SZBF for SDE (1) as claimed in statement 1) in the lemma. The statement 2) in the lemma follows from the fact that is a ZBF of the diffusion-free part of (1) (cf. [14, Proposition 1]) as well as a SZBF for the SDE (1) (cf. Proposition 1). ∎
III-B SZBF-induced Stochastic Stability
In this section, we show that the existence of a SZBF for the SDE in (1) induces a stochastic Lyapunov function which guarantees the stochastic stability of the corresponding invariance set. This thus essentially establishes the stochastic counterpart of [14, Proposition 2] that was developed for the deterministic systems case.
Proposition 2
Proof:
Note that being a SZBF on induces a stochastic Lyapunov function of the form
(15) |
With such a choice, one may notice that is continuous on its domain and at every point . Furthermore: i) for ; ii) for ; and iii) for , then satisfies
(16) |
with
Let us consider a solution of (1) in which denotes the zero set of the function at time (i.e. belongs to the zero set of at ). Assume that is closed in such that is also closed in , then by the continuous everywhere property of (1) in (4), there exists a time such that for a certain time interval and that is also a strong solution of (1). In this regard, with probability 1 is the first instance when leaves the set Using (III-A) to compute Itó formula for on the interval , we have that
Taking the expectation of the above equation gives
(17) |
which by (III-B) implies that
(18) |
Combining (19) with the property that for and positive for , we then have that
(19) |
with probability 1 which thus implies that holds with probability 1. Then by [16, Lemma 7.4], we conclude that the set is stable in probability. ∎
IV Remark and Discussion
This paper has presented an approach for the safety verification of the solution of Ito’s stochastic differential equations using the notion of stochastic zero barrier function. It is shown that the extension of ZBF based method in deterministic systems can be extended to provide SZBF based method for safety verification of Itó’s stochastic differential equation.
Acknowledgment
This research was supported by Ministry of Research and Technology - National Research and Innovation Agency (Kemenristek-BRIN) of the Republic of Indonesia under the Fundamental Research Scheme, 2020.
References
- [1] E. A. Lee, “Cyber physical systems: Design challenges,” in Proc. 11th IEEE ISORC, pp. 363–369, 2008.
- [2] K.-D. Kim and P. R. Kumar, “Cyber–physical systems: A perspective at the centennial,” Proc. IEEE, vol. 100, no. Special Centennial Issue, pp. 1287–1308, 2012.
- [3] Y. Tipsuwan and M.-Y. Chow, “Control methodologies in networked control systems,” Control Eng. Pract., vol. 11, no. 10, pp. 1099–1111, 2003.
- [4] H. Kong, F. He, X. Song, W.N. Hung, and M. Gu, “Exponential condition-based barrier certificate generation for safety verification of hybrid systems,” in Proc. 25th ICCAV, pp. 242–257, 2013.
- [5] H. Kong, X. Song, D. Han, M. Gu, and J. Sun, “A new barrier certificate for safety verification of hybrid systems,” Comp. J., vol. 57, no. 7, pp. 1033–1045, 2014.
- [6] L. Dai, T. Gan, B. Xia, and N. Zhan, “Barrier certificates revisited,” J. Symb. Comput, vol. 80, pp. 62–86, 2017.
- [7] S. Prajna, A. Jadbabaie, and G. J. Pappas, “A framework for worstcase and stochastic safety verification using barrier certificates,” IEEE Trans. Autom. Control, vol. 52, no. 8, pp. 1415–1428, 2007.
- [8] S. Prajna and A. Jadbabaie, “Safety verification of hybrid systems using barrier certificates,” in Proc. Wksh. HSCC, pp. 477–492, 2004.
- [9] S. Prajna, A. Jadbabaie, and G. J. Pappas, “Stochastic safety verification using barrier certificates,” in Proc. 43rd IEEE CDC, pp. 929–934, 2004.
- [10] A. D. Ames, et al., “Control barrier functions: Theory and applications,” in Proc. 18th ECC, pp. 3420–3431, 2019.
- [11] J. Steinhardt and R. Tedrake, “Finite-time regional verification of stochastic non-linear systems,” Int. J. Robot. Res., vol. 31, no. 7, pp. 901–923, 2012.
- [12] H. J. Kushner, Stochastic Stability and Control. Brown Univ. Providence, Rhode Island, Tech. Rep., 1967.
- [13] H. Kushner, “Finite time stochastic stability and the analysis of tracking systems,” IEEE Trans. Autom. Control, vol. 11, no. 2, pp. 219–227, 1966.
- [14] A. D. Ames, X. Xu, J. W. Grizzle, and P. Tabuada, “Control barrier function based quadratic programs for safety critical systems,” IEEE Trans. Autom. Control, vol. 62, no. 8, pp. 3861–3876, 2016.
- [15] B. Oksendal, Stochastic Differential Equations: An Introduction with Applications. Springer Science & Business Media, 2013.
- [16] R. Khasminskii, Stochastic Stability of Differential Equations. Springer Science & Business Media, vol. 66, 2011.
- [17] K. Itó, “Stochastic integral,” Proc. Imperial Acad., vol. 20, no. 8, pp. 519–524, 1944.
- [18] J. Aubin and G. Da Prato, “Stochastic Nagumo’s viability theorem,” Stoch. Anal. Appl., vol. 13, no. 1, pp. 1–11, 1995.
- [19] G. Da Prato and H. Frankowska, “Invariance of stochastic control systems with deterministic arguments,” J. Differ. Equations, vol. 200, no. 1, pp. 18–52, 2004.
- [20] F. Blanchini, “Set invariance in control,” Automatica, vol. 35, no. 11, pp. 1747–1767, 1999.