This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

On A Notion of Stochastic Zeroing Barrier Function

Tua A. Tamba1, Bin Hu2, and Yul Y. Nazaruddin3 1Dept. Electrical Engineering, Parahyangan Catholic University, Bandung 40141, Indonesia [email protected]2Dept. Engineering Technology, Old Dominion University, Norvolk, VA 23529, USA [email protected]3Instrumentation & Control Research Group, Institut Teknologi Bandung, Bandung 40132, Indonesia [email protected]
Abstract

This note examines the safety verification of the solution of Ito’s stochastic differential equations (SDE) using the notion of stochastic zeroing barrier function (SZBF). It is shown that an extension of the recently developed zeroing barrier function concept in deterministic systems can be derived to provide an SZBF based safety verification method for Itó’s SDE sample paths. The main tools in the proposed method include Itó’s calculus and stochastic invariance concept.

I Introduction

The fast developments and advances in sensor, computational and communication technologies have recently stimulated a growing interests in cyber-physical systems (CPS) framework for control systems design and implementation purposes [1, 2, 3]. In such a framework, a network of computers are often used to automatically manage the plant-sensor-controller-actuator interactions and data exchange via dedicated or suitable communication networks. The resulting CPS thus often contains tight interactions between physical, computational and communication processes, resulting in complex dynamics that are often not well understood. Among others, one of the frequently encountered challenges in CPS design are concerning the safety implementation of such CPS to guarantee the fulfillment of their safety-critical operational requirements. While a large number of results have so far been established, issues related to safety verification of CPS remain open problems.

In order to examine and verify the safety property of CPS, researchers in systems and control areas have recently proposed a framework based on the use of the so-called barrier function (BF). Being essentially a certificate-based strategy akin with the well-known Lyapunov’s stability analysis method, the BF approach verifies the safety property of CPS by finding some invariant set over which the considered safety property is fulfilled [4, 5, 6]. When compared to the more conventional simulation- or reachability-based methods, the BF based methods are arguably more computationally efficient as they do not require the exhaustive enumerations or simulations of the systems trajectories/paths for deciding the safety properties in questions. These have become the motivating reasons for the currently active research for further developments on both theoretical and application aspects of the BF methods in such areas as deterministic [7], hybrid [8], and stochastic systems [9] (see also e.g. [10] and the references therein).

With regard to stochastic systems, the development of BF based safety verification method was first formulated in [9] as an exit problem. More specifically, the safety property is defined as the probability of the sample paths of Itó SDE leaving a predefined safe set when initialized from a subset of that safe set. The approach in [9] essentially search for a BF in the form of a supermartingale of the process’ sample path that can be used to upper bound such an exit probability. The supermartingale requirement in [9] for the BF was later relaxed in [11] whereby it is only required to be a cc-martingale (cf. e.g. [12]). Akin to the idea for finite-time stability characterization developed in [13], such a relaxation is shown in [11] to be useful for characterizing the finite-time regional safety properties of Itó type SDE sample paths.

The aim of this note is to examine an extension of the recently developed BF based method introduced in [14] to the stochastic systems’ case. Specifically, we propose a stochastic analogue of the zeroing barrier function (ZBF) based method developed in [14] to allows for the safety verification of the solution of Itó’s SDE to be done using what we refer to in this paper as a stochastic ZBF (SZBF). We show in this note that, similar to the development of stochastic stability methods based on Lyapunov’s stability analysis in deterministic systems, the extension of ZBF based method in deterministic systems can be extended to derive a SZBF based method for safety verification of Itó’s SDE.

Section II formulates the problem setup and the considered SDE model. Section III presents the main result of the paper regarding SZBF-based invariance and stability property analyses of Itó’s SDE. Section IV concludes the note.

Notation: {\mathbb{R}} and n{\mathbb{R}}^{n} denote the set of real numbers and the nn-dimensional Euclidean space, respectively. We use xnx\in{\mathbb{R}}^{n} to denote a real-valued nn-dimensional vector xx with an Euclidean norm |x||x|. The expected value of a random variable and the probability of a random event to occur are denoted as 𝔼[]{\mathbb{E}}[\cdot] and []{\mathbb{P}}[\cdot], respectively. The family of all continuous strictly increasing functions κ:[0,a)[0,)\kappa:[0,a)\rightarrow[0,\infty) for some a>0a>0 is denoted as class 𝒦\mathcal{K} function. A continuous function α:(b,a)(,)\alpha:(-b,a)\rightarrow(-\infty,\infty) is said to belong to the extended class 𝒦\mathcal{K} function 𝒦e\mathcal{K}_{e} if it is strictly increasing and satisfies α(0)=0\alpha(0)=0. The family of all continuous functions γ:[0,b)×[0,)[0,)\gamma:[0,b)\times[0,\infty)\rightarrow[0,\infty) is denoted as class 𝒦\mathcal{KL} function for some b>0b>0 if for each fixed ss, the mapping γ(r,s)\gamma(r,s) belongs to the class 𝒦\mathcal{K} function with respect to rr and for each fixed rr, the mapping γ(r,s)\gamma(r,s) is decreasing with respect to ss and γ(r,s)0\gamma(r,s)\rightarrow 0 as ss\rightarrow\infty. Cc2C^{2}_{c} denotes the family of all functions V(x):nV(x):{\mathbb{R}}^{n}\rightarrow{\mathbb{R}} that are continuously twice differentiable in xx with compact support.

II Setup & Preliminaries

II-A System Description

Assume a complete probability space (Ω,,)\left(\Omega,\mathcal{F},\mathbb{P}\right) and consider a standard m\mathbb{R}^{m}-valued Wiener process wtw_{t} defined on this space. Let {t}t+\left\{\mathcal{F}_{t}\right\}_{t\in\mathbb{R}_{+}} be the right continuous filtration generated by wtw_{t}, i.e. t:=σ(ws; 0st)𝒩\mathcal{F}_{t}:=\sigma(w_{s};\;0\leq s\leq t)\vee\mathcal{N} in which 𝒩\mathcal{N} denotes the class of all \mathbb{P}-negligible sets. We consider a stochastic process xtx_{t} which evolves on this space according to the stochastic differential equation (SDE) of the form

dxt=b(xt)dt+k=1mσ(xt)dwtkdx_{t}=b(x_{t})\,dt+\sum_{k=1}^{m}\sigma(x_{t})\,dw_{t}^{k} (1)

with initial value x0x_{0} at time t=0t=0. In (1), both b()b(\cdot) and σk()\sigma_{k}(\cdot) with b(0)=0,σk(0)=0b(0)=0,\,\sigma_{k}(0)=0 are functional mappings from n\mathbb{R}^{n} into n\mathbb{R}^{n} which satisfy Assumption 1 below.

Assumption 1

For b()b(\cdot) and σk(x)\sigma_{k}(x) in (1):

  1. 1.

    there exists a nonnegative constant LL such that for all xnx\in\mathbb{R}^{n}, the following holds.

    |b(x)|2+k1m|σk(x)|2L(1+|x|2)|b(x)|^{2}+\sum_{k-1}^{m}|\sigma_{k}(x)|^{2}\leq L\left(1+|x|^{2}\right) (2)
  2. 2.

    for any x,ynx,y\in\mathbb{R}^{n}, the following holds.

    |b(x)b(y)|+k=1m|σk(x)=σk(y)||xy||b(x)-b(y)|+\sum_{k=1}^{m}|\sigma_{k}(x)=\sigma_{k}(y)|\leq|x-y|\\ (3)

Under Assumption 1, a unique strong solution of the SDE (1) is known to exist in Itô’s sense and is given by [15, 16]

xt=x0+0tb(xs)𝑑s+k=1m0tσk(xs)𝑑wskx_{t}=x_{0}+\int_{0}^{t}b(x_{s})ds+\sum_{k=1}^{m}\int_{0}^{t}\sigma_{k}(x_{s})dw_{s}^{k} (4)

where x0nx_{0}\in\mathbb{R}^{n} is given. In what follows, for any s0s\geq 0 and xnx\in\mathbb{R}^{n}, we use xts,xx^{s,x}_{t} to denote the solution of (1) of the form (4) at time sts\leq t when initialized from xx.

To the solution xtx_{t} in (4), we associate the infinitesimal generator which is defined by an operator \mathcal{L} acting on a function h(xt):mmh(x_{t}):\mathbb{R}^{m}\rightarrow\mathbb{R}^{m} of the form

h(xt):=limt0𝔼[h(xt)]h(x)t\mathcal{L}h(x_{t}):=\lim_{t\searrow 0}\frac{\mathbb{E}[h(x_{t})]-h(x)}{t} (5)

Here, we consider h(x)h(x) to be twice continuously differentiable on xx with compact support (denote this class of functions as Cc2C^{2}_{c}) such that (5) becomes [16]

h(x)=i=1nbi(x)h(x)xi+12i,j=1nk=1mσki(x)σkj(x)2h(x)xixj.\mathcal{L}h(x)=\sum_{i=1}^{n}b^{i}(x)\frac{\partial h(x)}{\partial x^{i}}+\frac{1}{2}\sum_{i,j=1}^{n}\sum_{k=1}^{m}\sigma_{k}^{i}(x)\sigma_{k}^{j}(x)\frac{\partial^{2}h(x)}{\partial x^{i}\partial x^{j}}. (6)

Furthermore, for any function h(x)Cc2h(x)\in C^{2}_{c} and the solution (4) of the SDE (1), Itó’s lemma [17] states that the following holds for h(xt)h(x_{t}).

dh(xt)=htdt+hxdxt+12dxth(x)xh(x)xdxt,dh(x_{t})=\frac{\partial h}{\partial t}\,dt+\frac{\partial h}{\partial x}\,dx_{t}+\frac{1}{2}dx_{t}^{\prime}\frac{\partial h(x)}{\partial x}\frac{\partial h^{\prime}(x)}{\partial x}dx_{t}, (7)

where dxtdx_{t} is defined as in (1), while dtdt=0,dtdwtk=0dt\,dt=0,\,dt\,dw_{t}^{k}=0 and dwtk1dwtk2=δk1k2dtdw_{t}^{k^{1}}dw_{t}^{k^{2}}=\delta_{k^{1}k^{2}}\,dt for any k1,k2kk^{1},k^{2}\in k with δ\delta being a dirac delta function, are used as a convention for (7).

II-B Problem Formulation

Given the SDE in (1), the objective of this paper is to examine the safety verification of the strong solution of (1) defined in (4). In particular, such a verification is done by characterizing the stochastic invariance property of a particular set with respect to (wrt.) the SDE (1). In this regard, we consider by construction the following closed set 𝒞\mathcal{C} (which is a subset of n\mathbb{R}^{n}) defined by a function h(x)h(x).

𝒞\displaystyle\mathcal{C} ={xn:h(x)0}\displaystyle=\left\{x\in\mathbb{R}^{n}:\,h(x)\geq 0\right\} (8a)
𝒞o\displaystyle{\kern 0.0pt\mathcal{C}}^{\mathrm{o}} ={xn:h(x)>0}\displaystyle=\left\{x\in\mathbb{R}^{n}:\,h(x)>0\right\} (8b)
𝒞\displaystyle\partial\mathcal{C} ={xn:h(x)=0}\displaystyle=\left\{x\in\mathbb{R}^{n}:\,h(x)=0\right\} (8c)

in which 𝒞\partial\mathcal{C} and 𝒞o{\kern 0.0pt\mathcal{C}}^{\mathrm{o}} denote the boundary and interior of 𝒞\mathcal{C}, respectively.

Given the SDE in (1) and the closed set 𝒞\mathcal{C} in (8), the main objective of this paper is to establish conditions on the defining function h(x)h(x) that will guarantee the set 𝒞\mathcal{C} to be invariant under the evolution of the SDE (1)’s strong solution in (4). Following the framework developed in [14] for characterizing the invariant set of deterministic systems dynamics, our approach is based on the stochastic version of the notion of zeroing barrier function. To this end, we recall in Definition 1 below the corresponding notion of stochastic invariant set to be used in this paper.

Definition 1

A closed subset 𝒞n\mathcal{C}\subset\mathbb{R}^{n} is said to be stochastically invariant wrt. the SDE (1) if for every 0\mathcal{F}_{0}-measurable random variable x0x_{0} such that x0𝒞x_{0}\in\mathcal{C} almost surely (a.s.), the strong solution xtx_{t} in (4) satisfies xt𝒞x_{t}\in\mathcal{C} for all t0t\geq 0 a.s.

III Main Results

This section proposes the notion of stochastic zeroing barrier function that can be used to establish the invariance of a closed set wrt. the strong solution of SDE (1) in (4).

III-A Stochastic Invariance Under SZBF Existence

In this subsection, we show that the existence of a SZBF ensure the stochastic invariance of a certain subset of n\mathbb{R}^{n} wrt. the SDE in (1). To begin with, we first state the following notion of stochastic zeroing barrier function (SZBF).

Definition 2 (SZBF)

Consider the SDE (1) and the set 𝒞\mathcal{C} defined in (8) by a function h(x):nh(x):\mathbb{R}^{n}\rightarrow\mathbb{R} with h(x)Cc2h(x)\in C^{2}_{c}. If there exists a class 𝒦e\mathcal{K}_{e} function α\alpha and a set 𝒟\mathcal{D} with 𝒞𝒟n\mathcal{C}\subseteq\mathcal{D}\subset\mathbb{R}^{n} such that for all x𝒟x\in\mathcal{D} the following hold:

(i) h(x)α(h(x)),and(ii)k=1mh(x)xσk(x)=0,\text{(i) }\mathcal{L}h(x)\geq-\alpha(h(x)),\;\text{and}\;\text{(ii)}\sum_{k=1}^{m}\frac{\partial h(x)}{\partial x}\sigma_{k}(x)=0, (9)

then h(x)h(x) is a SZBF.

We now present the main result of this paper which essentially states that the existence of a SZBF h(x)h(x) as per Definition 2 implies the invariance of a closed set 𝒞\mathcal{C} defined in (8) wrt. the solution of the SDE (1) in (4).

Proposition 1

Consider the SDE (1) and a closed set 𝒞\mathcal{C} in (8) defined by some function h(x):nh(x):\mathbb{R}^{n}\rightarrow\mathbb{R} with h(x)Cc2h(x)\in C^{2}_{c}. If h(x)h(x) is a SZBF defined on the set 𝒟\mathcal{D} with 𝒞𝒟n\mathcal{C}\subseteq\mathcal{D}\subset\mathbb{R}^{n}, then 𝒞\mathcal{C} is stochastically invariant wrt. the solution of (1).

Proof:

By Itó’s lemma, then the function h(x)h(x) satisfies

dh(x)\displaystyle dh(x) =h(x)xdxt+12(dxt)2h(x)x2(dxt)\displaystyle=\frac{\partial h(x)}{\partial x}dx_{t}+\frac{1}{2}(dx_{t})^{\prime}\frac{\partial^{2}h(x)}{\partial x^{2}}(dx_{t})
=h(x)x[b(xt)dt+k=1mσ(xt)dwtk]\displaystyle=\frac{\partial h(x)}{\partial x}\left[b(x_{t})\,dt+\sum_{k=1}^{m}\sigma(x_{t})\,dw_{t}^{k}\right]
+12[b(xt)dt+k=1mσ(xt)dwtk]2h(x)x2\displaystyle\quad+\frac{1}{2}\left[b(x_{t})\,dt+\sum_{k=1}^{m}\sigma(x_{t})\,dw_{t}^{k}\right]^{\prime}\frac{\partial^{2}h(x)}{\partial x^{2}}
×[b(xt)dt+k=1mσ(xt)dwtk]\displaystyle\hskip 50.0pt\times\left[b(x_{t})\,dt+\sum_{k=1}^{m}\sigma(x_{t})\,dw_{t}^{k}\right] (10)

Expanding the right-hand side of (III-A) and using the convention as stated following (7), we have that

dh\displaystyle dh =i=1nbi(x)h(x)xidt+k=1mh(x)xσk(x)dwtk\displaystyle=\sum_{i=1}^{n}b^{i}(x)\frac{\partial h(x)}{\partial x^{i}}\,dt+\sum_{k=1}^{m}\frac{\partial h(x)}{\partial x}\sigma_{k}(x)\,dw_{t}^{k}
+12i,j=1nk=1mσki(x)σkj(x)2h(x)xixjdt\displaystyle\quad+\frac{1}{2}\sum_{i,j=1}^{n}\sum_{k=1}^{m}\sigma_{k}^{i}(x)\sigma_{k}^{j}(x)\frac{\partial^{2}h(x)}{\partial x^{i}\partial x^{j}}\,dt
=(i=1nbi(x)h(x)xi+12i,j=1nk=1mσkiσkj(x)2h(x)xixj)dt\displaystyle=\left(\sum_{i=1}^{n}b^{i}(x)\frac{\partial h(x)}{\partial x^{i}}+\frac{1}{2}\sum_{i,j=1}^{n}\sum_{k=1}^{m}\sigma_{k}^{i}\sigma_{k}^{j}(x)\frac{\partial^{2}h(x)}{\partial x^{i}\partial x^{j}}\right)dt
+k=1mh(x)xσk(x)dwtk\displaystyle\quad+\sum_{k=1}^{m}\frac{\partial h(x)}{\partial x}\sigma_{k}(x)\,dw_{t}^{k} (11)

which, by the construction in (6), simplifies to

dh(x)=h(x)dt+k=1mh(x)xσk(x)dwtk.dh(x)=\mathcal{L}h(x)\,dt+\sum_{k=1}^{m}\frac{\partial h(x)}{\partial x}\sigma_{k}(x)\,dw_{t}^{k}. (12)

Now if h(x)h(x) is a SZBF, then it must satisfies condition (9) in Definition 2. This implies that (12) may be rewritten as

dh(x)α(h(x))dtdh(x)\geq-\alpha(h(x))\,dt (13)

for some α𝒦e\alpha\in\mathcal{K}_{e}. Using similar argument as in the proof of [14, Proposition 1], we have h˙(x)α(h(x))=0\dot{h}(x)\geq-\alpha(h(x))=0 for any x𝒞x\in\partial\mathcal{C}. By Nagumo’s theorem [18, 19, 20], we conclude that the set 𝒞\mathcal{C} in (8) is stochastically invariant. ∎

One important aspect of the result stated in Proposition 1 is that it allows one to determine the connection between the ZBF (when exists) of the diffusion-free part of (1) and the SZBF of the SDE (1). Specifically, if the set 𝒞\mathcal{C} defined by h(x)Cc2h(x)\in C^{2}_{c} is invariant wrt. the diffusion-free part dxt=b(xt)dtdx_{t}=b(x_{t})\,dt of (1), the conditions for 𝒞\mathcal{C} to be stochastically invariant wrt. the SDE (1) is stated in Lemma 1 below.

Lemma 1

Assume the defining function h(x)Cc2h(x)\in C^{2}_{c} of the set 𝒞\mathcal{C} in (8) is a ZBF for the diffusion-free part dxt=b(xt)dtdx_{t}=b(x_{t})\,dt of (1). If the diffusion part of the SDE in (1) satisfies:

  1. (i)

    12i,j=1nk=1mσkiσkj(x)2h(x)xixj=0\frac{1}{2}\sum_{i,j=1}^{n}\sum_{k=1}^{m}\sigma_{k}^{i}\sigma_{k}^{j}(x)\frac{\partial^{2}h(x)}{\partial x^{i}\partial x^{j}}=0

  2. (ii)

    k=1mh(x)xσk(x)dwtk=0\sum_{k=1}^{m}\frac{\partial h(x)}{\partial x}\sigma_{k}(x)\,dw_{t}^{k}=0

then the following statements are equivalent:

  1. 1.

    h(x)h(x) is a SZBF for the SDE (1)

  2. 2.

    𝒞\mathcal{C} is invariant wrt. the diffusion-free and the SDE (1)

Proof:

Note that (III-A) is of the form

dh(x)=i=1nbi(x)h(x)xidt+12i,j=1nk=1mσkiσkj(x)2h(x)xixjdt+k=1mh(x)xσk(x)dwtk.dh(x)=\sum_{i=1}^{n}b^{i}(x)\frac{\partial h(x)}{\partial x^{i}}\,dt\\ +\frac{1}{2}\sum_{i,j=1}^{n}\sum_{k=1}^{m}\sigma_{k}^{i}\sigma_{k}^{j}(x)\frac{\partial^{2}h(x)}{\partial x^{i}\partial x^{j}}\,dt\\ +\sum_{k=1}^{m}\frac{\partial h(x)}{\partial x}\sigma_{k}(x)\,dw_{t}^{k}. (14)

Since h(x)h(x) is a ZBF for the diffusion-free part of (1), we have by [14, Proposition 1] that h˙(x)α(h(x))\dot{h}(x)\geq-\alpha(h(x)) in which α𝒦e\alpha\in\mathcal{K}_{e}. Combining this and conditions (i)-(ii) in Lemma 1, we have h(x)α(h(x))\mathcal{L}h(x)\geq-\alpha(h(x)) and k=1mh(x)xσk(x)=0\sum_{k=1}^{m}\frac{\partial h(x)}{\partial x}\sigma_{k}(x)=0 which by Definition 2 implies h(x)h(x) is a SZBF for SDE (1) as claimed in statement 1) in the lemma. The statement 2) in the lemma follows from the fact that h(x)h(x) is a ZBF of the diffusion-free part of (1) (cf. [14, Proposition 1]) as well as a SZBF for the SDE (1) (cf. Proposition 1). ∎

Remark 1

Intuitively, Lemma 1 states that the invariance property of the differential equation of the form x˙(t)=b(x)\dot{x}(t)=b(x) may be preserved in its stochastic counterpart of the form (1) only if the diffusion part of the SDE (1) satisfies conditions (i)-(ii) in the lemma.

III-B SZBF-induced Stochastic Stability

In this section, we show that the existence of a SZBF for the SDE in (1) induces a stochastic Lyapunov function which guarantees the stochastic stability of the corresponding invariance set. This thus essentially establishes the stochastic counterpart of [14, Proposition 2] that was developed for the deterministic systems case.

Proposition 2

Let h(x):𝒟h(x):\mathcal{D}\rightarrow\mathbb{R} with hCc2h\in C^{2}_{c} be defined on an open subset 𝒟n\mathcal{D}\subseteq\mathbb{R}^{n} such that 𝒞𝒟n\mathcal{C}\subset\mathcal{D}\subseteq\mathbb{R}^{n} where 𝒞\mathcal{C} is defined as in (8). If h(x)h(x) is a SZBF wrt. the SDE in (1), then the set 𝒞\mathcal{C} is stochastically stable.

Proof:

Note that h(x)h(x) being a SZBF on 𝒟\mathcal{D} induces a stochastic Lyapunov function V𝒞(x):𝒟V_{\mathcal{C}}(x):\mathcal{D}\rightarrow\mathbb{R} of the form

V𝒞(x)\displaystyle V_{\mathcal{C}}(x) ={0,if x𝒞,h(x),if x𝒟𝒞.\displaystyle=\begin{cases}0,&\text{if $x\in\mathcal{C}$},\\[5.16663pt] -h(x),&\text{if $x\in\mathcal{D}\setminus\mathcal{C}$}.\end{cases} (15)

With such a choice, one may notice that V𝒞(x)V_{\mathcal{C}}(x) is continuous on its domain and V𝒞(x)Cc2V_{\mathcal{C}}(x)\in C^{2}_{c} at every point x𝒟𝒞x\in\mathcal{D}\setminus\mathcal{C}. Furthermore: i) V𝒞(x)=0V_{\mathcal{C}}(x)=0 for x𝒞x\in\mathcal{C}; ii) V𝒞(x)>0V_{\mathcal{C}}(x)>0 for x𝒟𝒞x\in\mathcal{D}\setminus\mathcal{C}; and iii) for x𝒟𝒞x\in\mathcal{D}\setminus\mathcal{C}, then V𝒞(x)\mathcal{L}V_{\mathcal{C}}(x) satisfies

V𝒞(x)\displaystyle\mathcal{L}V_{\mathcal{C}}(x) =h(x)\displaystyle=-\mathcal{L}h(x)
αh(x)=α(V𝒞(x))0,\displaystyle\leq\alpha\circ h(x)=\alpha(-V_{\mathcal{C}}(x))\leq 0, (16)

with α𝒦e.\alpha\in\mathcal{K}_{e}.

Let us consider a solution xt0,x0:=x00𝒞x_{t}^{0,x_{0}}:=x_{0}\in\mathcal{I}_{0}\subseteq\mathcal{C} of (1) in which t\mathcal{I}_{t} denotes the zero set of the function V𝒞(xt)V_{\mathcal{C}}(x_{t}) at time tt (i.e. x0x_{0} belongs to the zero set of V𝒞(x)V_{\mathcal{C}}(x) at t=0t=0). Assume that t\mathcal{I}_{t} is closed in 𝒞\mathcal{C} such that 0\mathcal{I_{0}} is also closed in 𝒞\mathcal{C}, then by the continuous everywhere property of (1) in (4), there exists a time t𝒞t_{\mathcal{C}} such that xt𝒞0,x0𝒞x_{t_{\mathcal{C}}}^{0,x_{0}}\in\mathcal{C} for a certain time interval [0,t𝒞)[0,\,t_{\mathcal{C}}) and that xt𝒞0,x0x_{t_{\mathcal{C}}}^{0,x_{0}} is also a strong solution of (1). In this regard, t𝒞>0t_{\mathcal{C}}>0 with probability 1 is the first instance when xt𝒞0,x0x_{t_{\mathcal{C}}}^{0,x_{0}} leaves the set 𝒞.\mathcal{C}. Using (III-A) to compute Itó formula for V𝒞(x)V_{\mathcal{C}}(x) on the interval [0,t𝒞)[0,\,t_{\mathcal{C}}), we have that

V𝒞(x(t𝒞t))V𝒞(x0)\displaystyle V_{\mathcal{C}}(x(t_{\mathcal{C}}\wedge t))-V_{\mathcal{C}}(x_{0}) =0t𝒞tV𝒞(xs)𝑑s\displaystyle=\int_{0}^{t_{\mathcal{C}}\wedge t}\mathcal{L}V_{\mathcal{C}}(x_{s})\,ds
k=1m0t𝒞tV𝒞(x)xσk(x)𝑑wsk𝑑s\displaystyle{}-\sum_{k=1}^{m}\int_{0}^{t_{\mathcal{C}}\wedge t}\frac{\partial V_{\mathcal{C}}(x)}{\partial x}\sigma_{k}(x)\,dw_{s}^{k}\,ds

Taking the expectation of the above equation gives

𝔼[V𝒞(x(t𝒞t))]V𝒞(x0)\displaystyle\mathbb{E}\left[V_{\mathcal{C}}(x(t_{\mathcal{C}}\wedge t))\right]-V_{\mathcal{C}}(x_{0}) =𝔼[0t𝒞tV𝒞(xs)𝑑s]\displaystyle=\mathbb{E}\left[\int_{0}^{t_{\mathcal{C}}\wedge t}\mathcal{L}V_{\mathcal{C}}(x_{s})\,ds\right] (17)

which by (III-B) implies that

𝔼[V𝒞(x(t𝒞t))]0.\mathbb{E}\left[V_{\mathcal{C}}(x(t_{\mathcal{C}}\wedge t))\right]\leq 0. (18)

Combining (19) with the property that V𝒞=0V_{\mathcal{C}}=0 for x𝒞x\in\mathcal{C} and positive for x𝒟𝒞x\in\mathcal{D}\setminus\mathcal{C}, we then have that

V𝒞(x(t𝒞t))=0V_{\mathcal{C}}(x(t_{\mathcal{C}}\wedge t))=0 (19)

with probability 1 which thus implies that (t𝒞t):=t(t_{\mathcal{C}}\wedge t):=t holds with probability 1. Then by [16, Lemma 7.4], we conclude that the set 𝒞\mathcal{C} is stable in probability. ∎

IV Remark and Discussion

This paper has presented an approach for the safety verification of the solution of Ito’s stochastic differential equations using the notion of stochastic zero barrier function. It is shown that the extension of ZBF based method in deterministic systems can be extended to provide SZBF based method for safety verification of Itó’s stochastic differential equation.

Acknowledgment

This research was supported by Ministry of Research and Technology - National Research and Innovation Agency (Kemenristek-BRIN) of the Republic of Indonesia under the Fundamental Research Scheme, 2020.

References

  • [1] E. A. Lee, “Cyber physical systems: Design challenges,” in Proc. 11th IEEE ISORC, pp. 363–369, 2008.
  • [2] K.-D. Kim and P. R. Kumar, “Cyber–physical systems: A perspective at the centennial,” Proc. IEEE, vol. 100, no. Special Centennial Issue, pp. 1287–1308, 2012.
  • [3] Y. Tipsuwan and M.-Y. Chow, “Control methodologies in networked control systems,” Control Eng. Pract., vol. 11, no. 10, pp. 1099–1111, 2003.
  • [4] H. Kong, F. He, X. Song, W.N. Hung, and M. Gu, “Exponential condition-based barrier certificate generation for safety verification of hybrid systems,” in Proc. 25th ICCAV, pp. 242–257, 2013.
  • [5] H. Kong, X. Song, D. Han, M. Gu, and J. Sun, “A new barrier certificate for safety verification of hybrid systems,” Comp. J., vol. 57, no. 7, pp. 1033–1045, 2014.
  • [6] L. Dai, T. Gan, B. Xia, and N. Zhan, “Barrier certificates revisited,” J. Symb. Comput, vol. 80, pp. 62–86, 2017.
  • [7] S. Prajna, A. Jadbabaie, and G. J. Pappas, “A framework for worstcase and stochastic safety verification using barrier certificates,” IEEE Trans. Autom. Control, vol. 52, no. 8, pp. 1415–1428, 2007.
  • [8] S. Prajna and A. Jadbabaie, “Safety verification of hybrid systems using barrier certificates,” in Proc. Wksh. HSCC, pp. 477–492, 2004.
  • [9] S. Prajna, A. Jadbabaie, and G. J. Pappas, “Stochastic safety verification using barrier certificates,” in Proc. 43rd IEEE CDC, pp. 929–934, 2004.
  • [10] A. D. Ames, et al., “Control barrier functions: Theory and applications,” in Proc. 18th ECC, pp. 3420–3431, 2019.
  • [11] J. Steinhardt and R. Tedrake, “Finite-time regional verification of stochastic non-linear systems,” Int. J. Robot. Res., vol. 31, no. 7, pp. 901–923, 2012.
  • [12] H. J. Kushner, Stochastic Stability and Control. Brown Univ. Providence, Rhode Island, Tech. Rep., 1967.
  • [13] H. Kushner, “Finite time stochastic stability and the analysis of tracking systems,” IEEE Trans. Autom. Control, vol. 11, no. 2, pp. 219–227, 1966.
  • [14] A. D. Ames, X. Xu, J. W. Grizzle, and P. Tabuada, “Control barrier function based quadratic programs for safety critical systems,” IEEE Trans. Autom. Control, vol. 62, no. 8, pp. 3861–3876, 2016.
  • [15] B. Oksendal, Stochastic Differential Equations: An Introduction with Applications. Springer Science & Business Media, 2013.
  • [16] R. Khasminskii, Stochastic Stability of Differential Equations. Springer Science & Business Media, vol. 66, 2011.
  • [17] K. Itó, “Stochastic integral,” Proc. Imperial Acad., vol. 20, no. 8, pp. 519–524, 1944.
  • [18] J. Aubin and G. Da Prato, “Stochastic Nagumo’s viability theorem,” Stoch. Anal. Appl., vol. 13, no. 1, pp. 1–11, 1995.
  • [19] G. Da Prato and H. Frankowska, “Invariance of stochastic control systems with deterministic arguments,” J. Differ. Equations, vol. 200, no. 1, pp. 18–52, 2004.
  • [20] F. Blanchini, “Set invariance in control,” Automatica, vol. 35, no. 11, pp. 1747–1767, 1999.