Impulsive stochastic systems with Markovian switching is a class of hybrid dynamical systems, which is composed of both the logical switching rule of continuous-time finite-state Markovian process and the state represented by a stochastic differential system [1] . Because of the presence of both continuous dynamics and discrete events, these types of models are capable of describing many practical systems in many areas, including social science, physical science, finance, control engineering, mechanical and industry. So this kind of systems have received much attention, recently (for instance, see [2] - [5] ).

It is well-known that stability is the major issue in the study of control theory, one of the most important techniques applied in the investigation of stability for various classes of stochastic differential systems is based on a stochastic version of the Lyapunov direct method. However, the so-called Razumikhin technique combined with Lyapunov functions has also been a powerful and effective method in the study of stability. Recalled that Razumikhin developed this technique to study the stability of deterministic systems with delay in [6] [7] , then, Mao extended this technique to stochastic functional differential systems [8] . This technique has become very popular in recent years since it is extensively applied to investigate many phenomena in physics, biology, finance, etc.

Mao incorporated the Razumikhin approach in stochastic functional differential equations [9] and in neutral stochastic functional differential equations [10] to investigate both p-th moment and almost sure exponential stability of these systems (see also [11] - [13] , for instance). Later, this technique was appropriately developed and extended to some other stochastic functional differential systems, especially important in applications, such as stochastic functional differential systems with infinite delay [14] - [16] , hybrid stochastic delay interval systems [17] and impulsive stochastic delay differential systems [18] - [20] . Recently, some researchers have introduced y-type function and extended the stability results to the general decay stability, including the exponential stability as a special case in [21] - [23] , which has a wide applicability.

In the above cited papers, both the p-th moment and almost sure stability on a general decay are investigated, but mostly used in stochastic differential equations. And As far as I know, a little work has been done on the impulsive stochastic differential equations or systems. In this paper, we will close this gap by extending the general decay stability to the impulsive stochastic differential systems. To the best of our knowledge, there are no results based on the general decay stability of impulsive stochastic delay differential systems with Markovian switching. And the main aim of the present paper is attempt to investigate the p-th moment and almost sure stability on a general decay of impulsive stochastic delay differential systems with Markovian switching. Since the delay phenomenon and the Markovian switching exists among impulsive stochastic systems, the whole systems become more complex and may oscillate or be not stable, we introduce Razumikhin-type theorems and Lyapunov methods to give the conditions that make the systems stable. By the aid of Lyapunov-Razumikhin approach, we obtain the p-th moment general decay stability of impulsive stochastic delay differential systems with Markovian. In order to establish the criterion on almost surely general decay stability of impulsive stochastic delay differential systems with Markovian, the Holder inequality, Burkholder-Davis-Gundy inequality and Borel- Cantelli’s lemma are utilized in this paper.

The paper is organized as follows. Firstly, the problem formulations, definitions of general dacay stability and some lemmas are given in Section 2. In Section 3, the main results on p-th moment and almost sure stability on a general decay of impulsive stochastic delay differential systems with Markovian switching are obtained with Lyapunov-Razumikhin methods. An example is presented to illustrate the main results in Section 4. In the last section the conclusions are given.

Throughout this paper, let be a complete probability space with some filtration satisfying the usual condition (i.e., the filtration is increasing and right continuous while contain all P-null sets). Let be an m-dimensional -adapted Brownian motion.

Let be the n-dimensional Euclidean space; denotes the real matrix space; is the set of all non-negative real numbers; denotes the family of continuous functions with the norm; denotes the standard Euclidean norm for vectors; let, ,) denotes the family of -measurable -valued random variables such that and be the -measur- able -valued random variables; means the expectation of a stochastic process; is a discrete index set, where N is a finite positive integer.

Let, be a right-continuous Markov chain on the probability space taking values in a finite state space with generator given by

where, and is the transition rate from i to j if while.

We assume that the Markov chain is independent of the Brownian motion. It is well known that almost every sample path of is a right-continuous step function with a finite number of simple in any subinterval if. In other words, there exist a sequence of stopping times almost surely such that is a constant in every interval for any, i.e.

In this paper, we consider the following impulsive stochastic delay differential systems with Markovian switching

where the initial value

represents the impulsive perturbation of x at time. The fixed moments of impulse times satisfy (as),.

For the existence and uniqueness of the solution we impose a hypothesis:

Assumption (H): For and satisfy the local Lipschitz condition and the linear growth condition. That is, there exist a constant such that

For all, and, and, moreover, there are a constant such that

For all, and.

Definition 1 is said to be y-type function, if it satisfies the following conditions:

(1) It is continuous, monotone increasing and differentiable;

(2) and;

(3).

(4) for any.

Definition 2 For, impulsive stochastic delay differential systems with Markovian switching (1) is said to be p-th moment stable with decay of order, if there exist positive constants and function, such that

when, we say that it is stable in mean square, when, we say that it is p-th moment exponential stable, when, we say that it is p-th moment polynomial stable.

Definition 3 impulsive stochastic delay differential systems with Markovian switching (1) is said to be almost surely stable with decay of order, if there exist positive constant and function, such that

when, we say that it is almost surely exponential stable, when, we say that it is almost surely polynomial stable.

Let denote the family of all nonnegative functions on that are continuously once differentiable in t and twice in x. For each define an operator for system (1) by

where

Lemma 1 (Burkholder-Davis-Cundy inequality) Let, , there exist positive constants and, such that

where

Lemma 2 (Borel-Cantelli’s lemma)

(1) If and, then

That is, there exist a set with and an integer valued random variable such that for every we have whenever.

(2) If the sequence is independent and, then

That is, there exists a set with, such that for every, there exists a sub-seq- uence such that the belongs to every.

In this section, we shall establish some criteria on the p-th moment exponential stability and almost exponential stability for system (1) by using the Razumikhin technique and Lyapunov functions.

Theorem 1 For systems (1), let (H) hold, and is a y-type function, Assume that there exist a function, positive constants and such that

(H₁) For all

(H₂) For all

For all and those satisfying

where.

(H₃) For all and

where and.

Then, for any initial, there exists a solution on to system (1). Moreover, the system (1) is p-th moment exponentially stable with decay of order.

Proof. Fix the initial data arbitrarily and write simply. When is replaced by, if we can prove that the system (1) is p-th moment exponentially stable with decay of order for all, then the desired result is obtained. Choose satisfying , and thus we can have the following fact:

Then it follows from condition (H₁) that

In the following, we will use the mathematical induction method to show that

In order to do so, we first prove that

This can be verified by a contradiction. Hence, suppose that inequality (9) is not true, than there exist some such that. Set

. By using the continuity of in

the interval, then and

Define, then and

Consequently, for all, we have

And so

By condition (H₂) we have

Consequently,

Applying the formula to yields

By condition (14), we obtain

On the other hand, a direct computation yields

that is

which is a contradiction. So inequality (9) holds and (8) is true for. Now we assume that (8) is satisfied for, i.e. for every,

Then, we will prove that (8) holds for,

Suppose (18) is not true, i.e. there exist some such that

Then, it follows from the condition (H₃) and (17) that

which implies that the dose not satisfy the inequality (19). And from this, set

. By the continuity of in the

interval, we know that and

Define, then and

Fix any, when for all, then (20)-(22) imply that

If for some, we assume that, without loss of generality, , for some, then from (17) and (20)-(22), we obtain

Therefore,

by condition (H₂) we have

Consequently,

Similar to (15), applying the formula to yields

By condition (25), we obtain

On the other hand, by (20) and (22), we have

that is

which is a contradiction. So inequality (18) holds. Therefore, by mathematical induction, we obtain (8) holds for all. Then from condition (H₁), we have

which implies

i.e., system (1) is pth moment exponentially stable with decay of order. The proof is complete.

Theorem 2 For system (1), suppose all of the conditions of Theorem 1 are satisfied. Let, assume that there exist constants, such that for all and,

Then, for any initial and for any, there exists a solution on to stochastic delay nonlinear system (1). Moreover, the system (1) is almost surely stable with decay of order and

Proof. Fix the initial data arbitrarily and write simply. We claim that

where

Choose sufficiently small and, for the fixed, let, where

is the maximum integer not more than x. Then for any, there exist positive integer i, , such that. So, for any, , we obtain

For each i when, , we obtain

By Theorem 1, we have

By Holder inequality, condition (26) and Theorem 1, we derives that

Similarly, by the Lemma 1 and (32), we obtain

where is a positive constant dependent on p only.

Substituting (31), (32) and (33) into (30) yields

Thus, it follows from (29) and (34), we obtain

Using Chebyshev inequality, we have

Since, by Lemma 2, when, , we obtain

That is

Thus, the system (1) is almost surely stable with decay of order.

In this section, a numerical example is given to illustrate the effectiveness of the main results established in Section 3 as follows. Consider an impulsive stochastic delay system with Markovian switching as follows

where is a right-continuous Markov chain taking values in with generator

And independent of the scalar Brownian motion, ,

, , ,.

Choosing, , , , then, ,

, then we have

and

By Theorem 1, we know that, which means that the conditions of Theorem 1 are satisfied. So the impulsive stochastic delay system with Markovian switching is p-th moment stable with decay of order 2. The simulation result of system (35) is shown in Figure 1, and the Markovian switching of system (35) is described in Figure 2.

In this paper, p-th moment and almost surely stability on a general decay have been investigated for a class of impulsive stochastic delay systems with Markovian switching. Some sufficient conditions have been derived to check the stability criteria by using the Lyapunov-Razumikhin methods. A numerical example is provided to verify the effectiveness of the main results.

The work was supported by the National Natural Science Foundation of China under Grant 11261033, and the Postgraduate Scientific Research Innovation Foundation of Inner Mongolia under Grant 1402020201336.

Zhiyu Zhan,Caixia Gao, (2016) Razumikhin-Type Theorems on General Decay Stability of Impulsive Stochastic Functional Differential Systems with Markovian Switching. Journal of Applied Mathematics and Physics,04,1617-1629. doi: 10.4236/jamp.2016.48172