Since Markov Jump systems is important class of stochastic dynamic systems, it has drawn a lot of attention. Many contributions for Markov Jump systems have been reported in the literature. Robust stability and stabilization control, H∞ control, H∞ filtering design, passive control and so on have been widely studied  -  . Robust stabilization problem and H∞ control for Markov Jump Linear Singular Systems with Wiener Process was studied in  . The problems of stability and robust stabilization for stochastic fuzzy systems were addressed in  , which designed a robust stochastic fuzzy controller with H∞ performance for a class of Markov Jump nonlinear systems. Some results on delay-dependent H∞ filtering for discrete-time singular Markov Jump systems were reported in  . The authors investigated delay-dependent robust stability and corresponding control problems for Markov Jump linear systems in  . In      , some methods of H∞ filtering design for Markov Jump systems or switched systems were proposed.
As well known, Lyapunov asymptotic stability theory focuses on the steady-state behavior of plants over an infinite-time interval. But in many practical systems, it is only required that the system states remain within the given bounds. This motivated the introduction of finite-time stability or short-time stability, which has received considerable attention  -  . The authors investigated the sufficient conditions of finite-time stability for a class of stochastic nonlinear systems in  . The problem of robust finite-time stabilization for impulsive dynamical linear systems was investigated in  . In  fuzzy control method was adopted to solve finite-time stabilization of a class of stochastic system. A robust finite-time filter was established for singular discrete-time stochastic system in  . Some related works for finite-time problems were discussed in  -  . To the best of the author’ knowledge, the problem of robust finite-time filtering for discrete-time Markov Jump stochastic systems has not been fully investigated. This motivates us to investigate the present study. One application of these new results could be used to detect generation of residuals for fault diagnosis problems.
In this paper, we introduce the definition of finite-time stochastic stable (FTSS) into a class of discrete-time Markov Jump stochastic systems with parametric uncertainties. The main purpose of this research is to construct a detection filter such that the resulting filter error augmented system is FTSS. A central problem that we consider is the design of a detection filter that generates a residual signal to estimate the fault signal and detect failure. Sufficient conditions for FTSS of the filter error system is established by applying the Lyapunov-Krasovskii functional candidate combined with LMIs. The desired FTSS filter can be received by solving a set of LMIs. A numerical example is given to demonstrate the applicability and validity of the proposed theoretical method.
The structure of the paper is organized as follows. Some preliminaries and the problem formulation are introduced in Section 2. In Section 3, a sufficient condition for FTSS of the corresponding filtering error system is established and the method to design a finite-time filter is presented. Section 4 presents a numerical example to demonstrate the effectivity of the mentioned methodology. Some conclusions are drawn in Section 5.
We use to denote the n-dimensional Euclidean space. The notation (respectively, , where X and Y are real symmetric matrices, means that the matrix is positive definite (respectively, positive semi-definite). I and 0 denote the identity and zero matrices with appropriate dimensions. and denotes the maximum and the minimum of the eigenvalues of a real symmetric matrix R. The superscript T denotes the transpose for vectors or matrices. The symbol * in a matrix denotes a term that is defined by symmetry of the matrix.
2. Model Descriptions and Preliminaries
We shall consider the following uncertain discrete-time Markov Jump stochastic system:
where , are the state vector and the measurement or output vector, is the controlled output, and is a one-dimensional zero-mean process which satisfies , which is assumed to be independent of the system mode . is the expected value. Here is a known scalar.
The random form process is a discrete-time Markov process taking values in a finite set . The set S comprises the operation modes of the system. The transition probabilities for the process are defined as
where is the transition probability rate from mode i to mode j, for .
For each possible value of in the succeeding discussion, we denote the matrices with the ith mode by
, , , , ,
, , ,
where for any are known constant matrices of appropriate dimensions are matrices that represent the time-varying parameter uncertainties and are assumed to be of the form:
, . (3)
The matrices are known and provide the structure of the uncertainty. is arbitrary except for the bound on which satisfies .
Where for any and are known constant matrices of appropriate dimensions.
We now summarize several needed results from the literature.
Definition 1 (  ) The discrete-time Markovian Jump stochastic system (1) is said to be finite-time stochastic stable (FTSS) with respect to , where and N is a positive integer, if implies for all .
The next two Lemmas will play a key role in what follows.
Lemma 1 (  ) Let M, N and F be matrices of appropriate dimension, and . Then for any scalar , .
Lemma 2 (Schur complement   )
Given a symmetric matrix , the following three conditions are equivalent to each other:
2) and ;
3) and .
We now consider the following filter:
where is the filter state, and matrices are filter parameters with compatible dimensions to be determined. It is assumed that is nonsingular. Define , . Then the filtering error system is
where, , ,
, , (6)
Then the problem to be presented in this paper can be summarized as follows.
Given a scalar , design a filter (4) for the system (1), such that
1) the filtering error system (5) is FTSS,
2) the filtering error satisfies
where the prescribed value is the attenuation level.
3. Robust H∞ Filter Design
In this section we address the problems of admissibly finite-time stochastic stability analysis and the filter design of the discrete-time Markov Jump stochastic system. A sufficient condition of the filter existence and the design technique is proposed in the following theorems.
Theorem 1: The error system in (5) is robust FTSS with respect to and (7) is satisfied if there exist scalars , , , and symmetric positive-definite matrix , so that if the following condition holds:
where , and
Proof: Let us consider the following Lyapunov function candidate for system (5):
Then, we compute that
Then by two applications of Lemma 2, we have
Applying the Schur Complement, the condition (8) contains the following inequality:
With the conditions (10) and (11), it then also follows that
Proceeding in an iterative fashion, we obtain the following inequality:
Thus we have that
Obviously, (8) indicates that
Then we can conclude that (7) holds.
Theorem 2 The filtering error system (5) is FTSS with respect to and the error signal satisfies (7), if there exist positive definite
matrix and matrices , , , satisfying:
where is from (8) and is the same as in (8) except that
Moreover, the suitable filter parameters in system (4) can be given by
Proof: By Theorem 1, the terms in (9) can be rewritten as follows:
Let , then the condition (8) is equivalent to (20).
4. Numerical Example
We now give a numerical example to illustrate the proposed approach. In this example, we choose the following coefficients for the discrete-time Markov Jump stochastic system in the form of (1):
, , , , , , , , , and use the Matlab LMI Toolbox.
, , , ,
, , ,
, , ,
, , .
Suppose , , , , , , , , and apply Theorem 1, we find that LMIs (5) is feasible. Thus the system is finite-time stochastic stable with respect to for all N. Moreover, applying Theorem 2, we can obtain the corresponding filter parameters as follows:
, , ,
, , .
The necessary LMI’s are solved in MATLAB using the LMI capabilities of the Robust Control Toolbox.
In this paper, we have investigated the H∞ filtering problems for discrete-time Markov Jump stochastic systems. Stochastic Lyapunov function method is adopted to establish sufficient conditions for the FTSS of the filter error system. The design of H∞ filter is constructed in a given finite-time interval in the form of LMIs with some fixed parameters. An example is given to demonstrate the validity of the proposed method.
 Raouf, J. and Boukas, E.K. (2004) Robust Stabilization of Markovian Jump Linear Singular Systems with Wiener Process. Proceeding of the 2004 American Control Conference, Boston, 30 June-2 July 2004, 3170-3175.
 Arrifano, N.S.D. and Oliveira, V.A. (2006) Robust H∞ Fuzzy Control Approach for a Class of Markovian Jump Nonlinear Systems. IEEE Transactions on Fuzzy Systems, 14, 738-754.
 Lin, J., Lin, J., Fei, S. and Shen, J. (2011) Delay-Dependent H∞ Filtering for Discrete-Time Singular Markovian Jump Systems with Time-Varying Delay and Partially Unknown Transition Probabilities. Signal Processing, 91, 277-289.
 Lutz, C.C. and Stilwell, D.J. (2016) Stability and Disturbance Attenuation for Markov Jump Linear Systems with Time-Varying Transition Probabilities. IEEE Transactions on Automatic Control, 61, 1413-1418.
 Kim, O.H. (2010) Delay-Dependent Robust H∞ Filtering for Uncertain Discrete-Time Singular Systems with Interval Time-Varying Delay. Automatica, 46, 591-597.
 Ma, S. and Boukas, E.K. (2009) Robust H∞ Filtering for Uncertain Discrete Markov Jump Singular Systems with Mode-Dependent Time Delay. IET Control Theory & Applications, 3, 351-361.
 de Oliveira, A.M. and Costa, O.L.V. (2017) H∞ Filtering for Markov Jump Linear Systems with Partial Information on the Jump Parameter. IFAC Journal of Systems and Control, 1, 13-23.
 Zhang, M., Shi, P., Liu, Z., et al. (2018) H∞ Filtering for Discrete-Time Switched Fuzzy Systems with Randomly Occurring Time-Varying Delay and Packet Dropouts. Signal Processing, 143, 320-327.
 Amato, F., Ambrosino, R., Ariola, M. and De Tommasi, G. (2011) Finite-Time Stability of Impulsive Dynamical Linear Systems Subject to Norm-Bounded Uncertainties. International Journal of Robust and Nonlinear Control, 21, 1080-1092.
 Xing, S.Y., Zhu, B.Y. and Zhang, Q.L. (2013) Stochastic Finite-Time Stabilization of a Class of Stochastic T-S Fuzzy System with the Ito’s-Type. Proceedings of the 32nd Chinese Control Conference, Xi’an, 1570-1574.
 Zhang, Z. and Zhang, Z.X. (2015) Finite-Time H∞ Filtering for T-S Fuzzy Discrete-Time Systems with Time-Varying Delay and Norm-Bounded Uncertainties. IEEE Transtractions on Fuzzy Systems, 23, 2427-2434.
 Zhang, Z., Zhang, Z., Zhang, H., Shi, P. and Karimi, H.R. (2015) Finite-Time H∞ Filtering for T-S Fuzzy Discrete-Time Systems with Time-Varying Delay and Norm-Bounded Uncertainties. IEEE Trans on Fuzzy Systems, 23, 2427-2434.
 Zhang, L., Basin, M., Wang, S., et al. (2016) Reliable Finite-Time H∞ Filtering for Switched Linear Systems with Persistent Dwell-Time. IEEE 55th Conference on Decision and Control, Las Vegas, 6382-6387.
 Zhang, Y., Li, Z. and Peng, X. (2018) Finite-Time Stabilization for Discrete Markov Jump Systems with Actuator Saturation. Chinese Control and Decision Conference, 4709-4714.