Since entering the 21st century, the control process is increasingly complex, the control target is more diverse, the control precision requirements are more accurate, the system environment is more strict, the productivity of the world in the rapid development at the same time also faced with a variety of new challenges. For example, a large control system is usually formed by multiple subsystems acting together through time series and following one or more constraints. However, Markov jump system can well describe the control process in which multiple subsystems have random changes in a discrete time in the control process, and meet the needs of current practical application engineering. Due to its powerful modeling ability, Markov jumping system  is widely used in aerospace , communication , industrial manufacturing , medicine , power and other fields . The Markov jumping system shows good adaptability in dealing with random phenomena such as packet loss, delay, channel fading and more     . In Ref. , finite-time control is designed based on performance for Markov jumping system with partially unknown time-varying transfer probability. A model-dependent Lyapunov function composed of bilateral closed-loop functions is constructed and applied to the fuzzy Markov jump system of sampled data in Ref. . An uncertain complex network with Markov topology and random time-varying delay is studied in Ref. . However, the aging  and damage  of components cannot be avoided in the actual system, the resources are wasted and the ideal control purpose is not achieved. Stability has always been one of the key points in control science. Only to ensure the stability of the system, the system can run normally. The study of the stability of the system continues. And the rapid stability of the system is also the embodiment of improving social productivity. How to make the system reach global stability faster is always one of the problems studied by many scholars. Filtering and signal technology  is one of the most important problems in the field of control. And the role of the filter whether on the elimination of interference signal or in the enhancement of the effective signal has a very good performance. Therefore, it is of practical significance to study the filtering problem of Markov jumping systems.
Filtering technology has always had an excellent performance in signal processing, and there are many studies on filter design, there are related designs of filtering in non-linear systems , time-delay systems , stochastic systems , fuzzy systems , etc. It is pointed out here that a time-varying filter  is designed to study stochastic systems, and its advantage is to obtain better transient performance. The article  proposes an asynchronous filter under performance, which makes full use of part of the available system modal information, improves signal quality, and saves signal resources. Next, a kind of nonstationary controller  is designed for a linear Markov jump system, which not only achieves the state feedback more accurately, but also shows excellent adjustment ability. If a nonstationary filter can be designed, the complex Markov jump system can be stabilized more quickly, and the signal can be used more efficiently, so it will be necessary to study the nonstationary filter.
Based on the above considerations, this paper mainly studied nonstationary state estimation for Markov jumping system with fading channel and multiplicative noises. To solve the filter gain matrix, an additional relaxation matrix consistent with the filter modes is introduced. The function of the relaxation variable is to eliminate the uncertain term in the matrix and facilitate the solution of matrix inequality by LMIs. The form of the relaxation variable is as follows:
which are used to eliminate the non-linear terms. For Markov jumping system with random stability and dissipative performance index, a nonstationary state filter based on multi-segment homogeneous Markov chains dispersion is designed. Finally, the effectiveness of the method is verified by simulation. The contributions of this work are as follows:
• For Markov jumping system: The channel coefficient, which is more consistent with the actual mode, is introduced to adapt to the complex signals received by the state estimator that varies with the mode. And in actual systems, it is often unrealistic to have only one kind of noise, so multiplicative noise is considered.
• For filter: A nonstationary state estimator is designed to adjust the modal part received by the original system.
• For simulation experiment: The simulation experiments of nonstationary filter and traditional asynchronous filter are done respectively, and the results are more convincing through simulation comparison.
Notations: See Table 1.
2. Problem Formulation
Consider the following system:
where is the state vector, represents the process output, is the signal waiting to be evaluated and is the disturbance noise input. For each , the system matrices , , , , , and represent the given real matrices. represents a scalar Brownian Motion with:
Table 1. Nomenclature.
In system (1), the switching of system mode is up to a Markov Chain (MC) ( ). In the finite state (FS) and , the transition probability matrix (TPM) is designed,
The measurement output is written as
where is an external disturbance input of measurement output. with l represents the given number of paths. represents the mutually independent channel coefficients. And are random variables and their values are in with and . is a given real matrices.
Remark 1 In system (1), the interference of Brownian motion , a random phenomenon, is considered. In fading channel, delay, packet loss and external disturbance are considered. Therefore, (1)-(3) is a complex system in line with the background of industrial application.
The following asynchronous filter is designed:
where is the estimate of state , is the estimate of the and , and are the designed gain filter matrices. In FS, satisfies the discrete nonstationary MC, and with TPM given by
also represents a discrete a MC in FS, and with TPM given by
Combining with system (1) and Equation (4). Letting
which needs to be noticed is .
Remark 2 When and , the filter (5) represents the homomorphic filter. When , and , the filter (5) represents mode-independent filter. Neither the former nor the latter can effectively utilize the part of the signal received by the state estimator. In order to solve this defect, the filter (5) has three independent modes, among which not only one mode is synchronous with the original system, but also two asynchronous modes. Therefore, the filter (5) is more regulatory and can make more efficient use of the signal from the original system (1).
Then the following filtering error system (FES) is designed as:
Then, the Definitions and Lemmas which will be used in this article are introduced:
Definition 1  Under the initial modes and initial conditions , when the following inequality is satisfied, FES (7) is stochastically stable.
Definition 2   Under performance index , FES (7) is called stochastically stable.
Lemma 1  There are constant matrices and . Then if and only if
3. Main Results
Firstly, the performance of FES (7) is analyzed, and the following results are given.
Theorem 1 Under performance, for a given scalar , then FES (7) is stochastically stable, if there exist matric and such that , , , Ref. (13) and Ref. (14) hold follow:
where and represent the proper symmetric positive definite matrix and
Proof: Consider the following Lyapunov function for system (1):
According to Equation (2), filter (5) and Equation (6) that , , , and , , the following equation is obtained,
Along the solution of Equation (14), the following equations are satisfied:
Assuming initial conditions and nonzero , we obtain
Equation (11) is set up by Lemma 1.
Under initial condition, nonzero and , which is obvious that:
The inequality below can be obtained by Lemma 1 that Equation (12) is true
the following inequality, which implies Equation (9), is obtained
Next, suppose there is a scalar and consider the situation that any , the following equality holds
Then, Equation (22) is obvious that
By Definition 1, Equation (23) holds means that FES (7) is randomly stable.
Theorem 2: For the given , if the following matrices are designed to satisfy
and matrices , , , , and such that , , .
Proof: Choosing , Equation (26) was immediately available from Equation (11),
Let’s take Equation (26) left times Equation (27) and right times Equation (27) transpose
Equation (28) is obviously taken from Equation (26) and Equation (27) that
In addition, since , we have:
To sum up, if Equation (28) is true then Equation (11) is clearly true, let’s introduce the relaxation variable to eliminate the products between System-matrix and Lyapunov-matrix. The substitution in Equation (28) is represented like this
Then Equation (24) is got from the above deduction. And then, by and , we can just go straight from Equation (12) to Equation (25).
4. A Numerical Example
As set of examples are taken to verify the positive value of the method. is selected as the initial state. Applying the disturbance noise in system (1) and the external disturbance in Equation (3). The parameters are given by
The TPM of MC is taken as
the TPMs of MC are given by
and the TPMs of MC are chosen as
The order of the fading model is and the probability density functions of channel coefficients are represented as follows
The mathematical expectation , and variance , . By solving the LMIs of Theorem 2, the parameters of the nonstationary filter are obtained as
When , and , the filter in (4) is mode-independent (MIF). When and , the filter in (4) is called mode-dependent filter (MDF). The traditional asynchronous filter occurs when or . The following Table 2 shows the values of different for the nonstationary and asynchronous filters under the performance index. From Table 2, that the nonstationary filter has less conservatism than asynchronous filter. The nonstationary filter can make the system (1) achieve better performance.
The relationship between the jumps of the three modes and the time series is described in Figure 1. Figure 2 shows the process of the regional stability of the system state in the time series under the adjustment of the nonstationary filter and the asynchronous filter. Figure 3 and Figure 4 respectively show the stabilization process of the state of the two filters themselves and the stabilization process of the corresponding filter error system state . Figure 5 respectively shows the process of the nonstationary filter and asynchronous filter in estimating the stability of the original system signal . In terms of system state , filter state and filter error system state , the nonstationary filter converge to stable faster than traditional asynchronous filter. The nonstationary filter also performs better in the estimation signal . What needs to be pointed out here is that in Figure 4, although the nonstationary filter error system state produces a longer wavelength before reaching stability, it still reaches stability relatively quickly.
Figure 1. Three Markov chains .
Figure 2. The state of system .
Table 2. Minimum for different kinds of filters.
Figure 3. The state of filter .
Figure 4. The state of FES .
Figure 5. The estimated signal of .
To sum up, the proposed nonstationary filter has better adaptability and stronger regulation, so that the system can operate effectively in the conditional industrial environment. On the other hand, compared with the traditional asynchronous filter, the nonstationary filter is more efficient to make the system stable, and has more practical engineering application significance, and is more suitable for practical engineering application promotion.
In this paper, the nonstationary filtering of Markov jumping system with fading channel and multiplicative noises are studied. The nonstationary filter takes into account three different segments of Markov chain, so that the nonstationary filter not only has the same mode as the original system (1), but also provides the adjustment function for other changes in the system (1) during the mode conversion, and makes more efficient use of the signals available in the system. The designed filtering method ensures that the FES (7) is stochastically stable under the performance index. Finally, the effectiveness of the method is demonstrated based on numerical examples. It needs to be pointed out that the actual control environment is far more demanding, and the nonstationary filter can be further studied through the following aspects. For example, To avoid the defect caused by slow algorithm operation when dealing with large-scale control system, the fuzzy control in  can be combined to simplify the solution of filtering scheme; The performance of nonstationary filter with more time delay should be analyzed in combination with the mean residence time ; the nonstationary filter can be combined with the practical application of non-convex regularized image denoising  for more complex image processing research. And a series of works are waiting for further research.
 Newbold, P.M. and Ho, Y.C. (2010) Detection of Changes in the Characteristics of a Gauss-Markov Process. IEEE Transactions on Aerospace and Electronic Systems, AES-4, 707-718.
 Wang, D., Ren, P. and Cheng, J. (2018) Cooperative Secure Communication in Two-Hop Buffer-Aided Networks. IEEE Transactions on Communications, 66, 972-985.
 Alina, R., Nikhil, S., Alexander, P., Rickert, M. and Knoll, A. (2015) Multimodal Human Activity Recognition for Industrial Manufacturing Processes in Robotic Workcells. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, Washington DC, November 2015, 259-266.
 Hong, Y.Y. and Lian, R.C. (2012) Optimal Sizing of Hybrid Wind/PV/Diesel Generation in a Stand-Alone Power System Using Markov-Based Genetic Algorithm. IEEE Transactions on Power Delivery, 27, 640-647.
 Cheng, J., Park, J.H., Liu, Y., Liu, Z. and Tang, L. (2016) Finite-Time [Formula Omitted] Fuzzy Control of Nonlinear Markovian Jump Delayed Systems with Partly Uncertain Transition Descriptions. Fuzzy Sets and Systems, 314, 99-115.
 Song, J., Niu, Y. and Zou, Y. (2018) Asynchronous Sliding Mode Control of Markovian Jump Systems with Time-Varying Delays and Partly Accessible Mode Detection Probabilities. Automatica, 93, 33-41.
 Tao, J., Lu, R., Shi, P., Su, H. and Wu, Z.G. (2016) Dissipativity-Based Reliable Control for Fuzzy Markov Jump Systems with Actuator Faults. IEEE Transactions on Cybernetics, 47, 2377-2388.
 Wei, B., Xiao, F. and Shi, Y. (2020) Synchronization in Kuramoto Oscillator Networks with Sampled-Data Updating Law. IEEE Transactions on Cybernetics, 50, 2380-2388.
 Xu, Y., Lu, R., Peng, H., Xie, K. and Xue, A. (2015) Asynchronous Dissipative State Estimation for Stochastic Complex Networks with Quantized Jumping Coupling and Uncertain Measurements. IEEE Transactions on Neural Networks and Learning Systems, 28, 268-277.
 Cheng, J., Zhu, H., Zhong, S., Zeng, Y. and Hou, L. (2014) Finite-Time H∞ Filtering for a Class of Discrete-Time Markovian Jump Systems with Partly Unknown Transition Probabilities. International Journal of Adaptive Control & Signal Processing, 28, 1024-1042.
 Tan, X., Cao, J. and Rutkowski, L. (2019) Distributed Dynamic Self-Triggered Control for Uncertain Complex Networks with Markov Switching Topologies and Random Time-Varying Delay. IEEE Transactions on Network Science and Engineering, 7, 1111-1120.
 Matolia, S., Guduru, G., Gottumukkala, B. and Kuna, K.K. (2020) An Investigation into the Influence of Aging and Rejuvenation on Surface Free Energy Components and Chemical Composition of Bitumen. Construction and Building Materials, 245, Article ID: 118378.
 Wei, J., Wang, H., Lin, B., Sui, T., Zhao, F. and Fang, S. (2019) Acoustic Emission Signal of Fiber-Reinforced Composite Grinding: Frequency Components and Damage Pattern Recognition. International Journal of Advanced Manufacturing Technology, 103, 1403-1404.
 Shen, B., Wang, Z., Ding, D. and Shu, H. (2013) H∞ State Estimation for Complex Networks with Uncertain Inner Coupling and Incomplete Measurements. IEEE Transactions on Neural Networks and Learning Systems, 24, 2027-2037.
 Zhang, B. and Zhuang, G. (2019) Extended Dissipative Control and Filtering for Singular Time-Delay Systems with Markovian Jumping Parameters. In: Gao, Q. and Karimi, H.R., Eds., Stability, Control and Application of Time-Delay Systems, Butterworth-Heinemann, Oxford, 227-255.
 Dragan, V, Aberkane, S. and Popa, I.L. (2018) Optimal Filtering for a Class of Linear Itô Stochastic Systems: The Dichotomic Case. Automatica, 90, 47-53.
 Chibani, A., Chadli, M., Ding, S.X. and Braiek, N.B. (2018) Design of Robust Fuzzy Fault Detection Filter for Polynomial Fuzzy Systems with New Finite Frequency Specifications. Automatica, 93, 42-54.
 Dong, H., Wang, Z., Ding, S.X. and Gao, H. (2015) Event-Based H∞ Filter Design for a Class of Nonlinear Time-Varying Systems with Fading Channels and Multiplicative Noises. IEEE Transactions on Signal Processing, 63, 3387-3395.
 Wu, Z.G., Shi, P., Su, H. and Chu, J. (2014) Asynchronous l2 - l∞ Filtering for Discrete-Time Stochastic Markov Jump Systems with Randomly Occurred Sensor Nonlinearities. Automatica, 50, 180-186.
 Zhu, Y., Zhang, L. and Basin, M.V. (2016) Nonstationary H∞ Dynamic Output Feedback Control for Discrete Time Markov Jump Linear Systems with Actuator and Sensor Saturations. International Journal of Robust and Nonlinear Control, 26, 1010-1025.
 He, S. and Liu, F. (2012) Finite-Time H∞ Fuzzy Control of Nonlinear Jump System with Time Delays via Dynamic Observer-Based State Feedback. IEEE Transactions on Fuzzy Systems, 20, 605-614.
 Shen, M., Yan, S., Zhang, G. and Park, J. (2016) Finite-Time H∞ Static Output Control of Markov Jump Systems with an Auxiliary Approach. Applied Mathematics & Computation, 273, 553-561.
 Shen, H., Jiao, S., Huo, S., Chen, M., Li, J. and Chen, B. (2017) On Energy-to-Peak Filtering for Semi-Markov Jump Singular Systems with Unideal Measurements. Signal Processing, 144, 127-133.
 Wu, Z.G., Shi, P., Su, H. and Chu, J. (2013) Stochastic Synchronization of Markovian Jump Neural Networks with Time-Varying Delay Using Sampled Data. IEEE Transactions on Cybernetics, 43, 1796-1806.
 Tang, L., Ren, Y., Fang, Z. and He, C. (2019) A Generalized Hybrid Nonconvex Variational Regularization Model for Staircase Reduction in Image Restoration. Neurocomputing, 359, 15-31.