Asynchronous dissipative control for networked time-delay Markov jump systems with event-triggered scheme and packet dropouts

This paper is concerned with asynchronous dissipative control for a class of networked time-delay Markov jump systems with event-triggered scheme and packet dropouts. To reduce communication consumption, an event-triggered transmission scheme is introduced. The phenomenon of packet dropout during the communication between the controller and the actuator is described by the Bernoulli model. The designed dissipative controller is asynchronous with the physical plant, which is described by a hidden Markov model. Based on a mode-dependent Lyapunov–Krasovskii function, a sufficient condition for the closed-loop control system to be stochastically stable and strictly (μ,ϑ,υ)-γ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\mu ,\vartheta ,\upsilon ){-}\gamma$$\end{document}-dissipative is obtained. Furthermore, the design of dissipative controller is simplified by using matrix scaling and slack matrix techniques. Finally, a robotic arm system is used as an example to verify the effectiveness of our proposed design method.

With the combination of computer technology, communication technology and control theory, networked control systems (NCSs) are developing rapidly due to the advantages of less wiring, high reliability and information sharing. However, the introduction of network also produces some new issues, e.g., time delay and packet dropouts. To solving these problems, a variety of approaches have been proposed [9][10][11][12][13][14][15][16][17]. In the case of packet dropouts, the works [9][10][11] investigated the fuzzy control of nonlinear MJSs, the H ∞ filtering of networked nonlinear discrete-time systems and the output feedback control of NCSs, respectively. As for the study of networked MJSs with time delay [12][13][14][15][16], the issue of state estimation based on sliding mode observer was addressed [13]. The stability of delayed MJSs with infinite states was analyzed, and a sufficient condition for the mean square stability of the system was given in the form of linear matrix inequalities (LMIs) [15].
On the other hand, issues like time delay and packet dropouts will lead to inadequate information transmission between different nodes. In MJSs, inadequate information transmission will inevitably cause asynchronous phenomenon. However, in most of the available works [18][19][20][21][22], it is assumed that the controller is mode-independent or perfectly synchronous with the physical plant. The former ignores mode information, which is simple in structure and easy to implement, but causes a great deal of conservatism. The latter needs the controller to obtain the mode information accurately and timely, which is difficult to achieve in practical systems. Recently, the asynchronous problem of MJSs has attracted more and more attention. The main asynchronous modeling approaches include time-delay model [23], piecewise homogeneous Markov chain model [24] and hidden Markov model (HMM) [25][26][27][28][29]. Based on HMM, an asynchronous state feedback H ∞ controller for time-delay MJSs was designed [26], and the asynchronous output tracking control with incomplete premise matching for T-S fuzzy MJSs was investigated [29]. In addition, dissipative theory has been studied for a long time, which means that the storage of energy is less than the supply of energy; that is, there is energy dissipation in the system. In recent years, scholars have conducted a lot of research on dissipative control [12,[30][31][32]. Based on dissipative theory, the stability of sampled-data MJSs was studied [30], and the problem of sliding mode control for nonlinear MJSs with external disturbances was investigated [31]. For incremental dissipative control for nonlinear stochastic MJSs, by using incremental Hamilton-Jacobi inequalities, the sufficient conditions for the random incremental dissipative property of nonlinear stochastic MJSs were given [32]. However, the current research on asynchronous dissipative control of MJSs is still insufficient, which is one of the motives of this work.
It is noted that the data transmission in the above works is based on periodictriggered scheme, and the sampling and transmission of system signals are in a fixed period, which can easily lead to network congestion, packet dropouts and other problems. However, the event-triggered scheme has been considered as an efficient method to overcome these obstacles [33][34][35]. The event-triggered scheme indicates that the system signals determine whether to transmit or not depending on the eventtriggered criterion, which can reduce the communication consumption effectively. The event-triggered risk-sensitive state estimation problem for HMMs was studied; by using the reference probability measure method, the estimation problem is transformed into an equivalent estimation problem and solved [36]. In order to solve the issue of the event-triggered self-adaptive control for random nonlinear MJSs, two self-adaptive controllers with fixed threshold scheme and relative threshold scheme were proposed [37]. Moreover, an event-triggered output feedback control strategy was proposed for networked MJSs with partially unknown transition probabilities [38], and an event-triggered sliding mode control strategy was considered for discrete-time MJSs [39]. Nevertheless, there are few works about dissipative asynchronous control of time-delay MJSs with event-triggered scheme and packet dropouts, which is another motive of this work.
This paper focuses on the design of asynchronous dissipative controller for networked time-delay MJSs with event-triggered scheme and packet dropouts. The main contributions of this paper are as follows: 1. Compared with the literature [26], this paper considers not only the varying delay of the physical plant, but also the network-induced communication constraints such as limited bandwidth and packet dropouts, which is more practical.
2. The asynchronous dissipative control scheme proposed in this paper provides a unified framework, in which the asynchronous strategy based on HMM contains two special cases: mode independence and synchronization, which are studied most in the existing literature; at the same time, the dissipative control problem also includes H ∞ control and passive control.
The remaining structure of this paper is as follows: Sect. 2.1 gives the problem description and system modeling. In Sect. 2.2, a sufficient condition for the closedloop control system to be stochastically stable and strictly dissipative is obtained. A controller design method is given in Sect. 2.3. A simulation example and results and discussion are provided in Sect. 3. Section 4 draws the conclusion.

Problem description
This work focuses on the design of the asynchronous dissipative controller for networked time-delay MJSs with packet dropouts under the event-triggered scheme, as shown in Fig. 1. Consider the networked time-delay MJSs as follows: where x k ∈ R n x , χ k 0 , y k ∈ R n y , u k ∈ R n u , w k ∈ R n w (w k ∈ l[0, ∞) ) denote the system state, the system initial state, the controlled output, the control input and the disturbance input, respectively. There exists time delay d k ∈ N + in the system (1) with the upper bound d 1 and the lower bound are the given real matrices with appropriate dimensions. The Markov jump process of system (1) is controlled by the mode parameter ∂ k ( ∂ k ∈ S , S = {1, 2, · · · , s} ) and complies with the transition probability matrix (TPM) ϒ = [π pq ] , in which the transition probability(TP) π pq is defined as follows: obviously, π pq ∈ [0, 1] and s q=1 π pq = 1 for ∀p, q ∈ S. Considering the limited bandwidth and energy in the system, we will introduce an event-trigger to reduce the transmission rate of sampling signals and relieve the communication pressure. The event-triggered mechanism is as follows: The sampling signal is transmitted to the controller only when the event-triggered condition is satisfied. Then according to (3), we can obtain Remark 1 Owing to the introduction of the event-triggered transmission scheme, the sampling signal does not need to be transmitted periodically, thus gaining the aim of reducing the data transmission frequency. In addition, we introduce a performance index of data transmission performance DTP = t S /t T × 100% to represent the communication performance [40], in which t S and t T indicate the transmission times of sampled data with and without the event-triggered mechanism, respectively.
Based on the output of the trigger (4), we will adopt the following asynchronous controller: where K σ k represents the controller gain, and σ k is the mode of the controller. The mode ∂ k of system (1) affects the mode σ k of the controller through the conditional transition matrix(CPM) � = [θ pj ] , and its conditional transition (CP) θ pj is described as follows [41]: (1) which denotes the controller works in mode j when the system (1) is in mode p, in which θ pj ∈ [0, 1] and s j=1 θ pj = 1 for ∀p, j ∈ S.

Remark 2
The controller and the physical plant (1) are mode asynchronous, and the asynchronous relationship is described by an HMM, which can well describe the asynchronization and connection between the controller and the plant through CPM. The controller's mode is influenced by the plant's mode, and their asynchronous level is reflected by the CPs. In addition, the asynchronous controller under the HMM scheme is more general, which covers both synchronous (i.e., =I ) and mode-independent (i.e., σ k ∈ {1} ) cases [42].
Considering that there exists network between the controller and the actuator, packet dropouts are inevitable. A Bernoulli stochastic process is used in this work to describe the packet dropout process: where β k denotes the Bernoulli process with and satisfies Furthermore, to facilitate subsequent derivations. Defining β k = β k − β , we obtain For the convenience of expression, let ∂ k = p , ∂ k+1 = q and σ k = j . According to (1), (4) and (7), we can obtain the following closed-loop dynamic system: Next, some important lemmas and definitions are introduced to facilitate the work of this paper. Definition 2.1 [43] The system (11) is stochastically stable, if w k ≡ 0 and for any initial condition (x 0 , ∂ 0 ) , satisfying Definition 2.2 [43] Given a constant γ > 0 , matrices µ ≤ 0 , ϑ and symmetric υ , the closed-loop system (11) is considered to be strictly (µ, ϑ, υ) − γ −dissipative, for any positive integer N, when w k ∈ l[0, ∞) and under 0 initial condition, satisfying

Stability and dissipativity analysis of the system
This section will derive a sufficient condition to ensure that the system (11) is stochastically stable and strictly (µ, ϑ, υ) − γ −dissipative.

Theorem 2.1 The system (11) is stochastically stable and strictly
which implies Then, using Schur complement to (21) and (20) again, we have wherē Next, choose the mode-dependent Lyapunov-Krasovskii function as follows: Denoting ∇V k as the forward differential of V k , Then, figure out E{∇V 1k } and E{∇V 2k } where " ≤ " is obtained from (27) and (28).
Accordingly, We know that ̟ < 0 from (16); hence, which conforms to definition 2.1; namely, the stochastic stability of the system (11) is proved.
Remark 3 A sufficient condition for stochastic stability and strict dissipativity is derived for the system (11) in Theorem 2.1. However, in terms of existing nonlinear term in Theorem 2.1, we cannot parameterize the controller gain directly by conditions (16) and (17); therefore, further linearization is required.

Design of the event-triggered asynchronous controller
This section will provide a design method for an event-triggered asynchronous controller and further determine the controller gains.
Theorem 2. 2 The system (11) is stochastically stable and strictly (µ, ϑ, υ) − γ −dissipative, if there exist matrices K j ∈ R n u ×n x , V ∈ R n x ×n x , positive matrices P p ∈ R n x ×n x , R pj ∈ R n x ×n x , Q ∈ R n x ×n x and a positive diagonal matrix Ḡ pj ∈ R n u ×n u , for ∀p, j ∈ S , satisfying where W pj = A p V + βB 1pKj A dp V D 1p βB 1pKj 0 βB 1pKj 0 0βB 1pKj 0 , C * pj = C p V + βB 2pKj , C dp = C dp V , P = diag{−P 1 , −P 2 , · · · , −P s }. and the controller gain K j can be determined by where V is an invertible slack matrix. Applying a congruence conversion to (36) by diag{P p , I, · · · , I} , one has where J p = [ θ p1 I · · · θ pj I · · · θ ps I] . Then, (40) is equivalent to (16).
I} , and applying a congruence conversion to (43) by , we can get where By employing Schur complement to (44), we get (17), and the proof is accomplished.

Remark 4
In Theorem 2.1, it is difficult to compute the controller gain due to the nonlinear term. Thus, we introduce the slack matrix V in Theorem 2.2 and transform the nonlinear problem into LMIs by using matrix scaling and slack matrix techniques.
Remark 5 Based on dissipative theory, the larger γ implies, the better dissipative performance. We can obtain the optimal performance γ * by solving a convex optimization problem as follows: Moreover, it is noted that the dissipative performance also includes two special performances: (1) H ∞ : let µ = −I, ϑ = 0, υ = (γ 2 + γ )I in (37).

Remark 6
Compared with the literature [26], although the same asynchronization method is introduced in this work, there are great differences in the issues of interest, the data transmission mechanism and the system performance. The work [26] mainly considered the H ∞ control of MJSs with time delay and quantization. However, we consider not only the time delay, but also the packet dropouts between the controller and the actuator. Considering the limited communication resources, we also introduce an event-triggered mechanism to reduce communication consumption. In addition, the dissipative control we consider is more general, which covers both H ∞ control and passive control. In particular, due to the introduction of event-triggered mechanism and packet dropouts, the technical derivation of the design method in this work is more complex.

Experimental results and discussion
In this section, a 4-mode robotic arm system [45] will be used to verify the validity of this design method, and the corresponding parameters are as follows:  Based on the feasible solution obtained above, we assume that the initial state x 0 = 0.3 0.2 T and disturbance input w k = 0.9 k cos(k) . Then, a simulation is carried out with the proposed event-triggered asynchronous controller. The simulation results are shown in Figs. 2, 3 and 4. It can be observed that the system state, output and control input tend to be stable gradually from Fig. 2; namely, the system is stochastically stable. Furthermore, we can find from Fig. 3 that the amount of data transmission has decreased significantly. Figure 4 shows the modes of the controller and the plant, which are asynchronous. Then, we will examine the event-triggered performance by changing the threshold δ . Based on Theorem 2.2, the simulation results are obtained in Table 1. It is easy to observe that as δ increases, the optimal control performance decreases slightly, while DTP is greatly improved. Therefore, we can choose a relatively appropriate δ to effectively reduce the data transmission rate on the premise that the system has satisfying dissipative performance. Then, we will discuss the impact of different packet dropout rates on system performance. As shown in Table 2, we can find that when β =1 which   stands for no packet dropout, the control performance of the system is the best. With the increase of packet dropout rate, the control performance becomes worse.
Next, we will investigate three control performances (i.e., dissipative performance, H ∞ performance and passive performance) under different CPMs: synchronous, weakly asynchronous, strongly asynchronous and completely asynchronous cases. The corresponding CPMs are as follows: Furthermore, the parameters (µ, ϑ, υ) for three different performances are presented in Table 3. The optimal performance γ * obtained by solving LMIs in Theorem 2.2 is shown in Table 4. We know that the smaller γ * means, the worse dissipative performance, while the better H ∞ performance and passive performance [46]. Transparently, the higher the asynchronous level between the physical plant and the controller is, the worse the control performance we obtain.

Conclusions
In this paper, the dissipative asynchronous control issue has been investigated for networked time-delay MJSs with event-triggered scheme and packet dropouts. An event-triggered strategy has been introduced to reduce the communication pressure, and an HHM has been used to describe the asynchronization between the controller and the physical plant. By using Lyapunov-Krasovskii function and dissipative theory, and combining slack matrix and matrix scaling techniques, a controller design method has been obtained. Finally, an example of robotic arm system has been taken to illustrate the effectiveness of our obtained approach. The relationship between dissipative performance, data transmission performance and event-triggered threshold has also been discussed. In the future, it will be worthy of our further investigation on the asynchronous control for networked