Fault detection for a class of Markov jump systems with unknown disturbances

Shuping HE , Fei LIU

Front. Electr. Electron. Eng. ›› 2009, Vol. 4 ›› Issue (1) : 60 -65.

PDF (175KB)
Front. Electr. Electron. Eng. ›› 2009, Vol. 4 ›› Issue (1) : 60 -65. DOI: 10.1007/s11460-009-0011-4
RESEARCH ARTICLE
RESEARCH ARTICLE

Fault detection for a class of Markov jump systems with unknown disturbances

Author information +
History +
PDF (175KB)

Abstract

An optimized fault detection observer is designed for a class of Markov jump systems with unknown disturbances. By reconstructing the system, the residual error dynamic characteristics of unknown input and fault signals, including unknown disturbances and modeling error are obtained. The energy norm indexes of disturbance and fault signals of the residual error are selected separately to reflect the restraint of disturbance and the sensitivity of faults, and the design of the fault detection observer is described as an optimization problem. By using the constructed Lyapunov function and linear matrix inequalities, a sufficient condition that the solution to the fault detection observer exists is given and proved, and an optimized design approach is presented. The designed observer makes the systems have stochastic stability and better capability of restraining disturbances, and the given norm index is satisfied. Simulation results demonstrate that the proposed observer can detect the faults sensitively, and the influence of unknown disturbance on residual error can be restrained to a given range.

Keywords

Markov jump systems / fault detection / optimized observer / stochastic stability / linear matrix inequalities

Cite this article

Download citation ▾
Shuping HE, Fei LIU. Fault detection for a class of Markov jump systems with unknown disturbances. Front. Electr. Electron. Eng., 2009, 4(1): 60-65 DOI:10.1007/s11460-009-0011-4

登录浏览全文

4963

注册一个新账户 忘记密码

Introduction

A lot of dynamical systems are highly relevant to processes whose parameters are subject to random abrupt changes because of, for example, sudden environment changes, subsystem switching, system noises, failures occurring in components or interconnections and executor’s faults, etc. Markov jump systems (MJSs) are a special class of hybrid systems that involve both time-evolving and event-driven mechanisms, and can be employed to model the above system phenomenon. In MJSs, the dynamics of the jump modes and continuous states are respectively modeled by finite state Markov chains and differential equations. Each operation mode refers to some dynamics and the corresponding mode transitions from one to another are governed by the Markov process as well. The existing results about MJSs cover a large variety of problems such as stochastic stability [1,2], stochastic H control [3], filtering problem [4] and references therein. Compared with these, however, very few literatures [5] consider the fault detection problems for MJSs.

In this article, the authors discuss the fault detection problem for a class of MJSs with unknown norm-bounded disturbances. With the aid of the related fault detection theory of linear system [69], the augmented dynamic system is remodeled and an optimized observer is constructed. By using the constructed Lyapunov function and linear matrix inequalities (LMIs), a sufficient condition that the solution to the fault detection observer exists is given and proved, and an optimized design approach is presented.

System description

Consider a class of linear MJSs over the space (Ω, F, P) by

{x ˙(t)=A(rt)x(t)+B(rt)u(t)+Bf(rt)f(t)+Bd(rt)d(t),y(t)=C(rt)x(t)+Dd(rt)d(t)+Df(rt)f(t),x(t)=x0,rt=r0,t=0,
where x(t)Rn is the state, u(t)Rm is the control input, y(t)Rl is the measured output, f(t)Rp is the additional fault signals, d(t)L2q[0,+) is the unknown inputs, including unknown disturbances and noises. x0, r0 are respectively the initial state and mode. A(rt), B(rt), Bd(rt), Bf(rt), C(rt), Dd(rt), Df(rt) are known mode-dependent constant matrices with appropriate dimensions. Let the random form process {rt,t0} be the Markov stochastic process taking values on a finite set Μ={1,2,...,N} with transition rate matrix Π={πij}, i,jM, and define the following transition probability from mode i at time t to mode j at time t+Δt as

Pij=Pr{rt+Δt=j|rt=i}={πijΔt+o(Δt),ij,1+πiiΔt+ο(Δt),i=j,
with transition probability rates πij0 for i, jM,ij andj=1,jiΝπij=-πii, where Δt>0 and limΔt0ο(Δt)/Δt=0.

For notational simplicity, when rt=i, iM,A(rt) , B(rt), Bd(rt), Bf(rt), C(rt), Dd(rt) and Df(rt) are respectively denoted asAi, Bi, Bdi, Bfi, Ci, Ddi andDfi. For the sake of clarity, MJSs (1) are assumed to be stochastically stable, (Ci, Ai) is assumed to be observable and Bfi is a full rank matrix.

<Label>Definition 1</Label> The MJSs (2) (setting u(t), f(t),d(t)0) are said to be stochastically stable, if for any initial x0 and mode r0, the following relation holds:

limTE{0Tx(t, x0, r0)2dt|x0, r0}<,
where E{} denotes the mathematics statistical expectation of the stochastic process or vector.

<Label>Definition 2</Label> In the Euclidean space {Rn×M×R+}, the authors introduce the stochastic Lyapunov function of system (2) as V(x(t), rt=i, t>0)=V(x, i), the weak infinitesimal operator of which satisfies

ΓV(x, i)=limΔt01Δt{E{V(x(t+Δt), rt+Δt, t+Δt)}-V(x(t), i, t)}.

In general, for model-based fault detection, the remaining important task is the evaluation of the generated residual. Furthermore, the evaluation of the generated residual includes residual evaluation function, choosing an appropriate threshold and fault detection logic.

As to MJSs (1), the authors set up the following full-rank fault detection observer:

{x^ ˙(t)=Aix^(t)+Hi[y(t)-y^(t)],y^(t)=Cix^(t),
where x^(t) and y^(t) are the estimated state and output, and Hi is the observer gain to be designed. For further analysis, the authors first introduce the state estimate error ϵ(t)=x(t)-x^(t) and the output error γ(t)=y(t)-y^(t). Here, γ(t) is selected as the residual signal because it is undetectable, and then the following residual generator can be obtained:

γ=y(t)-Cix^(t)=Ciϵ+Dfif+Ddid,
which describes the influences of additional faults and unknown disturbances to the system residual. For convenience, the robustness of disturbances to residual is denoted as γd and the sensitivity of faults to residual as γf. Similarly, the influence of disturbances and faults on estimate errors is denoted as ϵd and ϵf respectively.

Thus, the overall dynamic observer systems can then be presented according to systems (5) and (1):

{ϵ ˙=A ¯iϵ+B ¯fif+B ¯did,γ=Ciϵ+Dfif+Ddid,
where A ¯i=Ai-HiCi, B ¯fi=Bfi-HiDfi, B ¯di=Bdi-HiDdi.

<Label>Lemma 1</Label> [6] The MJSs (1) are said to be asymptotically stable if there exists a set of mode-dependent symmetric positive-definite matrices Pi, iM, such that

Ξi=A ¯iTPi+PiA ¯i+j=1NπijPj<0.

To minimize the effects of disturbances on the residual, the fault detection problem is formulated in the case f=0 to design the observer parameter Hi such that the dynamic error system (7) is stochastically stable and for all non-zero dL2[0, ),

E{ 0 tγdTγddt}r12E{ 0 tdTddt} |f=0.

Condition (9) gives the method of minimizing the effects of disturbances on the residual and the next target is to make the difference between the residual and the disturbances as small as possible.

Similarly, the authors introduce another performance index that can be described as designing the observer parameter Hi such that the dynamic error system (7) is stochastically stable and for all non-zero f(t)L2[0, ),

E{0tγdTγddt}r22E{0tfTfdt} |d=0.

Condition (10) gives the schemes of enhancing the effects of faults on the residual and then the difference between the residual and the faults is made as large as possible.

According to the above analysis, in the process of robust fault detection, it is expected that the effect of the robust fault detection observer will make the unknown inputs as small as possible while the fault signal should be large. To detect the faults, a widely adopted approach is used to choose an appropriate threshold Jth and determine the evaluation function f(γ).

Assume d2Δd, and then the threshold Jth can be set based on the unknown disturbances:

Jth=supdL2,f=0E{ 0 tγTγdt}=r12Δd.

Therefore, the following logic can be made for the fault detection:

{f(γ)={E0tγTγdt}>Jthwith fault,f(γ)={E0tγTγdt}Jthfault-free,
where (0, t] is the finite-time window. The evaluation time window t is limited because the evaluation of residual signal over the whole time range is impractical.

Condition (9) represents the worst-case criterion for the effect of disturbances on the residuals, while condition (10) stands for the worst-case criterion for the sensitivity of residuals to faults. Both provide a directly quantitative measure for robustness and sensitivity of fault detection. Generally speaking, to get the appropriate fault detection observer that reflects the restraining of disturbances on residuals and sensitivity of the increase of faults to residuals, the gain matrix Hi should satisfy condition (9) and condition (10) simultaneously. Therefore, to achieve the optimal trade-off between the robustness against disturbances and the sensitivity to faults, the fault detection observer design problem for stochastic MJSs (1) can be formulated to find Hi such that the dynamic error system (7) is stochastically stable under zero initial conditions and satisfies

Je=r1/r2.

Observer analysis and design of jump system

<Label>Theorem 1</Label> Considering MJSs (1), the dynamic error system (7) is almost asymptotically stable and satisfies condition (9), if there exists a set of mode-dependent symmetric positive-definite matrices Pi>0 and mode-dependent matrix H ¯i such that the following relation holds:

[Ξi+CiTCiPiB ¯di+CiTDdiB ¯diTPi+DdiTCi-r12I+DdiTDdi]<0,
or

[AiTPi+PiAi+j=1NπijPj+CiTCi-CiTH ¯iT-H ¯iCiPiBdi+CiTDdi-H ¯iDdiBdiTPi+DdiTCi-DdiTH ¯iT-r12I+DdiTDdi]<0.

<Label>Proof</Label> For given mode-dependent symmetric positive-definite matricesPiRn×n, iM, considering system (7), the Lyapunov function is defined as V(ϵd, i)=ϵdTPiϵd0.

Let f=0. Equation (7) is equivalent to

{ϵ ˙d=A ¯iϵd+B ¯did,γd=Ciϵd+Ddid.

From Definition 2, it follows that

ΓV(ϵd, i)=ϵdTΞiϵd+dTB ¯diTPiϵd+ϵdTPiB ¯did.

By integrating Eq. (17) between 0 to t, the following can be obtained:

E{0tΓV(ϵd, i)dt}=E{V(ϵd, i)}-V(ϵ0,i0).

In zero initial condition, considering the Dynkin formula, E{0tΓV(ϵd, i)dt}=E{V(ϵd, i)}can be obtained. By combing Eq. (9) and definingJ1=E{0tγdTγddt}-r12{E0tdTddt}, the following relation can be obtained by putting γd=Ciϵd+Ddid into J1:

J1+E{V(ϵd, i)}=E{0t[γdTγd-r12dTd+ΓV(ϵd,i)]dt}=E{0t{ϵdT[Ξi+CiTCi]ϵd+ϵdT[PiB ¯di+CiTDdi]d+dT[B ¯diTPi+DdiTCi]ϵd+dT[-r12I+DdiTDdi]d}dt}.

By applying Schur complements, the following can be obtained:

J1+E{V(ϵd, i)}=E0t{(ϵdT, dT)×[Ξi+CiTCiPiB ¯di+CiTDdiB ¯diTPi+DdiTCi-r12I+DdiTDdi]×(ϵdd)}dt.

Thus, J10can be guaranteed by matrix inequality (14) or (15). Without considering unknown disturbances, i.e., d=0, ΓV(ϵd, i)<0 will reduce to Ξi<0. In terms of inequality (10), the augmented system (7) is asymptotically stochastically stable according to Lemma 1. This completes the proof.

<Label>Theorem 2</Label> Considering MJSs (1), the dynamic error system (7) is almost asymptotically stable and satisfies condition (10), if there exists a set of mode-dependent symmetric positive-definite matrices Pi>0 and mode-dependent matrix H ¯isuch that the following relation holds:

[Ξi-CiTCiPiB ¯fi-CiTDfiB ¯fiTPi-DfiTCir22I-DfiTDfi]<0,
or,

[AiTPi+PiAi+j=1NπijPj-CiTCi-CiTH ¯iT-H ¯iCiCiTDfi+H ¯iDfi-PiBfiDfiTCi+DfiTH ¯iT-BfiTPir22I-DfiTDfi]<0.

<Label>Proof</Label> For given mode-dependent symmetric positive-definite matrices PiRn×n, iM, considering system (7), the Lyapunov function is defined as V(ϵf, i)=ϵfTPiϵf0.

Let d=0. Equation (7) is equivalent to

{ϵ ˙f=A ¯iϵf+B ¯fif,γf=Ciϵf+Dfif.

By defining J2=E{0tγfTγfdt}-r22E{0tfTfdt} and following the similar proof in Theorem 1, matrix inequalities (21) and (22) can be acquired. This completes the proof.

For MJSs (1) without jump parameters, Theorems 1 and 2 reduce to the main results of linear time-invariant system [6].

<Label>Theorem 3</Label> Considering MJSs (1), the dynamic error system (7) is almost asymptotically stochastically stable and satisfies condition (13), if there exists a set of mode-dependent symmetric positive-definite matrices Pi>0 and mode-dependent matrix Hi=Pi-1H ¯i such that matrix inequalities (14) and (21) hold or matrix inequalities (15) and (22) hold for r2>r1>0.

According to the above Theorems, the design algorithm of the optimized observer can be summarized as follows:

1) Obtain r1min, r2max by solving Theorem 1 and Theorem 2, respectively.

2) Let r2=r2max. If r11=r1min and r2 are feasible for LMIs (15) and (22), the optimized Hi=Pi-1H ¯i can be obtained. Otherwise, denote r1i=r1(i-1)+η1, i=1,2,...,r2i=r2(i-1)-η2, i=1,2,..., where η1>0, η2>0 are sufficient small scalars and i,i=1,2,..., is the ith iteration. With the new r1i and r2i , minimize J1e that is subject to LMIs (15) and (22) to test the feasibility. Repeat the operation until J1e=mini=1,2,...(r1i/r2i), and calculate the solution r1, r2, Pi, andHi=Pi-1H ¯i.

3) Let r1=r1min. If r21=r2max and r1 are feasible for LMIs Eqs. (15) and (22), the optimized Hi=Pi-1H ¯i can be obtained. Otherwise, denote r2i=r2(i-1)-ξ1, i=1,2,...,r1i=r1(i-1)+ξ2, i=1,2,..., whereξ1>0, ξ2>0 are sufficient small scalars and i=1,2,, is the ith iteration. With the new r1i and r2i , minimize J2e that is subject to LMIs Eqs. (15) and (22) to test the feasibility. Repeat the operation untilJ2e=mini=1,2,...(r1i/r2i), and calculate the solution, r1, r2, Pi and Hi=Pi-1H ¯i.

4) Choose the corresponding matrices r1, r2, Pi and Hi=Pi-1H ¯i that correspond to Jmin=min{J1e, J2e} in the above steps 1), 2) and 3), by which the optimized observer can be obtained. By setting appropriate parameters, the numeral simulation for the optimized observer demonstration will be described in Sect. 4.

Numeral example

Consider a class of continuous uncertain MJSs (2) with parameters given by

Mode 1:

A1=[25-2-3],B1=[0.40.2],C1=[11],Bf1=[4.32.8],Df1=[2.2],Bd1=[0.20.4],Dd1=[0.5];

Mode 2:

A2=[-5-13-1],B2=[0.50.5],C2=[11],Bf2=[-3.62.1],Df2=[2.2],Bd2=[0.50.5],Dd2=[0.4].

And the transition rate matrix is defined by
Π=[-221-1].
By solving LMIs (15) and (22), r1min=0.25and r2max=2.19 can be obtained. From the optimal algorithm formulated in Sect. 3, the optimal scalars will ber1=0.92, r2=1.48, thus the mode-dependent optimized observer gain matrices are as follows:

H1=[1.47711.1297],H2=[-1.03850.9960].

Assume external reference input is the unit step signal with 1 V, and the fault signal is a square wave signal with unit amplitude (1 V) that occurs from the 8th second to the 12th second. The unknown disturbance is a random white noise sequence with variance 0.05, as shown in Fig. 1. The system mode, residual signal and residual evaluation function are shown in Figs. 2, 3 and 4 respectively.

It can be seen from Fig. 4 that Jth=r12Δd=2.54 when assuming Δd=3.0 V. It can be concluded that, when t=9.1 s,f(γ)=E{0tγTγdt}=2.75>Jth. Thus, the faults that appear will be detected 1.1 s later after the faults happen.

Conclusions

Based on the norm theory, the authors design an optimized observer for a class of MJSs with unknown disturbances. By selecting the appropriate performance index, a sufficient condition that the solution to the fault detection observer exists is given and proved, and an optimized design approach is presented. Simulation results demonstrate the effectiveness of the developed approaches.

References

[1]

Feng X, Loparo K A, Ji Y, Chizeck H J. Stochastic stability properties of jump linear systems. IEEE Transactions on Automatic Control, 1992, 37(1): 38–53

[2]

Ji Y, Chizeck H J. Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control. IEEE Transactions on Automatic Control, 1990, 35(7): 777–788

[3]

De Farias D P, Geromel J C, Do Val J B R, Costa O L V. Output feedback control of Markov jump linear systems in continuous-time. IEEE Transactions on Automatic Control, 2000, 45(5): 944–949

[4]

Liu F. Robust L2–L filtering for uncertain jump systems. Control and Decision, 2005, 20(1): 32–35 (in Chinese)

[5]

Zhong M, Ye H, Shi P, Wang G. Fault detection for Markovian jump systems. In: IEE Proceedings - Control Theory and Applications, 2005, 152(4): 397–402

[6]

Peng T, Gui W H, Steven X D, Wu M, Li H. An LMI based H-/H optimal design approach for fault detection observer. Journal of Central South University (Science and Technology), 2004, 35(4): 628–631(in Chinese)

[7]

Chen J, Patton R J. Robust Model-Based Fault Diagnosis for Dynamic Systems. Boston: Kluwer Academic Publishers, 1999

[8]

Frank P M, Ding X. Survey of robust residual generation and evaluation methods in observer-based fault detection systems. Journal of Process Control, 1997, 7(6): 403–424

[9]

Zhong M Y, Ding S X, Lam J, Wang H. An LMI approach to design robust fault detection filter for uncertain LTI systems. Automatica, 2003, 39(3): 543–550

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag Berlin Heidelberg

AI Summary AI Mindmap
PDF (175KB)

925

Accesses

0

Citation

Detail

Sections
Recommended

AI思维导图

/