Beruflich Dokumente
Kultur Dokumente
www.elsevier.com/locate/ces
Abstract
This paper presents an approach to analyzing robustness properties of nonlinear systems under feedback control. The core idea is
to apply numerical bifurcation analysis to the closed-loop process, using the controller/observer tuning parameters, the set points, and
parameters describing model uncertainty (parametric as well as unmodeled dynamics) as bifurcation parameters. By analyzing the Hopf
bifurcation and saddle-node bifurcation loci with respect to these parameters, bounds on the controller tuning are identied which can
serve as a measure for the robustness of the controlled system. These bounds depend upon the type as well as the degree of mismatch
that exists between the plant and the model used for controller design.
The method is illustrated by analyzing three control systems which are applied to a continuously operated stirred tank reactor: a
state feedback linearizing controller and two output feedback linearizing controllers. While model uncertainty has only a minor effect
on the tuning of the state feedback linearizing controller, this does not represent a very realistic scenario. However, when an observer
is implemented in addition to the controller and an output feedback linearizing scheme is investigated, it is found that the plant-model
mismatch has a much more profound impact on the tuning of the observer than it has on the controller tuning. In addition, two observer
designs with different level of complexity are investigated and it is found that a scheme which makes use of additional knowledge about
the system will not necessarily result in better stability properties as the level of uncertainty in the model increases. These investigations
are carried out using the robustness analysis scheme introduced in this paper.
2004 Elsevier Ltd. All rights reserved.
Keywords: Nonlinear system; Bifurcation analysis; Feedback linearizing control; Robust controller tuning
1. Introduction
Over the past few years nonlinear process control has become increasingly popular in the chemical process industries. This development is due to the trend towards specialty
products, tighter prot margins, more stringent environmental requirements, as well as advances in nonlinear systems
theory and in the numerical implementation of nonlinear
controllers (Bequette, 1991).
Many different techniques for designing controllers for
nonlinear processes have been introduced in the literature.
One of the simplest methods is to linearize the process model
and to design a linear controller of PID type for the system.
Corresponding author. Present address: Department of Chemical
Engineering,Texas A&M University, College Station, TX 77843-3122,
USA. Tel.: +1-979-845-3568; fax: +1-979-845-6446.
E-mail address: hahn@tamu.edu (J. Hahn).
0009-2509/$ - see front matter 2004 Elsevier Ltd. All rights reserved.
doi:10.1016/j.ces.2004.06.026
More complex controller design techniques take the nonlinear behavior of the process into account. This category
of methods includes feedback linearization and nonlinear
model predictive control. If an accurate model of the process is known, then controller designs that make use of additional knowledge about the process can offer performance
advantages. However, the larger the model uncertainty the
more this performance advantage will degrade, even up to
the point that the closed-loop system can become unstable.
The described scenario presents the trade-off between performance and robustness (Henson and Seborg, 1991).
This paper introduces a systematic approach to analyzing the effect of model mismatch on controller and observer
design and tuning for nonlinear systems over a region of
operation. Bifurcation analysis is applied to controlled nonlinear systems by using the controller and observer parameters, the set points of the controller, as well as parameters
4326
decades. A seminal example is the analysis of various models of the exothermic continuous stirred tank reactor (see
Uppal et al., 1974, for example). Textbooks on bifurcation
theory and bifurcation analysis by parameter continuation
exist that address the subject with various degrees of mathematical rigor (Seydel, 1994; Perko, 1996; Guckenheimer
and Holmes, 1993; Kuznetsov, 1998b). In addition, software
for bifurcation analysis by parameter continuation is available for dynamic systems of different size, most notably
auto (Doedel et al., 2000), content (Kuznetsov, 1998a), and
DIVA (Mangold et al., 2000).
Bifurcation analysis by continuation involves linearizations of generally nonlinear process models. This often
causes confusion as readers assume that linearizations inevitably imply that the analysis is local only. This section
points out how numerical bifurcation analysis by continuation can in fact be used for more than local analysis of
nonlinear systemsdespite using linearizations.
Assume that a nonlinear model of the form
x = f (x, u, p)
(1)
nu = nu + np .
(2)
(3)
(4)
where A(xss , u ss ), B(xss , u ss ) denote the nx nx dimensional and nx nu -dimensional Jacobians of f w.r.t. x
and u,
respectively, evaluated at the steady state (xss , u ss ).
Clearly, linearization (4) will only be valid for sufciently
small ||x xss || and ||u u ss ||. Note in particular that Eq.
(4) will become invalid as the input u leaves the vicinity
of u ss .
As opposed to linearizing at a steady state, numerical bifurcation analysis by continuation uses linearizations along
curves of steady states. Assume that : U R nx is a curve
of equilibria which is parameterized by one of the u i while
all remaining parameters are kept at xed values u j = u j,ss
j
= i. Without loss of generality the curve is parameterized by the rst parameter u 1 , and the remaining u 2 , ..., u nu
25
20
(5)
0 = f ((u 1 ), u 1 ).
(6)
stable
unstable
Hopf bifurcation
15
4327
10
5
0
0
0.01
0.02
0.03
0.04
0.05
Fig. 1. Result of numerical paramerter continuation in .
(8)
4328
0.6
real parts
0.4
0.2
0
-0.2
-0.4
-0.6
-0.8
-1
0.01
0.02
0.03
0.04
0.05
Fig. 2. Real parts of the eigenvalues for the steady states shown in Fig.
1. Note that two real eigenvalues exist for = 0. The two corresponding
branches merge at about = 0.003 to form a single branch. For values of
larger than roughly = 0.003 a complex conjugate pair of eigenvalues
exists. The single branch marks the common real part of this complex
conjugate pair.
1
Hopf locus
0.8
a
0.6
0.4
unstable
stable
0.2
0
0
0.01
0.02
0.03
0.04
0.05
1998b). A discussion of the state space behavior that is related to these bifurcation points is beyond the scope of the
present paper. Here it is exploited that the stability boundary of the system can be analyzed by nding the loci of
Hopf and saddle-node bifurcations with respect to u.
Note
that eigenvalues were calculated for ease of illustration only.
In fact, a numerically expensive calculation of eigenvalues
can be avoided if test functions, which signal the crossing
of a stability boundary by a change in sign, are used instead
(Beyn et al., 2002).
Just as a curve of steady states was built up by parameter
continuation, curves of Hopf and saddle-node bifurcation
points can be traced. Fig. 3 shows the result of a continuation
of either of the Hopf points in Fig. 1. The curve in Fig. 3 was
obtained by applying parameter continuation to a standard
u=
Lrf h(x)
4329
given by
1 = 2 ,
2 = 3 ,
..
.
r = Lrf h(x) + Lg Lr1
f h(x)u,
= q(, ),
y = 1 .
(11)
The map between the input and the output can be linearized
by choosing a static state feedback control law
u=
v Lrf h(x)
(12)
Lg Lr1
f h(x)
such that the rth equation of (11) becomes r = v. It is possible to place the poles of the closed-loop transfer function
for the linearized subsystem dened by Eq. (11) in the
complex plane by choosing an appropriate feedback v. However, in most cases, the precise location of the closed-loop
poles is less important than the distance of the poles from
the imaginary axis. Therefore, only one tuning parameter
which represents the time constant of the closed-loop system, is used to shape the closed-loop response in this paper.
A feedback linearizing controller in terms of the original
states is then given by
r
( r1
)
(r )
r1
1
1
Lf h(x) r1 Lf h(x) + r (ysp h(x))
.
Lg Lr1
f h(x)
(13)
When this control law is applied to the process, the closedloop transfer function between the system output y and the
set point ysp becomes
y(s)
1
=
ysp (s) (s + 1)r
(14)
Two main categories of designing controllers via feedback linearization can be identied: inputoutput linearization and state-space linearization. The presentation in this
paper will exclusively focus on the former because it is more
generally applicable and will result in a linear inputoutput
behavior of the system if no model mismatch is present.
Consider a SISO control-afne nonlinear system with n
states of the form
x = f (x) + g(x)u,
y = h(x).
u=
(9)
k = k (x) = Lk1
f h(x),
1k r
(10)
and the j = r+j (x), 1j n r correspond to the internal dynamics of the process (Isidori, 1995; Kravaris
and Kantor, 1990). The normal form of the system is then
( r+1
r )
( r+1 )
2
Lr1
f h(x) r1 Lf h(x)
Lg Lr1
f h(x)
r+1
t
( 1 )
1
r (ysp h(x)) + r+1 0 (ysp h(x)) d
Lrf h(x)
Lg Lr1
f h(x)
(15)
(16)
4330
and an observer
x)
x = f(x)
+ g(
x)u
+ K(h(
y),
y = h(x),
x = f(x,
p)
+ g(
x,
p)u
+ K(x,
p,
p)(
y y),
y = h(x,
p),
u = k(x,
p,
, ysp )
(17)
x)
Lr h(
f
( r+1
r )
( r+1 )
2
x)
x)
h(
r1
Lr1
Lf h(
f
Lg Lr1
h(x)
( r+1
1 )
r
t
1
x))+
x))
(ysp (0)h(
(y h(
d
r+1 0 sp
,
r1
Lg L h(x)
(18)
(20)
+ K(x,
p,
p)(
h(x,
p)
y),
y = h(x, p).
(21)
x,
y = h(
p).
(22)
The ODEs of Eq. (22) have the same form as the equations
to which bifurcation analysis is typically applied.
Summarizing, there are several steps involved in performing bifurcation analysis of controlled nonlinear systems:
Identify parameters p and inputs u for the open-loop process.
Choose a controller structure for the system. Additionally,
design an observer if the controller requires information
about states which cannot be measured. The output of the
controller serves as input to the system and has to be removed from the set of variables to be used for bifurcation
analysis. Instead, the inputs to the controller as well as
controller and observer tuning parameters are added as
additional variables.
Perform bifurcation analysis using parameters of the process, set points as well as controller and observer parameters.
It is important to note that the set point of the system is one of
the bifurcation parameters. Since the bifurcation parameters
can be varied over nite ranges in parameter continuation,
this implies that the analysis can be performed over an entire
operating region of the process rather than for a particular
xed value of the set point.
However, it should be pointed out that it is assumed for
this investigation that the set point is not changed with a
high frequency. This assumption results from the bifurcation
analysis which returns information about equilibrium points
of the system but not about stability under the inuence of
time-varying excitations. For a discussion of the problem
class that can be addressed with bifurcation theory-based
4331
4332
CA =
CAf CA k0 exp
CA ,
(23)
V
RT
H
E
q
k0 exp
Tf T
CA
T=
V
C p
RT
UA
+
(Tc T ).
(24)
V
C p
The values of the parameters and the nominal operating conditions for this process are shown in Table 1. The temperature of the cooling uid, Tc , can be manipulated and the
reactor temperature, T, is measured. This results in a system
consisting of two states with a single input and a single output. While manipulation of Tc may not represent the most
realistic scenario for this process, it is nevertheless chosen
since this model has been widely used for controller design
including several publications on feedback linearizing controllers (Henson and Seborg, 1997). The bifurcation diagram
of the open-loop system is shown in Fig. 4a. The equilibria
of the system consist of two stable branches and one unstable branch connecting the two stable ones. The system
400
390
Variable
Value
Variable
Value
L
100 min
E
R
8750 K
CAf
1 mol
L
k0
1
7.2 1010 min
Tf
350 K
UA
100 L
Tc
5 104 minJ K
300 K
g
1000 L
CA
0.5 mol
L
340
Cp
J
0.239 gK
J
5 104 mol
350 K
330
H
4333
Stable Branch
Unstable Branch
Limit Point
Hopf Point
380
370
T [K]
360
350
320
310
300
270
330
310
320
330
370
360
350
340
330
320
310
300
280
290
300
Tc [K]
UA
V
Cp
(26)
320
380
E
2
1 t
Vq (Tf T ) +
CHp k0 exp( RT
)CA + VU
A
Cp T + (Tsp T ) + 2 0 (Tsp T ) d
Tc = u.
310
390
(b)
300
Tc [K]
270
u=
290
400
Tsp = T [K]
has two limits points and one Hopf point. The nominal operating point dened by the parameters in Table 1 lies on
the open-loop unstable branch. When a feedback linearizing controller (either with or without observer) is designed
for this process then the unstable branch of the equilibria
is stabilized. The results for the closed-loop case and no
model uncertainty are shown in Fig. 4b. Note, that in Fig. 4
the temperature of the cooling uid Tc serves as the bifurcation parameter for the open-loop case while the set point
Tsp is varied for the closed-loop system. Since the set point
of the process is equal to the temperature of the system for
the closed-loop case, it is possible to make statements about
the stability of the system in a region of the state space by
performing bifurcation analysis in the parameter space.
280
(a)
(25)
the states
q
E
C A = (CAf CA ) k0 exp
V
R T
C A + K1 (T T ),
q
H
E
T = (Tf T )
C A
k0 exp
V
C p
R T
UA
+
(Tc T ) + K2 (T T ).
V
C p
(27)
(28)
4334
1 =
observer
2 =
1.001
observer
(29)
*f1
*f1
1 2
1
2
*f1
*x1
*x1
=
+
*
f
2
*x 2
*x1
(30)
x,u
*f1 *f2
+
K2 (x, u, 1 , 2 ) = (1 + 2 ) +
*x 1
* x2
(31)
x,u
For this investigation it will be assumed that the heat transfer coefcient UA varies by up to 10% around its nominal
value. Uncertainties in other parameters have also been investigated for the state feedback linearizing controller. They
result in similar or lesser restrictions for the controller than
the investigated case. In order to be able to present the results
in a clear and concise manner, only parametric uncertainty
of UA is considered in this work.
4.3.2. Unmodeled dynamics
Another form of model mismatch that needs to be investigated is unmodeled dynamics. Since no model can describe
every detail of a process with perfect precision, it is commonly assumed that the fast dynamics of the process can be
neglected. While this is generally a good assumption, it does
lead to a bound on the achievable closed-loop performance.
In order to investigate these restrictions, bifurcation analysis
can be performed on a system that contains the most important part of the fast dynamics while a controller that has
no knowledge about this dynamics is used to control it. For
this work, the plant model is augmented by the following
two equations which describe the actuator dynamics as an
overdamped second-order process
v Tc = Tc + z
v z = z + u
(32)
440
420
420
400
400
380
Stable Region
380
Unstable Region
360
360
Unstable Region
340
340
320
Tsp= T [K]
Tsp= T [K]
4335
320
Stable Region
300
300
280
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
[min]
5.5
6.5
7.5
8.5
9.5
280
10
[min]
4336
400
= 0.25 [min]
= 0.5 [min]
= 1 [min]
= 5 [min]
390
380
370
380
= 0.1 [min]
= 0.25 [min]
= 0.5 [min]
= 1.0 [min]
Stable Region
390
360
Unstable Region
350
340
330
370
360
350
340
330
ta
e
bl
310
ns
320
310
320
eg
R
io
n
300
300
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
observer [min]
observer [min]
Fig. 6. Hopf curves for output feedback linearizing controllers and parametric uncertainty (U
A = 1.1 UA). The results for output feedback controller A
are shown on the left and for output feedback controller B on the right.
400
400
= 0.1 [min]
= 0.25 [min]
= 0.5 [min]
= 1.0 [min]
380
380
370
370
360
= 0.25 [min]
= 0.5 [min]
= 1 [min]
= 5 [min]
350
340
330
Unstable Region
390
Unstable Region
Tsp = T [K]
Tsp = T [K]
390
360
350
340
330
320
Stable Region
320
Stable Region
310
310
300
300
0
0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.2
0.01
0.02
0.03
0.04
0.05
0.06
observer [min]
observer [min]
Fig. 7. Hopf curves for output feedback linearizing controllers and unmodeled dynamics (v = 0.02 min). The results for output feedback controller A
are shown on the left and for output feedback controller B on the right.
Table 2
Bounds on observer tuning parameter observer
Unmodeled
dynamics (min)
Parametric
uncertainty (min)
0.094
0.011
0.42
0.21
5. Conclusions
This paper presented a method for analyzing robustness of
controlled nonlinear systems. The technique is based upon
applying bifurcation analysis to the closed-loop system. The
controller and observer are designed using a nominal model
while mismatch can exist between the nominal model and the
plant. Bifurcation analysis is then used to determine limits
for the controller and observer tuning parameters when the
controller is acting on the plant.
This technique has been illustrated with a case study
where a state feedback linearizing controller was compared
Appendix A.
It has been pointed out in the paper that choosing a large
value for the controller tuning parameter will have a negative effect on stability of the closed-loop system in the presence of parametric uncertainty. The mathematical explanation for this behavior is given below.
Consider a system with n states and relative degree r
which can be transformed into a normal form given by
1 = 2 ,
2 = 3 ,
..
.
r = Lrf h(x) + Lg Lr1
f h(x)u,
= q(, ),
y = 1 .
Lrf h(x)
Lg Lr1
f h(x)
v
Lg Lr1
f h(x)
2 0 0 1 ... 0 2 0
. . . . .
. = .. .. ..
. . ... .. + ... v,
(35)
.
.
0 0 0 ... 1 0
r1
r1
1
0 0 0 ... 0
r
r
= q(, ),
y = 1 .
If v is chosen to be equal to zero, as it will be the case when
the closed-loop time constant in Eq. (13) approaches innity, then this will result in a system where all the eigenvalues of the subsystem 1 ,...,r are identical to zero. Such
a feedback law will drive the system to the stability limit.
If there exists plant-model mismatch, then the relationship
between u and y will likely not be exactly linearized and
some of the eigenvalues of the closed-loop system may lie
in the open right-half of the complex plane. Therefore, the
feedback law shown in Eq. (34) needs to have an expression
for v that places the eigenvalues of the subsystem 1 ,...,r
in the open left-half complex plane and at a sufcient distance from the imaginary axis. This can be achieved by a
feedback law of the form shown in Eq. (13) with a carefully
determined value of :
0
1
0
...
0 1
1
0
1
...
0 2
2 0
. ..
..
..
.. .
.
.
. = .
.
.
.
.
.
..
0
0
0
...
1
r1
r1
r
r
r
( r1 )
(
(
)
)
1
1
2
r
r
r r1 r2 ...
0
0
.
.
+
(36)
. ysp ,
0
1
r
= q(, ),
y = 1 .
(33)
The map between the input and the output can then be linearized by choosing the static state feedback control law (12)
u(t) =
4337
(34)
such that the rth equation of (33) becomes r = v. This feedback law consists of two parts: the rst term eliminates the
dynamic behavior of the nonlinear system while the second
term imposes the desired closed-loop behavior. This results
in the following linear inputoutput system, where rep-
4338
Kravaris, C., Kantor, J.C., 1990. Geometric methods for nonlinear process
control. 2. Controller synthesis. Industrial Engineering Chemistry
Research 29, 23102323.
Kuznetsov, Yu.A. 1998a. CONTENTIntegrated environment for
analysis of dynamical systems. Tutorial. Dynamical Systems
Laboratory, Centrum voor Wiskunde en Informatica, Amsterdam,
ftp.cwi.nl/pub/CONTENT.
Kuznetsov, Yu.A., 1998b. Elements of Applied Bifurcation Theory. 2nd
Edition. Springer, New York.
Mahmoud, M.S., Khalil, H.K., 2002. Robustness of high-gain observerbased nonlinear controllers to unmodeled actuators and sensors.
Automatica 38, 361369.
Mangold, M., Kienle, A., Gilles, E.D., Mohl, K.D., 2000.
Nonlinear computation in DIVAmethods and applications. Chemical
Engineering Science 55 (2), 441454.
Marino, R., Tomei, P., 1995. Nonlinear Control Design. Prentice-Hall,
Upper Saddle River, NJ.
Mnnigmann, M., Marquardt, W., 2002a. Bifurcation placement of Hopf
points for stabilization of equilibria. In: Proceedings of the 15th IFAC
World Congress, Barcelona, Spain.
Mnnigmann, M., Marquardt, W., 2000b. Normal vectors on manifolds
of critical points for parametric robustness of equilibrium solutions of
ODE systems. Journal of Nonlinear Science 12, 85112.
Mnnigmann, M., Marquardt, W., 2003. Steady-state process optimization
with guaranteed robust stability and feasibility. AIChE Journal 49 (12),
31103126.
Morari, M., Zariou, E., 1989. Robust Process Control. Prentice-Hall,
Upper Saddle River, NJ.
Paladino, O., Ratto, M., 2000. Robust stability and sensitivity of real
controlled CSTRs. Chemical Engineering Science 55, 321330.
Perko, L., 1996. Differential Equations and Dynamical Systems. 2nd
Edition. Springer, New York.
Recke, B., Andersen, B.R., JZrgensen, S.B., 2000. Bifurcation control of
sample chemical reaction systems. In: Proceedings of the ADCHEM
2000. Pisa, Italy, pp. 575580.
Scott, S.K., 1991. Chemical Chaos International Series of Monographs
on Chemistry. Oxford University Press, New York.
Seydel, R., 1994. Practical Bifurcation and Stability Analysis. Springer,
New York.
Uppal, A., Ray, W.H., Poore, A.B., 1974. On the dynamic behavior of
continuous stirred tank reactors. Chemical Engineering Science 29,
967985.
Vidyasagar, M., 1993. Nonlinear Systems Analysis. second ed. PrenticeHall, NJ.
Zeitz, M., 1987. The extended Luenberger observer for nonlinear systems.
Systems and Control Letters 9, 149156.
Zhang, Y.C., Zamamiri, A.M., Henson, M.A., Hjortso, M.A., 2002. Cell
population models for bifurcation analysis and nonlinear control of
continuous yeast bioreactors. Journal of Process Control 12, 721734.