Controllability and Observability in Systems
Controllability and Observability in Systems
AUTONATIC
ON CONTROL, VOL. AC-16,NO. 6, DECEMBER 1971
A b ~ t r ~ ~ tthis
- h paper we discuss the concepts of controllability,
these concepts in the now f a m i l i a r synthesis techniques
reachability,reconstructibility, and observability andattempt to for linear systems. I n fact, all of the results of this paper
show why these concepts are important in linear systems theory.
We show how the above concepts allow us to solve the existence
(if not of this issue) [Link] directly or indirectly consequences
of Kalnmn'spioneeringwork.
problem of closed-loop regulation of a linear time-invariant h i t e - [Link] who have
dimensional system. The main results related to this are [Link] in this areaareGilbert
[7] and Luenberger [SI.
4 and 5. Similar but less sharp results arealso presented for time-
varying [Link] discussion then proceeds totheprecise The concepts of controllability and observability are of
relationships that exist between input-output and state descriptions
particularimportanceinthedesign of linearfeedback
of systems. Finally, the question of equivalence of internal and
input-output stability is discussed. [Link] and linear filters for linear stationary systems
in [Link] presence of white Gaussian disturbances. It is an
import,ant fact that if the system is controllable then the
linear feedback system obtained by using the theory of
I. INTRODUCTION [Link] cost is asymptotically
stable. Similarly, if the system is [Link] the linear
T H E most [Link] aspect of modern system theory filter obtained by using Iialman filtering theory is asymp-
is undoubtedly the prevalence of [Link]-space models totically [Link]. The concepts of controllability
for dynamical [Link]. This has providedaframework
and
observability are also important in the context of mathe-
which is at the same time extremely general, offers many matica.1 model building. Indeed, although wanting to use
advantages of a. conceptual and philosophical nature, and a state-space model to carry out the [Link] task,
yields concrete and specific pract,ical results much more one often starts with an [Link] model which may
directly t,han other methodswere able to provide. have been obt,ained experimentally. I n realizing a state-
I n treating dynamical systems described by st,ate-space spacemodelwhichproduces the desired input-output
models, it wasrecognized at a veryearlystagethat, relation, one may ma,kean excellent case for requiring this
[Link] regularityassumptionson t,he modelswere of realizat,ion to beminimal;t,hatis,tobe an accurate
essentia.1 importance for thevalidity of the various representa,t,ion which does not. introduceany phenom-
synthesis and [Link] techniques which were being em- ena whichwere not, accounted for a t leastimplicitly
ployed. These assumptions originally appeared as purely in the input-output. descript,ion. It turns out nore or less
mat,hematical devices [l], [2]. However, it. was soon [Link] that [Link] minimality is intimately [Link] to
recognized that theseproperties were of importancein t,he circle of conceptsincludingcontrollabilityand ob-
their own rightandrelated to thevery possibility of servabi1it.y.
achieving the desired degree of control [Link] obtaining the The purpose of this [Link] is to introduce theconcepts of
desired information about the [Link]. These notions were controllabilit,y andobservability for linearsystems for-
hence t,ermed controllability and observability. mally. I n doing [Link] we will consider several relat,ed con-
Reference [3] appears to be the first' fundamental cepts, e.g., those of [Link],ructibility,
study of controllability (in t,he context. of finite-dimen- which are of equalimportance, but whoserelevance is
sional linea,r systems) and it is mainly the early work of not as widely [Link]. We feel, moreover, that it is
Kalman and Bucy [4]and Iialman [5] which introduced conceptuallyadvant,ageous tostartthe discussion by
considering these notions in their generality and then to
specialize to finite-dimensional linear systems.
Xanuscript received July 29, 1971. Paper recommended by R. W.
Brockett, Associat,e Guest Editor. The work of J. C. Willems was We then consider the regulatorproblemfor finite-
supportedbythe [Link] Kingdom Science Research Council. dimensional linear [Link] [Link] first prove that
The work of S. K. [Link] was supported by the Air Force Office
of [Link] under Grant AFOSR 70-1941. for such syst,ems it, is possible to 1ocat.e [Link] closed-loop
J. C. Willems was temporarily with the Department of Applied poles using st,at.e feedback if and only if [Link] system is
Mathematicsand [Link] Physics, Gniversity of Cambridge,
Cambridge,England. He is now wit.h the Decision and Control controllable. We then show that is is possible to build a
Sciences Group,ElectronicSystemsLaborat,ory, h1assachuset.t.s
Institute of Technology, Cambridge, Mass. 02139.
S. IC. Mitter is with the Decision and Control Sciences Group,
[Link] Systems Laboratory, Massachusett.s Institute of Tech- We are notimplying that thereis no simple intuitive explanation
nolog,-, Cambridge, Mass. 02139. as t.o why [Link] should be the w e . What we mean is that there does
For a [Link] account of the historical development of this area, not seem to be any a priori reason why the possibilit,y of achieving
see [6, sec. 111. control and observation isrelated tothis aspect of model building.
WILLEMS AND NITTER: CONTROLLABILITY APV'D STATE RECONSTRUCTION 583
state reconstructor (using inputandoutput measure- A dynamical system in state-space form thus views the
ments) with arbitmry error dynamics provided the sys- generation of outputs from inputsandinit,ialstatesas
tem is observable. By combining t,hese two results occurring via the mechanism of composition of the state
we are able to demonstrate that a feedback compensator evolutionmapandt,[Link]
can be designed such that the closed-loop system has any evolution map takes into consideration the memoryof the
preassigned poles provided the system is controllable and system while the output reading map is memoryless and
observable. The existence question for linear regulators is depends only on the current value of the time, the state,
thus answered. It should be pointedout that the structure and the input.
of the resulting feedback compensator [Link] is [Link] Notation: The function r(t, 4(t, to, a , u), u ( t ) ) defined
using the above theory is [Link] the [Link] as that ob- for t 2 to will for convenience be unambiguously denoted
tained by invoking the separation theorem of st,ochastic by y(tol t o , u).
optimal control for the design of linear feedback systems The most prominent example of a dynamical system in
with a quadratic [Link] [Link] and in thepresence state-spaceformis the finite-dimensional linear syst,em
of Gaussian disturbances. (FDLS) described by the [Link].ia1equation
The discussion then turns to [Link] systems,
where m-e consider the questions of stabilizabilityand 3i. = A(t)z B ( t ) u + y = C(t)x (FDLS)
state reconstructibility. We consider [Link] aspectsof n;it,h X = R", 7 i = R", and Y = RP. The [Link](t),
input-output descriptions versus state-space descriptions B(t), and C(t) are throughout assumed to have compatible
and find that minimality of the state space is equivalent dimensions [Link] (again, mainly for technical reasons) to be
to controllability (reachability) and [Link]. +
continuous and bounded on (- m , m ). It is well known
Finally wedemonst,rate theequidence of internal that the above different.ia1 equat,ion t,hen defines a dy-
Lyapunov stabi1it.y andinput-outputstability for uni- [Link] t,he senseof the abovedefinit,ion with the
formly controllable and uniformly observable 1inea.r sys- state evolution ma.p given by [Link] so-called variation of
tems. constants formula:
Pt
11. DYNAMICAL
SYSTEMS
= 4(t, to>x(to> +Jtu
40, T ) B ( 7 ) U ( T ) CET
We fist introduce the notion of a dynamical system
in state-space form. The formal definition att,empts to cap- where the transition nzutrk 4 ( t , 7)is defined as the solution
ture the essential properties of finite-dimensional smooth of the mat,rix differential equation d(t, 7) = A(t)$(t, T),
[Link], [Link] output 4 ( ~T,) = I . The transition matrixsatisfies [Link] composition
functions to be continuous functions of time. This avoids law 4(&, tl)d(tl, to) = 4(&, to). See [lo]for more details.
vaiious technical [Link] and simplifies questions re- The abovedynamicalsystemhas a veryconvenient
lated to the existence and uniqueness of solut,ions for a.dditiona1 property not, expressed by the basic axioms of
finite-dimensional linear [Link].1systems. [Link] 1; namely, the stat,e evolution map is defined
The following definition of a dynamical system is con- for all t [Link] not only for t 2 to. Such dynamical [Link]
venient for this discussion. More general concepts ma.y be said to have the group property. Most systems described
found in [9]. bypartial differential equationsanddelay differential
Let U , Y , and X be normed linear spaces, and let U, equations do not have the group pr0pert.y. Discret,e sys-
y denote the space of cont,inuous funct,ions defined on tems and even [Link] systems for n-hich the A(t)
R = (- a, a ) withvalues in U, Y , respectively. %. matrix does not satisfy the [Link] properties stated
is termed the input space, y the output space, U the set above also need not have this property.
of input values, Y the set of &put values, and X the state Of particular importance in [Link],ice are the so-called
space. stationary dynamical systems in which 4 and y commute
Let to E R and let 3 = { t E Rlt 2 t o ] . Consider the with the shift operator, i.e., if ST denotes [Link] map from
m a p s + : 3 X R X X X % + X a n d r : R X X X 17-Y % (respectively y) into itself defined by ( S T u ) ( t ) =
termed the state euolution. n m p and read-out map, respec- u(t + TI, then ST4(t, to, 20, u) = 4 ( t +
T , to +
T , 20,
tively. +
STu) (respectively, STy(tO,zo,u) = y(to T , zo, STu)).
DeJinition 1: A dymnticalsystem is a quintuple { %, [Link] finite-dimensional systems(SFDLS)
y, X , 4, r ] satisfying thefollowing axioms, for all ul, a E are described by t,he differential equation
U, XO E X, to, t1, tz E R, to 5 tl 5 h.
3i.=Ax+Bu y=Cz (SFDLS)
a ) Causality: 4(tl, to, 20,ul)= 4(tl, to, zo, uz) whenever
ul(t)= uz(t) for to 5 t 5 tl. whichcorresponds to a. systemwithtransferfunction
b ) C o n S i ~ t a ~4(to,
y : to, 2 0 , U ) = xO. matrix G(s) = C(1s - A)-lB, where s is a complex
c) Semi-group property: 4(h, to, xo, u) = variable.
4 4 2 , tl, 4@l,to, x07 4 , 4 . The state-space descript,ion of dynamical systems will
d ) Smoothness: The functions 4 and r are continuous be contrasted with the input-output description in Sec-
functions of t, t 2 to. tion VI.
584 IEEE TRANSACTIONS ON dUTOX4TIC CONTROL, DECENBER 1971
111. SONE FUND?lMENTAL PROPERTIES O F latt,er case any u will do. Any unobservableirreducible
STATE-SPACE MODELS system is thus highly unsatisfactory from the viewpoint
I n t,his section the basic concepts [Link] t.0 control- of state reconstruction. This seems to have been over-
lability, observability, [Link] Lyapunov stabi1it.y are intro- looked in t,he literature.
duced. The properties of controllabiliby and observability The analogous [Link] to reconstructing the
of a dynamical syst,em refer to the influence of the input present [Link] from past [Link] become as follow.
on the state and of the [Link] on the output, [Link] Lyapunov Definition 4: Let t o be an element of the real line. Then
stability refers totheasymptotic behavior of undriven the state of a dynamical system is said to be zero input
systems. These notions nil1 be introduced in the context, [Link] a t to if lmon-ledge of theoutput corre-
of general dynamics1 [Link] as int,roduccd in Sect,ion I1 sponding to a.n input u = 0 for t < to uniquely deternunes
and then, in the follon-ing sect,ion, specialized to finite- x0 E X . Thus the output. due to someinitial state at
LC
dimensional linear syst,ems. t-1 = - m " is observed and t,he present state x. is to be
The fist series of definit,ions refers t.0 possible [Link] reconstructed. The stateof a dynamical [Link] said to be
in the statespace which may result. from [Link] inputs. reconstructible a.t to if orall u E U, knowledge of the
The concept of [Link] refers t.o t,ransferring an output for t I to uniquely determines .xo E X.
[Link] init,ial st,at,et.0 a desired trajectory. This desired Note that connectedness implies reachability and con-
[Link],ory is often an equilibrium point. R e nil1 assume trollability,and [Link]. observability implies zero-input
[Link] t,o be the case and take the zero element, t.0 represent observabilit.y, which in turn implies irreducibility. These
this equilibrium. not,ions arein genera1 notequivalent unless, as will
Assumptian: It mill be assumed that for all to E 2, be shon-n in the nextsection, the system is linear and
+(t, to, 0, 0) = 0 for t 2 to and r(to,O, 0) = 0. finit.e dimensional. The simplest. example of a nonlinear
D e J n i t i m 2: Let t o be an element of [Link] real line. The system for which this equivalence does not hold is the
state space of a dynamical system is said to be wachable [Link] R = A 5 u; y = Cx,n-here x E R", u E R, and
a t if, given any m E X,there exists a L 1 5 to and a u E u y E RP, and the matrices A and C [Link] compatible. It
such [Link] X = +(to, t-1, 0, u).A dynanlical system is mid should also benoted [ll] t,hat [Link], control-
to be controllable a.t to if, given a,ny mo E X, there exists labilit.y, connectedness, observabilit,y,irreducibility, and
a tl 2 to [Link] a I L E U such that +(tl, to, xo, u) = 0. The reconstructibility [Link] preserved under
(out,put.) feed-
siate space of a dynamical system is said t.0 be connected back, butthat zero-input observabi1it.y and zero-input
if, given any .xo, X I E X , there exist to 5 tl and a u E U reconstructibilit,y are in general not unless the system is
such [Link] +(&,to, zo, u) = 21. [Link] linearandfinite dimensional. If asystem is not
Observabilit,y refers to the possibility of reconstructing irreducible, then there exist tn-o initial states such t,hat
the stat,e from output measurements. As remarkedby t,he out,put to any input will be the same on the interval
Iialman et al. in [9], there are however two separate state [to, ). These two [Link] are thus compleOely indistinguish-
[Link] problems which one should consider. One able under experimentation a,nd the [Link] space may thus
refers to [Link] the [Link], output, be reduced by eliminatingone of these two states from t,he
observahions and t,he other refers to deducing the present state space. Note that although the observability defini-
[Link],efrom futureoutput observat,ions. It, is the first tions ask for the [Link] of the init,ial st,at.e,this is
property which is essential in filtering. There is also equivalenttoreconstructing the [Link],e on the whole
the question of what happens to t,he inputs in thisprocess. interval [to, m ). It. may in fact bemore logical to demand
Fortunately t,his is of no consequence for linear systems, this in the verydefinitions.
but for nonlinear systemsoneshould dist,inguish t,hree It should be remarked t,hat the abovedefinitions might
cases, depending on u-hether the input, is a priori known, not be appropriate for certain applications. In particular,
is arbitrarily assigned, or may be selected in [Link] cxperi- for distributed parameter systems i t issometimesmore
[Link] lea.& us to consider the folloxving series of convenient to make definit,ions of controllability which
definitions around the theme of deducing [Link] [Link] from require that, every state can be driven arbitmrily close
output observations. to theorigin rat,herthan exactly to it.
DeJinition 3: Let to E R. A dynamical system is said t,o It is importantfor many applications to have somewhat
be zero input observable a t to if knodedge of the output stronger cont,rollability and observability properties than
y(f0, xo, 0) for t >_ to uniquely determines x,,.A dynamical merely t,hose implied by the basic [Link]. These are
system is said to be obseraable a t t o if for all xa E X and now int,roduced. With linear [Link] mind \?.-e nil1
u E U lmon-ledge of the observed output y(to, mo, u ) for norm the input and output, [Link] by means of an LAype
f 2 to determines x. uniquely. The state space of a dy- norm.
namical system is said to be irreducible a t t o if for all x0 E Dejinition 5: -4dynamical systemis said to be unifolmly
X there exists a. u E % such that knowledge of the out,put controllable if there exists a T > 0 and acontinuous
y(to, xo,u)for t 2 touniquely determines .co. function au:R + R such that for all x0 E X and t o E R
The difference between irreducibility and observability [Link] exists a u E % with fi$Tllu(t) l u2 dt 5 a(IIroll) such
is t,hat in the former case the u which yields t,he initial +
t,hat +(to T,to,xo,u) = 0. The statespace of a dynamical
state x. may be a function of xo itself, u-hereas in the system is said to be uniformly reachable if t,here exists a
AKD WILLEMS NITTER: CONTROLLABILITY
RECONSTRUCTION
-4ND STA4TE 585
function p : R
x1 E X and to E R
-
observable if there exists a T > 0 and a monotone increasing into V I which [Link] (v2, Lal)r.72
R witlbhp(0) = 0 such that, for a.11 20, v1 E VI and u:! E Vz. The adjoint is linear and uniquely
= {L*vz, E ~ ) for
~ , all
of X, denot,ed byS'-, is defined as S'- = {v E Vl(v, s) = 0 [Link] st,ate x. at to and the control u ( t ) satisfies
for all s E 8 ) . If S is a closed subspace(and t,hw in
particular if X is finite dimensional) t,hen V = S @ SI; y(t) - Jtc(t)+(t,
r ) u ( r )dr = C(t)+(t, t0)zo Hz0
i.e., any elenlent v E V has a unique decomposition into to
+
v = XI x2 with X I E S and xz E SI. Let L be a linear where to I t I tl.
operator from VI into V z wit,h V I and V 2 inner product It is immediately clear from the above t,hat the finit,e-
spaces. Thenthe null space X ( L ) and the rangespace dimensional linearsystem (FDLS) is [Link] at to
R(L) of L are [Link] of V I and V z , defined re-
spectively by [Link] F:Czm(to,tl) -
in some finite time interval [to, t l ] <fm z d ody i f the linear
R" is onto R" and is observable
586 IEEE TRANSACTIONS ON AUT~XATIC CONTROL, DECEMBER 1971
in [Link] interval [to, t l ] if and only i';f the linear operator if for some T > 0 there exist.s an el > 0 such t,hat W (to,
H:R" 4 CZp(tO,t 1 ) is oneone on R". Consequently lo + T ) 2 QI for all ta E R; it isuniformlyobservable
controllabi1it.y on [to, t l ] requirest>hat, @(F) = R" and (uniformly reconstructible) if and only if for some T >
observability on [to, t l ] requires that. Z ( H ) = ( 0 ) . Thesr 0 there exists an e2 > 0 such that. J P ( t 0 , t o +
T ) 2 gI for
characterizationsare, however, somen-hat, unsatisfactory all to E R.
in the sense t,hat, they require knowledge of the range [Link] that, in vim- of the [Link] [Link]
space [Link] null space of operators defined from or into on A ( t ) , uniform cont>rollability is equivalent, to the exis-
infinit>e-dimensional spaces. If one considers Lemma 1, tence for some T > 0 of [Link] 1, 2 > 0 and M I , iif2
it becomes appa,rent, t,hat. these [Link] can be st-ated such that
asrequiring, [Link], that @(FF*) = R" and X-
(H*H) = ( 0 ) . Since, however, FF* and H*H b0t.h map
0 5 EJ 5 TV(t0, to + T ) 5 Jf1l
p
Similarly, if L2:R"
=
to associate controllabilit,y propertieswith observabilit.). A represent,at,ive feature of the response of this closed-loop
properties of the nmthematical adjoint, one would have to system is given by t,he location of its poles, i.e., by [Link]
int,roduce t,he concept, of a dynamical syshem which runs zeros of det ( I s - A +
B K ) . The question t>hm arises of
backwards in time or reverse t,he time direct>ionof [Link] ad- under wha.t condihions is it possible t.0 assign the poles of a
joint and consider the dynamical system t,hus obtained. dgnamicalsystemarbit,rarilybysuitablychoosing the
Thus one associates with the system feedback gainmatrix K . More precisely, given an arbitrary
d = A(t)Z +
B(t)u, y = C(t);t: polynomial
- -
I n view of the above remarks it is now- very simple to
I n t,he multi-input case the first results in this direction
prove t,he following correspondences between a. dynamical
are due to Langenhop [16] and Popov [l'i1. They proved
syst,em and it.s dual: cont,rollability a t to reconstructi-
t,hat, given an arbitrary polynomial ~ ( s with ) coefficients
bilit,y at. to, and reachabilityat to observability at to.
in [Link] field of real or complex numbers?there exists a
Remark: Any finite-dimensional linear dynamical system
may be decomposed into four subsystems: (1) a. control-
[Link] K (possibly complex)such [Link] det. ( I s - A +
B K ) = ~ ( s if) and only if the system is controllable. The
lableandobservablesubsyst,em; (2) a. subsystemwhich
proof given by Popov [17] makes interesting use of Kal-
is controllable but not observable; (3) a subsyst,em which
man's canonical structure theorem and is different, from
is observable but not controllable; and finally, 4) a, sub-
Langenhop's. W-onham [18] gave a different proof and fur-
system which is neit,her controllable nor [Link]
ther shorn-ed that, if the polynomial has coefficients in the
is Kalman's canonica.1 structure theorem (see the paper by
field of rea.1 numbers, then t,he matrix K can be chosen to
Silverman, this issue).
be real. In our cont,ext, Wonham's appears to be the first
complete proof. ,4 different proof and [Link] for pole
V. ALLOCATION, STATERECOXSTRUCTIOX,
POLE AKD
assignment was presented bp Simon andMitter [19]
CLOSED-LOOP REGULATION
and Simon [34]. The proof given inthispaper uses a
The following questions about, t,he control of dynanlical lemma due to Heymann [20]. The lemma also appears in
systems are of fundamental [Link] in [Link],ical Popov [31, p. 261, proposition 2, appendix A].
systemtheory-how to: 1) designa state feedbacklaw Theorem 4: There exists a [Link] X n matrix L such that
which [Link] t,he closed-loop response; 2) design a det (Is - A - BL) = s" + T,-~s"-' + +
. . . ro for
[Link] reconst,ructor, i.e., asystemwhichdeduces t,he arbit,rary real coefficients {yo, .rl, . . , rn-l ] if and o d y if
current state from past observations of the output; and the system 2 = A x + Bu is controllable; i.e., if and only
588 IEEE TRdNSACTIONS ON AUTO5L4TIC CONTROL, DECEMBER 1971
k! = ( A - HC)e. B = AX + Bu
y = cx
A possible criterion for the quality of the [Link],e recon-
[Link]
are the eigenvalues of t,he matrix governing the i = A? + Bu - H ( $ - y)
error equation, i.e., the zeros det (Is - A + H C ) . The
jj = CP
question thus arises of under what conditions on A and C
can
one
make the zeros of det (Is - A + H C ) arbitrary u = -KP.
by appropriately choosing H . This questionis precisely
Written in terms of x and e = f - x, this closed-loop
the dual of the pole-allocation question, and this observa-
dyna.mica1system may be m i t t e n as
tion immediately leads to the follouing theorem.
Theorem 5: There exists an (n X p ) matrix H such that 3i: = ( A - BK)x - BKe
the error dymmicsof t-he state reconstructor aregoverned
I! ( A - HC)e
by b = ( A - HC)e where e = P - x vith det ( I s - A + =
H C ) = an + ,rn-lsn-l + +
. . TO for arbitraryreal or
coefficients TO, TI, . . . , rn-l] if and only if [Link] system 3i: =
Ax + Bu, y = Cx is reconstructible (observable); i.e., if )
dt e
= (A -0BK -BK
A - H C >(>.e
[Link] only if the (np X n) matrix [Link] . . : (A)+lC]
is of full rank n. The above representation shows that the poles of the
+
Proof: Since i = A z Bu, y = Cz is reconstructible, closed-loop system are the zeros of det (Is - A BK) +
i = Az + Cv is controllable. Hence H may be chosen det (Is - A +
H C ) and may hence be allocated at will
such [Link] det (Is - A + CH) is preassigned. Since det by choosing K and H if and only if the system (SFDLS)
(Is - A + CH) = det. ( I s - A + H C ) , the result. is both controllable and reconstructible(observable) ;
follo\vs. i.e., if and only if t,he (nm X n) and ( n p X n) matrices
Remmk: The above state reconst,ruct>orissometimes [Link] . . : A - B ]and [C:ACi . . . : (A)-C] have
called a n obsewer. It suffers from one [Link] draw- full rank n.
back; namely, that, in reconstructing the state from the One may of course replace the stat.e reconstructor in
- [Link].s y x e ignore the fact. [Link],Jve lmou- y = Cx exactly t,his compensator by a Luenberger observer. This in fact
- andthusthat it. would be logical t.0 choose 2 such that yields a simpler design n-hich specializes to the state feed-
C2 = y. I n [Link] words, rather than estimating the whole back case.
[Link] x, i t suffces to estimate the components of z in the The stat.e feedback regulator, [Link] state reconstructor,
null space of C. This problem has been studied by Luen- and [Link] [Link] feedback regulator are shown in Fig. 1.
berger [SI lvho showed that thereexists a. stat.e reconstruc- Rwlzark: Thestructure of t,he [Link] compensator
tor of order (n - p ) n-hose [Link] in combination n-ith the shown in Fig. 1 is precisely the same as t,hat obtained by
observed output results in an errorvector which has p invoking the separat,ion theorem of stochastic control and
components identically zero and whose (72 - p ) remaining designing the feedback compensator for a linear system
components are governed by a st,[Link] linear dynamical \tilth Gaussian dist,urbances on the basis of deterministic
system of order ( n - p ) with preassigned eigenvalues of its optimal cont,rol theory for a quadratic cost and Kalman
system matxix. For a more complete account of this see filtering theory.
Wonham ~ 2 2 1 .
The regulator design based on pole allocation explained VI. STABILIZABILITY A h 9 STATE RECONSTRUCT~BILITY
in [Link] first p u t of this sectmionis based on exact, knowledge FOR TIME-VARYING SYSTEMS
of all the [Link]. For technological reasons i t is often very It was shoqn in Section I11 that the control
difficult, and inefficient to measure the complete [Link].e
u(t) = -B(f)$(to, t)W-l(t,, t&O, to 5tI11
vector, and one only has access to the out,put formeasure-
ments. The question thus a,rises [Link] i t is possible to will t,ransfert,he state of acontrollablelinear finite-
use the above ideas to design a compensator which has dimensional syst,em from state x0 at time to to state 0 at
as its input the output, of the [Link] to be controlled. A time tl. [Link] in a feedback form, this would lead
logical and intuitive procedure in [Link] such an out,- to the feedback control law
put compensator is to separate the task of stat,e recon- u = -B(t)W-l(t, t1)s
st,[Link] and feedbackregulationby first designing a
&ate reconstructor and then using [Link] estimated value of which, since limt,t,lIW-l(t, 51)11 = 00, calk for unbounded
the state (instead of t,he act.ua1value of the [Link]) in the feedback [Link]. This is not, surprising since i t amounts to
feedbackcontroller. Thisapproachis aprelude to t,he driving a linear system to zero in finite time. The problem
separation [Link] for stochadc optima.1 control. I n tmhe [Link] arises as to whether it is possible to design a con-
present, context. it, shouldbe considered as a reasonable [Link] bounded feedback cont.ro1 law which makes the
first approach to the design of an output feedback cont,roller. closed-loop system exponentially stable. It will be shown
Using [Link] idea we obtainthe follon-ing closed-loop that. under suitable cont,rollability assumptions this is in-
dynamical system: deed possible.
WILLENS AND MITTER: CONTROLLABILITY AND STATE RECONSTRUCTION 59 1
Y
. In choosing the correction input r in a feedback form it
should be realized that one has incomplet,e information of
e in that only x and Cx are known. Assume, however, that
r ischosen to be the dual of the feedback contxol lam
considered in thebeginning of this section,i.e.,
r = -&I-l(t, to)C(t)e = M - l ( t , to)(y - 9).
This correction signal is admissible sinceit only dependson
whichissuch
k! = (A(t)- M-l(t, to)C(f))e
that e(to) = 0. This state reconstructor,
however, asks for unboundedgains and will beunac-
I I ceptable in most situations. By dualizing Theorem 6 one
obtains a procedure for designing a st,ate reconstructor for
which the error [Link] zero at anexponential rate.
Theorem 7: Assume that the system(FDLS) is uni-
formly observable. Thenthere exists abounded con-
tinuous matrixH ( t ) such that thesyst,em
I
I I
I
i = A(t)2 + B(t)u - H(t)($ - y)
(C)
Consider6 now the subset U+of U defined as dynamical systems in state-spaceform inthat these
axioms donot a,llow for systemswitha t,ime-varying
U+ = { u E +(t) = o for t I to, some to E R } stat.e [Link]. For most, applications this inconsistency is of
and assume that + is similarly defined. Consider now a no consequence, but in order to obt,ain in a simple manner
mapping F from %+ int.0 y+. Then F is said to be [Link] an abst>ract solution to the minimal realization problem
on %+ if UI, u2 E %+ with ul(t) = ~ ( t for ) t 5 to implies fortime-varying [Link], this problem proves to bea
that (Ful)(t) = (Fu2)(t)for t 5 to. [Link] block. This difficulty maybe overcome bya
Dejinitim 8: A dynamica.1system in [Link] form suit,able modification of the [Link] of dynamica.1systems.
is a map from U+into y+xhich iscausal on %+. The input-outputdynamicalsystem which will be
The problem of realization is to construct a dynamical studied in this paper is described by a. Volterra integral
system in stat,e-spa,ceform such that it generates the same [Link] w(t, T) be a ( p X nz) matrix defined and
input-out,[Link] as the dynamicalsystemininput- continuous for t 2 7, and consider the input-output
output form. The question thusreduces to constructing an system defined with U = R" and Y = R P as follows.
appropriate stat,e-space X and suitable maps4 and I'. Consider u E %+ [Link] let to be such that u ( t ) = 0 for
The problem of realizationistrivially solved if one f 5 to. Then
requires no additional properties of the state-space model.
Indeed let X denote the set of all continuous Lr-valued
functionson [O, m ) which [Link] for sufficiently large
values of theirargument. Consider now adynamical
system in input-output form and let us [Link] [Link] state This system \vi11 in short, be denoted by y = Wu.
space a t t,ime t t o be the element of X svhich [Link] The next- section is concerned Tvith the realization of a
z(s) = u ( t - s) for t 2 0. This element of X will indeed system (LS) by means of a [Link] (FDLS).
quaIify for a st,at,e since, in trying to satisfy the require-
mentthat,thestate should summarize the essential VIII. ~IININAL REALIZATIONS OF LIKEARSYSTEMS
feat,ures about [Link] past input, we in fact. decided to store The question of state-space realizations of the system
the complete pastinput. It isinfact [Link] (LS) has been actively investigated in recent times, par-
[ll] to induce the appropriate state [Link] map and ticularly as a result of [Link] work of Iialman, Youla, and
readout. map to go along with this choice of t,he state. This Silverman. The present, section is devoted to one special
shows t,hat every input.-output dynamical [Link] has a. aspect, of this problem, namely, the relationship of mini-
state-space [Link] and yields a rather [Link],ing ma1it.y and controllability and obsenrability. The full
decomposit,ion of a dynamical system intoa. linear [Link]- implications and the algorithmic [Link] related to [Link]
axy [Link] dynamical part and a memoryless part. Of realization theory may be found in [Link] by Silverman
course one can essentially never expect this system to be in t,hisissue.
observable. This realization is indeed ext,remely inefficient. It is clear that. theinput.-output. system (LS)is realized
A much more interestingrealizationis t,he minimal by the state-space model (FDLS) if and onby if w ( f , 7) =
realizat,ion for which the stat,e-space X has as feu- elements C(t)+(l,T ) B ( Tfor ) all t 2 T. Furthermore the system ( I S )
as possible. This realizat,ionis always reachable and has a finite-dimensional linear realizabion (FDLS) if and
irreducible. It is logical to consider as the state at. time t only if there exist continuous [Link] G [Link] H such t,hat
the equivalence class of inputs up to time t which yield w(t, 7) = H ( ~ ) G ( Tfort ) 2 T.
the same output [Link] t,ime t, no matter how these inputs D e j i n i f i m 9: Assume [Link] t,he state-spacemodel (FDLS)
are continuedafter [Link] t. I n other words, theinputs is a realizat,ion of the input-output syst,em (LS). Then itis
UI E 21 and u2 E % will result. in the same stat.e at time t saidto be a minimal realizatimz of (IS) if every other
if any V I , u 2 E % with v1(s) = u1(s) and zlz(s) = u2(s) for realization of t,he [Link](FDLS) has a state space of greatw
s I t and v l ( s ) = v2(s) for s 2 t yield [Link] ( K 1 ) ( t ) = or equal dimension.
(Fv2)(t) for t > s. One may then proceed t.o induce the It is importantt.0 note that minimality of the realization
maps 4 and T from there. Thisrealization procedure works does not preclude the existence of nonlinear [Link]
well for [Link] difficulty withtime- realizations with a lower dimensional state space. I n [Link],
varying systemsarises from the fact [Link] the above such lower dimensional (indeed, [Link])nonlinear
equivalence class idea will result in a state space which is realizations will always exist.. It sufFIces, therefore, to
itself time varying. This difficu1t.y is basically a conse- consider space-flling curves which map R" o n e o n e a,nd
quence of a deficiency in the axiomaticframework for ont,o R. I n order to ensure that every finite-dimensional
realization requires a state space of a dimension at. least
that of the minima.1(linear) realization, one has t.0 require
some smoothness on the maps4 and T .
There is no real need to restrict [Link] t o %+.The difficulty
withinputs which extend t.0 - is that is is usually difficult to One may expect from the discussion in Section VI11 that
prove well-posedness of typical mathematical models. This problem the problem of constructing a minimal realization will (at
is completely avoided by considering % + as the class of admissible
inputs. least in principle) be simple for stationary [Link], but
WILLEMS AND NITTER: CONTROLLABILITY AND STATE RECONSTRUCTION 593
ill cause some difEculties for timevarying systems. We Proof: Let G(u) = e-AuB, u 2 0, H ( t ) = CeAt,
will thus consider the stationarycase first. t 2 0, [Link] let the operators G and H be as defined in the
Theorem 9: The linear system (LS) is realizable by a proof of Theorem 9. Sinceminimalityisequivalent to
state-space model (SFDLS) if and only if: 1) t,he kernel R(G) = R" (= reachability)and N ( H ) = { O ] ( = ob-
w(t, T ) isseparable, i.e., t,hereexist mat,rices H and G servability) the first [Link] of the theorem follows. Exist,ence
such that H(t)G(7) = w(t, T ) for t 2 T ; and 2) w(t, T ) = of a minimal realizationfollows from the proof of Theorem
w(t - 7,0). 9 and the similarity transformation follows since in every
Proof: The "only if" part of t-he theorem is obvious. minimal realization the st,ate space must, beisomorphic
To prove the "if" part we need to ident,ify a triplet of (in [Link] vector space sense) to the quotient. [Link] @(G)/
matrices A , B, C such that C 8 ' B = w(t, 0) for t 2 0. x(H).
We will first identify the state space. Let. %- be the Therealization [Link] for stationary 1inea.r systems
functions in % restricted to (- 03, 01 andlet y+ be thus presents inprinciple no difficulties. The time-va,rying
t,he functions in y restrided to [0, a).Consider now t,he case is much more involyed, however. Indeed assume [Link]
mapping from X- to y+defined by w(t, 7) = H(t)G(7) [which is a necessary condition for a
realization (FDLS) to exist,],[Link] let G, and HT be defined
y(t) = S_Onw(t, T)U(T) d7, t 20 as GTu = j?,G(u)u(u) d u and H,z = H ( t ) x for t 2 T .
It is then natural t.0 consider X , = R(GT)/N(HT) as the
stat,e space at time T and t,o define the maps 4 and P
and denote this mapping by y+ = W+[Link] w(t, T ) = from [Link]. There is, however,one basic difficulty with
H ( ~ ) G ( T )W, + maybe viewed ast,he composition W + this idea, namely X , is in general an explicit function of
= HG with G :U + Rqa n d H :Rq3 y+ defined by Gu = T , and in ordert.0 account for this it, becomes necessary to
~ ' ! , G ( T ) u ( T )d r and H z = H ( t ) x , t 2 0, where q denot,es start from a new axiomatic framework for t,reat,ing
[Link] number of rows of G (= [Link] number of columns of H ) . dynamicalsystems. A second difficu1t.y is [Link].t even if
Consider now [Link] quotient, [Link] X = a ( G ) / X ( H ) .This is X , is always a subspaceof, say, R", it may not, be possible
clearly a finite-dimensional (sayn-dimensional)vector to construct an n-dimensionalrealization exhibit,ing [Link]
space. required smoothness for [Link] parameters A(t), B(t), C(t).
We d l now ident,ify the A matrix. To do [Link], observe This sit,[Link] by trying tJo obt,ain a. one-
that the space X qualifies as a st,ate space byviewing the dimensionalrealization of the system & = bl(t)u, & =
[Link] a.t.t = T corresponding to the input u E % as the +
b2(t)u.,g = cl(t)zl c2(t)z2with bl(t) = cl(t) = 0 for t 2
element in R ( G ) / N ( H ) corresponding to u., E %+ wit,h 0 and bz(t) = ~ ( f )= 0 for t 5 0. Thus, [Link] reach-
+
u,(t) = u(T t ) for t 5 0. It is an easy matterto formalize abilityandobservabilityat some timeare [Link]
the linear maps 4 [Link] r associat,ed with this choice of t,he sufficient conditions for minimality, they are not neces-
state space. Let 4(t)zo, t 2 0, be the zero-input, response sary.
result,ing from z(0) = xo. Then 4(t) is an (n X n.) matrix Thereis, however, another (somewhat, artificial) pro-
which satisfies 4(0) = I and 4(tl)4(tz) = 4(tl +
tz) for cedure for achievingacertainamount of structural
tl, t 2 >_ 0. Thus +(t) = ea'for some matxix A . inva,riance for timevarying systems. This procedureis
The matrix C is then t,he linear mapping form R" into based on considering ant,i-causal systems in association
RP which [Link] x. into y(0). To [Link] the B mat,rix, with the causal syst,ems considered so far. This requires
notice [Link], by properly redefining G and H we may assume [Link] state [Link] t o possess thegroup propert,y
t,hat H ( t ) = CeALand x0 = j?,G(u)u(u) du. Then B = and the input-output maps to be defined as a causal map
G(0) [Link] w(t, 0) = H(t)G(O) = Ce"'B for t >_ 0, when timerunsin t,he usua.1 fonvard direct,ion and an
which shows that w(t, U ) = Ce"(lPu)B for t 2 u and t,hat the anticausal map when time runs bacltrmrd. The sta.t.e of a
triplet { A , B , C) isindeedarealization. Notmicet,hat state-space [Link] of such an input-output dynamical
this realization is in facta minimal one. system is this alternatively required to summarize past
Extensions [Link] more details of the ideas invoked in the and future inputs. This thenyields the required invariance
proof of t,he above theorem may be found in [6] and [Link] properties.
paper by Silverman in t,his issue. This device has been successfully applied to dynanlical
The following theorem is a.n immedia.t,e consequence of systems described by
the proof of Theorem 9 and yields the desired [Link]-
ship between [Link] and reachability-observability.
[Link] IO: A realization A , B , C is minimal if and
only if the system 2 = Ax +Bu; y = Cz is observable for t 2 t o when t runs forn-ard and for t 5 t o when t runs
a,nd has a [Link] [Link] [Link]-dimensional [Link] arethen re-
realization always exists and a,ny two minimal realizations quired t.0 sat,isfy the equalit,y w(t, 7) = C(t)4(t, T ) B ( T )
A I , B1, C1 and A*, B2,C2 are related via. the similarity for all t, T E R. In [Link] may in fact prove that a
t,ransformation A2 = TAT-I, B2 = TBI, C2 = CIT-l realiza,t,ionis minimal if [Link] only if [Link] [Link] syst,em is
for some invertible matrixT . reachable and observable at some time. These notions are
594 I E E E TRANSACTIONS O N AUTOMATIC CONTROL, DECEMBER 1971
1EEE Trans. Automat. Contr. vol. AC-11, pp. 190-195, Apr. pp.
nn 296-313, 1aca
san-si 2 1969.
1966. [361 S. K. Mitter and R. Foulkes, Controllability and pole assign-
[36]
R. E. Kalman, P. L. Falb, and ?VI. A. Arbib, Topics in Maihe- mentfordiscrete time linear [Link] defined over [Link]
matical System Theory. New York: McGraw-Hill, 1969. fields, SIAM J . Confr., vol. 9, pp. 1-7, 19il.
R. W . Brockett, FiniteDimensionalL,inearSystems. New
York: Wiley, 1970.
J. C. Willems, The generation of Lyapunov functionsfor
input-output stable systems, SIAM J . Contr., vol. 9, pp. 105-
134, 1971. ~-~
~~ -i -
~~~=%--L==- Sanjoy K. Mitter (h.168) received the [Link].
J. L. Willems, StabilityTheory of DynamicalSystems. New ===Z (Eng.) degree, the A.C.G.I. degree in elec-
York: Wiley, 1970. -~ t,rical engineering in 1957, andthePh.D.
P. K. Halmos, FinzteDimensionalVectorSpaces. Princeton, degree inautomatic control in 1965, all
N. J.: Van Nostrand, 1958. fromtheImuerial College of Science and
L. M . Silverman, andH. E. Meadows, Cont,rollabilit.y and
observability in
time-variable linear systems, S I A X J . Technology, University OF London, London,
Contr., vol. 5, no. 1, pp. 64-73, 1967. England.
X. Chang, An algebraiccharacterization of controllabilit.y, FromSeptember195itoFebruary 1961
I E E E [Link]. (Corresp.), vol. AC-10, pp. he worked onresearch and development of
112-113, Jan. 1965. [Link] telemetering and telecontrolsystems
C. E. Langenhop, On the [Link] of linear [Link], a t Brown Boveri 8: Co., Ltd., Baden,Switzer-
Proc. Amer. 3lath. SOC.,vol. 15(5), pp. 735-742, 1964. land, and from February 1961 to [Link] 1962, on computer control
F. AI. Popov,Hyperstabilit,y andoptimality of automatic of processes a t BattelleInstitute,Geneva, Swit,zerland. From
system with several control functions, Ret.. Rounz. Sei. Tech.,
Ser. Electrotech. Energ., vol. 9, no. 4,pp. 629-690, 1964. October 1962 to August 1965 he was a Central Electricity Generating
Ar. M. Wonham, On pole assignment. in multi-input. control- Board Research Fellow in the Electrical Engineering Department of
lable linear [Link],!IEEE Trans. Automat. Conlr., vol. AC12, Imperial College, Universit.y of London. I n 1965 he joined the
pp. 660-665, Dec. 1967. Systems Research CenterandSystems Engineering Division of
J. I). Simon and S. K. [Link], A theory of modal control, Case Western Reserve Fnivemity, Cleveland, Ohio, where he was
Injorm. Contr., vol. 13, pp. 316-353, 1968. an Associate Professor until 1970. During the academic year 1969-
hi. Heymann, Comment.s on pole assignment in n1nlt.i-input 1970 he was Visiting Ass0ciat.e Professorin theDepartment of
controllable linear systems, [Link]. Electrical
Engineering, Massachusett,s Institute of Technology,
(Corresp.), vol. X - 1 3 , pp. 748-749, Dec. 1968.
[Link], On the control of multiple input-output sys- Cambridge, where he is currently an Associate Professor. He was a
tems, in Conf. Rec. 2nd Asilomar Conf. Circuits and systems, [Link], wit,h the Cleveland Illuminating Company,Cleveland,
1968. Ohio, from 1966 to 1970. He has contributed to the literature on
IV. hI. Wonham, Dynamic [Link] theory, control and system theory.
I E E E [Link]. (Corresp.), vol. AC-15, pp. Dr. [Link] was theChairman of the Technical Committee on
258-259, Apr. 1970. Computational [Link], I)[Link] Systems of [Link] Information
1,. Weiss, and R. E. Kalman, Contributions t o linear system Dissemination Committee of theIEEEGroup on Automatic
[Link], Int. J . Eng. Sci., vol. 3, pp. 141-lil, 1965. Control.
D. C. Youla, The [Link] of linear dynamical systems from
prescribed weighting patterns, STAX J . -4ppZ. M&., vol. 14,
--~
nn 527-549
==. ,
1966
[25] C. 8 . ?[Link] and P. P. Varaiya, The minimal realization of a
nonanttclpabive impulse response [Link], S I A X J . A p p l .
Mafh., vol. 15, pp. 754-764, 1967. Jan C. Willems (S66-3168) was bornin
[26] J. C. Willems, The Analysis of Feedback Systems. Cambridge, Bmges, Belgium, in 1939. H e graduated in
Mass.: X.I.T. Press, 1971. electrical and mechanicalengineering from
[27] C. A . Desoer and A . J. Thomasian, X n0t.e on zero-stat.e the University of Ghent., Belgium,in 1963,
[Link] of linear systems, PTOC. 1st Allerton C o n f . Circuit and received the M.S. degree in electrical engi-
System Theory, 1963, .pp. 50-52. neering from the Universit.y of Rhode Island,
[28] L. [Link] and B. I>. 0. Anderson, [Link], [Link], in 1965, and the Ph.l). degree in
obaervability and stability of linear systems, S I A X J . electrical engineering from the Massachusetts
Contr., vol. 6, pp. 121-130, 1968.
1291 W. A . Wolovich. On the stabilization of controllable svstems. Institute of Technology, Cambridge, in
I E E E Trans. Automat. Contr. (ShortPapers), vol:AC-13, 1968.
pp. 569-5i2, Oct,. 1968. H e is currently an AssistantProfessor in
R. X. Brockett., System [Link] on group manifolds and
~~
the Department of Electrical Engineering, M.I.T. His area of main
coset spaces, to be published, interest is [Link] control. He is the author of The Analysis of
P . h,I. Popov, [Link] sistemelov aut,omate, Feedback Systems (M.I.T. Press, 1971). During 19iO and 1971 he
Editura. dcademii Republici SociidisteRomania (Bucharest), was with the Department of Applied [Link] and Theoret.ia1
1966. Physics, University of Cambridge, Cambridge, England.
H.H. Rosenbrock, StateSpace and Alfu!ticariabk Theory.
Appleton, Wis.: Nelson, 1970. Dr. Willenls is presently Chairman of t,he Stabilit,y, Eonlinear
F. R. Gantmacher, The Theory of Xatrices, vol. 1. New York: Systems,Dist,ributed SystemsCommittee of theIEEE Control
Chelsea, 1959. Systenls Society.