Beruflich Dokumente
Kultur Dokumente
CONVERGENCE OF A RECONSTRUCTION
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
Received by the editors January 14, 1991; accepted for publication (in revised form) April 30,
1991. This research was carried out at Rice University as part of the author’s doctoral thesis. Partial
support was given by Air Force Office of Scientific Research grant AFOSR-89-0363.
Institute for Mathematics and its Applications, University of Minnesota, Minneapolis, Min-
nesota 55455.
442
CONVERGENCE OF A RECONSTRUCTION METHOD 443
regularity (smoothness) of the forward map. Regularity estimates for the forward map
have been obtained previously, for example by Calder6n [5], but are not applicable in
this case. Our regularity estimates are deferred to 5.
Finally, we must mention that due to the regularization of the problem, the
convergence of the least-square minimization method proved here does not imply the
successful reconstruction of the original conductivity. As yet, nothing is known about
the accuracy of the reconstruction obtained in this way.
2. A minimization problem. In this section we formulate the inverse conduc-
tivity problem as a regularized least-squares minimization problem, prove that the
minimization problem has a solution, and show that the solution satisfies certain
smoothness bounds. First, we introduce the inverse conductivity problem.
The steady-state flow of electricity through an isotropically conductive material
in a bounded region D C ]R’, n _> 2 is modelled by the elliptic equation
(1) V. (7Vu) 0 in ft.
,
potential in.
The coefficient 7, a bounded measurable scalar function with 7(x) >_ a > 0 in
represents the electrical conductivity of the material. The function u is the voltage
The vector 7Vu represents current flow.
We assume that has a smooth boundary 0. Equation (1) along with the
Neumann boundary condition
Ou
pET)CL2(,)
444 DAVID C. DOBSON
Isaacson, and Newell [12] that in the presence of bounded measurement errors, the
"best" currents fs are the eigenfunctions of the difference operator A A#. It is also
pointed out in [12] that the eigenvalues decay very rapidly so that little information
can be gained from most currents fs.
If {fs} is a complete orthonormal set in 2(0), we have
where I]" I]HS denotes the Hilbert-Schmidt norm over L2(0). It can be verified that
A A is a Hilbert-Schmidt operator for a suitable class 7) [10].
Problem (5) has the right structure for solution by Newton-like methods but still
suffers from linear instability. We will construct a regularization term that stabilizes
the problem and also facilitates regularity estimates that will be important later.
To simplify notation, we henceforth approximate the sum in (5) with a single
boundary measurement. We emphasize that all of the following holds with any finite
sum approximating (5). Furthermore, all of the estimates in the remainder of the
paper are independent of the choice of f, requiring only that Ilfll.(on)is bounded by
a constant. Let us define the map F over some subset of L2() by
1 2 2
(8) min J(p)- g L
where/ E (0, x)), and B is an unbounded operator over L2(f’), which we will con-
struct. The regularization operator B is constructed so that its domain is contained
in the class ck,l() for a certain integer k (to be specified later). This fact will be
used in 5 to establish regularity estimates for the forward map F.
We construct B in terms of a "wavelet" basis. In [14], Jaffard and Meyer con-
struct orthonormal wavelet bases for L 2 functions on bounded domains, as opposed
to the usual constructions for L2(lRn). The wavelets have all the usual smoothness,
localization, and vanishing moments properties, and they are shown to naturally char-
acterize functions in the HSlder spaces C() and the Sobolev spaces H(). Refer
to [14] for details.
Let {s}seA be a wavelet basis of order m for L2(t’), as constructed by Jaffard
and Meyer. This orthonormal set in L2(gt ’) has exponential localization properties in
space, and each Cs is in the class c2m-2(’). We slightly alter the indexing notation
o
in [14] denoting the index set 4 j=0 Rj where each Rj is a discrete set in
that indexes location, and j denotes the scale.
Given a function p E L2(), for each a 4, let as, below, denote the wavelet
coefficient of p:
as In, p(x)s(x)dx.
CONVERGENCE OF A RECONSTRUCTION METHOD 445
Let {b}e.4 be a set of real numbers with b >_ 1. With {ba}, we associate the
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
operator B by defining
(Bp)(x)- E baaaCa(x),
for all p for which the sum converges in L2(fl’).
LEMMA 2.1. Let k E IN be given. Assume that the wavelet basis {} used in the
construction of B is of order m, where m > k + n/4 + 3/2, and that the coefficients
{} a4
(9) ba >_ 2iS, aE Rj, j 6 ]N,
where s e (k + n/2 + 1,2k + n/2 + 1). Then there is a constant C C(fY, k, m, s)
such that
(11)
From the Sobolev imbedding theorem (see, for example, [1]) and the fact that Of is
smooth, we have the imbeddings
(12)
so that
H(a’)
- ck+l( ’)
(10) follows immediately from (11). rl
ck’l(’),
The reason for this construction of B is that there is evidence that the com-
putational stability of the inverse problem can be improved by reparametrizing the
conductivities in terms of a wavelet basis. Chavent [6] has demonstrated this for a
similar coefficient determination problem. For the inverse conductivity problem we
could use the freedom allowed by (9) to choose the weights b larger for the wavelets
that are localized away from the boundary. This places less emphasis on determin-
ing details in p far away from the boundary, reflecting the limited resolution inherent
in the problem. See [10] for more along these lines, and [3] for a detailed resolution
analysis.
We should mention that in most practical least-square reconstruction schemes
(e.g., [7], [21]), the conductivity is represented by a simpler basis such as piecewise
constant functions. Although a similar regularization scheme could be used in this
case, the conductivity would no longer have the smoothness properties required by
our convergence theorem. This is perhaps of little practical consequence except in
the limit as the discretization approaches the continuous problem. See 5 for further
discussion of the smoothness condition.
We finish this section by showing that the functional J defined in (8) has a
minimizer whose Ck,(() norm is bounded as increases.
LEMMA 2.2. For all > O, the functional J has a minimizer p in the set
A {p e L2(f’)" p-F ")/_> a > 0},
446 DAVID C. DOBSON
and p E Ck’l(). Furthermore, there is a constant MI such that .for all sufficiently
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
-
Proof. Choose a sequence (pi} C A such that Jf(Pi) If inf(Jf(p) p E A).
Given some number M > l, the proof of Lemma 2.1 shows that for all i sufficiently
large,
(18)
Jfoa DF(’7)(5"7)
L s"TDF*(’7)()’
CONVERGENCE OF A RECONSTRUCTION METHOD 447
(19) V. (Vu*) 0 in
Ou*
Multiplying (15) by u* and integrating by parts along with identity (16) reveals that
(21) jfo(hu) =-/5/(Vu. Vu*).
Thus, we make the identification
(22) DR* (-)() -Vu- Vu*.
Differentiating J(p) in the direction 6p we get
(23) DJ(p)(6p) (Df*(p+’’)(F(p+’’) g) + B*Bp, 6p)L2().
Thus the gradient of Jt at p is the function
Formally,
where
G(p) nF*(p + ")(F(p + "’)
We denote the bilinear second derivative operator for F at
- by D2F(7)( ., .).
/ =0 on0gt.
Or/
Taking the second derivative of Jo in the direction 6p and applying the chain rule for
differentiation yields
Newton’s method is the iterative procedure Pi/l Pi -t-p, which at each step selects
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
the p that minimizes the right-hand side of (24). This is equivalent to solving the
corresponding linear equation
(25) HF(p)(p) -G(p).
In the hope that the residual F(p+/’) -g is small, or the problem is nearly linear
so that DF2(-) is small, we discard the second-order derivative term in HF. Denote
(26) H(p)(p) DF(p + 7’)*DF(p + 7’)(p) + B*Bp.
We will refer to H as the Gauss-Newton Hessian. Given an initial estimate p0 of the
solution to (8), and assuming that H(p)(.) is invertible for each i, the Gauss-Newton
method is the iteration
(28)
where #i 0 if the Gauss-Newton step lies inside the trust-region, and # > 0
otherwise. (Larger #i corresponds to a smaller trust-region radius.) If the trust-region
radius is chosen properly at each step, it can be shown under minimal assumptions
that the Levenberg-Marquardt method will converge to a local minimizer from any
starting point. An adequate description of trust-region globalization strategies is
beyond our scope; see Dennis and Schnabel [9] for a complete discussion. The key
CONVERGENCE OF A RECONSTRUCTION METHOD 449
fact we will use is that the trust-region can always be chosen so that J(pi+l) <_ J(pi)
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
at each step. In fact, most trust-region strategies insist on much stronger decrease
conditions. In addition, we will assume that the trust-region radius is bounded away
from zero: for some constant b,
(29) #i _< b for all i.
4. Convergence. In this section we establish the local convergence of the
Levenberg-Marquardt method (28)on problem (8).
Let k be an integer with k > n/2- 1; let the regularization operator B be
constructed as in 2. For convenience, we assume that the iterates satisfy pi
a > 0. This assumption can be removed by making the substitution /-+ log % but
+- _>
a > 0 in ,
LEMMA 4.2. Let
<-
and that [[’[[c,1(), [1 + i[[c,l() M. Then we have
(30)
(31)
(32)
and .for every
()
where
IIF(+5/) F(7)
L2 (0),
I[DF()(.)l[L.(n,),.(o) <_
IIF( + 5)
-
F(/)IIz:(o) C21ISIIL:(),
DF()(,)II’E=(o)<_C3115 ILL(,)
C1 C1 (a’, a, k,
450 DAVID C. DOBSON
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
C3 C3(a’, a, k, M),
Ca Ca( ’, a, k, M),
and K K(ft’, a, k,
The proof is deferred to 5.
Proo] of Theorem 4.1. Let I) {p’l]SpllL2(S,) _< M, p-t-.t _> a > 0}. Let S
suppz) liE(P-t-9/) -gl]’2(os)" From Lemma 2.1 and (al), it is easy to see that S
Let N C(M 2 + $2) 1/2, where C is the constant given by Lemma 2.1. From Lemma
and
so that
/2 IIBpll2 <- J(P) < J(po)
(34) llp, llc,,,()
Thus,
- _
Lemma 2.1 yields
1
llF(po + o")
1
gll
2,
We can now follow the structure of the proof of the local convergence of the Gauss-
N.
Newton method given in [9]. Let :D(B* B) denote the domain of B* S. For every > 0,
.
since DF*(/)DF() is a nonnegative operator, and B*B satisfies llS*SSpllL(,) >_
IlSpllL.(,) for all 5p e T)(B*B), the operator H(p)-(.) exists and
1
(35) llH(p)-ll
_
Let us denote H(pi) (’) Hi (.), F(pi + 7’) Fi, and similarly for DF, DF*, and a.
We proceed by induction. From (26) and (28), we see that
pf pl -H[DF) (F g) DF(F Fo DFo(pf Po))
+ B*Bpf + #o(Pf Po)].
It follows from (30), (32), and (35) that
1
llp roll -[IIDF) (F ) + B*BpII
+ CaIIp poll u + %ollp poll],
CONVERGENCE OF A RECONSTRUCTION METHOD 451
where I1" I1" IIL(a’) It is easy to check that over D(B*B), J is Gateaux
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
differentiable, and DJ(p)(hp) (G(p), 5p)L2(a,). From the proof of Lemma 2.1,
we see that H(t) C Z)(B*B), so Z)(B*B) is a dense, convex subset of L2([2). Since
p is a local minimizer of J, the variational inequality DJ(p)(hp) 0 implies that
G(p) DF(F g) + B*Bp O.
Hence we have
(36) DF(F g) + B*Bp [DF DF](F g).
Applying (33) to bound (36), we obtain
1
(37) IIP roll < -[(CL + %o)llP poll + CCllp poll ]
1
< (CL + b + CCe)[Ip Poll
Since > CL + b, we can choose e small enough so that the iteration constant in (38)
is strictly less than one, and the q-linear convergence follows.
To see that the convergence rate is q-quadratic when F(p + 7)-g 0 and
# O(I[DF(p + 9/)*(F(p + /’) g)[[L2(gt,)), note that in this case (36) is zero, so
CL O. The q-quadratic convergence rate then follows from (37). E]
-
squares method of 3 does not follow. To establish the stronger result, we make use
of elliptic regularity estimates. These estimates require that the conductivity -y be
bounded in Ck’l(t), where k > n/2- 1. After proving Lemma 4.2, we will finish this
section by examining the necessity of the smoothness assumption E ck’(t). We
construct a simple one-dimensional example that "almost" shows that the smoothness
assumptions are necessary.
Let DF(9/)(5/) be defined as in (17). Let p e H() solve
V. (’), + 5")’)Vp
Op
-V. 5-Vhu in ,
(39) (9’ + 59’) _-dz__ 0 on OFt.
immediately yields
.
will follow easily from the next three lemmas.
LEMMA 5.1. Let "/ 6 ck’l(=), where k is an integer with k > n/2- 1, and
7(x) >_ a > 0 in Let f 6 2(0ft). For each solution u 6 Hl(t) of the problem
(43)
V.
7-5- f on Oft,
we have
(44)
where C C(fY, a, k, 1lTllck,l(f)).
Proof. By standard elliptic regularity results (see, for example, Gilbarg and
Trudinger [111), for each solution u of (43),
(45)
where C C(ft’,a,k, II/llck. (a) ). Having assumed that OFt’ is smooth, we can ap-
ply the Sobolev imbedding lemma (see Adams [1]), which gives the existence of a
continuous linear injection
the property that. (Euo)s O. Hence (48) yields the desired inequality (44) for u0.
Since Vu and C are independent of additive constants in u, (44) remains valid for all
solutions u.
Hence
-
D
Equipped with these estimates, we go on to prove Lemma 4.2.
Proof of Lemma 4.2. We first prove (30). Let w H () be a solution of
V.9/Vw=0 ingt,
(49) Ow
9/ 6u on0.
Let us hold 9/fixed and use the notation DF(69/) DF(9/)(69/). Integrating by parts,
applying (15) and (49), and using the fact that supp 69/C ’, we obtain
IfDF(6) II2L.(o)
Thus
IIDF()II2L<O) IIIIL<’)IlVwlIL<’)IlVulIL<,
Application of Lemmas 5.3 and 5.1 yields
w E HI(f) solve
V ( + 6)Vw 0 in f,
Using Lemm 5.1 and 5.3 to estimate ]]Vw’[]L(,) and Lemma 5.2 to estimate
]]VbU]]L(), we obtain
Thus
(54) -
IlvlI 2 (o)
Using Lemmas 5.1 and 5.3 to estimate
2
<
Ilvl[ :(o)
IIIIL- (’) IlVv’IIL: (’) IlVullL (’)"
IIVull we obtain
(’)
and
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
_
so that
_ _
Hence
[[[DF(y + 5,-y)* DF(0’)*]II2 IlVu*lloollWll + IlVulloollW,*ll +
where all norms are over ’. We have by Lemmas 5.1 and 5.3 that liVUiiL(,) C.
By Lemmas 5.2 and 5.3,
(57)
Similarly, I[Vu*l[oo KIIll.(o) and IlVv*ll2 c so that
(58) II[DF*(’y + ,5O,) DF*(/)IOIIL.(,) Ile"YIIL-(,)(C + IlVvllLoo(,)).
Inequalities (45) and (47)show that
IlL’(a) + IBI(EuB)2)I/2;
hence Lemma 5.3 yields for 1 _< j _< n,
(59)
The fact that IIllc,(), k 1, is bounded, combined with (59) shows that for some
constant N, IIV" 57Vu1152() <_ N. Since the right-hand side of (55) is bounded in L 2,
elliptic regularity applies to give
on 67 from L2() to
DAVID C. DOBSON
Lq() for any q > 2. In the second case, consider relaxing the
_
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php
bound (32) to
(the usual notion of Fr6chet differentiability). In this case, for n 3, we can relax
the smoothness condition on 67 in Lemma 4.2 to C’1 (). Both of these facts can be
proved in a manner similar to our proof of Lemma 4.2; see [10] for details.
We will now construct a simple one-dimensional example illustrating that the
forward map is not regular over LP(), p < 2, when the derivative of the conductivity
function is not uniformly bounded. Although the example falls short of establishing
the necessity of the smoothness conditions in Lemma 4.2, it does show that the forward
map does not have all the regularity properties that we might hope it would.
Let (0, 1) C IR. We linearize about _= 1, with Neumann data f {-1, 1},
so that u(x) x solves
d2u
--0 in,
dx 2
u’(O)=u’(1)--1,
o,
and F(7) u(1) 1.
Let m be an integer, m >_ 2. Define 5m on as follows
2mx ifxE[0, ),
-),3
_
1
1 1/2-2rex ifxE[-,
&’ym(X--)= 2mx-1/2 ifxe[ mm’ )’
3
0 otherwise.
1
(63) IF( + 5) F(7) DF()(5%)[ m
(log(i-i-2
1
)1)
2m
Since the log term tends to zero as m c, (63) tends to zero no faster than 1/m.
By (61), for any p < 2,
(64)
so that
IF(7 + 57m) F(7) DF(7)(57m)I
(65) oc
115 mll ( )
as m .Since only the unifo Lipschitz continuity of the conductivity per-
turbations w violated, we "almost" showed that the smoothness sumptions in
Lemma 4.2 are necessary in the ce n 1.
The same argument shows that
[F( + 5) F(7) nF()(5)] > K > 0
Acknowledgments. The author thanks the Institute for Mathematics and its
Applications for support while finishing this manuscript, and Bill Symes and Fadil
Santosa for encouragement. Thanks also to the referee for very helpful suggestions.
REFERENCES
[11] D. GILBARG AND N. S. TRUDINGER, Elliptic Partial Differential Equations of Second Order,
Downloaded 05/31/16 to 200.120.123.167. Redistribution subject to SIAM license or copyright; see http://www.siam.org/journals/ojsa.php