Beruflich Dokumente
Kultur Dokumente
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at http://www.jstor.org/page/
info/about/policies/terms.jsp
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content
in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship.
For more information about JSTOR, please contact support@jstor.org.
Mathematical Association of America is collaborating with JSTOR to digitize, preserve and extend access to The American
Mathematical Monthly.
http://www.jstor.org
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
METHODS OF MATRIX INVERSION
DONALD GREENSPAN, University
of Maryland
Introduction.The physical scientisthas long been plagued with large linear
systems of equations, hopeless differentialequations or systemsof such equa-
tions, or simply enigmatic integralequations. Each of these problems in turn
often lends itselfto matrixanalysis and the approach usually involves matrix
inversion.However, it is only with the advent of high speed computation that
the approach has enteredthe realm of practicality.
The purposeof thispaper is to presentsome of the existingmethodsof matrix
inversionin a fashionrequiringa minimalmathematicalbackground.("Minimal
mathematical background" implies knowingthe definitionof a matrix,how to
add and multiplymatrices,how to apply matrix notation to systemsof linear
equations, and how to evaluate a determinant.Most of this material is dis-
cussed in [27].)
In each of the followingdiscussions,matrixA will be assumed non-singular
and will be representedby:
The main diagonal of A will be that part of the matrix consistingof the
elements aii, i= 1, 2, * * * , n; and the trace [A] will be the sum of these ele-
ments. The unit matrix is one such that aii=1; i=1, 2, * * * , n; and ai1=0;
i !j; i, j=1, 2, 3, * , n. A is called symmetricif and only if ai =aji forall
i andj.
Method I-Elimination method. Multiplyrow 1 by 1/a,,.Then multiplyrow
1 by -aii and add to row i fori = 2, 3, 4, * , n. This sequence of operations
has the effectof creatinga 1 in the firstpositionof the main diagonal and zeros
everywhereelse in the firstcolumn of the matrix.Apply the same technique to
the second row, thus creatinga 1 in the second position on the main diagonal
and zeros everywhereelse in the second column. Apply the same technique to
the thirdrow, again resultingin a column of (n -1) zeros and a 1 in the main
diagonal position. Keep up this procedureuntil the given matrixis reduced to
the unit matrix.By performing the verysame sequence of operationson the unit
303
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
304 METHODS OF MATRIX INVERSION [May
2 -2 4-
A= 2 3 21.
--I I -1j
Then we writedown:
[2 -2 4 1 0 O]
2 3 2 O 1 0.
--I I -1 O O 1j
1-1
1 2 i 01
2 3 2 O 1 0.
-1-1 2 2 0-
0 5-2 -1 I 0.
BO0 1 2 1_
Multiplyrow2 by 5. Hence:
1 -1 2 a 0 0
0 1 _ 5_X 5 0 .
_O O 1 a 12
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
1955] METHODS OF MATRIX INVERSION 305
j9
-1 0 0 _8X T
0 1 0 0 5 2
LO '1 a 1
2-2 4 :-:i
2 3 2 is I0 5
-1I I - aI o 1.
The only problemwhich can arise, assumingno loss of significanceto make the
matrixat any stage singular,is that one of the aii becomes 0. In this case, one
need only interchangetwo rowsso that the zero on the main diagonal is removed
fromits choice position. In order to get A-' then,one need only take the final
result and interchangein it the same numberedcolumns as those of the rows
which were interchanged.
A technique like this is called an eliminationtechnique. Application of it to
a large scale matrixshould be accompanied by an examination of [30].
Method II. Consider the matrixB such that:
B =IA
_p I
22-2 4-
A= 2 3 2
L1 I -1_
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
306 METHODS OF MATRIX INVERSION [May
Then
1 0 0 2 -2 4 0 0-1 1 -1 1
0 1 0 2 3 2 0 1 0 2 3 2
0 0 1 -1 1-1 1 0 0 2-2 4
B=
0 0 0 1 00 0 0 0 1 0 0
0 0 0 0 1 0 0 0 O 0 1 0
LO O O O O 1_ Lo 0 0 O O 1_
0 00 00 1 -1 I 0 0
0 1 0 2 5 0 0 1 2 0 5 0
1 0 0 02 2 1 0 2 0 2
O O O 1 1- I O O 1 1-1
0 0 0 0 1 0 O O O 0 1 0
LO O O O O I- Lo 0 0 O O 1_
~00 -1 I 0 0-
0 5 25 0 1 0
i0 1 O 0 1.
O 1
0 0 0 1-1 0
1
0 0 0
Lo000 0 01i
Hence
=0 5 1 2 Q 1? 1 0 .
_< 0 1 Lo 0 1_0
A-' = QP = 15 25
A QP1[0 ii
Let us note firstthat methodI is a special case of method II but that method
I is worthyof special discussion,foralthough Andree [21 claims method II is
the fasterof the two, method I is more readilycoded forhigh speed machines.
MethodIII. GivenmatrixA, considermatrixB suchthat AB =I. Setting
the product AB equal to I term by term yields n2 equations in n2 unknowns
whichone triesto solve. These actually formn distinctsets of linear systems.
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
19551 METHODS OF MATRIX INVERSION 307
Example 3: Given
2 -2 Xi4' Yx
A = 2 3 2 letB = X2 Y2 Z2.
-X y3 Y3 z3
Then:
2 -2 X1 Fl
il 2x1-2X2+4x3 2y1-2y2+4y3 2z1-2z2+4z3
2 3 2 :
X2 Y2 Z2 2x:+3X2+2X: 2y,+3y2+2y3 2z1+3Z2+2z]
[1 0
=l 1 o'
Lo O 12
Hence:
2x1- 2X2 + 4x3 = 1 2y -2Y2 + 4y3 = ? 2zi-2z2? + 4z3=?
2x1+ 3x2 + 2x3 = 0 2y + 3Y2 + 2y3= 1 2z, + 3z2+ 2z3 O
-X1+ X2- X3=0 -yl+ Y2- Y3 = 0 -Zi+ Z2 Z3=l1
1= I = I = a
Therefore:
A-'
_4a[
A
0
O 1]
It will be noted that the problemof matrixinversionhas herebeen converted
to one of solving linear systemsof equations. Much researchhas been done on
this latter problemand hence any technique associated with solving linear sys-
tems carn be applied to matrix inversion. Besides the usual methods of:
a) Cramer's rule, b) Gauss eliminationmethod,c) Gauss-Jordanmethod,and
d) Crout's method, more modern techniques are described in: [5], [8], [12],
[16], [21], [23], [26].
Method IV. Adjointmethod.
Let An=determinant formedfrommatrixA by deletingrow1 and column
1 and multiplyingby (- 1) 1+1.
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
308 METHODS OF MATRIX INVERSION [May
Then:
3 2 -2 4
Ali = (1)2 | = -5 A21 = (-1)3 I
| = 2
2 2 2 4
A12= (-1) 1 1 =0 A22= (-1) 4 1 1| = 2
2 3 2 -2
A13 = (-1)4 1 = 5 A23 = (-1)W 1 1 =0
-2 4
A31 = (-1)4 3 2 = -16
2 4
A32 =(-1)5 2 2 =4
2 -2
A83= (-1)6 = 10.
2 3
Also:
2-2 4
IA| = 2 3 2 =10;
-1 1 -1
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
1955] METHODS OF MATRIX INVERSION 309
therefore
- s 2 - 161 - X
A-' _ 0 2 4= O 1 2
_5 0 10 I O 7_1
Sl=
Si= [a11],
[all] S2= L:1
S2= an iF2=
F2 a12]
11 Si an2 1 53 =aii[a21a22
Fa an an
a12 a13 =_a a. S 2 |a1
a23 ,
La31 a32 a33l _a3ia32 a331
a1 a12... alN
SN_ a2Ar
A 0a11 aC212
a21 a22
thenwe have:
Eall C12] [/311 131211
a21 ?X22 321 22
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
310 METHODS OF MATRIX INVERSION [May
S2 =
Eall ai2i _S1
I-
a121
=1
F2 -21
I
a21 ?X22 a21 a22 2 3
=- [!^
[:112J]
021 022 -i
]*
Now:
=
a2~ [als
a23 all
j[
-22-2
2 3
4]
S8
La3la32 ]
a33 _j 2l 1a2]
0a22 - -
Then:
ail
sYll S2-2 [2
-2 -2-
]
3_, a12
01=_ [:=[1
an81
a23 2_2,
4
Note that S21= alll is known fromthe previous calculation. Again using the
formulasforthe #ij,it followsthat:
=1 [~ j,
1]7 := [fil1 21 = [0 (322= [1].
Therefore:
-1 1
A 8 0
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
1955] METHODS OF MATRIX INVERSION 311
eigenvalues of the matrixA and the equation itselfis called the characteristic
equation of the matrixA. For example, if:
-2 -2 4- -2 -2 4- -1 0 O_
A =2 3 2 B= 2 3 2 - 0 1 0
L-1 1 -1i _-1 O1_ _ 0 1i
[2-X -2 4
= 2 3- X 2 ,
_-1 1 -1-X
0O O 1 Lo 0 0_
and this may be readily verifiedby performingthe indicated operations.
A matrix may satisfy many differentequations besides its characteristic
equation. It can be shown that thereexistsan equation of least degreewhichthe
matrixsatisfiesand this degree may be less than that of the characteristicequa-
tion. This equation of least degree is unique to withina multiplicativeconstant
and is appropriatelycalled the minimalequation associated with the matrix. If
C(x) = 0 is the characteristicequation associated with a matrixand M (x) = 0 is
the minimal equation which the matrix satisfies,then it can be shown that
M(x) is a factorof C(x).
Now, suppose some equation has been foundwhich the matrixsatisfies,the
characteristicequation usually sufficing. Then if the equation is:
a0xn + aixn-l + a2xn-2 + * + al-x + a. = 0, an 0,
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
312 METHODS OF MATRIX INVERSION [May
or:
A-' = -
an
{-aoAn-1- a,An-2 -an-II}
Example6:
2 -2 4-
A= 2 3 2
L-1 1 -1_
It has been shown that A has the characteristicequation:
XI - 4X2 + 7X - 10 = 0.
Then:
2 -2 4- 3 -2 -2 4- 2 -2 -2 4-
2 3 2] 4 2 3 2 + 7 2 3 2
h-1 1 -1_ _-1 1 -1_ _-1 1 -1i
-1 0 O- -O O 0-
- 10 O 1 0 = O O
o 0 1 Lo 0 00
and:
[2 2 4 2 2 -2 1
42 1 0 - 1O =[
2' 3 2 -4 2 3 2 + 7 O 1 0 -1OA-1 = O O
L-1 1 -1j L-1 1 -1j 0 0 1 Lo 0 0j
or:
~-5 2 -16-
0 2 4 - 1OA-1 o
0
L 5 0 10j
and finally,
n2
W 1
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
1955] METHODS OF MATRIX INVERSION 313
(1) ck = -
trace [AAkA1
k
(2) A k = AAAk_1 - CkI,
we have:
Example 7. Let
2 -2 4-
A= 2 3 2i
Then:
A2W
A-1 =9 0 W
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
314 METHODS OF MATRIX INVERSION [May
1 -\13
1) 1+ 2 i
2 2
2) eo(A) = 6
- -
el(A) = 3- + -
2~ i+ 2(- 2i i+ = - +2i
I
e2(A) = 3 (- 2- 2i + 2 (--2+-2i' + -2- 2 i
3) eo =-1
6
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
1955] METHODS OF MATRIX INVERSION 315
1 a/3'.
el-l=-
2 6
1 a/13
2 6
5
4) bo= --
18~~~~~~~~~~
1 1
bi = -(eol + er-lw-1 + e -I2) = -
3 18
b= -
1
(eO1 + er1w-2 + e-1w4) =-
7
5)
5 7 1
18 18 18
1 5 7
18 18 18
7 1 5
18 18 18_
The method is a good one in that it worksreadily on matriceswith complex
components. If B is real and symmetrical,[13] gives simplerformulasfor the
computationof the eigenvalues.
Method IX-Newton's formula.In general,given a number W, suppose one
wishes to calculate 1/W. Let x=11W. Then by Newton's formula,setting
f(x) = W- 1/x,
f(x,)
Xn+l = Xn f (Xn) P6 o,
Xn
-
=Xn I
Xn2
= Xn(2 - WXn).
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
316 METHODS OF MATRIX INVERSION [May
Example9. Let
-I 2 3-
A= 2 3 4].
-3 4 4j
Then: choose
[-3.0 4.1 -0.9
X0= 4.1 -5.1 1.91.
L-0.9 1.9 -1.11
~4 0 0 ~ 0 0 0~
A-4 0 4 0 + -1 0 0
L_0 0 4_ L- 0 -1I 0_,
]+[- oJ
?ooi
,-I o O-- O O O- -
= 0
4
1
]0 +
_-4 4 0 0
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
1955] METHODS OF MATRIX INVERSION 317
-I 0 0- - 0 0 0- - 0 0 0- 2 - 0 0 0-
=4 0 1 0 _ 4 0 0 + -4 0 0 _ 0 0 +
_001 4 0 _0-4 0 _0-4 0_
-1
LO 0 IJ L O OJ0- - OJ0- - OJ0
-I 0 0_-4 0 0 +- 0 0 0 _0 0 0 ..
?0
[1
I
1
0 0-
_ ?
4
0]
o 0_
0 0-
01 0 0 0L 0 0 0
I
=s X ~1 0 = 0.
4 1_ 4
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions
318 METHODS OF MATRIX INVERSION [May
This content downloaded from 155.69.24.171 on Tue, 17 Nov 2015 00:25:05 UTC
All use subject to JSTOR Terms and Conditions