Beruflich Dokumente
Kultur Dokumente
Matrices are used throughout mathematics and in related elds such as physics, engineering, economics, and statistics. The algebra of matrices provides a model for the
study of vector spaces and linear transformations.
Introduction
A rectangular array of mathematical expressions is called a pdwul{. A matrix with p
rows and q columns is referred to as an p q matrix. Matrices are sometimes referred
to simply as duud|v/ and an p 4 or 4 q array is also called a yhfwru.
Entries in matrices can be real or complex numbers, or mathematical expressions
with real or complex coefcients. Most of the choices from the Matrices submenu will
operate on both real and complex matrices. The QR and SVD factorizations discussed
later in this chapter assume real matrices.
Matrix entries are identied by their row and column number. The matrix can be
considered as a function on pairs of positive integers and, if the matrix is given a name,
this feature can be used to retrieve the entries.
5
6
;8 88 6:
83 8 using Dene + New Denition.
Example 66 Dene D @ 7 68 <:
:<
89
7<
Then applying Evaluate yields the following.
D5>6 @ 83
D6>6 @ 7<
Note that the subscripted row and column numbers are separated by a comma.
260
Creating Matrices
L To create a matrix
1. Click
Introduction
261
Zero
You can get an p q matrix of all zeroes, for any p and q.
L Matrices + Fill Matrix + Zero
3 3
3 3
Identity
You can get an q q identity matrix for any q. You can also specify a nonsquare matrix
and choose identity.
L Matrices + Fill Matrix + Identity
5
6
4 3 3
7 3 4 3 8
3 3 4
6
4 3 3 3
7 3 4 3 3 8
3 3 4 3
4
9 3
9
7 3
3
3
4
3
3
6
3
3 :
:
4 8
3
This operation produces a (square) identity matrix as large as possible and lls in
remaining rows or columns, if any, with zeroes.
Random
With this option, you get a matrix lled with random integers between << and <<.
L Matrices + Fill Matrix + Random
;8
88
69 68
Random Matrix
In addition to Fill Matrix, the Matrices submenu contains the entry Random Matrix.
This choice brings up the following dialog.
262
This lets you specify the range for random (integer) entries as well as specify some
special types.
L Matrices + Random Matrix
(66, Unrestricted (respectively Symmetric, Antisymmetric, Triangular), Range
of Random Entries: -10 to 10)
5
6 5
6 5
6 5
6
7 :
;
9 3 43
3 7 :
7 6 43
7 43 9 ; 8 7 3
8
4 8 7 7
3 ; 8 7 3 ;
8 8
8 :
9
43 4
4
: ; 3
3
3
4
Jordan Block
A Mrugdq eorfn is a square matrix with the same expression along the main diagonal,
ones on the superdiagonal, and zeroes elsewhere. The dialog box asks for the number
of rows and columns and for an item for the diagonal. Jordan forms that are built from
Jordan blocks are discussed in more detail later in this chapter.
L Matrices + Fill Matrix + Jordan block
5 5 with on diagonal and 7 7 with { on diagonal
3
{ 4 3
E 3 { 4
4
E
C 3 3 {
3
3 3 3
4
3
3 F
F
4 D
{
Dened by Function
To use the Dened by Function option, rst dene a function i +l> m, of two variables.
Introduction
263
Then use Dened by Function to create the p q matrix with +l> m, entry equal to
i +l> m, for 4 l p and 4 m q.
Example 67 Kloehuw pdwulfhv
Dene i +l> m, @ l.m44 .
From the Fill Matrix dialog, choose Dened by Function.
Type i in the box for the function name.
Set rows and columns to 5 or 6=
Click OK.
6
5
&
%
4 45 46
4
4 5
9 4 4 4 :
7 5 6 7 8
4
4
5
4
6
4
7
4
8
{57
{67
You can use Fill Matrix to create a general matrix with entries such as dl>m .
Example 69 Dq _duelwudu|% 6 6 pdwul{
Dene the function d+l> m, @ dl>m .
From the Fill Matrix dialog, choose Dened by function.
Enter d for the function name.
Set rows and columns to 6. 5
6
d4>4 d4>5 d4>6
7 d5>4 d5>5 d5>6 8
d6>4 d6>5 d6>6
Note the comma between subscripts. Without the comma in the denition of the
function d +l> m,, the subscript lm would be interpreted as a product! You can use the
following trick to create a general matrix up to < < with no commas in the subscripts.
Example 70 Dqrwkhu irup iru dq _duelwudu|% 6 6 pdwul{
Dene the function d+l> m, @ d43l.m .
From the Fill Matrix dialog, choose Dened by function.
Enter d for the function name.
Set rows and columns to 6. 5
6
d44 d45 d46
7 d54 d55 d56 8
d64 d65 d66
264
Band
The Band option requires that you enter a list such as d> e> f with an odd number of
entries. This option creates a matrix with a band of entries around the main diagonal,
up to the width of your list, and with zeroes elsewhere. The rst entry will be the item
in the middle of your list.
Example 72 D 5 5 edqg pdwul{
From the Fill Matrix dialog, choose Band.
Type d in the Enter band list box.
d 3
3 d
Example 73 Edqg pdwulfhv
From the Fill Matrix dialog, choose Band.
Type d> e> f in the Enter Band List box.
Set rows to 5 or 8, and columns to 5, 8, or ;.
5
5
6
e f 3 3 3
9
9 d e f 3 3 :
9
9
:
e f
9 3 d e f 3 :
9
9
9
:
d e
7
7 3 3 d e f 8
3 3 3 d e
e f 3 3 3 3 3 3
d e f 3 3 3 3 3
3 d e f 3 3 3 3
3 3 d e f 3 3 3
3 3 3 d e f 3 3
6
:
:
:
:
8
Example 74 Choosing Band and entering the lists 3, 4, and 3> > 4 generates a
zero matrix, an identity matrix, and a Jordan block, respectively.
5
6
5
6
5
6
3 3 3
4 3 3
4 3
7 3 3 3 8
7 3 4 3 8
7 3 4 8
3 3 3
3 3 4
3 3
Revising Matrices
Rows, columns, or a block of rows or columns can be deleted from a matrix. The
alignment of rows and columns can be reset. A rectangular block can be replaced.
Introduction
265
Changing Alignment
L To change the alignment of entries
1. Select the matrix using the mouse (or starting with the insertion point at the left of
the matrix, press SHIFT + RIGHT ARROW ).
2. Click the Properties button
266
Concatenating Matrices
You can merge two matrices into one if they have the same number of rows.
L To concatenate two matrices
Introduction
267
{.4
5
6|
7w . 5
8s. z
:}
{.4
5
8s. z
, concatenate:
6|
7w . 5
:}
6
78 54 ;
78> 54> ;> 4<> 3> 8> 48> 9 to 3 columns: 7 4< 3 8 8
48 9
A matrix lled with data can be reshaped, with the new matrix corresponding to the
same list as the original data.
L To reshape a matrix
1. Place the insertion point in the matrix.
2. From the Matrices submenu, choose Reshape.
268
6
;8 88 6:
<:
83 8
to 3 columns: 7 68
:<
89
Standard Operations
You can perform standard operations on matrices, such as addition, subtraction, and
multiplication, by evaluating expressions entered in natural notation.
4 5
7 6
4 5
7 6
@
e
e45
e55
d 5d
7d 6d
8 9
; :
@
d44 . e44
d54 . e54
d45 . e45
d55 . e55
@
d 8e 5d 9e
7d ;e 6d :e
Standard Operations
269
a scalar called the lqqhu surgxfw (sometimes called the grw surgxfw) of the two vectors.
The pdwul{ surgxfw of an pn matrix with a n q matrix is an pq matrix obtained
by taking inner products of rows and columns, the lmth entry of the product DE being
the inner product of the lth row of D with the mth column of E.
L Evaluate
d e
8 9
; :
f
g
d e
x y
4 5
7 6
@ df . eg
f
g
df . eg
xf . yg
8 9
; :
6
@
54 53
77 78
<74 <75
4589 4588
To put an exponent on a matrix, place the insertion point immediately on the right
or choose Insert + Superscript, and type the exponent in the
8 9
; :
4
3
E
@ C
:
46
;
46
4
9
46 F
8 D
46
To check that this matrix satises the dening property, evaluate the product.
270
8 9
; :
E
C
:
46
;
46
4
9
4 3
46 F
@
8 D
3 4
46
8 9
; :
4
@
=86;79
=79487
=9486; =6;795
Checking the product of a matrix with its inverse gives you an idea of the degree of
accuracy of the approximation.
L Evaluate
8 9
=86;79
=79487
=<<<<; =33335
@
; :
=9486; =6;795
=33335
=<<<<;
Since +Dq ,
L Evaluate
8 9
; :
8 9
; :
6
@
6
<74 <75
4589 4588
#
@
<74 <75
4589 4588
4588
54<:
<75
54<:
4589
54<:
<74
54<:
# 4588
54<:
4589
54<:
<75
54<:
<74
54<:
@
4 3
3 4
4
The preceding product demonstrates that D6 @ D6
.
The p q matrix with every entry equal to zero is the lghqwlw| iru dgglwlrq that
is, for any p q matrix D,
D.3@3.D@D
and the dgglwlyh lqyhuvh of a matrix D is the matrix +4, D.
L Evaluate
5
6 5
d4>4 d4>5
d4>4
7 d5>4 d5>5 8 . 7 d5>4
d6>4 d6>5
d6>4
6 5
6
3 3
d4>5
d5>5 8 @ 7 3 3 8
d6>5
3 3
Standard Operations
271
L Evaluate
{5 8{ 5 @
5 5
7
3
{5 8{ 5{3 @
5 5
7 3
You can also dene the function i +{, @ {5 8{ 5 and apply Evaluate (twice) to
get the following.
L Evaluate, Evaluate
5
4 5
4 5
5 5
8
5@
7 6
7 6
7 3
4 5
The expression 8
5 is not, strictly speaking, a proper expression. How7 6
5 3
ever, when evaluated, the 5 is interpreted in this context as
, or twice the 5 5
3 5
identity matrix.
4 5
Another say to evaluate a polynomial at a matrix is to dene the matrix D @
,
7 6
enclose the polynomial in square brackets, and evaluate at { @ D, as in the following
example.
i
4 5
7 6
L Evaluate, Evaluate
5
{ 8{ 5 {@D @
4 5
7 6
5
8
4 5
7 6
5@
5 5
7 3
272
56
:
L Evaluate
U 5
g
9{ g{
frv { 5{6
g{5 vlq {
@
g
{45 7{
g{5 oq { { . 6{
L Evaluate Numerically
vlq5
oq 8
h
{ . 6{
@
3
5=:4;6
4=93<7 7=3{
vlq5 { . frv5 {
9{5
7 vlq 7{ frv 7{ vlq { frv | . vlq | frv {
@
4
9{5
5 vlq ;{ vlq +{ . |,
L Evaluate
{ . 4 5{6 6
4
9{5
g
@
g{ vlq 7{ 6 vhf {
7 frv 7{ 6 vhf { wdq {
273
Each column that contains the leading nonzero entry for any row contains only zeroes
above and below that entry.
;
5 6
5 8 ;
;
5 6
, fraction-free Gaussian elimination:
3 77 8;
;
5 6
5 8 ;
&
%
64
4 3
77
, Reduced row echelon form:
3 4 5<
55
274
65
6 5
6
4 3 3
83 45 4;
83 45 4;
7 3 3 4 8 7 64 59 95 8 @ 7
4 7: <4 8
3 4 3
4 7: <4
64 59 95
L Multiply row 5 by
5
65
6 5
6
4 3 3
;3 5 4;
;3
5
4;
7 3 3 8 7 66 59
;5 8 @ 7 66 59
;5 8
3 3 4
47 7: <4
47
7:
<4
Equations
Systems of equations were introduced on page 71. The algebra of matrices provides you
with additional tools for solving systems of linear equations.
4:
;
>| @
44
;
>} @
8
7
Equations
275
To solve a system of equations with two equations and three unknowns, you must
specify Variables to Solve for in a dialog box. Put the insertion point anywhere in the
matrix and from the Solve submenu, choose Exact. A dialog box comes up asking you
to specify the variables. Enter the variable names, separated by commas.
L Solve + Exact
Variable(s) to Solve for : {> |
5{ | @ 4
, Solution is : i| @ 9} . :> { @ 6} . 7j
{ . 6} @ 7
Variable(s) to Solve for : {> }
5{ | @ 4
, Solution is : { @
{ . 6} @ 7
4
5
. 45 |> } @
:
9
49 | =
Matrix Equations
The system of equations
d44 {4 . d45 {5 . = = = . d4q {q
d54 {4 . d55 {5 . = = = . d5q {q
@ e4
@ e5
..
.
@ ep
e4
e5
..
.
6
:
:
:
8
{q
ep
dp4 dp5 = = = dpq
You can solve these systems using Exact on the Solve submenu. There are advantages
to solving systems of equations in this way, and often you can best deal with systems
of linear equations by solving the matrix version of the system. Two of the preceding
examples correspond to the rst two of the following matrix equations. Compare these
results with the solutions obtained previously.
5
6
5
6
4
4 5
{
4 8 by the vector 7 | 8
Example 78 Multiply the coefcient matrix 7 5 7
3
5 6
}
{ . | 5} @ 4
to display the system of equations 5{ 7| . } @ 3 in matrix form.
5| 6} @ 4
5
65
6 5
6 5
6
4
4 5
{
{ . | 5}
4
7 5 7
4 8 7 | 8 @ 7 5{ 7| . } 8 @ 7 3 8
3
5 6
}
5| 6}
4
276
5 4 3
4
3 6
4:
;
44
;
8
7
6
:
8
6
6
5
{
7 6w4
4
7 | 8@
, Solution is : 7 : 9w4 8
7
w4
}
5
5 4 3 4
4
3 6 4
6
{
9 | :
9
: @ 4 , Solution is :
7 } 8
7
z
6
7 6w4 w5
9 : 9w4 w5 :
:
9
8
7
w4
w5
5
In the rst case, you can also solve the equation by multiplying both the left and right
sides of the equation by the inverse of the coefcient matrix, and evaluating the product.
L Evaluate
6 5
64 5
6 5
{
4
4 5
4
9
7 | 8 @ 7 5 7
4 8 7 3 8@ 7
}
3
5 6
4
5
4:
;
44
;
8
7
6
:
8
Matrix Operators
A matrix operator is a function that operates on matrices.
Trace
The wudfh of an q q matrix is the sum of the diagonal elements. This operation applies
to square matrices only.
L To compute the trace of a square matrix
1. Place the insertion point in the matrix.
2. From the Matrices submenu, choose Trace.
Matrix Operators
277
L Trace
d e
, trace: d . g
f g
4
;8 88 6:
C 68 <:
83 D, trace: 94
:<
89
7<
Transpose
The wudqvsrvh of an p q matrix is the q p matrix that you obtain from the rst
matrix by interchanging the rows and columns.
L To compute the transpose of a matrix
1. Place the insertion point in the matrix.
2. From the Matrices submenu, choose Transpose.
L Matrices + Transpose
d e
f g
d f
, transpose:
e g
You can also get the transpose of a matrix by using the superscript W .
L Evaluate
d e f
g h i
W
4
d g
@ C e h D
f i
Hermitian Transpose
The Khuplwldq wudqvsrvh of a matrix is the transpose together with the replacement of
each entry by its complex conjugate. It is also referred to as the dgmrlqw or Khuplwldq
dgmrlqw of a matrix (not to be confused with the classical adjoint or adjugate, discussed
elsewhere in this chapter.)
L To compute the Hermitian transpose of a matrix
1. Place the insertion point in the matrix.
2. From the Matrices submenu, choose Hermitian Transpose.
278
5l 7.l
, Hermitian transpose:
l
5l
5 . l l
7l 5.l
You can also get the Hermitian transpose of a matrix by using the superscript K.
L Evaluate
l 5.l
7l 6 5l
K
@
l
7l
5 l 6 . 5l
Determinant
The ghwhuplqdqw of an q q matrix +dlm , is the sum and difference of certain products
of the entries. Specically,
[
+4,vjq+, d4+4, d5+5, dq+q,
ghw+dlm , @
where ranges over all the permutations of i4> 5> = = = > qj and +4,vjq+, @ 4, depending on whether is an even or odd permutation.
Note that this operation applies to square matrices only.
L To compute the determinant of a square matrix
1. Place the insertion point in the matrix.
2. From the Matrices submenu, choose Determinant.
L Matrices + Determinant
d e
f g
d4>4
7 d5>4
d6>4
5
, determinant: dg ef
d4>5
d5>5
d6>5
6
d4>6
d5>6 8, determinant:
d6>6
6
;8 88 6:
7 68
<:
83 8, determinant: 45485<
:<
89
7<
Matrix Operators
279
enclosing the matrix in vertical brackets from the expanding brackets list under
L Evaluate
ghw
d e
f g
d e
f g
@ dg ef
@ dg ef
6
d4>4 d4>5 d4>6
ghw 7 d5>4 d5>5 d5>6 8 @ d4>4 d5>5 d6>6 d4>4 d5>6 d6>5 d5>4 d4>5 d6>6 .d5>4 d4>6 d6>5 .
d6>4 d6>5 d6>6
d6>4 d4>5 d5>6 d6>4 d4>6 d5>5
5
6
;8 88 6:
7 68
<:
83 8, determinant: 45485<
:<
89
7<
;8 88
@ 43 4:3
68
<:
Adjugate
The adjugate or classical adjoint of a matrix D is the transpose of the matrix of cofactors
l.m
of D. The l> m cofactor Dlm of D is the scalar +4, ghw D +lmm,, where D +lmm, denotes
the matrix that you obtain from D by removing the lth row and mth column.
L Matrices + Adjugate
d e
f g
, adjugate:
g e
f
d
Note The product of a matrix with its adjugate is diagonal, with the entries on the
diagonal equal to the determinant of the matrix.
d e
g e
dg ef
3
@
f g
f
d
3
dg ef
280
6
5
6
<
9
: 8
66;7
79< 64;6
:463
9 7 ; 6 <5 :
9
634 6533 ;486 :
9
:, adjugate: 9 665<
:
7 6 9
8
7
:
9
739; 594
9;<9 5<:9 8
8 8
3 4
5:8
;73
;8 4449
L Evaluate
5
<
9
: 8
9 7 ; 6 <5
9
7 6 9
:
9
8 8
3 4
5
65
6
66;7
79< 64;6
:463
: 9 665<
634 6533 ;486 :
:9
:
8 7 739; 594
9;<9 5<:9 8
5:8
;73
;8 4449
6
::864
3
3
3
9 3
::864
3
3 :
:
@9
7 3
3
::864
3 8
3
3
3
::864
6
<
9
: 8
9 7 ; 6 <5 :
: @ ::864
ghw 9
7 6 9
:
9 8
8 8
3 4
Note The relationship just demonstrated gives a formula for the inverse of an invertible matrix D.
4
dgmxjdwh D
D4 @
ghw D
Permanent
The shupdqhqw of an q q matrix +dlm , is the sum of certain products of the entries.
Specically,
[
permanent+dlm , @
d4+4, d5+5, dq+q,
where ranges over all the permutations of i4> 5> = = = > qj. This operation applies to
square matrices only.
L To compute the permanent of a matrix
1. Place the insertion point in the matrix.
Matrix Operators
281
d e
f g
d4>4
7 d5>4
d6>4
, permanent: dg . ef
d4>5
d5>5
d6>5
6
d4>6
d5>6 8, permanent:
d6>6
6
;8 88 6: 68 <:
:<
89
7<
96 8 @ <:
pd{ 7 83
8: 8< 78
; <6
5
6
<5
76 95 ::
99
9 87
8
<< 94 83 :
:
plq 9
7 45 4; 64 59 95 8 @ <4
4
7: <4 7: 94
Matrix Norms
Choosing Norm from the Matrices submenu gives the 5-norm of a vector or matrix.
The 20qrup, or Hxfolghdq qrup, of a vector is the Euclidean length of the vector.
d
s
s
e
d
@ d5 . e5 . f5 . g5
@ d5 . e5
f
e
g
The 50qrup, or Hxfolghdq qrup, of a matrix D is its largest singular valuethe number
dened by
nD{n
nDn @ pd{
{9@3 n{n
282
4
5 4
3
s
C 4
5 4 D, 2-norm: 5 . 5
3 4
5
s
s
5 6
, 2-norm: 45 ;< . 45 ;8
8 :
5 . 6l
8
9
: . 5l
s
s
, 2-norm: 45 587 . 5 7<:6
=5 =6
=8 =:
, 2-norm: =<659;
1. Select the matrix by using the mouse or by pressing SHIFT + RIGHT ARROW.
2. Click
L Evaluate
=5 =6
=8 =:
@ = <65 9;
5 . 6l
8
9
: . 5l
8
s
s
:
4
4
46 9 @ 5 854 . 5 6:
4s
s
@
5 587 . 5 7<:6
The 40qrup of a matrix is the maximum among the sums of the absolute values of
the terms in a column:
$
# q
[
nDn4 @ pd{
mdlm m
mq
l@4
Matrix Operators
L Evaluate
d e
f g
283
=5567 =648;
=8957 =:444 @ 4= 359 <
4
@ pd{ +mdm . mfm > mem . mgm,
4
8
:
46 9 @ 4;
4
8 . 6l
:
46 9 8l
s
@ 67 . 46
4
The 4-qrup of a matrix is the maximum among the sums of the absolute values of
the terms in a row:
4
3
q
[
mdlm mD
nDn4 @ pd{ C
lq
L Evaluate
d e
f g
8
:
46 9 @ 4<
4
m @4
=5567 =648;
=8957 =:444 @ 4= 5:6 8
4
8 . 6l
:
46 9 8l
@ 46 .
s
94
The Kloehuw0Vfkplgw qrup (or Iurehqlxv qrup) nDnI of a matrix D is the square
root of the sums of the squares of the terms of the matrix D.
4 45
3
F
E [
mdlm m5 D
nDnI @ C
4m q
4lq
L Evaluate
8 . 6l
s
:
46 9 8l @ 646
I
8
s
:
46 9 @ 6 64
I
u
d e
5
5
5
5
@
mdm
.
mem
.
mfm
.
mgm
f g I
=5567 =648;
@ = <;8 9<
=8957 =:444 I
Condition Number
The frqglwlrq qxpehu of an invertible matrix D is the product of the 5-norm of D and
the 5-norm of D4 . This number measures the sensitivity of some solutions of linear
284
6
3 4 3
7 3 3 4 8, condition number: 4
4 3 3
5
6
8 8 6
7 6
3
8 8, condition number: 5=;57<
4
8
7
5
6
5 4
3
3
8 4s 6 4s
9 4
5 4
3 :
9
:, condition number: 5 . 5 8 5 . 5 8
7 3 4
5 4 8
@ <=7:547
3
3 4
5
5
9
9
9
7
4
4
5
4
6
4
7
4
5
4
6
4
7
4
8
4
6
4
7
4
8
4
9
4
4
4 4=33334
4
7
4
8
4
9
4
:
6
:
:
:, condition number: 48847
8
, condition number: 733335
These nal two matrices are extremely ill-conditioned. Small changes in some entries of D or e may result in large changes in the solution to linear equations of the form
D{ @ e in these two cases.
Exponential Functions
The most natural way to dene hP is to imitate the power series for h{ =
h{ @ 4 . { . 45 {5 . 49 {6 .
4
57
6
{7 .
hP @ 4 . P . 45 P 5 . 49 P .
4
57
P7 .
In general,
hwP @
4 +wP ,n
[
n$
n@3
To evaluate the expression hP for a matrix P , leave the insertion point in the expression
285
h . 46 h8 46 h8 46 h4
h 56 h4 46 h4 . 56 h8
5
h 5h7 5h5
hD.E @
3
h7
5
6
4 w 45 w5 . 6w
8
GhwF G4 @ 7 3 4
w
3 3
4
hD @
5
4
6
5 8
6
&
hwD @
h . 46 h8w
h 56 hw
5
w
6
5 8w
6
h 46 hw
h . 56 h8w
4 8w
6
4
w
6
&
h5 h5 . h7
3
h7
5
6
4 w 45 w5 . 6w
4
8
hGwFG @ 7 3 4
w
3 3
4
hD hE @
Note that one of the properties of exponents that holds for real numbers fails for
matrices. The equality hD.E @ hD hE requires that DE @ ED, and this property fails
to hold for the matrices in the example. However, exponentiation preserves the property
4
of similarity, as demonstrated by GhwF G4 @ hGwFG .
4
7 4 3
C 3 7 3 D, characteristic polynomial: +[ 7,6
3 3 7
286
4 3
4 3
4 3 3
7 4 3
7 . [
3
[C 3 4 3 DC 3 7 3 D@ C
3 3 4
3 3 7
3
3
7 . [
ghw C
3
3
4
7 . [
3
4
7 . [
3
4
3
D
3
7 . [
4
3
D @ +[ 7,6
3
7 . [
4
7 4 3
C 3 7 3 D, minimum polynomial: 49 ;[ . [ 5 @ +[ 7,5
3 3 7
6[
8
[
{
|
{
|
, minimum polynomial: 8{ . 6[| . +6[ |, . 5
, characteristic polynomial: 5 +| . , . | {[
287
frv vlq
vlq
frv
, eigenvalues: frv . l vlq > frv l vlq
4 5
6 7
, eigenvalues:
4=3 5
6 7
8
5
4
5
66> 85
4
5
s
66
, eigenvalues: =6:55;> 8=6:56
When you choose Eigenvectors from the Matrices submenu, with each eigenvector,
you get the corresponding eigenvalue. These eigenvectors are grouped by eigenvalues,
and the multiplicity for each eigenvalue is indicated.
L Matrices + Eigenvectors
4 5
6 7
, eigenvectors:
4
6
4
7
6
' where is a root of ] 5 8] 5
288
4 5
6 7
6.
4 5
6 7
66
s66
8.
4s
4s
4s
6.
9.
@
s66
4s
s
66
8
5
s66
9
66
>
s
. 45s 66
9 . 66
66
66
s66
8.
s
66
>
@
s
45s 66
9 66
8
5
;3
4<
? 6 @
C 4 D '4
=
>
6
In the preceding example, 5 is an eigenvalue occurring with multiplicity 5, and 4 is
an eigenvalue occurring with multiplicity 4. The dening property Dy @ fy is illustrated
by the following.
L Evaluate
3
8 9
C 4
7
6 9
3
8 9
C 4
7
6 9
43
9
5 DC
7
43
9
5 DC
7
4 3
5
4 D@C
3
4 3
5
3 D@ C
4
4
7
5 D,
3
4
7
3 D>
5
4 3 4
5
7
5C 4 D@C 5 D
3
3
3 4 3 4
5
7
5C 3 D @ C 3 D
4
5
289
5 4
4 5
4 4
4 4
, eigenvalues: 6> 4>
, eigenvalues: 3> 5>
290
9 4 3
9
9
:
3 4
:, row echelon form: 9
9
8
9
9
7 3 3
3 3
6
46666:
9;597
:737<
3
67465
63;8
4
<:85
3
3
3
6
:
:
:
:
:
:
:
8
The preceding calculation gives the same basis as found in the previous example.
L Matrices + Fraction-free Gaussian Elimination
5
6
;8 88 6: 68
9 <:
83
:<
89 :
9
:, fraction-free Gaussian elimination:
7 7<
96
8: 8< 8
69
;
53 <7
5
6
;8 88
6:
68
9
3 43;8 6459 4698 :
9
:
7
3
3 46985; 764<3 8
3
3
3
3
The nonzero rows in the preceding matrix give a basis for the row space:
;8 88 6:
68 , 3 43;8 6459
4698 ,
3 3 46985; 764<3 .
6 5
3
4
9 4 : 9 3
9 :>9
7 3 8 7 3
3
4
6 5
6
3
: 9 3 :
:>9 :
8 7 4 8
4
291
You can also take the transpose of D and apply Fraction-Free Gaussian Elimination to the result, because the column space of D is the row space of DW .
6
;8 88 6: 68
9 <:
83
:<
89 :
9
:, nullspace basis:
7 7<
96
8: 8< 8
69
;
53 <7
9
9
9
9
9
9
9
7
46666:
9;597
:737<
67465
63;8
<:85
4
6
:
:
:
:
:
:
:
8
The ohiw qxoovsdfh is the vector space consisting of all 4 p vectors \ satisfying
\ D @ 3. You nd a basis for the left nullspace by rst taking the transpose of D and
then choosing Nullspace Basis from the Matrices submenu.
L Evaluate
5
6W 5
;8 88 6: 68
;8
9 <:
9 88
:
83
:<
89
9
: @9
7 7<
7 6:
96
8: 8< 8
69
;
53 <7
68
6
<: 7< 69
83 96
; :
:
:< 8:
53 8
89 8< <7
;8
9 88
9
7 6:
68
6
<:
7< 69
83
96
; :
:, nullspace basis:
:<
8:
53 8
89 8< <7
;5
A
A
?9
9
7
A
A
=
6<
4 A
A
@
3 :
:
4 8A
A
>
4
To check that this vector is in the left nullspace, take the transpose of the vector and
check the product.
292
6W 5
4
;8 88 6: 68
9 3 : 9 <:
83
:<
89
9
: 9
7 4 8 7 7<
96
8: 8<
4
69
;
53 <7
6
:
:@ 3 3 3 3
8
6 3
7 8
@
=9 =;
=; =9
8=3 7=3
3
6=3
The two matrices T and D @ TU have the same column spaces. Observe, in the
following example, that the columns of D are linear combinations of the columns of T.
Then, since both column spaces have dimension 5 and one contains the other, it follows
that they must be the same space.
Example 80 The preceding product comes from the following linear combinations.
=9
=;
6
@ 8
.3
=;
=9
7
and
=;
3
=9
6
@ 7
=9
8
=;
This conversion of the columns of D into the orthonormal columns of T is referred
to as the Judp~Vfkplgw ruwkrjrqdol}dwlrq process. In general, since U is upper-right
triangular, the subspace spanned by the rst n columns of the matrix D @ TU is the
same as the subspace spanned by the rst n columns of the matrix T.
293
6
:
:, row basis:
4 3 49 6 > 3 4
8
6 5
3
4
9 4 : 9 3
9
: 9
7 4 8 > 7 4
3
4
454
8
59
8
6
:
:
8
294
{6 . 6{ 4 {5 6{ . 8
;8 88
,
{7 . 6{5
6: 68
{6 . 8{5
4
3
Smith normal form:
3 {: . 8{8 6{7 . 4<{6 5;{5
<: 83
:< 89
295
3
9
4
{7 . 6{5 5{ . 4, Companion matrix: 9
7 3
3
3
3
4
3
6
3 4
3 5 :
:
3 6 8
4 3
6
3 3 f
{6 . d{5 . e{ . f, Companion matrix: 7 4 3 e 8
3 4 d
Note that the rst of the following matrices is the companion matrix of its own characteristic and minimum polynomials.
3
4
3
3
3
3
3
4
3
3
4
3 d
3 e F
F
3 f F
F, minimum polynomial:
3 g D
4 h
3
3
3
4
3
d . e[ . f[ 5 . g[ 6 . h[ 7 . [ 8
Choosing Rational Canonical Form from the Matrices submenu produces a factorization of a square matrix as S I S 4 , where I is in rational canonical form. A udwlrqdo
fdqrqlfdo irup, sometimes called a Iurehqlxv irup, is a block diagonal matrix with
each block the companion matrix of its own minimum and characteristic polynomials.
Each of the minimum polynomials of these blocks is a factor of the characteristic polynomial of the original matrix. The polynomials that determine the blocks of the rational
canonical form sequentially divide one another.
L Matrices + Rational Canonical Form
5
5
4 5 6
4 4 63
3 3 3 9
4:
7 7 8 9 8 @ 7 3 7 99 8 7 4 3 4; 8 9
9 3 <
: ; <
3 : 435
3 4 48 7
:
3
87
5
65
4
44
<
5
5:
6
:
:
:
8
Notice that the rational canonical form in the preceding example is the companion
matrix of its minimum polynomial [ 6 48[ 5 4;[. Now look at the companion
matrix of this same matrix.
296
4 5
6 5
6
4 3 3
4 5 6
{ 4 5
6
{ C 3 4 3 D 7 7 8 9 8 @ 7 7 { 8 9 8
3 3 4
: ; <
:
; { <
L Matrices + Smith Normal Form
5
6
5
6
{ 4 5
6
4 3
3
7 7 { 8 9 8, Smith normal form: 7 3 4
8
3
5
6
:
; { <
3 3 4;{ 48{ . {
The polynomial occurring in the preceding Smith normal form has its coefcients
displayed in the rational canonical form shown previously.
6 5
65
65
6
8 9 9
4
8 5
3 5 3
4 4 5
7 4
7
5 8 @ 7 3 4 3 8 7 4
6 3 8 7 3 4
3 8
6 9 7
3
6 4
3
3 5
3
6
4
There are two blocks in the preceding rational canonical form:
1. The companion matrix
3 5
4 6
of [ 5 6[ . 5 @ +[ 4, +[ 5,
6
8 9 9
7 4
7
5 8, characteristic polynomial:
6 9 7
[ 6 . ;[ 8[ 5 7 @ +[ 4, +[ 5,5
L Matrices + Minimum Polynomial, Factor
5
6
8 9 9
7 4
7
5 8, minimum polynomial: 5 6[ . [ 5 @ +[ 4, +[ 5,
6 9 7
297
6
5
6
{8
9
9
4
3
3
7 4
8
{ 7 5 8, Smith normal form: 7 3 { 5
3
5
6
9
{.7
3
3
5 6{ . {
These two examples illustrate a relationship among the Smith normal form, the characteristic matrix, and the rational canonical form of a matrix.
Note The Smith normal form of the characteristic matrix of D displays the factors of
the characteristic polynomial of D that determine the rational canonical form of D=
Jordan Form
Choosing Jordan Form from the Matrices submenu produces a factorization of a
square matrix as S MS 4 , where M is in Jordan form. This form is a block diagonal
matrix with each block an elementary Jordan matrix. More specically, the Mrugdq
irup of an q q matrix D5is a matrix of the form
6
Mq4 +4 ,
3
3
9
:
3
3
Mq5 +5 ,
9
:
M+D, @ 9
:
..
..
.
.
.
.
7
8
.
.
.
.
3
3
Mqn +n ,
where q4 .q5 . .qn @ q, and each diagonal block Mql +l , is an ql ql hohphqwdu|
Mrugdq pdwul{ of the form
5
6
l 4 3 3
9 3 l 3 3 :
9
:
9
.. . .
..
.. :
Mql +l , @ 9 ...
. .
.
. :
9
:
7 3 3 l 4 8
3 3 3 l
298
6
5 4
3
7 4
5 4 8 @
3 4
5
5
4
5
9
7 3
45
65 5
3
3
9
s
s
s
:
4
3
5 5 89
7
7 3 5 5
s
4
3
3
5. 5
7
4
7
4
7
4
7
4
7
65
6
3
4
:9
:
s
:9 4
5
4 :
87
8
s
4 5 4
4
5
9 4
9
7 3
3
3 3
5 3
3 5
3 6
6 5
3
3 4 3
9 4 3 3
3 :
:@ 9
3 8 7 3 3 3
5
3 3 6
65
3
5 4
9 3 5
3 :
:9
4 87 3 3
3
3 3
3
3
5
3
65
3
3 4
9 4 3
3 :
:9
4 87 3 3
3 3
5
6
3 3
3 3 :
:
3 46 8
4 3
64 5
6
3
5 4 3 3
F 9
:
3 :
:F @ 9 3 5 3 3 :
8
D
7
3
3 3 5 4 8
5
3 3 3 5
5 4
, the companion matrix of the miniIn this case, Mq4 +4 , @ Mq5 +5 , @
3 5
mum polynomial of
5
6
5 3 3 3
9 4 5 3 3 :
:
D@9
7 3 3 5 3 8
3 3 6 5
7
The matrix D has characteristic polynomial +[ 5, with roots i5> 5> 5> 5j, and min5
imum polynomial [ 5 7[ . 7 @ +[ 5, .
3 3
5 3
3 5
3 6
3
4
3
3
3
3
4
3
65
3
5 3
9
3 :
:9 3 5
3 87 3 3
4
3 3
3
3
5
3
65
3
4 3
9
3 :
:9 3 4
3 87 3 3
5
3 3
3
3
4
3
299
6
3
3 :
:
3 8
4
4
5
. 45 l
45 l
l 3
3 l
4 4l
4 4.l
In this case,
Mq4 +4 , @ ^l` and Mq5 +5 , @ ^l` are 4 4 matrices. The matrix
4
5
has characteristic and minimum polynomial {5 . 4 @ +{ . l, +{ l, =
4 4
Orthogonal Matrices
An ruwkrjrqdo pdwul{ is a real matrix for which the inner product of any two different
columns is zero and the inner product of any column with itself is one. The matrix is
said to have ruwkrqrupdo columns. Such a matrix necessarily has orthonormal rows as
well.
L Matrices + Orthogonality Test
frv vlq
vlq
frv
, orthogonal? wuxh
4
3 3 4
C 4 3 3 D, orthogonal? wuxh
3 4 3
3 4
4 4
, orthogonal? i dovh
300
6
8 8 6
7 6
3
8 8, singular values: i6=89> 7=94> 43=4j
4=3
8
7
8 8 6
6 3
8
s s
47> :< @ i6=:7> ;=;<j
, singular values:
L Matrices + SVD
5
6
8 8 6
7 6
3
8 8@
4
8
7
5
65
65
6
=:55 =4<4 =998
43=4
3
3
=776
=94;
=97<
7 =788
=8<6 =997 8 7 3
7=94
3 8 7 =:96 =973 =3;<: 8
=855 =:;5 =674
3
3
6=89
=7:4
=789 =:88
These two outer matrices fail the orthogonality test because they are numerical approximations only. You can check the inner products of the columns to see that they are
approximately orthogonal.
L Matrices + Singular Values, Matrices + SVD
4 5=3
, singular values: i=699> 8=7:j
6 7
4 5
=738 =<48
8=7:
3
=8:9 =;4:
@
6 7
=<48
=738
3
=699
=;4: =8:9
PLU Decomposition
Any p q real matrix D can be factored into a product D @ S OX , with O and X real
lower and upper triangular p p and p q matrices, respectively, with 4s on the
main diagonal of O, and with S a permutation matrix. This factorization D @ S OX is
called the SOX ghfrpsrvlwlrq of D. The matrix X is an echelon form of D.
Exercises
301
6 5
65
65
6
4 5 6
4 3 3
4 3 3
4 5
6
7 5 7 9 8 @ 7 3 3 4 8 7 6 4 3 8 7 3 7 ; 8
6 5 4
3 4 3
5 3 4
3 3
3
5
6 5
65
4
5 8 6 8
4 3 3
:
7 : 8
<
9 8 @ 7 3 4 3 87 5
7 6
8 <
3 3 4
5
6 5
65
4
78
;
4 3 3
7 <6 <5 8 @ 7 3 4 3 8 7 64
48
76
76 95
3 3 4
78
3
4
59
78
=865 4=<8
4=8 =3346
3 3
3 3
@
@
4 3
3 4
3 4=3
4=3 3
4 3
3 4
3
4
4556
49<;
4=3
3
= 687 9: 4=3
3 3
3 3
65
3
5 8 6
6<
3 8 7 3 78
5
5
7
4
3 3 48
65
3
78
3 87 3
4
3
;
4465
48
8
7:
5
899
78
6
8
6
8
4= 8 =33 46
3 4= <7< 8
Note that the upper triangular matrix in the rst example is the same as the following.
L Matrices + Fraction-Free Gaussian Elimination
5
6
5
6
4 5 6
4 5
6
7 5 7 9 8, fraction-free Gaussian elimination: 7 3 7 ; 8
6 5 4
3 3
3
In general, the upper triangular matrix in the PLU decomposition is the echelon form
of the original matrix obtained by Gaussian elimination.
Exercises
1. The vectors x @ 4 4 3 and y @ 4 4 4 span a plane in U6 = Find the
projection matrix S onto the plane, and nd a nonzero vector e that is projected to
zero.
2. For the following matrix, nd the characteristic polynomial, minimum polynomial,
eigenvalues, and eigenvectors. Discuss the relationships among these, and explain
the multiplicity of the eigenvalue.
5
6
5 3 3 3
9 4 5 3 3 :
9
:
7 3 3 5 3 8
3 3 6 5
302
4 4 4
4 3 5
?
Solutions
1. The projection matrix S onto the plane in U6 spanned by the vectors x @ ^4> 4> 3`
4 W
D , where x and y are the columns
and y @ ^4> 4> 4` is the product S @ D DW D
of D.
5 4 4
644 5
6W
5
6 35
6
6W 5
3
4 4
4 4
4 4
4 4
5
5
F
E
S @ 7 4 4 8 C7 4 4 8 7 4 4 8D 7 4 4 8 @ 7 45 45 3 8
3 4
3 4
3 4
3 4
3 3 4
Note that S z is a linear combination of x and y for any vector z @ +{> |> }, in U6 ,
so S maps U6 onto the plane spanned by x and y.
5 6
5 6
5 4 4
65
6 5 4
6
4
3
4
{
{ . 45 |
5
5
5
{.|
} 7 4 8.}7 4 8
7 45 45 3 8 7 | 8 @ 7 45 { . 45 | 8 @
5
3
4
}
}
3 3 4
To nd a nonzero vector e that is projected to zero, leave the insertion point in the
matrix S , and from the Matrices submenu choose Nullspace Basis.
;5
5 4 4
6
6<
3
? 4 @
5
5
7 45 45 3 8, nullspace basis: 7 4 8
=
>
3
3 3 4
5
6
5 3
3 3
9 4 5
3 3 :
: has characteristic polynomial +[ 5,7 , minimum
2. The matrix 9
7 3 3
5 3 8
3 3 6 5
5
polynomial 7 7[ . [ 5 @ +[ 5, , and eigenvalue and eigenvectors
;
5 6 5 6<
3
3 A
A
A
A
?
9 3 : 9 4 :@
:>9 :
5> 7> 9
7 3 8 7 3 8A
A
A
A
=
>
4
3
Solutions
303
5
9 4
9
7 3
3
3 3
5 3
3 5
3 6
65
3
3
9 4
3 :
:9
3 87 3
5
3
6
5
3
3
: 9 5 :
9 4
: @ 9 : @ 59
8 7 3 8
7 3
3
3
6
:
:
8
3. The solutions of this equation are in U6 , and the column space of D is a subset of
U5 , so these solutions cannot be the column space of D. They do form the nullspace
of D by the denition of nullspace consequently, this
is a subspace of U6 . The
5 set 6
4
4 4 4 7 8
6
4 @
product of D with the rst row of D is
, which is not
4 3 5
6
4
3
, so the solution set is not the row space of D.
3
To determine whether this subspace of U6 is a point, line, or plane, solve the system
of equations: from the Solve submenu, choose Exact
6
5
6
5
{4
5w4
3
4 4 4 7
{5 8 @
w4 8
, Solution is: 7
3
4 3 5
{6
w4
The
subspace is a line. It is the line that passes through the origin and the point
5 4 4 .
4. Apply the following operations in turn.
frv vlq
New Denition: D +, @
vlq
frv
Evaluate, Evaluate:
frv vlq
frv * vlq *
D +, D +*, @
vlq
frv
vlq *
frv *
frv frv * vlq vlq * frv vlq * vlq frv *
@
vlq frv * . frv vlq *
frv frv * vlq vlq *
Leave the insertion point in the matrix, and from the Combine submenu choose
304
frv + . *, vlq + . *,
vlq + . *,
frv + . *,
This result proves the rst identity. For the second part, carry out the following steps.
Evaluate
D +, D +, @
Evaluate
frv
vlq
vlq
frv
frv
vlq
vlq
frv
frv
vlq
frv
vlq
vlq
frv
vlq
frv
@
frv5 . vlq5
3
3
frv5 . vlq5
Leave the insertion point in the matrix and choose Simplify, or from the Combine submenu choose Trig Functions.
4 3
3
frv5 . vlq5
@
3 4
3
frv5 . vlq5