Linear Algebra (2014)

Chapter 1

Chapter 1 Introduction to Vectors

The heart of linear algebra is in two operations both with vectors. We add
vectors to get v+w. We multiply them by numbers c and d to get cv and dw.
Combining those two operations (adding cv to dw) gives the linear
combination cv + dw.
For example,

1.1 Vectors and Linear Combinations

Geometric Vectors:
Scalar: magnitude (e.g. current, voltage, electronic signals, temperature,
mass), in lower-case letters, such as v, w, x, y, z
Vector: consists of many magnitude components (e.g. displacement, force in
2-D or 3-D spaces), in lower-case boldface letters, naturally
introduces the concept of direction.
e.g. v=(v1, v2,, vn) for simplicity, or formally
B

v1
v
v n

NCTU EE

terminal point

A
initial point

v AB

Linear Algebra (2014)

Chapter 1

Equivalent: vectors with the same magnitude and direction.

v=w

Vector addition:

v+w
w

Zero vectors:

v+w

(arbitrary direction)

0+v=v+0=v
Negative of vector:

-v
v + (-v) = 0

Difference of vectors:

v w = v + (-w)

v-w

Scalar multiplication of vectors: kv

NCTU EE

Linear Algebra (2014)

Chapter 1

Vectors in 2-D Space:

y

( v1 , v 2 )

origin

The coordinates ( v1 , v2 ) are called the components of v.

If v ( v1 , v 2 ) and w ( w1 , w2 ) ,
v w (v1 w1 , v2 w2 )
kv (kv1 , kv2 )
v - w (v1 w1 , v2 w2 )

1
w
2

vw

4
v
2

1
w

vw

1
w

NCTU EE

4
v
2

5

0

Linear Algebra (2014)

Chapter 1

Vectors in 3-D Space

If v (v1 , v2 , v3 ) and w (w1 , w2 , w3 ) ,
v w (v1 w1 , v2 w2 , v3 w3 )
kv (kv1 , kv2 , kv3 )
v - w (v1 w1 , v2 w2 , v3 w3 )

z
origin

v3
v

O
y

v1

( v1 , v2 , v3 )

v2
y

coordinate axes

The Important Questions

1. What is the picture composed of all combinations cu, where c is an
arbitrary number R, u is some vector?

2. What is the picture composed of all combinations cu+ dv, where c and d
are arbitrary numbers R, u, v are some vectors?

3. What is the picture composed of all combinations cu+dv+ew, where c, d

and e are arbitrary numbers R, u, v, w are some vectors?

NCTU EE

Linear Algebra (2014)

Chapter 1

1.2 Lengths and Dot Products

Vectors can span a space. There are infinitely many spaces we can create
and will encounter in real world. What do we do with those spaces and
vectors in electronics engineering and other academic disciplines?
1. Strengths of electronic signals?
2. Similarity between electronic signals?
3. How to do electronic signal compressions?
The Length (or Norm) of a Vector
Notation:

u (u1 ,

In 2-D space,
In 3-D space,
unit vector:

u u12

u (u1 , u2 )

u u12 u22

u (u1 , u2 , u3 )

u u12 u22 u32

, un )

un 2

u 1
ku k u

Dot Product (Inner Product) of Vectors

Definition: Dot product of two vectors v and w is the sum of their
pairwise component products.
Let v = (v1, v2,, vn) and w = (w1, w2,, wn), then
n

v w = (v1, v2,, vn) (w1, w2,, wn) = v1w1 v 2 w 2 v n w n v i w i

i 1

w1

= w v, or v w v 1 v n
w n

NCTU EE

Linear Algebra (2014)

Chapter 1

Dot products in 2-D space

The dot product or inner product of v=(v1,v2) and w=(w1,w2) is the
number v w v w v1 w1 v 2 w 2 .
Dot products in 3-D space
P (w1 , w 2 , w 3 )

( v1 , v2 , v3 )
Q
v
y
2

PQ v w v w 2v w
x

1
2
2
2
(v w vw )
2

w1 w 2 w 3 , v

v-w

vw

( v1 w1 ) 2 ( v 2 w 2 ) 2 ( v 3 w 3 ) 2

v w v1w1 v 2 v 2 v3w3

The Angle between Vectors: cos

NCTU EE

v1 v 2 v 3

vw
v w

Linear Algebra (2014)

Chapter 1

Let u and v be vectors in 2-D space or 3-D space

(a) v v v

(b) u v = v u
(c) u (v + w) = u v + u w
(d) k(u v) = (ku) v = u (kv), k is a scalar
(e) v v > 0 if v 0;

v v = 0 if v = 0.

(f) Any vector u can be made (normalized) as a unit vector u/||u||

(g) If the vectors u and v are nonzero and is the angle between

is acute
them, then is obtuse

uv 0

uv 0

Schwarz inequality: | v w | v w

Triangle inequality: v w v w

Orthogonal Vectors: perpendicular vectors

Notation:

uv

u and v are orthogonal u v = 0

NCTU EE

uv 0

Linear Algebra (2014)

Chapter 1

1.3 Matrices
1
0
0
1, v 1 , w 0
u

First example,



0
1
1
the linear combination of u, v, w lead to a difference matrix A.
Matrix times vector

Ax u v w

Dot products with rows

0 0 x1
1
Ax 1 1 0 x 2

0 1 1 x 3

Linear combinations are the key to linear algebra,

and the output Ax is a linear combination of the columns of A.

Linear Equations

NCTU EE

Linear Algebra (2014)

Chapter 1

The Inverse Matrix

1
0
1



Second example, u 1, v 1 , w * 0
0
1
1
the linear combination of u, v, w* lead to a cyclic difference matrix C.

0 1 x 1
1
Cx 1 1
0 x 2

0 1 1 x 3

x1 x 3
x x b
1
2
x 3 x 2

0
0
If
b

,
0
1

If b 3 ,
5

All Linear combinations x1u+x2v+x3w* = b lie on the plane given

by b1+b2+b3 = 0.

NCTU EE