Beruflich Dokumente
Kultur Dokumente
Signal Analysis
(Mathematical Fundamentals of Signal Processing)
Supplemented by
the repetition of some basics of Linear Algebra and Analysis
and by some basics of Functional Analysis
for
from
Klaus Markwardt
Contents
1 Notations
2.1
Complex numbers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.2
2.3
. . . . . . . . . . . . . . . . . . . . . . . . . 12
. . . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.3.1
Rules of Integration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.3.2
2.3.3
Improper integrals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.3.4
18
3.1
3.2
3.3
3.4
3.5
Fourier series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
3.6
3.7
3.8
3.9
. . . . . . 27
. . . . . . . . . . . . . . . . . . 30
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
33
4.1
Linear Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
4.2
4.3
Normed spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
4.4
4.5
4.6
4.7
4.8
Metric spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
. . . . . . . . . . . . . . . . . . . . . . . . . . 46
5 Fourier transform
51
5.1
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
5.2
5.3
5.4
5.5
5.6
5.7
5.8
. . . . . . . . . . . . . . . . 58
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
70
72
7.1
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
7.2
7.3
7.4
. . . . . . . . . . . . . . . . . . . . . . 77
83
90
99
Literature Hints
Fourier and wavelet analysis
Books in English: [1], [17], [15], [8], Books in German : [14], [6], [7], [19],
Wavelet analysis
Books in English : [18], [9], [3],[4]
Later studies : [5], [10], [11], [16],
Books in German : [2], [12]
Notations
No
No = {0, 1, 2, }
C k (R)
C k (I)
Lp (R)
f Lp (R) if
Mn (f )
Mn (f ) =
|f (t)|p dt exists, p N
supp(f )
support of a function f
(t)
lk
Kronecker delta
F(f ) , f
Angular frequency :
Frequency
f (n)
L(f )
L(f )(z) =
R
0
= 2
z C, Laplace Transform
4
A or 1A
Re(f ) , Im(f )
hf, gi
hf, gi =
f (t) g(t) dt
kf k = kf k2
kf k =
bcc
dce
A*B
Vector Sets
Rn
Cn
Zn
u, v, w
Set of Matrices
(n, m)-matrix
R(n,m)
C(n,m)
Z(n,m)
A, B, C
aij
det(A)
other Notions
u Cn
A R(n,m)
name
alpha
beta
gamma
delta
epsilon
zeta
eta
theta
character
name
iota
kappa
lambda
mu
nu
xi
omicron
pi
character
name
rho
sigma
tau
upsilon
phi
chi
psi
omega
character
2
2.1
http://en.wikipedia.org/wiki/Complex_number
http://www.mathematics-online.org/kurse/kurs9/
Imaginary unit i:
i2 = 1
Cartesian or algebraic representation complex numbers:
z = a + b i,
a, b R
a + bi
(a + b i)(c d i)
ac + bd bc ad
=
= 2
+ 2
i
c + di
(c + d i)(c d i)
c + d2
c + d2
Examples 2.2.
(3 + 2i) + (5 + 5i) = (3 + 5) + (2 + 5)i = 8 + 7i,
(5 + 5i) (3 + 2i) = (5 3) + (5 2)i = 2 + 3i,
=
=
=
+ i
(3 + 7i)
(3 + 7i) (3 7i)
(9 + 49) + (21i 21i)
58
58 58
Complex plane
x = r cos
y = r sin ,
arctan
arctan
= arg(z) = arctan
(2.1)
p
x2 + y 2
y
x
y
x
y
x
for
x>0
for
x < 0, y 0
for
x < 0, y < 0
for
x = 0, y > 0
for
x = 0, y < 0
(2.2)
= arg(z) =
arccos r
arccos xr
for
for
y0
(2.3)
y<0
for r + x = 0
(2.4)
(2.5)
(2.6)
Eulers formula
Compare http://en.wikipedia.org/wiki/Exponential_function
Exponential function with complex argument:
ez = ex+i y = ex eiy = ex [ cos (y) + i sin (y) ]
Absolut value of it
|ez | = ex
One can prove that
|z1 z2 | = |z1 | |z2 |
z1
=
z2
|z1 |
,
|z2 |
z2 6= 0
Remark 2.4. Verification of Eulers formula with Taylor series for ex , cos(x) and sin(x) :
http://en.wikipedia.org/wiki/Taylor_series
(2.7)
nN
(2.8)
n
n
3
n3
n sin(x) cos
(x)
sin (x) cos
(x) +
sin5 (x) cosn5 (x) + . . .
3
5
dn
e
2
X
n
i+1
(1)
sin2i1 (x) cosn2i+1 (x)
2i 1
i=1
n
n
n
2
n2
cos (x)
sin (x) cos
(x) +
sin4 (x) cosn4 (x) + . . .
2
4
c
bn
2
X
i n
(1)
sin2i (x) cosn2i (x)
2i
n1
i=0
De Moivres formula can be used to find the n-th roots of a complex number.
(cp. http://en.wikipedia.org/wiki/Nth_root) , Parts: Roots of unity and Complex roots
With a = |a| ei
and
0 < 2
the solutions of
zn a = 0
can be represented by
Special case a = 1
p
zk = n |a| exp
=
i
2i
+k
n
n
with k = 0, 1, . . . , n 1 .
n roots of unity
10
(2.9)
Symmetrie
1 x
e + ex
2
sin(x) = sin x,
sinh(x) = sinh x,
sinh x =
cos(x) = cos x,
cosh(x) = cosh x,
1 x
e ex
2
tan(x) = tan x,
tanh(x) = tanh x
Eigenschaften
cosh2 x sinh2 x = 1,
cos(x + 2)
= cos x,
cos2 x + sin2 x = 1,
sin(x + 2)
= sin x,
tan(x + ) = tan x
In analytical modelling often the following trigonometric function values are used.
Funktionswerte
/6
sin x
1
2
cos x
tan x
1
2
3
3
/4
1
2 2
1
2 2
1
Additionstheoreme
sin(x y)
/3 /2
1
1
2 3
1
2
2/3
1
2 3
12
3
0
3/4
5/6
1
1
0
2 2
2
12 2 12 3 1
1
11
sin 2x
= 2 sin x cos x
3
3
2.2
Compare
http://en.wikipedia.org/wiki/Differential_calculus
http://en.wikipedia.org/wiki/Numerical_differentiation
http://en.wikipedia.org/wiki/List_of_Differentiation_Identities
2.3
2.3.1
Rules of Integration
Compare
http://en.wikipedia.org/wiki/Antiderivative
http://en.wikipedia.org/wiki/Riemann_integral
http://en.wikipedia.org/wiki/Integral_calculus
http://en.wikipedia.org/wiki/Fundamental_theorem_of_calculus
http://en.wikipedia.org/wiki/Integration_by_parts
http://en.wikipedia.org/wiki/Integration_by_substitution
http://en.wikipedia.org/wiki/Lists_of_integrals
Indefinite integrals
Integration by parts:
Z
f 0 (x) g(x) dx
(2.10)
f (g(x)) g (x) dx =
u = g(x)
f (u) du
F (u) = F (g 1 (u))
12
(2.11)
g(x) ]ba
f 0 (x) g(x) dx
(2.12)
Integration by substitution:
With u = g(x)
First rule:
Second rule:
f (u) du =
f (g(x)) g 0 (x) dx =
g 1 ()
g 1 ()
du = g 0 (x) dx
und
f
ur x [a, b]
g(b)
f (u) du
g(a)
f (g(x)) g 0 (x) dx
if g 1
exists.
With
= g(a)
und
= g(b),
a = g 1 ()
und
b = g 1 (),
and
we get a simpler form
2.3.2
f (g(x)) g (x) dx =
f (u) du.
Compare
http://archives.math.utk.edu/visual.calculus/4/riemann_sums.4/index.html
http://en.wikipedia.org/wiki/Rectangle_method
http://en.wikipedia.org/wiki/Numerical_integration
Rectangle method
Specifically, the interval [a, b] over which the function f is to be integrated is divided into n subintervals Ik = [xk xk1 ]. If all subintervals Ik sufficiently small then we have
Z
f (x) dx
n
X
k=1
f (k ) (xk xk1 )
with
xk1 k xk ,
= xk xk1 = const
13
for all k
a = x0 ,
b = xn ,
f (x) dx x
n
X
f (k )
(2.13)
k=1
f (x) dx = x
n1
X
k=0
f (a + k x) + En(`) (f )
(2.14)
(2.15)
f (x) dx = x
n
X
k=1
f (a + k x) + En(r) (f )
h = x =
the estimates
(b a)
(`)
h
En (f ) Mf 0
2
(b a)
(r)
h,
En (f ) Mf 0
2
with
(2.16)
Mf 0 = max f 0 (x).
axb
f (xk1 ) + f (xk )
2
by
in (2.13) :
Z
f (x) dx = x
n1
X
1
1
f (a) +
f (a + k x) + f (b)
2
2
k=1
+ E (n) (f )
(2.17)
This composite trapezoidal rule can be interpreted as the arithmetic mean of the left corner approximation and the right corner approximation. For the error in (2.17) one gets the estimate
|E(f )|
or
(b a) 2
h max f 00 (x)
axb
12
|E(f )|
(b a)
Mf 00 h2
12
with h = x =
(b a)
n
with Mf 00 = max f 00 (x)
axb
|f 00 (x)|
(2.18)
2.3.3
Improper integrals
Compare
http://en.wikipedia.org/wiki/Improper_integral
1. Unbounded integrand on interval of finite length
(a) Singularity in the right boundary point
Z
Z b
f (x) dx := lim
b
0
0
f (x) dx
f (x) dx
a+
0
a<c<b
c+
lim
f (x) dx
a b+
2.3.4
f (x) dx
Compare
http://en.wikipedia.org/wiki/Normal_distribution
http://en.wikipedia.org/wiki/Probability_density_function
One of the most used improper integrals is given by
Z
2
ex dx =
(2.19)
It is used in the theory of normal distributions, cp. [13]. The corresponding family of Gaussian
probability density functions (short : Gaussian functions) can be written as.
f, (x) :=
(x)2
1
e 2 2 ,
2
15
> 0,
(2.20)
Mean value : ,
Variance : 2
Var(X)
f, (x) dx = 1
Furthermore by
E(X) =
Var(X) =
2
1
+
Z
(x )2
dx =
x exp
2 2
+
Z
(x )2
(x ) exp
d x = 2
2 2
2
16
(2.21)
(2.22)
17
3.1
Compare
http://en.wikipedia.org/wiki/Periodic_function
http://en.wikipedia.org/wiki/Simple_harmonic_motion
http://de.wikipedia.org/wiki/Trigonometrisches_Polynom
(take above not the corresponding English variant)
http://en.wikipedia.org/wiki/Fourier_series
http://en.wikipedia.org/wiki/Frequency_spectrum
Real trigonometric polynomial of order n (standard form) :
n
n (t) =
a0 X
+
ak cos(k 1 t) + bk sin(k 1 t),
2
k=1
ak , bk R,
1 =
2
T
(3.1)
Here 1 is used instead of , because later gets the part of angular frequency variable. But 1
is in (3.1) a given fixed angular frequency. Likewise gets the part of frequency variable later.
= 2
In this script is used for frequency variable not f and not !
Interpretation of (3.1) in the sense of oscillation theory :
T ist a period of n , the basic period (period of all in n contained oscillations).
1 is corresponding angular frequency to T (basic angular frequency)
Basic frequency 1 of (3.1) is given by 1 = 2 1
(3.1) includes oscillations with integer multiples of the basic frequency 1
Corresponding angular frequencies are integer multiples of the basic angular frequency 1 .
k = k 1 ,
k = k 1 ,
k = 1, 2, n
a(k ) = ak ,
b(k ) = bk ,
k = 1, 2, n
(3.2)
a(k ) = ak ,
b(k ) = bk ,
k = 1, 2, n
(3.3)
Example 3.1. In particular for 2-periodic trigonometric polynomials, i.e. for T = 2 , one
gets
n
a0 X
+
ak cos(k t) + bk sin(k t)
(3.4)
2
k=1
with
k =
k
,
2
k = k
and
for
k = 0, 1, 2, n
Example 3.2. For 1-periodic trigonometric polynomials, i.e. for T = 1, one gets
n
a0 X
+
ak cos(2 k t) + bk sin(2 k t)
2
(3.5)
k=1
with
k = k,
3.2
and
k = 2k
for
k = 0, 1, 2, n
In the engineering literature the real trigonometric polynomial (3.1) is often given in the following
real amplitude-phase representation.
Cosine-representation :
n
a0 X
+
Ak cos(k 1 t k )
n (t) =
2
< k
with
k=1
(3.6)
From
cos( ) = cos cos + sin sin
you get for every k N
Ak cos(k 1 t k ) = Ak cos(k ) cos(k 1 t) + Ak sin(k ) sin(k 1 t).
Compare this with (3.1) and get
ak = Ak cos(k ),
bk = Ak sin(k )
for k = 1, 2,
(3.7)
If this types of amplitudes Ak and phases k are given, then coefficients ak and bk in (3.1) are
well-defined. If the coefficients ak and bk are given, then compare with polar coordinates, look at
formulas (2.3) and (2.4).
Set
x = ak ,
y = bk ,
r = Ak ,
= k
ak
arccos Ak
arccos Aakk
if bk 0
if bk < 0
19
(3.8)
for
k = 1, 2, n
(3.9)
or
k =
bk
2
arctan
Ak +ak
if Ak + ak > 0
for
if Ak + ak = 0
k = 1, 2, n
(3.10)
a0
2
you get the spectral value A0 , which can become also negative. (Other definition of A0 connected
with 0 is possible, but not used here)
The above formulas can be interpreted as relations between different spectra of special time signals
:
between the spectrum {ak , bk } and the spectrum {Ak , k }
A0 =
n (t) =
a0 X
+
Ak sin(k 1 t k )
2
with
k=1
< k
(3.11)
From
sin( ) = cos() sin() sin() cos()
you get for every k
Ak sin(k 1 t k ) = Ak cos(k ) sin(k 1 t) Ak sin(k ) cos(k 1 t)
Compare this with (3.1) and get for the real Fourier coefficients
ak = Ak sin(k ),
bk = Ak cos(k )
k = 1, 2,
(3.12)
bk
if ak 0
arccos Ak
=
for k = 1, 2, n
bk
arccos Ak if ak > 0
A0 =
20
(3.14)
or
k =
ak
2
arctan
Ak +bk
if Ak + bk > 0
if Ak + bk = 0
for k = 1, 2, n
(3.15)
a0 X
n (t) =
+
Ak cos(k 1 t + k )
2
with
< k
with
< k
k=1
and
a0 X
Ak sin(k 1 t + k )
+
n (t) =
2
k=1
3.3
Alternative to (3.1), (3.6) respectively (3.11) a complex representation of the real trigonometric
polynomials is often used.
n
X
n (t) =
Ck ei k1 t .
(3.16)
k=n
This representation is connected with the later introduced discrete Fourier-transform (DFT).
Between the real spectrum of (3.1) and the complex spectrum of (3.16) the relations
2 C0 = a0 ,
ak = Ck + Ck ,
bk = i (Ck Ck ),
kN
and
C0 =
Ck =
Ck =
a0
2
ak i bk
,
2
ak + i bk
,
2
(3.17)
k N,
kN
(3.18)
(3.19)
In general this spectral values Ck become complex, also if the trigonometric polynomial n is
real-valued. They own real part Re(Ck ) and imaginary part Im(Ck ).
So n (t) is connected with a complex angular frequency spectrum :
This is discrete, bounded, finite and contains also negative angular frequencies.
All containing frequencies are whole multiples of a basic angular frequency 1 .
k = k 1 ,
k = k ,
k ) = Ck ,
C(
k = n, 1, 0, 1, , n
(3.20)
Spectral plot :
= Real and imaginary part of the spectrum are plotted versus angular frequency .
If n is real-valued, then
k )) of the spectrum is an even function of with discrete domain
the real part Re(C(
and
k )) of the spectrum is an odd function of with discrete domain.
the imaginary part Im(C(
Of course n (t) is connected also with a complex frequency spectrum :
This is discrete, bounded, finite and contains also negative frequencies, but only whole multiples
of a basic frequency 1 .
k = k 1 ,
k = k ,
k ) = Ck ,
C(
k = n, 1, 0, 1, , n
(3.21)
Spectral plot :
= Real and imaginary part of the spectrum are plotted versus frequency .
3.4
The complex representation (3.16) of the real trigonometric polynomial can be transferred in
n (t) =
n
X
k=n
with
n
X
k=n
|Ck | ei k ei k1 t
(3.22)
Ck = |Ck | ei k
|Ck | =
a2k + b2k
for k = 0, 1, 2, 3 .
if you set
2
k = arg(Ck ) for
k = 0, 1, 2, 3
b0 = 0
(3.23)
(3.24)
The phases k are the arguments of the Ck in the complex plane (Argand plane)
In our case of real valued trigonometric polynomials we get from (3.17)
k = (k ) = (k ) = arg(ak i bk ) = arg(ak + i bk )
k = (k ) = (k ) = arg(ak + i bk )
C0 is real and so for 0 there are 3 possibilities:
1. 0 = 0 if C0 > 0
22
for
for
k = 1, 2, n
k = 1, 2, n
2.
3.
0 = if C0 < 0
0 is not uniquely defined for C0 = 0.
and k = k
for k = 1, 2, n
respectively
|C(
k )| = |C(k )| and (k ) = (k )
for k = 1, 2, n
So
k )| becomes an even function of
this discrete amplitude spectrum |C(
and
this discrete phase spectrum (k ) becomes an odd function of .
Similar to (3.6), (3.9) and (3.10) we get now formulas for calculating the in (3.24) defined arguments
k .
For the negative angular frequencies we get :
ak
arccos 2 |Ck |
k = (k ) =
arccos ak
if bk 0
if bk < 0
2 |Ck |
or
k = (k ) =
This results in
2
arctan
bk
2 |Ck |+ak
k = k
for k = 1, 2, n
if
2 |Ck | + ak 0
if
2 |Ck | + ak = 0
for k = 1, 2, n
for k = 1, 2, n.
3.5
or (k ) = (k )
for k = 1, 2, n.
Fourier series
Very general periodic signals can represented as Fourier series. This are limits of trigonometric
polynomials.
This means: Periodic signals can be decomposed into a sum of simple oscillating functions, namely
sines and cosines or in complex exponentials (possibly infinitely many summands,infinitely many
harmonic oscillations). The study of Fourier series is a branch of Fourier analysis and provides
essential basics for discrete spectral analysis.
23
Compare http://en.wikipedia.org/wiki/Square_wave
Examples for periodic signals
a0 X
+
ak cos(k 1 t) + bk sin(k 1 t),
2
k=1
ak , bk R,
1 =
2
T
(3.25)
if the convergence concept for the right side is determined properly, compare for instance section
3.10. Then the real representation (3.6) and (3.11), the complex representation (3.16) and the
complex amplitude-phase representation (3.22) also converge for n . The relations between the
different discrete spectra remain valid, but now the corresponding spectra are countable infinitely
discrete spectra.
24
The angular frequency based spectrum of a periodic signal f is connected with its Fourier series
(3.25)
a(o )
a0
= ,
a(k ) = ak ,
b(k ) = bk ,
kN
(3.26)
2
2
with whole multiples of one basic angular frequency 1
k = k 1 ,
a0
2
kN
a(k ) = ak ,
b(k ) = bk ,
kN
ak =
bk =
2
T
tZ
0 +T
f (t) cos(k1 t) dt
(3.27)
2
T
tZ
0 +T
f (t) sin(k1 t) dt
(3.28)
t0
t0
if the integrals exist (more accurate later). With t0 any time shifting of the periodicity interval can
be used (Simplification of the calculation!). Especially we get from (3.27)
1
a0
=
2
T
tZ
0 +T
f (t)dt
(3.29)
t0
ak =
bk =
2
T
2
T
ZT
0
ZT
f (t) cos(k1 t) dt
(3.30)
f (t) sin(k1 t) dt
(3.31)
or
T
ak =
2
T
Z2
f (t) cos(k1 t) dt
(3.32)
f (t) sin(k1 t) dt
(3.33)
T2
bk =
2
T
Z2
T2
25
Particularly for 2-periodic signals f (t), that implies T = 2 , the Fourier series (3.25) becomes
a0 X
+
ak cos(k t) + bk sin(k t)
2
ak , bk R,
k=1
1 = 1,
T = 2
(3.34)
In the formulas (3.27), (3.28), (3.29) (3.30), (3.31) (3.32) and (3.33) T = 2 and 1 = 1 is to
insert.
For practical examples in generally the Fourier coefficients in (3.25) cannot be calculated in a
closed form. Then this coefficients must be approximated up to a choosen order n. So you get an
approximation of a given periodic oscillation by a trigonometric polynomial of order n. Here n must
be choosen so large, that all essential oscillation components are contained in the approximation. In
practice composed oscillations will be measured by piezoelectric accelerometers. To get the essential
spectral values of the measured signals, you can use the discrete Fourier transform (DFT). In many
programs this is implemented as a fast algorithm, the so called fast Fourier transform (FFT), see
Matlab, Maple, etc. With this things we deal later.
3.6
If the periodic time signal f (t) is an odd function, then the ak are zero. The Fourier series (3.25)
becomes
X
bk sin(k1 t)
f (t) =
k=1
This is called a sine-series. The sine-series becomes zero at t = 0. The derivative of a sine series is
a formal cosine series, but take account of its convergence behavior.
If the periodic time signal f (t) is an even function, then the bk are zero. The Fourier series (3.25)
becomes
a0 X
f (t) =
+
ak cos(k1 t)
2
k=1
It is also called cosine series. The derivative of a cosine series is a formal sine series, but take
account of its convergence behavior.
Compare http://en.wikipedia.org/wiki/Even_and_odd_functions
3.7
We get such Fourier series from the complex trigonometric polynomial (3.16) if we calculate all
complex Fourier coefficients Ck and if there exist some well defined limit for n against infinity.
f (t) =
k=
Ck ei k1 t
(3.35)
tZ
o +T
to
26
1 =
2
T
Compare (3.27), (3.28), (3.29) and the following representation formulas there.
Mostly the versions for to = 0 and for to = T2 are used.
k ) = C(
k) = 1
Ck = C(
T
ZT
k ) = C(
k) = 1
Ck = C(
T
Z2
f (t) ei k1 t dt
(3.36)
f (t) ei k1 t dt
(3.37)
T2
3.8
27
28
3.9
The following definitions of piecewise continuity and piecewise continuous differentiability are special connected with the field of Fourier series. In other fields you find sometimes modifications of
this definitions.
Definition 3.4. A function f : [ , ] C is called piecewise continuous on this closed interval
[ , ], if it is continuous on all but a finite number of exception points t1 , t2 , tm in which
the onesided limits exist.
Remarks :
1. If f : [ , ] C is continuous, then we have no exception points and the set {t1 , t2 , tm }
is empty. A continuous f will be considered as a special piecewise continuous function.
2. No every piecewise continuous f is continuous.
3. The function value f (tk ) in an exception point tk plays no role, because f is there not
continuous. So we include in the definition 3.4 the case, in which the f (tk ) are not defined.
Although the domain D of f in that case is D = [ , ]\{t1 , t2 , tm }, we use the notation
in definition 3.4.
4. Definition 3.4 is often used for the special case of real valued functions f : [ , ] R.
The functions (signals) defined in Definition 3.4 are special cases of absolute integrable functions
f on [ , ]
(short : f L1 ([, ]), look at the equation (4.16) with p = 1 .
ZT
If
|f (t)| dt < ,
[ , ].
The functions in Definition 3.4 are also special cases of quadratic integrable functions on [ , ]
(short : f L2 ([, ]) , look at the examples 4.19 and 4.29. In signal theory such signals f are
called signals with finite energy on [, ].
If
ZT
0
|f (t)|2 dt < ,
[ , ].
Theorem 3.5. On every bounded interval [, ] a quadratic integrable function f is also absolut
integrable.
L2 ([, ]) L1 ([, ])
In general for functions f : I C with unbounded domains I this not true. For
I = (, ],
I = [, )
and
I = (, )
(3.38)
we get
L2 (I) * L1 (I)
and
L1 (I) * L2 (I).
Theorem 3.6. All Fourier coefficients, that means all spectral values exist, if the T -periodic signal
f is absolute integrable on one period, for instance absolut integrable on one of the intervals
T T
[, ] = [0, T ], [, ] = [T, 0] or [, ] = ,
.
2 2
29
3.10
Compare
http://en.wikipedia.org/wiki/Convergence_of_Fourier_series
Theorem 3.10. If f (t) is T -periodic and piecewise continuous differentiable on one period of length
T then the Fourier series is pointwise convergent for all t R. With 1 = 2
T the limit of the
Fourier series is then given by
a0 X
+
ak cos(k 1 t) + bk sin(k 1 t)
f (t) =
2
k=1
f (t) + f (t+)
a0 X
=
+
ak cos(k 1 t) + bk sin(k 1 t)
2
2
k=1
In every bounded closed interval [ , ] on which in addition f is continuous the Fourier series
converges uniformly to f (t).
If f (t) is additionally continuous on R, then the Fourier series converges uniformly to f (t) on the
whole domain R.
Remark 3.11. Under the same assumptions you can formulate a similar convergence theorem by
using (3.35) and (3.37) or (3.36)
f (t) =
k=
Ck ei k1 t
30
X
f (t) + f (t+)
=
Ck ei k1 t
2
k=
3.11
Theorem 3.13. If the periodic signal f (t) has continuous derivatives up to order m and if f (m) (t)
is piecewise continuous differentiable then there exists a constant L > 0 with
Ck
L
|k|m+1
Ck
3.12
Exercises
Exercise 3.14. The time signal f has the following properties: f (t) = f (t + 2) for all t R
and
0
for t 2
4 for
2 < x < 2
f (t) =
0
for 2 t <
1. What is the primitive period of f (t). Sketch the signal in the interval [3, 3]. Has f (t) a
symmetry property?
2. Determine the real and complex Fourier coefficients ak , bk and Ck . Write the Fourier series
down.
31
3. Sketch the corresponding spectra for || 4. Change the angular frequency scaling by frequency scaling and adapt the above spectral representations.
4. Calculate and sketch for the above complex spectrum the corresponding parts of the amplitude
and of the phase spectrum.
Exercise 3.15. Let a T -periodic function f (t) with the convergent Fourier series (3.25) be given.
1. How the basic angular frequency, the basic frequency, the basic period, the real and complex
Fourier coefficients are changed, if we replace f (t) by f(t) = f (p t) with some p > 0 (time
dilation of the signal f ). Use for the new parameters
1, a
k .
2. Take for f (t) the time signal of the exercise 3.14 and set p = 2. Sketch 3 periods of f(t).
Sketch the corresponding spectra for || 8 and compare this results with the last exercise.
Exercise 3.16. Let a T -periodic function f (t) with the convergent Fourier series (3.25) be given.
1. How the basic angular frequency, the basic frequency, the basic period, the real and complex
Fourier
coefficients are changed, if we replace f (t) by f(t) = f (t to ) with some to > 0 (time shifting
of the signal f ). Use for the new parameters
1, a
k .
2. Take for f (t) the time signal of the exercise 3.14 and set to = 4 . Sketch 3 periods of f(t).
Sketch the corresponding spectra for || 8 and compare this results with the last exercise.
32
4.1
Linear Spaces
The notion vector space will be generalised in this section. So function spaces and signal spaces
(spaces of discrete signals and spaces of signals with continuous domain) can be interpreted as
special cases of such a generalized structure. In the following definition consider only the cases
F = R : field of real numbers
F = C : field of complex numbers
Definition 4.1. A set V together with an operation 00 +00 (addition) is called a linear space over
a field F if the following axioms are valid:
1. If u, v, w V then v + w V and
v+w =w+v
(v + w) + u = v + (w + u)
there is a zero vector 0 V so that v + 0 = v for all v V
each v V has an additive inverse x V such that x + v = 0.
( + ) v = v + v
(v + w) = v + w
( ) v = ( v)
1v =v
4.2
Definition 4.4. If two linear spaces V and W over the same field F are given, then a map
A : V W
is called linear or a linear operator if for all u, v V und F the following conditions are
fulfilled
A is homogeneous:
A ( v) = A (v)
A is additive:
A (u + v) = A (u) + A (v)
In the cases
A : V R
A : V C
or
4.3
Normed spaces
kxk = 0
(4.2)
k xk = || kxk
x=0
(4.3)
(Definitheit)
(positive homogeneous)
kx + yk kxk + kyk
(4.4)
(4.5)
0 is here the zero element (zero vector) and 0 is the number zero. The norm is positive definite.
A linear space with a norm is called a normed space (normed vector space).
A linear space can be provided with several different norms.
Example 4.6. V = Rn with Euclidean norm
v
u n
q
uX
2
2
kxk2 := x1 + + xn = t
x2i ,
i=1
x Rn
n
X
i=1
35
|xi |.
z Cn
kxkp :=
n
X
|xk |
n
X
k=1
!1
p1
(4.6)
a norm in Rn or in Cn .
The triangle inequality becomes now the form
n
X
k=1
!1
n
X
|xk + yk |p
!1
|xk |p
k=1
k=1
!1
|yk |p
(4.7)
This special case of triangle inequality is known as Minkowski inequality for vectors and finite
sequences respectively.
With q as the corresponding conjugate H
older exponent of p, that means
1 1
+ =1
p q
1 p, q ,
1
= 0 ),
(4.8)
!1
(4.9)
the so called H
olders inequality
n
n
X
X
x k yk
|xk yk |
k=1
k=1
n
X
k=1
!1
|xk |p
n
X
k=1
|yk |q
is valid.
With dot product (scalar product) in Rn
hx, yi =
n
X
hx, yi R
x k yk ,
k=1
(4.10)
x y Rn
(4.11)
(4.12)
It is possible to bring forward (4.12) and other inequalities in Rn or Cn on special function spaces
(spaces of signals with continuous time or continuous frequency domain). Especially for the case
p = q = 2 the inequalities (4.9) or (4.12) become a variant of Cauchy-Schwarz inequality (Schwarz
inequality). It estimates scalar products (4.10) with Euclidean norms (lengths of vectors).
With the complex valued scalar product in Cn
hx, yi =
n
X
x k yk ,
(4.13)
k=1
which is a generalisation of (4.10), the notions and statements between (4.8) and (4.12) remain
valid, if we substitute in (4.9)
!
!
n
n
X
X
xk yk
by
xk yk .
k=1
k=1
36
p
p 1, n = 1, 2, 3,
kxkp kxk1 np1 kxkp ,
in
Rn and Cn
Example 4.12. For a given closed interval I = [a, b] we define C(I) as the set of continuous
functions on I This set C(I) becomes in a simple way a linear space. With
||f || = max{ |f (t)| : t I}
(4.14)
n=1
|an |p < ,
forms a linear space `p (N) (usual term by term Addition and usual outer number multiplication).
This linear space becomes with
!1
p
X
p
||a||p =
|an |
n=1
a normed space.
In the case p = by
is the linear space of all bounded sequences defined (real or complex valued). This linear space
becomes with
||a|| = sup |an |
n
a normed space.
All statements between (4.6) and (4.13) can be taken on this example, if one substitutes n by .
But the used series must exist.
The linear spaces ` (No ), `p (No ), ` (Z) and `p (Z) and corresponding norms for p 1 are
similar defined.
37
f : I R resp. f : I C
for which
Z
I
|f (t)|p dt <
1p<
(4.16)
represent the linear space Lp (I). By identification of functions which are only different on a set of
measure 0 one gets in this space with
kf kp :=
Z
1
p
|f (t)| dt
p
(4.17)
a norm. The triangle inequality for this special norm is known again as Minkowski inequality.
If one substitute in the examples 4.10 the sums by appropriate integrals, then the statements of that
examples can be translate to the space Lp (I).
Most of linear spaces V mentioned in this subsection are complete.
Completeness of V means:
Every Cauchy sequence in the space V has a limit that is also in V.
In particular in a complete space V = V(k k)
follows from
always
kfn k < ,
n=1
fn = f
n=1
4.4
with
fn V
for all n
Compare
http://en.wikipedia.org/wiki/Inner_product_space
http://en.wikipedia.org/wiki/Dot_product
An inner product space is sometimes also called a pre-Hilbert-space, since its completion with
respect to the metric, induced by its inner product, is a Hilbert space.
In this subsection let V be a real linear space.
Definition 4.15. A scalar product (or an inner product) on V is a map
h, i : V V R
that satisfies the following 5 axioms for all x, y, z V and all R
1.
hx, xi 0
(non negative)
38
2.
hx, xi = 0 x = 0
(definite)
3.
hx, yi = hy, xi
(symmetric)
4.
hx + y, zi = hx, zi + hy, zi
5.
hx, yi = hx, yi
und
hx, yi = hx, yi
(4.18)
for all
x, y V .
(4.19)
Beweis:
(4.19) is trivial in the case y = 0. So only the case hy, yi 6= 0 for any real number R is to
examine. One gets
0 hx y, x yi = hx y, xi hx y, yi = hx, xi 2hx, yi + 2 hy, yi
With the special choice
=
results
hx, yi
= hx, yi kyk2
hy, yi
Example 4.18. In Euclidean spaces Rn the inequality (4.19) takes the form
n
v
! v
!
u n
n
X
u
X
u
u X
t
xi yi
x2i t
yi2
i=1
i=1
(4.20)
i=1
Compare http://en.wikipedia.org/wiki/Euclidean_space
Example 4.19. The linear space of all real valued functions over I = [a, b] which are quadratic
integrable there, is termed by
L2 (I)
oder
L2 ([a, b]) ,
An inner product is here given with
hf, gi :=
The induced norm is
Zb
f (t) g(t) dt
(4.21)
v
u b
uZ
p
u
kf k := hf, f i = t f 2 (t) dt.
(4.22)
For this special case the squared Schwarz inequality (4.19) gets the shape
b
2 b
b
Z
Z
Z
f (t) g(t) dt f 2 (t) dt g 2 (t) dt
a
(4.23)
40
2.
(4.24)
the definition of the angle between two non-zero elements (abstract vectors).
By
2
hx, yi
p
1
p
hx, xi hy, yi
(4.25)
4.5
Example 4.22. Basic functions regarding real Fourier series for the basic interval [ 0, 2 ] are
gn (t) = cos(n t),
n = 0, 1, 2, ,
m = 1, 2, ,
t [ 0, 2 ]
This is the most known example of an orthogonal function system. Using angle sum and difference
identities, compare
http://en.wikipedia.org/wiki/List_of_trigonometric_identities#Trigonometric_functions
one gets
sin(n t) sin(m t) =
cos(n t) cos(m t) =
sin(n t) cos(m t) =
1
(cos(n t m t) cos(n t + m t))
2
1
(cos(n t m t) + cos(n t + m t))
2
1
(sin(n t m t) + sin(n t + m t))
2
(4.26)
(4.27)
(4.28)
Because of sin( + 2 ) = cos() the formula (4.27) directly follows from (4.26). Using Eulers
formula it becomes possible to proof them all.
From ( 4.26), (4.27) and (4.28) the following orthogonality relations result
Z2
for n = m, m = 1, 2,
sin(n t) sin(m t) dt =
(4.29)
0
for
n
=
6
m,
n,
m
=
1,
2,
0
41
for n = m, m = 1, 2,
Z2
2 for n = m = 0
cos(n t) cos(m t) dt =
0
for n =
6 m, n, m = 1, 2,
Z2
cos(n t) sin(m t) dx = 0
(4.30)
n N0 , m N
for
(4.31)
for
for
n, m = 1, 2,
hgn , gm i = nm
for
n, m = 1, 2,
n = 0, 1, 2, ,
m = 1, 2, ,
n N0 , m N
and
1
gn = gn ,
n = 1 hn
h
n = 1, 2,
for
n N0 , m N
a0 X
f (t) =
+
ak cos(k t) + bk sin(k t)
2
L2 ([0, 2]) .
k=1
a0 X
fN (t) =
+
ak cos(k t) + bk sin(k t)
2
kf fN k2 0
results
k=1
for
N .
So the energy of the approximation error can be made arbitrarily small, if you choose N sufficiently
large.
For the Fourier coefficients the following Parsevals identity hold
|a0 |2 1 X
1
+
|ak |2 + |bk |2 =
4
2
2
k=1
42
Z2
0
|f (t)|2 dt =
kf k2
2
|a0 |2 1 X
1
+
|ak |2 + |bk |2 =
4
2
2
k=1
Z2
0
|fN (t)|2 dt =
kfN k2
2
So the signal energy |f (t)|2 or |fN (t)|2 can be calculated by the spectrum of the signal. On the
right sides of the last two equations the energy of one signal period will divided by the length of
one time period. This is the average signal power of f or fN in this period. Because the signals
are 2 -periodic this is here also the finite average power of the complete signals.
Now the general case of real Fourier series :
Basic functions regarding real Fourier series for the basic interval [ 0, T ] are
gn (t) = cos(n 1 t),
n = 0, 1, 2, ,
m = 1, 2, ,
t [ 0, T ]
with
2
T
as basic angular frequency. They will be used to develop T -periodic functions in Fourier series.
One gets from (4.29), (4.30), (4.31) by the substitution
1 =
t = 1 t,
dt = 1 dt.
sin(n 1 t) sin(m 1 t) dt =
ZT
cos(n 1 t) cos(m 1 t) dt =
and
ZT
T
2
for n = m,
for n 6= m,
m = 1, 2,
for n = m,
for n = m = 0
for n 6= m,
(4.32)
n, m = 1, 2,
T
2
cos(n 1 t) sin(m 1 t) dt = 0
m = 1, 2,
(4.33)
n, m = 1, 2,
for n N0 , m N,
(4.34)
n = 0, 1, 2, ,
m = 1, 2, .
Exercise 4.24. Define the orthogonality relations for the functions gn , hm in the last example
similar to the example 4.22. Then construct also an orthonormal basis in L2 ([0, T ]) for this
generalized case.
Theorem 4.25. If f L2 ([0, T ]) then you get for the Fourier series
a0 X
f (t) = +
ak cos(k 1 t)+bk sin(k 1 t)
2
L2 ([0, T ]) .
k=1
a0 X
fN (t) =
+
ak cos(k 1 t) + bk sin(k 1 t)
2
results
k=1
43
kf fN k2 0
for
N .
So the energy of the approximation error can be made arbitrarily small, if you choose N sufficiently
large.
For the Fourier coefficients the following Parsevals identity hold
ZT
1
|a0 |2 1 X
|ak |2 + |bk |2 =
+
4
2
T
k=1
|f (t)|2 dt =
kf k2
T
of f (t)
of fN (t)
1
|a0 |2 1 X
|ak |2 + |bk |2 =
+
4
2
T
k=1
ZT
0
|fN (t)|2 dt =
kfN k2
T
kf fN k =
ZT
0
|f (t) fN (t)| dt =
ZT
0
|f (t)|2 dt
N
|a0 |2
T X
T
|ak |2 + |bk |2
4
2
k=1
From this we get quick the approximation error measured in the average signal power.
4.6
(also complex pre-Hilbert-space or complex vector space with scalar product called)
Compare http://en.wikipedia.org/wiki/Inner_product
Definition 4.26. A scalar product (also inner product called) on a complex vector space V is a
map
h, i : V V C
that satisfies the following five axioms for all elements x, y, z V (abstract vectors) and all scalars
C (complex numbers)
1.
hx, xi 0
(non negative)
2.
hx, xi = 0 x = 0
(definite)
3.
hx, yi = hy, xi
Hermitian symmetry
4.
hx + y, zi = hx, zi + hy, zi
5.
hx, yi = hx, yi
44
und
hx, yi = hx, yi
(4.35)
Such a complex inner product is also called a positive-definite Hermitian form. In real spaces we
worked with similar positive-definite symmetric bilinear forms.
Analogue to the real case now also a norm can be produced.
Definition 4.27. Every complex inner product produces by
p
kxk := hx, xi
(4.36)
n
X
i=1
hx, yi :=
xi yi = y x,
n
X
i=1
xi yi = x y ,
Remark : The adjoint matrix is defined by A = A . Vectors are special matrices. The induced
norm is now defined by
v
v
u n
u n
uX
uX
2
t
kxk :=
|xi | = t
xi xi = x x ,
if x is a row vector
i=1
i=1
(4.37)
Z
Z
Z
f (t) g(t) dt |f (t)|2 dt |g(t)|2 dt
(4.38)
i=1
i=1
i=1
Example 4.29. In the linear space of complex valued and quadratic integrable functions over an
bounded interval I = [a, b]
kurz:
L2 (I) oder L2 ([a, b]) ,
Zb
f (t) g(t) dt
(4.39)
v
u b
uZ
p
u
kf k := hf, f i = t |f (t)|2 dt
(4.40)
The complex inner product space is complete, if regarding induced norm every Cauchy sequence is
convergent. Such a space is called a Hilbert space.
45
4.7
Often in the applications complex Fourier expansions are used, to analyse oscillating structures.
Here for instance the complex function system
fn (t) = {exp(i n t)},
n Z,
t [ 0, 2 ]
(4.41)
which is related with that of example 4.22 and connected with the complex representation of Fourier
series for 1 = 1 and T = 2 is given.
The orthogonality relations corresponding the interval [ 0, 2 ] are now simpler to calculate
Z2
mZ
2 for n = m,
int imt
e
dx =
(4.42)
e
0
for
n
=
6
m,
n,
m
Z
0
or
hfn , fm i = 2 nm
Pay attention to
ei m t = ei m t .
The function system (4.41) characterises a system of complex harmonic oscillations which contains
2
n
1
, ,
2
2
2
the frequencies
1, 2, n
and the
corresponding periods
2,
(4.43)
(4.44)
2
2
,
2
n
k=
Ck ei kt
L2 ([0, 2]) .
N
X
k=N
Ck ei kt
kf fN k2 0
results
for
N .
So the energy of the approximation error can be made arbitrarily small, if you choose N sufficiently
large.
For the Fourier coefficients the following Parsevals identity hold
k=
1
| Ck |2 =
2
Z2
0
|f (t)|2 dt =
kf k2
2
46
of f (t)
k=N
1
| Ck |2 =
2
Z2
0
|fN (t)|2 dt =
kfN k2
2
of fN (t)
Between the spectra of theorem 4.30 and theorem 4.23 the equations
X
|a0 |2 1 X
|ak |2 + |bk |2 =
+
| Ck |2
4
2
k=1
k=
N
N
X
|a0 |2 1 X
|ak |2 + |bk |2 =
+
| Ck |2
4
2
k=1
k=N
hold.
As a rule periodic oscillations with any basic angular frequency 1 > 0 are to analyse. So you
must substitute (4.43) and (4.44) by
n 1
frequencies
:
, n = 1, 2,
(4.45)
2
angular frequencies
n 1 ,
corresponding periods
T :
2
,
n 1
n = 1, 2,
(4.46)
n = 1, 2,
That in this case of complex Fourier series used function system, compare (3.35)
fn (t) = ei n 1 t ,
n Z,
t [ 0, T ]
(4.47)
i n 1 t
ei m 1 t
dt =
or
for n = m
(4.48)
for n 6= m
hfn , fm i = T nm
The function system (4.48) provides an orthogonal basis in in the complex function space L2 ([0, T ]).
Exercise : Change it so, that you get an orthonormal basis in L2 ([0, T ]).
Theorem 4.31. If f L2 ([0, T ]) then you get for the complex Fourier series (3.35)
f (t) =
k=
Ck ei k1 t
L2 ([0, T ]) .
N
X
k=N
Ck ei k1 t
kf fN k2 0
results
for
N .
So the energy of the approximation error can be made arbitrarily small, if you choose N sufficiently
large.
For the Fourier coefficients the following Parsevals identity hold
k=
1
| Ck |2 =
T
ZT
0
47
|f (t)|2 dt =
kf k2
T
k=N
1
| Ck |2 =
T
ZT
0
|fN (t)|2 dt =
kfN k2
T
On the right sides of the last two equations is standing the average signal power of f (t) and fN (t).
The energy error of signal approximation in one period can calculated by
2
kf fN k =
ZT
0
|f (t) fN (t)| dt =
ZT
0
|f (t)| dt T
N
X
k=N
| Ck |2
From this we get quick the approximation error measured in the average signal power.
Between the spectra of theorem 4.31 and theorem 4.25 again the equations
X
|a0 |2 1 X
|ak |2 + |bk |2 =
+
| Ck |2
4
2
k=1
k=
N
N
X
|a0 |2 1 X
+
|ak |2 + |bk |2 =
| Ck |2
4
2
k=1
hold.
4.8
k=N
Metric spaces
A metric space is a set where a notion of distance between elements of the set is defined. Such a
distance d is also called a distance function or a metric.
Definition 4.32. A metric d on a set M is defined by the following axioms
d : M M R
d (x, y)
d (y, x)
(symmetry)
d (x, y)
d(x, z) + d(z, y)
(triangle inequality)
d (x, y)
d (x, y)
(non negative)
x=y
(definite)
which are valid x, y, M. A set M with such a metric d is called a metric space M = (M, d).
In any normed space V = (V, k k) is a metric defined by
d(x, y) kx yk,
x, y V
a metric. So every normed space becomes a special metric space with the metric induced by the
given norm.
Special metrics induced by norms:
48
v
u n
q
uX
x2i ,
kxk2 = x21 + + x2n = t
( Euclidean norm)
i=1
v
u n
p
uX
2
2
2
d(x, y) = kx yk2 = (x1 y1 ) + (x2 y2 ) + + (xn yn ) = t (xi yi )2
i=1
a metric space.
v
u n
p
uX
2
2
|zi |2 ,
kzk2 = |z1 | + + |zn | = t
z Cn
i=1
v
u n
p
uX
2
2
2
d(z, w) = kz wk2 = |z1 w1 | + |z2 w2 | + + |zn wn | = t
|zi wi |2
i=1
a metric space.
n
X
i=1
|xi |
n
X
i=1
!1
n
X
i=1
|xi yi |
|xi |p
1p<
d(x, y) = kx ykp =
n
X
i=1
!1
|xi yi |
Example 4.33. With interval I = [a, b] in the linear space C(I) the maximum norm is given by
||f || = max{ |f (t)| : t I}
This norm induces by
d(f, g) = ||f g|| = max{ |f (t) g(t)| : t I}
on V = C(I) a distance. With this distance one can construct a uniform neighbourhood of every
given f C(I).
Example 4.34. For the in (4.16) and (4.17) defined normed space Lp (I) the distance is defined
by
1
p
Z
p
|f (t) g(t)| dt
d(f, g) = kf gkp :=
I
50
Fourier transform
5.1
Introduction
Consider a periodic signal fT : R R with period T, its complex Fourier series and its discrete
spectral values Ck , compare (3.35). By using the discrete spectral values
T
)= 1
Ck = C(
k
T
Z2
fT(t) eik t dt
with
1 =
2
T
and k = k 1 =
2k
T
(5.1)
T2
k=
Ck eik1 t
respectively
fT(t) =
k=
) eik t
C(
k
with
k = k1 . (5.2)
Certainly some convergence conditions must be satisfied, compare for instance subsection 3.10.
Now let f (t) and f() be two functions with
f : RC
f : R C,
and
f (t) = F
(5.3)
1
{ f()} (t) :=
2
f() eit d .
(5.4)
If both integrals exist and the equations hold, then we call {f (t), f()} a Fourier transform pair.
In applications we often use only the case of a real valued time signal f (t).
To a time signal f (t) of such a pair corresponds an angular frequency spectrum f(). Similar in
) of the periodic time signal f (t). This also
(5.1) we had considered the discrete spectrum C(
T
k
C()
contains complex amplitudes to isolated angular frequencies k .
f() is an angular frequency density, this means,
its a complex amplitude density (per angular frequency unit). The frequency spectrum is
now blurred or smeared.
51
For understanding this, compare it in principle with some types of loading in structural mechanics :
A sum of concentrated loads on a beam
is a set of forces which act on some discrete (isolated) points.
A load density on a beam (force per length)
is a load blurred on some interval.
Symbolically one can write instead of (5.3) and (5.4) also
F
f (t) p f()
F
f() p f (t)
and
i2t
f (t) e
dt
and
f (t) =
f() ei2t d
with = 2 .
(5.5)
f() = A sinc () .
Now calculate the F-transform of a special dilated and right shifted version of f (t).
Hint: First operation is dilation, second is shifting. Time center of the resulting rectangular impulse
is 2 , duration time of the impulse is .
t 2
g(t) = A rect
with > 0
g() =
g(t) e
it
g() = A
sinc
A eit dt
1 ei
e
= A
i
With
one gets
dt =
2
g() = A sinc
sin
ei 2 i
2
e
i
ei 2 .
2
Apply the table of Fourier transformation pairs to short the calculations:
t 2
t
f (t) 7 f
7 f
f() 7 f( ) 7 f( ) ei 2
52
5.2
Plausibility considerations:
Let f (t) be an absolute integrable signal, short : f L1 (R). Such a signal is non-periodic.
Furthermore let f (t) be piecewise continuous differentiable.
Choose now a sufficient large T so, that f (t) is essentially localized in the interval [ T2 ,
Let fT(t) be a periodic signal fT : R R with
T T
fT(t) = f (t)
for all t ,
2 2
and
fT(t + T ) = fT(t)
for all
T
2 ].
Remark: Looking on fT(t) in one special period means looking on the essentially part of f (t) .
Remark: From T follows particularly fT(t) f (t) with L1 -convergence.
By setting
2
T
and k = k =
2k
T
the relations
The analyzing formula (5.1) can be compared now with (5.3) for sufficient large T :
T
)=
C(
k
Z2
fT(t) eik t dt
T2
So we get
f (t) eik t dt =
f(k )
2
) 1 f( )
f(k )
or
C(
with =
.
(5.6)
k
k
2
T
T
This means that the discrete spectral values of periodic time signals can be approximated by
calculation the continuous Fourier transform at the corresponding angular frequency values k .
)
C(
k
k=
) eik t
C(
k
1 X
1
f (k ) eik t
f() eit d .
2
2
k=
For T we get 0. Then the difference of the two series goes to zero. The right
expression represents the inverse Fourier transform.
With T follows for the angular frequency increment
point t of continuity
Z
1
f (t) =
f() eit d
2
53
This is the reconstruction formula (5.4) for non-periodic time signals. You get it as a limit case of
the periodic-time-signal considerations.
If t is no point of continuity then you get similar to subsection 3.10
f (t) + f (t+)
1
=
2
2
f() eit d .
Generally we identify functions which are distinct only on a set of measure 0. Then the last
representation for some special points t becomes irrelevant.
Example 5.2. Begin like in example 5.1 with
f (t) = A rect(t) .
With T > 1 you get by
fT(t) =
n=
f (t n T )
a T -periodic function with the property fT(t) = f (t) for T2 < t T2 . The periodic function
fT(t) is here constructed by a function f (t) with bounded support. f (t) is not periodic! Now calculate
the complex Fourier coefficients (5.1) for
1 =
From
eik t dt =
2
T
and
k = k 1 =
2k
T
T >1
with
eik t
exp(ik t)
eik t
+C =i
+C =i
+C
i k
k
k
for
k 6= 0
12
T2
exp(i
k
k
2 )
exp(i
k
k
2 )
12
A 2 i sin(
= i
T
k
) = A sinc k
C(
also valid for
k
T
2
Here you get with the F-transform of example 5.1
) = 1 f( )
C(
k
k
T
or
)=
C(
k
k
2 )
A sin( 2k )
=
k
T
2
0 = 0
f(k ).
In this example instead of the approximations (5.6) even the corresponding equations hold for T > 1.
Exercise 5.3. Realize the same operations and calculations for the signal g(t) in example 5.1
Theorem 5.4. For a time signal f with f L2 (R) and supp(f ) [ to , to + T ] and for a
corresponding periodization given by
fT(t) =
n=
f (t n T )
2. fT L2 ([ to , to + T ]), fT L2 [ T2 ,
period.
3. fT L1 ([ to , to + T ]),
period.
] , fT L2 ([ 0, T ]), the same finite energy in every
T
2
T
2
fT L1 [ T2 ,
] ,
4. The Fourier transform f() exists for all and is a continuous function with the special
properties
f() 0 for and f() 0 for . (Riemann-Lebesgue-Lemma)
5. f L2 (R). This means : Also the spectrum has finite energy.
6. Between the complex Fourier coefficients Ck of fT(t) and the Fourier transform f() of f (t)
the relations
) = 1 f( )
Ck = C(
k
k
T
or
)=
Ck = C(
k
f(k ) = f(k )
with
1
,
T
k =
k
T
f(k ) rect
k=
X
2 X
k
k
=
C(k ) rect
=T
C(k ) rect
k=
k=
If the complex Fourier coefficients are known then the continuous Fourier transform can be
approximated. The Fourier coefficients depend on the choosing of the above period length
T . By enlarging T the approximation of the Fourier transform with the Fourier coefficients
becomes better.
Remark 5.5. For a given time signal g L2 (R) L1 (R) we get by
f (t) = g(t) rect
t
T
signals
f (t)
and
fT(t) =
n=
f (t n T )
which satisfy the assumptions of theorem 5.4 with to = T2 . Especially proposition 6 of theorem 5.4
is valid. If the Fourier transform g is known (and of simple structure) but the Fourier transform f
not then can we try to approximate the Fourier coefficients
) = 1 f( )
Ck = C(
k
k
T
by
Ck = C(
) = g(k ) .
k
T
2
Z
Z
1
1
1
i
t
i
t
i
t
k
k
k
C
g(t)
e
dt
g(t)
e
dt
g(t)
e
dt
k
+
k
T
T
T
T2
or weakened but simplified
Ck Ck
T
Z 2
1
|g(t)| dt +
T
Z
T
2
55
|g(t)| dt
Z
g(t) eik t dt
T
2
R
R
R
R
R
R
i
t
i
t
k dt
k dt +
g(t)
e
|g(t)|
dt
|g(t)| dt
g(t)
e
|g(t)|
dt
+
|g(t)|
dt
+
T
T
T
Ck Ck
2
2
2
=
T
|
g (k )|
R2
Ck
f(k )
ik t
g(t)
e
dt
T
2
This are only plausibility considerations but try the application for some very rapid decaying time
signals with unbounded support.
For another period starting value to all calculations can be adapted simple.
5.3
Let the Fourier transform of a real signal f (t) be represented by f(). This spectral density or
spectrum f() is usually complex and can be written in normal form as
f() = Re{f}() + Im{f}() i ,
or short
if it dont cause confusion. The functions R() and I() are the real and the imaginary part of
the spectrum. In the polar form
f() = f() ei ()
or
f() = f() exp (i ())
the amplitude spectrum and the phase spectrum of the signal f are given by
p 2
f () = R () + I 2 (),
() = arg f()
R()
for I() 0
arccos
|f()|
() =
R()
arccos
for I() < 0
|f()|
undefined
for all with f(w) = 0
or
() =
2
arctan
I()
|f()|+R()
f or
f or
f
()
+ R() 6= 0
f () + R() = 0
If f (t) is real valued then the spectrum f() satisfies the properties that R() is even and I() is
odd. That means
f (t)
real valued
R() = R()
56
f (t)cos(t)dt
and
I() =
f (t)sin(t)dt .
If f (t) is a real time signal then its amplitude spectrum f() is even and its phase spectrum
() is odd. That means
and
() = ().
f () = f()
If f (t) is real valued, then with fe as the even part of f and fo as the odd part of f we get
F
fe (t) =
1
2
fo (t) =
1
2
and
The F-transform of a real and even function is real and even. The F-transform of a real and odd
function is pure imaginary and odd.
A real signal f (t) which can be expressed by
1
f (t) =
2
f() eit d
Z
Z
1
i() it
i(()+t)
f
()
e
e
d
=
f
()
d .
e
2
For real f (t) the amplitude spectrum f() is even and the phase spectrum () is odd. Then
also
sin(() + t) is an odd function for every fixed parameter t. So we get the representation
1
f (t) =
Z
f () cos(() + t) d
g(t) = rect
with > 0 is g() = sinc
ei 2 ,
|
g ()| = sinc
.
2
The phase spectrum is calculated with the help of
for
sinc
>0
2
2
()
=
sinc
<0
2 for
2
where the whole number k is choosen so that < .
57
by
= + 2 k ,
A = 1.
Exercise 5.7. Sketch the time signal g(t) of the last example.
Sketch an essentiell section of the corresponding amplitude spectrum |
g ()|.
Sketch the envelope of this amplitude spectrum and characterise its asymptotic behavior.
Sketch the phase spectrum.
Think about the essentiell support of |
g ()| which contains all significant angular frequencies. In
general the essentiell support is not the support. It must be defined in some sense. From this we get
the essentiell (angular frequency) bandwidth. In general it is not the (angular frequency) bandwidth
(exact bandwidth).
Exercise 5.8. Replace g(t) in example 5.6 by the time signal
t to
g(t) = rect
with some arbitrary fixed to ,
some arbitrary fixed
> 0.
Adapt the considerations and calculations of example 5.6 and that of the last exercise.
5.4
For the Fourier transformation of a linear combination of time signals the property
)
( n
n
n
X
X
X
k Ft {fk (t)} () =
k fk () ,
Ft
k fk (t) () =
k=1
k=1
k=1
holds that means the F-Transform is a linear operator (a linear map). A shorter formulation of
this superposition principle is given by
n
X
k=1
k fk (t) p
n
X
k fk () .
(5.7)
k=1
The proof follows from the fact that the integral is a linear functional.
In principle the F-Transform can be applied to complex valued time functions f (t) also. For the
conjugate
complex f (t) of f (t) you get
Z
n
o
Ft f (t) () =
f (t) eit dt
or shorter
F
f (t) p f()
(5.8)
f (t to ) p ei to f()
(5.9)
1
F
{ f (t + ) f (t )} p i f() sin( ) ,
2
f (t + ) f (t )
sin( )
F
p i f()
.
2
(5.10)
Example 5.9. Look at the examples 5.2 and 5.6 and calculate the F-transform of the following
time signal.
t 2
t + 2
rect
with parameter 6= 0 .
f (t) = rect
t
t
f () = exp i
() exp i
()
Ft rect
Ft rect
2
f() = 2 i sin
sinc
2
2
This (angular) frequency spectrum is pure imaginary and odd (time signal f (t) self is real and odd).
Here a time-limited signal was given (bounded time support), but its F-transform is not frequencylimited (no bounded frequency support).
Time scaling of a signal f (t) is connected with the following equation in frequency domain
Ft { f (a t) }() =
simpler formulated by
F
f (a t) p
In the case a < 0 the operator
1
F{ f (t) }() ,
|a|
1
f
|a|
a
for all
a 6= 0
(5.11)
f (t) 7 f (a t)
realises time dilation and time reflection.
Example 5.10. Find the F-transforms of the signal dilations
t
t
f1 (t) = rect
and
f2 (t) = rect
2
2
From the transform pair
results
for all
> 0.
t
F
f (t) = rect
p sinc
F
f1 (t) = f (2 t) = f1 (t) p
sinc
2
4
t
F
f2 (t) = f
= f2 (t) p 2 sinc( )
2
Sketch the two time signals and their amplitude spectra for some parameter > 0. Compare the
time signals, the amplitude spectra and their main lobes.
The main lobe width of |f1 ()| is twice as the main lobe width of |f()|, whereas the main lobe
width of |f2 ()| is half of the main lobe width of |f()|. Here the amplitudes of all time pulses are
1.
59
Exercise 5.11. Change all rectangular pulses of the last examples by appropriate multiplications
with constants, so that the signal energy becomes 1. Adapt for them the considerations and tasks
of the last example.
Choose then the coefficients so that you get rectangular impulses of L1 -Norm 1 and adapt again the
considerations.
A special case of the above time scalings is the time reversal operation (time reflection R)
R : f (t) 7 f (t)
The F-transform of g(t) = f (t) can be calculated with the help of
Ft {f (t)}() = F{f }() ,
shorter expressed by
F
f (t) p f() .
(5.12)
f (t) e
it
Z
Z
i t
f (t) e dt =
f (t) eit dt = f()
dt =
and
F
f (t) p f() ,
(5.13)
f1 () =
>0
et H(t) eit dt
t it
dt =
t=+
e(+i)t
=
( + i)
e(+i)t dt
t=o
f1 () =
= 2
i 2
2
+ i
+
+ 2
2. Use now the formula for time reflection to calculate the next signal spectrum.
f2 (t) = f1 (t) = et H(t)
60
f2 () =
1
i
for > 0
We get with
f3 (t) = f1 (t) + f1 (t) = f1 (t) + f2 (t)
f3 () =
1
1
+
+ i
i
the result
2
for > 0
+ 2
Neither the time representation nor the frequency representation of this signal has a bounded
support.
f3 () =
Duality properties :
F
f (t) p f()
1
F
f() p f (t)
F
f(t) p 2 f ()
f () p
F 1
(5.14)
1
f (t)
2
Proof of the first property : From the formula for F 1 you get
2f (t) =
f() eit d ,
f() eit d .
f(t) eit dt ,
f() p f (t)
=
=
F
f(t) p f ()
F 1
f () p f(t)
a2
1
a||
F
e
= g()
p
2
+t
a
Solution : By
for
a>0
2a
1 a|t|
1
F
=
e
p 2
2
+
2a
a + 2
and the duality property of the F-transform, we get
F
ea|t| p
a2
a2
1
1 a||
F
p 2
e
2
+t
2a
61
(5.15)
a||
1
F
p
e
2
+t
a
Conclusion
Z
a2
a||
1
F 1
e
p 2
a
a + t2
and
cos(t)
dt = ea||
2
2
a +t
a
a>0
a>0
for
sin(a t)
()
f or a > 0
Ft
t
t
F
rect
p sinc
2
t
F
p 2 a sinc(a )
a=
= rect
2
2a
1
t
F
p sinc(a )
rect
2a
2a
Apply the duality property and get with the even function rect(x)
F
sinc(a t) p 2
With
1
.
rect
2a
2a
sin(a t)
a sin(a t)
a
=
= sinc(a t)
t
at
for
a>0
sinc(2B t) p
1
rect
2B
4B
for
B>0
This two time signals (time filters) are signals (filters) with finite bandwidth. They have a bounded
-support.
Theorem 5.15. If the function f (t) has a Fourier transform f() which is is continuous at
= 0 , then
Z
f (0) =
f (t) dt
62
f() d
(t) p 1
(t to ) p ei to
and
(5.16)
Every time-shifted Dirac impulse contain all frequencies with the same amplitude |ei to | = 1, this
means that this impulse has a constant amplitude spectrum.
This results from
Z
(t to ) eit dt = exp(i to )
eit
because
is a continuous function of t .
eic t p 2 ( c )
and in particular
F1 {(
F 1
( c ) p
1 p 2 ()
(5.17)
( c ) eit d
1 ic t
e
2
1 ic t
F
e
p ( c )
2
F
or f( c ) p f (t) ei c t
(5.18)
This complex modulation modifies every time signal f (t) so that the spectral density will be shifted
(shifting of the corresponding angular frequency spectrum).
Sequently application of time dilation, complex modulation and F-transform yields to
1 c
F
f (at) eic t p
f
(5.19)
|a|
a
by using at first
F
f (at) p
and then the left of the formulas (5.18).
1
f
|a|
a
1
1 i
e f ( + c ) + ei f( c )
2
2
or shorter
1
1
fmod () = ei f( + c ) + ei f( c )
2
2
This results directly from formula (5.18).
63
(5.20)
|| > |c + o | and
f or
|| < |c o |
If above all f() is centered around 0 then fmod is centered around c . This means here that f()
is centered around c in (0, +) and centered around c in (, 0) . Illustrate this by a sketch.
As special examples of (5.20) we get
1
1
f ( c ) + f( + c )
2
2
(5.21)
1
1
f ( c )
f ( + c )
2i
2i
(5.22)
f (t) cos(c t) p
:
2
f (t) sin(c t) p
and
for =
5.5
for = 0 :
The energy contained in a real or complex time signal with f L2 (R) is defined by
E(f ) =
|f (t)|2 dt .
(5.23)
The integrand |f (t)|2 is called the energy density per time. Since for f L2 (R) the equations
Z
1
|f (t)|2 dt =
2
|f()|2 d =
|f()|2 d ,
(Parsevals theorem)
(5.24)
|f()|2 d
or
E(f ) =
|f()|2 d
(5.25)
2
2
|f ()| is the energy density per angular frequency and |f ()| is the energy density
Here
per frequency .
In particular : If f is quadratic integrable then f also and conversely.
More generally we get for f, g L2 (R) relations between the scalar products in time domain
and in frequency domains.
1
2
hf, git =
1
f (t) g(t) dt =
2
or
hf, git =
1 D E
f() g() d =
f , g
2
D
E
f() g() d = f, g
64
(5.26)
(5.27)
Example 5.18. For f (t) = rect(t) you get E(f ) = 1 and for g(t) = f ( t ) = rect( t ) you get
E(g) = if > 0 .
F
Using the energy theorem and rect( t ) p sinc 2 you can realise the equations
1
E(
g) =
2
2
Z
h
i2
t
sinc
d =
rect
dt =
2
> 0.
for
E(
g) =
2
Z
t
2
dt =
[ sinc ( ) ] d =
rect
for
> 0.
sinc2
sinc2 ( ) d =
2
d =
Proof that
sinc
2
1
p
rect
F 1
for
for
t
=: h (t)
>0
> 0.
>0
2
1 1
Calculate now for g the energy portion Ep in the -band [ 2
, ] respectively in the -band [ , ]
Substitution =
, d =
1
Ep =
2
sinc
2
d =
Z1
sinc2 () d 0, 924
5.6
Compare http://en.wikipedia.org/wiki/Convolution
The convolution
+
Z
(f g)(t) =
f (t ) g( ) d
or
+
Z
(g f )(t) =
f ( ) g(t ) d,
65
(5.28)
ist defined, if one of the two integrals almost every exists. If one of them exists almost every then
also the other with
(f g)(t) = (g f )(t)
Theorem 5.19. Convolution in L1 (R)
If f and g are elements of L1 (R) then the following properties hold:
1. (f g)(t) exists almost everywhere
2. f g L1 (R)
with
kf gk1 kf k1 kgk1.
f g L1 (R)
(5.29)
Theorem 5.20. For f, g, h L1 (R) and arbitrary C the following operation rules hold :
f ( g) = ( f ) g = (f g)
f (g + h) = (f g) + (f h)
f g = gf
f (g h) = (f g) h
L1 (R) becomes with the operations + and a commutative algebra. In L1 (R) does not
exists an identity element respect to the convolution. This means there is no function g L1 (R)
with (f g)(t) = f (t).
If f (t) is continuous around the time point t = 0 then its convolution with the Dirac impulse
(t) results in
+
+
Z
Z
f (t ) ( ) d =
f ( ) (t ) d = f (t)
(5.30)
(f )(t) =
( )(t) = (t),
( f )(t) = f (t )
(5.31)
( )(t) = + (t) = (t ( + ))
So (t) realizes a shifting of signals. In engineering notation you can formulate the above properties
also in the following way.
(t) f (t) = f (t),
(t ) f (t) = f (t )
(t ) (t ) = (t ( + ))
66
(5.32)
(5.33)
Lemma 5.22. If f (t) and g(t) are measurable functions and (f g)(t) exists almost everywhere
then
supp(f g) supp(f ) + supp(g)
(5.34)
Conclusions of this Lemma :
Convolution in the case of left-side limited supports
supp(f ) [a, +),
supp(g) [b, +)
supp(f g) [a + b, +)
(5.35)
supp(f g) (, c + d]
(5.36)
supp(f g) [a + b, c + d]
(5.37)
supp(g) (, d]
supp(g) [b, d]
In the case of special limited supports modifications of the formula (5.28) can be used to calculate
the convolution.
Theorem 5.23. If (f g)(t) exists almost everywhere then
supp(f ) [0, +)
supp(f ) [0, +)
supp(f ) [0, +)
supp(f ) [0, +)
and
and
+
Z
(f g)(t) =
f ( ) g(t ) d
(5.38)
(f g)(t) =
supp(g) [0, +)
supp(g) [0, +)
Zt
f (t ) g( ) d
(5.39)
(f g)(t) =
Zt
f (t ) g( ) d
(5.40)
(f g)(t) =
Zt
f ( ) g(t ) d
(5.41)
Theorem 5.24. If f (t) and g(t) are both piecewise continuous functions with supp(f ) [a, +)
and supp(g) [b, +) then their convolution (f g)(t) is for all t continuous and has the property
supp(f g) [a + b, +).
Corollary 5.25. If f (t) and g(t) are both piecewise continuous functions with compact support,
then their convolution (f g)(t) exists, has also a compact support and is continuous.
Now convolution of f (t) and g(t) in different function spaces,
Theorem 5.26. If f L1loc(R), g L1 (R) and supp(g) is bounded then the convolution (f g)(t)
is almost everywhere defined and belongs to L1loc(R).
67
q1
and
1 1
+ =1
p q
(conjugate H
older-exponents)
then (f g)(t) is defined everywhere. Furthermore (f g)(t) is then continuous and bounded on
R with
kf gk kf kp kgkq
Mostly used special cases :
p = 2, q = 2 results in
f, g L2 (R)
(f g)(t)
kf gk kf k2 kgk2 (5.42)
The convolution of two signals with finite energy is a continuous and bounded function on R.
p = 1, q = results in
f L1 (R), g L (R)
g(t) 7 (f g)(t) .
Such filtering improves here the regularity of the input signal g(t) .
Lets consider a further possibility of convolution.
Theorem 5.29. If f L1 (R) and g L2 (R) then exists (f g)(t) almost everywhere with
f g L2 (R) and
kf gk2 kf k1 kgk2
Such a filter f (t) maps a time signal with finite energy in a time signal with finite energy.
Theorem 5.30. (Derivations of convolution)
Lets assume that f L1 (R) and g C p (R). If in addition for k = 0, 1, , p the functions
g (k) (t) are bounded then
f g C p (R)
and
(f g)(k) = f g (k)
f
ur
are valid.
68
k = 1, 2, , p
Under suitable conditions the Fourier transform of a convolution (f g)(t) in the time domain is
the pointwise product of the two corresponding Fourier transforms.
Ft {(f g)(t)}() = Ft {f (t)}() Ft {g(t)}()
Similar the Fourier transform of a usual product of time signals can be calculated by
Ft {f (t) g(t)}() =
1
Ft {f (t)}() Ft {g(t)}()
2
5.7
5.8
compare with
http://en.wikipedia.org/wiki/Cross-correlation and
http://en.wikipedia.org/wiki/Autocorrelation
More in the lectures
69
(5.44)
f() = Ft {f (t)} ()
f (t to )
ei to f ()
f (a t)
1
|a|
eio t f (t)
f( o )
f(t)
2 f ()
f (n) (t)
(i )n f()
(i t)n f (t)
f(n) ()
Rt
f ( ) d
f( a )
f()
i
for a 6= 0
+ f(0) ()
(f g)(t)
f() g()
f (t) g(t)
1
2
(f g)()
70
Important examples :
(t n MT )
(t n MT )
2
MT
n=
n=
eikMT
k=
k=
2
MT
H(t)
()
tri(t)
sinc2 ( 2 )
(t)
2()
(t t0 )
eit0
eio t
2 ( 0 )
cos(0 t)
[( + 0 ) + ( 0 )]
sin(0 t)
i [(
rect(t)
sinc( 2 )
rect( at )
a sinc( a2 )
sgn(t)
2i
sinc(t)
rect( 2 )
Poisson formula
Heaviside
Triangular pulse :
tri(t) = (rect rect)(t)
0 ) ( + 0 )]
a>0
71
sinc(t)
)
rect( 2
e 2 2
2 2
2 e 2
H(t) et
1
+ i
>0
e|t|
2
2 + 2
>0
H(t) t et
1
( + i)2
>0
H(t) et cos(o t)
( + i)
0 2 + ( + i)2
>0
H(t) et sin(o t)
0
0 2 + ( + i)2
>0
t2
7
7.1
Compare:
http://en.wikipedia.org/wiki/Discrete_Fourier_transform
The discrete Fourier transform DFT is the most important discrete transform, used to realize a
practical Fourier analysis for sampled signals in engineering applications.
The DFT maps every discrete time signal with N samples on a special frequency domain representation. The output of the DFT is a discrete signal of the same length N .
The DFT requires a discrete input of finite length N (row or column vector). Such inputs are often
created by sampling a continuous signal in a chosen finite time interval of length T . The standard
form of this time segment is here [ 0, T ].
Generally an analog signal f (t) will be converted to a discrete signal by equally spaced sampling
the continuous signal.
See the definitions of sampling period and sampling frequency in
http://en.wikipedia.org/wiki/Sampling_%28signal_processing%29+
You have to chose a sufficient large time duration T in which the given continuous signal f (t) was
sampled to fk = f (tk ), k = 0, 1, 2, and a sufficient small sampling period t to get a realistic
frequency analysis of f (t).
But chose T not to large and t not to small (computing time).
Two principal cases for an appropriate choosing of T :
72
a) f (t) is essentially localized in an interval of length T . This means that a sufficient large part of
the signal energy is contained in the chosen interval.
b) If a) is not possible then reduce T in a practical way. But look careful on your physical and
mathematical model and decide, if you can get your expected calculation results with sufficient
correctness.
Theoretically the application of DFT in both cases is connected with a T -periodization.
Example 7.1. As an academical example the following signal with continuous domain let be given.
3 t
cos(5 t 6 ) for t 0
e
f (t) =
0
for t < 0
You can consider it in some chosen [ 0, T ] so that the case a) is valid. This restriction of f (t) is a
non-periodic signal. But its T-periodization, which starts in [ 0, T ] becomes of course T-periodic.
For our engineering applications only one basic period is of interest. In this period we sample f (t)
and get our discrete input signal for the DFT. The discrete output is a frequency spectrum. This is
only an academical example, because in practise we dont have a closed-form analytical expression
(also no approximation) before sampling the time signal.
Remark 7.2. If a continuous T -periodic signal f (t) is given by a closed-form analytical expression,
for instance by
T 2
f (t) = t
for t [ 0, T ] and f (t + T ) = f (t) for all t R.
2
then we have an special case of b). Now we sample f (t) in the given basic period of [ 0, T ]
with a sufficient small t by evaluation the fk = f (k t), k = 0, 1, 2, . Then we can
calculate the discrete spectrum with the help of Matlab-fft, vide infra. This gives the possibility of
quick signal approximation by trigonometrical polynomials connected with the corresponding spectral
decomposition (compare chapter Real and complex Fourier series).
The DFT can be computed efficiently in practice by using a fast Fourier transform algorithm (FFT).
The term FFT is often used to mean DFT, but DFT refers to a mathematical transformation of a
(time) signal and FFT refers to a specific family of algorithms for computing the DFT.
FFT-algorithms are implemented in many program systems (Matlab, Maple, Mathematica and
others).
FFT provides opportunities for fast calculations of many practical tasks,
for instance
- calculations of essential frequencies contained in a sampled signal,
- calculations of discrete convolutions with long filters
- approximation of continuous convolutions and
- calculations of signal correlations.
Remark 7.3. The input of the DFT could be a sampling of some continuous time signal f(t) with
the special sampling period t = 1 .
f0 = f(0),
f1 = f(1),
f2 = f(2),
fN 1 = f(N 1)
f0 , f1 , , , fN 1
73
(7.1)
The chosen time duration of the continuous signal f(t) is in this special case T = N .
In principle the DFT implies a N -periodization of the discrete input signal f (theory).
fk = fk+N
kZ
for all
So we would get
f
=
=
f2 , f1 , f0 , f1 , , fN 1 , fN , fN +1 ,
, fN 2 , fN 1 , f0 , f1 , , fN 1 , f0 , f1 ,
, f(N 2), f(N 1), f(0), f(1), , f(N 1), f(0), f(1),
With this N -periodization is connected a T -periodization fp (t) of f(t), which starts on the interval
[ 0, T ].
This results in fp (t) = fp (t + T ) for all t.
If you know the values in one period, then all values are defined. So the next definition is reasonable.
With the imaginary unit i and N as the primitive Nth root of 1 is given the following definition.
Definition 7.4 (DFT). The sequence of N complex numbers (vector with N components)
f = f0 , f1 , , , fN 1
F0 , F1 , , , FN 1
N
1
X
fn kn
N
N = e
with
2i
N
k = 0, . . . , N 1
n=0
(7.2)
k = 0, . . . , N 1,
with
n = 0, . . . , N 1
N
1
X
fn e
2i
kn
N
k = 0, . . . , N 1
with
n=0
Remark 7.5. In principle there is for every positive integer N one DFT, so this N must be careful
chosen at the beginning.
The DFT implies a N -periodization of its discrete output signal F also (theory). From
(k+N ) n
n
N
= k
N
you can verify that the formula (7.2) for DFT is defined for all k Z with Fk+N = Fk . So the
frequency domain representation becomes also N -periodic.
Theorem 7.6. The inverse transform of (7.2) exists and is called inverse discrete Fourier transform (IDFT). It is given by
fn =
N 1
1 X kn
Fk N
N
with
N = e
k=0
74
2i
N
n = 0, . . . , N 1
(7.3)
k = 0, . . . , N 1,
with
n = 0, . . . , N 1
N 1
1 X 2i kn
Fk e N ,
N
n = 0, . . . , N 1
k=0
Remark 7.7. Mostly the discrete time signal f is real valued. But the DFT F can be a complex
valued vector even if f is real valued.
From
k(n+N )
N
= kn
N
results that the formula (7.3) for IDFT is defined for all n Z with
periodicity of the discrete time signals is confirmed by the IDFT.
fn+N = fn . So the N -
2i
Remark 7.8. With the N th standard unit root N = e N you get the special Vandermonde
matrix F of size (N, N ) and its generally nth column F(: , n) by
00
10
20
F=
N
..
(N 1)0
01
11
21
02
12
22
..
.
..
.
(N 1)1
(N 1)2
0(N 1)
...
...
...
..
1(N 1)
2(N 1)
..
.
(N 1)(N 1)
. . . N
0(n1)
1(n1)
.
2(n1)
F(: , n) =
..
.
(N 1)(n1)
N
(7.4)
The column vectors of the matrix F form an orthogonal basis in the space C of N-dimensional
complex vectors. But this basis is not orthonormal. With the scalar product (4.13) the column
vectors of F satisfy
h F(: , n) , F(:, m) i = N (n, m)
N
where (n, m) is the Kronecker delta. A similar property holds for the rows of F.
Hint: F(: , m) results from Matlab-notation. In a similar way F(k, :) denotes the row with the
index k.
By using column vectors f and F for the time sampling and the corresponding frequency spectrum
the DFT (7.2) can be realized in matrix form
F = F f .
The matrix F is symmetric. Its inverse can be calculated by the formula
F1 =
1
F
N
in which F is the adjoint matrix of F. The adjoint matrix will be called also as conjugate transpose
matrix or Hermitian transpose matrix.
75
00
01
N
N
10
11
N
N
21
1
1
20
N
F =
N
N
..
..
.
.
(N 1)0
(N 1)1
02
12
...
0(N 1)
1(N 1)
...
...
..
.
..
22
(N 1)2
2(N 1)
..
.
(N 1)(N 1)
. . . N
(7.5)
The inverse discrete Fourier transform (7.3) can be realized in matrix form now.
f = F1 F
Hint: If you have to calculate (7.4) or (7.5) for some N , for instance N = 4 or N = 5, then you
can use
p+kN
= pN , for all k Z
N
to simplify the work with considerations modulo N.
By using the floor function (see Matlab help) we define now a special remainder function, which
results in non-negative integer values of one indexing period. Here N > 0 is the length of this
indexing period.
jxk
N,
x Z, N N
(7.6)
(x)N := x
N
(x)N computes the unique nonnegative remainder on division of the integer x by the positive integer
N . It returns an integer r such that x = q N + r holds for some integer q. In addition, we have
r = (x)N
The interpretation of
(x y)N
0r<N
xy
= (x y)
N
is clear: calculate first the difference and then the remainder function.
With the function (7.6) we can define operations on infinite discrete periodic sequences by restricting
them on one basic period of length N (vector with N components).
fn = f0 , f1 , , , fN 1 ,
n = 0, 1, , N 1
Simple circular right shift of fn
f(n1)N =
fN 1 , f0 , f1 , , , fN 2
f1 , f2 , , , fN 1 , f0
fN k , fN k+1 , , f0 , , , fN k1
7.2
Let fn , gn , hn , be discrete time signals with the same length N and the
k, H
k,
index variable n = 0, 1, . . . , N 1. The corresponding DFT-spectra Fk , G
index variable k = 0, 1, . . . , N 1 are then also of length N . As above we use
N = e
with the
2i
N
N
1
X
fm g(nm)N
(7.7)
m=0
fn = f(n)N
(7.8)
(7.9)
(7.10)
(7.11)
(7.12)
(7.13)
(7.14)
Fk R,
fn = f(n)N
Fk = F(k)N
(7.15)
(7.16)
1
k
Fk ~ G
N
(7.17)
7.3
N 1
1 X
fn gn =
Fk Gk
N
(7.18)
k=0
1
t
is the time sampling period. It is the time between neighboring samples. This can be also
considered as the time resolution of the measuring.
t1 = t,
tN 1 = (N 1) t
t[2] = t,
t[N ] = (N 1) t
The measured values (of elongation, force, acceleration velocity, et cetera) at the discrete
points
f0 = f (0), f1 = f (t), , f (N 1) = f ((N 1) t)
become in Matlab indexing the form
f [1] = f (0),
f [2] = f (t),
f [N ] = f ((N 1) t)
f (t)
1
sampling frequency
t
The perfect reconstruction property is fulfilled
Sa =
if Sa > 2 max
or if
2 t < Tm
1
1
1
=
=
.
T
N t
N
7.4
1
1
=
T
N t
(7.19)
In most books and implemented programs the DFT is given without the sampling period t as
scaling factor. In this case all relations will be considered for the special case t = 1 only. For
instance the FFT-algorithm in Matlab f f t is connected with t = 1 . If you use Matlab include
DF T {fn } = f f t(fn )
N
1
X
fn kn
N
with
N = e
2i
N
k = 0, . . . , N 1
n=0
(7.20)
N
1
X
Fk kn
N
with
k=0
1
1
=
,
T
N t
n = 0, . . . , N 1 (7.21)
t }
= DF T {fn ,
t }
+ DF T {gn ,
t }
(7.22)
(7.23)
f
,
t = F
for every fixed m Z
n
N
N
Reversal in time domain Reversal in frequency domain
DF T f(n)N , t = F(k)N
(7.24)
(7.25)
= F(k)N
(7.26)
(7.27)
fn = f(n)N
80
Fk R,
Fk = F(k)N
(7.28)
DF T {fn ~ gn ,
t }
k
= Fk G
(7.29)
t }
k
= Fk ~ G
with
1
1
=
T
N t
(7.30)
N
1
X
fn gn =
n=0
N
1
X
k
Fk G
with
k=0
1
1
=
T
N t
(7.31)
If we change the scaling in the standard-DFT (7.2) by the factor t, then compared with the set of
properties from (7.9) until (7.18) only the last three formulas (7.29), (7.30) and (7.31) are changed.
Interpretation of the DFT-spectrum for even N
With Ny = N2 the Nyquist-frequency becomes
ny
N
N
1
1
1
= Ny =
=
=
=
2
2 N t
2 t
2
1
t
The Nyquist-frequency is the half of the sampling frequency. You can interpret the spectrum Fk
of a t-sampled time signal fn now by
F0 = F (0),
F1 = F (),
N
2
FNy 1 = F ((Ny 1) ),
, FN 2 = F (2),
FN 1 = F ()
(2 Ny ) ,
2 ,
Remark 7.9. In generally the sampled time signals are real in our applications. By (7.27) yo get
then
Fk = F(k)N .
In the N -periodization this is connected with an even real part and an odd imaginary part. Now all
frequency information is contained in the left half of the t-scaled output-spectrum of Matlab:
t
F [1] = F0 ,
F [2] = F1 , ,
F0 = F (0),
F1 = F (), ,
F [Ny + 1] = FNy
with
Ny =
N
2
Often only sections of this half part spectrum are plotted to get better visual frequency resolution.
81
Remark 7.10. In applications it is often necessary to filter t-sampled time signals gn of finite
length N . Such filtering can be realized by circular convolution.
gn 7 fn ~ gn
In the spectral domain of the
t-scaled
Compare (7.29). If fn is real valued and circular symmetric then the spectrum Fk also. Compare
(7.28). By using the sampling function sinc and circular shifting in the time domain you can
construct circular symmetric filters fn with the property
1 for 0 k Nf
1
N
1 for N Nf k N 1
Fk =
with Nf <
.
t
2
0 for Nf k N Nf 1
With the corresponding time representation
hn =
1
fn
t
you can realize in a computer program an ideal distortion-free low pass filtering now. Distortion-free
k will be changed not by filtering. The corresponding
means, that the phase-spectrum of the signal G
frequency band is given by
0 , f
with
f = N f
k =
Verify that the spectrum H
1
t
Fk is circular symmetric.
The real (Re or R) and imaginary part (Im or I) of this discrete spectrum, the amplitude spectrum
(magnitude) and the phase spectrum (argument) are defined similarly to the case of continuous
Fourier transform.
Amplitude spectrum :
|F | = |F0 |, |F1 |, , , |FN 1 |
with
|Fk | =
and
Phase spectrum :
with
q
[R(Fk )]2 + [I(Fk )]2
= arg(F ) =
0 , 1 , , , N 1
k = arg(Fk ) = atan2 I(Fk ), R(Fk )
82
Example 1.1
Example 1.2
83
Example 1.3
Example 1.4
84
Example 1.5
Example 1.6
85
Example 1.7
Example 1.8
86
Example 1.9
87
88
Example 1.10
89
Example 2.1
Example 2.2
90
Example 2.3
91
Example 2.4
92
Example 2.5
Example 2.6
93
Example 2.7
94
Example 2.8
95
Example 2.9
Example 2.10
96
Example 2.11
97
Example 2.12
Example 2.13
98
10
Example 3.1
Example 3.2
99
Example 3.3
100
101
References
[1] G. Bachman. Fourier and wavelet analysis. Springer, New York, 2000.
[2] W. Bani. Wavelets: Eine Einf
uhrung f
ur Ingenieure. Oldenbourg Verlag, M
unchen, 2001.
[3] Y. T. Chan. Wavelet Basics. Kluver Academic Publishers, Boston, Dordrecht, London, 1995.
[4] C. K. Chui. An Introduction to Wavelets. Wavelet Analysis and its Applications. Academic
Press, Boston, San Diego, New York, London, Sydney, Tokyo, Toronto, 1992.
[5] I. Daubechies. Ten Lectures on Wavelets. Society for Industrial and Applied Mathematics
(SIAM), Philadelphia, 1992.
[6] O. Follinger. Laplace- und Fourier-Transformation. H
uthig, Heidelberg, 1993.
[7] O. Follinger. Laplace-, Fourier- und z-Transformationen. H
uthig, Heidelberg, 2003. 8. u
berarb.
Aufl. / bearb. von Mathias Kluwe, 424 S.
[8] K. Grochenig. Foundations of time-frequency analysis. Birkhauser, Boston, 2001.
[9] G. Kaiser. A Friendly Guide to Wavelets. Birkhauser, Boston, Basel, Berlin, 1994.
[10] A. K. Louis and P. Maa and A. Rieder. Wavelets: Theorie und Anwendungen. Teubner,
Stuttgart, 2nd edition, 1998.
[11] S. Mallat. A Wavelet Tour of Signal Processing. Academic Press, 1999.
[12] K. Markwardt. Die schnelle Wavelet-Transformation als Grundlage f
ur Verfahren zur Systemund Parameteridentifikation. ISM-Berichte, Bauhausuniversitat Weimar, 2007. 128 Seiten,
ISSN: 1610-738.
[13] D. C. Montgomery. Applied statistics and probability for engineers. Wiley, Hoboken, 2006.
[14] H. G. Natke. Einf
uhrung in Theorie und Praxis der Zeitreihen- und Modalanalyse: Identifikation schwingungsf
ahiger elastomechanischer Systeme. Vieweg /and Sohn Verlagsgesellschaft,
Braunschweig/Wiesbaden, 1992.
[15] H. J. Nussbaumer. Fast fourier transform and convolution algorithms. Springer, Berlin, 1981.
[16] Resnikoff. Wavelet Analysis. Springer, New York-Berlin-Heidelberg, 1998.
[17] S. W. Smith. Digital signal processing: A practical guide for engineers and scientists. Amsterdam, 1955.
[18] G. Strang and T. Nguyen. Wavelets and Filter Banks. Wellesley-Cambridge Press, Wellesley
MA 0218181 USA, 1997.
[19] T. Westermann. Mathematik f
ur Ingenieure mit Maple, Differential- und Integralrechnung f
ur
Funktionen mehrerer Variablen, gew
ohnliche und partielle Differentialgleichungen, FourierAnalysis, graph. Darst. + 1 CD-ROM (12 cm). Berlin [u.a.], 1997. Umfang: XIV, 563 S.
102