Eece253 01 Intro

EECE/CS 253 Image Processing
Richard Alan Peters II

Department of Electrical Engineering and
Computer Science
Fall Semester 2011
Lecture Notes: Introduction and Overview
This work is licensed under the Creative Commons Attribution-Noncommercial 2.5 License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc/2.5/ or
send a letter to Creative Commons, 543 Howard Street, 5th Floor, San Francisco, California, 94105, USA.
. 1 % { . { . . . . .
Introduction and Overview
This presentation is an
overview of some of the
ideas and techniques to be
covered during the course.
25 August 2011 1999-2011 by Richard Alan Peters II 2
1. Image formation
2. Point processing and equalization
3. Color correction
4. The Fourier transform
5. Convolution
6. Image sampling, warping, and stitching
7. Spatial filtering
8. Noise reduction
9. Mathematical morphology
10. High dynamic range imaging
11. Image compression
Topics
Wallace and Gromit
Wallace
Gromit
likes cheese
reads Electronics for Dogs
http://www.aardman.com/wallaceandgromit/index.shtml
Wallace and Gromit will be subjects of some of the imagery in this introduction.
Image Formation
Image Formation
Image Formation
projection
through lens
image of object
Image Formation
projection onto
discrete sensor
array.
digital camera
Image Formation
sensors register
average color.
sampled image
Image Formation
continuous colors,
discrete locations.
discrete real-
valued image
Digital Image Formation: Quantization
continuous color input
d
i
s
c
r
e
t
e

c
o
l
o
r

o
u
t
p
u
t

continuous colors
mapped to a finite,
discrete set of colors.
Sampling and Quantization
pixel grid
sampled real image quantized sampled &
quantized
Digital Image
a grid of squares,
each of which
contains a single
color
each square is
called a pixel (for
picture element)
Color images have 3 values per
pixel; monochrome images have
1 value per pixel.
Color Images
Are constructed from three
intensity maps.
Each intensity map is pro-
jected through a color filter
(e.g., red, green, or blue, or
cyan, magenta, or yellow) to
create a monochrome image.
The intensity maps are
overlaid to create a color
image.
Each pixel in a color image is
a three element vector.
Color
Images
On a
CRT
Point Processing
original + gamma - gamma + brightness - brightness
original + contrast - contrast histogram EQ histogram mod
Color Processing
requires some
knowledge of
how we see
colors
Eyes Light Sensors
#(blue) << #(red) < #(green)
cone density near fovea
Color Sensing / Color Perception
These are approximations
of the responses to the
visible spectrum of the
red, green, and blue
receptors of a typical
human eye.
These are
approximations of
the responses to
the visible
spectrum of the
red, green,
and blue
receptors of a
typical human eye.
The simultaneous red + blue
response causes us to
perceive a continuous range
of hues on a circle. No hue is
greater than or less than any
other hue.
l
u
m
i
n
a
n
c
e

h
u
e

s
a
t
u
r
a
t
i
o
n

photo receptors brain
The eye has 3 types of photoreceptors:
sensitive to red, green, or blue light.
The brain transforms RGB into separate
brightness and color channels (e.g., LHS).
Color Perception
all bands luminance chrominance
red green blue
16 pixelization of:
luminance and chrominance
(hue+saturation) are perceived
with different resolutions, as
are red, green and blue.
Color Perception
all bands luminance chrominance
red green blue
16 pixelization of:
Color Balance
and Saturation
Uniform changes in color
components result in
change of tint.
E.g., if all G pixel values are
multiplied by > 1 then the
image takes a green cast.
Color Transformations
222
222
218
222
222
185
17
122
114 236
227
106
240
171
103
240
171
160
17
121
171 240
230
166
17 17
122 121
114 171
222 222
222 222
185 218
240 240
171 171
103 160
236 240
227 230
106 166
Image aging: a transformation, , that mapped:
The 2D Fourier Transform of a Digital Image
2 1 1
0 0
, , ,
ur vc
i R C
R C
u v
I r c u v e I
1 1 2
1
0 0
( , )
ur vc
R C i
R C
RC
r c
u,v I r c e I
Let I(r,c) be a single-band (intensity) digital image with R
rows and C columns. Then, I(r,c) has Fourier representation
where
are the R x C Fourier coefficients.
these complex
exponentials are
2D sinusoids.
2D Sinusoids:
orientation
... are plane waves with
grayscale amplitudes,
periods in terms of lengths, ...
2
, cos cos sin 1
2 C R
A c r
I r c
A
= phase shift
r
c
2D Sinusoids:
... specific orientations,
and phase shifts.
r
c
r
c
The Value of a Fourier Coefficient
is a complex
number with a
real part and an
imaginary part.
If you represent
that number as a
magnitude, A, and
a phase, ,
..these represent the amplitude
and offset of the sinusoid with
frequency and direction .
The Sinusoid from the Fourier Coeff. at (u,v)
Here is the same coefficient plotted as
magnitude, A, and a phase, , and displayed
in the space domain as a sinusoid.
I
|F{I}| [F{I}]
The Fourier Transform of an Image
magnitude phase
Continuous Fourier Transform
The continuous Fourier
transform assumes a
continuous image exists
in a finite region of an
infinite plane.
2 ( )
I , ,
i uc vr
r c u v e dudv I
2 ( )
, I ,
i uc vr
u v r c e dcdr I
The BoingBoing Bloggers
Discrete Fourier Transform
The discrete Fourier
transform assumes a
digital image exists on a
closed surface, a torus.
1 1 2
0 0
I ( )
uc vr
R C i
C R
v u
r,c u,v e I
1 1
2
0 0
, I ,
cu rv
R C
i
C R
r c
u v r c e I
The BoingBoing Bloggers
Convolution
16 , 16 c r
0 , 0 c r
16 , 16 c r 16 , 16 c r
16 , 16 c r
Sum times 1/5
Sums of shifted and
weighted copies of
images or Fourier
transforms.
Convolution Property of the Fourier Transform
The Fourier Transform of a
product equals the
convolution of the Fourier
Transforms. Similarly, the
Fourier Transform of a
convolution is the product of
the Fourier Transforms
.
by computed be can n convolutio spatial a Then,
tion multiplica pointwise represents
n convolutio represents
. } {
Moreover,
. } {
Then,
). , ( and ) , ( Transforms Fourier
have ) , ( and ) , ( functions Let
1
G F g f
G F g f
G F g f
v u G v u F
c r g c r f
-
F
F
F
Sampling, Aliasing, & Frequency Convolution
aliasing (the jaggies) no aliasing (smooth lines)
Sampling,
Aliasing, &
Frequency
Convolution
(a) (b)
(c) (d)
(a) aliased
(b) power spectrum
(c) unaliased
(d) power spectrum
8 16
Resampling
nearest neighbor nearest neighbor
bicubic interpolation bicubic interpolation
(resizing)
Rotation
a n d m o t i o n b l u r

Image Warping
Panorama via Overlay
Originals
Merged
*

*
not so good.
B
r
u
n
o

P
o
s
t
l
e

h
t
t
p
:
/
/
h
u
g
i
n
.
s
o
u
r
c
e
f
o
r
g
e
.
n
e
t
/
t
u
t
o
r
i
a
l
s
/
t
w
o
-
p
h
o
t
o
s
/
e
n
.
s
h
t
m
l

Panorama via Stitching
Originals
Merged
*

*
much better.
B
r
u
n
o

P
o
s
t
l
e

h
t
t
p
:
/
/
h
u
g
i
n
.
s
o
u
r
c
e
f
o
r
g
e
.
n
e
t
/
t
u
t
o
r
i
a
l
s
/
t
w
o
-
p
h
o
t
o
s
/
e
n
.
s
h
t
m
l

Gaussian LPF in FD Original Image Power Spectrum
Image size: 512x512
SD filter sigma = 8 Frequency Domain (FD) Filtering
Original Image Filtered Image Filtered Power Spectrum
Image size: 512x512
SD filter sigma = 8 FD Filtering: Lowpass
Image size: 512x512
FD notch sigma = 8
FD Filtering: Highpass
Image size: 512x512
FD notch sigma = 8
FD Filtering: Highpass
signed image with
0 at middle gray
original blurred sharpened
Spatial Filtering
Spatial Filtering
bandpass
filter
unsharp
masking
original
Spatial Filtering
bandpass
filter
unsharp
masking
original
signed image with
0 at middle gray
Motion Blur
vertical regional
zoom
rotational
original
color noise blurred image color-only blur
Noise Reduction
5x5 Wiener filter color noise blurred image
Noise Reduction
Noise Reduction
original
periodic
noise
frequency
tuned filter
Shot Noise or Salt & Pepper Noise
+ shot noise - shot noise s&p noise
Nonlinear Filters: the Median
s&p noise original median filter
Nonlinear Filters: Min and Maxmin
+ shot noise min filter maxmin filter
Nonlinear Filters: Max and Minmax
- shot noise max filter minmax
Nonlinear Processing: Binary Morphology
L shaped SE
O marks origin
Foreground: white pixels
Background: black pixels
Cross-hatched
pixels are
indeterminate.
Used after opening to grow back pieces of the original
image that are connected to the opening.
Permits the removal of small regions that are disjoint
from larger objects without distorting the small
features of the large objects.
original opened reconstructed
Nonlinear Processing: Binary Reconstruction
L shaped SE
O marks origin
Foreground: white pixels
Background: black pixels
Cross-hatched
pixels are
indeterminate.
Nonlinear Processing: Grayscale Morphology
Grayscale Morphology: Opening
opening: erosion then dilation opened & original
Grayscale Morphology: Opening
erosion & opening erosion & opening & original
reconstructed opening original
Nonlinear Processing: Grayscale Reconstruction
Forensic Analysis of Photographs
Photographs by Robert Fenton of a battlefield in the Crimean war taken on 23 April 1855.
From Morris, Errol, Which Came First, the Chicken or the Egg?, Parts 1-3, New York
Times, Zoom Editorial Section, 25 Sept. 2007 (pt.1), 7 Oct. 2007 (pt.2), 30 Oct. 2007 (pt.3).
Which came first?
Photographs by Robert Fenton of a battlefield in the Crimean war taken on 23 April 1855. From Morris, Errol, Which Came First, the
Chicken or the Egg?, Parts 1-3, New York Times, Zoom Editorial Section, 25 Sept. 2007 (pt.1), 7 Oct. 2007 (pt.2), 30 Oct. 2007 (pt.3).
Which came first?
Photographs by Robert Fenton of a battlefield in the Crimean war taken on 23 April 1855. From Morris, Errol, Which Came First, the
Chicken or the Egg?, Parts 1-3, New York Times, Zoom Editorial Section, 25 Sept. 2007 (pt.1), 7 Oct. 2007 (pt.2), 30 Oct. 2007 (pt.3).
Which came first?
High Dynamic Range
(HDR) Imaging
under exposed
B
a
r
t
l
o
m
i
e
j

O
k
o
n
e
k

h
t
t
p
:
/
/
w
w
w
.
e
a
s
y
h
d
r
.
c
o
m
/
e
x
a
m
p
l
e
s
.
p
h
p

High Dynamic Range
(HDR) Imaging
default exposure
B
a
r
t
l
o
m
i
e
j

O
k
o
n
e
k

h
t
t
p
:
/
/
w
w
w
.
e
a
s
y
h
d
r
.
c
o
m
/
e
x
a
m
p
l
e
s
.
p
h
p

High Dynamic Range
(HDR) Imaging
over exposed
B
a
r
t
l
o
m
i
e
j

O
k
o
n
e
k

h
t
t
p
:
/
/
w
w
w
.
e
a
s
y
h
d
r
.
c
o
m
/
e
x
a
m
p
l
e
s
.
p
h
p

High Dynamic Range
(HDR) Imaging
combined
B
a
r
t
l
o
m
i
e
j

O
k
o
n
e
k

h
t
t
p
:
/
/
w
w
w
.
e
a
s
y
h
d
r
.
c
o
m
/
e
x
a
m
p
l
e
s
.
p
h
p

Image Compression
Yoyogi Park, Tokyo, October 1999. Photo by Alan Peters.
Original image is
5244w x 4716h
@ 1200 ppi:
127MBytes
Image Compression: JPEG
J
P
E
G

q
u
a
l
i
t
y

l
e
v
e
l

F
i
l
e

s
i
z
e

i
n

b
y
t
e
s

J
P
E
G

q
u
a
l
i
t
y

l
e
v
e
l

F
i
l
e

s
i
z
e

i
n

b
y
t
e
s

Image Compression: JPEG
Image Compositing
Combine parts from separate images to form a new image.
Its difficult to do well.
Requires relative positions, orientations, and scales to be
correct.
Lighting of objects must be consistent within the separate
images.
Brightness, contrast, color balance, and saturation must
match.
Noise color, amplitude, and patterns must be seamless.
Prof. Peters in his home office. Needs a better shirt.
Image Compositing Example
This shirt demands a monogram.
He needs some more color.
Nice. Now for the way hed wear his hair if he had any.
He cant stay in the office like this.
Wheres a hepcat Daddy-O like this belong?
In the studio!
Collar this jive,
Jackson. Like
crazy, Man !

Eece253 01 Intro

Hochgeladen von

Dokumentinformationen

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Eece253 01 Intro

Hochgeladen von

Copyright:

Verfügbare Formate

EECE/CS 253 Image Processing

Richard Alan Peters II

Das könnte Ihnen auch gefallen