9/2/2010

SGN-3016 Digital Image Processing (5 cr)

Lecturer:
Lectures:

Moncef Gabbouj
Term 1 (Periods I and II), Room TB 223, Fridays12:15 14.00

Exercises and Assistants:

Dr. Esin Guldogan (Office TX xxx)
Group 1: Tuesdays
14.15-16.00, room TC 415
Group 2: Wednesdays 14.15-16.00, room TC 415
Group 3: Thursdays
14.15-16.00, room TC 415
Course webpage: http://www.cs.tut.fi/~moncef/SGN-3016-DIP/
First Lecture:
Friday3 September 2010
First Exercises:
Tuesday 7th September 2010 (Group 1), Wednesday 8th September 2010 (Group 2)
and Thursday 9th September 2010 (Group 3). Each student is assigned to ONE exercise group!
Description: Basic principles and concepts of image processing will be covered in the course.
Textbook:
Rafael C. Gonzalez and Richard E. Woods, Digital Image Processing, Third Edition, Prentice Hall, 2007,
Chapters 1-6.
Other references:
The Image Processing Handbook, John C. Russ, Editor, CRC Press, 1999.
Introduction to Digital Image Processing with Matlab, A. McAndrew, Thomson, 2004.
1.1

Chapters to be Covered
Chapter 1: Introduction to Digital Image Processing
Chapter 2: Digital Image Fundamentals
Chapter 3: Intensity Transformations and Spatial Filtering
Chapter 4: Filtering in the Frequency Domain
Chapter 5: Image Restoration and Reconstruction
Chapter 6: Color Image Processing

1.2

9/2/2010

Course Goals and Outcomes

Course Goals: This course is designed to help the student:
Apply principles and techniques of digital image processing in applications related
to digital imaging system design and analysis.
Analyze and implement image processing algorithms.
Gain hands-on experience in using software tools for processing digital images.
Course Outcomes: This course requires the student to demonstrate the ability to:
Explain the basic elements and applications of image processing
Analyze image sampling and quantization requirements and implications
Perform Gray level transformations for image enhancement
Apply histogram equalization for image enhancement
Use and implement order-statistics image enhancement methods
Design and implement two-dimensional spatial filters for image enhancement
Model the image restoration problem in both time and frequency domains
Explain Wiener filtering for de-blurring and noise removal
Explain the representation of colors in digital color images
Use Matlab to implement different image processing tasks
Document implementation code, report experimental results and draw proper
conclusions
Prepare and submit a (optional) project report.

1.3

Course Schedule

03.09. Introduction to Digital Image Processing

10.09. Chapter 2: Digital Image Fundamentals
17.09. Chapter 2: Digital Image Fundamentals (contd)
24.09. Chapter 3: Intensity Transformation and Spatial Filtering
01.10. No lecture
08.10. Chapter 3: Intensity Transformation and Spatial Filtering (contd)
15.10. Chapter 4: Filtering in the Frequency Domain

18.-22.10. Exam week

29.10.
29 10 Chapter
Ch
44: Fil
Filtering
i in
i the
h Frequency
F
Domain
D
i (contd)
(
d)
05.11. Chapter 4: Filtering in the Frequency Domain (contd)
12.11. Chapter 5: Image Restoration
19.11. Chapter 5: Image Restoration (contd)
26.11. Chapter 6: Color Image Processing
03.12. Chapter 6: Color Image Processing (contd) and Course Review
1.4

9/2/2010

General Information
Prerequisites
Students should be familiar with mathematical analysis, matrix theory,
probability, linear systems theory, and computer (Matlab) programming.
Requirements
One final exam, homework and attendance of the exercises and an optional
computer project. The optional project may not raise your course grade by
more than one point.
To pass the course, you need to get at least 50% of the exam points and
attend a minimum of 8 exercises.
Exam Dates
13 Dec 2010, 9.00 - 12.00, Make-up 24 Jan 2011, 9.00 - 12.00 and 7 March
2011, 9.00-12.00. Pre-registration for ALL exams is mandatory!
Attendance
Highly recommended for the lectures as from time to time, additional topics,
1.5
not covered in the book, will be discussed in class

Chapter 1: Introduction
Early stages of digital photography

over
85-year old!

1.6

9/2/2010

Chapter 1: Introduction

1.7

Chapter 1: Introduction
In contrast, look at the image of the smallest object ever photographed

1.4 nanometer-long pentacene molecule comprised of 22 carbon atoms

and 14 hydrogen atoms. You can actually make out each of those atoms
and their bonds, and it
it'ss thanks to the atomic force microscope.
http://gizmodo.com/53469
64/crazy+powerful-ibmmicroscope-takes-first-3dimage-of-molecularatomic-bonds
1.8

9/2/2010

Chapter 1: Introduction

A team from IBM Research Zurich used what is known as an atomic

force microscope or AFM to photograph the molecule at using a
silicon microscale cantilever coated in carbon dioxide lasers,
an "ultrahigh vacuum" and temperature around 5 degrees Kelvin!
1.9

Chapter 1: Introduction

FIGURE 1.4 The first picture of the moon by a US spacecraft.

Ranger 7 took this image on July 31, 1964, about 17 minutes
before impacting the lunar surface (Courtesy of NASA)

1.10

9/2/2010

Chapter 1: Introduction
Radiation-based images
Images based on radiation from ElectroMagnetic spectrum are most familiar,
e.g. X-ray images and visible spectrum images.
EM waves can be thought of as propagating sinusoidal waves of varying
wavelengths or as a stream of massless particles, each traveling in a wavelike
pattern and moving at the speed of light.

Each massless particle contains a certain amount (or bundle) of energy. Each
bundle of energy is called a photon.
If spectral bands are grouped according to energy per photon, we obtain the
spectrum below.
100

1.11

Chapter 1: Introduction
Radiation-based images

Each massless particle contains a certain amount (or bundle) of energy

energy. Each
bundle of energy is called a photon.
If spectral bands are grouped according to energy per photon, we obtain the
spectrum below.

100

1.12

9/2/2010

Chapter 1: Introduction
Bone Scan

PET Scan

Examples of
Gamma-ray
Ga
a ay
imaging

notice the tumor

i the
in
h brain
b i andd
in the lung

Cygnus loop is a gas cloud

generated by a star in the
constellation of Cygnus

Gamma radiation from

a valve in a nuclear
reactor

notice the 1.13

area of
strong radiation

Center for Gamma-Ray Imaging, Univ of Arizona: http://www.radiology.arizona.edu/CGRI/research.html

Chapter 1: Introduction
Examples of X-ray imaging
Chest X-ray
X ray
X-ray of circuit board
Image of blood
vessels
(angiogram)

Computerised
axial tomography
(CT) of the head

Cygnus loop in the

X-ray band

1.14

9/2/2010

Chapter 1: Introduction

1.15

Chapter 1: Introduction
Examples of X-ray imaging
CT scan vs MRI imaging:
http://www.cancerhelp.org.uk/help/default.asp?page=149

1.16

9/2/2010

Chapter 1: Introduction
Examples of ultraviolet imaging
UV is used in
fluorescence
microscopy, a
method to study
material which can
be made to
fluoresce.

Normal corn
Infected corn
(by smut)
UV imaging is used in
lithography, industrial
inspection, microscopy, biological
imaging and astronomical
observations

Smut corn disease

Cygnus loop in the
UV band
1.17

Chapter 1: Introduction

Imaging in the visible and IR bands

Examples of
light
microscopy
images

Applications
range from
enhancement to
measurements.

1.18

9/2/2010

Chapter 1: Introduction

NASAs Landsat satellite captures and transmits images of

Earth from space for the purpose of monitoring
environmental conditions on the planet. It uses both visible
and infrared regions of the spectrum.

1.19

Chapter 1: Introduction

1.20

The Potomac river is clearly seen in all bands

10

9/2/2010

Chapter 1: Introduction

More hurricane pictures from

Plymouth State University
Weather Center
1.21

Chapter 1: Introduction

Human settlements in the Americas

1.22

11

9/2/2010

Chapter 1: Introduction

1.23

Chapter 1: Introduction

1.24

12

9/2/2010

Chapter 1: Introduction

1.25

Chapter 1: Introduction

1.26

13

9/2/2010

Chapter 1: Introduction

1.27

Chapter 1: Introduction

1.28

14

9/2/2010

Chapter 1: Introduction

Examples of Scanning Electron Microscope (SEM) images

1.29

Chapter 1: Introduction

Examples of computer generated images

1.30

15

9/2/2010

Photographs from Tampere

168 m high

1.31

Early panorama with mobile phone camera

25 frames, 320x240 resolution. Final image 705x262

16

9/2/2010

400% of original size

34
2005

17

9/2/2010

Chapter 1: Introduction

1.35

Chapter 1: Introduction

1.36

18

9/2/2010

How are pictures made?

A basic image capture
system contains a lens
and a detector. Film
detects far more visual
information than is
possible with a digital
system.

With digital photography,

the detector is a solid state
image sensor called a
charge coupled device,
(CCD) for short.

On an area array CCD, a

matrix of hundreds of
thousands of microscopic
photocells creates pixels
by sensing the light
intensity
of
small
portions of the film
image.

Ref.: www.kodak.com/US/en/digital/dlc/book3/chapter1/digFundCapture1.shtml
1.37

Types of Image Degradations (1/2)

lack of contrast

image
enhancement

motion blur

image
restoration

1.38

19

9/2/2010

Types of Image Degradations (2/2)

BLURRING
image
enhancement

NOISE

image
restoration

1.39

Chapter 1: Introduction

A l versus digital
Analog
di i l image
i
processing
i
Analog image

Digital image

+ imitates light intensity

- records only samples of the

information rather than all of it

+ compactness

+ copy quality

+ scalability

+ freedom from noise

+ seamlessness

+ computer compatibility

http://www.videomaker.com/article/3250/

1.40

20

9/2/2010

Chapter 1: Introduction

Recall that an analog signal copies by imitating:

Light from the camcorder lens slams into a sensor on the imaging
chip, creating an electrical charge.
The stronger the light, the stronger the charge, which is to say
that the electrical signal is imitating the intensity of the light that
produced it.
Multiply this stimulus/response by several hundred thousand sensors
covering all three primary colors and you have the entire optical
image imitated by an electrical signal of rapidly and continuously
varying voltage.
back
1.41

Chapter 1: Introduction
In a digital system, by contrast, the first thing that happens to the original
continuous signal is that it's fed through an analog/digital converter chip.
That chip looks at the signal hundreds of thousands of separate times per second
and assigns each discrete sampling a numerical value that corresponds to the
strength of the signal at that precise moment in time.
These numbers, rather than the signal itself, represent the digital image.
This means that digital recording differs from analog in two crucial ways:
It numerically encodes the information rather than electrically mimicking it
It records only samples of the information rather than all of it.
back
1.42

21

9/2/2010

Chapter 1: Introduction
Compactness
Information in analog image or video can be stored very efficiently and cheaply
(up to two and a half hours of video on one $1 VHS tape at SP speed).
High-quality digital video demands a huge amount of storage space. For example,
DVDs (Digital Versatile Disks), must squeeze 4.7 gigabytes of data onto a single
side of the disk just to fit a feature-length movie and that's with a hefty dose of
compression.

back

1.43

Chapter 1: Introduction
Scalability
All videos, analog and digital, tend to look sharper and clearer on a smaller
screen; it's the natural result of squeezing the same amount of visual information
into a smaller space. All but the highest quality digital video, however, suffers
greatly from enlargement. When you blow up your digitized image onto a huge
home-theater TV screen, for example, all of those invisible digital compression
artifacts become quite noticeable--straight lines become jaggy, curves look
blocky, etc. Analog video, on the other hand, is much better at filling larger
screens with sharp-looking images.
back

1.44

22

9/2/2010

Chapter 1: Introduction
Seamlessness
In the audio world, some purists have returned to analog (vinyl LP) recordings
because they hear the fact that digital recordings only sample the signal at
intervals instead of copying the whole thing. To them, CDs sound hollow and
brittle as a consequence.

back

1.45

Chapter 1: Introduction
Copy Quality
We talk about "copying" a digital image or a digital video file, but we are not
actually making a copy at all. Instead, we're making a transcription: rewriting the
information rather than duplicating it.
Instead of copying the video signal, digital duplication transcribes the numerical
code that describes that signal. If you transcribe it accurately, you can decode the
result into a daughter signal that is essentially indistinguishable from the parent.

back
1.46

23

9/2/2010

Chapter 1: Introduction
Freedom from Noise
Noise is any disturbance in an electrical current that is not part of the signal, and every
current carries a certain amount of this electrical garbage.
Since an analog dupe is an imitation, it happily copies the noise along with the parent
signal, while adding new noise in the process. That means that in each generation, the
noise level relative to the signal (signal-to-noise ratio) increases and the quality decreases
proportionately.
In digital recording, noise is not a problem because the signal consists entirely of current
pulses
l carrying
i information
i f
ti e.g. Morse
M
code:
d power on = 1;
1 power off
ff = 0.
0 If the
th voltage
lt
level of the "power on" part of the signal is well above the noise level, then the
transcribing system can be set to respond only to current at that level and ignore the noise
entirely. So even if the process adds a small amount of its own noise, it never copies the
parental noise--nor does it pass on its own noise to the copy.
The result is that digital video can be copied through many generations without
appreciable quality loss. This is a massive improvement over analog video.

1.47

back

Chapter 1: Introduction
Computer Compatibility
By far the biggest advantage of digital video is that a computer can process and store it.
For many years, professionals have digitized video, not only to take advantage of loss-free
duplicating, but also to perform image editing. Image editing means superimposing titles,
compositing multiple images, and adding effects like dissolves and wipes.
But as hard drives got bigger and faster, and as image compression techniques improved, it
became possible to digitize the signal and then keep it in that form indefinitely by storing
it in the computer
computer.
Digital storage also saw the birth of nonlinear editing, with almost instant access to any
footage anywhere in the computer. This advantage is so great that digital video would
probably prevail over analog due to random (nonlinear) access alone.
1.48

back

24

9/2/2010

Chapter 1: Introduction
HUMAN VISUAL SYSTEM IS THE ULTIMATE JUDGE
OF QUALITY understanding HVS

Original Camera Rendering

Post-processing with our algorithm

1.49

25