Sie sind auf Seite 1von 46

Image Processing &

Computer Vision Course coordinators

• Instructors: Dr. Jignesh N. Sarvaiya,

Email: jns@eced.svnit.ac.in

The first photograph in the world


Joseph Nicéphore Niépce, View from the Window at Le Gras, 1826.
2 4

Textbook General Information


• Prerequisites
► Suggested textbook: Knowledge of at least two of the following three areas:
 R.C. Gonzalez and R.E. Woods, “Digital Image i) linear algebra ,
Processing”, 4th Ed., Prentice-Hall Pub. ii) elementary probability theory,
iii) signals and systems
 Any other book with a similar title is fine

5 6

1
General Information (Con’d)
Work Submission
• Working load:
- Homework and computer assignments ► Homework
- Mid-Sem Exam (30 Marks)
- END-SEM Exam (50 Marks)
 Hard copy only (submit soft copy only if you
have obtained the permission from the
- Quiz/viva/Assignments/Mini-project (20 Marks)
instructor)
Mini- Project (3 person per team, MATLAB-based)  Instructor will collect them before the class on
the due date
•Warnings:
􀂄 Copying assignment is prohibited. ► Computer assignments
􀂄 Delay of submission influences on marks and grades  Soft copy only

7 8

Specific Teaching Objectives


How to Achieve
By the end of this semester, you will
– Know basics of digital image processing ► Multimode teaching interface
including image acquisition, perception,  I will present the course material in three
transformation, enhancement, Image forms: Power point, MATLAB demo,
processing in frequency domain,
interpolation, restoration, segmentation,
Blackboard
analysis, and so on ► Teaching is two-way communication
 I need to know your background better
– Be able to use MATLAB to implement basic (survey)
image processing algorithms and get
familiar with some functions provided by  Please make the best use of office hours and
MATLAB image processing toolbox email
9 10

2
12
of What is a Digital Image?
Tour Guide 36

Image Image A digital image is a representation of a two-

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Acquisition Generation dimensional image as a finite set of digital
D.I.P. values, called picture elements or pixels
Theme Image
Park Compression

Image Image
Manipulation Analysis

Image Image
Display Perception
11

13 14
of What is a Digital Image? (cont…) of What is a Digital Image? (cont…)
36 36

Pixel values typically represent gray levels, Common image formats include:
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

colours, heights, opacities etc – 1 sample per point (B&W or Grayscale)


– 3 samples per point (Red, Green, and Blue)
Remember digitization implies that a digital
– 4 samples per point (Red, Green, Blue, and “Alpha”,
image is an approximation of a real scene a.k.a. Opacity)

1 pixel

For most of this course we will focus on grey-scale


images

3
15
of What is Digital Image Processing?
36

Some argument about where image An image may be defined as a two-


processing ends and fields such as image dimensional f(x,y), where x and y are
analysis and computer vision start
spatial coordinates and the amplitude of f
at any pair of coordinates (x,y) is called
intensity of the image at that point.

16

18
Representing Digital Images
of What is DIP? (cont…)
36

The continuum from image processing to computer


vision can be broken up into low-, mid- and high-level
processes

High Level Process


Low Level Process Mid Level Process
Input: Attributes
Input: Image Input: Image
Output:
Output: Image Output: Attributes
Understanding
Examples: Noise Examples: Object
Examples: Scene
removal, image recognition,
understanding,
sharpening segmentation
autonomous
In this course we navigation
17
will stop here

4
A Historical Overview of DIP A Historical Overview of DIP
Early 1920s: One of the first applications of
digital imaging was in the news-
paper industry
 The Bartlane cable picture transmission service
 Images were transferred by submarine cable
between London and New York
Newspaper industry used Bartlane cable picture
transmission system to send pictures by submarine  Pictures were coded for cable transfer and
cable between London and New York in 1920s reconstructed at the receiving end on a
telegraph printer
19 20

Early Improvement The Born of Digital Computers


Mid to late 1920s: Improvements to ► The images in previous slides are digital; but
the Bartlane system resulted in higher
quality images
they are NOT considered as the results of
DIP
-New reproduction processes based
on photographic techniques ► What do we mean by Digital Image
-Increased number of tones in
reproduced images Processing ?
 Processing digital images by a digital
computer
► DIP has been dependent on the
The number of distinct gray levels coded by Bartlane system
development of digital computers and other
was improved from 5 to 15 by the end of 1929
supporting technologies (e.g., data storage,
21
display and transmission) 22

5
Why do we need to Processing Human Perception
an image ?
► Image processing is a subclass of signal ► Employ methods capable of enhancing
processing concerned specifically with pictures. information for human interpretation and
► Improve image quality for human perception analysis
and/or computer interpretation. ► Typical applications
It is motivated by major applications - Noise Filtering
► Improvement of pictorial information for human - Content enhancement
perception
(Certain characteristics)
► Image processing for autonomous machine
applications
- Contrast enhancement
► Efficient storage and transmission
- Deblurring
- Remote Sensing
23 24

25 26

6
27 28

29 30

7
► In nuclear Medicine: Approach is to inject a
patient with a radioactive isotope that
emits gamma rays as it decays. Images are
produced from emissions collected by
gamma ray detectors

31 32

► Figure (a) shows a familiar chest X-ray generated simply by placing the patient
between an X-ray source and a film sensitive to X-ray energy.

► The intensity of the X-rays is modified by absorption as they pass through the
patient, and the resulting energy falling on the film develops it, much in the
same way that light develops photographic film.

► Angiography is another major application in an area called contrast


enhancement radiography. This procedure is used to obtain images (called
angiograms) of blood vessels. A catheter (a small, flexible, hollow tube) is
inserted, for example, into an artery or vein in the groin.

► an X-ray contrast medium is injected through the catheter. This enhances


contrast of the blood vessels and enables the radiologist to see any
irregularities or blockages.

► Figure (b) shows an example of an aortic angiogram. The catheter can be seen
being inserted into the large blood vessel.

33 34

8
► Applications of ultraviolet “light” are varied. They include lithography,
industrial inspection, microscopy, lasers, biological imaging, and
astronomical observations.

► Fluorescence microscopy is an excellent method for studying materials


that can be made to fluoresce, either in their natural form (primary
fluorescence) or when treated with chemicals capable of fluorescing
(secondary fluorescence).

► Figure (a) shows a fluorescence microscope image of normal corn, and


Fig. (b) shows corn infected by “smut,” a disease of cereals, corn,
grasses, onions, and sorghum that can be caused by any of more than
700 species of parasitic fungi.

35 36

37 38

9
Examples: Visual and Infrared Imaging Examples: Visual and Infrared Imaging

39 40

Examples: Infrared Satellite Imaging Examples: Infrared Satellite Imaging

2003
USA 1993 41 42

10
43 44

45 49

11
Fundamental Steps in DIP
Extracting image Light and EM Spectrum
components

Improving the
appearance Partition an image into
its constituent parts or
objects

Result is more
suitable than Represent image for
the original computer processing

c   E  h , h : Planck's constant.
50 51

Light and EM Spectrum Light and EM Spectrum


► Monochromatic light: void of color
► The colors that humans perceive in an object are Intensity is the only attribute, from black to white
determined by the nature of the light reflected
Monochromatic images are referred to as gray-scale
from the object. images

e.g. green objects reflect light with wavelengths primarily ► Chromatic light bands: 0.43 to 0.79 um
in the 500 to 570 nm range while absorbing most of the
energy at other wavelength The quality of a chromatic light source:
Radiance: total amount of energy
Luminance (lm): the amount of energy an observer perceives
from a light source
Brightness: a subjective descriptor of light perception that is
impossible to measure. It embodies the achromatic notion of intensity
and one of the key factors in describing color sensation.

52 53

12
Image Acquisition A Simple Image Formation Model

f ( x, y )  i ( x , y ) r ( x , y )

f ( x, y ) : intensity at the point (x, y )


i ( x, y ) : illumination at the point (x, y )
Transform (the amount of source illumination incident on the scene)
illumination
energy into r ( x, y ) : reflectance/transmissivity at the point (x, y )
digital images
(the amount of illumination reflected/transmitted by the object)
where 0 < i( x, y ) <  and 0 < r ( x, y ) < 1

54 58

Some Typical Ranges of illumination Some Typical Ranges of Reflectance

► Illumination ► Reflectance
Lumen — A unit of light flow or luminous flux
Lumen per square meter (lm/m2) — The metric unit of measure  0.01 for black velvet
for illuminance of a surface

 On a clear day, the sun may produce in excess of 90,000 lm/m2 of


 0.65 for stainless steel
illumination on the surface of the Earth
 0.80 for flat-white wall paint
 On a cloudy day, the sun may produce less than 10,000 lm/m2 of
illumination on the surface of the Earth
 0.90 for silver-plated metal
 On a clear evening, the moon yields about 0.1 lm/m2 of illumination

 The typical illumination level in a commercial office is about 1000 lm/m2  0.93 for snow
59 60

13
61 62

63 64

14
65 66

67 68

15
69 70

71 72

16
The Born of Computer
Soar Into Outer Space
Tomography

The first picture of moon by US spacecraft Ranger 7 Sir Godfrey N. Housefield and Prof. Allan M. Cormack
on July 31, 1964 at 9:09AM EDT shared 1979 Nobel Prize in Medicine for the invention of CT
73 74

The Boom of Digital Images


A Physical Perspective of Image Acquisition
in the Last 20 Years
► Acquisition ► Extendthe capabilities of human vision
 Digital cameras, scanners systems
 MRI and Ultrasound imaging  From visible spectrum to non-visible
 Infrared and microwave electromagnetic power spectrum
imaging  From close-distance sensing to remote
► Transmission sensing
 Internet, wireless
communication
► Display
 Printers, LCD monitor, digital TV 75 76

17
Visible (I): Photography Visible (II): Motion Pictures

77 78

Visible (III): Law Enhancement and


Biometrics Visible (IV): Light Microscopy

Taxol (250) Cholesterol (40) Microprocessor (60)


79 80

18
Beyond Visible (I): Thermal
Visible (V): Remote Sensing
Images
Operate in infrared frequency

Human body disperses Different colors indicate


heat (red pixels) varying temperatures
Hurricane Andrew America at night
taken by NOAA GEOS (Nov. 27, 2000)

81 82

Beyond Visible (II): Radar Beyond Visible (III): MRI and Astronomy
Images Operate in radio frequency
Operate in microwave frequency

knee spine head

Moutains in Southeast Tibet visible infrared radio


83 84

19
Beyond Visible (IV): Fluorescence
Microscopy Beyond Visible (V): Medical Diagnostics
Operate in ultraviolet frequency Operate in X-ray frequency

chest head

normal corn smut corn


85 86

Other Non-Electro-Magnetic Imaging


Beyond Visible (VI): PET and Astronomy
Operate in gamma-ray frequency
Modalities

► Acoustic imaging
 Translate “sound waves” into image signals
► Electron microscopy
 Shine a beam of electrons through a speciman
► Synthetic images in Computer Graphics
 Computer generated (non-existent in the real
Cygnus Loop in the world)
constellation of Cygnus
Positron Emission Tomography
87 88

20
Acoustic Imaging Electron Microscope
visible seismic

potential locations of oil/gas 2500 Scanning Electron Microscopy (SEM) image of


damaged integrated circuit
(white fibers are oxides resulting from thermal destruction)
89 90

Summary: Why do we need images? Image Display and Perception


► Various imaging modalities help us to see
invisible objects due to ► Display
 Opaqueness (e.g., see through human body)  CRT, LCD, DLP, Plasma, LCOS, D-ILA
 Far distance (e.g., remote sensing)  HDTV, display wall
 Small size (e.g., light microscopy)  PDA, cellular phone, Gameboy
► Other signals (e.g., seismic) can also be  Stereoscopic (3D)
translated into images to facilitate the
► Perception
analysis
 Human Vision System (HVS)
► Images are important to convey
information and support reasoning  Vision-related diseases and healthcare

A picture is worth a thousand words! 91 92

21
Representing Digital Images
An image may be defined as a
two-dimensional f(x ,y), where x
and y are spatial coordinates and
the amplitude of f at any pair of
coordinates (x,y) is called
intensity of the image at that
point.
93 94

Digital Image Types : Intensity Image Digital Image Types : RGB Image

Intensity image or monochrome image Color image or RGB image:


each pixel corresponds to light intensity each pixel contains a vector
normally represented in gray scale (gray representing red, green and
level). blue components.

Gray scale values


RGB components
10 10 16 28
 9 6 26 37 10 10 16 28
   9 656 70 56  43
15 25 13 22 26 3756
 32 99 96  67 78
54 70
  15  256013902296
  67
32 15 87 39   21  54 47  42 
32 158587853943  92
54  65 65 39 
32 65 87 99

22
Image Types : Binary Image Image Types : Index Image

Binary image or black and white image Index image


Each pixel contains one bit : Each pixel contains index number
1 represent white pointing to a color in a color table
0 represents black
Color Table
Index Red Green Blue
component component component
No.
1 0.1 0.5 0.3
2 1.0 0.0 0.0
1 4 9
6 4 7  3 0.0 1.0 0.0
Binary data   4 0.5 0.5 0.5
6 5 2
0 0 0 0 5 0.2 0.8 0.9
0 0 0 0
  Index value … … … …
1 1 1 1
 
1 1 1 1

Representing Digital Images Representing Digital Images

► The representation of an M×N numerical


array as

 f (0, 0) f (0,1) ... f (0, N  1) 


 f (1, 0) f (1,1) ... f (1, N  1) 
f ( x, y )  
 ... ... ... ... 
 
 f ( M  1, 0) f ( M  1,1) ... f ( M  1, N  1) 

99 100

23
Representing Digital Images Representing Digital Images

► The representation of an M×N numerical ► Therepresentation of an M×N numerical


array as array in MATLAB

 a0,0 a0,1 ... a0, N 1   f (1,1) f (1, 2) ... f (1, N ) 


 a ... a1, N 1   f (2,1)
a1,1 f (2, 2) ... f (2, N ) 
A f ( x, y )  
1,0

 ... ... ... ...   ... ... ... ... 


   
 aM 1,0 aM 1,1 ... aM 1, N 1   f ( M ,1) f ( M , 2) ... f (M , N ) 

101 102

Representing Digital Images Representing Digital Images

► Discrete intensity interval [0, L-1], L=2k

► The number b of bits required to store a M × N


digitized image

b=M×N×k

103 104

24
Spatial and Intensity Resolution
Spatial and Intensity Resolution

► Spatial resolution
— A measure of the smallest discernible detail in an image
— stated with line pairs per unit distance, dots (pixels) per
unit distance, dots per inch (dpi)

► Intensity resolution
— The smallest discernible change in intensity level
— stated with 8 bits, 12 bits, 16 bits, etc.

105 106

Spatial and Intensity Resolution Spatial and Intensity Resolution

107 108

25
Reading an Image

109 110

111 112

26
113 114

115 116

27
118
of Introduction
36

Digital Image Processing:


Introduction “One picture is worth more than ten
thousand words”
Anonymous

119 120
of References of Contents
36 36

“Digital Image Processing”, Rafael C. This lecture will cover:


Gonzalez & Richard E. Woods, – What is a digital image?
Addison-Wesley, 2002 – What is digital image processing?
– Much of the material that follows is taken from – History of digital image processing
this book – State of the art examples of digital image
processing
– Key stages in digital image processing

28
121 122
of What is a Digital Image? of What is a Digital Image? (cont…)
36 36

A digital image is a representation of a two- Pixel values typically represent gray levels,
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
dimensional image as a finite set of digital colours, heights, opacities etc
values, called picture elements or pixels Remember digitization implies that a digital
image is an approximation of a real scene

1 pixel

123 124
of What is a Digital Image? (cont…) of What is Digital Image Processing?
36 36

Common image formats include: Digital image processing focuses on two


– 1 sample per point (B&W or Grayscale) major tasks
– 3 samples per point (Red, Green, and Blue)
– Improvement of pictorial information for
– 4 samples per point (Red, Green, Blue, and “Alpha”,
human interpretation
a.k.a. Opacity)
– Processing of image data for storage,
transmission and representation for
autonomous machine perception
Some argument about where image
processing ends and fields such as image
For most of this course we will focus on grey-scale analysis and computer vision start
images

29
125 126
of What is DIP? (cont…) of History of Digital Image Processing
36 36

The continuum from image processing to computer Early 1920s: One of the first applications of

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
vision can be broken up into low-, mid- and high-level digital imaging was in the news-
processes paper industry
High Level Process – The Bartlane cable picture
Low Level Process Mid Level Process
Input: Attributes transmission service Early digital image
Input: Image Input: Image
Output: Image Output: Attributes
Output: – Images were transferred by submarine cable
Understanding between London and New York
Examples: Noise Examples: Object
removal, image recognition,
Examples: Scene – Pictures were coded for cable transfer and
understanding,
sharpening segmentation reconstructed at the receiving end on a
autonomous
navigation telegraph printer
In this course we
will stop here

127 128
of History of DIP (cont…) of History of DIP (cont…)
36 36

Mid to late 1920s: Improvements to the 1960s: Improvements in computing


Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Bartlane system resulted in higher quality technology and the onset of the space race
images led to a surge of work in digital image
– New reproduction processing
processes based – 1964: Computers used to
on photographic improve the quality of
techniques images of the moon taken
– Increased number by the Ranger 7 probe
of tones in Improved – Such techniques were used
reproduced images digital Early 15 tone digital A picture of the moon
image
in other space missions
image
including the Apollo landings taken by the Ranger 7
probe minutes before
landing

30
129 130
of History of DIP (cont…) of History of DIP (cont…)
36 36

1970s: Digital image processing begins to 1980s - Today: The use of digital image
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

be used in medical applications processing techniques has exploded and


– 1979: Sir Godfrey N. they are now used for all kinds of tasks in all
Hounsfield & Prof. Allan M. kinds of areas
Cormack share the Nobel – Image enhancement/restoration
Prize in medicine for the
– Artistic effects
invention of tomography,
the technology behind – Medical visualisation
Computerised Axial – Industrial inspection
Typical head slice CAT
Tomography (CAT) scans image – Law enforcement
– Human computer interfaces

131 132
of Examples: Image Enhancement of Examples: The Hubble Telescope
36 36

One of the most common uses of DIP Launched in 1990 the Hubble
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

techniques: improve quality, remove noise telescope can take images of


etc very distant objects
However, an incorrect mirror
made many of Hubble’s
images useless
Image processing
techniques were
used to fix this

31
133 134
of Examples: Artistic Effects of Examples: Medicine
36 36

Artistic effects are Take slice from MRI scan of canine heart,

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
used to make and find boundaries between types of tissue
images more – Image with gray levels representing tissue
visually appealing, density
to add special – Use a suitable filter to highlight edges
effects and to make
composite images

Original MRI Image of a Dog Heart Edge Detection Image

135 136
of Examples: GIS of Examples: GIS (cont…)
36 36

Geographic Information Systems Night-Time Lights of


Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

– Digital image processing techniques are used the World data set
extensively to manipulate satellite imagery – Global inventory of
– Terrain classification human settlement
– Meteorology – Not hard to imagine
the kind of analysis
that might be done
using this data

32
137 138
of Examples: Industrial Inspection of Examples: PCB Inspection
36 36

Human operators are Printed Circuit Board (PCB) inspection


Images taken from Gonzalez & Woods, Digital Image Processing (2002)

expensive, slow and – Machine inspection is used to determine that


unreliable all components are present and that all solder
joints are acceptable
Make machines do the
job instead – Both conventional imaging and x-ray imaging
are used
Industrial vision systems
are used in all kinds of
industries
Can we trust them?

139 140
of Examples: Law Enforcement of Examples: HCI
36 36

Image processing Try to make human computer


Images taken from Gonzalez & Woods, Digital Image Processing (2002)

techniques are used interfaces more natural


extensively by law – Face recognition
enforcers – Gesture recognition
– Number plate Does anyone remember the
recognition for speed user interface from “Minority
cameras/automated
toll systems
Report”?
– Fingerprint recognition These tasks can be
– Enhancement of extremely difficult
CCTV images

33
141 142
Key Stages in Digital Image Processing:
of Key Stages in Digital Image Processing of
36 36 Image Aquisition
Morphologi Morphologi

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition

Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n

143 144
of
Key Stages in Digital Image Processing: of
Key Stages in Digital Image Processing:
36 Image Enhancement 36 Image Restoration
Morphologi Morphologi
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition

Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n

34
145 146
of
Key Stages in Digital Image Processing: of
Key Stages in Digital Image Processing:
36 Morphological Processing 36 Segmentation
Morphologi Morphologi
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition

Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n

147 148
of
Key Stages in Digital Image Processing: of
Key Stages in Digital Image Processing:
36 Object Recognition 36 Representation & Description
Morphologi Morphologi
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition

Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n

35
149 150
of
Key Stages in Digital Image Processing: of
Key Stages in Digital Image Processing:
36 Image Compression 36 Colour Image Processing
Morphologi Morphologi
Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition

Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n

151 152
of Summary of Sampling, Quantisation And Resolution
36 36

We have looked at: In the following slides we will consider what


– What is a digital image? is involved in capturing a digital image of a
– What is digital image processing? real-world scene
– History of digital image processing – Image sensing and representation
– State of the art examples of digital image – Sampling and quantisation
processing – Resolution
– Key stages in digital image processing
Next time we will start to see how it all
works…

36
153 154
of Image Representation of Image Acquisition
36 36

Before we discuss image acquisition recall Images are typically generated by


Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
that a digital image is composed of M rows illuminating a scene and absorbing the
and N columns of pixels energy reflected by the objects in that scene
each storing a value col
– Typical notions of
Pixel values are most illumination and scene
often grey levels in the can be way off:
range 0-255(black-white) • X-rays of a skeleton
We will see later on • Ultrasound of an
that images can easily unborn baby
be represented as • Electro-microscopic
f (row, col)
images of molecules
matrices row

155 156
of Image Sensing of Image Sensing
36 36

Incoming energy lands on a sensor material


Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

responsive to that type of energy and this


generates a voltage
Collections of sensors are arranged to
capture images

Imaging Sensor

Line of Image Sensors Array of Image Sensors Using Sensor Strips and Rings

37
157 158
of Image Sampling And Quantisation of Image Sampling And Quantisation
36 36

A digital sensor can only measure a limited


Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
number of samples at a discrete set of
energy levels
Quantisation is the process of converting a
continuous analogue signal into a digital
representation of this signal

159 160
Image Sampling And Quantisation
of Image Sampling And Quantisation of
(cont…)
36 36

Remember that a digital image is always


Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

only an approximation of a real world


scene

38
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)

of
of

36
36

163
161

Image Representation
Image Representation

Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)

of
of

36
36

164
162

Image Representation
Image Representation

39
165 166
of Spatial Resolution of Spatial Resolution (cont…)
36 36

The spatial resolution of an image is

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
determined by how sampling was carried out
Spatial resolution simply refers to the
smallest discernable detail in an image
– Vision specialists will
often talk about pixel
size
– Graphic designers will
talk about dots per
inch (DPI)

167 168
of Spatial Resolution (cont…) of Spatial Resolution (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

40
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)

of
of

36
36

171
169

Spatial Resolution (cont…)


Spatial Resolution (cont…)

Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)

of
of

36
36

172
170

Spatial Resolution (cont…)


Spatial Resolution (cont…)

41
173 174
of Intensity Level Resolution of Intensity Level Resolution (cont…)
36 36
256 grey levels (8 bits per pixel) 128 grey levels (7 bpp) 64 grey levels (6 bpp) 32 grey levels (5 bpp)
Intensity level resolution refers to the

Images taken from Gonzalez & Woods, Digital Image Processing (2002)
number of intensity levels used to represent
the image
– The more intensity levels used, the finer the level of
detail discernable in an image
– Intensity level resolution is usually given in terms of
the number of bits used to store each intensity level
Number of Intensity
Number of Bits Examples
Levels
1 2 0, 1
2 4 00, 01, 10, 11
4 16 0000, 0101, 1111
8 256 00110011, 01010101
16 65,536 1010101010101010 16 grey levels (4 bpp) 8 grey levels (3 bpp) 4 grey levels (2 bpp) 2 grey levels (1 bpp)

175 176
of Intensity Level Resolution (cont…) of Intensity Level Resolution (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

42
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)

of
of

36
36

179
177

Intensity Level Resolution (cont…)


Intensity Level Resolution (cont…)

Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)

of
of

36
36

180
178

Intensity Level Resolution (cont…)


Intensity Level Resolution (cont…)

43
181 182
of Intensity Level Resolution (cont…) of Intensity Level Resolution (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

183 184
Resolution: How Much Is Enough?
of Resolution: How Much Is Enough? of
(cont…)
36 36

The big question with resolution is always


how much is enough?
– This all depends on what is in the image and
what you would like to do with it
– Key questions include
• Does the image look aesthetically pleasing?
• Can you see what you need to see within the
image? The picture on the right is fine for counting
the number of cars, but not for reading the
number plate

44
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)

of
of

36
36

187
185

Low Detail
Medium Detail
High Detail

Intensity Level Resolution (cont…)


Intensity Level Resolution (cont…)

Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)

of
of

36
36

188
186

Intensity Level Resolution (cont…)


Intensity Level Resolution (cont…)

45
189
of Summary
36

We have looked at:


– Human visual system
– Light and the electromagnetic spectrum
– Image representation
– Image sensing and acquisition
– Sampling, quantisation and resolution
Next time we start to look at techniques for
image enhancement

46

Das könnte Ihnen auch gefallen