IMAGE PROCESSING

Chapter 1 Introduction

Contents
Definition of image Generation of image Steps in image processing Elements of DIP system Image enhancement, restoration and analysis

Prepared by Trupti Mane

Try and describe the picture....

One picture is worth more than ten thousand words.

Prepared by Trupti Mane

Why Image Processing?

4

Two principal application areas

Improving pictorial information for better human interpretation. Processing of image data for storage, transmission and representation for autonomous machine perception.
Prepared by Trupti Mane

Image - Definition
5

Replica of an obiect / scene which one can see a two-dimentional light intensity function f(x,y) x and y spatial (plane) coordinates

amplitude of f at any pair of coordinates intensity / gray level / brightness of that image at that point
Prepared by Trupti Mane

Axis Convention for Representing Image

6

Pixel (x,y) moves to the right as y (column index) increases

f(x,y)

Image can be represented easily using matrices in which gray level of a pixel is represented as f(x,y)

Pixel (x,y) moves downwards as x (row index) increases

Prepared by Trupti Mane

Digital Image
7

When x, y, and the amplitude values of f are all finite, discrete quantities, we call the image digital image Digital image: an image f(x,y) that has been discretized both in spatial coordinates and brightness. A matrix who's row and column indices identify a point in the image and corresponding matrix element identifies gray level at that point. Image sampled and quantized.
Prepared by Trupti Mane

Pixel
8

Digital image composed of a finite no of elements Each element has a particular location and value These elements are picture elements image elements pels pixels Pixel term most widely used to denote elements of digital image
Prepared by Trupti Mane

Digital Image Processing

9

Processing of digital images by means of a digital computer

Prepared by Trupti Mane

Machine Vision vs. Human Vision

10

Vision - most advanced of human senses - so images play the single most important role in human perception Humans - limited to the visual band of the electromagnetic (EM) spectrum Imaging machines cover almost the entire EM spectrum, ranging from gamma to radio waves can operate on images generated by sources that humans are not accustomed to associating with images e.g. Ultrasound, electron microscopy, and computer-generated images Thus digital image processing encompasses a wide and varied field of applications Prepared by Trupti Mane

both the input and output of a process are images

image understanding

to use computers to emulate human vision

Image Processing Image Analysis Computer Vision

No clear cut boundaries Therefore another classification

3 types of computerized processes

Low Level Processing

11

Mid Level Processing

Prepared by Trupti Mane

High Level Processing

Low Level Processing

12

involve primitive operations such as image preprocessing to reduce noise, contrast enhancement, and image sharpening characterized by the fact that both its inputs and outputs are images

Prepared by Trupti Mane

Mid Level Processing

13

involves tasks such as segmentation (partitioning an image into regions or objects) description of those objects to reduce them to a form suitable for computer processing classification (recognition) of individual objects characterized by the fact that its inputs generally are images, but its outputs are attributes extracted from those images (e.g., edges, contours, and the identity of individualPrepared objects) by Trupti Mane

Higher Level Processing

14

involves making sense of an ensemble of recognized objects, as in image analysis performing the cognitive functions normally associated with vision

Prepared by Trupti Mane

Scope of DIP
15

Based on the preceding comments, we see that a logical place of overlap between image processing and image analysis is the area of recognition of individual regions or objects in an image Thus digital image processing encompasses processes whose inputs and outputs are images encompasses processes that extract attributes from images including recognition of individual objects

Prepared by Trupti Mane

Example
16

E.g. Automated Analysis of Text which includes

acquiring an image of the area containing the text
preprocessing that image extracting (segmenting) the individual characters describing the characters in a form suitable for computer processing

recognizing those individual characters

The above processes in the example of text analysis are in the scope of digital image processing This may be viewed as being in the domain of image analysis and even computer vision, depending on the level of complexity implied by the statement making sense

Prepared by Trupti Mane

17

Generation of digital images

How images are generated in various categories and the areas of applications in which they are applied

Prepared by Trupti Mane

Image Categories
18

Categorized according to their source Sources of energy Electromagnetic energy spectrum - principal energy source acoustic ultrasonic electronic Synthetic images generated by computers used for modeling and visualization
Prepared by Trupti Mane

Electromagnetic Spectrum
19

Electromagnetic waves can be - propogating sinusoidal waves of varying wavelengths - a stream of massless particles each traveling in a wavelike pattern moving at the speed of light Massless particles contains bundle of energy called photons Spectral bands grouped according to energy/photon we get spectrum

The electromagnetic spectrum arranged according to energy/photon Prepared by Trupti Mane

Gamma-Ray Imaging
20

Major uses 1) nuclear medicine 2) astronomical observations

Nuclear medicine patients are injected with radioactive isotopes that emit gamma rays as it decays images are generated by collecting the emission by gamma ray detectors
Prepared by Trupti Mane

Gamma-Ray Imaging ( contd.)

21

Nuclear Medicine Image coplete bone scan obtained by using gamma ray imaging

Such images are used to locate sites of inflections or tumors

Prepared by Trupti Mane

Bone scan

Gamma-Ray Imaging ( contd.)

22

Image obtained by using Positron Emission Tomography (PET) A tumor in the brain and one in the lung easily visible as small white masses

The patient is given a radioactive isotope that emits positrons as it decays - when a positron meets an electron, both are annihilated and two gamma rays are given off which are detected and a tomographic image is created
PET image

Prepared by Trupti Mane

Gamma-Ray Imaging ( contd.)

23

Image a Cygnus loop imaged in gamma ray band

obtained using natural radiation of the object being imaged

Cygnus loop

Cygnus Loop A star in the constellation of Cygnus exploded about 15000 years ago, generating a superheated stationary gas cloud (called as Cygnus loop) that glows in a spectacular array of colours
Prepared by Trupti Mane

Gamma-Ray Imaging ( contd.)

24

Image gamma radiation from a valve in a nuclear reactor Left side of the image area of strong radiation is seen
Gamma radiation from a reactor valve

Prepared by Trupti Mane

X-ray Imaging
25

Oldest source of EM spectrum

Areas of application medical diagnostics industry astronomy

Prepared by Trupti Mane

X-ray Imaging
26

Chest x-ray generated simply by placing the patient between an x-ray source and a film sensitive to x-ray energy Intensity of x-ray modified by absorption in the body
Resulting energy falling on the film developes it
Prepared by Trupti Mane

Chest x-ray

X-ray Imaging (contd.)

27

Digital images are obtained by one of two methods: (1) by digitizing X-ray films; or (2) by having the X-rays that pass through the patient fall directly onto devices (such as a phosphor screen) that convert Xrays to light. The light signal in turn is captured by a lightsensitive digitizing system

Prepared by Trupti Mane

X-ray Imaging (contd.)

28

Angiography procedure used to obtain images of blood vessels ( angiograms ) A catheter (a small, flexible, hollow tube) is inserted into an artery or vein in the groin The catheter is threaded into the blood vessel and guided to the area to be studied When the catheter reaches the site under investigation, an Xray contrast medium is injected through the catheter This enhances contrast of the blood vessels and enables the radiologist to see any irregularities or blockages
Prepared by Trupti Mane

X-ray Imaging (contd.)

29

The catheter can be seen being inserted into the large blood vessel on the lower left of the picture Note the high contrast of the large vessel as the contrast medium flows up in the direction of the kidneys, which are also visible in the image Image subtraction is used to enhance further the blood vessels being studied
Prepared by Trupti Mane

Aortic angiogram

X-ray Imaging (contd.)

30

CAT- Computerized Axial Tomography Best known use of x-ray in medical imaging Each CAT image - slice taken perpendicularly through the patient Numerous slices are generated as the patient is moved in a longitudinal direction The ensemble of such images constitutes a 3-D rendition of the inside of the patient, with the longitudinal resolution being proportional to the number of slice images taken Advantages- resolution & 3D capability
Prepared by Trupti Mane

Head CT

X-ray Imaging (contd.)

31

Industrial processes- higher energy x-rays are used Industrial CAT scans are useful when the parts can be penetrated by X-rays, such as in plastic assemblies, and even large bodies, like solidpropellant rocket motors This is an x-ray image of an electronic circuit board Used to examine circuit boards for flaws in manufacturing missing components, broken traces, etc.
Prepared by Trupti Mane

Circuit board

X-ray Imaging (contd.)

32

Example of x-ray imaging in astronomy Image Cygnus loop imaged in x-ray band

Cygnus loop
Prepared by Trupti Mane

Imaging in Ultraviolet band

33

Applications of ultraviolet light lithography industrial inspection microscopy lasers biological imaging, and astronomical observations

Prepared by Trupti Mane

Imaging in Ultraviolet band (contd.)

34

Ultraviolet light - used in fluorescence microscopy Fluorescence - the mineral fluorspar fluoresces when ultraviolet light is directed upon it. The ultraviolet light itself is not visible, but when a photon of ultraviolet radiation collides with an electron in an atom of a fluorescent material, it elevates the electron to a higher energy level The excited electron relaxes to a lower level and emits light in the form of a lower-energy photon in the visible (red) light region

Prepared by Trupti Mane

Imaging in Ultraviolet band (contd.)

35

fluorescence microscope - use an excitation light to irradiate a prepared specimen and then to separate the much weaker radiating fluorescent light from the brighter excitation light. Thus, only the emission light reaches the eye or other detector. The resulting fluorescing areas shine against a dark background with sufficient contrast to permit detection. The darker the background of the non-fluorescing material, the more efficient the instrument. Fluorescence microscopy - excellent method for studying materials that can be made to fluoresce, either in their natural form (primary fluorescence) or when treated with chemicals capable of fluorescing (secondary fluorescence).
Prepared by Trupti Mane

Imaging in Ultraviolet band

36

Fluorescence Microscopy

Fluorescence microscope image Corn infected by smut , a disease of a corn caused by parasitic fungi Prepared by Trupti Mane

Imaging in Ultraviolet band (contd.)

37

Cygnus Loop- imaged in a high energy region of the ultraviolet band

Prepared by Trupti Mane

Imaging in Visible & IR Band

38

Applications - light microscopy - astronomy - remote sensing - industry - law enforcement

Prepared by Trupti Mane

Light Microscopy
39

micro inspection to materials characterization

Taxol (anticancer agent) magnified 250 X

Cholesterol 40 X
Prepared by Trupti Mane

Microprocessor 60 X

Light Microscopy
40

Nickel oxide thin film 600 X

Surface of audio CD 1750 X

Prepared by Trupti Mane

Organic superconductor 450 X

Remote Sensing
41

Thematic bands in NASAs LANDSAT satellite The primary function of LANDSAT is to obtain and transmit images of the Earth from space, for purposes of monitoring environmental conditions on the planet.
Prepared by Trupti Mane

Remote Sensing
42

LANDSAT satellite images of the Washington, D.C. Area The numbers refer to the thermatic bands Prepared by Trupti Manein previous table

Remote Sensing
43

The area imaged is Washington D.C - includes features such as buildings, roads, vegetation, and a major river (the Potomac) going through the city Images of population centers are used routinely (over time) to assess population growth and shift patterns, pollution, and other factors harmful to the environment The differences between visual and infrared image features are quite noticeable in these images e.g. how well defined the river is from its surroundings in Bands 4 and 5
Prepared by Trupti Mane

Weather observation and prediction

44

Multispectral image of a hurricane taken by a National Oceanographic and Atmospheric Administration (NOAA) satellite using sensors in the visible and infrared bands.

The eye of the hurricane is clearly visible in this image.

Prepared by Trupti Mane

Nighttime Lights of the World

45

The images were generated by the infrared imaging system mounted on a NOAA DMSP (Defense Meteorological Satellite Program) satellite provides a global inventory of human settlements

IR satellite images of the America The small gray map - reference

Prepared by Trupti Mane

Nighttime Lights of the World

46

The infrared imaging system operates in the band 10.0 to 13.4 m, and has the unique capability to observe faint sources of visible near infrared emissions present on the Earths surface, including cities, towns, villages, gas flares, and fires. A computer program can be written that would use these images to estimate the percent of total electrical energy used by various regions of the world.

IR satellite images of the remaining Prepared by Trupti Mane populated part of the world

Automated visual inspection of manufacturing goods

47

Controller board for a CD ROM drive Missing Component

Imaged pill container Objective to have machine look for missing pills
Prepared by Trupti Mane

Automated visual inspection of manufacturing goods

48

A clear plastic part with unacceptable number of air pocketsin it

image processing is used to look for bottles that are not filled up to the acceptable levels
Prepared by Trupti Mane

Law Enforcement
49

Thumb prints used for either enhancement or authentication

Image of a paper currency processed for automated counting , law enforcement, the reading of the serial number for the purpose of tracking and identifying bills

Prepared by Trupti Mane

Law Enforcement
50

Automated license plate reading using character recognition

Used extensively for traffic monitoring and surveillance

Area in which imaging system detected the plate

Result of automated reading of plate content

Prepared by Trupti Mane

Imaging in Microwave Band

51

Imaging radar dominant application It works like a flash camera- it provide microwave pulses to illuminate an area on the ground- take snapshot image A radar uses an antenna and digital computer processing to record its images

Only microwave energy reflected back towards the radar antenna can be seen
Prepared by Trupti Mane

Imaging in Microwave Band

52

Radar image of mountains in southeast Tibet

Clarity and detail of image not affected due to clouds or other atmospheric conditions as it is in case of images in visible band
Prepared by Trupti Mane

Imaging in thr Radio Band

53

Magnetic Resonance Imaging (MRI) Patient is placed in a powerful magnet- radio waves in short pulses passed through his body Patients tissues emit responding pulses of radio waves Location from which these signals originate and their strength are determined by computer- it produces 2D picture of a section of the patient
Prepared by Trupti Mane

Imaging in thr Radio Band

54

MRI image of a human knee and spine

Prepared by Trupti Mane

Imaging in thr Radio Band

55

Image of the Crab Pulser ( in the center of images ) covering the electromagnetic spectrum

Prepared by Trupti Mane

Other imaging Modalities

56

Acoustic imaging

Electron Microscopy
Synthetic ( computer-generated ) imaging

Prepared by Trupti Mane

57

Fundamental Steps in Digital Image Processing

Prepared by Trupti Mane

58

by Trupti Mane Fundamental StepsPrepared in Digital Image processing

Image Acquisition
59

It could be as simple as being given an image that is already in digital form

Involves preprocessing such as scaling

How images are generated is already discussed

Prepared by Trupti Mane

Image Enhancement
60

To bring out detail that is obscured To highlight features of interest in an image

E.g., to increase contrast of an image to make it look better Subjective area of image processing user decides what gives a good enhancement result
Prepared by Trupti Mane

Image Restoration
61

Mproving appearance of an image Objective area of image processing based on mathematical or probabilistic models of image degradation
Enhancement is based on human subjective preferences regarding what constitute a good enhancement result

Prepared by Trupti Mane

Colour Image Processing

62

Gaining importance due to increasing use of digital images over the Internet Our interest is limited to gray level image processing

Prepared by Trupti Mane

Wavelets
63

Foundation for representing images in various degrees of resolution Used in - image data compression - pyramidal representation ( images are subdivided successively into smaller regions)

Prepared by Trupti Mane

Image Compression
64

Deals with techniques for reducing - storage required to save an image - BW required to transmit it

Prepared by Trupti Mane

Morphological Processing
65

Tools for extracting image components that are useful in representation and description of shape

Prepared by Trupti Mane

Image Segmentation
66

To partition an image into its constituent parts or objects To seperate objects from the background Output raw pixel data, constituting either the boundary of a region or all the points in the region itself
Prepared by Trupti Mane

Representation and Descirption

67

Always follow output of segmentaition Transforming raw pixel data into a form suitable for subsequent computer processing is necessary Representation making a decision whether the data should be represented as a boundary or as a complete region
Prepared by Trupti Mane

Representation and Descirption

68

Boundary representation appropriate when the focus is on external shape characteristics such as corners and inflections

Regional representation - appropriate when the focus is on internal properties such as texture or skeletal shape

Prepared by Trupti Mane

Representation and Descirption

69

A method for describing the data so the features of interest are highlighted is necessary Description feature selection Deals with extracting attributes that result in some quantitative information of interest or are basic for differentiating one class of object from another
Prepared by Trupti Mane

Recognition
70

Process that assigns a lebel (e.g., vehicle) to an object based on its descriptors

Prepared by Trupti Mane

71

Components of an DIP system

Prepared by Trupti Mane

72

by Trupti Mane Components of anPrepared Image Processing System

Sensing
73

Two elements required to acquire digital images 1) a physical device sensitive to the energy radiated by the object to be imaged 2) digitizer- device for converting output of physical sensing device into digital form E.g., a digital video camera
Prepared by Trupti Mane

Specialized Image Processing Hardware

74

Digitizer + hardware that performs other primitive operation such as ALU ALU- performs AL operations in parallel on entire image- e.g., ALU is used in averaging images as soon as they are digitized to reduce noise

Prepared by Trupti Mane

Specialized Image Processing Hardware

75

Also called front-end subsystem Most distinguishing characteristics- speed i.e this unit performs functions requiring fast data throughputs that a computer cannot handle e.g., digitizing & averaging video images at 30 frames/s
Prepared by Trupti Mane

Computer
76

A general purpose computer suitable for off-line image processing tasks

Prepared by Trupti Mane

Software
77

Consist of specialized modules that perform specific task Also include capability for the user to write code using specialized modules as a minimum

Prepared by Trupti Mane

Mass Storage
78

Digital storage- three types Short term storage- for use during processing On- line storage- for fast recall Archival storage- characterized by infrequent access
Prepared by Trupti Mane

1)

2)

3)

Mass Storage (contd.)

79

Short- term storage Computer memory Specialized boards- frame buffers

Frame buffers Store one or more images & can be accessed rapidly Allows instantaneous image zoom, scroll (vertical shifts) and pan (horizontal shifts)
Prepared by Trupti Mane

Mass Storage (contd.)

80

On- line storage Magnetic disks , optical-media storage Characterized by frequent access to the stored data Archival storage Characterized by massive storage requirement but infrequent need for access Magnetic tapes and optical disks housed in Prepared by Trupti Mane jukeboxes

Hardcopy
81

Devices used for recording images - laser printer - CD ROM disks, etc.

Prepared by Trupti Mane

Thank You!!!

82

Prepared by Trupti Mane