Introduction to Digital Image Processing & its Fundamentals

History

The origins of digital image processing

History

15-tone equipment

History

1960s 1964 Ranger 7

History

Digital Image Processing (DIP)

Pixel: the smallest element in a picture F(x,y), x and y are the spatial coordinates, and the F is the pixel value (graylevel) at this point Improve picture information for human interpretation Process data for storage and transmission Represent the content (feature extraction ) for the machine perception and management

Digital Image Representation

f(x,y)

f(x, y): x, y denote spatial coordinates, and f() at any point (x,y) is proportional to the brightness (or gray level) of the image. In a digital image, (x,y) is a discrete picture elements, pixel (pel).

Image
pel

Frames to be digitized are first partitioned into a large number of picture element or pels for short, which are typically arranged in row and columns. A row of pels is called a scan line.

Image & Video

Pixel or Pel

Line

Sequence
Frame or Picture

Why Digitalized ?

Good quality for storage and transmission Interactivity Variable- rate transmission on demand Easy software conversion from one standard to another Integration of various video applications Editing capabilities, such as cutting and pasting, zooming, removal of noise and blur

Robustness to channel noise and ease of encryption Trend of DSP VLSI Problem with a digital video system

Huge amount of data

Solution: Image/Video Compression

Elements of Digital Image Processing

Applications: multimedia, DSC, remote diagnosis, video conferencing, VOD, surveillance, ... Acquisition: sensing and digitizing Storage: short-term, on-line, and archival Processing: software on general-purpose or dedicated computers, hardware boards Communication: PSTN, ISDN, wireless, the Internet Display: TV monitors, slides/photos, CRT, printers

Three Level of DIP

Lowlevel

Midlevel

Reduce noise, contrast enhancement and image sharpening Input and output are both images Segmentation and description Input: general images Output: edge, contour, sharp and etc. Recognize the objects

Highlevel

DIP: PR, IA & CV

Pattern Recognition:

Image Analysis:

Also known as classification or pattern classification The act of taking in raw data and taking an action based on the category of the data Use statistics and machine learning methods The extraction of useful information from image By means of digital image processing techniques A subfield of artificial intelligence Program a computer to "understand" a scene or features in an image

Computer Vision:

Relationships Between DIP, PR, IA & CV

PR

DIP

CV

IA

Application of DIP

Industry:

Medical imaging & image analysis

Digital camera, camcorder, scanner LCD TV, Plasma TV.. Vision-based vehicle detection OCR, alignment, positioning CT, MRI, X-ray Bioinformatics for drug design

Others

Satellite imaging, resource analysis, national defense

Traditional Topics

Image enhancement

Adjusting the image histogram to improve image contrast

Image restoration

Application of the median filter

 Image transformation

 Image segmentation

Image Categorizing via Source

Image sources may come from electromagnetic (EM) bands (see below), acoustics, ultrasound, electron, range measurement or simply computer-generated EM : milimeter wave, microwave, thermal, near infrared, visual, X-ray, Gamma-ray

X-Ray Imaging

Infrared and Thermal

Multispectral Imaging

Multispectral Imaging

Please note that bands 4 5 and 7

Satellite Imaging

Infrared Satellite Imaging

Infrared Satellite Imaging

Electromagnetic

(Crab Nebula)

Ultrasound Imaging

MRI Imaging

Magnetic Resonance Imaging

Scanning Electron Microscope

Applications

Medicine

Breast cancer inspector

Vascular

Applications

Manufactured goods check

Applications

Acoustic imaging

Seismic for oil exploration

Applications

Fingerprint matching License plate reading Serial number reading

Fundamental Steps

Components of IPS

Digital Image Fundamentals

Cf. Prof. Wen-Nung Lies slides

Formation of Image

Component

Eye: retina Camera: CCD..

Human Visual Perception

How many different gray levels can humans see? People can distinguish more than 5 bits but less than 6 bits.

32 steps in gray level

64 steps in gray level

Human Visual Perception

Is our perception of gray level affected by surrounding brightness

Is the gray level the same at the left side of each panel as it is at the right side?

Human Visual Perception

Which narrow vertical stripe looks darker? In fact, they are the same brightness.

Simultaneous Contrast

All the center squares have exactly the same intensity

Optical Illusion

Nonexisting information or wrongly perceives geometrical properties of objects

Quantitatively Describe Quality of Chromatic Light Source

Radiance

Total amount of energy that flows from the light source (Watts, W) A measurement of the amount of energy An observer perceives from a light source (lumens, lm) A subjective descriptor of light perception

Luminance

Brightness

Quantitatively Describe Quality of Chromatic Light Source

Example

Light emitted from a far infrared source have high radiance, but almost no luminance

Image Sensing & Acquisition

The illumination source emits energy which is reflected or absorbed by the element of the scene being imaged

The wavelength of an EM wave required to see an object must be of the same size as or smaller than the object The physical properties of the sensor materials also limits the capability of imaging sensors (cf. CCD & CMOS, CCD & IRCCD)

2-D sensor array, up to 4000x4000 noise reduction is achieved by long integration time

Image Formation Model

Intensity=illumination*(reflectance or transmissivity)

r(x,y) = 0.01 for black velvet, 0.65 for

stainless steel, 0.8 for flat-white wall paint, 0.9 for silver-plated metal, 0.93 for snow

Image sampling & Quantization

Digitalizing the coordinate values is called sampling. Digitalizing the amplitude values is called quantization

Sampling for 2-D sensor array is needless

Image content is a consideration in choosing parameters in sampling and quantization

Digital Images Representation

Definition of coordinate system

Dynamic range of an image Range of values spanned by the gray levels of existing pixels

Spatial resolution (e.g., dpi, or 1024x1024) Gray-level resolution (8 (often visual), 10, 12 (e.g., thermal), or 16 bits/sample)

Image Data Formats

Binary: 0 & 1 (mainly line drawing or documents) Gray Scale (Levels): 0 (black), shades of gray, 2^m - 1 (white). Color: three primary color components, e.g. Red (R), Green (G), Blue (B). Resolution: 1024x1024, 512x512, 256x256, 352x240, ...

Uncompressed Image

Image Type Pixels per Frame Bits/Pixel Uncompressed Size 3.74 Mb FAX (200 dpi) 1700 x 2200 1 VGA XVGA 640 x 480 1024x768 8 24 246 Mb 18.87 Mb

Digital Image Acquisition Process

Energy

Basic Concepts in Sampling and Quantization

Sampling and Quantization

F(x) F(x)

x SAMPLING QUANTIZATION

2-D Sampling

2D image

Representing Digital Image

Spatial resolution Definition of coordinate

Number of Storage Bits

Sampling
(a) (b) (c) (d) (e) (f) 1024x1024 512x512 256x256 128x128 64x64 32x32

Quantization: 256, 128, 64, 32, 16, 8, 4, 2

Downsampling

Re-sampling

Different Gray-level

Isoperformance Curve

In N-k plane, points on the same curve represent equal subjective quality

Isoperformance Curve

Isopreference curve tends to shift right and upward Vertical behavior which is graylevel-independent)

Zooming & Shrinking

Zoom: oversampling Shrink: undersampling

Zooming & Shrinking

Zooming : oversampling Shrinking : undersampling Methods

Nearest neighbor interpolation Pixel replication Bilinear interpolation Use more neighbors for interpolation (e.g., cubic interpolation) Blur an image slightly before shrinking it (according to sampling theory)

Related Techniques

Duplicate Interpolation

Bilinear Cubic

Comparisons

Duplication Bilinear interpolation Cubic interpolation

Refer from CCU Prof. Wen-Nung Lie

Basic Concept

4, 8-connected Adjacency

Connected and graylevels are similar (in an allowed set)

4, 8, or m-adjacency (mixed)

Distance Measurement

Euclidean distance D4 distance (city-block distance)

Equal distance map

Distance Measurement

D8 distance (chessboard distance)

Equal distance map

Distance Measurement

Dm distance (the shortest m-path between the points) n depends on the pixels along the path

The m-path between p and p4 is dependent on the value (0 or 1) of p1and p3 -- 2 or 3 or 4