Beruflich Dokumente
Kultur Dokumente
4c8 Handout 2
Pupil
Retina
Optic Nerve
Blind Spot
just noticeable difference in intensity intensity is the power of the incident visible light
The solution is
= = 1 log10 2
p defines a perceptual intensity scale. Our perception of intensity is linear wrt p. When we talk about intensity values in images we are referring to this scale. 256 levels are sufficient and hence 8-bits numbers are commonly used to define intensity ranges in images.
Colour Sensitivity
Cone Cells in the eyes convert wavelengths of life into 3 values known as a tri-stimulus
The tri stimulus values encode the relative strengths of each of the 3 colour basis.
Different colours correspond to different mixtures of tri-stimulus values.
must determine tristimulus (ie. RGB) values for a mono-chromatic light source as a function of its wavelength. (perceptual studies)
These functions are known as colour matching functions and can be used to estimate RGB for any combination of colours.
Note: exact values of weights vary the higher weight for green reflects the increased sensitivity of the HVS to luminance in wavelengths corresponding to the colour green.
YUV contd.
U and V values are defined below for PAL = 0.5 = 0.625 Hence conversion between RGB and YUV is linear
0.3 0.6 0.1 =C , where C = 0.15 0.3 0.45 0.4375 0.375 0.0625
RGB values can be found from YUV values by calculating the matrix inverse of C.
Examples of Conversions
Black (rgb = [0 0 0]) has yuv = [0 0 0] White (rgb = [255 255 255]) has yuv = [255 0 0] Shade of Gray (rgb = [x x x]) has yuv = [x 0 0] Red (rgb = 255 0 0) has yuv = [76.5 -38.3 111.6] Green (rgb = [0 255 0]) has yuv = [153 -76.5 -95.6]
Note: It is common to scale the U and V components so that it fits inside the range 0 to 255 (add 128 to both values)
Conversion from RGB to each of these colour spaces is linear but the conversion coefficients can vary slightly.
RGB v YUV
RGB
YUV
RGB v HSV
RGB
Hue Saturation Value
HSV
Spatial Frequency =
N cycles
Grating increases in freq. Left to Right Intensity decreases vertically. Sensitivity is given by the perceived height of the columns.
Max sensitivity is at about 5 degrees/cycle Vertical Frequency Sensitivity is similar but HVS is less sensitive to lower frequencies
100
90
80
70
60
50
40
30
50
100
150
200
250
300
350
400
450
500
20
140
160
180 Column
200
220
240
Bands appear to be brighter on the left than on the right. This is due to spatial filtering in the visual cortex. This phenomenon is simulated with simple filtering of an image row using a low pass filter with a symmetric impulse response.
Original Image
C o lo ur s ub s a m p le d b y 4 :1
Downsample the U and V chrominance channels and leave the Y channel alone
OK
512 x 512 + 256 x 256 x 2 = 0.31 MB (1/2 bandwidth of original)
C o lo ur s ub s a m p le d b y 1 6 :1
Downsample the U and V chrominance channels and leave the Y channel alone
Still OK
512 x 512 + 128 x 128 x 2 = 0.24 MB (1/3 bandwidth of original)
Lum ina nc e s ub s a m p le d b y 1 6 :1
Not good
128 x 128 x 3 = 0.04 MB (1/16 bandwidth of original)
Latex
Chrominance Downsampling
You will often see ratios in the description of codecs
4:2:0 means 4:1 Chrominance downsampling (2:1 along rows and columns) 4:2:2 2:1 Chrominance downsampling only along the rows. ie. half the colour samples are kept 4:1:1 4:1 Chrominance downsampling along rows. No downsampling along rows. 4:4:4 no Chrominance downsampling
Noise harder to see in Textured areas due to reduction in contrast sensitivity at higher spatial frequencies.
1 =
()
is the image, is the ground truth/reference image and N is the number of pixels in the image
= 10 log10
2552
A 100 x 100 block of noise has been added to each image at two locations. Because of activity masking it is much less visible in right image. Hence perceived quality of the right image should be higher.
These images show the difference between the corrupted images and the original. MSE 3.7
Lots of subjects required to get reliable measurements. Also subjectivity implies that there will be disagreements between subjects.
Summary
We discussed HVS factors that influence compression
human contrast sensitivity depends drops as spatial frequency increases contrast sensitivity is less for chrominance than luminance