THE VISUAL DISPLAY SYSTEM

The Visual Display System consists of two important components – the Monitor and the Adapter Card & Cable.

THE MONITOR

The principle on which the monitor works is based upon the operation of a sealed glass tube called the Cathode Ray Tube
(CRT).

Monochrome CRT

The CRT is a
vacuum sealed
glass tube having
two electrical
terminals inside,
the negative
electrode or
cathode (K) and
a positive
electrode or
anode (A).
Across these
terminals a high
potential of the
order of 18 KV is
maintained. This
produces a beam
of electrons,
known as
cathode rays,
from the cathode
towards the
anode. The front
face of the CRT is
coated with a
layer of a material
called phosphor
arranged in the form of a rectangular grid of a large number of dots. The material phosphor has a property of emitting a
glow of light when it is hit by charged particles like electrons.
The beam of electrons is controlled by three other positive terminals. The control
grid (G1) helps to draw out the electrons in an uniform beam, the accelerating grid
(G2) provides acceleration to the electrons in the forward direction and the
focusing grid (G3) focuses the beam to a single point on the screen ahead, so that
the diameter of the beam is equal to the diameter of a single dot of phosphor. This
dot is called a pixel, which is short for Picture Element. As the beam hits the
phosphor dot, a single glowing pixel is created at the center of the screen. On the
neck of the CRT are two other electrical coils called deflection coils. When
current flows through these coils, the electrical field produced interacts with the
electron beam thereby deflecting it from its original path. One of the coils called
the horizontal deflection coil moves the beam horizontally across the screen
and the other coil called the vertical deflection coil moves the beam vertically
along the height of the screen. When both these coils are energized the electron
beam can be moved in any direction thus generating a single spot of light at any
point on the CRT screen.

Raster Scanning

To draw an image on the CRT screen involves the process of raster scanning. It is the process by which the electron beam
sequentially moves over all the pixels on the screen. The beam starts from the upper-left corner of the screen, moves over
the first row of pixels until it reaches the right hand margin of the screen. The beam is then switched off and retraces back
horizontally to the beginning of the second row of pixels. This is called horizontal retrace. It is then turned on again and
moves over the second row of pixels. This process continues until it reaches the bottom-right corner of the screen, after
which it retraces back to the starting point. This is called vertical retrace. The entire pattern is called a raster and each
scan line is called a raster line.

Frames and Refresh Rate

The electron beam is said to

produce a complete frame of
picture when starting from the
top-left corner it moves over all
the pixels and returns back to
the starting point. The human
brain has the capability to hold
on to the image of an object
before our eyes for a fraction of
a second even after the object
has been removed from before
our eyes. This phenomenon is
called persistence of vision.
As the beam moves over each
pixel, the glow of the pixel dies down although its image persists in our eyes for sometimes after that. So if the beam can
come back to the pixel before its glow has completely disappeared, to us it will seem that the pixel is glowing continuously.
It has been observed that we see a steady image on the screen only if 60 frames are generated on the screen per second
i.e. the electron beam should return to its starting point within 1/60 th of a second. The monitor is then said to have a
refresh rate of 60 Hz. A monitor with a refresh rate of less than 50 Hz produces a perceptible flicker on the screen and
should be avoided.

Color CRT

The working principle of

a color CRT is same as
that of a monochrome
CRT, except that here
each pixel consists of
three colored dots
instead of one and is
called a triad. These
colors are red, green and
blue (RGB) and are
called primary colors.
Corresponding to the
three dots there are also
three electron beams
from the electrode (also
called electron gun) each
of which falls on the
corresponding dot. It has been experimentally observed that the three primary colored lights can combine in various
proportions to produce all other colors. As each of the three beams hits the corresponding dots in various intensities, they
produce different proportions of the three elementary colored lights which together create the sensation of a specific color in
our eyes. Our eyes cannot distinguish the individual dots but see their net effect as a whole. A perforated screen called a
shadow mask prevents the beams from falling in the gap between the dots. Secondary colors are created by mixing
equal quantities of primary colors e.g. red and green create yellow, green and blue create cyan, blue and red create
magenta, while all the three colors in equal proportion produce white.

Interlacing

A process by which monitors of lower refresh rates can produce images comparable in quality to that produced by a monitor
of higher refresh rate. Here each frame is split into two parts consisting of odd and even lines from the complete image.
These are called odd-field and even-field. The first field is displayed for half the frame duration and then the second field
is displayed so that its lines fit between the lines of the first field. This succeeds in lowering the frame rate without
increasing the flicker correspondingly, although the picture quality is still not same as that of a non-interlaced monitor. One
of the most popular applications of interlacing is TV broadcasting.

Monitor Specifications

(a) Refresh Rate : Number of frames displayed by a monitor in one second. Thus a monitor having a frame rate of 60 Hz
implies that an image on the screen of the monitor is refreshed 60 times per second.

(b) Horizontal Scan Rate : Number of horizontal lines displayed by the monitor in one second. For a monitor having a
refresh rate of 60 Hz and 600 horizontal lines on the screen, the horizontal scan rate is 36 KHz.

(c) Dot Pitch : Shortest distance between two neighbouring pixels or triads on the screen. Usually of the order of 0.4 mm
to 0.25 mm.

(d) Pixel Addressability : The total number of pixels that can be addressed on the screen. Measured by the product of
the horizontal number of pixels and the vertical number of pixels on the screen. Modern monitors usually have 640 X
480 pixels or 800 X 600 pixels on the screen.

(e) Aspect Ratio : Ratio of the width of the screen to its height. For computer monitors and TV screens it is 4:3, whereas
for movie theatres it is 16:9.

(f) Size : The longest diagonal length of the monitor. Standard computer monitors are usually between 15” and 20” in
size.

(g) Resolution : The total number of pixels per unit length of the monitor either in the horizontal or vertical directions.
Measured in dots per inch (dpi). Usually of the order of 75 dpi to 96 dpi for modern monitors.

(h) Color Depth : A measure of the total number of colors that can be displayed on a monitor. Depends on the number of
the varying intensities that the electron beams can be made to have. A monitor with a color depth of 8-bits can display
a total of 28 or 256 colors.

Problem-1

A 15” monitor with aspect ratio of 4:3 has a pixel addressability of 800 X 600. Calculate its resolution.

Lets the width of the monitor be 4x and its height be 3x.

For a right angled triangle by we know,
(4x)2 + (3x)2 = 152
i.e. 16x2 + 9x2 = 152
i.e. x=3
 The width of the monitor is 12” and the height is 9”
So, resolution is (800/12) = (600/9) = 66.67 dpi

Problem-2

A monitor can display 4 shades of red, 8 shades of blue and 16 shades of green. Find out its color depth.

Each pixel can take up a total of (4 X 8 X 16) or 512 colors.

Since 29 = 512, the monitor has a color depth of 9-bits.

THE VIDEO ADAPTER CARD AND CABLE

The Video Adapter is an expansion card which usually sits on a slot on the motherboard. It acts as an interface between the
processor of the computer and the monitor. The digital data requiring for creating an image on the screen is generated by
the central processor of the computer and consists of RGB values for each pixel on the screen. These are called pixel
attributes. For an 8-bit image, each pixel is digitally represented by an 8-bit binary number. The adapter interprets these
attributes and translates them into one of 256 voltage levels (since 28 = 256) to drive the electron gun of the monitor.
These intensity signals along with two synchronization signals for positioning the electron beam at the location of the pixel,
are fed to the monitor from the adapter through the video cable.

The VGA

The Video Graphics Array (VGA) adapter was a standard introduced by IBM which was capable of displaying text and
graphics in 16 colors at 640 x 480 mode or 256 colors at 320 x 240 mode. A VGA card had no real processing power
meaning that the CPU had to do most of the image manipulation tasks. The VGA adapter was connected to a VGA
compatible monitor using a video cable with a 15-pin connector. The pins on the connector carried various signals from the
card to the monitor including the color intensity signals and the synchronization signals. The sync signals were generated by
the adapter to control the movement of the electron guns of the CRT monitor. Sync signals consisted of the horizontal sync
pulses which controlled the left to right movement of the electron beam as well as the horizontal retrace, and the vertical
sync pulses which controlled the up and down movement of the beam as well as the vertical retrace. Nowadays VGA has
become obsolete being replaced by the SVGA adapters.

The SVGA

The industry extended the VGA standard to include improved capabilities like 800 x 600 mode with 16-bit color and later on
1024 x 768 mode with 24-bit color. All of these standards were collectively called Super VGA or SVGA. The Video Electronics
Standard Association (VESA) defined a standard interface for the SVGA adapters and called it VESA BIOS Extensions. Along
with these new improved standards came accelerated video cards which included a special graphics processor on the
adapter itself and relieved the main CPU from most of the tasks of image manipulation.

Components of an Adapter
The main components of the video adapter card include :

Display Memory

A bank of memory within the adapter card used for storing pixel attributes. Initially used for storing the image data from
the CPU and later used by the adapter to generate RGB signals for the monitor. The amount of memory should be sufficient
to hold the attributes of all the pixels on the screen and depends on the pixel addressability as well as the color depth. Thus
for a 8-bit image displayed at 640 x 480 mode, minimum amount of display memory required is approximately 1 MB.
Graphics Controller

A chip within the adapter card responsible for coordinates the activities of all other components of the card. For the earlier
generation video cards, the controller simply passed on the data from the processor to the monitor after conversion. For
modern accelerated video cards, the controller also has the capability of manipulating the image data independently of the
central processor.

Digital-to-Analog Converter

The DAC actually converts the digital data stored in the display memory to analog voltage levels to drive the electron beams
of the CRT.

Problem-3

A monitor has pixel addressability of 800 X 600 and a color depth of 24-bits. Calculate the minimum amount of
display memory required in its adapter card to display an image on the screen.

A total of 24-bits are allocated to each pixel.

So for a total of 800 X 600, total number of bits required is (800 X 600 X 24).
To store these many bits, the amount of display memory required is (800 X 600 X 24)/(8 X 1024 X 1024) which
rounded to the next highest integer becomes 2 MB.

Accelerated Graphics Port (AGP)

To combat the eventual saturation of the PCI bus with video information a new interface has been pioneered by Intel
(http://developer.intel.com/technology/agp) , designed specifically for the video subsystem. AGP was developed in response
to the trend towards greater and greater performance requirements for video. As software evolves and the computer use
continuously into previously unexplored areas such as 3D acceleration and full-motion video playback, both the processor
and the video adapter need to process more and more information. Another issue has been the increasing demands for
video memory. Much larger memory are being required on video cards not just for the screen image but for the 3D
calculations. This in turn makes the video card more expensive.
AGP gets around these problems by two approaches. It provides a separate AGP slot on the motherboard connected to an
AGP bus providing 530 MB/sec. It also utilizes a portion of the main memory known as the texture cache for storing pixel
attributes thereby going beyond the limits of display memory on the adapter card. AGP is ideal for transferring the huge
amount of data required for displaying 3D graphics and animation. AGP is considered a port and not a bus as it involves
only two devices, the processor and the video card and is not expandable. AGP has helped remove bandwidth overheads
from the PCI bus.
 The slot itself is physically
similar to the PCI slot but is
offset further from the edge of
the motherboard.

The Liquid Crystal Display

Principle of Operation

Liquid crystals were first discovered in the late 19 th century by Austrian botanist Freidrich Reinitzer and the term liquid
crystal was coined by German physicist Otto Lehmann.
Liquid crystal are transparent organic substances consisting of long rod-like molecules which in their natural state arrange
themselves with their axes roughly parallel to each other. By flowing the liquid crystal over finely grooved
surface it is possible to control the alignment of the molecules as they follow the alignment of the grooves.

The first principle of an LCD consists of sandwiching a layer of liquid crystal between two finely grooved surfaces whose
grooves are perpendicular to each other. Thus the molecules at the two surfaces are aligned perpendicular to each other
and those at the intermediate layers are twisted by intermediate angles. Light in following the molecules is also twisted by
90 degrees as it passes through the liquid crystal.

The second principle of an LCD depends on

polarizing filters. Natural light waves are oriented
at random angles. A polarizing filter acts as a net
of finely parallel lines blocking all light except those
whose waves are parallel to those lines. A second
polarizer perpendicular to the first would therefore
block all of the already polarized light. An LCD
consists of two polarizing filters perpendicular to
each other with a layer of twisted liquid crystals
between them. Light after passing through the first
polarizer is twisted through 90 deg. By the liquid
crystal and passes out completely through the
second polarizer. This gives us a lighted pixel. On
applying an electric charge across the liquid crystal
its molecular alignment is disturbed. In this case
light is not twisted by 90 degrees by the liquid
crystal and therefore blocked by the second
polarizer. This gives us a dark pixel. Images are
drawn on the screen using arrangements of these
lighted and dark pixels.
 VIDEO

INTRODUCTION

The recording and editing of sound has long been in the domain of the PC. Doing so with motion video
has only recently gained acceptance. This is because of the enormous file size required by video. For
example : one second of 24-bit, 640 X 480 mode video and its associated audio required 30 MB space.
Thus a 20 minute clip filled 36 GB of disk space. Moreover it required processing at 30 MB/s.

The only solution was to compress the data, but compression hardware was very expensive in the early
days of video editing. As a result video was played in very small sized windows of 160 X 120 pixels
which occupied only 1/16 th of the total screen. It was only after the advent of the Pentium-II processor
coupled with cost reduction of video compression hardware, that full screen digital video finally became
a reality.

Moving Pictures

In motion video the illusion of moving images is created by displaying a sequence of still images rapidly
one after another. If displayed fast enough our eye cannot distinguish the individual frames, rather
because of persistence of vision merges the individual frames with each other thereby creating an effect
of movement.
Each individual image in this case is called a frame and the speed with which the images are displayed
one after another is called frame rate. The frame rate should range between 20 and 30 for perceiving
smooth realistic motion. Audio is added and synchronized with the apparent movement of images.
Motion picture is recorded on film whereas in motion video the output is an electrical signal. Film
playback is at 24 fps while for video ranges from 25 to 30. Visual and audio data when digitized and
combined into a file gives rise to digital video.

Video represents a sequence of real world images taken by a movie camera. So it depicts an event that
physically took place in reality. Animation also works on the same principle of displaying a sequence of
images at a specific speed to create the illusion of motion but here the images are drawn by artists, by
hand or software. So the events do not depict any real sequence of events taking place in the physical
world.

ANALOG VIDEO

In analog video systems video is stored and processed in the form of analog electrical signals. The most
popular example is television broadcasting. In contrast, digital video is where video is represented by a
string of bits. All forms of video represents in a PC represents digital video.

Video Camera

Analog video cameras are used to record a succession of still images and then convert the brightness and
color information of the images into electrical signals. These signals are transmitted from one place to
another using cables or by wireless means and in the television set at the receiving end these signals are
again converted to form the images. The tube type analog video camera is generally used in professional
studios and uses electron beams to scan in a raster pattern, while the CCD video camera, using a light-
sensitive electronic device called the CCD, is used for home/office purposes where portability is
important.

Tube type Camera

The visual image in

front of the video
camera is presented
to the user by an
optical lens. This
lens focuses the
scene on the
photosensitive surface of a tube in the same way that the lens of a camera focuses the image on the film
surface.
The photo-sensitive surface, called Target, is a form of semi-conductor. It is almost an insulator in the
absence of light. With absorption of energy caused by light striking the target, electrons acquire
sufficient energy to take part in current flow. The electrons migrate towards a positive potential applied
to the lens side of the target. This positive potential is applied to a thin layer of conductive but
transparent material. The vacant energy states left by the liberated electrons, called holes, migrate
towards the inner surface of the target. Thus a charge pattern appears on the inner surface of the target
that is most positive where the brightness or luminosity of the scene is the greatest.
The charge pattern is sampled point-by-point by a moving beam of electrons which originates in an
electron gun in the tube. The beam scans the charge pattern in the same way a raster is produced in a
monitor but approach the target at a very low velocity. The beam deposits just enough carriers to
neutralize the charge pattern formed by the holes. Excess electrons are turned back towards the source.
The exact number of electrons needed to neutralize the charge pattern constitute a flow of current in a
series circuit. It is this current flowing across a load resistance that forms the output signal voltage of the
tube.

CCD Camera

The ADC sends the digital information

to a digital signal processor (DSP).
The DSP adjusts the contrast and
detail in the image, compresses the
data and sends it to the camera’s
storage medium.

The transistors generate a continuous

analog electrical signal that goes to an
analog to digital converter. The ADC
translates the varying signal to a digital
format consisting of 1s and 0s.

Instead of being focused on

photographic film, the image is
focused on a chip called a CCD.
The face of the CCD is studded
with an array of transistors that
create electrical current in
proportion to the intensity of light
striking them.

Light passing through the lens of the camera is focussed on a chip called CCD. The surface of the CCD is covered with an
array of transistors that create electrical current in proportion to the intensity of the light striking them. The transistors
make up the pixels of the image. The transistors generate a continuous analog electrical signal that goes to an ADC which
translates the signal to a digital stream of data. The ADC sends the digital information to a digital signal processor (DSP)
that has been programmed specifically to manipulate photographic images. The DSP adjusts the contrast and brightness of
the image, and compresses the data before sending it to the camera’s storage medium. The image is temporarily stored on
a hard drive, RAM, floppy or tape built into the camera’s body before being transferred to the PC’s permanent storage.
 Television Systems
Color Signals

The video cameras produce three output

signals which require three parallel cables for transmission. Because of the complexities involved in
transmitting 3 signals in exact synchronism, TV systems do not usually handle RGB signals. Signals are
encoded in composite format as per Luma-Chroma principle based on human color perceptions. This is
distributed using a single cable or channel.

Human Color Perception

All objects that we observe are focused sharply by the lens system of the eye on the retina. The retina
which is located at the back side of the eye has light sensitive cells which measure the visual sensations.
The retina is connected with the optic nerve which conduct the light stimuli as sensed by the organs to
the optical centre of the brain. According to the theory formulated by Helmholtz the light sensitive cells
are of two types – rods and cones. The rods provide brightness sensation and thus perceive objects in
various shades of grey from black to white. The cones that are sensitive to color are broadly divided in
three different groups. One set of cones detect the presence of blue color, the second set perceives red
color and the third is sensitive to the green shade. The combined relative luminosity curve showing
relative sensation of brightness produced by individual spectral colors is shown below. It will be seen
from the plot that the sensitivity of the human eye is greatest for the green-yellow range decreasing
towards both the red and blue ends of the spectrum. Any color other than red, green and blue excite
different sets of cones to generate a cumulative sensation of that color. White color is perceived by the
additive mixing of the sensations from all the three sets of cones.
Based on the spectral response curve and extensive tests with a large number of observers, the relative
intensities of the primary colors for color transmission e.g. for color television, has been standardized.
The reference white for color television transmission has been chosen to be a mixture of 30% red, 59%
green and 11% blue. These percentages are based on the light sensitivities of the eye to different colors.
Thus one lumen (lm) of white light = 0.3 lm of red + 0.59 lm of green + 0.11 lm of blue = 0.89 lm of
yellow + 0.11 lm of blue = 0.7 lm of cyan + 0.3 lm of red = 0.41 lm of magenta + 0.59 lm of green.

Luma-Chroma Principle

The principle states that any video signal can be broken into two components :
The luma component, which describes the variation of brightness in different portions of the image without regard to any
color information. It is denoted by Y and can be expressed as a linear combination of RGB :

Y = 0.3R + 0.59G + 0.11B

 The chroma component, which describe the variation of color
information in different parts of the image without regard to any brightness information. It is denoted by C and can further
be subdivided into two components U and V.

Thus RGB output

signals from a video camera are transformed to YC format using electronic circuitry before being transmitted. At the
receiving end for a B/W TV, the C component is discarded and only the Y component is used to display a B/W image. For a
color TV, the YC components are again converted back to RGB signals which are used to drive the electron guns of a CRT.

Color Television Camera

The figure below shows a block diagram of a color TV camera. It essentially consists of three camera
tubes in which each tube receives selectively filtered primary colors. Each camera tube develops a signal
voltage proportional to the respective color intensity received by it. Light from the scene is processed
by the objective lens system. The image formed by the lens is split into three images by glass prisms.
These prisms are designed as diachroic mirrors. A diachroic mirror passes one wavelength and rejects
other wavelengths. Thus red, green and blue images are formed. These pass through color filters which
provide highly precise primary color images which are converted into video signals by the camera tubes.
This generates the three color signals R, G and B.

To generate the monochrome or brightness signal that represents the luminance of the scene the three
camera outputs are added through a resistance matrix in the proportion of 0.3, 0.59 and 0.11 for R, G
and B respectively

Y = 0.3R + 0.59G + 0.11B

The Y signal is transmitted as in a monochrome television system. However instead of transmitting all
the three color signals separately the red and blue camera outputs are combined with the Y signal to
obtain what is known as the color difference signals. Color difference voltages are derived by
subtracting the luminance voltage from the color voltages. Only (R-Y) and (B-Y) are produced. It is
only necessary to transmit two of the three color difference signals since the third may be derived from
the other two.
The color difference signals equal zero when white or grey shades are being transmitted. This is
illustrated by the calculation below.

For any grey shade (including white) let R = G = B = v volts.

Then Y = 0.3v + 0.59v + 0.11v = v
Thus, (R-Y) = v – v = 0 volt, and (B-Y) = v – v = 0 volt.
When televising color scenes even when voltages R, G and B are not equal, the Y signal still represents
monochrome equivalent of the color. This aspect can be illustrated by the example below. For simplicity
of calculation let us assume that the camera output corresponding to the maximum (100%) intensity of
white light be an arbitrary value of 1 volt.

Consider a color of unsaturated magenta and it is required to find out the voltage components of the
luminance and color difference signals.

Since the hue is magenta it implies a mixture of red and blue. The word unsaturated indicates that some
white light is also there. The white content will develop all the three i.e. R, G and B voltages, the
magnitudes of which will depend on the extent of unsaturation. Thus R and B voltages must dominate
and both must be of greater amplitude than G. Let R=0.7 volt, G=0.2 volt, B=0.6 volt represent the
unsaturated magenta color. The white content must be represented by equal quantities of the three
primaries and the actual amount must be indicated by the smallest voltage i.e. G=0.2 volt. Thus the
remaining i.e. R=(0.7-0.2)=0.5 volt and B=(0.6-0.2)=0.4 volt is responsible for the magenta hue.
The luminance signal Y = 0.3R+0.59G+0.11B = 0.3(0.7)+0.59(0.2)+0.11(0.6) = 0.394 volt.
The color difference signals are : (R-Y) = 0.7-0.394 = 0.306 volt
(B-Y) = 0.6-0.394 = 0.206 volt
The other component (G-Y) can be derived as shown below:
Y = 0.3R+0.59G+0.11B
Thus, (0.3+0.59+0.11)Y = 0.3R+0.59G+0.11B
Rearranging the terms, 0.59(G-Y) = -0.3(R-Y) –0.11(B-Y)
i.e. G-Y = -0.51(R-Y)-0.186(B-Y)

Since the value of the luminance is Y=0.394 volt and peak white corresponds to 1 volt, the magenta will
show up as a fairly dull grey in a monochrome television set.

Chroma Sub-sampling
Conversion of RGB signals into YC format also has another important advantage of utilizing less
bandwidth through the use of chroma subsampling. It had been observed through experimentation that
human eye is more sensitive to brightness information than to color information. This limitation can be
exploited to transmit reduced color information as compared to brightness information, a process called
chroma-subsampling, and save on bandwidth requirements.
On account of this, we get code words like "4:2:2" and "4:1:1" to describe how the subsampling is done.
Roughly, the numbers refer to the ratios of the luma sampling frequency to the sampling frequencies of
the two chroma channels (typically Cb and Cr, in digital video); "roughly" because this formula doesn't
make any sense for things like "4:2:0".

4:4:4 --> No chroma subsampling, each pixel has Y, Cr and Cb values.

4:2:2 --> Chroma is sampled at half the horizontal frequency as luma, but the vertical frequency is the
same. The chroma samples are horizontally aligned with luma samples.
4:1:1 --> Chroma is sampled at one-fourth the horizontal frequency as luma, but at full vertical
frequency. The chroma samples are horizontally aligned with luma samples.
4:2:0 --> Chroma is sampled at half the horizontal frequency as luma, and also at half the vertical
frequency. Theoretically, the chroma pixel is positioned between the rows and columns.

Bandwidth and
Frequencies
Each TV channel is
allocated 6 MHz of
bandwidth. Out of
these the 0 to 4 MHz
part of the signal is
devoted to Y
component, the next
1.5 MHz is taken up
by the C component,
and the last 0.5 MHz
is taken up by the
audio signal.
 Video Signal Formats

Component Video

Our color television system starts out with three channels of information; Red, Green, & Blue (RGB). In
the process of translating these channels to a single composite video signal they are often first converted
to Y, R-Y, and B-Y. Both three channel systems, RGB and Y, R - Y, B - Y are component video signals.
They are the components that eventually make up the composite video signal. Much higher program
production quality is possible if the elements are assembled in the component domain.

Composite Video

A video signal format where both the luminance and chroma components are transmitted along a single
wire or channel. Usually used in normal video equipment like VCRs as well as TV transmissions.
NTSC, PAL, and SECAM are all examples of composite video systems.

S-Video
Short for
Super-video. A
video signal
format where
the luminance
and color
components are
transmitted separately using multiple cables or channels.
Here picture quality is better than that of composite video
but is more expensive. Usually used in high end VCRs and
capture cards.
 Television Broadcasting Standards
NTSC
National Television Systems Committee. Broadcast standard used in USA and Japan. Uses 525 horizontal lines at 30 (29.97)
frames / sec. Uses composite video format where luma is denoted by Y and chroma components by I and Q. While Y utilizes
4 MHz bandwidth of a television channel, I uses 1.5 MHz and Q only 0.5 MHz. I and Q can be expressed as combinations of
RGB as shown below :
I = 0.74(R-Y) – 0.27(B-Y)
Q = 0.48(R-Y) + 0.41(B-Y)

PAL

Phase Alternating Lines. Broadcast standard used in Europe, Australia, South Africa, India. Uses 625 horizontal lines at 25
frames / sec. Uses composite video format where luma is denoted by Y and chroma components by U and V. While Y
utilizes 4 MHz bandwidth of a television channel, U and V both uses 1.3 MHz each. U and V can be expressed as a linear
combination of RGB as shown below :
U = 0.493(B-Y)
V = 0.877(R-Y)

SECAM

Sequential Color and Memory. Used in France and Russia. The fundamental difference between the SECAM system on one
hand and the NTSC and PAL system on the other hand is that the latter transmit and receive two color signals
simultaneously while in the SECAM system only one of the two difference signals is transmitted at a time. It also uses 625
horizontal lines at 25 frames/sec. Here the color difference signals are denoted by DR and DB and both occupies 1.5 MHz
each. They are given by the relations:
DR = -1.9(R-Y)
DB = 1.5(B-Y)

Other Television Systems

Enhanced Definition Television Systems (EDTV)

These are conventional systems modified to offer improved vertical and horizontal resolutions. One of the systems emerging
in US and Europe is known as the Improved Definition Television (IDTV). IDTV is an attempt to improve NTSC image
by using digital memory to double the scanning lines from 525 to 1050. The pictures are only slightly more detailed than
NTSC images because the signal does not contain any new information. By separating the chrominance and luminance parts
of the video signal, IDTV prevents cross-interference between the two.

High Definition Television (HDTV)

The next generation of television is known as the High Definition TV (HDTV). The HDTV image has approximately twice as
many horizontal and vertical pixels as conventional systems. The increased luminance detail in the image is achieved by
employing a video bandwidth approximately five times that used in conventional systems. Additional bandwidth is used to
transmit the color values separately. The aspect ratio of the HDTV screen will be 16 : 9. Digital codings are essential in the
design and implementation of HDTV. There are two types of possible digital codings : composite coding and component
coding. Composite coding of the whole video signal is in principle easier than a digitization of the separate signal
components (luma and chroma) but there are also serious problems with this approach, like disturbing cross-talk between
the luma and chroma information, and requirement of more bandwidth due to the fact that chroma-subsampling would not
be possible. Hence component coding seems preferable. The luminance signal is sampled at 13.5 MHz as it is more crucial.
The chrominance signals (R-Y, B-Y) are sampled at 6.75 MHz (4:2:2). The digitized luminance and chrominance signals are
then quantized with 8 bits each. For the US, a total of 720000 pixels are assumed per frame. If the quantization is 24
bits/pixel and the frame rate is approximately 60 frame/second, then the data rate for the HDTV will be 1036.8
Mbits/second. Using a compression method data rate reduction to 24 Mbits/second will be possible without noticeable
quality loss. In the case of European HDTV, the data rate is approximately 1152 Mbits/second.

DIGITAL VIDEO

Video Capture

Source and Capture Devices

Two main components : Source and Source device Capture device. During capture the visual component
and audio component are captured separately and automatically synchronized. Source devices must use
PAL or NTSC playback and must have Composite video or S-video output ports.

The source and source device can be the following :

• Camcorder with pre-recorded video tape
• VCP with pre-recorded video cassette
• Video camera with live footage
• Video CD with Video CD player
Video Capture Card

A full motion video capture card is a circuit board in the computer that consists of the following components :
• Video INPUT port to accept the video input signals from NTSC/PAL/SECAM broadcast signals, video camera or VCR. The
input port may conform to the composite-video or S-video standards.
• Video compression-decompression hardware for video data.
• Audio compression-decompression hardware for audio data.
• A/D converter to convert the analog input video signals to digital form.
• Video OUTPUT port to feed output video signals to camera and VCR.
• D/A converter to convert the digital video data to analog signals for feeding to output analog devices.
• Audio INPUT/OUTPUT ports for audio input and output functions.
Rendering support for the various television signal formats e.g. NTSC, PAL, SECAM imposes a level of complexity in the
design of video capture boards.

Video Capture Software

The following capabilities might be provided by a video capture software, often bundled with a capture card :

AVI Capture : This allows capture and digitization of the input analog video signals from external devices and conversion to
an AVI file on the disk of the computer. No compression is applied to the video data and hence this is suitable for small files.
Playback of the video is done through the Windows Media Player. Before capturing parameters like frame rate, brightness,
contrast, hue, saturation etc. as well as audio sampling rate and audio bit size may be specified.

AVI to MPEG Converter : This utility allows the user to convert a captured AVI file to MPEG format. Here the MPEG
compression algorithm is applied to an AVI file and a separate MPG file is created on the disk. Before compression
parameters like quality, amount of compression, frame dimensions, frame rate etc. may be specified by the user. Playback
of the MPEG file is done through the Windows Media Player.

MPEG Capture : Certain cards allow the user to capture video directly in the MPEG format. Here analog video data is
captured, digitized and compressed at the same time before being written to the disk. This is suitable for capturing large
volumes of video data. Parameters like brightness, contrast, saturation etc. mat be specified by the user before starting
capturing.

DAT to MPEG Converter : This utility converts the DAT format of a Video-CD into MPEG. Conversion to MPEG is usually
done for editing purposes. DAT and MPG are similar formats so that the file size changes by very small amounts after
conversion. The user has to specify the source DAT file and the location of the target MPG file.

MPEG Editor : Some capture software provide the facility of editing an MPEG file. The MPG movie file is opened in a
timeline structure and functions are provided for splitting the file into small parts by specifying the start and end of each
portion. Multiple portions may also be joined together. Sometimes functions for adding effects like transitions or sub-titling
may also be present. The audio track may also be separately edited or manipulated.
 Video Compression
Types of Compression

Video compression is a process whereby the size of the digital video on the disk is reduced using certain mathematical
algorithms. Compression is required only for storing the data. For playback of the video, the compressed data need again to
be decompressed. Software used for the compression/decompression process are called CODECs. During the process of
compression the algorithms analyse the source video and tries to find out redundant and irrelevant portions. Greater is the
amount of these portions in the source data, better is the scope of compressing it.

Video compression process may be categorised using different criteria.

Lossless compression occurs when the original video data is not changed permanently in any way during the compression
process. This means that the original video data can be obtained after decompression. Though this preserves the video
quality, but the amount of compression achieved is usually limited. This process is usually used where the quality is of more
importance than the storage space issues e.g. medical image processing.
Lossy compression occurs where a part of the original data is discarded during the compression process in order to reduce
the file size. This data is lost forever and cannot be recovered after the decompression process. Thus here quality is
degraded due to compression. The amount of compression and hence the degradation in quality is usually selectable by the
user – more is the compression greater is the degradation in quality and vice versa. This process is usually used where
storage space is more important than quality e.g. corporate presentations.

Since video is essentially a sequence of still images, compression can be differentiated on what kind of redundancy is
exploited. Intraframe compression occurs where redundancies in each frame or still image (spatial redundancy) is exploited
to produce compression. This process is same as an image compression process. A video CODEC can also implement
another type of compression when it exploits the redundancies between adjacent frames in a video sequence (temporal
redundancy). This is called interframe compression.

Compression can also be categorized based on the time taken to compress and decompress. Symmetrical compression
algorithms take almost the same for both the compression and decompression process. This is usually used in live video
transmissions. An asymmetrical compression algorithm usually take a greater amount of time for the compression process
than for the decompression process. This is usually used for applications like CD-ROM presentations.

Since video is essentially a sequence of still images, the initial stage of video compression is same as that for image
compression. This is the intraframe compression process and can be both lossless and lossy. The second stage after each
frame is individually compressed is the interframe compression process where redundancies between adjacent frames are
exploited to achieve compression.

Lossy Coding Techniques

Lossy coding techniques are also known as Source Coding. The popular methods are discussed below :

Discrete Cosine Transform (DCT)

Which portion of data is considered lossy and which lossless depends on the algorithm.
One method to separate relevant from irrelevant information is Transform Coding. This transforms data into a different
mathematical model better suited for the purpose of separation. One of the best known transform codings is Discrete Cosine
Transform (DCT). For all transform codings an inverse function must exist to enable reconstruction of the relevant
information by the decoder.
An image is subdivided into blocks of 8 X 8 pixels. Each of these blocks is represented as a combination of DCT functions.
64 appropriately chosen coefficients represent the variation of horizontal and vertical frequencies of varying pixel intensities.
The human eye is greatly sensitive at low frequency levels, but it sensitivity decreases at high frequency levels. Thus
reduction in number of high frequency DCT components weakly affects image quality. After the DCT transform, a process
called Quantization is used to extract the relevant information by making the high frequency components zero.

Video Compression Techniques

After the image compression techniques, the video CODEC uses interframe algorithms to exploit
temporal redundancy, as discussed below :

Motion Compensation

By motion compensated prediction, temporal redundancies between two frames in a video sequence can
be exploited. Temporal redundancies can arise from movement of objects in front of a stationary
background. The basic concept is to look for a certain area (block) in a previous or subsequent frame
that matches very closely an area of the same size in the current frame. If successful then the differences
in the block intensity values are calculated. In addition, the motion vector which represents the
translation of the corresponding blocks in both x- and y-directions is determined. Together the
difference signal and the motion vector represent the deviation between the reference block and
predicted block.
 Some Popular CODECs

JPEG

Stands for Joint Photographic Experts Group, a joint effort by ITU and ISO. Achieves compression by
first applying DCT, then quantization, and finally entropy coding the corresponding DCT coefficients.
Corresponding to the 64 DCT coefficients, a 64 element quantization table is used. Each DCT
coefficient is then divided by the corresponding quantization table entry, and the values rounded off. For
entropy coding Huffman method is used.

MPEG-1

Stands for
Moving Pictures
Expert Group.
MPEG-1
belongs to a
family of ISO
standards.
Provides motion
compensation
and utilizes
both intraframe
and interframe compression. Uses 3 different types of frames : I-frames, P-frames and B-frames.
I-frames (intracoded) : These are coded without any reference to other images. MPEG makes use of JPEG for I frames.
They can be used as a reference for other frames.
P-frames (predictive) : These require information from the previous I and/or P frame for encoding and decoding. By
exploiting temporal redundancies, the achievable compression ratio is higher than that of the I frames. P frames can be
accessed only after the referenced I or P frame has been decoded.
B-frames (bidirectional predictive) : Requires information from the previous and following I and/or P frame for encoding
and decoding. The highest compression ratio is attainable by using these frames. B frames are never used as reference for
other frames.

Reference frames must be transmitted first. Thus transmission order and display order may differ. The first I frame must be
transmitted first followed by the next P frame and then by the B frames. Thereafter the second I frame must be
transmitted. An important data structure is the Group of Pictures (GOP) . A GOP contains a fixed number of consecutive
frames and guarantees that the first picture is an I-frame. A GOP gives an MPEG encoder information as to which picture
should be encoded as an I, P or B frame and which frames should serve as references.

The first frame in a GOP is always an I-frame which is encoded like an intraframe image i.e. with DCT, quantization and
entropy coding. The motion estimation step is activated when B or P frames appear in the GOP. Entropy coding is done by
using Huffman coding technique.
Cinepak

Cinepak was originally developed to play small movies on '386 systems, from a single- speed CD-ROM drive. Its greatest
strength is its extremely low CPU requirements. Cinepak's quality/datarate was amazing when it was first released, but does
not compare well with newer CODECs available today. There are higher-quality (and lower-datarate) solutions for almost
any application. However, if you need your movies to play back on the widest range of machines, you may not be able to
use many of the newer codecs, and Cinepak is still a solid choice.
After sitting idle for many years, Cinepak is finally being dusted off for an upgrade. Cinepak Pro from CTI
(www.cinepak.com) is now in pre-release, offering an incremental improvement in quality, as well as a number of bug fixes.
Supported by QuickTime and Video for Windows.

Sorenson
One of the major advances of QuickTime 3 is the new Sorenson Video CODEC which is included as a standard component of
the installation. It produces the highest quality low-data rate QuickTime movies.
The Sorenson Video CODEC produces excellent Web video suitable for playback on any Pentium or PowerMac. It also
delivers outstanding quality CD-ROM video at a fraction of traditional data rates, which plays well on 100MHz systems.
Compared with Cinepak, Sorenson Video generally achieves higher image quality at a fraction of the data rate. This allows
for higher quality, and either faster viewing (on the WWW), or more movies on a CD-ROM (often four times as much
material on a disc as Cinepak). It supports variable bitrate encoding [When movies are compressed, each frame of the video
must be encoded to a certain number of bytes. There are several techniques for allocating the bytes for each frame. Fixed
bitrate is used by certain codecs (like Cinepak), which attempt to allocate approximately the same number of bytes per
frame. Variable bitrate (VBR) is supported by other codecs (such as MPEG-2 and Sorenson), and attempts to give each
frame the optimum number of bytes, while still meeting set constraints (such as the overall data rate of the movie, and the
maximum peak data rate). ]. Supported by Quicktime. Manufacturer is Sorenson Vision Inc (www.sorensonvideo.com )

RealVideo

RealMedia currently has only two video CODECs: RealVideo (Standard) and RealVideo (Fractal).
RealVideo (Standard) is usually best for data rates below 3 Kbps. It works better with relatively static material than it does
with higher action content. It usually encodes faster. RealVideo (Standard) is significantly more CPU intensive than the
RealVideo (Fractal) CODEC. It usually requires a very fast PowerMac or Pentium for optimal playback. It is supported by the
RealMedia player. Manufacturer is Progressive Networks (www.real.com).

H.261
H.261 is a standard video-conferencing CODEC. As such, it is optimized for low data rates and relatively low motion. Not
generally as good quality as H.263. H.261 is CPU intensive, so data rates higher than 50 Kbps may slow down most
machines. It may not play well on lower-end machines. H.261 has a strong temporal compression component, and works
best on movies in which there is little change between frames. Supported by Netshow, Video for Windows.

H.263
H.261 is a standard video-conferencing CODEC. H.263 is an advancement of the H.261 standard, mainly it was used as a
starting point for the development of MPEG (which is optimized for higher data rates). Supported by QuickTime, Netshow,
Video for Windows.

Indeo Video Interactive (IVI)

Indeo Video Interactive (IVI) is a very high-quality, wavelet-based CODEC. It provides excellent image quality, but requires
a high-end Pentium for playback. There are currently two main versions of IVI. Version 4 is included in QuickTime 3 for
Windows; Version 5 is for DirectShow only. Neither version currently runs on the Macintosh, so any files encoded with IVI
will not work cross-platform. Version 5 is very similar to 4, but uses an improved wavelet algorithm for better compression.
Architecures supported are QuickTime for Windows, Video for Windows, DirectShow. Manufacturer is Intel (www.intel.com).

VDOLive

VDOLive is an architecture for web video delivery, created by VDOnet Corporation (www.vdo.net). VDOLive is a server-
based, "true streaming" architecture that actually adjusts to viewers' connections as they watch movies. Thus, true
streaming movies play in real-time with no delays for downloading. For example, if you clicked on a 30 second movie, it
would start playing and 30 seconds later, it would be over, regardless of your connection, with no substantial delays.
VDOLive's true streaming approach differs from QuickTime's "progressive download" approach. Progressive download allows
you to watch (or hear) as much of the movie as has downloaded at any time, but movies may periodically pause if the
movie has a higher data rate than the user's connection, or if there are problems with the connection or server, such as
very high traffic. In contrast to progressive download, the VDOLive server talks to the VDOPlayer (the client) with each
frame to determine how much bandwidth a connection can support. The server then only sends that much information, so
movies always play in real time. In order to support this real-time adjustment of the data-stream, you must use special
server software to place VDOLive files on your site.
The real-time adjustment to the viewer's connection works like this: VDOLive files are encoded in a "pyramidal" fashion. The
top level of the pyramid contains the smallest amount of the most critical image data. If your user has a slow connection,
they are only sent this top portion. The file's next level has more data, and will be sent if the viewer's connection can handle
it, and so forth. Users with very fast connections (T1 or better) are sent the whole file. Thus, users are only sent what they
can receive in real-time, but the data has been pre-sorted so that the information they get is the best image for their
bandwidth.

MPEG-2

MPEG-2 is a standard for broadcast-quality digitally encoded video. It offers outstanding image quality and resolution.
MPEG-2 is the primary video standard for DVD-Video. Playback of MPEG-2 video currently requires special hardware, which
is built into all DVD-Video players, and most (but not all) DVD-ROM kits.
MPEG-2 was based on MPEG-1 but optimized for higher data rates. This allows for excellent quality at DVD rates (300-1000
Kbps), but tends to produce results inferior to MPEG-1 at lower rates. MPEG-2 is definitely not appropriate for use over
network connections (except in very special, ultra-high-performances cases).

MPEG-4

MPEG-4 is a standard currently under development for the delivery of interactive multimedia across networks. As such, it is
more than a single CODEC, and will include specifications for audio, video, and interactivity. The video component of MPEG-
4 is very similar to H.263. It is optimized for delivery of video at Internet data rates. One implementation of MPEG-4 video
is included in Microsoft's NetShow. The rest of the MPEG-4 standard is still being designed. It was recently announced that
QuickTime's file format will be used as a starting point.

Playback Architectures

QuickTime

QuickTime is Apple's multi-platform, industry-standard, multimedia software architecture. It is used by software developers,
hardware manufacturers, and content creators to author and publish synchronized graphics, sound, video, text, music, VR,
and 3D media. The latest free downloads, and more information, are available at Apple's QuickTime site.
(http://www.apple.com/quicktime). QuickTime offers support for a wide range of delivery media, from WWW to DVD-ROM.
It was recently announced that the MPEG-4 standard (now in design) will be based upon the QuickTime file format.
QuickTime is also widely used in digital video editing for output back to videotape. QuickTime is the dominant architecture
for CD-ROM video. It enjoys an impressive market share due to its cross-platform support, wide range of features, and free
licensing. QuickTime is used on the vast majority of CD-ROM titles for these reasons. QuickTime is a good choice for kiosks,
as it integrates well with Macromedia Director, MPEG, and a range of other technologies.

RealMedia

The RealMedia architecture was developed by Progessive Networks, makers of RealAudio. It was designed specifically to
support live and on-demand video and audio across the WWW. The first version of RealMedia is focused on video and audio,
and is referred to as RealVideo. Later releases of RealMedia will incorporate other formats including MIDI, text, images,
vector graphics, animations, and presentations. RealMedia content can be placed on your site either with or without special
server software. There are performance advantages with the server, but you don't have to buy one to get started. However,
high volume sites will definitely want a server to get substantially improved file delivery performance. Users can view
RealMedia sites with the RealPlayer, a free "client" application available from Progressive. A Netscape plug-in is also
available. The main downside to RealMedia is that it currently requires a PowerMac or Pentium computer to view. As such,
RealMedia movies aren't available to the full range of potential users. The latest free downloads, as well as more
information, are available at www.real.com.

NetShow

Microsoft's NetShow architecture is aimed at providing the best multimedia delivery over networks, from 14.4 kbps modems
to high-speed LANs. There is an impressive range of audio and video CODECs built into NetShow 3.0. Combined with a
powerful media server, this is a powerful solution for networked media. Technically, the term "NetShow" refers to the client
installation and the server software. Netshow clients are built on top of the DirectShow architecture. Because of this,
NetShow has access to its own CODECs, and also those for DirectShow, Video for Windows, and QuickTime. Netshow media
on WWW pages may be viewed via ActiveX components (for Internet Explorer), plug-ins (for Netscape Navigator), or stand-
alone viewers. NetShow servers support "true streaming" (in their case, called "intelligent streaming"): the ability to
guarantee continuous delivery of media even if the networks' performance degenerates. If this happens, NetShow will
automatically use less video data (thus reducing the quality). If the amount of available bandwidth decreases more,
NetShow will degrade video quality further, until only the audio is left. Microsoft says that their implementation provides the
most graceful handling of this situation. The latest free downloads, as well as more information, are available at Microsoft's
NetShow site (www.microsoft.com/netshow).

DirectShow

DirectShow (formerly known as ActiveMovie) is the successor to Microsoft's Video for Windows architecture. It is built on top
of the DirectX architecture (including DirectDraw, DirectSound, and Direct3D), for optimum access to audio and video
hardware on Windows-based computers. Supported playback media includes WWW, CD-ROM, DVD-ROM, and DVD-Video
(with hardware). DV Camera support will be added in an upcoming release. DirectShow has its own player (the Microsoft
Media Player, implemented as an ActiveX control) which may be used independently or within Internet Explorer. There is
also a plug-in for use with Netscape Navigator. And playback may also be provided by other applications using the OCX
component. As DirectShow is the playback architecture for NetShow, these playback options support either delivery
approach. Media Types Supported are Audio, Video, Closed Captioning (SAMI), MIDI, MPEG, animation (2D or 3D). The
latest free downloads, as well as more information, are available at Microsoft's DirectX site
(www.microsoft.com/directx/pavilion/dshow/default.asp).

Video for Windows

Video for Windows is similar to QuickTime. Its main advantage is that it is built into Windows 95. However, it is limited in
many ways. It runs on Windows only, doesn't handle audio/video synchronization as well as QuickTime, and doesn't support
variable-length frames. Video for Windows is no longer supported by Microsoft, and is being replaced by
DirectShow/ActiveMovie (one of the DirectX technologies). Video for Windows is often referred to as "AVI" after the .AVI
extensions specified by its file format.

[Some of the details discussed is available at: http://www.etsimo.uniovi.es/hypgraph/video/codecs/Default.htm ]

Some Concepts of Video Editing

Time Base and Frame Rates

In the natural world we experience time as a continuous flow of events. However working with video
requires precise synchronization so it is necessary to measure time using precise numbers. Familiar time
increments like hours, minutes, seconds, are not precise enough as each second might contain several
events. When editing video several source clips may need to be imported to create the output clip. The
source frame rates of these source clips determine how many frame rates are displayed per second
within these clips. Source frame rates can be different for different types of clips:
Motion picture film – 24 fps
PAL and SECAM video – 25 fps
NTSC video – 29.97 fps
Web applications – 15 fps
CD-ROM applications – 30 fps

In a video editing project file there is a single and common timeline where all the imported clips are
placed. A parameter called the timebase determines how time is measured and displayed within the
editing software. For example a timebase of 30 means each second is divided into 30 units. The exact
time at which an edit occurs depends on the timebase specified for the particular project. Since there
needs to be a common timebase for the video editor timeline, source clips whose frame rates do not
match with the specified timebase needs adjustments. For example if the frame rate of a source clip is 30
fps and the timebase of the project is also 30 fps then all frames are displayed as expected (figure below,
half second shown)

However if the source clip was recorded at 24 fps and it is placed on a timeline with a timebase of 30
then to preserve the proper playback speed some of the original frames need to be repeated. In the figure
below, frames 1, 5 and 9 are shown to be repeated for half second duration.

If the final edited video clip needs to be exported at 15 fps, then from the timeline every alternate frames
need to be discarded.

On the other hand if the timebase was set at 24 and the final video needs to be exported at 15 fps, then
some selective frames would need to be discarded. In the figure below frames 3, 6, 8 and 11 are shown
to be discarded for half second duration.
SMPTE Timecode

Timecode defines how frames in a movie are counted and affects the way you view and edit a clip. For
example, you count frames differently when editing video for television than when editing for motion-
picture film. A standard way to represent timecode have been developed by a global body called Society
of Motion Pictures and Television Engineers (SMPTE) and represent timecode by a set of numbers. The
numbers represent hours, minutes, seconds, and frames, and are added to video to enable precise editing
e.g. 00:03:51:03.
When NTSC color systems were developed, the frame rate was changed by a tiny amount to eliminate
the possibility of crosstalk between the audio and color information; the actual frame rate that is used is
exactly 29.97 frames per second. This poses a problem since this small difference will cause SMPTE
time and real time (what your clock reads) to be different over long periods. Because of this, two
methods are used to generate SMPTE time code in the video world: Drop and Non-Drop.

In SMPTE Non-Drop, the time code frames are always incremented by one in exact synchronization to
the frames of your video. However, since the video actually plays at only 29.97 frames per second
(rather than 30 frames per second), SMPTE time will increment at a slower rate than real world time.
This will lead to a SMPTE time versus real time discrepancy. Thus, after a while, we could look at the
clock on the wall and notice it is farther ahead than the SMPTE time displayed in our application.

1 sec. (clock time)

1 sec. (SMPTE time) [video plays at 29.97 frames per sec]

Difference of 0.03 frames per second translates to (0.03 × 60 × 60) or 108 frames per hour.

SMPTE Drop time code (which also runs at 29.97 frames per second ) attempts to compensate for the
discrepancy between real world time and SMPTE time by "dropping" frames from the sequence of
SMPTE frames in order to catch up with real world time. What this means is that occasionally in the
SMPTE sequence of time, the SMPTE time will jump forward by more than one frame. The time is
adjusted forward by two frames on every minute boundary which increases the numbering by 120
frames every hour. However to achieve a total compensation of 108 frames, the increment is avoided at
the following minute boundaries : 00, 10, 20, 30, 40 and 50. Thus when SMPTE Drop time increments
from 00:01:59:29, the next value will be 00:02:00:02 in SMPTE Drop rather than 00:02:00:00 in
SMPTE Non-Drop. In SMPTE Drop, it must be remembered that certain codes no longer exist. For
instance, there is no such time as 00:02:00:00 in SMPTE Drop. The time code is actually 00:02:00:02.
No frames are lost, because drop-frame timecode does not actually drop frames, only frame numbers. To
distinguish from the non-drop type, the numbers are separated by semicolons instead of colons i.e.
00;02;00;02

1 hour (clock time)

diff. of 108 frames 1 hour (SMPTE time)

Online Editing and Offline Editing

There are three phases of video production :

• Pre-production : Involves writing scripts, visualizing scenes, storyboarding etc.
• Production : Involves shooting the actual scenes
• Post-production : Involves editing the scenes and correcting / enhancing wherever necessary.
Editing involves a draft or rough cut called Offline Edit which gives a general idea of the editing
possibilities. Offline edit is usually done on a low-end system using a low resolution copy of the original
video. This is to make the process economically feasible because a low resolution copy is sufficient to
decide on the edit points. An edit decision list (EDL) is created which contains a list of the edit changes
to be carried out. The EDL can be refined through successive iterations until the edit points and changes
are finalized. Since the iterative process may potentially take a long time duration (typically several
days) using a high-end system is not considered desirable and optimum. Once the EDL is finalized, the
final editing work is done on the actual high-resolution copy of the video using a powerful system. This
operation is called Online Edit. It requires a much lesser time compared to an offline edit because the
operations are done only once based on the finalized EDL. The higher costs of the high-end system need
to be borne only for a short time duration (typically few hours).

Edit Decision List (EDL)

An EDL is used in offline editing for recording the edit points. It contains the names of the original
clips, the In and Out points, and other editing information. In Premiere editing decisions in the Timeline
are recorded in text format and then exported in one of the EDL formats. A standard EDL contains the
following columns:
(a) Header – Contains title and type of timecode (drop-frame or nondrop-frame)

(b) Source Reel ID – Identifies the name or number of the videotape containing the source clips
(c) Edit Mode – Indicates whether edits take place on video track, audio track or both.
(d) Transition type – Describes the type of transition e.g. wipe, cut etc.
(e) Source In and Source Out – Lists timecodes of first and last frames of clips
On a high-end system the EDL is accepted by an edit controller which applies the editing changes to the
high-quality clips.

FireWire (IEEE-1394)

Although digital video in an external device or camera is already in binary computer code, you still need
to capture it to a file on a hard disk. Capturing digital video is a simple file transfer to a computer if the
computer has an available FireWire (IEEE-1394) card and a digital video CODEC is available. The
IEEE-1394 interface standard specification is also known as "FireWire" by Apple Computer, Inc. and as
"iLink" or "iLink 1394" by Sony Corp. Developed by the Institute of Electrical and Electronics
Engineers it is a serial data bus that allows high speed data transfers. Three data rates are supported :
100, 200 and 400 Mbps. The bus speed is governed by the slowest active node

It consists two separately shielded pairs of wires for signaling, two power conductors and an outer
shield. Upto 63 devices can be connected in daisy chain. The standard also support hot plugging which
means that devices can be connected or disconnected without switching off power in the cable.
IEEE 1394 is a non-proprietary standard and many organizations and companies have endorsed the
standard. The Digital VCR Conference selected IEEE 1394 as its standard digital interface; an EIA
committee selected IEEE 1394 as the point to point interface for digital TV. Video Experts Standards
Association (VESA) adopted IEEE 1394 for home networking. Microsoft first supported IEEE 1394 in
the Windows 98 operating system and it is supported in newer operating systems.