Taiz University, YEMEN

14 September 2014
Taiz University, YEMEN
To identify the information theory and
how is it related to communication
system and transmission link.
To develop the tools necessary to
enable the student to evaluate
communication and storage systems
for selecting an appropriate
coding/decoding technique.
To design different types of coding
systems.
2 14 September 2014
Taiz University, YEMEN
It assumes students have a
background in
Probability Theory
Logic Principles
Digital Communication Systems
3 14 September 2014
Taiz University, YEMEN
4 14 September 2014
Text Books:
Fundamentals in Information Theory and Coding
by M. Borda, 2011.
ERROR CONTROL CODING From Theory to
Practice by P. Sweeney, 2002.
A Practical Guide to Error-Control Coding Using
MATLAB by Y. Jiang, 2010.
Error-Correction Coding for Digital
Communications by G. Clark, 1981.
Digital Communication by J. Proakis, 2001.

Taiz University, YEMEN
5 14 September 2014
Grade Date
Assignment 20 Presented at 16/11/2014
Test 1 10 12/10/2014
Test 2 20 7/12/2014
Final Exam 100
Total 150
Taiz University, YEMEN
Information Transmission Systems
Information Theory
Source Coding
Channel Coding
6 14 September 2014
Taiz University, YEMEN
14 September 2014 7
Information
is any message that brings a specification in a problem
which involves a certain degree of uncertainty.

have meaning of form/shape of the mind.

is a fundamental, abstract notion, as energy in physics.
Taiz University, YEMEN
14 September 2014 8
Source
The information source S generates the
information.
Channel
The channel is the physical medium which is
used to transmit the information from S to D.
Destination
The destination D receives the information
which is sent by C.
Taiz University, YEMEN
14 September 2014 9
Noise (N)
Information carried by
signal X
Transmitted signal x(t)
The information source can be discrete (digital source), or continuous (signal
source). The discrete source generates a finite number of symbols (e.g. 0 and 1 used
in digital communications) while the continuous source, an infinite number of
symbols (e.g. voice, television signal, measurement and control signals).
Received signal y(t)
Taiz University, YEMEN
The role of an ITS is to ensure a high degree of
fidelity for the information at destination,
regardless to the imperfections and
interferences occurring in the channel or
storage medium.

14 September 2014 10
signal processing for
transmission depend on
Source Destination Channel
Accuracy
degree
System
cost
Taiz University, YEMEN
14 September 2014 11
Analogue Systems
Accuracy degree is estimated by mean squared error [] and signal/noise
ratio (SNR) []:

Digital Systems
Accuracy degree is estimated by bit error rate (BER): the probability of
receiving an erroneous bit.
Taiz University, YEMEN
14 September 2014 12
S/D
source/destination;
C
S
/ DC
S
source
encoding/decoding
blocks;
E/D source
encryption/decrypti
on blocks;
C
C
/DC
C
channel
encoding/decoding
blocks;
i information
(signal)
v encoded word
n noise
r received signal
estimated
information.
Taiz University, YEMEN
The process named coding stands for both encoding and
decoding and is used to achieve the followings:
matching the source to the channel/storage medium (if different as
nature), using the source encoding block (C
S
).
ensuring efficiency in transmission/storage, which means minimum
transmission time/minimal storage space, all these defining source
compression (C
S
).
reliable transmission/storage despite channel/storage medium noise
(error protection performed by the channel coding block C
C
)
preserving information secrecy from unauthorized users, using the
source encryption/decryption blocks (E/D).
For digital systems, signal detection, meaning that the
receiver must decide, using the received signal, which of
the digital signals has been sent
14 September 2014 13
Taiz University, YEMEN
Why modulation is used in ITS?
Why synchronous is necessary for digital system?
Why digital?
14 September 2014 14
Illustration of signal regeneration in digital communications: a) original signal,
b) slightly distorted signal, c) distorted signal, d) intense distorted signal, e)
regenerated signal (l - distance in transmission).
Taiz University, YEMEN
15 14 September 2014