BIRLA INSTITUTE OF TECHNOLOGY AND SCIENCE, PILANI Hyderabad Campus INSTRUCTION DIVISION SECOND SEMESTER 2010-2011 Course Handout

Part II Date: 7-1-2011 In addition to Part-I (General Handout for all courses appended to the timetable) this portion gives further specific details regarding the course. Course No. Course Title Instructor-in-charge Instructors : ECE C393 : Information Theory and Coding : P.K.Thiruvikraman : P.K.Thiruvikraman

1. Course description: 3 0 3 Random variables and random processes; Information sources and source coding theorem, Kraft inequality, Shannon-Fano codes, Huffman codes, Arithmetic Codes, Lempel-Ziv-Welch algorithm, universal source codes; channel capacity: channel capacity; noisy channel coding theorem for discrete memoryless channels; channel capacity with feedback; continuous and Gaussian channels; error control coding: linear block codes and their properties, hard-decision decoding, convolution codes and the Viterbi decoding algorithm, iterative decoding; turbo codes and low density-parity-check codes; rate distortion theory: rate distortion function, random source codes; joint source-channel coding and the separation theorem; cryptography: basic concepts on cryptography and cryptoanalysis, security issues; private-key encryption algorithms- stream ciphers, block ciphers, Shannon's theory; introduction to number theory - modular arithmetic, exponentiation and discrete logarithms in Galois field; public-key encryption algorithms- DiffieHellman public-key distribution scheme, RSA public-key cryptosystem; Message authentication, hashing functions, digital signatures.

2. Scope & Objective: 1. To apply the concepts of random processes and probability theory to communication subsystems 2. To implement security measures in communication systems using cryptographic principles

3. Text Books 1. Information Theory, Coding and Cryptography, 2nd Ed., Dr. Ranjan Bose, Tata McGrawHill

4. Reference Books 1. Elements of information theory, Thomas M.Cover and Joy A.Thomas, Wiley-India 2. Foundations of Coding, Jiri Adamek, John Wiley, 1991 3. The Mathematics of Coding Theory, Paul Garrett, Pearson Education, 2005

5. Course Plan Lect. No. 1,2 Topics to be covered Learning Objectives Ref. to Text Book (Sec nos) Introduction to Information Theory Measure of Information 1.1 to 1.2

3,4 5,6 7,8 9, 10 11, 12

Average Mutual Information and Entropy Source coding theorem Huffman Coding The Lempel-Ziv algorithm, run length encoding Rate distortion function & Optimum Quantizer

Concept of Binary Symmetric channel, conditional\l entropy Fundamentals of source coding

1.3 1.5 1.6 1.7,1.8 1.9-1.10

13, 14, 15 16, 17, 18, 19 20, 21 22, 23 24, 25 26, 27 28, 29 30, 31, 32, 33 34, 35, 36, 37 38, 39, 40 41, 42

Introduction to Image Compression Channel Models Block codes for error correction Matrix description of linear block codes Syndrome decoding Hamming codes Cyclic codes Matrix description of cyclic codes BCH codes Cryptography Asymmetric key cryptography

To understand JPEG compression format and lossy compression To understand Channel capacity & noisy coding theorem Introduction to error correcting codes Parity check matrix, decoding of a linear code

1.11 to 1.13 2.1 to 2.4 3.1 to 3.2 3.3 to 3.6 3.7 to 3.9 3.10 to 3.13

Division algorithm for cyclic codes

4.1 to 4.3 4.4 to 4.11

Generator polynomials, Minimal polynomials Overview of encryption techniques, symmetric key cryptography, The RSA algorithm

5.1 to 5.10 8.1 to 8.4 8.8 to 8.9

6. Evaluation Scheme Component Test I Test II Surprise tests* Assignments Compre Duration 50 mts. 50 mts. Weightage 60 60 30 30 120 Date & Time TBA TBA Venue TBA TBA Remarks Open Book Closed Book Open Notes Closed Book

3 hrs

TBA

* 4 surprise tests will be held during lecture or tutorial hours and best 2 will be considered. No make up for surprise tests. Make-up for other components only with prior permission. 7. Chamber Consultation Hour: Will be announced in the class. 8. Notices: Notices concerning this course will be displayed on the Notice board of department of EEE only. Students should also check the EDUCAN website for notices and course material. 2

Instructor-in-Charge ECE C393