APJ ABDUL KALAM TECHNOLOGICAL UNIVERSITY
SECOND SEMESTER M.TECH DEGREE EXAMINATION, APRIL-MAY 2017

Electronics and Communication Engineering

(Telecommunication Engineering)

01EC6518 Information Theory

Max. Marks : 60 Duration: 3 Hours
Answer any two questions from each Part

Part A

1. a) The channel matrix between the source 'X' and the destination 'Y' ina
communication system is given by:

yi

y2

= = ys
0.7

Source emits symbols with probabilities 0.3, 0.4 and 0.3. Find H(X), H(Y), HWY),
3೧6 (7) 0) Differentiate between Memory less sources and Markov sources. (2) 2. a)
Determine the Lempel Ziv code for the bit stream 000101110010100101. Also recover
the original sequence from the encoded stream. (4) b) Find a binary Huffman code for
the source emitting symbols with probabilities 0.49, 0.14, 0.14, 0.07, 0.04, 0.02, 0.02,
0.01. Also find the code efficiency and redundancy. (5)

3. a) Explain about marginal entropy of a source. Derive a relation for marginal
entropy. (4)