Consider a source with 5 possible messages: a1, a2, a3, as, as. (a) What is the maximum possible entropy for a source of this type (that is, a source with 5 possible messages)? (b) Suppose this source generates its message according to the following probability distri- bution: P(a)= 0.24, P(a2) = 0.22, P(a3) = 0.20, P(as) = 0.18, P(as) = 0.16. How many bits would a Huffman code assign to message a3?

Consider a source with 5 possible messages: a1, a2, a3, as, as. (a) What is the maximum possible entropy for a source of this type (that is, a source with 5 possible messages)? (b) Suppose this source generates its message according to the following probability distri- bution: P(a)= 0.24, P(a2) = 0.22, P(a3) = 0.20, P(as) = 0.18, P(as) = 0.16. How many bits would a Huffman code assign to message a3?

A First Course in Probability (10th Edition)

10th Edition

ISBN:9780134753119

Author:Sheldon Ross

Publisher:Sheldon Ross

Chapter1: Combinatorial Analysis

Section: Chapter Questions

Problem 1.1P: a. How many different 7-place license plates are possible if the first 2 places are for letters and...

See similar textbooks