Consider a source with 5 possible messages: a1, a2, a3, as, as. (a) What is the maximum possible entropy for a source of this type (that is, a source with 5 possible messages)? (b) Suppose this source generates its message according to the following probability distri- bution: P(a)= 0.24, P(a2) = 0.22, P(a3) = 0.20, P(as) = 0.18, P(as) = 0.16. How many bits would a Huffman code assign to message a3?
Consider a source with 5 possible messages: a1, a2, a3, as, as. (a) What is the maximum possible entropy for a source of this type (that is, a source with 5 possible messages)? (b) Suppose this source generates its message according to the following probability distri- bution: P(a)= 0.24, P(a2) = 0.22, P(a3) = 0.20, P(as) = 0.18, P(as) = 0.16. How many bits would a Huffman code assign to message a3?
A First Course in Probability (10th Edition)
10th Edition
ISBN:9780134753119
Author:Sheldon Ross
Publisher:Sheldon Ross
Chapter1: Combinatorial Analysis
Section: Chapter Questions
Problem 1.1P: a. How many different 7-place license plates are possible if the first 2 places are for letters and...
Related questions
Question
Need help solving this practice problem. Will rate, thank you in advance.

Transcribed Image Text:Consider a source with 5 possible messages: a1, a2, a3, a4, a5.
(a) What is the maximum possible entropy for a source of this type (that is, a source with
5 possible messages)?
(b) Suppose this source generates its message according to the following probability distri-
bution:
P(a)= 0.24, P(a2) = 0.22, P(a3) = 0.20, P(as) = 0.18, P(as) = 0.16.
How many bits would a Huffman code assign to message a3?
Expert Solution

This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
Step by step
Solved in 4 steps with 65 images

Recommended textbooks for you

A First Course in Probability (10th Edition)
Probability
ISBN:
9780134753119
Author:
Sheldon Ross
Publisher:
PEARSON


A First Course in Probability (10th Edition)
Probability
ISBN:
9780134753119
Author:
Sheldon Ross
Publisher:
PEARSON
