Exercise 4.7 Calculate the system entropies where I is the binary erasure channel (BEC), introduced in §4.1, and the input probabilities of 0 and 1 are p and p. Show that this channel satisfies (4.9) and (4.10). H(BA) ≤ H(B), H(AB) ≤ H(A), (4.9) (4.10)

A First Course in Probability (10th Edition)
10th Edition
ISBN:9780134753119
Author:Sheldon Ross
Publisher:Sheldon Ross
Chapter1: Combinatorial Analysis
Section: Chapter Questions
Problem 1.1P: a. How many different 7-place license plates are possible if the first 2 places are for letters and...
icon
Related questions
Question
Exercise 4.7
Calculate the system entropies where I is the binary erasure channel (BEC), introduced in §4.1,
and the input probabilities of 0 and 1 are p and p. Show that this channel satisfies (4.9) and
(4.10).
H(BA) ≤H(B),
H(AB) ≤ H(A),
(4.9)
(4.10)
Transcribed Image Text:Exercise 4.7 Calculate the system entropies where I is the binary erasure channel (BEC), introduced in §4.1, and the input probabilities of 0 and 1 are p and p. Show that this channel satisfies (4.9) and (4.10). H(BA) ≤H(B), H(AB) ≤ H(A), (4.9) (4.10)
H(B | A) ≤ H(B),
(4.9)
d only if P = or p = 0, 1. This means that the uncertainty
decreases when A is known. Similarly, H(A | B) = H (p) +
(p) (since H(q) ≥ H(P)), so
H(AB) ≤ H (A),
(4.10)
Transcribed Image Text:H(B | A) ≤ H(B), (4.9) d only if P = or p = 0, 1. This means that the uncertainty decreases when A is known. Similarly, H(A | B) = H (p) + (p) (since H(q) ≥ H(P)), so H(AB) ≤ H (A), (4.10)
Expert Solution
steps

Step by step

Solved in 3 steps

Blurred answer
Similar questions
Recommended textbooks for you
A First Course in Probability (10th Edition)
A First Course in Probability (10th Edition)
Probability
ISBN:
9780134753119
Author:
Sheldon Ross
Publisher:
PEARSON
A First Course in Probability
A First Course in Probability
Probability
ISBN:
9780321794772
Author:
Sheldon Ross
Publisher:
PEARSON