A random variable X has a probability distribution as X a b C P(X) = |p(x) 1/4 1/2 1/4] It is correlated with the other random variable Y(0,1). Their relation can be |X\Y 1 1/2 1/2 a described by conditional probability matrix P(Y/X) = b 2/3 1/3 1/4 3/4

Advanced Engineering Mathematics
10th Edition
ISBN:9780470458365
Author:Erwin Kreyszig
Publisher:Erwin Kreyszig
Chapter2: Second-order Linear Odes
Section: Chapter Questions
Problem 1RQ
icon
Related questions
Question
A random variable X has a probability
distribution
as
X
P(X) = D6
a
C
p(x) 1/4 1/2 1/4]
It is correlated with the other random variable Y(0,1).
Their relation can be
X\Y
1/2 1/2
2/3 1/3
1/4 3/4
1
a
described by conditional probability matrix P(Y/X) =
b
%3D
Transcribed Image Text:A random variable X has a probability distribution as X P(X) = D6 a C p(x) 1/4 1/2 1/4] It is correlated with the other random variable Y(0,1). Their relation can be X\Y 1/2 1/2 2/3 1/3 1/4 3/4 1 a described by conditional probability matrix P(Y/X) = b %3D
1) calculate its entropy, H(X).
2) calculate P(Y) and entropy of Y, H(Y).
3) calculate the joint and conditional entropy H(XY) and H(Y/X).
4) calculate the mutual information I(X,Y).
5) calculate the conditional entropy H(X/Y).
Transcribed Image Text:1) calculate its entropy, H(X). 2) calculate P(Y) and entropy of Y, H(Y). 3) calculate the joint and conditional entropy H(XY) and H(Y/X). 4) calculate the mutual information I(X,Y). 5) calculate the conditional entropy H(X/Y).
Expert Solution
steps

Step by step

Solved in 4 steps

Blurred answer
Knowledge Booster
Markov Processes and Markov chain
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, advanced-math and related others by exploring similar questions and additional content below.
Recommended textbooks for you
Advanced Engineering Mathematics
Advanced Engineering Mathematics
Advanced Math
ISBN:
9780470458365
Author:
Erwin Kreyszig
Publisher:
Wiley, John & Sons, Incorporated
Numerical Methods for Engineers
Numerical Methods for Engineers
Advanced Math
ISBN:
9780073397924
Author:
Steven C. Chapra Dr., Raymond P. Canale
Publisher:
McGraw-Hill Education
Introductory Mathematics for Engineering Applicat…
Introductory Mathematics for Engineering Applicat…
Advanced Math
ISBN:
9781118141809
Author:
Nathan Klingbeil
Publisher:
WILEY
Mathematics For Machine Technology
Mathematics For Machine Technology
Advanced Math
ISBN:
9781337798310
Author:
Peterson, John.
Publisher:
Cengage Learning,
Basic Technical Mathematics
Basic Technical Mathematics
Advanced Math
ISBN:
9780134437705
Author:
Washington
Publisher:
PEARSON
Topology
Topology
Advanced Math
ISBN:
9780134689517
Author:
Munkres, James R.
Publisher:
Pearson,