write a function H(p1, p2) that determines the entropy of a four-state system, if it is known that the probability of occurrence of the 3rd and 4th events is the same. what the maximum values of this function? *photo is an example for this question

Calculus: Early Transcendentals
8th Edition
ISBN:9781285741550
Author:James Stewart
Publisher:James Stewart
Chapter1: Functions And Models
Section: Chapter Questions
Problem 1RCC: (a) What is a function? What are its domain and range? (b) What is the graph of a function? (c) How...
icon
Related questions
Question
100%

write a function H(p1, p2) that determines the entropy of a four-state system, if it is known that the probability of occurrence of the 3rd and 4th events is the same. what the maximum values of this function?

*photo is an example for this question

Task 3. Write a function H(p1, p2) that determines the entropy of a three-state
system. What is the maximum value of this function?
Solution. Consider a system X with three states x1, x2, x3. State probabilities:
X₁ X1 X2
X3
Pi P₁ P2 1- P1 - P2
The entropy of such a system is:
H (P1, P2) =
=-P₁ log p₁ - p2 log p2 - (1- P1 - P2) log(1- P₁ - P2).
The entropy of the system is maximum if the states of the system are equally
probable:
Xi X1 X2 X3
Pi
and is equal to the logarithm of the number of states. Therefore, the function H(p1,
p2) reaches a maximum at the point (1/3, 1/3) and the largest value of the function
is Hmax(p1, p2) = log 3.
Transcribed Image Text:Task 3. Write a function H(p1, p2) that determines the entropy of a three-state system. What is the maximum value of this function? Solution. Consider a system X with three states x1, x2, x3. State probabilities: X₁ X1 X2 X3 Pi P₁ P2 1- P1 - P2 The entropy of such a system is: H (P1, P2) = =-P₁ log p₁ - p2 log p2 - (1- P1 - P2) log(1- P₁ - P2). The entropy of the system is maximum if the states of the system are equally probable: Xi X1 X2 X3 Pi and is equal to the logarithm of the number of states. Therefore, the function H(p1, p2) reaches a maximum at the point (1/3, 1/3) and the largest value of the function is Hmax(p1, p2) = log 3.
Expert Solution
steps

Step by step

Solved in 2 steps with 2 images

Blurred answer
Similar questions
Recommended textbooks for you
Calculus: Early Transcendentals
Calculus: Early Transcendentals
Calculus
ISBN:
9781285741550
Author:
James Stewart
Publisher:
Cengage Learning
Thomas' Calculus (14th Edition)
Thomas' Calculus (14th Edition)
Calculus
ISBN:
9780134438986
Author:
Joel R. Hass, Christopher E. Heil, Maurice D. Weir
Publisher:
PEARSON
Calculus: Early Transcendentals (3rd Edition)
Calculus: Early Transcendentals (3rd Edition)
Calculus
ISBN:
9780134763644
Author:
William L. Briggs, Lyle Cochran, Bernard Gillett, Eric Schulz
Publisher:
PEARSON
Calculus: Early Transcendentals
Calculus: Early Transcendentals
Calculus
ISBN:
9781319050740
Author:
Jon Rogawski, Colin Adams, Robert Franzosa
Publisher:
W. H. Freeman
Precalculus
Precalculus
Calculus
ISBN:
9780135189405
Author:
Michael Sullivan
Publisher:
PEARSON
Calculus: Early Transcendental Functions
Calculus: Early Transcendental Functions
Calculus
ISBN:
9781337552516
Author:
Ron Larson, Bruce H. Edwards
Publisher:
Cengage Learning