write a function H(p1, p2) that determines the entropy of a four-state system, if it is known that the probability of occurrence of the 3rd and 4th events is the same. what the maximum values of this function? *photo is an example for this question
write a function H(p1, p2) that determines the entropy of a four-state system, if it is known that the probability of occurrence of the 3rd and 4th events is the same. what the maximum values of this function? *photo is an example for this question
Calculus: Early Transcendentals
8th Edition
ISBN:9781285741550
Author:James Stewart
Publisher:James Stewart
Chapter1: Functions And Models
Section: Chapter Questions
Problem 1RCC: (a) What is a function? What are its domain and range? (b) What is the graph of a function? (c) How...
Related questions
Question
100%
write a function H(p1, p2) that determines the entropy of a four-state system, if it is known that the probability of occurrence of the 3rd and 4th events is the same. what the maximum values of this function?
*photo is an example for this question

Transcribed Image Text:Task 3. Write a function H(p1, p2) that determines the entropy of a three-state
system. What is the maximum value of this function?
Solution. Consider a system X with three states x1, x2, x3. State probabilities:
X₁ X1 X2
X3
Pi P₁ P2 1- P1 - P2
The entropy of such a system is:
H (P1, P2) =
=-P₁ log p₁ - p2 log p2 - (1- P1 - P2) log(1- P₁ - P2).
The entropy of the system is maximum if the states of the system are equally
probable:
Xi X1 X2 X3
Pi
and is equal to the logarithm of the number of states. Therefore, the function H(p1,
p2) reaches a maximum at the point (1/3, 1/3) and the largest value of the function
is Hmax(p1, p2) = log 3.
Expert Solution

This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
Step by step
Solved in 2 steps with 2 images

Recommended textbooks for you

Calculus: Early Transcendentals
Calculus
ISBN:
9781285741550
Author:
James Stewart
Publisher:
Cengage Learning

Thomas' Calculus (14th Edition)
Calculus
ISBN:
9780134438986
Author:
Joel R. Hass, Christopher E. Heil, Maurice D. Weir
Publisher:
PEARSON

Calculus: Early Transcendentals (3rd Edition)
Calculus
ISBN:
9780134763644
Author:
William L. Briggs, Lyle Cochran, Bernard Gillett, Eric Schulz
Publisher:
PEARSON

Calculus: Early Transcendentals
Calculus
ISBN:
9781285741550
Author:
James Stewart
Publisher:
Cengage Learning

Thomas' Calculus (14th Edition)
Calculus
ISBN:
9780134438986
Author:
Joel R. Hass, Christopher E. Heil, Maurice D. Weir
Publisher:
PEARSON

Calculus: Early Transcendentals (3rd Edition)
Calculus
ISBN:
9780134763644
Author:
William L. Briggs, Lyle Cochran, Bernard Gillett, Eric Schulz
Publisher:
PEARSON

Calculus: Early Transcendentals
Calculus
ISBN:
9781319050740
Author:
Jon Rogawski, Colin Adams, Robert Franzosa
Publisher:
W. H. Freeman


Calculus: Early Transcendental Functions
Calculus
ISBN:
9781337552516
Author:
Ron Larson, Bruce H. Edwards
Publisher:
Cengage Learning