For a probability density function p(x) >0 on the interval (-∞, ∞) the entropy functional S[p] is given by S[p] = - fo dx p(x) log p(x). Suppose that the function p(x) is subject to the constraints 8 T dx f(x) p(x) = c, ∞ p dx p(x) = 1 and where f(x) is a fixed function and c is a constant. Show that is a stationary path for S[p] is given by p(x) = exp(-1 - \ - μf(x)), where A and μ are Lagrange multipliers.

A First Course in Probability (10th Edition)
10th Edition
ISBN:9780134753119
Author:Sheldon Ross
Publisher:Sheldon Ross
Chapter1: Combinatorial Analysis
Section: Chapter Questions
Problem 1.1P: a. How many different 7-place license plates are possible if the first 2 places are for letters and...
icon
Related questions
Question
For a probability density function p(x) > 0 on the interval
(-∞, ∞) the entropy functional S[p] is given by
-I dx p(x) log p(x).
S[p]
=
Suppose that the function p(x) is subject to the constraints
Lo de
[* dx p(x) 1 and
=
-∞
dx f(x)p(x) = c,
where f(x) is a fixed function and c is a constant.
Show that is a stationary path for S[p] is given by
p(x) = exp(-1-\- µf(x)),
where λ and u are Lagrange multipliers.
Transcribed Image Text:For a probability density function p(x) > 0 on the interval (-∞, ∞) the entropy functional S[p] is given by -I dx p(x) log p(x). S[p] = Suppose that the function p(x) is subject to the constraints Lo de [* dx p(x) 1 and = -∞ dx f(x)p(x) = c, where f(x) is a fixed function and c is a constant. Show that is a stationary path for S[p] is given by p(x) = exp(-1-\- µf(x)), where λ and u are Lagrange multipliers.
Expert Solution
steps

Step by step

Solved in 3 steps with 17 images

Blurred answer
Recommended textbooks for you
A First Course in Probability (10th Edition)
A First Course in Probability (10th Edition)
Probability
ISBN:
9780134753119
Author:
Sheldon Ross
Publisher:
PEARSON
A First Course in Probability
A First Course in Probability
Probability
ISBN:
9780321794772
Author:
Sheldon Ross
Publisher:
PEARSON