11.13. Consider the stochastic control problem Þ(s,x) = T --[] <-mode] = sup E¹8, U where the (1-dimensional) system X, is given by dXt=dx = (1-ut)dt + dBt. The control ut=ut(w) can assume any value in U = [0, 1] and T= inf{t> 8; X ≤0} (the time of bankruptcy). Show that if p≥ 2 then the optimal control is u = 1 for all t and the corresponding value function is Þ(s,x) = e¯Pª ² (1 − e¯√²²) ; x ≥ 0.

MATLAB: An Introduction with Applications
6th Edition
ISBN:9781119256830
Author:Amos Gilat
Publisher:Amos Gilat
Chapter1: Starting With Matlab
Section: Chapter Questions
Problem 1P
icon
Related questions
Question

Stochastic control problem

11.13. Consider the stochastic control problem
T
(s,x) = sup ES, I
= sup 5^= [] -² ude]
U
where the (1-dimensional) system X, is given by
dXt = dx = (1 - ut)dt + dBt.
The control ut = ut(w) can assume any value in U = [0, 1] and
T = inf{t> s; X ≤0} (the time of bankruptcy).
Show that if p > 2 then the optimal control is
u = 1
for all t
and the corresponding value function is
Þ(s,x) = e
-P² ²/1 (1 - e-√²P = )
x ≥ 0.
Transcribed Image Text:11.13. Consider the stochastic control problem T (s,x) = sup ES, I = sup 5^= [] -² ude] U where the (1-dimensional) system X, is given by dXt = dx = (1 - ut)dt + dBt. The control ut = ut(w) can assume any value in U = [0, 1] and T = inf{t> s; X ≤0} (the time of bankruptcy). Show that if p > 2 then the optimal control is u = 1 for all t and the corresponding value function is Þ(s,x) = e -P² ²/1 (1 - e-√²P = ) x ≥ 0.
Expert Solution
steps

Step by step

Solved in 3 steps with 19 images

Blurred answer
Similar questions
  • SEE MORE QUESTIONS
Recommended textbooks for you
MATLAB: An Introduction with Applications
MATLAB: An Introduction with Applications
Statistics
ISBN:
9781119256830
Author:
Amos Gilat
Publisher:
John Wiley & Sons Inc
Probability and Statistics for Engineering and th…
Probability and Statistics for Engineering and th…
Statistics
ISBN:
9781305251809
Author:
Jay L. Devore
Publisher:
Cengage Learning
Statistics for The Behavioral Sciences (MindTap C…
Statistics for The Behavioral Sciences (MindTap C…
Statistics
ISBN:
9781305504912
Author:
Frederick J Gravetter, Larry B. Wallnau
Publisher:
Cengage Learning
Elementary Statistics: Picturing the World (7th E…
Elementary Statistics: Picturing the World (7th E…
Statistics
ISBN:
9780134683416
Author:
Ron Larson, Betsy Farber
Publisher:
PEARSON
The Basic Practice of Statistics
The Basic Practice of Statistics
Statistics
ISBN:
9781319042578
Author:
David S. Moore, William I. Notz, Michael A. Fligner
Publisher:
W. H. Freeman
Introduction to the Practice of Statistics
Introduction to the Practice of Statistics
Statistics
ISBN:
9781319013387
Author:
David S. Moore, George P. McCabe, Bruce A. Craig
Publisher:
W. H. Freeman