Although we used gradient descent to find the minimizer of f in part (a), we can also use calculus to solve the problem directly. Show that the minimizer of f is âû = (A" A # 71)-'A"b,

Advanced Engineering Mathematics
10th Edition
ISBN:9780470458365
Author:Erwin Kreyszig
Publisher:Erwin Kreyszig
Chapter2: Second-order Linear Odes
Section: Chapter Questions
Problem 1RQ
icon
Related questions
Question
Consider the following optimisation problem:
min f(x),
xER"
where
1
f (x)
| Ax – b||3 + |||3,
and where A E R™×n, b € R" are defined as
1
2
1
-1
3
|
A
1
1
2
2
-1 -2
1
-2
Transcribed Image Text:Consider the following optimisation problem: min f(x), xER" where 1 f (x) | Ax – b||3 + |||3, and where A E R™×n, b € R" are defined as 1 2 1 -1 3 | A 1 1 2 2 -1 -2 1 -2
Although we used gradient descent to find the minimizer of ƒ in part (a), we can also use calculus
to solve the problem directly. Show that the minimizer of f is
â = (A" A + 71)-'A"b,
where I is the 4 × 4 identity matrix. What is the exact numerical value of âî for the problem in (a)
and how does it compare to your result from gradient descent?
What to submnit: your working out.
Transcribed Image Text:Although we used gradient descent to find the minimizer of ƒ in part (a), we can also use calculus to solve the problem directly. Show that the minimizer of f is â = (A" A + 71)-'A"b, where I is the 4 × 4 identity matrix. What is the exact numerical value of âî for the problem in (a) and how does it compare to your result from gradient descent? What to submnit: your working out.
Expert Solution
steps

Step by step

Solved in 5 steps

Blurred answer
Recommended textbooks for you
Advanced Engineering Mathematics
Advanced Engineering Mathematics
Advanced Math
ISBN:
9780470458365
Author:
Erwin Kreyszig
Publisher:
Wiley, John & Sons, Incorporated
Numerical Methods for Engineers
Numerical Methods for Engineers
Advanced Math
ISBN:
9780073397924
Author:
Steven C. Chapra Dr., Raymond P. Canale
Publisher:
McGraw-Hill Education
Introductory Mathematics for Engineering Applicat…
Introductory Mathematics for Engineering Applicat…
Advanced Math
ISBN:
9781118141809
Author:
Nathan Klingbeil
Publisher:
WILEY
Mathematics For Machine Technology
Mathematics For Machine Technology
Advanced Math
ISBN:
9781337798310
Author:
Peterson, John.
Publisher:
Cengage Learning,
Basic Technical Mathematics
Basic Technical Mathematics
Advanced Math
ISBN:
9780134437705
Author:
Washington
Publisher:
PEARSON
Topology
Topology
Advanced Math
ISBN:
9780134689517
Author:
Munkres, James R.
Publisher:
Pearson,