(i) Show that where à = WA, b {wi}/²1. m Σw? ((xWLS + xWLSai) – bi)² = ||ÃxWLS — Ã||², i=1 = Wb and W Rmxm is the diagonal matrix with diagonal entries

Algebra and Trigonometry (6th Edition)
6th Edition
ISBN:9780134463216
Author:Robert F. Blitzer
Publisher:Robert F. Blitzer
ChapterP: Prerequisites: Fundamental Concepts Of Algebra
Section: Chapter Questions
Problem 1MCCP: In Exercises 1-25, simplify the given expression or perform the indicated operation (and simplify,...
icon
Related questions
Question
(ii) Show that XWLS solves
ATW2AXWLS
ATW²b.
(iii) Suppose rank(A) = 2. Since W is invertible, we then also have rank(WA) = 2 Verify that
XWLS – XLS = (ATW²A)-¹A¹(W² — I)(b – Ax¹S).
=
You do not need to derive the expression on the right hand side from scratch, it is sufficient
to show that it simplifies to the quantity on the left hand side.
(iv) Based on the expression in part (iii), briefly discuss your expectations on ||XWLS - XLS || in
the following situations:
(a) All of the weights {w} are chosen equal to or close to 1.
(b) There is a straight line that exactly passes through all of the points {ai, bi}1.
Transcribed Image Text:(ii) Show that XWLS solves ATW2AXWLS ATW²b. (iii) Suppose rank(A) = 2. Since W is invertible, we then also have rank(WA) = 2 Verify that XWLS – XLS = (ATW²A)-¹A¹(W² — I)(b – Ax¹S). = You do not need to derive the expression on the right hand side from scratch, it is sufficient to show that it simplifies to the quantity on the left hand side. (iv) Based on the expression in part (iii), briefly discuss your expectations on ||XWLS - XLS || in the following situations: (a) All of the weights {w} are chosen equal to or close to 1. (b) There is a straight line that exactly passes through all of the points {ai, bi}1.
Exercise 1. Suppose we are given a set of points {ai, bi}. Then, as in the lecture notes, we
can find the straight line b = x₁ + x2a that best fits these observations by choosing xLS € R² to
minimise
m
Σ ((xLS + x²Sai) − b;)² = ||AxLS — b||²,
-
i=1
where b Rm is the vector containing {b}₁, and the matrix A € Rmx2 is the Vandermonde
matrix with entries aij = a-¹.
In practice, some of the data points {ai, bi} might be more reliable or more important than
others. In this case, we can choose a set of positive weights {w}₁CR and instead choose
XWLSER2 to minimise
m
Σw ((xWLS + xy
i=1
xWLSai) – bi) ².
A large weight we will force the minimiser xWLS to make ((xWLS + xWLSai) – bi)² small, whereas
a small weight will allow ((xWLS + xWLSai) – bi) ² to be quite large.
(i) Show that
m
Σw ((xWLS + xWLS ai) – bi)² = ||ÃxWLS – B||²,
i=1
where à = WA, b = Wb and We Rmxm is the diagonal matrix with diagonal entries
{wi}=1.
1
Transcribed Image Text:Exercise 1. Suppose we are given a set of points {ai, bi}. Then, as in the lecture notes, we can find the straight line b = x₁ + x2a that best fits these observations by choosing xLS € R² to minimise m Σ ((xLS + x²Sai) − b;)² = ||AxLS — b||², - i=1 where b Rm is the vector containing {b}₁, and the matrix A € Rmx2 is the Vandermonde matrix with entries aij = a-¹. In practice, some of the data points {ai, bi} might be more reliable or more important than others. In this case, we can choose a set of positive weights {w}₁CR and instead choose XWLSER2 to minimise m Σw ((xWLS + xy i=1 xWLSai) – bi) ². A large weight we will force the minimiser xWLS to make ((xWLS + xWLSai) – bi)² small, whereas a small weight will allow ((xWLS + xWLSai) – bi) ² to be quite large. (i) Show that m Σw ((xWLS + xWLS ai) – bi)² = ||ÃxWLS – B||², i=1 where à = WA, b = Wb and We Rmxm is the diagonal matrix with diagonal entries {wi}=1. 1
Expert Solution
steps

Step by step

Solved in 2 steps with 2 images

Blurred answer
Recommended textbooks for you
Algebra and Trigonometry (6th Edition)
Algebra and Trigonometry (6th Edition)
Algebra
ISBN:
9780134463216
Author:
Robert F. Blitzer
Publisher:
PEARSON
Contemporary Abstract Algebra
Contemporary Abstract Algebra
Algebra
ISBN:
9781305657960
Author:
Joseph Gallian
Publisher:
Cengage Learning
Linear Algebra: A Modern Introduction
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Algebra And Trigonometry (11th Edition)
Algebra And Trigonometry (11th Edition)
Algebra
ISBN:
9780135163078
Author:
Michael Sullivan
Publisher:
PEARSON
Introduction to Linear Algebra, Fifth Edition
Introduction to Linear Algebra, Fifth Edition
Algebra
ISBN:
9780980232776
Author:
Gilbert Strang
Publisher:
Wellesley-Cambridge Press
College Algebra (Collegiate Math)
College Algebra (Collegiate Math)
Algebra
ISBN:
9780077836344
Author:
Julie Miller, Donna Gerken
Publisher:
McGraw-Hill Education