Consider the same house rent prediction problem where you are supposed to predict price of a house based on just its area. Suppose you have n samples with their respective areas, x(¹), (2),...,x(n), their true house rents y(1), y(2),..., y(n). Let's say, you train a linear regres- sor that predicts f(x)) = 0 + 0₁x¹). The parameters 0 and 0₁ are scalars and are learned by minimizing mean-squared-error loss with L1-regularization through gradient descent with a learning rate a and the regularization strength constant A. Answer the following questions. 1. Express the loss function(L) in terms of x(i),y(i), n, 00, 01, X. ƏL 2. Compute 200 ƏL 3. Compute 01 4. Write update rules for 0, and 0₁ Hint: d|w| dw - 1 undefined -1 w>0 w=0 w <0

icon
Related questions
Question
Consider the same house rent prediction problem where you are supposed to predict price
of a house based on just its area. Suppose you have n samples with their respective areas,
x(¹), x(²),...,x(n), their true house rents y(¹), y(2),..., y(n). Let's say, you train a linear regres-
sor that predicts f(x)) = 0 + 0₁x). The parameters, and 0₁ are scalars and are learned
by minimizing mean-squared-error loss with L1-regularization through gradient descent with
a learning rate a and the regularization strength constant A. Answer the following questions.
1. Express the loss function(L) in terms of x(i),y(i), n, 00, 01, X.
2. Compute L
200
ƏL
3. Compute 20₁
4. Write update rules for 0o and 0₁
Hint:
d|w|
dw
undefined
-1
w>0
w=0
w <0
Transcribed Image Text:Consider the same house rent prediction problem where you are supposed to predict price of a house based on just its area. Suppose you have n samples with their respective areas, x(¹), x(²),...,x(n), their true house rents y(¹), y(2),..., y(n). Let's say, you train a linear regres- sor that predicts f(x)) = 0 + 0₁x). The parameters, and 0₁ are scalars and are learned by minimizing mean-squared-error loss with L1-regularization through gradient descent with a learning rate a and the regularization strength constant A. Answer the following questions. 1. Express the loss function(L) in terms of x(i),y(i), n, 00, 01, X. 2. Compute L 200 ƏL 3. Compute 20₁ 4. Write update rules for 0o and 0₁ Hint: d|w| dw undefined -1 w>0 w=0 w <0
Expert Solution
steps

Step by step

Solved in 4 steps with 29 images

Blurred answer