Regression: Let's say, we want to perform linear regression on a dataset containing m examples and n features. Our output is a linear funcion as follows: Ti = W₁x₁,1 + W2X₁,2 ++Wnxin + b Now, if the error is E, then the gradient descent weight update rules should be as follows: W₁ = wi - A for i € {1,2, ..., n} dwi b=b-ASE For the following loss functions E, find and SE Swi 1. Mean Squared Error: 2. Sum of Squared Error: 4. Mean Absolute Error: m E = ²₁(yi - Yi)² m i=1 E = = Σ²1 (Yi-Yi) ² 3. Mean Squared Logged Error: Sometimes, y; and can be too large. So, we use the following loss function. 'δω. 1m m E = (logyi - log Ji)² E = 1 Yi - Yi| 15m m

MATLAB: An Introduction with Applications
6th Edition
ISBN:9781119256830
Author:Amos Gilat
Publisher:Amos Gilat
Chapter1: Starting With Matlab
Section: Chapter Questions
Problem 1P
icon
Related questions
Question

Please give a step-by-step solution.

Answer question 4.

 

Regression: Let's say, we want to perform linear regression on a dataset containing m examples
and n features. Our output is a linear funcion as follows:
Ti = W₁xi,1 + W2x i,2+.......... + Wnxi¸n + b
Now, if the error is E, then the gradient descent weight update rules should be as follows:
2. Sum of Squared Error:
w₁ = w₁ - XE for i € {1,2,...,n}
b=b-X
dwi
SE
For the following loss functions E, find and S.
db
1. Mean Squared Error:
SE
dwi
4. Mean Absolute Error:
m
1
E = ²₁ (Yi - Yi)²
m
E = ²₁ (Yi - Y₁ )²
3. Mean Squared Logged Error: Sometimes, y; and y, can be too large. So, we use the following
loss function.
E = ₁ (log yi - log yi)²
m i=1
E = = 2²₁ |Yi - Yi|
m i=1
Transcribed Image Text:Regression: Let's say, we want to perform linear regression on a dataset containing m examples and n features. Our output is a linear funcion as follows: Ti = W₁xi,1 + W2x i,2+.......... + Wnxi¸n + b Now, if the error is E, then the gradient descent weight update rules should be as follows: 2. Sum of Squared Error: w₁ = w₁ - XE for i € {1,2,...,n} b=b-X dwi SE For the following loss functions E, find and S. db 1. Mean Squared Error: SE dwi 4. Mean Absolute Error: m 1 E = ²₁ (Yi - Yi)² m E = ²₁ (Yi - Y₁ )² 3. Mean Squared Logged Error: Sometimes, y; and y, can be too large. So, we use the following loss function. E = ₁ (log yi - log yi)² m i=1 E = = 2²₁ |Yi - Yi| m i=1
Expert Solution
steps

Step by step

Solved in 3 steps with 12 images

Blurred answer
Recommended textbooks for you
MATLAB: An Introduction with Applications
MATLAB: An Introduction with Applications
Statistics
ISBN:
9781119256830
Author:
Amos Gilat
Publisher:
John Wiley & Sons Inc
Probability and Statistics for Engineering and th…
Probability and Statistics for Engineering and th…
Statistics
ISBN:
9781305251809
Author:
Jay L. Devore
Publisher:
Cengage Learning
Statistics for The Behavioral Sciences (MindTap C…
Statistics for The Behavioral Sciences (MindTap C…
Statistics
ISBN:
9781305504912
Author:
Frederick J Gravetter, Larry B. Wallnau
Publisher:
Cengage Learning
Elementary Statistics: Picturing the World (7th E…
Elementary Statistics: Picturing the World (7th E…
Statistics
ISBN:
9780134683416
Author:
Ron Larson, Betsy Farber
Publisher:
PEARSON
The Basic Practice of Statistics
The Basic Practice of Statistics
Statistics
ISBN:
9781319042578
Author:
David S. Moore, William I. Notz, Michael A. Fligner
Publisher:
W. H. Freeman
Introduction to the Practice of Statistics
Introduction to the Practice of Statistics
Statistics
ISBN:
9781319013387
Author:
David S. Moore, George P. McCabe, Bruce A. Craig
Publisher:
W. H. Freeman