Linear Regression Implement Linear Regression on the given Dataset. You need to implement gradient descent from scratch i.e. you cannot use any libraries for training the model (You may use numpy, but libraries like sklearn are not allowed).

Computer Networking: A Top-Down Approach (7th Edition)
7th Edition
ISBN:9780133594140
Author:James Kurose, Keith Ross
Publisher:James Kurose, Keith Ross
Chapter1: Computer Networks And The Internet
Section: Chapter Questions
Problem R1RQ: What is the difference between a host and an end system? List several different types of end...
icon
Related questions
Question
100%

please answer all the question please

 

Linear Regression
Implement Linear Regression on the given Dataset. You need to implement gradient
descent from scratch i.e. you cannot use any libraries for training the model (You may
use numpy, but libraries like sklearn are not allowed).
Dataset: Housing Price Prediction Dataset
(a)
Section B (Scratch Implementation)
(d)
You will need to perform K-Fold cross-validation (K=2-5) in this exercise
(implement from scratch). What is the optimal value of K? Justify it in your report
along with the table for the mean RMSE of K-values and K-value.
(b)
/
Plot the RMSE V/s iteration graph for all models trained with optimal
value of K for K-Fold cross-validation. RMSE should be reported on the train and
val set.
(c)
Iodify your Regression implementation by including L1 (LASSO) and L2
(Ridge Regression) regularization. Implement both regularization functions from
scratch and train the model again. Try different values of the regularization pa-
rameter and report the best one. Plot similar RMSE V/s iteration graph as before
(train and val loss).
7
Implement the normal equation (closed form) for linear regression and
get the optimal parameters directly for each fold (optimal K). Report the RMSE
on respective validation sets.
Transcribed Image Text:Linear Regression Implement Linear Regression on the given Dataset. You need to implement gradient descent from scratch i.e. you cannot use any libraries for training the model (You may use numpy, but libraries like sklearn are not allowed). Dataset: Housing Price Prediction Dataset (a) Section B (Scratch Implementation) (d) You will need to perform K-Fold cross-validation (K=2-5) in this exercise (implement from scratch). What is the optimal value of K? Justify it in your report along with the table for the mean RMSE of K-values and K-value. (b) / Plot the RMSE V/s iteration graph for all models trained with optimal value of K for K-Fold cross-validation. RMSE should be reported on the train and val set. (c) Iodify your Regression implementation by including L1 (LASSO) and L2 (Ridge Regression) regularization. Implement both regularization functions from scratch and train the model again. Try different values of the regularization pa- rameter and report the best one. Plot similar RMSE V/s iteration graph as before (train and val loss). 7 Implement the normal equation (closed form) for linear regression and get the optimal parameters directly for each fold (optimal K). Report the RMSE on respective validation sets.
Expert Solution
steps

Step by step

Solved in 2 steps

Blurred answer
Recommended textbooks for you
Computer Networking: A Top-Down Approach (7th Edi…
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Concepts of Database Management
Concepts of Database Management
Computer Engineering
ISBN:
9781337093422
Author:
Joy L. Starks, Philip J. Pratt, Mary Z. Last
Publisher:
Cengage Learning
Prelude to Programming
Prelude to Programming
Computer Engineering
ISBN:
9780133750423
Author:
VENIT, Stewart
Publisher:
Pearson Education
Sc Business Data Communications and Networking, T…
Sc Business Data Communications and Networking, T…
Computer Engineering
ISBN:
9781119368830
Author:
FITZGERALD
Publisher:
WILEY