2. Consider a binary-class classification problem, where there are equal numbers of positive and negative examples in the data set. Also suppose that the class label (i.e. +/- is totally randomly assigned to these examples. Now for the following two classification models. estimate their test accuracies based on different estimation methods. (i) A perfect decision tree model trained from the training data without pruning. (a) Repeated random subsampling method, in which 2/3 of data for training, the rest for testing. Test Accuracy = ? (b) Stratified 10-fold CV. Test Accuracy = ? (c) LOOCV. Test Accuracy = ? (ii) A majority predictor model trained from the training data that always predicts the majority class in training data. (a) Repeated random subsampling method, in which 2/3 of data for training, the rest for testing. Test Accuracy = ? (b) Stratified 10-fold CV. Test Accuracy = ? (c) LOOCV. Test Accuracy = ?

Computer Networking: A Top-Down Approach (7th Edition)
7th Edition
ISBN:9780133594140
Author:James Kurose, Keith Ross
Publisher:James Kurose, Keith Ross
Chapter1: Computer Networks And The Internet
Section: Chapter Questions
Problem R1RQ: What is the difference between a host and an end system? List several different types of end...
icon
Related questions
Question
100%

[7_A_2]

Please answer the following question step by step.

2. Consider a binary-class classification problem, where there are equal
numbers of positive and negative examples in the data set. Also suppose that the class label (i.e. +/-)
is totally randomly assigned to these examples. Now for the following two classification models,
estimate their test accuracies based on different estimation methods.
(i) A perfect decision tree model trained from the training data without pruning.
(a) Repeated random subsampling method, in which 2/3 of data for training, the rest for testing.
Test Accuracy = ?
(b) Stratified 10-fold CV.
Test Accuracy =?
(c) LOOCV.
Test Accuracy = ?
(ii) A majority predictor model trained from the training data that always predicts the majority class in
training data.
(a) Repeated random subsampling method, in which 2/3 of data for training, the rest for testing.
Test Accuracy = ?
(b) Stratified 10-fold CV.
Test Accuracy = ?
(c) LOOCV.
Test Accuracy = ?
Transcribed Image Text:2. Consider a binary-class classification problem, where there are equal numbers of positive and negative examples in the data set. Also suppose that the class label (i.e. +/-) is totally randomly assigned to these examples. Now for the following two classification models, estimate their test accuracies based on different estimation methods. (i) A perfect decision tree model trained from the training data without pruning. (a) Repeated random subsampling method, in which 2/3 of data for training, the rest for testing. Test Accuracy = ? (b) Stratified 10-fold CV. Test Accuracy =? (c) LOOCV. Test Accuracy = ? (ii) A majority predictor model trained from the training data that always predicts the majority class in training data. (a) Repeated random subsampling method, in which 2/3 of data for training, the rest for testing. Test Accuracy = ? (b) Stratified 10-fold CV. Test Accuracy = ? (c) LOOCV. Test Accuracy = ?
Expert Solution
steps

Step by step

Solved in 3 steps with 1 images

Blurred answer
Recommended textbooks for you
Computer Networking: A Top-Down Approach (7th Edi…
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Concepts of Database Management
Concepts of Database Management
Computer Engineering
ISBN:
9781337093422
Author:
Joy L. Starks, Philip J. Pratt, Mary Z. Last
Publisher:
Cengage Learning
Prelude to Programming
Prelude to Programming
Computer Engineering
ISBN:
9780133750423
Author:
VENIT, Stewart
Publisher:
Pearson Education
Sc Business Data Communications and Networking, T…
Sc Business Data Communications and Networking, T…
Computer Engineering
ISBN:
9781119368830
Author:
FITZGERALD
Publisher:
WILEY