Suppose that we would like to select between two prediction models, M₁ and M₂. We have performed 10 rounds of 10-fold cross validation on each model, where the same data partitioning in round i is used for both M₁ and M₂. The error rates obtained for M₁ are 30.5, 32.2, 20.7, 20.6, 31.0, 41.0, 27.7, 26.0, 21.5, 26.0. The error rates for M₂ are 22.4, 14.5, 22.4, 19.6, 20.7, 20.4, 22.1, 19.4, 16.2, 35.0. Comment on whether one model is significantly better than the other considering a significance level of 1%

Suppose that we would like to select between two prediction models, M₁ and M₂. We have performed 10 rounds of 10-fold cross validation on each model, where the same data partitioning in round i is used for both M₁ and M₂. The error rates obtained for M₁ are 30.5, 32.2, 20.7, 20.6, 31.0, 41.0, 27.7, 26.0, 21.5, 26.0. The error rates for M₂ are 22.4, 14.5, 22.4, 19.6, 20.7, 20.4, 22.1, 19.4, 16.2, 35.0. Comment on whether one model is significantly better than the other considering a significance level of 1%

Database System Concepts

7th Edition

ISBN:9780078022159

Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Chapter1: Introduction

Section: Chapter Questions

Problem 1PE

See similar textbooks

Similar questions

Given the following accuracy rates for k-fold cross-validation with k = 4, which model will we choose to mal accuracy rate for that model? Observations in the Validation Set 301-400 201-300 101-200 1-100 Multiple Choice Model 1; 69.7% Model 2; 70.5% Model 1 69.5% 70.2% 71.8% 67.3% Model 2 72.2% 68.9% 71.5% 69.4% Nathanie
Assign the best “possible action” to exactly one training curve. Use a possible explanation at most once. Assume these are learning curves for a model trained to classify CIFAR images using PyTorch trained with a typical cross entropy loss. Choose the most fitting answer.
Assume we are trained two models using linear SVM with soft margins. One with C = 1 and another with C = 10. Which of the following statements are true? C=1 has larger margin than C=10 C=10 has larger margin than C=1 If data is linearly separable, C=1 training error is lower than or equal to C=10 If data is linearly separable, C=10 training error is lower than or equal to C=1 If data is linearly separable, C=10 and C=1 both training error of zero
The non-parametric density-based approach assumes that the density around a normal data observation within a cluster (relatively big) is similar to the density around its neighbours, and the density around an outlier (relatively small) is considerably different to the density around its neighbours. If we had the density of observation within a cluster smaller than the density around an outlier, explain why we would have such a situation. And provide a solution to this problem.
Suppose that we would like to select between two prediction models, M₁ and M₂. We have performed 10 rounds of 10-fold cross validation on each model, where the same data partitioning in round i is used for both M₁ and M₂. The error rates obtained for M₁ are 30.5, 32.2, 20.7, 20.6, 31.0, 41.0, 27.7, 26.0, 21.5, 26.0. The error rates for M₂ are 22.4, 14.5, 22.4, 19.6, 20.7, 20.4, 22.1, 19.4, 16.2, 35.0. Comment on whether one model is significantly better than the other considering a significance level of 1%.
A threshold of total variability explained has been set at 85%. How many principal components must you select?