For the Best Engine with Differential Confidence or Second Best Engine approach shown, answer the following questions (on the training data): (C1-Cothers) range Best Engine Accuracy Second Best Engine Accuracy % Samples in this range ≥ 0.35 0.97 0.88 0.20 0.30-0.35 0.96 0.86 0.12 0.25-0.30 0.94 0.90 0.14 0.20-0.25 0.93 0.95 0.13 0.15-0.20 0.90 0.87 0.15 0.10-0.15 0.86 0.85 0.10 0.05-0.10 0.81 0.89 0.08 ≤ 0.05 0.75 0.93 0.08 1) What is the accuracy of the Best Engine? 2) What is the accuracy of the Second Best Engine? 3) Using a single threshold on one of the boundaries provided, what is the best accuracy of the pattern? 4) What is the percent improvement in absolute error rate? 5) Using multiple thresholds on the boundaries provided, what is the best accuracy of a multi-threshold
For the Best Engine with Differential Confidence or Second Best Engine approach shown, answer the following questions (on the training data):
|
(C1-Cothers) range |
Best Engine Accuracy |
Second Best Engine Accuracy |
% Samples in this range |
|
≥ 0.35 |
0.97 |
0.88 |
0.20 |
|
0.30-0.35 |
0.96 |
0.86 |
0.12 |
|
0.25-0.30 |
0.94 |
0.90 |
0.14 |
|
0.20-0.25 |
0.93 |
0.95 |
0.13 |
|
0.15-0.20 |
0.90 |
0.87 |
0.15 |
|
0.10-0.15 |
0.86 |
0.85 |
0.10 |
|
0.05-0.10 |
0.81 |
0.89 |
0.08 |
|
≤ 0.05 |
0.75 |
0.93 |
0.08 |
1) What is the accuracy of the Best Engine?
2) What is the accuracy of the Second Best Engine?
3) Using a single threshold on one of the boundaries provided, what is the best accuracy of the pattern?
4) What is the percent improvement in absolute error rate?
5) Using multiple thresholds on the boundaries provided, what is the best accuracy of a multi-threshold Best Engine with Differential Confidence or Second Best Engine?
6) What is the percent improvement in absolute error rate?
Trending now
This is a popular solution!
Step by step
Solved in 4 steps
