Theorem 3.6 Lower bound, realizable case Let H be a hypothesis set with VC-dimension d> 1. Then, for any learning algorithm A, there erist a distribution D over X and a target function f e H such that d- 1 Rp(hs. f) > 32m > 1/100. Pr (3.33)

Computer Networking: A Top-Down Approach (7th Edition)
7th Edition
ISBN:9780133594140
Author:James Kurose, Keith Ross
Publisher:James Kurose, Keith Ross
Chapter1: Computer Networks And The Internet
Section: Chapter Questions
Problem R1RQ: What is the difference between a host and an end system? List several different types of end...
icon
Related questions
Question
Machine learning
Theorem 3.6 Lower bound, realizable case
Let H be a hypothesis set with VC-dimension d > 1. Then, for any learning
algorithm A, there exist a distribution D over X and a target function f e H
such that
d - 1
Pr
S-Dm
Rp(hs, f) >
2 1/100.
(3.33)
32m
Proof Let X = {r0, 21,...,T4-1} CX be a set that is fully shattered by H. For
any e > 0, we choose D such that its support is reduced to X and so that one
point (ro) has very high probability (1 - e), with the rest of the probability mass
distributed uniformly among the other points:
8e
Prfro] = 1-8e and Vie [1, d- 1], Pra =
(3.34)
%3D
Transcribed Image Text:Theorem 3.6 Lower bound, realizable case Let H be a hypothesis set with VC-dimension d > 1. Then, for any learning algorithm A, there exist a distribution D over X and a target function f e H such that d - 1 Pr S-Dm Rp(hs, f) > 2 1/100. (3.33) 32m Proof Let X = {r0, 21,...,T4-1} CX be a set that is fully shattered by H. For any e > 0, we choose D such that its support is reduced to X and so that one point (ro) has very high probability (1 - e), with the rest of the probability mass distributed uniformly among the other points: 8e Prfro] = 1-8e and Vie [1, d- 1], Pra = (3.34) %3D
Expert Solution
steps

Step by step

Solved in 2 steps with 1 images

Blurred answer
Recommended textbooks for you
Computer Networking: A Top-Down Approach (7th Edi…
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Concepts of Database Management
Concepts of Database Management
Computer Engineering
ISBN:
9781337093422
Author:
Joy L. Starks, Philip J. Pratt, Mary Z. Last
Publisher:
Cengage Learning
Prelude to Programming
Prelude to Programming
Computer Engineering
ISBN:
9780133750423
Author:
VENIT, Stewart
Publisher:
Pearson Education
Sc Business Data Communications and Networking, T…
Sc Business Data Communications and Networking, T…
Computer Engineering
ISBN:
9781119368830
Author:
FITZGERALD
Publisher:
WILEY