Infinite Hypothesis Spaces
m>= 1/ε(ln|H|+ln1/γ)
spaces are infinite
– linear separators
– artificial neural networks
– decision trees (continuous input)
X:{1,2,3,4,5,6,7,8,9,10}
H: h(x) = x>=Θ
|H|=∞
Trade all hypotheses (only track non-negative integer), keep version space
X = R
H = {h(x) = xe[a,b]}
parameterized by a,b e R
VC = 2