Access Restriction

Author Beimel, Amos ♦ Bergadano, Francesco ♦ Bshouty, Nader H. ♦ Kushilevitz, Eyal ♦ Varricchio, Stefano
Source ACM Digital Library
Content type Text
Publisher Association for Computing Machinery (ACM)
File Format PDF
Copyright Year ©2000
Language English
Subject Domain (in DDC) Computer science, information & general works ♦ Data processing & computer science
Subject Keyword DNF ♦ Computational learning ♦ Learning disjoint ♦ Learning polynomials ♦ Multiplicity automata
Abstract We study the learnability of multiplicity automata in Angluin's exact learning model, and we investigate its applications. Our starting point is a known theorem from automata theory relating the number of states in a minimal multiplicity automaton for a function to the rank of its Hankel matrix. With this theorem in hand, we present a new simple algorithm for learning multiplicity automata with improved time and query complexity, and we prove the learnability of various concept classes. These include (among others): -The class of disjoint DNF, and more generally $satisfy-\textit{O}(1)$ DNF.-The class of polynomials over finite fields.-The class of bounded-degree polynomials over infinite fields.-The class of XOR of terms.-Certain classes of boxes in high dimensions.In addition, we obtain the best query complexity for several classes known to be learnable by other methods such as decision trees and polynomials over GF(2).While multiplicity automata are shown to be useful to prove the learnability of some subclasses of DNF formulae and various other classes, we study the limitations of this method. We prove that this method cannot be used to resolve the learnability of some other open problems such as the learnability of general DNF formulas or even $\textit{k}-term$ DNF for $\textit{k}$ = ω(log $\textit{n})$ or $satisfy-\textit{s}$ DNF formulas for $\textit{s}$ = ω(1). These results are proven by exhibiting functions in the above classes that require multiplicity automata with super-polynomial number of states.
ISSN 00045411
Age Range 18 to 22 years ♦ above 22 year
Educational Use Research
Education Level UG and PG
Learning Resource Type Article
Publisher Date 2000-05-01
Publisher Place New York
e-ISSN 1557735X
Journal Journal of the ACM (JACM)
Volume Number 47
Issue Number 3
Page Count 25
Starting Page 506
Ending Page 530

Open content in new tab

   Open content in new tab
Source: ACM Digital Library