Approximating Boolean Functions with Depth-2 Circuits

Abstract

We study the complexity of approximating Boolean functions with disjunctive normal forms (DNFs) and other depth-2 circuits, exploring two main directions: universal bounds on the approximability of all Boolean functions, and the approximability of the parity function. In the first direction, our main positive results are the first nontrivial universal upper bounds on approximability by DNFs: (a) every Boolean function can be $\epsilon$-approximated by a DNF of size $O_\epsilon(2^n/\log n)$, and (b) every Boolean function can be $\epsilon$-approximated by a DNF of width $c_\epsilon\, n$, where $c_\epsilon < 1$. Our techniques extend broadly to give strong universal upper bounds on approximability by various depth-2 circuits that generalize DNFs, including the intersection of halfspaces, low-degree Polynomial threshold functions, and unate functions. We show that the parameters of our constructions almost match the information-theoretic inapproximability of a random function. In the second direction our mai...