We consider the relationship between correlations and entanglement in gapped quantum systems, with application to matrix product state representations. We prove that there exist gapped one-dimensional local Hamiltonians such that the entropy is exponentially large in the correlation length, and we present strong evidence supporting a conjecture that there exist such systems with arbitrarily large entropy. However, we then show, under an assumption on the density of states which is believed to be satisfied by many physical systems such as the fractional quantum Hall effect, that an efficient matrix product state representation of the ground state exists in any dimension. Finally, we comment on the implications for numerical simulation.