Two new recently proposed classes of topological phases, namely fractons and higher order topological insulators (HOTIs), share at least superficial similarities. The wide variety of proposals for these phases calls for a universal field theory description that captures their key characteristic physical phenomena. In this work, we construct topological multipolar response theories that capture the essential features of some classes of fractons and higher order topological insulators. Remarkably, we find that despite their distinct symmetry structure, some classes of fractons and HOTIs can be connected through their essentially identical topological response theories. More precisely, we propose a topological quadrupole response theory that describes both a 2D symmetry enriched fracton phase and a related bosonic quadrupolar HOTI with strong interactions. Such a topological quadrupole term encapsulates the protected corner charge modes and, for the HOTI, predicts an anomalous edge with fractional dipole moment. In 3D we propose a dipolar Chern-Simons theory with a quantized coefficient as a description of the response of both second order HOTIs harboring chiral hinge currents, and of a related fracton phase. This theory correctly predicts chiral currents on the hinges and anomalous dipole currents on the surfaces. We generalize these results to higher dimensions to reveal a family of multipolar Chern-Simons terms and related $\theta$-term actions that can be reached via dimensional reduction or extension from the Chern-Simons theories.