We present a new exactly divergence-free and well-balanced hybrid finite volume/finite element scheme for the numerical solution of the incompressible viscous and resistive magnetohydrodynamics (MHD) equations on staggered unstructured mixed-element meshes in two and three space dimensions. The equations are split into several subsystems, each of which is then discretized with a particular scheme that allows to preserve some fundamental structural features of the underlying governing PDE system also at the discrete level. The pressure is defined on the vertices of the primary mesh, while the velocity field and the normal components of the magnetic field are defined on an edge-based/face-based dual mesh in two and three space dimensions, respectively. This allows to account for the divergence-free conditions of the velocity field and of the magnetic field in a rather natural manner. The non-linear convective and the viscous terms in the momentum equation are solved at the aid of an explicit finite volume scheme, while the magnetic field is evolved in an exactly divergence-free manner via an explicit finite volume method based on a discrete form of the Stokes law in the edges/faces of each primary element. The latter method is stabilized by the proper choice of the numerical resistivity in the computation of the electric field in the vertices/edges of the 2D/3D elements. To achieve higher order of accuracy, a piecewise linear polynomial is reconstructed for the magnetic field, which is guaranteed to be exactly divergence-free via a constrained L2 projection. Finally, the pressure subsystem is solved implicitly at the aid of a classical continuous finite element method in the vertices of the primary mesh and making use of the staggered arrangement of the velocity, which is typical for incompressible Navier-Stokes solvers. In order to maintain non-trivial stationary equilibrium solutions of the governing PDE system exactly, which are assumed to be known a priori, each step of the new algorithm takes the known equilibrium solution explicitly into account so that the method becomes exactly well-balanced. We show numerous test cases in two and three space dimensions in order to validate our new method carefully against known exact and numerical reference solutions. In particular, this paper includes a very thorough study of the lid-driven MHD cavity problem in the presence of different magnetic fields and the obtained numerical solutions are provided as free supplementary electronic material to allow other research groups to reproduce our results and to compare with our data. We finally present long-time simulations of Soloviev equilibrium solutions in several simplified 3D tokamak configurations, showing that the new well-balanced scheme introduced in this paper is able to maintain stationary equilibria exactly over very long integration times even on very coarse unstructured meshes that, in general, do not need to be aligned with the magnetic field.