Hinged slab bridges are widely used in the medium and small-span bridges on highways and the joints are highly susceptible to damage under the action of the increasing traffic. However, current methods for damage identification of hinged joints, whether rely on static or dynamic testing, typically require substantial manpower, resources and time, which presents challenges for the rapid evaluation of numerous bridges. In view of this, a novel damage index named spectrum correlation matrix (SCM) is proposed and its feature extraction technology is established as well as the potential for sparse measurement is theoretically explained. Furthermore, a rapid, robust, and convenient damage identification methodology using SCM and Levenberg-Marquardt algorithm is proposed. An optimal strategy for the layout of sparse measuring points has been explored, the sensitivity and the effectiveness of the proposed method is validated through both numerical simulations and the in-situ test of a bridge in service. The results indicate that the SCM contains abundant vibration information and shows a high sensitivity to damage. The strategy for the layout of measuring points is highly efficient and the proposed methodology greatly reduces the number of measuring points compared to previous vibration-based methods, which eases rapid identification of damage for joints in hinged slab bridges.