With the increasing focus on structural health monitoring of concrete during its service life, self-sensing functional concrete has emerged as an effective method for real-time detection and assessment of structural conditions. We recently proposed a new methodology of preparing conductive cementitious mortar with graphene-coated aggregates (Gr@Ag). Instead of the traditional approach, where conductive fillers are directly intermixed and uniformly distributed in the binding matrix, the development of Gr@Ag has created a more efficient path for electron transport through the connections of aggregates. The main objective of this study is to understand the effect of aggregate gradation on the electrical performances of conductive mortars, and the piezoresistivity is optimized by adjusting the aggregate packing. Electrochemical impedance spectroscopy was employed to investigate the underlying mechanisms of how aggregate gradation affects the mortar's electrical conductivity. It was found that both the internal resistance and resistivity of the conductive mortar considerably decreased with the reduction in Gr@Ag particle size. The contribution of conductive sand to the conductivity of mortar can reach 80.89–92.36 %, effectively transforming the conductive path from a disconnected state to a connected state. Reducing the particle size of the conductive aggregates contributes to an increase in particle contact rate, with the particle contact rate reaching up to 59 %. The presence of completely isolated conductive aggregates is noticeably reduced. As the particle size decreases, there is a significant reduction in mechanical performance. The conductive aggregates become relatively isolated from the matrix, and both the size of the conductive aggregates and the interfacial transition zone play vital roles to affect the mechanical properties.