Meso-structure is one of the major sources of macro-performance in asphalt mixtures. The research on aggregate distribution state is of great significance for the further improvement of asphalt mixture macro-performance. However, the variations of research methods among prior works hamper the deduction of the holistic potential and promising directions of coarse aggregate distribution analysis from current research findings. This work comprehensively verified the quantifying ability of aggregate distribution state indices and their correlation with rutting performance under an advanced digital image processing technique and a wide range of asphalt mixture types, and aims to provide a reference of the holistic potential and promising directions of coarse aggregate distribution analysis for subsequent research. To this end, eleven typical asphalt mixtures’ aggregate distribution state and rutting performance were measured, quantified, and correlated. The results show that Kpe nears or more than 0.56 can be the sign of coarse aggregates effectively interlocked while it nears or less than 0.26 is the opposite; Uarea nears or less than 2 % can be the sign of reaching a coarse aggregate distribution equilibrium; Δorien approaches 6.21 can be the sign of reaching a coarse aggregate orientation equilibrium; mixtures with a nominal maximum aggregate size of 10 mm are disabled in gathering contact chains. Moreover, these coarse aggregate distribution state quantifying indices proposed in existing research can indeed describe the meso-structural features of asphalt mixtures to a certain extent. However, these indices fail to capture the underlying meso-structural features relating to rutting performance and lead to limited applicability. Furthermore, the poor performance of these coarse aggregate distribution state quantifying indices in the global fitting mainly comes from their incompatibility with changes in nominal maximum aggregate size.