Objectives: The aim of this study was to determine and compare the capability of several B-mode ultrasound (US) and shear wave elastography (SWE) metrics to differentiate subjects with chronic non-specific neck pain from asymptomatic subjects. Methods: A diagnostic accuracy study recruiting a sample of patients with chronic neck pain and asymptomatic controls was conducted. Data collection included sociodemographic information (i.e., gender, age, height, weight and body mass index), clinical information (pain intensity assessed using the Visual Analogue Scale and pain-related disability using the Neck Disability Index) and B-mode ultrasound and shear wave elastography features of the cervical multifidus muscle (cross-sectional area, perimeter, mean echo intensity, fat infiltration, shear wave speed and Young’s modulus). After analyzing between-group differences for left/right sides, cases and controls, and males and females, the area under the receiver operating characteristic (ROC) curve, the optimal cut-off point, the sensitivity, the specificity, the positive likelihood ratio (LR) and negative LR for each metric were calculated. A total of 316 individuals were recruited in this study (n = 174 cases with neck pain and n = 142 asymptomatic controls). Results: No significant differences (p > 0.05) were found between cases and controls for most variables, except for fatty infiltration, which was significantly higher in chronic neck pain cases (p < 0.001). Gender differences were significant across all US and SWE metrics (all, p < 0.001 except p = 0.015 for fatty infiltrates). A slight asymmetry was observed between the left and right sides for area (p = 0.038). No significant interactions between group, gender and side (all metrics, p > 0.008) were identified. Fatty infiltration was the most effective discriminator, with a ROC value of 0.723, indicating acceptable discrimination. The optimal cut-off point for fatty infiltration was 25.77, with a moderate balance between sensitivity (59.8%) and specificity (20.5%). However, its positive likelihood ratio (LR) of 0.75 suggests limited usefulness in confirming the condition. Conclusions: Fatty infiltration was significantly higher in individuals with chronic idiopathic neck pain compared to those without symptoms, while other muscle metrics were similar between both groups. However, since fat infiltration had moderate diagnostic accuracy and the other metrics showed poor discriminatory power, US cannot be used solely to discriminate patients with idiopathic neck pain.