Cimicifugae Rhizoma, known in Chinese as Shengma, is a common medicinal material in traditional Chinese medicine (TCM), mainly used for treating wind-heat headaches, sore throat, uterine prolapse, and other diseases. An approach using a combination of ultra-performance liquid chromatography (UPLC), mass spectrometry (MS), and multivariate chemometric methods was designed to assess the quality of Cimicifugae Rhizoma. All materials were crushed into powder and the powdered sample was dissolved in 70% aqueous methanol for sonicating. Chemometric methods, including hierarchical cluster analysis (HCA), principal component analysis (PCA), and orthogonal partial least squares discriminant analysis (OPLS-DA), were adopted to classify and perform a comprehensive visualization study of Cimicifugae Rhizoma. The unsupervised recognition models of HCA and PCA obtained a preliminary classification and provided a basis for classification. In addition, we constructed a supervised OPLS-DA model and established a prediction set to further validate the explanatory power of the model for the variables and unknown samples. Exploratory work research found that the samples were divided into two groups, and the differences were related to appearance traits. The correct classification of the prediction set also demonstrates a strong predictive ability of the models for new samples. Subsequently, six chemical makers were characterized by UPLC-Q-Orbitrap-MS/MS, and the content of four components was determined. The results of the content determination revealed the distribution of representative chemical markers caffeic acid, ferulic acid, isoferulic acid, and cimifugin in two classes of samples. This strategy can provide a reference for assessing the quality of Cimicifugae Rhizoma, which is significant for the clinical practice and quality control of Cimicifugae Rhizoma.