In this study, the collision induced dissociation tandem mass spectrometry (CID-MS/MS) fragmentation pathway of chemical components in rhubarb was wholly explored using 34 standards by UHPLC-QTOF-MS/MS in negative ion mode. In consequently, the diagnostic product ions for speedy screening and categorization of chemical components in rhubarb were ascertained based on their MS/MS splitting decomposition patterns and intensity analysis. According to these findings, a fresh two-step data mining strategy had set up. The initial key step involves the use of characteristic product ions and neutral loss to screen for different types of substituents and basic skeletons of compounds. The subsequent key step is to screen and classify different types of compounds based on their characteristic product ions. This method can be utilized for rapid research, classification, and identification of compounds in rhubarb. A total of 356 compounds were rapidly identified or tentatively characterized in three rhubarb species extracts, including 150 acylglucoside, 125 anthraquinone, 65 flavanols and 15 other compounds. This study manifests that the analytical strategy is feasible for the analysis of complex natural products in rhubarb.