We aimed to develop radiomics with attribute bagging, which leverages multimodal ultrasound (US) images to improve the classification accuracy of breast tumors. A retrospective study was conducted. B-mode US, shear wave elastographic, and contrast-enhanced US images of 178 patients with 181 tumors (67 malignant and 114 benign) were included. Radiomics with attribute bagging consisted of extraction of 1226 radiomic features and analysis of them with attribute bagging. Histologic examination results acted as the reference standard. Radiomics with several feature selection algorithms were used for comparison. Cross-validation and a holdout test were performed to evaluate their performances. The accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve of radiomics with attribute bagging with the multimodal US images were 84.12%, 92.86%, 78.80%, and 0.919, respectively, exceeding all the comparison methods. Radiomics with attribute bagging combined with multimodal US images has the potential to be used for accurate diagnosis of breast tumors in the clinic.