We aimed to investigate the correlation between shear-wave elastography (SWE) and apparent diffusion coefficient (ADC) values in breast cancer and to identify the associated characteristics. We included 91 breast cancer patients who underwent SWE and breast MRI prior to surgery between January 2016 and November 2017. We measured the lesion’s mean (Emean) and maximum (Emax) elasticities of SWE and ADC values. We evaluated the correlation between SWE, ADC values and tumor size. The mean SWE and ADC values were compared for categorical variable of the pathological/imaging characteristics. ADC values showed negative correlation with Emean (r = − 0.315, p = 0.002) and Emax (r = − 0.326, p = 0.002). SWE was positively correlated with tumor size (r = 0.343–0.366, p < 0.001). A higher SWE value indicated a tendency towards a higher T stage (p < 0.001). Triple-negative breast cancer showed the highest SWE values (p = 0.02). SWE were significantly higher in breast cancers with posterior enhancement, vascularity, and washout kinetics (p < 0.02). SWE stiffness and ADC values were negatively correlated in breast cancer. SWE values correlated significantly with tumor size, and were higher in triple-negative subtype and aggressive imaging characteristics.