The mislocalization of proteins leads to breast cancer, one of the world’s most prevalent cancers, which can be identified from immunohistochemical images. Here, based on the deep learning framework, location prediction models were constructed using the features of breast immunohistochemical images. Ultimately, six differentially localized proteins that with stable differentially predictive localization, maximum localization differences, and whose predicted results are not affected by removing a single image are obtained (CCNT1, NSUN5, PRPF4, RECQL4, UTP6, ZNF500). Further verification reveals that these proteins are not differentially expressed, but are closely associated with breast cancer and have great classification performance. Potential mechanism analysis shows that their co-expressed or co-located proteins and RNAs may affect their localization, leading to changes in interactions and functions that further causes breast cancer. They have the potential to help shed light on the molecular mechanisms of breast cancer and provide assistance for its early diagnosis and treatment.