Bisphenol A (BPA) is an endocrine-disrupting compound, and the binding mechanism of BPA with carrier proteins has drawn widespread attention. Halogen substitutions can significantly impact the properties of BPA, resulting in various effects for human health. Here, we selected tetrabromobisphenol A (TBBPA) and tetrachlorobisphenol A (TCBPA) to investigate the interaction between different halogen-substituted BPAs and human serum albumin (HSA). TBBPA/TCBPA spontaneously occupied site I and formed stable binary complexes with HSA. Compared to TCBPA, TBBPA has higher binding affinity to HSA. The effect of different halogen substituents on the negatively charged surface area of BPA was an important reason for the higher binding affinity of TBBPA to HSA compared to TCBPA. Hydrogen bonds and van der Waals forces were crucial in the TCBPA-HSA complex, while the main driving factor for the formation of the TBBPA-HSA complex was hydrophobic interactions. Moreover, the presence of TBBPA/TCBPA changed the secondary structure of HSA. Amino acid residues such as Lys199, Lys195, Phe211, Arg218, His242, Leu481, and Trp214 were found to play crucial roles in the binding process between BPA compounds and HSA. Furthermore, the presence of halogen substituents facilitated the binding of BPA compounds with HSA.