Conjugated polymer donors are crucial for enhancing the power conversion efficiencies (PCEs) in all-polymer solar cells (All-PSCs) in nonhalogenated solvents. In this work, three wide-band-gap polymer donors (Sil-D1, Ph-Sil-D1, and Nap-Sil-D1) based on dithienobenzothiadiazole (DTBT) and benzodithiophene (BDT) donor moieties optimized by side chain engineering were designed and synthesized. Alkyl (Sil-D1), phenyloxy (Ph-Sil-D1), and naphthyloxy (Nap-Sil-D1) alkyl siloxane side chain units were incorporated into these polymer donors, respectively. Notably, the Nap-Sil-D1 polymer donor had a greater conjugation length, π-electron delocalization, and improved dipole moment. The deepest highest occupied molecular orbital level of Nap-Sil-D1, with a high absorption coefficient, showed better aggregation properties. In addition, reduced bimolecular recombination and trap-state density generated a high charge transfer to cause a significant enhancement of open-circuit voltage, current density, and fill factor values of 0.94 V, 25.5 mA/cm2, and 70.4%, respectively, for the Nap-Sil-D1-blended All-PSC ternary device (PM6:Nap-Sil-D1:PY-IT), with the highest PCE of 16.8% in the o-xylene solvent, compared to other polymers (Sil-D1 and Ph-Sil-D1) with PCEs of 15.5 and 16.2%. As a result, this optimized device architecture was found to be the most promising as a nonhalogenated solvent processed in additive-free ternary All-PSCs with good stability.