In organic solar cells (OSCs), the nonradiative voltage loss (ΔVnr) has been identified as a critical factor for the relatively lower open-circuit voltage. Under open-circuit conditions, most of the charge recombination processes occur via the triplet exciton state, underscoring the importance of the energy structures concerning the local exciton (LE) and charge transfer (CT) spin states. In this Letter, we propose a five-state model to explore the spin state energy structures to reduce ΔVnr. Our calculations reveal that, to minimize ΔVnr, the spin singlet state for LE should possess a lower energy than the triplet state, ES1 < ET1. In contrast, the energies of the CT spin states have a negligible effect on ΔVnr. We identify the best energy structure as ES1 < ET1 ∼ ECT1/CT3. Moreover, our calculations demonstrate that strong couplings between these spin states, particularly involving spin flip, can effectively mitigate ΔVnr. These findings present novel insights for the advancement of OSCs.