AgGaS2 (AGS) is the most commonly used commercial infrared nonlinear optical (IR NLO) material. However, AGS has a narrow band gap (Eg=2.58 eV) and a low laser-induced damage threshold (LIDT), primarily attributed to its mobile liquid-like Ag+ constituent and the unstable Ag-S chemical bond. Herein, we propose a "band reformation of AGS" strategy, which leads to the successful syntheses of four lanthanide sulfides, LiLnGeS4 (Ln=La-Nd), crystalizing in an asymmetric Ama2 structure. LiLaGeS4 demonstrates that eliminating the presence of Ag-4d band increases the Eg to 3.32 eV and enhances the LIDT (14-29×AGS, measured by both powder and single crystal); while increasing the nonbonding density of states of the S-3p band enhances the 2nd-nonlinear optical coefficient (1.06×AGS). Besides, the bond length discrepancy between [LiS4], [GeS4] and [LaS8] units leads to a moderate birefringence (Δn=0.052). Such a unique structure further results in extremely small thermal expansion with αL=0.41-1.74×10-5 K-1, along different crystallographic axes. Our theoretical studies indicate that the synergy of the structure building units contribute to the second harmonic generation performance. These results suggest that the "band reformation of AGS" strategy provides effective guidance to discover new NLO crystals with optimized performance.