Accurate state-of-health (SOH) estimation is crucial for the lithium-ion battery industry, as it underpins the safety, durability, and reliability of lithium-ion batteries. Currently, most researchers use various methods of health indicator (HI) extraction for the SOH estimation of batteries. However, these methods may require certain expertise and prior knowledge to achieve accurate modeling, being affected by measurement noise and other factors. To solve the abovementioned problems, three Kullback–Leibler (KL) divergence features based on partial voltage sequences are proposed as new HIs that are independent of prior knowledge and strongly correlated with SOH. Moreover, a modified retentive network is proposed to enhance SOH estimation accuracy and better utilize HIs than traditional deep learning methods, which have high training costs and insufficient accuracy. To ensure consistent extraction of KL divergence features across various experimental conditions and time intervals, a B-spline algorithm is utilized for interpolation. The effectiveness of the proposed method is validated through analysis of Pearson correlation coefficients and experiments conducted in four dimensions. Additionally, the potential of using the proposed method to compress data on the cloud-side is explored.