The effectiveness of knee rehabilitation systems in aiding patients with rehabilitation training has been well-documented. Presently, there is an increasing emphasis on the wearing comfort and user engagement of these systems. In this paper, a wearable knee rehabilitation system (WKRS) based on the graphene textile composite sensor (GTCS), which subjects perform rehabilitation training by controlling the ascent and descent of a bird in the visual feedback game utilized GTCS, is proposed and investigated. To obtain an accurate and smooth estimated knee joint angle, we propose an improved tree boosting regression algorithm based on extreme gradient boosting (XGBoost), called improved XGBoost (IXGB). Specifically, the estimated results are smoothed by two steps: curving the preliminary estimating results within the same interval and smoothing the preliminary estimating results using the weighted moving average method. An online experiment with ten subjects validates the effectiveness of the WKRS and IXGB. Results indicate that the IXGB significantly enhances the smoothness of estimated value while maintaining estimation accuracy compared to XGBoost, random forest regression (RFR) and support vector regression (SVR). IXGB achieves an average increase of 33.43 % in root mean square error, 23.83 % in R-squared, and a 62.63% decrease in smoothness.