The increasing use of nonlinear loads entails serious electrical energy quality problems in power grids. Active power filter could lead to significant improvement in harmonic compensation performance. In this paper, an adaptive second-order sliding mode fuzzy control based on linear feedback strategy for a three-phase active power filter is proposed to eliminate harmonics. This scheme is constituted by adaptive controller, second-order sliding mode controller, fuzzy controller, and linear feedback controller. The linear feedback controller can compensate the system’s nonlinearities and make the new system have a linear behavior between the input and output. Moreover, the second-order sliding mode controller could transfer the discontinuities in the controller and reduce system chattering. Simulation results illustrate the proposed controller has better performance compared with fuzzy control and adaptive sliding mode fuzzy control.