In the wind tunnel model angle of attack test, the lever arm effect caused by the model vibration will greatly affect the attitude measurement accuracy. For the centrifugal acceleration term, there will be residual rectification errors using the low-pass filtering method; for the tangential acceleration, because of the same frequency as the attitude angle, the low-pass filtering method cannot filter it out. The mechanical compensation method will dramatically increase the compensation error of the tangential acceleration term due to the differential calculation. Aiming at the removal of the centrifugal acceleration term, this paper demonstrates that the error of the mechanical compensation method is far less than the low-pass filter method in the wind tunnel test environment. Aiming at the removal of the tangential acceleration term, this paper proposes a compensation method based on multi-accelerometers, which avoids the error amplification caused by differential calculation. Through theoretical derivation, analysis and simulation, the proposed method significantly improves the compensation accuracy of the lever arm effect.