The adaptive interference cancellation technique has been widely utilized in radar, GPS, data link, etc., systems to address challenges from external interference, such as co-site and hostile interference. Since the anti-jamming performance of the adaptive interference cancellation technique is sensitive to group delay mismatch between channels, the group delay mismatch becomes one of the main factors that limit the system’s anti-jamming capability. However, the traditional adaptive interference cancellation system’s mathematical model cannot quantitatively characterize the group delay mismatch effect on the wideband interference cancellation performance. In this paper, the mathematical model of the wideband adaptive spatial interference cancellation (ASIC) system is established, which considers the group delay mismatch, to quantitatively analyze the impact of group delay mismatch on the hostile interference cancellation. The mathematical model utilizes the weighted multi-tone signals to fit the wideband interference, and then, delay differences are attached to each tone signal to simulate the group delay mismatch. Then, the analytic expressions of weight and interference cancellation ratio are derived, which consider the interference bandwidth and group delay mismatch, to quantitatively analyze the group delay mismatch effect on the anti-jamming performance of the wideband ASIC system. Simulation results indicate that the theoretical analysis based on the mathematical model of wideband ASIC system are accurate, which can achieve the quantitative analysis of the group delay mismatch effect on the WIC performance.