This paper studies the estimation and inference of a partially linear varying coefficient spatial autoregressive panel data model with fixed effects. By means of the basis function approximations and the instrumental variable methods, we propose a two-stage least squares estimation procedure to estimate the unknown parametric and nonparametric components, and meanwhile study the asymptotic properties of the proposed estimators. Together with an empirical log-likelihood ratio function for the regression parameters, which follows an asymptotic chi-square distribution under some regularity conditions, we can further construct accurate confidence regions for the unknown parameters. Simulation studies show that the finite sample performance of the proposed methods are satisfactory in a wide range of settings. Lastly, when applied to the public capital data, our proposed model can also better reflect the changing characteristics of the US economy compared to the parametric panel data models.