We study the surface quasi-geostrophic equation with an irregular spatial perturbation∂tθ+u⋅∇θ=−ν(−Δ)γ/2θ+ζ,u=∇⊥(−Δ)−1θ, on [0,∞)×T2, with ν⩾0, γ∈[0,3/2) and ζ∈B∞,∞−2+κ(T2) for some κ>0. This covers the case of ζ=(−Δ)α/2ξ for α<1 and ξ a spatial white noise on T2. Depending on the relation between γ and α, our setting is subcritical, critical or supercritical in the language of Hairer's regularity structures [38]. Based on purely analytical tools from convex integration and without the need of any probabilistic arguments including renormalization, we prove existence of infinitely many analytically weak solutions in Llocp(0,∞;B∞,1−1/2)∩Cb([0,∞);B∞,1−1/2−δ)∩Cb1([0,∞);B∞,1−3/2−δ) for all p∈[1,∞) and δ>0. We are able to prescribe an initial as well as a terminal condition at a finite time T>0, and to construct steady state, i.e. time independent, solutions. In all cases, the solutions are non-Gaussian, but we may as well prescribe Gaussianity at some given times. Moreover, a coming down from infinity with respect to the perturbation and the initial condition holds. Finally, we show that our solutions generate statistically stationary solutions as limits of ergodic averages, and we obtain existence of infinitely many non-Gaussian time dependent ergodic stationary solutions. We also extend our results to a more general class of singular SPDEs.