In this paper, we consider the elliptic relative equilibria of four-body problem with two infinitesimal masses. The most interesting case occurs when the two small masses tend to the same Lagrangian point L4 (or L5). In [20], Xia showed that there exist four central configurations: two of them are non-convex, and the other two are convex. We prove that the elliptic relative equilibria raised from the non-convex central configurations are always linearly unstable, while for the elliptic relative equilibria raised from the convex central configurations, the conditions of linear stability with respect to the parameters are provided.