Photoresponsive liquid crystal (LC) physical gels have attracted more and more attention because of the nature of strong response via light stimulus. Although many efforts on the breaking and recovering of physical gels through photoisomerization have been focused, fast electro-optical response and high mechanical properties even upon light irradiations are difficult to achieve at the same time. In this work, two kinds of azobenzene-containing gelators (AG1 and AG2) with different terminal groups were designed and synthesized. Both gelators could induce the nematic LC P0616A self-assemble into anisotropic phase-separated LC physical gels at low contents. Their phase-transition behavior, thermal stability, microstructure, and mechanical strength were systematically studied. Compared with AG2 in P0616A, the P0616A/AG1 gels showed better mechanical property. When the gelator content was above 3 wt %, the P0616A/AG1 gels possessed good self-supporting ability with a storage modulus more than 104 Pa. Thus, the photoresponsive electro-optical properties and structures of P0616A/AG1 gels were focused in detail. It was surprising that the electro-optical response speed of the P0616A/AG1 gels could be promoted upon UV irradiation. In particular, the decay time (τoff) was only about half when compared with the initial state, whereas the gels still exhibited good self-supporting ability; also the network of the LC physical gels had no change at macro- and microstructural levels. These exciting results would open a door for the application of this material in electro-optical devices.