Designing highly accurate and robust controls for quantum unitary operations is vital for practical quantum computation. In this paper, we demonstrate that the robustness of quantum gate controls can be enhanced by optimizing the sampling-based infidelity variance, which is formulated as a multi-objective optimization task to achieve high robustness while maintaining high gate fidelity. A two-step approach that first optimizes the average fidelity and then turns to the infidelity variance is proposed, where two modified differential evolution (DE) algorithms, i.e., mixed-guided-strategy DE (MGSDE) and multi-objective mixed-strategy DE (MOMSDE), are designed to search fields for the two steps of robust quantum gate control, respectively. Both MGSDE and MOMSDE adopt the mixed strategy, and in particular, MGSDE adopts a guided mutation scheme to accelerate the convergence, and MOMSDE uses an optimal buffer to explore the Pareto front. Numerical results demonstrate that the proposed approach enhances the control robustness and provides an efficient in-situ learning paradigm to tackle the disturbance problem for the control design of quantum gates.