The implementation of a high-fidelity two-qubit quantum logic gate remains an outstanding challenge for isolated solid-state qubits such as nitrogen-vacancy (NV) centers in diamond. In this work, we show that by driving pairs of NV centers to undergo photon scattering processes that flip their qubit states simultaneously, we can achieve a unitary two-qubit gate conditioned upon a single photon-detection event. Further, by exploiting quantum interference between the optical transitions of the NV centers' electronic states, we realize the existence of two special drive frequencies: a ``magic'' point where the spin-preserving elastic scattering rates are suppressed and a ``balanced'' point where the state-flipping scattering rates are equal. We analyzed four different gate operation schemes that utilize these two special drive frequencies, and various combinations of polarizations in the drive and collection paths. Our theoretical and numerical calculations show that the gate fidelity can be as high as 98%. The proposed unitary gate, combined with available single-qubit unitary operations, forms a universal gate set for quantum computing.