We show that circularly polarized emission light from InGaAs/GaAs quantum dot (QD) ensembles under optical spin injection from an adjacent GaAs layer can switch its helicity depending on emission wavelengths and optical excitation density. We attribute this anomalous behavior to simultaneous contributions from both positive and negative trions and a lower number of photo-excited holes than electrons being injected into the QDs due to trapping of holes at ionized acceptors and a lower hole mobility. Our results call for caution in reading out electron spin polarization by optical polarization of the QD ensembles and also provide a guideline in improving efficiency of spin light emitting devices that utilize QDs.