The stability of a rigid particle in yield stress fluids, comprised of soft particle glasses (SPGs), is investigated in shear flow under an applied external force, such as weight, using particle dynamics simulations. Results provide the critical force threshold, in terms of the dynamic yield stress and the flow strength, required to initiate sedimentation of the rigid particle over a wide range of shear rates and volume fractions. The streamlines of the SPGs show local disturbances when the rigid particle settles. The form of these disturbances is consistent with the microdynamics and microstructure response of the neighboring soft particles of the sedimenting rigid particle. Sedimenting particle induces non-affine displacement to the suspensions at low shear rates and high applied forces, while these dynamical events are localized and suppressed at high shear rates. Stability diagrams, which provide the conditions of the sedimentation of the rigid particle, are presented in terms of the applied force and the shear rate. These individual stability diagrams at each volume fraction map onto a universal stability diagram when the external force is scaled by the dynamic yield stress and shear rate with a ratio of the solvent viscosity to the low-frequency modulus of the SPGs.