All-solid-state Li metal batteries are widely considered as the most promising technologies to realize the increasing safety and capacity requirements for the next generation of Li batteries. However, it is experimentally demonstrated that the penetration of stiff solid electrolytes by Li dendrites seems even more severe than that of liquid electrolytes and the abnormal failure behavior of soft Li metal penetrating hard SEs is quite elusive. In the present work, a multi-coupling phase field model of Li electrodeposition is further developed to incorporate the elasto-plastic mechanical behavior and the significant size effect of Li metal. Then, the established approach is utilized to specifically evaluate the different mechanisms of Li electrodeposition and stripping in liquid electrolytes and hard solid electrolytes with various governing factors including applied voltage, external stress, ionic conductivity, SEI inhomogeneity and interfacial porosity. Especially, we summarize the accurate quantification of the regularity of external stress mechanisms which determine whether the external stress can either promote or demote the nonuniformity of Li/ solid electrolytes interface. This research provides a theoretical perspective of mechanical mechanism to reveal the conflict of experimental optimization strategies and may be instructive for the Li/ solid electrolytes interface design of all-solid-state Li metal batteries.