With the large-scale centralized penetration of renewable energy represented by wind turbine and photovoltaic power generation, the equivalent inertia and synchronous torque of traditional power grids have decreased, which is worsening the frequency dynamics and threatening the stability and reliability of power grids. Virtual synchronous generators (VSGs) are a type of grid-friendly inverter in microgrids (MGs) that mimic rotational synchronous generators (SGs) to maintain system stability with the increasing penetration of power electronic converters. In this paper, the stability analysis method of one type of VSG, synchronverter, is investigated based on internal voltage dynamics. The torque components affecting the stability mechanism of synchronizing, inertia, and damping torque is introduced, which offers a physical insight into transient stability and dynamic performance. Insufficiency in either damping or synchronizing torque would increase the unstable possibility. The characterization method of stability mechanisms can be illustrated by the phasor diagram of synchronverter internal voltage. Some cases under different disturbances which change the pattern of synchronizing and damping torque and in turn influence the internal voltage dynamics of synchronverters, are also discussed. In addition, an auxiliary correction control loop is proposed and added in the synchronverter control loop to enhance the robustness of the synchronverter against disturbances. The tunable coefficient of the correction loop is analyzed based on the internal voltage method. Simulation results verify the validity of the internal voltage stability method in synchronverters.