We use frequency-resolved x-ray microscopy to fully characterize the potential well of a magnetic vortex in a soft ferromagnetic permalloy square. The vortex core is excited with magnetic broadband pulses and simultaneously displaced with a static magnetic field. We observe a frequency increase (blueshift) in the gyrotropic mode of the vortex core with increasing bias field. Supported by micromagnetic simulations, we show that this frequency increase is accompanied by internal deformation of the vortex core. The ability to modify the inner structure of the vortex core provides a mechanism to control the dynamics of magnetic vortices.