Visible light communication (VLC) exhibits rapid development tendency in recent years since it has many attractive features such as its low cost, electromagnetic interference-free and license-free spectrum. In this work, we consider the indoor VLC system with single mobile user. Due to mobility, the distance between the activated light-emitting diode (LED) and receive photodiode (PD) is varied. Under the assumption of random direction (RD) mobility model, we derive the probability density function (PDF) and the cumulative distribution function (CDF) of received electrical signal-to-noise ratio (SNR) for the mobile user. The adaptive spatial modulation (ASM) scheme with two adaptive mechanisms is developed where the modulation size can be dynamically changed based on the derived CDF and pre-specified switching threshold. Simulation results demonstrate that the proposed scheme can balance the trade-off in terms of spectral efficiency and link robustness.