Visible light communication (VLC) has emerged as a promising technology for wireless communication as it offers higher data rates and secure data transmission along with providing indoor illumination. However, VLC is restricted by the line of sight (LoS) nature of the optical channel that consequently results in light path blockages. Therefore, an effective solution would be to combine VLC with a radio frequency (RF) system to form a hybrid VLC/RF network that would take into account the preferences of an end-user with the practicality of implementation. In such networks, an efficient vertical handover (VHO) technique is the most critical element as it ensures a seamless transition between the two networks. In this work, we propose a vertical handover technique that utilizes the user’s location information to make a handover decision. We found that the frequency of light path blockages increases with the increasing number of users in a confined space, resulting in significant performance deterioration. This additional information is then utilized so that the VHO algorithm effectively selects the most feasible network. The proposed algorithm has been tested against the immediate vertical handover algorithm (I-VHO) and the dwell vertical handover algorithm (D-VHO) with two different dwell times. The average number of handovers, quality of experience (QoE), and packet loss have been set as performance metrics. We show from several simulation scenarios that the proposed method results in a fewer number of handovers while maintaining higher QoE and lower packet loss.