Visible light communication (VLC) has emerged as a promising technology that facilitates high speed green communication for the next generation communication systems. However, some of the performance-limiting impairments in VLC include intersymbol interference (ISI), LED's nonlinearity, and multiplicative fading distortion due to user mobility, which present a significant gap between the promised and the achieved throughput of VLC based systems. To mitigate the aforementioned channel impairments, this paper proposes a random Fourier feature (RFF) based kernel minimum symbol error rate (KMSER) decision feedback equalizer (DFE) based post-distorter for VLC, which supports post distortion under finite memory budget. Furthermore, the feedforward, and feedback filter weights are jointly optimized by using a stronger minimum symbol error rate criterion as opposed to the conventional minimum mean square error criterion. Simulations indicate that the proposed RFF-KMSER-DFE based post-distorter exhibits superior BER performance and lower computational complexity over the existing dictionary based post-distorters. Lastly, an analytical bound for BER is derived for the proposed algorithm, and corroborated through simulations.