A novel, to the best of our knowledge, photodetector with a metalens packaging module used as the visible light communication (VLC) receiver is proposed and designed. An LED consisting of red, green, blue, and yellow chips (RGBY-LED) is adopted as the transmitter for intensity modulation direct detection VLC systems. A metalens array with a numerical aperture (NA) of 0.707 used as a polarization-insensitive planar lens of the VLC system receiver is designed at wavelengths of 457, 523, 592, and 623 nm corresponding to blue, green, yellow, and red for high efficiency. Compared with a traditional Fresnel lens positive-intrinsic-negative (PIN) photodetector module as the VLC receiver, the introduction of a metalens module can decrease the form factor of the VLC receiver module and, in particular, it is much thinner. The combination of the multi-color LED transmitter and photodetector metalens packaging module receiver can increase the modulation bandwidth due to four different wavelengths used for the VLC system. Finite-difference time domain (FDTD) simulations are performed to validate the performance of the photodetector with a metalens module. It is revealed that the corresponding efficiencies of 57.5%, 55.4%, 57%, and 56.3% were achieved at wavelengths of 623, 592, 523, and 457 nm, respectively, based on a metalens array with a 0.707 NA and 2.5 µm radius of the active area of the photodetector. It is a promising technology for indoor VLC systems such as those for smart phones and other Internet of Things devices due to the need for compact packaging for the receiver.