D-band (110-170 GHz) has been regarded as a potential candidate for the future 6G wireless network because of its large available bandwidth. At present, the lack of electrical amplifiers operating in the high frequency band and the strong nonlinear effect, i.e., the D-band, are still important problems. Therefore, effective methods to mitigate the nonlinear issue resulting from the ROF link are indispensable, among of which machine learning is considered the most effective paradigm to model the nonlinear behavior due to its nonlinear active function and structure. In order to reduce the computation amount and burden, a novel deep learning neural network equalizer connected with typical mathematical frequency offset estimation (FOE) and carrier phase recovery (CPR) algorithms is proposed. We implement D-band 45 Gbaud PAM-4 and 20 Gbaud PAM-8 ROF transmission simulations, and the simulation results show that the real value neural network (RVNN) equalizer connected with the Viterbi-Viterbi algorithm exhibits better compensation ability for nonlinear impairment, especially when dealing with serious inter-symbol interference and nonlinear effects. In our experiment, we employ coherent detection to further improve the receiver sensitivity, so a complex baseband signal after down conversion at the receiver is inherently produced. In this scenario, the complex value neural network (CVNN) and RVNN equalizer connected with the Viterbi-Viterbi algorithm have better BER performance with an error rate lower than the HD-FEC threshold of 3.8 × 10-3.