In large scale multiple-input multiple-output (MIMO) systems (or massive MIMO systems), hybrid beamforming is a promising technique due to its versatile tradeoff between implementation cost (including hardware cost and power consumption) and system performance. In this paper, we investigate the downlink millimeter wave (mmWave) multi-user massive MIMO system and propose an interference cancellation (IC) framework on hybrid beamforming design. Based on the proposed framework, three successive interference cancellation (SIC) aided hybrid beamforming algorithms are proposed to deal with inter-user and intra-user interference. Specifically, for the first proposed algorithm, we use zero-forcing (ZF) to cancel inter-user interference and use SIC to cancel intra-user interference. For the second one, SIC is used to cancel inter-user interference and ZF is used to cancel intra-user interference. Both inter-user interference and intra-user interference are suppressed by SIC in the third algorithm. Furthermore, the optimal detection order of data streams is derived according to the post-detection signal-to-interference-plus-noise ratio (SINR). Numerical results show that the proposed SIC-aided hybrid beamforming algorithms outperforms the existing approaches in terms of spectral efficiency (SE) at the cost of computational complexity for the SIC procedure. Moreover, the results indicate that the proposed algorithms can achieve good SE performance with 2-bit finite resolution phase shifters and channel estimation error.