This paper investigates the factors which can influence the quenching effect from the perspective of energy transfer. The quenched fluorescence of the CdSe semiconductor quantum dots (SQDs) by using plasmonic Au nanocrystals (p-AuNCs) and molecule-like Au nanocrystals (m-AuNCs) in aqueous suspensions and spin-coated films is comparatively investigated. In the aqueous suspensions, the p-AuNCs have larger quenching effect than the m-AuNCs. In the spin-coated films, the p-AuNCs and m-AuNCs have comparable quenching factor. Furthermore, the experiments show that the p-AuNCs simultaneously enhance the radiative and nonradiative rates. But the m-AuNCs only enhance the nonradiative rate of the SQDs, which reveals the difference of quenching process between the p-AuNCs and m-AuNCs. This result of the research has guiding significance for the detection technique based on the fluorescence quenching.