Surface-enhanced Raman scattering (SERS) is renowned for amplifying Raman signals, with electromagnetic mechanism (EM) enhancement arising from localized surface plasmon resonances and chemical mechanism (CM) enhancement as a result of charge transfer interactions. Despite the conventional emphasis on EM as a result of plasmonic effects, recent findings highlight the significance of CM when noble metals appear as smaller entities. However, the threshold size of the noble metal clusters/particles corresponding to the switch in SERS mechanisms is not clear at present. In this work, the VSe2-xOx/Au composites with different Au sizes are employed, in which a clear view of the SERS mechanism switch is observed at the Au size range of 16-21 nm. Our findings not only provide insight into the impact of noble metal size on SERS efficiency but also offer quantitative data to assist researchers in making informed judgments when analyzing SERS mechanisms.