Electropolymerization of aniline on suitably roughened gold electrodes enabled us to record in situ surface-enhanced Raman scattering (SERS) spectra of polyaniline (PAni) during the doping-undoping process. Indeed, SERS-activation pretreatment of gold working electrode, using a specific electrochemical oxidation-reduction procedure, leads to the formation of countless surface asperities. The intergranular sites, known as “hot spots”, thus generated by the surface roughness are the seat of a strong electromagnetic coupling which leads to a huge SERS effect. Contrary to the case of platinum or mirror-polished gold electrodes, the use of roughened gold leads to high quality in situ SERS spectra of PAni, allowing the observation of important changes in the spectral features of its different oxidation states. In this study, we relied on spectral decomposition procedures to monitor and try to quantify these transformations accompanying the variation in the oxidation state of the polymer in different acidic aqueous solutions. In particular, the transition between the different forms of PAni (leucoemeraldine → emeraldine → pernigraniline), the drastic passage from benzenoid to quinoid structures of some aniline nuclei and the evolution of the charge-carrying structural defects are investigated despite the limitations imposed by the challenging conditions of the in situ analysis.