Controlling composition and plasmonic response of bimetallic nanoparticles (NPs) is of great relevance to tune their catalytic activity. Herein, we demonstrate reversible composition and plasmonic response transitions from a core/shell to a bimetallic alloyed palladium/gold NP triggered by CO adsorption and sample temperature. The use of self-organized growth on alumina template film allows scrutinizing the impact of core size and shell thickness onto NP geometry and plasmonic response. Topography, molecular adsorption, and plasmonic response are addressed by scanning tunneling microscopy, vibrational sum frequency generation (SFG) spectroscopy, and surface differential reflectance spectroscopy, respectively. Modeling CO dipolar interaction and optical reflectivity corroborate the experimental findings. We demonstrate that probing CO adsorption sites by SFG is a remarkably sensitive and relevant method to investigate shell composition and follow in real-time Pd atom migration between the core and the shell. Pd-Au alloying is limited to the first two monolayers of the shell and no plasmonic response is found, while for a thicker shell, a plasmonic response is observed, concomitant with a lower Pd concentration in the shell. Above 10-4mbar, at room temperature, CO adsorption triggers the shell restructuration, forming a Pd-Au alloy that weakens the plasmonic response via Pd migration from the core to the shell. NP annealing at 550K, after pumping CO, leads to the desorption of remaining CO and gives enough mobility for Pd to migrate back inside the core and recover a pure gold shell with its original plasmonic response. This work demonstrates that surface stoichiometry and plasmonic response can be tuned by using CO adsorption and NP annealing.