The optical response of metal nanoparticles is governed by plasmonic resonances, which depend often intricately on the geometry and composition of the particle and its environment. In this work we describe a method and analysis pipeline unravelling these relations at the single nanoparticle level through a quantitative characterization of the optical and structural properties. It is based on correlating electron microscopy with microspectroscopy measurements of the same particle immersed in media of different refractive indices. The optical measurements quantify the magnitude of both the scattering and the absorption cross sections, while the geometry measured in electron microscopy is used for numerical simulations of the cross section spectra accounting for the experimental conditions. We showcase the method on silver nanocubes of nominal 75 nm edge size. The large amount of information afforded by the quantitative cross section spectra and measuring the same particle in two environments, allows us to identify a specific degradation of the cube surface. We find a layer of tarnish, only a few nanometers thick, a fine surface compositional change of the studied system which would be hardly quantifiable otherwise.