Aberrantly accumulated metabolites elicit intra- and inter-cellular pro-oncogenic cascades, yet current measurement methods require sample perturbation/disruption and lack spatio-temporal resolution, limiting our ability to fully characterize their function and distribution. Here, we show that Raman spectroscopy (RS) can directly detect fumarate in living cells in vivo and animal tissues ex vivo, and that RS can distinguish between Fumarate hydratase (Fh1)-deficient and Fh1-proficient cells based on fumarate concentration. Moreover, RS reveals the spatial compartmentalization of fumarate within cellular organelles in Fh1-deficient cells: consistent with disruptive methods, we observe the highest fumarate concentration (37 ± 19 mM) in mitochondria, where the TCA cycle operates, followed by the cytoplasm (24 ± 13 mM) and then the nucleus (9 ± 6 mM). Finally, we apply RS to tissues from an inducible mouse model of FH loss in the kidney, demonstrating RS can classify FH status. These results suggest RS could be adopted as a valuable tool for small molecule metabolic imaging, enabling in situ non-destructive evaluation of fumarate compartmentalization.