Climate change may alter soil microbial communities and soil organic matter (SOM) composition. Soil carbon (C) cycling takes place over multiple time scales; therefore, long-term studies are essential to better understand the factors influencing C storage and help predict responses to climate change. To investigate this further, soils that were heated by 5 °C above ambient soil temperatures for 18 years were collected from the Barre Woods Soil Warming Study at the Harvard Forest Long-term Ecological Research site. This site consists of large 30 × 30 m plots (control or heated) where entire root systems are exposed to sustained warming conditions. Measurements included soil C and nitrogen concentrations, microbial biomass, and SOM chemistry using gas chromatography–mass spectrometry and solid-state 13C nuclear magnetic resonance spectroscopy. These complementary techniques provide a holistic overview of all SOM components and a comprehensive understanding of SOM composition at the molecular-level. Our results showed that soil C concentrations were not significantly altered with warming; however, various molecular-level alterations to SOM chemistry were observed. We found evidence for both enhanced SOM decomposition and increased above-ground plant inputs with long-term warming. We also noted shifts in microbial community composition while microbial biomass remained largely unchanged. These findings suggest that prolonged warming induced increased availability of preferred substrates, leading to shifts in the microbial community and SOM biogeochemistry. The observed increase in gram-positive bacteria indicated changes in substrate availability as gram-positive bacteria are often associated with the decomposition of complex organic matter, while gram-negative bacteria preferentially break down simpler organic compounds altering SOM composition over time. Our results also highlight that additional plant inputs do not effectively offset chronic warming-induced SOM decomposition in temperate forests.