The root of Polygala tenuifolia Willd. (Polygalaceae) is well known for its use in the treatment of neurasthenia, amnesia, and inflammation. In this study, we isolated phenyl propanoid type metabolite tenuifoliside A, one of the phenylpropanoids from P. tenuifolia, and investigated its anti-inflammatory effects in lipopolysaccharide (LPS)-stimulated RAW264.7 and murine peritoneal macrophages. The results showed that tenuifoliside A inhibited the production of nitric oxide (NO), inducible nitric oxide synthase (iNOS), prostaglandin E2 (PG E2), and cyclooxygenase (COX)-2. In addition, tenuifoliside A suppressed the production of pro-inflammatory cytokines, such as tumor necrosis factor (TNF)-α and interleukin (IL)-1β. We also evaluated the effects of tenuifoliside A on the activation of nuclear factor-kappaB (NF-κB). Tenuifoliside A inhibited the translocation of the NF-κB subunit p65 into the nucleus by interrupting the phosphorylation and degradation of inhibitor kappa B (IκB)-α in LPS-stimulated murine peritoneal macrophages. Moreover, we confirmed that the suppression of the inflammatory process by tenuifoliside A was mediated through the mitogen-activated protein kinases (MAPKs) pathway based on the fact that tenuifoliside A significantly decreased p-c-Jun N-terminal kinase (p-JNK) protein expression in LPS-stimulated murine peritoneal macrophages. Taken together, the anti-inflammatory effects of tenuifoliside A were mediated by the inhibition of the NF-κB and MAPK pathways. This study is the first report on the anti-inflammatory effects of tenuifoliside A, and the strong anti-inflammatory effects of tenuifoliside A provide potential compound to be developed as therapeutic for inflammatory diseases.