In the present study, we prepared an ethanol extract from the flowers of Styphnolobium japonicum L. (SJFE) and found that it contains rutin as a major constituent as well as quercetin kaempferol and isorhamnetin as minor components. In lipopolysaccharide-stimulated RAW 264.7 macrophages, we observed that SJFE significantly inhibited the production of nitric oxide and the expression of major inflammatory biomarkers such as inducible NO synthase, cyclooxygenase-2, interleukin (IL)-6, and IL-1β significantly. Based on these in vitro results, we investigated the anti-inflammatory properties of SJFE on osteoarthritis (OA) of the left hind knee joints induced by monosodium iodoacetate in rats. SJFE was orally administered to the rats with arthritis for 4 weeks, and the following results were obtained. The rats treated with SJFE exhibited a 24% improvement in the weight-bearing index of their affected legs, as well as reductions of 31.5% and 23.2% in serum levels of cartilage oligomeric matrix protein and C-terminal telopeptide 2, respectively. Additionally, Mankin’s score, an indicator used to assess the severity of joint cartilage damage, decreased by 2.75 points compared to the control with no treatment. These findings suggest that SJFE possesses anti-inflammatory properties and can alleviate symptoms of OA, indicating its potential to offer relief to individuals suffering from arthritis.