The diagnosis of osteoarthritis (OA) is based on radiological changes that are delayed, along with clinical symptoms. Early and very early diagnosis at the stage of molecular pathology may eventually offer an opportunity for early therapeutic intervention that may retard and prevent future damage. Cartilage oligomeric matrix protein (COMP) is a non-collagenous extracellular matrix protein that promotes the secretion and aggregation of collagen and contributes to the stability of the extracellular matrix. There are contradictory literature data and currently, the parameter is used only for scientific purposes and its significance is not well-determined. The serum level of COMP in patients with metabolic type OA of the knee has not been evaluated. The aim of the study was to analyze serum COMP levels in metabolic knee OA and controls with different BMI. Our results showed that the mean COMP values were significantly higher in the control group (1518.69 ± 232.76 ng/mL) compared to the knee OA patients (1294.58 ± 360.77 ng/mL) (p = 0.0012). This may be related to the smaller cartilage volume in OA patients. Additionally, COMP levels negatively correlated with disease duration (p = 0.04). The COMP level in knee OA with BMI below 30 kg/m2 (n = 61, 1304.50 ± 350.60 ng/mL) was higher compared to cases with BMI ≥ 30 kg/m2 (n = 76, 1286.63 ± 370.86 ng/mL), but the difference was not significant (p = 0.68). Whether this finding is related to specific features in the evolution of the metabolic type of knee OA remains to be determined. Interestingly, comparison of COMP levels in the controls with different BMI revealed significantly higher values in overweight and obese individuals (1618.36 ± 203.76 ng/mL in controls with BMI ≥ 25 kg/m2, n = 18, 1406.61 ± 216.41 ng/mL, n = 16; p = 0.0092). Whether this finding is associated with increased expression of COMP in the adipose tissue or with more intensive cartilage metabolism in relation to higher biomechanical overload in obese patients, considering the earlier development of metabolic type knee OA as an isolated finding, remains to be determined.