Collagen degeneration is an important pathological feature of osteoarthritis. The purpose of this study is to investigate whether the polarization-sensitive optical coherence tomography (PSOCT)-based optical polarization tractography (OPT) can be useful in imaging collagen structural changes in human osteoarthritic cartilage samples. OPT eliminated the banding artifacts in conventional PSOCT by calculating the depth-resolved local birefringence and fiber orientation. A close comparison between OPT and PSOCT showed that OPT provided improved visualization and characterization of the zonal structure in human cartilage. Experimental results obtained in this study also underlined the importance of knowing the collagen fiber orientation in conventional polarized light microscopy assessment. In addition, parametric OPT imaging was achieved by quantifying the surface roughness, birefringence, and fiber dispersion in the superficial zone of the cartilage. These quantitative parametric images provided complementary information on the structural changes in cartilage, which can be useful for a comprehensive evaluation of collagen damage in osteoarthritic cartilage.