Liver fibrosis is assessed mainly by conventional staining or second harmonic generation (SHG) microscopy, which can only provide collagen content in fibrotic area. We propose to use polarization-resolved SHG (PR-SHG) microscopy to quantify liver fibrosis in terms of collagen fiber orientation and crystallization. Liver samples obtained from autopsy cases with fibrosis stage of F0–F4 were evaluated with an SHG microscope, and 12 consecutive PR-SHG images were acquired while changing the polarization azimuth angle of the irradiated laser from 0° to 165° in 15° increments using polarizer. The fiber orientation angle (φ) and degree (ρ) of collagen were estimated from the images. The SHG-positive area increased as the fibrosis stage progressed, which was well consistent with Sirius Red staining. The value of φ was random regardless of fibrosis stage. The mean value of ρ (ρ-mean), which represents collagen fiber crystallinity, varied more as fibrosis progressed to stage F3, and converged to a significantly higher value in F4 than in other stages. Spatial dispersion of ρ (ρ-entropy) also showed increased variation in the stage F3 and decreased variation in the stage F4. It was shown that PR-SHG could provide new information on the properties of collagen fibers in human liver fibrosis.