Gas content and flow characteristics are closely related to shale lithofacies, and significant differences exist in the pore structure and fractal characteristics among lithofacies. In this study, X-ray diffractometer (XRD), field-emission scanning electron microscopy (FE-SEM), gas adsorption (N2 and CO2), and fractal theory were employed to systematically characterize the pore attributes of the marine Wufeng–Longmaxi formation shales. The information of various pores and microfractures among lithofacies was extracted and quantified via high-resolution FE-SEM image stitching technology. Shales were classified into four types based on mineral compositions, and siliceous shales possess the largest SEM-based surface porosity (2.84%) and the largest pore volume (PV) (average 0.0243 cm3/g) as well as specific surface area (SSA) (average 28.06 m2/g). The effect of lithofacies variation on the PV of shale is minor. In contrast, the lithofacies variation has a significant impact on the SSA, and the SSA of siliceous shale is 39.11% higher than that of argillaceous shale. PV and SSA show strong positive correlation with the total organic carbon (TOC) content but negative correlation with clay minerals. Siliceous shales have the greatest fractal dimension D1 (pore surface roughness) (average 2.6821), which is contributed by abundant organic matter pores with more complicated boundaries. The largest fractal dimension D2 (pore structure complexity) (average 2.8263) is found in mixed shales, which is attributed to well-developed intraparticle (intraP) pores associated with carbonate mineral dissolution. This indicates that siliceous shales have the highest methane adsorption capacity and that shale gas desorption, diffusion, and seepage are more difficult in mixed shales.