Natural structural materials typically feature complex hierarchical anisotropic architectures, resulting in excellent damage tolerance. Such highly anisotropic structures, however, also provide an easy path for crack propagation, often leading to catastrophic fracture as evidenced, for example, by wood splitting. Here, we describe the weakly anisotropic structure of Ginkgo biloba (ginkgo) seed shell, which has excellent crack resistance in different directions. Ginkgo seed shell is composed of tightly packed polygonal sclereids with cell walls in which the cellulose microfibrils are oriented in a helicoidal pattern. We found that the sclereids contain distinct pits, special fine tubes like a "screw fastener," that interlock the helicoidal cell walls together. As a result, ginkgo seed shell demonstrates crack resistance in all directions, exhibiting specific fracture toughness that can rival other highly anisotropic natural materials, such as wood, bone, insect cuticle, and nacre. In situ characterization reveals ginkgo's unique toughening mechanism: pit-guided crack propagation. This mechanism forces the crack to depart from the weak compound middle lamella and enter into the sclereid, where the helicoidal cell wall significantly inhibits crack growth by the cleavage and breakage of the fibril-based cell walls. Ginkgo's toughening mechanism could provide guidelines for a new bioinspired strategy for the design of high-performance bulk materials.