Construction of hierarchical architecture with suitable band alignment for graphitic carbon nitride (g-C3N4) played a pivotal role in enhancing the efficiency of photocatalysts. In this study, a novel attapulgite-intercalated g-C3N4/ZnIn2S4 nanocomposite material (ZIS/CN/ATP, abbreviated as ZCA) was successfully synthesized using the freeze-drying technique, thermal polymerization, and a simple low-temperature hydrothermal method. Attapulgite (ATP) was intercalated into g-C3N4 to effectively regulate its interlayer structure. The results reveal a substantial enlargement of its internal space, thereby facilitating the provision of additional active sites for improved dispersibility of ZnIn2S4. Notably, the optimized photocatalyst, comprising a mass ratio of ATP, g-C3N4, and ZnIn2S4 at 1:1:2.5 respectively, achieves an outstanding hydrogen evolution rate of 3906.15 μmol g−1h−1, without the need for a Pt co-catalyst. This rate surpasses that of pristine g-C3N4 by a factor of 475 and ZnIn2S4 by a factor of 5, representing a significant improvement in performance. This significant enhancement can be primarily attributed to the higher specific surface area, richer active sites, broadened light response range, and efficient interfacial charge transfer channels of the ZCA composite photocatalyst. Furthermore, the Z-scheme photocatalytic mechanism for the sandwich-like layered structure heterojunction was thoroughly investigated using diverse characterization techniques. This work offers new insights for enhancing photocatalytic performance through the expanded utilization of natural minerals, paving the way for future advancements in this field.