Geopolymers are alternatives to ordinary Portland cement as construction materials. The increasing demand for sustainable construction materials has driven the utilization of industrial by-products and agricultural waste. The disposal of oil palm frond (OPF) biomass as waste in landfills poses significant environmental challenges, necessitating effective recycling strategies. This study examines the incorporation and feasibility of OPF as a reinforcing fiber in fly ash geopolymer composites, examining its impact on physical and mechanical properties. Various parameters were tested, including fiber content (10–20 wt.%), shapes (shredded and tubular), and lengths (1–3 cm). The geopolymer composites with 10 wt.% shredded oil palm frond and 1-cm tubular oil palm frond fibers enhance the compressive strength by 17% compared to the control sample without oil palm frond. The shredded oil palm frond was particularly effective, enhancing strength performance and achieving better dispersion within the geopolymer matrix. Conversely, increasing the fiber content and length generally resulted in diminished composite strength, attributed to the creation of a more porous structure and weaker fiber-matrix interactions. However, lower fiber additions were shown to decrease porosity and water absorption, highlighting the potential of optimized oil palm frond fiber content and form in improving the environmental and mechanical performance of geopolymer composites. These results support the viability of oil palm frond as a sustainable additive in geopolymers, contributing to waste reduction and material innovation in construction.