Construction materials are at the forefront of global economic development as they provide the foundation for the infrastructure of other industries, with cementitious materials being predominantly used in construction projects. To promote sustainable development, alternative materials are added to cement mortar to increase durability and reduce emissions. In this regard, graphene oxide (GO) and fly ash (FA) are two alternative materials commonly used in cement mortar, which are readily available or are just the waste from other local material production. With different ratios, the amount of GO and FA can affect the properties of cement mortar positively or negatively. This study aims to determine the effects of GO and FA on cement mortar mixtures under material conditions. Research results show that 10 wt% FA and 0.036 wt% GO will give cement mortar the best physical and mechanical properties while ensuring other necessary properties, such as workability. When increasing FA to 30 wt% or GO to 0.05 wt%, the strength of the mortar mixture tends to decrease. Another issue is that the specific surface area of graphene is very high, which poses a significant challenge when uniform dispersion in the cement paste mixture is required. Polycarboxylate combined with a specific mixing sequence has demonstrated good dispersibility and high stability. Through this research, it is demonstrated that the addition of GO and FA has the potential for sustainable development of the construction industry by considering the contexts of the local recycled cementitious replacement materials.