SGI-1027 is a recognized inhibitor of DNA methyltransferase 1 (DNMT1), and earlier investigations have indicated an inverse correlation between dysregulated DNMT1 expression in gastric cancer (GC) and retinoblastoma 1 (RB1) gene expression. Despite this knowledge, the precise mechanisms underlying the action of SGI-1027 in GC cells remain inadequately comprehended. The primary objective of this study is to elucidate the impact of SGI-1027 on the behavior of GC cells, encompassing aspects such as growth and metastatic potential, by intervening in DNMT1, thereby influencing the regulation of RB1 gene expression. The acquisition of the normal gastric mucosal cell line GES-1 and the human gastric cancer cell line MKN45 was followed by employing Western blot (WB) and quantitative reverse transcription-polymerase chain reaction (qRT-PCR) techniques to evaluate the expression levels of RB1 and DNMT1 in these two cell lines. Subsequently, the MKN45 cell line was cultured in medium containing varying concentrations of SGI-1027, and the impact of SGI-1027 on the regulation of RB1 and DNMT1 in GC cells was reassessed using WB and qRT-PCR techniques. To scrutinize the effect of SGI-1027 on GC cells, we utilized the 3-(4,5-dimethyl-2-thiazolyl)-2,5-diphenyl-2H tetrazolium bromide (MTT) assay to determine cell proliferation and performed Transwell experiments to assess cell migration and invasion capabilities. Throughout this process, we also employed WB to assess the levels of cell cycle-associated proteins (Cyclin D1, Cyclin E1, and Cyclin B1) and proteins related to apoptosis (BCL-2 associated protein X apoptosis regulator (BAX) and B-cell lymphoma 2 apoptosis regulator (BCL-2)). Furthermore, we injected the MKN45 cell line and MKN45 cell line cultured with the optimal concentration of SGI-1027 for 5 days and 10 days into mice subcutaneously and through the tail vein, dividing them into the Model group, Model+SGI-1027 5d group, and Model+SGI-1027 10d group. We monitored changes in tumor size and volume in mice, and tumor tissues as well as lung tissues were collected for hematoxylin and eosin (HE) staining. Finally, DNMT1 expression levels in GC tissues were detected using both WB and immunohistochemistry (IHC) techniques. Additionally, RB1 expression levels in GC tissues were assessed using WB. In contrast to GES-1 cells, MKN45 cells displayed a distinctive profile characterized by increased DNMT1 expression and decreased RB1 expression (p < 0.05). However, upon the introduction of SGI-1027, a notable decrease in DNMT1 levels within GC cells was observed, concomitant with an elevation in RB1 gene expression, with 25 μmol/L SGI-1027 identified as the optimal concentration (p < 0.05). Functional assays demonstrated that SGI-1027-treated GC cells exhibited pronounced features of inhibited proliferation, migration, and invasion when compared to untreated MKN45 cells (p < 0.05). Moreover, in SGI-1027-treated GC cells, the levels of Cyclin D1, Cyclin E1, Cyclin B1, and BCL-2 were significantly reduced, while the expression level of BAX increased (p < 0.05). Notably, the most pronounced impact was observed at 25 μmol/L SGI-1027, further underscoring its regulatory effects on tumor cell behavior (p < 0.05). In animal experiments, the Model group exhibited a substantial increase in tumor volume, with HE staining results indicating extensive necrosis in most gastric tissues and noticeable signs of lung metastasis, accompanied by increased DNMT1 expression and decreased RB1 gene expression. In contrast, the SGI-1027 group displayed a reduction in gastric tumor volume, decreased necrosis, and reduced lung tumor metastasis (p < 0.05). Additionally, the expression of DNMT1 was significantly reduced in SGI-1027-treated GC cells, while RB1 expression increased (p < 0.05), further confirming the inhibitory effects of SGI-1027 on tumor growth and metastasis. SGI-1027 effectively hinders the proliferation and dissemination of GC cells by downregulating DNMT1 and promoting the expression of RB1.