Anemoside B4 (B4) is a saponin that is extracted from Pulsatilla chinensis (Bge.), and Regel exhibited anti-inflammatory, antioxidant, antiviral, and immunomodulatory activities. However, its hypoglycemic activity in diabetes mellitus has not been evaluated. Here, we explored the effect of B4 on hyperglycemia and studied its underlying mechanism of lowering blood glucose based on hyperglycemic rats in vivo and L6 skeletal muscle cells (L6) in vitro. The rats were fed a high-fat diet (HFD) for one month, combined with an intraperitoneal injection of 60 mg/kg streptozotocin (STZ) to construct the animal model, and the drug was administrated for two weeks. Blood glucose was detected and the proteins and mRNA were expressed. Our study showed that B4 significantly diminished fasting blood glucose (FBG) and improved glucose metabolism. In addition, B4 facilitated glucose utilization in L6 cells. B4 could enhance the expression of glucose transporter 4 (GLUT4) in rat skeletal muscle and L6 cells. Mechanistically, B4 elevated the inhibition of the phosphatidylinositol 3-kinase (PI3K)/protein kinase B (AKT) signaling pathways. Furthermore, we confirmed the effect of B4 on glucose uptake involved in the enhancement of GLUT4 expression in part due to PI3K/AKT signaling by using a small molecule inhibitor assay and constructing a GLUT4 promoter plasmid. Taken together, our study found that B4 ameliorates hyperglycemia through the PI3K/AKT pathway and promotes GLUT4 initiation, showing a new perspective of B4 as a potential agent against diabetes.