Cancer invasion and migration play a pivotal role in tumor malignancy, which is a major cause of most cancer deaths. Rotating magnetic field (RMF), one of the typical dynamic magnetic fields, can exert substantial mechanical influence on cells. However, studying the effects of RMF on cell is challenging due to its complex parameters, such as variation of magnetic field intensity and direction. Here, we developed a systematic simulation method to explore the influence of RMF on tumor invasion and migration, including a finite element method (FEM) model and a cell-based hybrid numerical model. Coupling with the data of magnetic field from FEM, the cell-based hybrid numerical model was established to simulate the tumor cell invasion and migration. This model employed partial differential equations (PDEs) and finite difference method to depict cellular activities and solve these equations in a discrete system. PDEs were used to depict cell activities, and finite difference method was used to solve the equations in discrete system. As a result, this study provides valuable insights into the potential applications of RMF in tumor treatment, and a series of in vitro experiments were performed to verify the simulation results, demonstrating the model's reliability and its capacity to predict experimental outcomes and identify pertinent factors. Furthermore, these findings shed new light on the mechanical and chemical interplay between cells and the ECM, offering new insights and providing a novel foundation for both experimental and theoretical advancements in tumor treatment by using RMF.