This study was conducted before and after harvesting of wheat and maize in a typical agricultural landscape of the North China Plain. We investigated the diversity of two important natural enemy groups, carabids and spiders, using pitfall traps at crop field margin with different vegetation structures and their neighboring crop field. Throughout the comparison of the spatial and temporal distribution of the diversity of carabids and spiders in field margin and neighboring field, and the investigation of the relationship between arthropod communities and vegetation structure, this study aimed to understand the role of semi-natural field margin in biodiversity conservation of different natural enemy taxa. Results showed that the abundance of spiders was significantly higher in field margin than in neighboring fields over the entire period. No significant difference of the diversity of carabids in field margin and crop field was observed, but the community composition was different. Number of spider families increased in field margin but deceased in crop field after harvesting, indicating a migration activity between field and field margin. Vegetation structure in the field margin had different association with carabids than with spiders, with diversity of dominant carabid species positively associated with herb coverage and negatively with wood coverage, while the diversity of spider family Linyphiidae was positively associated with herb coverage only. Semi-natural habitat benefited the conservation of the diversity of arthropod natural enemies in crop field via promoting their dispersal to crop field, while such impacts differed from different vegetation structures and varied from target beneficial natural enemy communities. Future studies should focus on in-depth understanding of the food and habitat source requirement of different natural enemy taxa, and hence to design suitable semi-natural habitats to maintain a high diversity of natural enemy communities.