The bacterial community plays an important role in biogeochemical cycles in marine sediment. However, little is known about the vertical profiles and co-occurrence patterns of bacterial community in sediment cores from the marine environment. In this study, five sediment cores were taken from a subtropical bay in China, heavily impacted by anthropogenic activities. The bacterial composition in sediment cores was investigated by using high-throughput sequencing of the 16S rRNA gene. A principal coordinates analysis and an adonis analysis of the operational taxonomic unit (OTU) compositions showed that spatial variation, rather than vertical variation, determined the bacterial structure in sediment cores. The bacterial complexity varied greatly across the five sediment cores, and the rare taxa played an important role in supporting the stability of the bacterial network. This study revealed that sediment properties and anthropogenic activities may induce a shift in the bacterial composition in sediment cores of a subtropical bay.