The dynamics of aquatic microbes is of great importance for comprehending the acclimatisation and evolution of microorganisms in lake ecology. However, little is known about the adaption strategies of microbial communities in East Dongting Lake, which had special and complexity geographical characteristics. A semi-enclosed lake area (A) and a waterway connected to Yangtze River (B) both existed in the lake zone. Here, we investigated bacterial and fungal community diversity, community network and community assembly processes in sediment and water. The results indicated that the proportion of OTU numbers and their relative abundance for rare and abundant taxa were different obviously between sediment and water, but not between bacteria and fungi. However, abundant subcommunities dominated the shifts of bacterial community diversity and structure in A region, while rare subcommunities for fungal community diversity. Compared to fungal community, bacterial network was more compact and more key stones were identified as rare taxa. In addition, stochastic processes (dispersal limitation) drove the community assembly of abundant and rare subcommunities, but the effects of deterministic processes (including variable and heterogeneous selections) affected more on rare rather than abundant taxa. Partial Mantel test further indicated that the effect of environmental factors was a stronger force in shaping abundant bacterial subcommunities (TOC, NH4+-N, TN, and ORP) and rare fungal subcommunities (ORP). Environmental factors explained more of the variation in bacterial community structure than that in fungal community structure, although they had additional effects on fungal community diversity and community assembly. Moreover, bacterial community affected the fungal community as a biotic factor in water. This research provided new insights into better understanding of microbial communities in the complex environment of the East Dongting Lake.