Water quality parameter dynamics, gut, sediment and water bacteria communities were studied to understand the environmental influence on the gut microbial community of a new strain of Huanghe common carp. A total of 3,384,078 raw tags and 5105 OTUs were obtained for the gut, water and sediment bacteria. The water quality had a stronger influence on the water bacteria community than gut and sediment bacteria communities. The ambient water quality parameters also significantly influenced the water and sediment bacteria communities. Comparing the gut, sediment, and water microbial communities, a relationship was found among them. However, gut bacteria were more closely related to sediment bacterial communities than to water bacteria communities. The results showed that the top three bacterial taxa were identical in gut and sediment samples in the early days of rearing. Interestingly, bacterial communities in the carp gut, water, and sediment had different adaptabilities to variations in environmental factors.