Due to interactions with variety of environmental and physicochemical factors, the composition and diversity of bacteria and fungi in manure ectopic fermentation are constantly changing. The purpose of this study was to investigated bacterial and fungal changes in dairy manure ectopic fermentation, as well as the relationships between keystone species and physicochemical characteristics. Ectopic fermentation was carried out for 93 days using mattress materials, which was combined with rice husk and rice chaff (6:4, v/v), and dairy waste mixed with manure and sewage. Physicochemical characteristics (moisture content, pH, NH4+-N (NN), total organic carbon (TO), total nitrogen (TN) and the C/N ratio) of ectopic fermentation samples were measured, as well as enzymatic activity (cellulose, urease, dehydrogenase and alkaline phosphatase). Furthermore, the bacterial and fungal communities were studied using 16S rRNA and 18S rRNA gene sequencing, as well as network properties and keystone species were analyzed. During the ectopic fermentation, the main pathogenic bacteria reduced while fecal coliform increased. The C/N ratio gradually decreased, whereas cellulase and dehydrogenase remained at lower levels beyond day 65, indicating fermentation maturity and stability. During fermentation, the dominant phyla were Chloroflexi, Firmicutes, Proteobacteria, Bacteroidetes, and Actinobacteria of bacteria, and Ascomycota of fungi, while bacterial and fungal community diversity changed dramatically and inversely. The association between physicochemical characteristics and community keystone taxon was examined, and C/N ratio was negative associated to keystone genus. These data indicated that microbial composition and diversity interacted with fermentation environment and parameters, while regulation of keystone species management of physicochemical factors might lead to improved maturation rate and quality during dairy manure ectopic fermentation. These findings provide a reference to enhance the quality and efficiency of waste management on dairy farm.