Antibiotic resistance genes (ARGs) are prevalent in the livestock environment, but little is known about impacts of animal farming on the gut antibiotic resistome of local people. Here we conducted metagenomic sequencing to investigate gut microbiome and resistome of residents in a swine farming village as well as environmental relevance by comparing with a nearby non-farming village. Results showed a shift of gut microbiome towards unhealthy status in the residents of swine farming village, with an increased abundance and diversity in pathogens and ARGs. The resistome composition in human guts was more similar with that in swine feces and air than that in soil and water. Mobile gene elements were closely associated with the prevalence of gut resistome. Some plasmid-borne ARGs were colocalized in similar genetic contexts in gut and environmental samples. Metagenomic binning obtained 47 ARGs-carrying families in human guts, and therein Enterobacteriaceae posed the highest threats in antibiotic resistance and virulence. Several ARGs-carrying families were shared by gut and environmental samples (mainly in swine feces and air), and the ARGs were evolutionarily conservative within genera. The findings highlight that swine farming can shape gut resistome of local people with close linkage to farm environmental exposures.