In this paper, we consider the automorphism groups of Cayley graphs which are a basis of a complete Boolean algebra of strongly regular graphs, one of such graph is the integral distance graph Γ . The automorphism groups of the integral distance graphs Γ were determined by Kovács and Ruff in 2014 and by Kurz in 2009. Our point of interest will be restricted to the one determined by Kovács and Ruff. Here we consider the automorphism groups of subgraphs Γ 1 and Γ 2 , which inherit the properties of Γ . It will be shown that Aut Γ is isomorphic to Aut Γ 2 and that Aut Γ 1 is isomorphic to S F q 2 ≀ S [ 2 ] .