Randić index is one of the classical graph-based molecular structure descriptors in the field of mathematical chemistry. The Randić index of a graph is calculated by summing the reciprocals of the square root of the product of the degrees of two adjacent vertices in the graph. Meanwhile, the non-commuting graph is the graph of vertex set whose vertices are non-central elements and two distinct vertices are joined by an edge if and only if they do not commute. In this paper, the general formula of the Randić index of the non-commuting graph associated to three types of finite groups are presented. The groups involved are the dihedral groups, the generalized quaternion groups, and the quasi-dihedral groups. Some examples of the Randić index of the non-commuting graph related to a certain order of these groups are also given based on the main results.