Autism spectrum disorder (ASD) is defined by two core behavioral characteristics, namely, restricted repetitive behaviors and impaired social-communicative functioning. BTBR T+ltpr3tf/J (BTBR) mice provide a valuable animal model for ASD to elucidate the underlying mechanisms of these two behavioral characteristics of ASD. This study examined the social function of excessive grooming behavior in BTBR mice as a phenotype of restricted repetitive behaviors. Compared to the control C57BL/6 J (B6) strain, BTBR mice showed increased self-grooming when placed alone in a test apparatus, and this behavior was even more evident when confronted with a stimulus mouse (either B6 or BTBR) in a three-chamber test apparatus. While B6 mice tended to groom their face/snout region on the empty side of the chamber, BTBR mice showed excessive grooming with frequent transitions among grooming body regions on the side of the chamber containing a social stimulus. Acute systemic injection of buspirone,a serotonin 1A receptor agonist, as an anxiolytic, facilitated approach behavior toward social stimuli in the three-chamber setting in both B6 and BTBR mice. However, this treatment did not affect grooming behavior in B6 mice and significantly enhanced self-grooming in BTBR mice. These behaviors in BTBR mice suggest a potential signaling function of grooming in response to social stimuli, in which bodywide grooming of BTBR mice expressed in the proximity of social opponents may stimulate the release of olfactory (possibly dismissive) signals. Consequently, the putative neural mechanisms underlying excessive grooming may differ from those regulating social approaches that are associated with anxiolytic mechanisms.