In most rabbit farms, breeding does kindle and nurse their kits in single-litter cages throughout their entire reproduction cycle. However, the protective behavior can lead to aggressive displays and injuries when the does are housed in groups. This study aimed to evaluate cage enrichment for reducing the agonistic behavior in part-time group-housed does. A total of eighty does with their 22-day-old kits were allocated to 20 multi-litter cages, with each cage housing four does and their litters for 10 days. Each multi-litter group was subjected to one of four treatments: alfalfa blocks as distraction material (A), wooden panels underneath the platforms (P), both alfalfa and wooden panels (AP), or no extra enrichment (controls, C). This experiment was replicated for three consecutive reproduction cycles. The skin injuries of the does and the kits were scored with a tagged visual analog scale before grouping and at one, three, six, eight, and 10 days after grouping. Computer vision techniques were used to continuously monitor rabbit activity and agonistic behavior (aggression and fleeing/chasing) during the first 24 h after grouping, specifically during light hours. During the first day in the group, 67.2% of the does and 13.4% of the kits acquired new injuries. This increased to 82.0 and 33.2%, respectively after 10 days in the group relative to the onset of grouping. The injury scores of the does increased toward the sixth day after grouping compared to the first (p < 0.001) and were highest on the tenth day for the kits (p < 0.001). On all the observation days, the number of injured does was higher in C compared to A (p = 0.04) and AP treatment (p = 0.005). There were no other treatment effects observed on the doe or kit skin injuries. Rabbit activity was highest after grouping but decreased after the first and second days (p < 0.001). The agonistic interactions between the does involved more fleeing/chasing behavior (62.0%) rather than aggression (38.0%). Although hierarchy fights are likely when unacquainted does are group-housed, the many animals that sustained injuries and the high injury scores confirm that part-time group housing for does is challenging and possibly inevitable. This study has shown that alfalfa, with or without wooden panels, can slightly reduce the number of injured does.