Studies have shown that duration perception depends on several visual processes. However, the stages of visual processes that contribute to duration perception remain unclear. This study examined the effects of categorical differences in face adaptation on perceived duration. In all the experiments, we compared the perceived durations of human, monkey, and cat faces (comparison stimuli) after adapting to a human face. Results revealed that the human comparison stimuli were perceived shorter than the monkey and cat comparison stimuli (categorical face adaptation on duration perception [CFAD]). The difference between the face categories disappeared when the adapting stimulus was rendered unrecognizable by phase scrambling, indicating that adaptation to low-level visual properties cannot fully account for the CFAD effect. Furthermore, CFAD was preserved but attenuated when the adapting stimulus was inverted or a 1,000-ms interval was inserted before the comparison stimuli, which implied that CFAD occurred as long as the adapting stimulus was perceived as a face and not simply based on conceptual category processes. These findings indicate that face adaptation affects perceived duration in a category-specific manner (the CFAD effect) and highlights the involvement of visual categorical processes in duration perception.