Periprosthetic joint infection (PJI) is a catastrophic complication after total hip arthroplasty. A new drug-loaded carbon fiber-reinforced polymer (CFRP) prosthesis with a sustained drug-release mechanism is being developed for one-stage surgery. We aimed to examine the diffusion dynamics of vancomycin from vancomycin paste-loaded CFRP implants. The differences in the in vitro diffusion dynamics of vancomycin paste were investigated using the elution test by varying parameters. These included the mixing ratio of vancomycin and distilled water (1:0.8, 1:1.2, and 1:1.4) for vancomycin paste, and hole diameter (1mm and 2mm) on the container. The in vivo diffusion dynamics were investigated using a rabbit model with vancomycin-loaded CFRP implants placed subcutaneously. The in vitro experiments showed that the diffusion effect of vancomycin was highest in the parameters of vancomycin paste with distilled water mixed in a ratio of 1:1.4, and with a 2mm hole diameter. The in vivo experiments revealed diffusion dynamics similar to those observed in the in vitro study. The drug diffusion effect tended to be high for vancomycin paste with a large water ratio, and a large diameter of holes. These results indicate that the drug diffusion dynamics from a CFRP implant with holes can be adjusted by varying the water ratio of the vancomycin paste, and the hole size on the CFRP implant.