We investigated the prevalence of a type IV secretion system (T4SS)-bearing plasmid among clinical isolates of carbapenem-resistant Acinetobacter baumannii (CRAB) using plasmid replicon typing. The complete sequence of a T4SS-bearing plasmid, pAB_CC, isolated from A. baumannii TYTH-1 was determined, and a comparative analysis of the T4SS gene modules was performed. Of the 129 isolates studied, GR6 (repAci6) was the most common (45 of 96 isolates) and was strongly linked with the T4SS. A comparative analysis of the T4SS locus in seven plasmid genomes, including pAB_CC, pACICU2, pABKp1, pABTJ1, p1BJAB0714, p2BJAB0868, and p2ABTCDC0715, indicated that fourteen genes on these plasmids were highly conserved compared to those of the F plasmid. Additionally, the chromosomes in the seven representative isolates may be evolutionarily distinct from their intrinsic T4SS-bearing plasmids, suggesting that the two T4SS lineages emerged long before the appearance of EC II. These two lineages are now widespread in A. baumannii strains.