Background: Plant associated endophytic microbes play an important role in plant’s growth and development. After seed germination, the seed associated endophytes rapidly colonize the seedlings and help in their growth and protection against pathogens. This study was aimed to understand the diversity in the endophytic microbial population associated with the seeds of papaya (Carica papaya) and its wild relatives from Vasconcellea genus (family: Caricaceae). The species of Vasconcellea genus are widely used to introgress virus resistance in cultivated varieties of papaya. Hence, the diversity of seed associated endophytic microbes and their gene functional analysis was carried out through next generation sequencing of the microbial 16S rRNA and ITS sequences. Results: The 16S rRNA amplicon analysis revealed that the number of operational taxonomic units (OTUs) was higher for the endophytic bacteria, ranging between 144–204 when compared to 41–69 OTUs for the endophytic fungi. The bacterial phylum Proteobacteria was the most abundant seed associated phylum, with 64.7–72.8% abundance, across all four species of Caricaceae family, followed by Firmicutes (13.6–26.1%), Patescibacteria (1.1–2%) and Actinobacteria (0.7–2.7%). With respect to the diversity of bacteria by abundance indices, Vasconcellea goudotiana had the highest OTUs of 204, followed by 177 in V. cauliflora, 156 in V. cundinamarcensis, and 144 in C. papaya. The alpha diversity indices and functional analysis revealed the differences in the OTUs and the functional annotations among the above four plant species. The fungal OTUs were in the range of 41–69; however, only a small fraction of them could be taxonomically classified. Conclusion: Our microbiome studies reveal the differences in the seed associated endophytic microbial community across the four plant species of Caricaceae family. This study also unravels the composition of endophytic microbial population associated with the seeds of different plant species of Caricaceae family and their gene functions. It also provides an insight into both culturable and nonculturable endophytic microbes. Further this study reveals that domestication of Carica papaya might have resulted into reduced microbial diversity when compared to their wild relatives from Vasconcellea genus.