Rhizobia are a well-known group of soil bacteria that establish symbiotic relationship with leguminous plants, fix atmospheric nitrogen, and improve soil fertility. To fulfill multiple duties in soil, rhizobia are elaborated with a large and complex multipartite genome composed of several replicons. The genetic material is divided among various replicons, in a way to cope with, and satisfy the diverse functions of rhizobia. In addition to the main chromosome, which is carrying the essential (core) genes required for sustaining cell life, the rhizobia genomes contain several extra-chromosomal plasmids, carrying the nonessential (accessory) genes. Occasionally, some mega-plasmids, denoted as secondary chromosomes or chromids, carry some essential (core) genes. Furthermore, specific accessory gene sequences (the symbiotic chromosomal islands) are incorporated in the main chromosome of some rhizobia species in Bradyrhizobium and Mesorhizobium genera. Plasmids in rhizobia are of variable sizes. All of the plasmids in a Rhizobium cell constitute about 30–50% of the genome. Rhizobia plasmids have specific characters such as miscellaneous genes, independent replication system, self-transmissibility, and instability. The plasmids regulate several cellular metabolic functions and enable the host rhizobia to survive in diverse habitats and even under stress conditions. Symbiotic plasmids in rhizobia are receiving increased attention because of their significance in the symbiotic nitrogen fixation process. They carry the symbiotic (nod, nif and fix) genes, and some non-symbiotic genes. Symbiotic plasmids are conjugally-transferred by the aid of the non-symbiotic, self-transmissible plasmids, and hence, brings about major changes in the symbiotic interactions and host specificity of rhizobia. Besides, the rhizobia cells harbor one or more accessory, non-symbiotic plasmids, carrying genes regulating various metabolic functions, rhizosphere colonization, and nodulation competitiveness. The entire rhizobia-plasmid pool interacting in harmony and provides rhizobia with substantial abilities to fulfill their complex symbiotic and non-symbiotic functions in variable environments. The above concepts are extensively reviewed and fairly discussed.