Oral and/or tongue swabs have demonstrated ability to detect Mycobacterium tuberculosis (Mtb) in adults with pulmonary tuberculosis (TB). Swabs provide useful alternative specimens for diagnosis of TB using molecular assays however, the diagnostic pickup by culture requires further improvement and development. Several studies identified the presence of differentially culturable tubercle bacilli (DCTB) populations in a variety of clinical specimens. These organisms do not grow in routine laboratory media and require growth factors in the form of culture filtrate (CF) from logarithmic phase cultures of Mtb H37Rv. Herein, we compared the diagnostic performance of sputum and tongue swabs using Mycobacterial Growth Indicator Tube (MGIT) assays, Auramine smear, GeneXpert and DCTB assays supplemented with or without CF. From 89 eligible participants, 83 (93%), 66 (74%) and 79 (89%) were sputum positive by MGIT, smear and GeneXpert, respectively. The corresponding tongue swabs displayed a lower sensitivity with 39 (44%), 2 (2.0%) and 18 (20%) participants respectively for the same tests. We aimed to improve the diagnostic yield by utilizing DCTB assays. Sputum samples were associated with a higher positivity rate for CF-augmented DCTB at 82/89 (92%) relative to tongue swabs at 36/89 (40%). Similarly, sputum samples had a higher positivity rate for DCTB populations that were CF-independent at 64/89 (72%) relative to tongue swabs at 26/89 (29%). DCTB positivity increased significantly, relative to MGIT culture, for tongue swabs taken from HIV-positive participants. We next tested whether the use of an alternative smear stain, DMN-Trehalose, would improve diagnostic yield but noted no substantial increase. Collectively, our data show that while tongue swabs yield lower bacterial numbers for diagnostic testing, the use of growth supplementation may improve detection of TB particularly in HIV-positive people but this requires further interrogation in larger studies.