Ladakh lies at a strategic location between the Indus River valley and the Hindu Khush Mountains, which makes the “Land of high passes” one of the major routes of movement. Through the years the region has faced multi-layered cultural movements, genetic assimilation and demographic changes. The initial settlement in the years goes back to the early Neolithic age and still continues despite its harsh, unhospitable and cold climate. Previous studies mostly covered the patrilineal markers of the region and an in-depth study lacked to represent the matrilineal ancestry and possible genetic inflow in the region. Hence, our current study first time generated complete mitogenomes of 108 unrelated individuals from Ladakh belonging to three population groups namely, Changpa (n = 38), Brokpa (n = 32) and Monpa (n = 38). In the in-depth analysis, we found that the mitogenome of the three Ladakhi groups are highly diverse in terms of maternal haplogroup distribution carrying lineages specific to East Asia (M9a), Tibbet (A21) and South Asia (M3, M30, U2). In our analysis we found that Changpa and Monpa probably have shared maternal ancestry compared to Brokpa, which is very distinct and also later suffered possible historical Bottleneck. Bayesian evolutionary and Network analysis indicates more ancient maternal lineage of Changpa and Monpa in terms of M9a haplotypes, but they also share some genetic history with Tibeto-Burman speakers in past. These findings conclusively indicate possible matrilineal genetic inflow in Ladakh from three directions, primarily from East Asia or South East Asia during post-glacial, West Eurasia and also from South Asia.