Dispersal is a fundamental aspect of primates' lives and influences both population and community structuring, as well as species evolution. Primates disperse within an environmental context, where both local and intervening environmental factors affect all phases of dispersal. To date, research has primarily focused on how the intervening landscape influences primate dispersal, with few assessing the effects of local habitat characteristics. Here, we use a landscape genetics approach to examine between- and within-site environmental drivers of short-range black-and-white ruffed lemur (Varecia variegata) dispersal in the Ranomafana region of southeastern Madagascar. We identified the most influential drivers of short-range ruffed lemur dispersal as being between-site terrain ruggedness and canopy height, more so than any within-site habitat characteristic evaluated. Our results suggest that ruffed lemurs disperse through the least rugged terrain that enables them to remain within their preferred tall-canopied forest habitat. Furthermore, we noted a scale-dependent environmental effect when comparing our results to earlier landscape characteristics identified as driving long-range ruffed lemur dispersal. We found that forest structure drives short-range dispersal events, whereas forest presence facilitates long-range dispersal and multigenerational gene flow. Together, our findings highlight the importance of retaining high-quality forests and forest continuity to facilitate dispersal and maintain functional connectivity in ruffed lemurs.