Habitat loss and fragmentation represent the most serious extinction threats for many species and have been demonstrated to be especially detrimental for mammals. Particularly, highly specialized species with low dispersal abilities will encounter a high risk of extinction in fragmented landscapes. Here we studied the edible dormouse (Glis glis), a small arboreal mammal that is distributed throughout Central Europe, where forests are mostly fragmented at different spatial scales. The aim of this study was to investigate the effect of habitat fragmentation on genetic population structures using the example of edible dormouse populations inhabiting forest fragments in south western Germany. We genotyped 380 adult individuals captured between 2001 and 2009 in four different forest fragments and one large continuous forest using 14 species-specific microsatellites. We hypothesised, that populations in small forest patches have a lower genetic diversity and are more isolated compared to populations living in continuous forests. In accordance with our expectations we found that dormice inhabiting forest fragments were isolated from each other. Furthermore, their genetic population structure was more unstable over the study period than in the large continuous forest. Even though we could not detect lower genetic variability within individuals inhabiting forest fragments, strong genetic isolation and an overall high risk to mate with close relatives might be precursors to a reduced genetic variability and the onset of inbreeding depression. Results of this study highlight that connectivity among habitat fragments can already be strongly hampered before genetic erosion within small and isolated populations becomes evident.