Changes in extreme precipitation have become a significant issue of regional disaster risk assessment and water resources management. Extreme precipitation variability is affected by multiple factors and shows disparities across different regions. Especially in mountain areas, geographic feature and local characteristics put more complexity and uncertainty on the changes of precipitation extremes. In this study, ten extreme precipitation indices of Wuling Mountain Area (WMA) during 1960–2019 have been used to analyzed the spatiotemporal variations of precipitation extremes. The relationships between extreme precipitation and potential driving factors, including geographic factors, global warming, local temperature, and climate indices, were investigated via correlation analysis. The results indicated that extreme precipitation tends to have a shorter duration and stronger intensity in WMA. Decreasing trends in R10mm, R20mm, R25mm, and the consecutive wet days (CWD) series account for 92%, 68%, 52%, and 96% of stations, while most stations in WMA have rising trends in Rx1day (68%), SDII (64%), R95p (72%), and R99p (72%). Significant abrupt changes in extreme precipitation indices mainly occurred in the 1980s–1990s. Geographic factors, local temperature, and climate indices exert different impacts on extreme precipitation. Longitude and elevation instead of latitude significantly affect extreme precipitation indices except for the maximum duration of wet spells. Global warming is likely to increase the intensity and decrease the duration of extreme precipitation, while the influence of local temperature is not exactly the same as that of global warming. The study reveals that summer monsoon indices are the dominant climate factor for variations of precipitation extremes in WMA. The correlation coefficient between extreme precipitation indices (such as Rx1day, R95p, R99p) and the East Asian summer monsoon index is around 0.5 and passed the significant test at the 0.01 level. The weakening of the summer monsoon indices tends to bring extreme precipitation with stronger intensity. The findings provide more understanding of the drivers and reasons of extreme precipitation changes in the mountain area.