In Taiwan, even though the highway agencies have been making effort to improve the overall serviceability of the road system, more often than not, road users were not satisfied with the performance of the maintenance and rehabilitation (M&R) activities. This paper focuses on the performance of M&R activities in Taiwan from the road users’ perspective. Surveys were conducted to collect the users’ perception (serving as the performance) of the M&R activities. The Decision Making Trial and Evaluation Laboratory (DEMATEL) and Analytic Network Process (ANP) are jointly used to quantify the performance of M&R activities. DEMATEL is employed to understand the influence among the criteria/elements, and ANP is used to determine the relative weights of the elements. It is found that the respondents were most concerned about unsafe conditions due to manhole covers, damaged manhole covers, insufficient street lighting, potholes and bumps on pavements, and uneven pavements. Furthermore, the performance of M&R activities implemented on six major road types in Taiwan is analysed using the Formal Concept Analysis (FCA) method. Based on the concept lattice and association rules derived from FCA, directions for the improvement of M&R activities are proposed.