As the demand for private vehicles rises, there has been a gradual increase in the number of motor vehicles on the roads, leading to a growing concern about addressing traffic safety. Currently, China’s approach to assessing driver capabilities remains rooted in traditional, non-intelligent, and standardized evaluation methods based on examination subjects. The traditional model often falls short in providing constructive feedback on a driver’s real-world vehicle handling abilities, as many of the examination subjects can be practiced in advance to achieve a mere passing result, which, undoubtedly, increases the likelihood of underqualified drivers on the road. To address the issues of the current examination-oriented driver evaluation system in China, we propose a road performance assessment model (RPAM) that assesses drivers comprehensively by evaluating their road environment perception and vehicle operation abilities based on an in-vehicle and out-vehicle perception system. The model leverages patterns of the driver’s head posture, along with real-time information on the vehicle’s behavior and the road conditions, to quantify various performance metrics related to reasonable operation processes. These metrics are then integrated to generate a holistic assessment of the driving capabilities. This paper ultimately conducted tests of the RPAM on one actual examination route in Beijing. Two drivers were randomly selected for the examination. The model successfully computed the overall ability scores for each driver, validating the effectiveness.