Abstract The traditional machine intelligence system lacks deep understanding and reasoning ability. This study took the automatic driving system in multi-agent as an example to bring higher-level intelligence and decision-making ability to automatic driving through knowledge intelligence. It obtained real-world geographic information data from OpenStreetMap, preprocessed the data, and built a virtual environment. The inception model was used to identify information in environmental images, and the knowledge information of traffic regulations, road signs, and traffic accidents was expressed to build a knowledge map. The knowledge related to automatic driving was integrated, and automatic driving training was carried out through the reward mechanism and the deep Q-network (DQN) model. About 13 kinds of traffic situations were set up in the virtual environment, and the traditional machine intelligence autonomous driving and knowledge fusion autonomous driving multi-agent were compared. The results show that the average number of accidents in 100,000 km of traditional machine intelligence autonomous driving and knowledge fusion autonomous driving multi-agents was 3 and 1.4, and the average number of violations in 100,000 km was 4.3 and 1.8, respectively. The average graphics processing unit (GPU) utilization rate of knowledge fusion autonomous driving in 13 virtual environments was 75.9%, and the average peak GPU utilization rate was 96.1%. Knowledge fusion of autonomous driving multi-agents can effectively improve the safety of autonomous driving and enable autonomous driving multi-agents to have a higher level of decision-making ability.