As computing and communication technologies continue to evolve, leading technology companies are investing significant resources in self-driving car techniques. With the use of deep learning in driverless driving, driverless cars are enabling them to sense, make decisions and control in complex environments, leading to truly autonomous driving. Deep learning is used for environment perception, which enables driverless cars to understand their surroundings by recognizing information such as road surfaces, pedestrians and vehicles, and also used for decision formulation, by predicting the behavior of other vehicles, pedestrians and identifying the environment around the road conditions to control the driverless car to make the optimal driving decision. But in order to achieve fully autonomous driving, there are still some technical aspects. Therefore, we deep learning in the existing driverless technology is reviewed, mainly discussing the application in the direction of driverless implementation and safety inspection. Through reading a large amount of literature, we discuss the problems that hinder the development of the driverless field, and at the same time, how to solve the problems in the future to promote the breakthrough of the driverless field. The application of deep learning in driverless not only enhances the intelligence level of driverless cars, but also prepares for the commercial application of driverless cars in the future. It enables driverless cars to better identify and adapt to complex traffic environments. Finally, realizing truly autonomous driving.