Abstract. With the rapid advancement of science and technology, autonomous driving technology has been widely applied in various fields such as the automotive industry, intelligent warehousing, and emergency rescue. Traditional 2D path planning has limitations in dealing with the complex and dynamic environments of the real world, making it difficult to meet the high precision and complex path planning requirements of autonomous vehicles. With the development of data acquisition technology, large-scale point cloud data has become easily accessible, which can better extract the three-dimensional complex of the environment. Nevertheless, the unstructured nature and vast amount of point cloud data make path planning on it extremely challenging. Voxel models can effectively compress point cloud data and provide neighboring topological structures. In view of this, we propose a voxel-based framework for the path planning of autonomous vehicles in dynamic and complex 3D environments, which involves converting point cloud data into voxels and extracting navigation spaces. Subsequently, deep reinforcement learning techniques are utilized to achieve obstacle avoidance and navigation on the voxel map. It is expected that this framework will contribute to the development of 3D path planning and enhance the utilization of point cloud data in the navigation field.