Dynamic legend generation for geological maps aims to detect and identify geological map symbols within the current viewshed and generate a corresponding real-time legend to help users quickly obtain the name and meaning of symbols. Detection and recognition entail high complexity and uncertainty because of the diversity of symbol types and the randomness of symbol distribution, and thus the generation of dynamic legends for geological maps is challenging. A new framework based on deep learning is proposed in this study, combining the deep convolutional neural network (CNN) and graph convolutional network (GCN) to realize the extraction and recognition of geological map symbols. Within the framework, a CNN-based model called single symbol detection network (SSDN) is developed to detect and identify single geological map symbols, and a novel GCN combined with L2 distance attention (DAGCN) is proposed to deal with the difficulty of extracting compound symbols caused by the randomness of symbol distribution. This work systematically solves the problem of geological symbol detection with the aid of object detection technology based on deep learning, providing foundation for the dynamic legend generation. Experiments show that the framework of the proposed method is effective, and a new benchmark is established for geological symbol detection on geological maps. All of our data and code are publicly available.