The search for cancer biomarkers is of great significance for the early diagnosis and clinical treatment planning of pancreatic cancer. RNA transcription networks can effectively represent the interactions between RNA molecules, and the irregular perturbations in these interactions can lead to pathological states, making them commonly used for identifying cancer biomarkers. However, traditional network-based methods for identifying cancer biomarkers often rely on prior information and mutation data. Furthermore, most network controllability-based methods face the limitation of high computational complexity, preventing their integration with deep learning methods. In this paper, we propose a novel deep learning framework, called HATZFS, for identifying driver biomarkers in pancreatic cancer using RNA differential expression data. The proposed model combines hierarchical deep Q-network (HDQN), graph attention network (GAT), and zero-forcing set (ZFS). Firstly, a pancreatic cancer RNA transcription regulatory network is constructed to embed the complex relationship among Long non-coding RNA (lncRNA), microRNA (miRNA) and messenger RNA (mRNA). Then, we transform it into multiple subgraphs using graph sampling method, and apply GAT to learn the node features of the subgraphs. Finally, the HATZFS performs HDQN to select subgraphs and identify important RNA as driver nodes, and determining the controllability of the subgraphs based on ZFS. More important, the paper theoretically proves that when all subgraphs are controllable, the original graph is also controllable, and the union of the driver node sets of all subgraphs is equal to the driver node set of the original graph. To confirm the effectiveness of the proposed model, comprehensive experiments are conducted on the benchmark dataset consisting of 14 databases, comparing it with eight other algorithms. The experimental results demonstrate that the proposed model outperforms other methods. Overall, HATZFS not only provides the importance of all RNA molecules in the pancreatic cancer RNA regulatory network, but also identifies the driver node set of the network as driver biomarkers. Source code can be accessed at https://github.com/HongJieTongXue/HATZFS.