The Cenozoic strata in the Rakhine Basin play a crucial role in hydrocarbon exploration; however, the provenance of these sedimentary rocks remains poorly investigated. In this study, we employed detrital zircon geochronology and geochemistry in the northern Rakhine shelf to investigate the provenance of sedimentary rocks and, combined with the previous studies, to identify their spatial and temporal variations and to elucidate the provenance evolution since the middle Miocene. The geochemical results of the zircons indicate that the primary source rocks of the sedimentary rocks are magmatic and metasedimentary rocks, particularly those of continental arc and post-collision granites. The origin of these rocks can be attributed to the Gangdese arc magmatic belt in the north, as well as the Indo-Burma Ranges in the east. The sedimentary rocks in the northern Rakhine yield zircon U-Pb age peaks primarily at 0-150 Ma, 400-600 Ma, 600-1000 Ma, and 1600-2100 Ma, with minor populations at 150-400 Ma and >2100 Ma. The detrital zircon provenance study shows that the zircons in the Miocene sedimentary rocks were primarily derived from the paleo-Brahmaputra River, with contributions ranging from 68.7% to 77.0%. During the Pliocene, the paleo-Brahmaputra River and the Chittagong-Tripura Fold Belt were the most significant sediment suppliers. Since the early Pleistocene, the northern Rakhine coastal region has played a significant role in their composition. The Brahmaputra River was the predominant contributor to upper Pleistocene rocks, and the Rakhine coastal region’s contribution to the shelf intensified throughout the Pleistocene. In conjunction with regional tectonic evolution, our study underscores the importance of the Indian Plate subduction as a pivotal factor influencing the provenance transitions in the northeastern Bay of Bengal.