The young Taiwan orogenic belt is a classic example of a modern arc–continent convergence zone, which displays a longitudinal transition from active collision in the north to oceanic subduction in the south. However, the timing of its initial exposure above the sea level and the early-stage uplift mechanism has been a point of much debate. Here we applied major and trace element, Nd isotope and heavy minerals analysis on the Miocene sedimentary rocks from the Hengchun Peninsula to trace sediment provenance and to further constrain the tectonic-sedimentary evolution of the Taiwan accretionary prism. Results show that the Hengchun mudstones (∼11.6–6.5 Ma) are characterized by higher CaO (1.42 wt %) and MgO (2.57 wt %) contents, Cr/Zr (0.52) and Co/Th (1.58) ratios, and less negative ϵNd (t) values (−12 to −7) than those from the Chinese passive continental margin sediments. It indicates that the Chinese mainland was not exclusive sediment contributor for the Hengchun sediments. Combined with the high content of Cr-spinel heavy mineral (mean value ∼ 28.2%) in the Hengchun Miocene sandstones, and the presence of mafic lithic grains and N-MORB-type mafic rocks of 26-22 Ma in the Hengchun Peninsula, it is clear that the subducting South China Sea oceanic lithosphere should be also considered for the origin of the Hengchun sediments. The most likely source of these oceanic clasts being transported to the Hengchun Peninsula is the equivalent prism to the north, which had involved oceanic fragments during the subduction process. Consequently, Taiwan accretionary prism should have been already partly exposed prior to ∼11.6 Ma, considerably earlier than most previous estimates and the onset of arc-continent collision. Underplating of seamounts and/or the thinned Chinese continental margin beneath the overlying Taiwan accretionary prism, together with wedge extrusion tectonics, may have played an important role for this early-stage uplift, which now is also observed in the sandbox experiments, marine observation and analogue modeling. Our study not only better integrates the subduction and then erosion history of the South China Sea oceanic crust with sedimentary records in Taiwan, but also signifies a modern example from Taiwan that highlights the importance of soft exhumation mechanism in worldwide plate convergence zones relative to hard collision.