Sedimentological and zircon U–Pb–Hf isotopic analyses of the Carboniferous strata in the Bainaimiao arc belt (BAB) provide provenance information for the northern margin of the North China Craton (NCC). The late Carboniferous strata in the eastern BAB were dominantly shallow marine carbonate-clastic deposits. Detrital zircon data show that: (1) sandstone from lower Sidaozhangpeng Formation displays two major age peaks of 369 Ma and 2522 Ma, with eHf (t) values of − 25.9 to − 20.4 and 2.2–6.4, respectively; (2) sandstone from upper Sidaozhangpeng Formation shows a significant age peak at 384 Ma, with eHf (t) values of − 25.3 to − 14.5. Determination of detrital zircon parent rock types based on trace element proxies suggests that the protolith rock types consist of felsic (73%) and mafic rocks (22%), with minor alkaline rocks (5%), implying a continental arc setting. The U–Pb–Hf dating of the Carboniferous strata in the western and eastern BAB shows different provenances: the Carboniferous sediments in the western BAB were derived from early Paleozoic magmatic rocks, micro-block (Hunshandake Block) and the NCC basement; the provenances of the Carboniferous strata from the eastern BAB were mainly local Devonian magmatic rocks, with subordinate input of the Neoarchean NCC basement rocks. The early Paleozoic zircon grains recorded by the early Devonian rhyolitic tuff and late Carboniferous sandstone indicate that the early Paleozoic arc magmatic activities also occurred in the eastern BAB.