Graphene, with its zero-bandgap electronic structure, is a highly promising ultra-broadband light absorbing material. However, the performance of graphene-based photodetectors is limited by weak absorption efficiency and rapid recombination of photoexcited carriers, leading to poor photodetection performance. Here, inspired by the photogating effect, we demonstrated a highly sensitive photodetector based on graphene/WSe2 vertical heterostructure where the WSe2 layer acts as both the light absorption layer and the localized grating layer. The graphene conductive channel is induced to produce more carriers by capacitive coupling. Due to the strong light absorption and high external quantum efficiency of multilayer WSe2, as well as the high carrier mobility of graphene, a high photocurrent is generated in the vertical heterostructure. As a result, the photodetector exhibits ultra-high responsivity of 3.85 × 104 A/W and external quantum efficiency of 1.3 × 107%. This finding demonstrates that photogating structures can effectively enhance the sensitivity of graphene-based photodetectors and may have great potential applications in future optoelectronic devices.