The unsatisfactory crystalline quality of the absorber layer has seriously impeded the development of kesterite photovoltaic devices, including a small grain size, a typical multi-layer structure, and inherent defects and defect clusters. Herein, we simultaneously modify the nature of the absorber bulk and the heterojunction interface by sputtering quaternary alloy targets and subsequent selenium-free annealing to improve the photovoltaic performance of Cu2ZnSnSe4 (CZTSe) solar cells. By adjusting the sputtering power, the elemental content and distribution in the precursor film are effectively controlled, which helps to obtain a single-layer large grain CZTSe absorber layer with better homogenization and compactness. The harmful inherent defects are significantly suppressed by such a modification. Simultaneously, the widened depletion width and enhanced built-in electric field, as well as improved band alignment at the heterojunction, enhance carrier collection. As a consequence, the efficiency of CZTSe solar cells has improved greatly from 6.91% to 10.12%. The single-target preparation strategy without selenization provides a simple and novel perspective for simultaneously adjusting the morphology and defects of kesterite photovoltaic materials, paving the way for promoting innovative industrial applications.