Abstract The mufti-angle imaging technique is proposed to address the wall position offset and the side flaps and gate flaps caused by the sparse array in the ultra-wide band through-wall radar building layout imaging, using the characteristic that the azimuth upward distance profile is similar around the main flap but different around the side flap/gate flap. Firstly, after the backward projection algorithm obtains the wall image of each viewpoint, the mufti-directional two-dimensional matching filter is used to enhance the image of each viewpoint and eliminate the effect of side flaps and raster flaps. Then the images of each viewpoint are decomposed by combining the multistage transform, i.e., the non-down sampling contour let transform, and the obtained low-frequency components and high-frequency components are fused using the corresponding fusion rules, respectively. Finally, the final fused building layout image is obtained by non-down sampling contour let inverse transform. The simulation experimental data show that the running time of the method in this paper is 10.99s. It shows that the proposed method enhances the outline and detail information of the building wall, and the final fused image obtained has prominent wall image, clearer edge contours, and good retention of overall detail information. The quality of image fusion is greatly improved than other methods, which paves the way for subsequent fusion methods including chatterers such as construction building corners and windows and doors.