4H-SiC avalanche photodiodes (APDs) working in Geiger mode are promising devices for ultra-weak ultraviolet light detection. In this letter, the degree of avalanche uniformity across device mesa of 4H-SiC p-i-n APDs is studied by imaging hot carrier luminescence pattern of the devices in avalanche regime. It is found that the luminescence emission from the APD under avalanche always first appears in the [ $\overline 1 \overline 1 20$ ] side of the top contact electrode. As over-bias increases, the luminescence pattern gradually extends toward the [ $11\overline 2 0$ ] direction and finally covers the whole device mesa. A physical model is proposed to explain the non-uniform avalanche phenomenon, in which the substrate off-orientation related carrier lateral drift would cause asymmetric hole accumulation and screening of junction electrical field along the [ $11\overline 2 0$ ] direction.