The 18 mm thick Q235A low carbon steel plates were welded via the ultra-narrow gap metal active gas arc welding (ultra-NGMAGW) and narrow gap submerged arc welding (NGSAW), and the microstructure and mechanical properties of the welded joints' area were characterized. The results showed that there is acicular ferrite (AF) in the weld zone of the joint obtained via the ultra-NGMAGW. The AF grains are fine and have a great difference in growth direction, resulting in high local dislocation density. However, there is no AF in the welded joint obtained via the NGSAW. Using numerical simulation analysis of the temperature field distribution and the thermal cycle curve in the welding process of the ultra-NGMAGW, it was found that the mechanism of microstructure evolution is that during the welding process of the ultra-NGMAGW, the heat input is low, the cooling rate is quick, and the residence time in the high temperature region is short. Therefore, pearlite with coarse grains is basically not formed. AF nucleates in different directions with inclusions as the core. The tensile strength of the weld joint obtained via the ultra-NGMAGW is 643 MPa, which corresponds to 139% of that of the base metal, and 132% of that obtained via the NGSAW. The ultra-NGMAGW joints exhibited better tensile strength and higher microhardness than the NGSAW joints, which is mainly due to the existence of AF.