Mode decomposition (MD) based on the matrix operation (MDMO) is one of the fastest mode decomposition methods in fiber laser which has great potential for optical communications, nonlinear optics and spatial characterization applications. However, we found that the image noise sensitivity is the main limit to the accuracy of the original MDMO method, but improving the decomposition accuracy by using conventional image filtering methods is almost ineffective. By using the norm theory of matrices, the analysis result shows that both the image noise and the coefficient matrix condition number determine the total upper-bound error of the original MDMO method. Besides, the greater the condition number, the more sensitive of MDMO method is to noise. In addition, it is found that the local error of each mode information solution in the original MDMO method is different, which depends on the L2-norm of each row vector of the inverse coefficient matrix. Moreover, a more noise-insensitive MD method is achieved by screening out the information corresponding to large L2-norm. In particular, selecting the higher accuracy among the original MDMO method and such noise-insensitive method as the result in a single MD process, a strong anti-noise MD method was proposed in this paper, which displays high MD accuracy in strong noise for both near-filed and far-filed MD cases.