We use twist deformation techniques to analyze the behavior under area-preserving diffeomorphisms of quantum averages of Wilson loops in Yang-Mills theory on the noncommutative plane. We find that while the classical gauge theory is manifestly twist covariant, the holonomy operators break the quantum implementation of the twisted symmetry in the usual formal definition of the twisted quantum field theory. These results are deduced by analyzing general criteria which guarantee twist invariance of noncommutative quantum field theories. From this a number of general results are also obtained, such as the twisted symplectic invariance of noncommutative scalar quantum field theories with polynomial interactions and the existence of a large class of holonomy operators with both twisted gauge covariance and twisted symplectic invariance.