Bimetallic surfaces allow tailoring their catalytic activity by modifying their composition and/or structure. However, under operating conditions, catalytically active bimetallic structures are often not stable and change their morphology which might reduce their functionality. Still, catalytically active structures do not necessarily need to be thermodynamically stable and might also be kinetically stabilized. Here we report kinetic Monte Carlo simulations based on density functional theory calculation to address the meta-stability of surface alloy systems. As structural changes can typically only occur via vacancy diffusion in the surface, we first determine the vacancy diffusion barrier as a function of their bimetallic environment. By determining the temporal evolution of the bimetallic surface alloys as a function of temperature, we analyze the factors underlying the stability and structure of the bimetallic surface alloys.