It is a common practice for chemical refinery tail gases to be treated in an incinerator and then released into the atmosphere. However, tail gas combustion is a key component in ensuring that the treatment process meets the relevant standards. In this paper, a vertical tail gas incinerator gas premixing structure design is proposed, aiming to improve the gas mixing effect. Based on the basic structure of the right-hand gas distribution pipe and the single-layer fan mixer at the throat, three new structures are proposed. The five new gas-premixing structures were combined into eight new structures. A series of numerical simulations were performed for one prototype premixed structure and five new premixed structures, respectively. The gas premixing structures were screened, evaluated, and optimized using gas mixing inhomogeneity and pressure loss as control parameters. Finally, the premixing structure with the best combination for the mixing unit was selected. This study is of great significance for improving the effectiveness of tail gas incineration in chemical refineries and protecting the ecological environment.