Growing industry and shifting environmental regulations have made chimneys taller and more flexible, thus making them susceptible to wind forces. Consequently, it becomes necessary to analyze the chimney for undesired wind force causing vortex induced vibration (VIV) and to enhance their performance by the implementation of appropriate countermeasures. In this study, three passive control devices, namely, tuned mass inerter system (TMIS), tuned mass damper (TMD) and multi-tuned mass damper (MTMD), are used to control the VIV of high-rise chimneys. The TMIS comprises a mass element, spring, damper, and inerter subsystem. The MTMD is distributed over the top one-third height of the chimney. The three control devices control the response of the chimneys under random vortex induced forces, and their relative performances are evaluated. The modal spectral analysis and Genetic Algorithm are employed to establish a method for optimizing the damper-structure system for VIV control. The response analysis duly considers the effect of the nonlinear aero-elastic effect. The novelty of the paper lies in the application of TMIS for chimney subjected to vortex induced vibration and comparing its results with other traditional dampers (TMD and MTMD) for the three chimneys of height 120 m, 210 m, and 360 m of varying diameter, taken as illustrative examples. In addition, the study examines the impact of different mass ratios and the mass of the inerter on chimneys. For the three chimneys considered, it is observed that the performance of the TMD is best among the three control techniques adopted. For the tallest chimney (360 m), all three control devices display an optimum mass ratio for which the response reduction is maximum. The performance of the TMIS improves with the increased height of the chimney.