China possesses a substantial capacity for coke production, resulting in the annual generation of over 100 billion standard cubic meters of the by-product coke oven gas. The comprehensive utilization of this gas has emerged as a matter of significant concern within the coking industry. The removal of carbonyl sulfide (COS) from coke oven gas is crucial for enhancing gas quality, mitigating equipment corrosion, minimizing environmental pollution, elevating the quality of recovered products, and fostering the production of high-quality steel. A novel Ca-Ba-γ-Al2O3 catalyst has been devised, employing γ-Al2O3 as the catalyst matrix and integrating calcium hydroxide (Ca(OH)2) alongside barium hydroxide octahydrate (Ba(OH)2·8H2O) as the alkaline activating components. The impact of various factors, including reaction temperature, humidity, and the number of activating components loaded, on the hydrolysis efficiency of COS has been meticulously investigated. Furthermore, the catalytic reaction mechanism has been elucidated utilizing advanced characterization techniques such as X-ray diffraction (XRD) and Brunauer–Emmett–Teller (BET) analysis. The outcomes of this research reveal that, under optimal conditions of a reaction temperature of 55 °C and a humidity of 56%, the Ca-Ba-γ-Al2O3 catalyst achieves a remarkable COS hydrolysis efficiency of 95.22%.