Abstract This paper studies the calibration device and method of the gas leakage alarm system, and evaluates the uncertainty of the measurement results. Firstly, it analyzes the important components, parameters, and working principles of the gas leakage alarm system. Then, it designs a set of inhalation-type gas leakage alarm system calibration devices to test the indication error, repeatability, and response time of the alarm system, and evaluates the uncertainty of the calibration device. The study concludes that the relative expanded measurement uncertainty of the device calibrating the alarm system is 2.6%, which meets the accuracy requirements of national standards for calibration devices. The main factors affecting the measurement results are the resolution and repeatability of the alarm system being tested. By improving the performance of the alarm system sensor, the measurement results of the alarm system can be made closer to the true value, reducing misjudgment and improving the accuracy of the system. And during calibration, the measurement capability of the device can be enhanced by using higher grade gas standard substances.