Different regions have established traffic noise prediction models to adapt to their particular environmental characteristics. This paper aimed to develop a traffic noise prediction model for mountainous cities. In China, the traffic noise prediction model HJ 2.4-2009, which itself is based on the sound pressure level corrected for roadway gradients (RGs), has been receiving widespread acceptance. On the basis of the model in HJ 2.4-2009, the RG correction coefficient was proposed to modify the original model and a per-vehicle noise prediction model was built using a multilayer feedforward artificial neural network (ANN) model. The data collected from a municipal road of a hilly city, Chongqing, was used to train and validate the ANN model. The predictor variables comprised the per-vehicle noise value, vehicle type, vehicle velocity, and roadway gradient. The results showed that the modified HJ 2.4-2009 model incorporating the gradient correction coefficient achieved a significantly higher R2 for mountainous cities than the original model. Besides, the ANN-based noise prediction model achieved considerable accuracy improvement over the empirical predictive equations.