Since the early 20th century, many studies have been conducted about the noise characteristics of trains, particularly in regards to annoyance. However, none of the studies considered the frequency dependence of short-term annoyance of railway noise. Moreover, none of the studies was performed to observe the change of the annoyance using sound quality metrics when the frequency component of railway noise was modified. Thus, in the current study, after experimentally confirming the validity of using sound quality metrics as assessment units, the frequency dependence of short-term annoyance was investigated that included sound quality metrics based on frequency-modified ‘conventional’ railway noise. Three experiments were conducted on the study. In the first experiment, 50 participants determined the words most suitable to represent the quantity of railway noise, and the metrics that were expected to be most relevant to railway noise were identified. Using the results from the first experiment, 50 participants estimated the magnitude of subjective loudness, subjective sharpness, and the annoyance of the railway noise to verify the reasonability of using sound quality metrics as the assessment units of estimating the frequency dependence. From the results of the second experiment, it was determined that the subjective factors and the calculated factors had clear linear relationships, and it was identified that sound quality metrics can be used to determine the frequency dependence of short-term annoyance of the railway noise. In the third experiment, 50 participants estimated the upper and lower limits of hearing perception of subjective loudness of the railway noise to identify the frequency sensitivity of participants to the railway noise. Finally, case studies were conducted on short-term annoyance model using multiple regression method, which confirmed the frequency dependence of the annoyance of the railway noise.