Research shows a reduced responsivity to implicit as well as explicit facial emotion recognition (emotional dampening) in prehypertensives and hypertensives. This study explored auditory and audiovisual emotion recognition in prehypertensives and hypertensives. Participants (N = 175) who were normotensives, prehypertensives, and hypertensives (n = 57, 58, and 60, respectively) completed an auditory implicit task (matching auditory target with auditory distractors) and two cross-modal implicit tasks (matching visual target with auditory distractors, and vice-versa), and an auditory explicit task (labelling emotions in audio-clips). Findings showed an aberrant speed-accuracy trade-off, where prehypertensives focused more on accuracy at the cost of speed while hypertensives showed the opposite. Discriminant function analysis revealed that blood pressure (BP)-associated emotional dampening is a highly specific but moderately sensitive correlate of hypertension. Our study highlights that prehypertensives and hypertensives demonstrate emotional dampening in implicit (but not explicit) auditory emotion recognition and a greater deficit for auditory than visual recognition of implicit emotions. Findings show emotional dampening as an observable correlate of elevated BP and hypertension.