Twelve healthy male college-age students were recruited to investigate the effects of different noise exposure conditions on complex task performance and vigilance. During each noise exposure, the Multi-Attribute Task Battery (MATB) with low, medium, and high mental workloads were conducted in the order designated by the Latin square method. Meanwhile, a psychomotor vigilance test (PVT) was used to evaluate human vigilance. Heart rate variability (HRV) signals were also collected while participants performed the tasks. The generalized additive mixed-effect model (GAMM) results showed that the increased mental workload had an inverted U-shaped effect on MATB task performance. Noise exposure had no significant impact on the overall performance of MATB tasks. However, when exposed to increased noise sharpness at low mental workloads, Tracking Task (TRA) performance significantly decreased, whereas the System Monitoring Task (SYS) performance was significantly improved. In addition, higher noise sound pressure level and sharpness would impair human vigilance, which was reflected in a lower mean sample entropy of HRV and worse performance on the PVT. The results indicated that noise control in the workplace should consider both sound pressure level and sharpness.