Electrodermal activity (EDA) is a widely used psychophysiological measurement in laboratory-based studies. In recent times, these measurements have seen a transfer from the laboratory to wearable devices due to the simplicity of EDA measurement as well as modern electronics. However, proper conditions for EDA measurement are recommended once wearable devices are used, and the ambient conditions may influence such measurements. It is not completely known how different types of ambient noise impact EDA measurement and how this translates to wearable EDA measurement. Therefore, this study explored the effects of various noise disturbances on the generation of EDA responses using a system for the simultaneous recording of all measures of EDA, i.e., skin conductance responses (SCRs), skin susceptance responses (SSRs), and skin potential responses (SPRs), at the same skin site. The SCRs, SSRs, and SPRs due to five types of noise stimuli at different sound pressure levels (70, 75, 80, 85, and 90 dB) were measured from 40 participants. The obtained results showed that EDA responses were generated at all levels and that the EDA response magnitudes were significantly (p < 0.001) influenced by the increasing noise levels. Different types of environmental noise may elicit EDA responses and influence wearable recordings outside the laboratory, where such noises are more likely than in standardized laboratory tests. Depending on the application, it is recommended to prevent these types of unwanted variation, presenting a challenge for the quality of wearable EDA measurement in real-world conditions. Future developments to shorten the quality gap between standardized laboratory-based and wearable EDA measurements may include adding microphone sensors and algorithms to detect, classify, and process the noise-related EDA.