The microstructure of concrete can be affected by many factors, from non-destructive environmental factors through to destructive damage induced by transient stresses. Coda wave interferometry is a technique that is sensitive enough to detect weak changes within concrete by evaluating the ultrasonic signal perturbation compared to a reference state. As concrete microstructure is sensitive to many factors, it is important to separate their contributions to the observables. In this study, we characterize the relationships between the concrete elastic and inelastic properties, and temperature and relative humidity. We confirm previous theoretical studies that found a linear relationship between temperature changes and velocity variation of the ultrasonic waves for a given concrete mix, and provide scaling factors per Kelvin for multiple settings. We also confirm an anti-correlation with relative humidity using long-term conditioning. Furthermore, we explore beyond the existing studies to establish the relationship linking humidity and temperature changes to ultrasonic wave attenuation.