Bragg reflectors are essential for beam transport in X-ray free-electron laser (XFEL) facilities. On interaction with Bragg reflectors, a part of the pulse energy will be absorbed, causing the propagation of displacement waves due to rapid thermal expansion. It is suspected that these waves may cause stability problems for XFELs operating with megahertz repetition rates. Here, we experimentally investigate the displacement of a diamond Bragg reflector induced by an optical ultra-violet laser pulse, simulating XFEL pulses with mJ pulse energy, both at room temperature and cryogenic temperatures. Our experiment shows negligible damping of the displacement waves on µs timescales, which could cause disruption for subsequent XFEL pulses. We compare our measurements to a simulation framework based on the assumptions of local thermodynamic equilibrium and classical mechanics, observing reasonable agreement. Our results show that thermoelastic effects are critical for a reliable stability assessment of Bragg reflectors, but are often overlooked.