The motion of particles along channels of finite width is known to be hindered by either the presence of energy barriers along the channel direction or by variations in the width of the channel in the transverse direction (rugged channel). Remarkably, when both features are present, they can interact to produce a counterintuitive result: adding energy barriers to a rugged channel can enhance the rate of diffusion along it. This is the result of competing energetic and entropic effects. Under the approximation of particles instantaneously in equilibrium in the transverse direction, one can tailor the energy barriers to the ruggedness to recover free diffusion. However, such fine-tuning and potentially restrictive approximations are not necessary to observe an enhanced rate of diffusion as we demonstrate by adding a range of (non-fine-tuned) energy barriers to a channel of sinusoidally varying curvature. Furthermore, this was observed to hold for systems with a finite characteristic timescale for motion in the transverse direction, thus, suggesting that the phenomenon lends itself to be exploited for practical applications.