Existing works on coherence resonance, i.e., the phenomenon of noise-enhanced temporal regularity, focus on excitable dynamical systems such as those described by the FitzHugh-Nagumo equations. We extend the scope of coherence resonance to an important class of dynamical systems: coupled chaotic oscillators. In particular, we show that, when a system of coupled chaotic oscillators is under the influence of noise, the degree of temporal regularity of dynamical variables characterizing the difference among the oscillators can increase and reach a maximum value at some optimal noise level. We present numerical results illustrating the phenomenon and give a physical theory to explain it.