Grinding of workpieces from hardened steel, especially in case of safety relevant components, usually requires a reliable method for the detection of thermo-mechanical surface damages. Compared to the common post-process methods, in-process detection promises saving of detection time and, particularly, a fast reaction to negative influences on the surface integrity. The present work shows the suitability of magnetic Barkhausen noise (BN) for the in-process detection of thermo-mechanically influenced regions during an outer diameter cylindrical grinding process. Different from other non-destructive inspection methods, BN allows the detection of changes of the residual stress state even before the occurrence of visible tempering zones. However, in case of pronounced tempering or rehardening zones, a single BN value does not enable an unambiguous statement about the surface state. Therefore, additionally the specific grinding power Pc” in dependence of the contact time Δt is considered, which allows to exclude grinding burn starting from light tempering zones. A particular focus of this study is the BN analysis during grinding with different types of grinding wheels.