The dominant narrative on caste today asserts that the people belonging to the Scheduled Castes or “Dalits” and Scheduled Tribes or “Tribals” face pervasive and disproportionately more violence. The situation is considered further accentuated by the alleged “caste bias” against these communities in the police and the judiciary. The stringent legal provisions passed by the Indian Parliament, specifically to address crimes against these communities, have been presented as ineffectual or insufficient in curbing this violence. The official crime statistics are often cited as supporting these claims. However, a closer look at this data on crimes against SCs and STs, including the rates of crimes, court convictions and pendency, shows that these popular claims are not based on the evidence that the data provides. Further, a scrutiny of the claims itself reveals serious conceptual problems, fallacies, and errors. This article, while analyzing the currently available data on crimes against SCs and STs, also traces the source of the problems that have marred their understanding and interpretation. We specifically look at the evolution of the word ‘atrocity’ in the context of caste, how the term acquired a strange definition, how it came to mediate the understanding of caste violence and the collection of crime statistics, and how its usage is incredibly loaded to prove the point that there is excessive violence against SCs and STs.