This study examines the extent of exposure to verbal violence experienced by people with intellectual disabilities and whether it differs based on their housing situation: living in the community, with family, or in a residential facility. One hundred and eighty-nine people with intellectual disabilities were interviewed about their experience with verbal violence. Eighty-six percent reported experiencing verbal violence in their lifetime and approximately 77% experienced it the past week. Participants were most likely to be yelled at, and friends were the most common perpetrators. While there were few differences by setting, people living with their families were more likely to be laughed at and marginally more likely to experience rude comments. Verbal violence is prevalent in the lives of people with intellectual disabilities in Israel. Interventions are necessary to assist people with intellectual disabilities to deal with such incidents, with possible additional supports needed for those living with family.