The intersection of disability and aging often presents obstacles and discomfort for older people with disabilities keen to access mainstream opportunities for social participation. Besides individual situations and preferences – disability-based or not – environmental and social factors may limit full access to participation for older people with disabilities. Although ageist and ableist trends of contemporary ideas of aging have been documented, few studies have examined how those discourses are enacted in the field. In the context of participatory action research carried out since 2014 in a seniors' leisure club, we conducted 14 individual interviews with volunteers and seven focus groups with 45 members in order to explore their personal experiences with impairments and disability within the club, whether members who develop impairments can continue to participate and whether prospective new members with different types of impairments would be welcomed. We used an interactionist framework inspired by Goffman's work and based on the concept of stigma to analyze participants' narratives. Results indicate that participation by members with disabilities is seen as unusual, disconcerting and disjunctive. Evidence exposes the stigmatizing practices, encompassing labeling, stereotyping, setting apart and discrimination against members with impairments. Their participation may be acceptable if it does not affect the normal course of activities; otherwise, stigmatizing discourses relegate them to the margins. Because stigma can have an overwhelming impact on the lives and social participation of older people with impairments, stakeholders' awareness should be raised so they can understand it and intervene more effectively.