Transgender and gender diverse (TGD) individuals represent a population with a heavy burden of HIV. Multi-level stigma encountered by TGD individuals can create significant barriers to discussing topics related to HIV prevention; however, research on communication between TGD patients and primary care providers (PCPs) about HIV vulnerability and prevention remains limited. This study used in-depth qualitative interviews with 25 TGD patients and 15 PCPs conducted in 2022 to explore perspectives on HIV vulnerability communication during primary care encounters. Overall, 14 of the TGD patients were nonbinary, genderqueer, or another gender identity; all but two participants identified as a sexual minority. The majority of PCPs (n = 11) were physicians. The range of years practicing medicine was between two and 39years. Thematic analysis was used to organize codes and establish themes. Three broad themes regarding factors that facilitate communication regarding HIV vulnerability were identified: (1) focusing on behaviors over identities, (2) conveying impartiality, and (3) acknowledging individuality among TGD patients. Findings corroborate earlier research that identified strengths in providers refraining from behavior-based assumptions tied to a patient's gender identity and sexual orientation and conveying impartial and nonjudgmental attitudes when discussing behaviors that can increase HIV vulnerability. Additionally, these findings underscore the significance of recognizing that, within the TGD community, all persons have unique circumstances, preferences, and needs. Future work should continue to explore the dynamics of HIV vulnerability and prevention discussions, especially among TGD individuals from diverse backgrounds and regions, to identify strategies for strengthening patient-provider communication and reducing vulnerability to HIV.