This study examined the relationship between perceived stigma in healthcare settings during pregnancy and psychological distress and well-being in the postpartum period among individuals who took opioids while pregnant. Analyses included 134 birth mothers of opioid-exposed infants. At 0–1 months postpartum, perceived stigma and psychological distress were measured using the Prenatal Opioid use Perceived Stigma scale and measures from the Patient-Reported Outcome Measurement Information System (PROMIS). Food insecurity, housing instability, and Adverse Childhood Experiences (ACEs) were also assessed. Linear and generalized linear mixed-effect models were conducted to compare PROMIS scale scores and unmet needs by stigma, adjusting for site/location, age, race/ethnicity, marital status, education, public insurance, and parity. More than half of participants (54%) perceived stigma in healthcare settings. Individuals reporting stigma had higher depression, anxiety, and anger scores (p < 0.001) indicating greater psychological distress in the postpartum period compared to those reporting no stigma, after controlling for demographic characteristics. In addition, they scored significantly lower on the PROMIS meaning and purpose scale, an indicator of well-being (p = 0.002). Those reporting stigma were more likely to have food insecurity (p = 0.003), three or more ACEs (p = 0.040), verbal or physical abuse during pregnancy (p < 0.001), and less emotional support (p = 0.006) than those who did not. An association was observed between perceived stigma in the prenatal period and psychological distress in the postpartum period, providing support for stigma reduction interventions and education for healthcare providers on trauma-informed care.