Vitamin B6-restricted diets and low plasma pyridoxal 5′-phosphate (PLP) status altered plasma polyunsaturated fatty acids (PUFA) compositions. Evidence suggests the role of gender in the metabolism of vitamin B6 and PUFA. However, no epidemiologic study examined the impact of gender on the relationship between vitamin B6 and PUFA status in adults. Thus, we investigated whether there were gender differences in the association of vitamin B6 intake and plasma PLP concentration with plasma PUFA concentrations and ratios (eicosapentaenoic acid (EPA), docosahexaenoic acid (DHA), arachidonic acid (AA), EPA + DHA, EPA/AA, (EPA + DHA)/AA) in US young/middle-aged adults. In total, 864 participants (20–59 years; 484 men, 380 women) from the National Health and Nutrition Examination Survey (NHANES) 2003–2004 were used for this cross-sectional study. Nutrient intakes were estimated from two 24 h recalls and supplement questionnaires; plasma PLP and PUFA were measured. Multivariate linear regression was utilized to obtain unstandardized (b) and standardized (β) coefficients. Covariates included demographic, socioeconomic, dietary variables, physical activity level, cigarette smoking status, alcohol consumption, prescription medication use, and BMI. There were significant interactions between gender and PLP on EPA (P-interaction = 0.004), DHA (P-interaction = 0.020), EPA + DHA (P-interaction = 0.010), EPA/AA (P-interaction = 0.002), (EPA + DHA)/AA (P-interaction = 0.004), whereas no interaction between gender and B6 intake existed. In gender-stratified analyses, in men, PLP was positively associated with EPA (β = 0.138, b = 0.104, p = 0.0004), DHA (β = 0.101, b = 0.058, p = 0.036), EPA + DHA (β = 0.125, b = 0.073, p = 0.005), EPA/AA (β = 0.144, b = 0.099, p = 0.0002), (EPA + DHA)/AA (β = 0.123, b = 0.068, p = 0.005). However, no associations between PLP and PUFA existed in women. In conclusion, gender differences were found in the relationships between plasma PLP and plasma EPA, DHA, EPA + DHA, EPA/AA, and (EPA + DHA)/AA, with significant direct associations in men only among US young/middle-aged adults.