Low back pain (LBP) is an important condition associated with high healthcare burden. However, the relationship of this condition with physical function (PF) and health-related quality of life (HRQoL) remains unclear. This is a cross-sectional study that aims to investigate the association between presence and intensity of non-chronic LBP with PF and HRQoL in middle-and older-aged adults. Participants answered questions about presence and intensity of LBP in the previous year, self-reported their PF and HRQoL (SF-12), and underwent objective measures of PF ([ExSPPB] including usual gait speed, narrow walk, chair stands, and standing balance), endurance performance ([EP] long-distance corridor walk) and fatigability. Generalized linear models and logistic regression models were performed. A total of 1500 participants (52.5% women, 70.3% white) aged 69.0 (SD 13.1) years were included. Of those, 642 (42.8%) reported LBP and the mean pain intensity was 4.1 (SD 2.2). After adjustments for potential confounders, presence of LBP was associated with lower self-reported PF (OR 1.73, 95% CI 1.27 to 2.37), lower physical component of HRQoL (β -0.03, 95% CI -0.04 to -0.02) and poorer chair stand performance (β -0.05, 95% CI -0.09 to -0.008). Higher intensity of LBP was associated with lower physical component of HRQoL (β -0.01, 95% CI -0.02 to -0.007), poorer ExSPPB performance (β -0.01, 95% CI -0.02 to -0.004), slower usual gait speed (β -0.01, 95% CI -0.02 to -0.004), lower total standing balance time (β -0.01, 95% CI -0.02 to -0.001) and higher fatigability (OR 1.13, 95% CI 1.01 to 1.25). The presence of non-chronic LBP was more consistently associated with lower self-reported PF, while higher intensity non-chronic LBP was associated with poorer objectively measured PF and fatigability. Collectively, this evidence suggests that although presence of pain may affect perception of function, greater pain intensity appears more strongly associated with unfavorable functional performance in mid-to-late life.