Pathological biomarkers of Alzheimer's disease (AD) and other dementias can change decades before clinical symptoms. Lifestyle and health factors might be relevant modifiable risk factors for dementia. Many previous studies have been focusing on associations of lifestyle and health-related factors with clinical outcomes later in life. We aimed to determine to what extent midlife factors of lifestyle, inflammation, vascular, and metabolic health were associated with long-term changes in blood-based biomarkers of AD (amyloid beta (Aβ)) and neurodegeneration (neurofilament light chain (NfL); total tau(TTau)). In 1,529 Beaver Dam Offspring Study (BOSS) participants (mean age 49 years, standard deviation (SD) = 9;54% were women), we applied mixed-effects models with baseline risk factors as determinants and 10-year serum biomarker change as outcomes. We found that education and inflammatory markers were associated with levels and/or change over time across all three markers of AD and neurodegeneration in the blood. There were baseline associations of measures of cardiovascular health with lower Aβ42/Aβ40. TTau changed little over time and was higher in individuals with diabetes. Individuals with lower risk in a number of cardiovascular and metabolic risk factors, including diabetes, hypertension, and atherosclerosis had slower accumulation of neurodegeneration over time, as determined by NfL levels. Various lifestyle and health factors, including education and inflammation, were associated with longitudinal changes of neurodegenerative and AD biomarker levels in midlife. If confirmed, these findings could have important implications for developing early lifestyle and health interventions that could potentially slow processes of neurodegeneration and AD.