Abstract Background Few previous cohorts have studied the different type of physical activities and the degree of cognitive decline. The objective of this work was to analyze the leisure, domestic and professional activities with mild and moderate cognitive disorders in older people living in community. Methods The study used data from the longitudinal and observational study, FrèLE (FRagility: Longitudinal Study of Expressions). The collected data included: socio-demographic variables, lifestyle, and health status (frailty, comorbidities, cognitive status, depression). Cognitive decline was assessed by using: MMSE (Mini-Mental State Examination) and MoCA (Montreal Cognitive Assessment). MoCA was used with two cut-offs (26 and 17) so as to define mild and moderate cognitive disorders Physical activity was assessed by the PASE (Physical Activity Scale for the Elderly), structured in three sections: leisure, domestic and professional activities. Spline and proportional hazards regression models (Cox) were used to estimate the risk of cognitive disorders. Results At baseline, 1623 participants were included and the prevalence of cognitive disorders was 6.9% (MMSE) and 7.2% (MoCA), mild cognitive disorders was 71.3%. The mean age was 77 years, and 52% of the participants were women. After a 2 years long follow-up, we found 6.9% (MMSE) and 6% (MoCA) cognitive disorders on participants. Analyses showed that domestic activities were associated to cognitive decline (HR = 0.52 [0.28-0.94] for MMSE and HR = 0.48 [0.28-0.80] for MoCA). No association were found with leisure and professional activities, and no spline were significant with mild cognitive disorders. Conclusions Analysis showed a relationship between cognitive disorders and type of physical activity, thanks to the use of specific questionnaire of elderly and two global test of cognition. These findings will contribute to the debate on the beneficial effects of physical activity on cognition. Key messages This work allowed to compare two test of cognition and their link with physical activity. It contributes to the debate on the beneficial effects of physical activity on cognition. The work allowed us to see the effect of the different types of physical activity and the impact of the statistical method on the results.