PurposeThe aim of this study is to determine the validity of consumer grade step counter devices during the early recovery period after knee replacement surgery.MethodsTwenty-three participants wore a Fitbit Charge or Apple Watch Series 4 smart watch and performed a walking test along a 50-metre hallway. There were 9 males and 14 females included in the study with an average age of 68.5 years and BMI of 32. Each patient wore both the Fitbit Charge and Apple Watch while completing the walking test and an observer counted the ground truth value using a thumb-push tally counter. This test was repeated pre-operatively with no gait aid, immediately post operatively with a walker, at 6 weeks follow up with a cane and at 6 months with no gait aid. Bland-Altman plots were performed for all walking tests to compare the agreement between measurement techniques.ResultsMean overall agreement of step count for pre-operative and at 6 months for subjects walking without gait aids was excellent for both the Apple Watch vs. actual and Fitbit vs. actual with bias values ranging from − 0.87 to 1.36 with limits of agreement (LOA) ranging between − 10.82 and 15.91. While using a walker both devices showed extremely little agreement with the actual step count with bias values between 22.5 and 24.37 with LOA between 11.7 and 33.3. At 6 weeks post-op while using a cane, both the Apple Watch and Fitbit devices had a range of bias values between − 2.8 and 5.73 with LOA between − 13.51 and 24.97.ConclusionsThese devices show poor validity in the early post operative setting, especially with the use of gait aids, and therefore results should be interpreted with caution.