We explore the reliability of joint angles in road cycling obtained using inertial measurement units. The considered method relies on 3D accelerometer and gyroscope measurements obtained from two such units, appropriately attached to two adjacent body parts, measuring the angle of the connecting joint. We investigate the effects of applying a simple drift compensation technique and an error-state Kalman filter. We consider the knee joint angle in particular, and conduct two measurement trials, a 5 and a 20 minute one, for seven subjects, in a closed, supervised laboratory environment and use optical motion tracking system measurements as reference. As expected from an adaptive solution, the Kalman filter gives more stable results. The root mean square errors per pedalling cycle are below 3.2°, for both trials and for all subjects, implying that inertial measurement units are not only reliable for short measurements, as is usually assumed, but can be reliably used for longer measurements as well. Considering the accuracy of the results, the presented method can be reasonably extended to open, unsupervised environments and other joint angles. Implementing the presented method supports the development of cheaper and more efficient monitoring equipment, as opposed to using expensive motion tracking systems. Consequently, cyclists can have an affordable way of position tracking, leading to not only better bicycle fitting, but to the avoidance and prevention of certain injuries as well.