We present and analyse a numerical method for understanding the low-inertia dynamics of an open, inextensible viscoelastic rod - a long and thin three dimensional object - representing the body of a long, thin microswimmer. Our model allows for both elastic and viscous, bending and twisting deformations and describes the evolution of the midline curve of the rod as well as an orthonormal frame which fully determines the rod's three dimensional geometry. The numerical method is based on using a combination of piecewise linear and piecewise constant finite element functions based on a novel rewriting of the model equations. We derive a stability estimate for the semi-discrete scheme and show that at the fully discrete level that we have good control over the length element and preserve the frame orthonormality conditions up to machine precision. Numerical experiments demonstrate both the good properties of the method as well as the applicability of the method for simulating undulatory locomotion in the low-inertia regime.