Abstract The Coupled Dark State Magnetometer (CDSM) is an optically pumped magnetometer. For the Jupiter Icy Moons Explorer (JUICE) mission, the CDSM and two fluxgate magnetometers are combined in the J-MAG instrument to measure the static and low frequency magnetic field in the Jupiter system. During certain calibration manoeuvres, the CDSM has to be able to measure magnetic field strengths down to 100 nT with an accuracy of 0.2 nT (1 σ). At such low magnetic fields, the CDSM’s operational parameters must be carefully selected to obtain narrow resonance structures. Otherwise, the coupled dark state resonances, used for the magnetic field detection in different instrument modes, overlap and result in a systematic error. In this paper we demonstrate that with the found instrument settings the CDSM is able to measure magnetic field strengths below 100 nT with a systematic error less than 0.2 nT resulting from the overlap of the resonances.