Radiotherapy is now recognized as a pillar in the fight against cancer. Two different types are currently used in clinical practice: (1) external beam radiotherapy, using high-energy X-rays or electron beams, both in the MeV-range, and (2) intraoperative radiotherapy, using low-energy X-rays (up to 50 keV) and MeV-range electron beams. Versatile detectors able to measure the radiation dose independently from the radiation nature and energy are therefore extremely appealing to medical physicists. In this work, a dosimeter based on a high-quality single-crystal synthetic diamond sample was designed, fabricated and characterized under low-energy X-rays, as well as under high-energy pulsed X-rays and electron beams, demonstrating excellent linearity with radiation dose and dose-rate. Detector sensitivity was measured to be 0.299 ± 0.002 µC/Gy under 6 MeV X-ray photons, and 0.298 ± 0.004 µC/Gy under 6 MeV electrons, highlighting that the response of the diamond dosimeter is independent of the radiation nature. Moreover, in the case of low-energy X-rays, an extremely low limit of detection (23 nGy/s) was evaluated, pointing out the suitability of the device to radiation protection dosimetry.