With the high demand for a healthy diet, it is necessary and important to explore natural sweeteners used in food that enhance palatability but minimize calories. Citrus is considered a good potential source of noncaloric sweeteners, but to date, only one sweetness modulator has been found in this most common fruit crop. Herein, an efficient strategy based on an in-house database and the untargeted and targeted metabolomics analyses was proposed to screen sweeteners or sweet-enhancing compounds from citrus. Eight sweeteners or sweetness-enhancing compounds were screened out, seven of which were newly identified from the genus Citrus. Surprisingly, we identified naturally occurring oxime V, which previously was only known as a synthetic compound. The contents of five compounds, in 11 citrus cultivars or unreleased selections across two production years, were compared. Successful identification of these natural sweeteners and sweetness-enhancing compounds in citrus fruit indicated the potential to identify the relevant biosynthetic pathways and to breed new citrus cultivars containing these compounds that provided both palatability and lower sugar consumption. This study also demonstrated that the proposed metabolomics-based screening strategy could greatly boost the identification of taste modulators with low contents in natural resources.