In this study, carbon quantum dots (CQDs) and rhodamine B (RhB) were physically mixed to construct a highly selective and sensitive ratiometric fluorescent sensor (CQDs@RhB) for the quantitative and visual detection of Hg2+. After adding Hg2+, the emission peak of CQDs at 445 nm was quenched and the peak of RhB at 575 nm remained unchanged; the ratio of the two emission peaks had a linear relationship with the Hg2+ concentration. The CQDs@RhB had a detection range of 0–15 µM and the limit of detection (LOD) is 65.93 nM and a color change from blue to pink was visible to the naked eye under ultraviolet light. The study revealed a static quenching mechanism of CQDs@RhB. The established method was successfully applied to the detection of Hg2+ in real water and rice samples with satisfactory results. In addition, a portable fluorescent paper-based sensor platform was developed using computer software assistance. The relationship with Hg2+ concentration was constructed by converting the pictures obtained under ultraviolet light to RGB color mode for visualization and quantitative detection of Hg2+. This study provides a valuable strategy for constructing a rapid detection system for Hg2+ in the field.