The reactive nitrogen species (RNS) in lysosomes play a major role during the regulation of lysosomal microenvironment. Nitroxyl (HNO) belongs to active nitrogen species (RNS) and is becoming a potential diagnostic and therapeutic biomarker. However, the complex synthesis routes of HNO in biosystem always hinder the exact determination of HNO in living cells. Here, a rhodamine-based fluorescent probe used to determine nitroxyl (HNO) in lysosomes was constructed and synthesized. 2-(Diphenylphosphino)benzoate was utilized as the sensing unit for HNO and morpholine was chose as the targeting group for lysosome. Before the addition of HNO, the probe displayed a spirolactone structure and almost no fluorescence was found. After the addition of HNO, the probe existed as a conjugated xanthene form and an intense green fluorescence was observed. The fluorescent probe possessed fast response (3 min) and high selectivity for HNO. Furthermore, fluorescence intensity of the probe linearly related with the HNO concentration in the range of 6.0 × 10−8 to 6.0 × 10−5 mol L−1. The detection limit was found to be 1.87 × 10−8 mol L−1 for HNO. Moreover, the probe could selectively targeted lysosome with excellent biocompatibility and had been effectually utilized to recognize exogenous HNO in A549 cells.