Cystic fibrosis (CF) is a life-threatening genetic disease. At present, the common method for diagnosis of CF is to detect the chloride concentration in sweat using ion-selective electrodes. However, the current sweat testing methods require a relatively large quantity of sweat sample, at least 25 µL, which is very difficult to obtain, especially for newborns. This paper presents a new method and a new device for rapid detection of the chloride concentration from a small volume of solution. In this method, the chloride concentration is determined quantitatively by the fluorescence intensity of MQAE, a chloride ion fluorescent indicator. In this device, the sample is carried by a small piece of filter paper on a cover glass exposed to an UV LED light source. The resulting fluorescent signals are detected by a Si photodiode. Data acquisition and processing are accomplished by LabVIEW software in a PDA. Based on the Stern–Volmer relationship, the effects of different parameters on the fluorescence intensity were analyzed. The observed significant difference between 40 and 60 mM (the borderline of chloride concentration for CF) is discussed in this paper. The results show that detection can be completed within 10 s. The minimum detectable volume of the chloride solution is 1 μL. The novel method and the device are of great potential for CF diagnosis.