A low-cost, portable bioluminescence detector based on a silicon photomultiplier (SiPM) was developed for on-site colony detection, the main components of which are a low-noise photoelectric signal detection and processing circuit, power management module, and high-performance embedded microcontroller subsystem with peripheral circuits. Balanced chopper modulation and lock-in amplification techniques were adopted to improve the signal-to-noise ratio, and a zero-adjustment technique was used to eliminate the dark current of the SiPM to expand the dynamic range. Using this bioluminescence detector, adenosine triphosphate could be determined in the range of 3.6 × 10−6 to 3.6 × 10−11 mol/L, and bacterial colonies could be determined in the range of 1.0 × 103 to 1.0 × 109 CFU/mL, with a limit of quantitation of 1.0 × 103 CFU/mL. Satisfactory recoveries and precision were obtained. Actual samples were accurately tested and the data were verified by comparison with those from the national standard method. The manufacturing cost of the bioluminescence detector was only $30, which is only approximately 1% of the price of current commercial instruments. This study provides a tool for rapid on-site detection of bacterial colonies, as well as a new concept for the development of low-cost portable detection equipment.