The recently proposed omnidirectional depth segmentation method (ODSM) has advantages over traditional depth segmentation in terms of robustness and computational costs. However, this method uses at least six fringe patterns and changes their sequences multiple times to perform depth segmentation, which limits its segmentation speed and increases computational complexity. This paper proposes a fast computational depth segmentation (FCDS) method in which only five patterns are used for object segmentation at different depths into isolated regions without the requirement of pattern sequence changing. Phase singularity points are fully utilized due to their significance as depth segmentation markers to extract segmenting lines used for depth determination. Meanwhile, a modified Fourier transform algorithm (MFTA) is introduced to calculate the wrapped phase sequences, which uses two groups of orthogonal phase-shifting fringe patterns and a DC component pattern (five in total). The segmenting lines along orthogonal directions can be extracted with the FCDS method without changing the fringe sequences, which not only solves the problem of phase insensitivity but reduces the calculation costs. Besides, the problem of mis-segmentation is solved with an optimization algorithm for depth segmenting lines and successfully segments objects with abrupt depth changes. The simulation results demonstrate the effectiveness and precision of the proposed method. The experimental results prove the success of the proposed method for segmenting objects of similar color with a segmentation speed that is up to a 120% increase relative to previous methods.