Road Tunnels are an important part of the current road transportation infrastructure. As the main form of tunnel lining diseases, cracks are easy to interact with other areas, which seriously affects the safe operation of the tunnel. Due to the similarity of brightness and linearity between surface cracks and lining cracks, the existing crack detection algorithms can not extract cracks accurately and quickly. An algorithm of lining seam crack elimination with rectangular mark is proposed here. First, the line segments in the image are detected by the Line Segment Detector algorithm based on the coarse percolation detection of the crack. Second, the distribution directions are calculated, and cracks from the lining seams are distinguished by the adaptive threshold judgment method. Third, by using the distribution characteristics of pixels, the line segments are extended to form rectangular marks perpendicular to the direction of lining seams. Finally, the marking information is used to remove the lining joints and obtain the real surface cracks of tunnel lining. Experimental results show that the algorithm can quickly and effectively remove any shape distribution of lining seam. The algorithm fills in the blank of concrete tunnel lining surface crack detection technology.