In this paper, we propose a fast Line Segment Detection algorithm for Polarimetric synthetic aperture radar (PolSAR) data (PLSD). We introduce the Constant False Alarm Rate (CFAR) edge detector to obtain the gradient map of the PolSAR image, which tests the equality of the covariance matrix using the test statistic in the complex Wishart distribution. A new filter configuration is applied here to save time. Then, the Statistical Region Merging (SRM) framework is utilized for the generation of line-support regions. As one of our main contributions, we propose a new Statistical Region Merging algorithm based on gradient Strength and Direction (SRMSD). It determines the merging predicate with consideration of both gradient strength and gradient direction. For the merging order, we set it by bucket sort based on the gradient strength. Furthermore, the pixels are restricted to belong to a unique region, making the algorithm linear in time cost. Finally, based on Markov chains and a contrario approach, the false alarm control of line segments is implemented. Moreover, a large scene airport detection method is designed based on the proposed line segment detection algorithm and scattering characteristics. The effectiveness and applicability of the two methods are demonstrated with PolSAR data provided by UAVSAR.