Airborne LiDAR point clouds classification has been a challenging task due to the characteristics of point clouds and the complexity of the urban environment. Recently, methods that directly act on unordered point set have achieved satisfactory results in point clouds classification. However, the existing methods that directly consume point clouds pay little attention to the interaction between the deep layers, which makes the feature learning insufficient in complex environments. In this paper, we propose a deep neural network for semantic labeling task. It iteratively learns deep features in a hierarchical structure, and provides a simple but efficient way to make interactions between different hierarchical levels. Since iteration process will greatly increase the number of layers, we employ the residual network to improve the performance. In addition, we also introduce dilated k-nearest neighbors and multi-scale grouping to increase the receptive field. The experiments on both Vaihingen 3D dataset and Dayton Annotated LiDAR Earth Scan (DALES) dataset demonstrate the effectiveness of the proposed method in point cloud classification.