Fault samples of marine engine are extremely scarce, and there are unavoidably some hard samples with small inter-class differences, which pose a serious challenge to fault diagnosis of marine engines. This paper proposes a deep metric learning method, namely deep concentric Siamese network (DCSN), to apply strong forces to hard samples towards their corresponding correct distribution areas under small-sample conditions. First, DCSN is committed to learn discriminative information from limited fault samples through a carefully designed metric learning strategy. Then, DCSN distinguishes hard samples using inner and outer boundaries, and applies strong forces to them, making the deep model more focusing on the correct classification of hard samples. Third, DCSN shrinks the distribution area of intra-class samples, which improves intra-class compactness and inter-class separability. Finally, the experimental results on the marine engine fault dataset show that the proposed DCSN yields higher diagnostic performance compared to the considered competitive methods.