This paper concerns the positive singular Yamabe problem (SYP) in the case where the set of singularities is finite. The main result of the paper is the construction of solutions to the SYP for compact manifolds non-degenerate manifolds M that are conformally flat in a neighborhood of the singular set. We use a gluing method to construct solutions to the SYP, by attaching complete non-compact constant scalar curvature Delaunay ends to M with small balls removed.