Cross-domain collaborative filtering (CDCF) is an effective solution to alleviate the data sparsity problem. Most of existing CDCF methods rely on overlapping data, such as users, items or both. But in some realistic scenes, detection and accessibility of overlapping data are difficult or even impossible, which poses a pressing demand for researches on cross-domain recommendation without overlapping data. There actually have been some attempts on addressing this problem by sharing cluster-level rating pattern across source and target domains. But these solutions require explicit ratings, which makes them not suitable for more common implicit feedback recommendation. To address this problem, we propose a novel CDCF model for non-overlapping data scenarios, which adaptively extracts latently overlapping users of source and target domains from all users to build an implicit bridge for knowledge transfer. Specifically, we first design a self-supervised classifier guided by inter-domain contrastive learning to divide domain users into distinct groups based on their preference differences. Then, we perform graph convolution operations on the subgraph formed by such group users and their interactive items to explicitly mine the higher-order collaborative relationships between users and items. Finally, we construct sparse and reasonable implicit bridges between domains by designing flow-aware similarity measures for selective knowledge transfer among the extracted latently overlapping users. Extensive experiments on four public datasets demonstrate the superior performance of our proposed model over several state-of-the-art graph-based single- and cross-domain models.