Diffusion magnetic resonance imaging, a non-invasive tool to infer white matter fiber connections, produces a large number of streamlines containing a wealth of information on structural connectivity. The size of these tractography outputs makes further analyses complex, creating a need for methods to group streamlines into meaningful bundles. In this work, we address this problem by proposing a set of flexible and efficient streamline clustering approaches based on kernel dictionary learning and sparsity priors. Proposed approaches, which include L0 norm, group sparsity, and manifold regularization prior, allow streamlines to be assigned to more than one bundle, making the clustering more robust to overlapping bundles and inter-subject variations. We evaluate the performance of our method on an expert labeled dataset as well as data from the Human Connectome Project. Results highlight the ability of our method to group streamlines into plausible bundles and illustrate the impact of sparsity priors on the performance of the proposed methods. Methods presented in this work are relevant for the neuroscience studies on diffusion tractography analysis, as well as pattern recognition applications requiring the unsupervised clustering of 3D curves.