Noise usually affects the reliability of quantitative analysis in diffusion-weighted (DW) magnetic resonance imaging (MRI), especially at high b-values and/or high spatial resolution. Higher-order singular value decomposition (HOSVD) has recently emerged as a simple, effective, and adaptive transform to exploit sparseness within multidimensional data. In particular, the patch-based HOSVD denoising has demonstrated superb performance when applied to T1-, T2-, and proton density-weighted MRI data. In this study, we aim to investigate the feasibility of denoising DW data using the HOSVD transform. With the low signal-to-noise ratio in typical DW data, the patch-based HOSVD denoising suffers from stripe artifacts in homogeneous regions because of the HOSVD bases learned from the noisy patches. To address this problem, we propose a novel denoising method. It first introduces a global HOSVD-based denoising as a prefiltering stage to guide the subsequent patch-based HOSVD denoising stage. The HOSVD bases from the patch groups in prefiltered images are then used to transform the noisy patch groups in original DW data. Experiments were performed using simulated and in vivo DW data. Results show that the proposed method significantly reduces stripe artifacts compared with conventional patch-based HOSVD denoising methods, and outperforms two state-of-the-art denoising methods in terms of denoising quality and diffusion parameters estimation.