To obtain high-resolution velocity fields of cerebrospinal fluid (CSF) and cerebral blood flow by applying a physics-guided neural network (div-mDCSRN-Flow) to 4D flow MRI. The div-mDCSRN-Flow network was developed to improve spatial resolution and denoise 4D flow MRI. The network was trained with patches of paired high-resolution and low-resolution synthetic 4D flow MRI data derived from computational fluid dynamic simulations of CSF flow within the cerebral ventricles of five healthy cases and five Alzheimer's disease cases. The loss function combined mean squared error with a binary cross-entropy term for segmentation and a divergence-based regularization term for the conservation of mass. Performance was assessed using synthetic 4D flow MRI in one healthy and one Alzheimer' disease cases, an in vitro study of healthy cerebral ventricles, and in vivo 4D flow imaging of CSF as well as flow in arterial and venous blood vessels. Comparison was performed to trilinear interpolation, divergence-free radial basis functions, divergence-free wavelets, 4DFlowNet, and our network without divergence constraints. The proposed network div-mDCSRN-Flow outperformed other methods in reconstructing high-resolution velocity fields from synthetic 4D flow MRI in healthy and AD cases. The div-mDCSRN-Flow network reduced error by 22.5% relative to linear interpolation for in vitro core voxels and by 49.5% in edge voxels. The results demonstrate generalizability of our 4D flow MRI super-resolution and denoising approach due to network training using flow patches and physics-based constraints. The mDCSRN-Flow network can facilitate MRI studies involving CSF flow measurements in cerebral ventricles and association of MRI-based flow metrics with cerebrovascular health.