Abstract Holograms which reconstruct the transverse profile of light with complex-amplitude information have demonstrated more excellent performances with an improved signal-to-noise ratio compared with those containing amplitude-only and phase-only information. Metasurfaces have been widely utilized for complex-amplitude holograms owing to its capability of arbitrary light modulation at a subwavelength scale which conventional holographic devices cannot achieve. However, existing methods for metasurface-based complex-amplitude hologram design employ single back-diffraction propagation and rely on the artificial blocks which are able to independently and completely control both amplitude and phase. Here, we propose an unsupervised physics-driven deep neural network for the design of metasurface-based complex-amplitude holograms using artificial blocks with incomplete light modulation. This method integrates a neural network module with a forward physical propagation module and directly maps geometric parameters of the blocks to holographic images for end-to-end design. The perfect reconstruction of holographic images verified by numerical simulations has demonstrated that compared with the complete blocks, an efficient utilization, association and cooperation of the limited artificial blocks can achieve reconstruction performance as well. Furthermore, more restricted controls of the incident light are adopted for robustness test. The proposed method offers a real-time and robust way towards large-scale ideal holographic displays with subwavelength resolution.