Spatial shaping of light beams has led to numerous new applications in fields such as imaging, optical communication, and micromanipulation. However, structured radiation is less well explored beyond visible optics, where methods for shaping fields are more limited. Binary amplitude filters are often used in these regimes and one such example is a photon sieve consisting of an arrangement of pinholes, the positioning of which can tightly focus incident radiation. Here, we describe a method to design generalized photon sieves: arrays of pinholes that generate arbitrary structured complex fields at their foci. We experimentally demonstrate this approach by the production of Airy and Bessel beams, and Laguerre–Gaussian and Hermite–Gaussian modes. We quantify the beam fidelity and photon sieve efficiency, and also demonstrate control over additional unwanted diffraction orders and the incorporation of aberration correction. The fact that these photon sieves are robust and simple to construct will be useful for the shaping of short- or long-wavelength radiation and eases the fabrication challenges set by more intricately patterned binary amplitude masks.