Gravitational field of small bodies can be modeled e.g. with mascons, a polyhedral model or in terms of harmonic functions. If the shape of a body is close to the spheroid, it is advantageous to employ the spheroidal basis functions for expressing the gravitational field. Spheroidal harmonic models, similarly to the spherical ones, may be used in navigation and geophysical tasks. We focus on modeling the exterior gravitational field of oblate-like Asteroid (101955) Bennu and prolate-like Asteroid (4769) Castalia with spheroidal harmonics. Using the Gauss–Legendre quadrature and the spheroidal basis functions, we converted the gravitational potential of a particular polyhedral model of a constant density into the spheroidal harmonics. The results consist of (i) spheroidal harmonic coefficients of the exterior gravitational field for the Asteroids Bennu and Castalia, (ii) spherical harmonic coefficients for Bennu, and (iii) the first and second-order Cartesian derivatives in the local spheroidal South-East-Up frame for both bodies. The spheroidal harmonics offer biaxial flexibility (compared with spherical harmonics) and low computational costs that allow high-degree expansions (compared with ellipsoidal harmonics). The obtained spheroidal models for Bennu and Castalia represent the exterior gravitational field valid on and outside the Brillouin spheroid but they can be used even under this surface. For Bennu, 5 m above the surface the agreement with point-wise integration was 1% or less, while it was about 10% for Castalia due to its more irregular shape. As the shape models may produce very high frequencies, it was crucial to use higher maximum degree to reduce the aliasing. We have used the maximum degree 360 to achieve 9–10 common digits (in RMS) when reconstructing the input (the gravitational potential) from the spheroidal coefficients. The physically meaningful maximum degree may be lower (≪360) but its particular value depends on the distance and/or on the application (navigation, exploration, etc.).