Clathrates are open crystals in which molecules are arranged in a hierarchy of polyhedral cages that encapsulate guest molecules and ions. As well as holding fundamental interest, molecular clathrates serve practical purposes, such as for gas storage, and their colloidal counterparts also appear promising for host-guest applications. Here using Monte Carlo simulations, we report the entropy-driven self-assembly of hard truncated triangular bipyramids into seven different host-guest colloidal clathrate crystals with unit cells ranging from 84 to 364 particles. The structures consist of cages that are either empty or occupied by guest particles, which can be different from or identical to the host particles. The simulations point to crystallization occurring through the compartmentalization of entropy between low- and high-entropy subsystems for the host and the guest particles, respectively. We use entropic bonding theory to design host-guest colloidal clathrates with explicit interparticle attraction, providing a route to realize such systems in the laboratory.