The theory of harmonic analysis over cosec and conjugation class spaces in groups is generalized to functions over the space of bilateral classes. The latter are novel equivalence sets which include the above as particular cases. The relevant orthogonal function bases are partial traces. The standard harmonic functions and characters are recovered as special examples.