Let (G, G’) be a reductive dual pair of subgroups of the metaplectic group S$(2m, R), where G is compact. Then the restriction of the oscillator representation o of Sp(2m, R) to G%’ decomposes as x,5=, T,@T: where the correspondence zj++ r( is a bijection [7]. The modules T : are unitary highest weight modules, and all such representations are obtained this way [5]. On the other hand, the unitary highest weight modules of G’ have been constructed in [3] via derived functors; in particular each such representation is associated to (is the “quantization” of) a coadjoint orbit for G’. The purpose of this paper is to establish the connection between these two realizations via the &?-orbit structure of the symplectic manifold R’“CO). These results have been known in principle for some time, the main problem being an understanding of how to quantize nilpotent and degenerate elliptic coadjoint orbits. Let 8, = Lie(G), 0; = Lie(c’). Let $ (respectively Ic/‘) be projection from Gp(2m, R)* to S,* (respectively @A*). Here ( )* = Hom,( , R). Then + and I,+’ restriced to the minimal coadjoint orbit I$,,, of Gp(2m, R)* define the graph of a correspondence between coadjoint Gand (?-orbits. Note that 0 In,” z R*” {O} via the moment map for the action of Sp(2m, R) on R”” { 0 ). Generically this is a bijection. Nilpotent orbits for C? do arise. Suppose a c-orbit 0 corresponds to a (?-orbit C’. In [ 111 it was observed that in some cases if we associate representations X(O) and X’(P’) to 0 and 0’ via geometric quantization, then X(O)@x’(0’) occurs in WJGG, (i.e., X(6) corresponds to x’(0’)). In [2] the derived functor construction was used to quantize some elliptic orbits, and this was done in greater generality. That is, for (0 = G. I. elliptic, ~(8) is cohomologically induced from a one-dimensional representation of L = stab,(i,), and similarly for G’. If ~(0) and n’(0’) have regular infinitesimal character, then n(O) corresponds to ~‘(6’). At the time [2] was written the modules n(O) with singular infinitesimal character were not understood. Furthermore, it was not known how 138 Oool-8708/87 $7.50
Read full abstract