Branching Laws for Some Unitary Representations of SL(4,R)

In this paper we consider the restriction of a unitary irreducible representation of type Aq(λ) of GL(4,R) to reductive subgroups H which are the fixpoint sets of an involution. We obtain a formula for the restriction to the symplectic group and to GL(2,C), and as an application we construct in the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Symmetry, Integrability and Geometry: Methods and Applications
Datum:2008
Hauptverfasser: Ørsted, B., Speh, B.
Format: Artikel
Sprache:Englisch
Veröffentlicht: Інститут математики НАН України 2008
Online Zugang:https://nasplib.isofts.kiev.ua/handle/123456789/148973
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Назва журналу:Digital Library of Periodicals of National Academy of Sciences of Ukraine
Zitieren:Branching Laws for Some Unitary Representations of SL(4,R) / B. Ørsted, B. Speh // Symmetry, Integrability and Geometry: Methods and Applications. — 2008. — Т. 4. — Бібліогр.: 28 назв. — англ.

Institution

Digital Library of Periodicals of National Academy of Sciences of Ukraine
_version_ 1860098920074444800
author Ørsted, B.
Speh, B.
author_facet Ørsted, B.
Speh, B.
citation_txt Branching Laws for Some Unitary Representations of SL(4,R) / B. Ørsted, B. Speh // Symmetry, Integrability and Geometry: Methods and Applications. — 2008. — Т. 4. — Бібліогр.: 28 назв. — англ.
collection DSpace DC
container_title Symmetry, Integrability and Geometry: Methods and Applications
description In this paper we consider the restriction of a unitary irreducible representation of type Aq(λ) of GL(4,R) to reductive subgroups H which are the fixpoint sets of an involution. We obtain a formula for the restriction to the symplectic group and to GL(2,C), and as an application we construct in the last section some representations in the cuspidal spectrum of the symplectic and the complex general linear group. In addition to working directly with the cohmologically induced module to obtain the branching law, we also introduce the useful concept of pseudo dual pairs of subgroups in a reductive Lie group.
first_indexed 2025-12-07T17:27:47Z
format Article
fulltext Symmetry, Integrability and Geometry: Methods and Applications SIGMA 4 (2008), 017, 19 pages Branching Laws for Some Unitary Representations of SL(4, R)? Bent ØRSTED † and Birgit SPEH ‡ † Department of Mathematics, University of Aarhus, Aarhus, Denmark E-mail: orsted@imf.au.dk URL: http://person.au.dk/en/orsted@imf ‡ Department of Mathematics, 310 Malott Hall, Cornell University, Ithaca, NY 14853-4201, USA E-mail: speh@math.cornell.edu Received September 10, 2007, in final form January 27, 2008; Published online February 07, 2008 Original article is available at http://www.emis.de/journals/SIGMA/2008/017/ Abstract. In this paper we consider the restriction of a unitary irreducible representation of type Aq(λ) of GL(4, R) to reductive subgroups H which are the fixpoint sets of an involution. We obtain a formula for the restriction to the symplectic group and to GL(2, C), and as an application we construct in the last section some representations in the cuspidal spectrum of the symplectic and the complex general linear group. In addition to working directly with the cohmologically induced module to obtain the branching law, we also introduce the useful concept of pseudo dual pairs of subgroups in a reductive Lie group. Key words: semisimple Lie groups; unitary representation; branching laws 2000 Mathematics Subject Classification: 22E47; 11F70 1 Introduction Understanding a unitary representation π of a Lie groups G often involves understanding its restriction to suitable subgroups H. This is in physics referred to as breaking the symmetry, and often means exhibiting a nice basis of the representation space of π. Similarly, decomposing a tensor product of two representations of G is also an important branching problem, namely the restriction to the diagonal in G×G. Generally speaking, the more branching laws we know for a given representation, the more we know the structure of this representation. For example, when G is semisimple and K a maximal compact subgroup, knowing the K-spectrum, i.e. the collection of K-types and their multiplicities, of π is an important invariant which serves to describe a good deal of its structure. It is also important to give good models of both π and its explicit K-types. There has been much progress in recent years (and of course a large number of more classical works, see for example [27, 6, 7, 8]), both for abstract theory as in [11, 12, 14, 13], and concrete examples of branching laws in [24, 25, 18, 4, 28]. In this paper, we shall study in a special case a generalization of the method applied in [19] and again in [8]; this is a method of Taylor expansion of sections of a vector bundle along directions normal to a submanifold. This works nicely when the original representation is a holomor- phic discrete series for G, and the subgroup H also admits holomorphic discrete series and is embedded in a suitable way in G. The branching law is a discrete sum decomposition, even with finite multiplicities, so-called admissibility of the restriction to H; and the summands are themselves holomorphic discrete series representations for H. Since holomorphic discrete series ?This paper is a contribution to the Proceedings of the 2007 Midwest Geometry Conference in honor of Thomas P. Branson. The full collection is available at http://www.emis.de/journals/SIGMA/MGC2007.html mailto:orsted@imf.au.dk http://person.au.dk/en/orsted@imf mailto:speh@math.cornell.edu http://www.emis.de/journals/SIGMA/2008/017/ http://www.emis.de/journals/SIGMA/MGC2007.html 2 B. Ørsted and B. Speh representations are cohomologically induced representations in degree zero, it is natural to at- tempt a generalization to other unitary representations of similar type, namely cohomologically induced representations in higher degree. We shall focus on the line bundle case, i.e. the Aq(λ) representations. In this case T. Kobayashi [13] obtained necessary and sufficient conditions that the restriction is discrete and that each representation appears with finite multiplicity, socalled admissibility of the representation relatively to the subgroup. Using explicit resolutions and filtrations associated with the imbedding of H in G, we analyze the derived functor modules and obtain an explicit decomposition into irreducible representations. It is perhaps not surpris- ing, that with the appropriate conditions on the imbedding of the subgroup, the class of (in our case derived functor) modules is preserved in the restriction from H to G. While the algebraic methods of derived functor modules, in particular the cohomologically induced representations, provide a very strong tool for the theoretical investigations of unitary representations of reductive Lie groups, it has been difficult to work with concrete models of these modules. It is however exactly these models that we use in this paper, as outlined above; the fact that one may consider these modules as Taylor expansions of appropriate differential forms, indicates that it should be natural to study these Taylor expansions along submani- folds – and when these submanifolds are natural for the subgroup for which one wants to do the branching law, there arises a useful link between the algebraic branching and the geometry of the imbedding of the subgroup. It is our hope, that this idea (that we carry out in some relatively small examples) will have a broader use in deciding the possible candidates for representations occuring in an admissible branching law. Here is the general setting that we consider: Let G be a semisimple linear connected Lie group with maximal compact subgroup K and Cartan involution θ. Suppose that σ is another involution so that σ ·θ = θ ·σ and let H be the fixpoint set of σ in G. Suppose that L = Lx is the centralizer of an elliptic element x ∈ i(g ∩ h) and let q = l⊕ u, qH = q ∩ h be the corresponding θ-stable parabolic subgroups. Here we use as usual gothic letters for complex Lie algebras and subspaces thereof; a subscript will denote the real form, e.g. go. We say that pairs of parabolic subalgebras q, qH which are constructed this way are well aligned. For a unitary character λ of L we define following Vogan/Zuckerman the unitary representations Aq(λ). In this paper we consider the example of the group G = SL(4, R). There are two G-conjugacy classes of skew symmetric matrices with representants Q1 = ( J 0 0 −J ) and Q2 = ( J 0 0 J ) where J = ( 0 −1 1 0 ) . Let H1 respectively H2 be the symplectic subgroups defined by these matrices and H ′ 1, H ′ 2 the centralizer of Q1, respectively Q2. All these subgroups are fix point sets of involutions σi, i = 1, 2 and σ′i, i = 1, 2 respectively. The matrix Q2 has finite order, it is contained in all subgroups Hi and iQ2 ∈ g defines a θ-stable parabolic subalgebra q of sl(4, C) and also θ-stable parabolic subalgebras qh1 = q∩ h1 of h1, respectively qh2 = q∩ h2 of h2. Its centralizer L in SL(4, R) is isomorphic to GL1(2, C) = {T ∈ GL(2, C)| |det(T )| = 1}. The parabolic subgroups q, qh1 as well as q, qh2 are well aligned. We consider in this paper the unitary representation Aq of G corresponding to trivial cha- racter λ. Its infinitesimal character is the same as that of the trivial representation. The representation Aq was studied from an analytic point of view by S. Sahi [21]. Since the Aq has nontrivial (g,K)-cohomology and is isomorphic to a representation in the residual spectrum, this representation is also interesting from the point of view of automorphic forms. See for example [23]. We show in this paper that the restriction of Aq to H1 and H ′ 1 is a direct sum of irreducible unitary representations, where as the restriction to H2 and H ′ 2 has continuous spectrum. We also determine explicitly the restriction of Aq to the subgroups H1 and H ′ 1 and conclude that for all unitary (h1,H1 ∩K)-modules V the dimension of Hom(h1,H1∩K)(Aq, V ) is at most 1. Branching Laws for Some Unitary Representations of SL(4, R) 3 If we interpret SL(4, R) and Sp(2, R) as Spin(3,3) and Spin(2,3) then these branching laws can in some sense be considered as supporting the conjectures by B. Gross and D. Prasad [3] for the restriction of Vogan packets of representations of SO(n, n) to representations of SO(n−1, n). The paper is organized as follows: After introducing all the notation in Section 2 we prove in Section 3 using a result of T. Kobayashi, that the restriction of Aq to H1 and H ′ 1 is a direct sum of irreducible unitary representations, whereas the restriction to H2 and H ′ 2 does have a continuous spectrum. This discrete/continuous alternative, see [12], is one of the deep results that we invoke for symmetric subgroups. We do not attempt in this paper to say anything about the continuous spectrum, and we mainly focus on the admissible situation, so the alternative is really admissible/non-admissible. In Sections 4 and 5 we determine the representations of H1 respectively of H ′ 1 that appear in the restriction of Aq to H1 respectively H ′ 1 and show that it is a direct sum of unitary representations of the form Aq∩h1(µ) respectively Aq∩h′1 (µ′), each appearing with multiplicity one. The main point is here, that we find a natural model in which to do the branching law, based on the existence results of T. Kobayashi; and also following experience from some of his examples, where indeed derived functor modules decompose as derived functor modules (for the smaller group). In Section 6 we introduce pseudo dual pairs. This allows us to find another interpretation of the restrictions of Aq to the pseudo dual pair H1, H2. This notion turns out to be extremely useful for analyzing the spectrum in the admissible situation, and combined with our idea of restricting a cohomologically induced module gives the complete branching law. In Section 7 we recall some more examples of branching laws. In Section 8 we formulate a conjecture about the multiplicity of representations in the restric- tion of representations Aq of semisimple Lie groups G to subgroups H, which are centralizers of involutions. If the restriction of Aq to H is a direct sum of irreducible representation of H we expect that there is a θ-stable parabolic subalgebra qH of H so that all representations which appear in the restriction are of the form AqH (µ) and that a Blattner-type formula holds. See the precise conjecture at the end of Section 8, where we introduce a natural generalization of previously known Blattner-type formulas for the maximal compact subgroup. In Section 9 we see how these results may be used to construct automorphic representations of Sp(2, R) and GL(2, C) which are in the discrete spectrum for some congruence subgroup. For Sp(2, R) these representations are in the residual spectrum, whereas for GL(2, C) these representations are in the cuspidal spectrum. We expect that our methods extend to other situations with similar applications to automorphic representations; and we hope the point of view introduced here also will help to understand in a more explicit way the branching laws for semisimple Lie groups with respect to reductive subgroups. 2 Notation and generalities 2.1. Let G be a connected linear semisimple Lie group. We fix a maximal compact subgroup K and Cartan involution θ. Let H be a θ-stable connected semisimple subgroup with maximal compact subgroup KH = K ∩H. We pick a fundamental Cartan subgroup CH = TH ·AH of H. It is contained in a fundamental Cartan subgroup C = T · A of G so that TH = T ∩ H and AH = A∩H. The complex Lie algebra of a Lie group (as before) is denoted by small letters and its real Lie algebra by a subscript o. We denote the Cartan decomposition by go = ko ⊕ p. Definition. Let q and qH be θ-stable parabolic subalgebras of g, respectively h. We say that they are well aligned if qH = q ∩ h. We fix xo in tH . Then i xo defines well aligned θ-stable parabolic subalgebras q = l⊕ u and qH = lH ⊕ uH = q ∩ h of g respectively h; for details see page 274 in [10]. 4 B. Ørsted and B. Speh We write L and LH for the centralizer of x0 in G and in H respectively. For a unitary character λ of L we write λH for the restriction of λ to LH . 2.2. For later reference we recall the construction of the representations Aq(V ), V an irreducible (q, L ∩K) module. We follow conventions of the book by Knapp and Vogan [10] (where much more detail on these derived functor modules is to be found – this is our standard reference) and will always consider representations of L and not of the metaplectic cover of L as some other authors. We consider U(g) as right U(q) module and write V ] = V ⊗ ∧topu. Let pL be a L∩K-invariant complement of l∩ k in l. We write rG = pL⊕u. Now we introduce the derived functor modules as on page 167 in [10], recalling that this formalizes Taylor expansions of certain differential forms. Since all the groups considered in the paper are connected we use the original definition of the Zuckerman functor [26] and do not use the the Hecke algebra R(g,K) to define the representations Aq(V ). Consider the complex 0 → HomL∩K(U(g),Hom(∧0rG, V ]))K → → HomL∩K(U(g),Hom(∧1rG, V ]))K → HomL∩K(U(g),Hom(∧2rG, V ]))K → · · · . Here the subscript K denotes the subspace of K-finite vectors. We denote by T (x,U(·)) an element in HomL∩K(U(g),HomC(∧n−1rG, V ]))K . The differential d is defined by d T (x,U(X1 ∧X2 ∧ · · · ∧Xn)) = n∑ i=1 (−1)iT (Xix,U(X1 ∧X2 ∧ · · · X̂i · · · ∧Xn)) + n∑ i=1 (−1)i+1T (x,XiU(X1 ∧X2 ∧ · · · X̂i · · · ∧Xn)) + ∑ i<j (−1)i+jT (x, U(PrG [Xi, Xj ] ∧X1 ∧X2 ∧ · · · X̂i · · · X̂j · · · ∧Xn)), where x ∈ U(g), Xj ∈ rG and PrG is the projection onto rG along l ∩ k. Let s = dim(u ∩ k) and let χ be the infinitesimal character of V . If 2〈χ + ρ(u), α〉 |α|2 6∈ {0,−1,−2,−3, . . . } for α ∈ ∆(u), where 〈 , 〉 denotes the Killing form of g, then the cohomology is zero except in degree s and if V is irreducible this defines an irreducible ((U(g),K)-module Aq(V ) in degree s (8.28 in [10]). By (5.24 in [10], see also the remark/example on page 344) the infinitesimal character of Aq(V ) is χ + ρ(u) (usual shift of the half-sum of all positive roots in u). If V is trivial the infinitesimal character of Aq(V ) is ρG and we write simply Aq. Two representations Aq and Aq′ are equivalent if q and q′ are conjugate under the compact Weyl group WK . For an irreducible finite dimensional (qH , LH ∩ K)-module V LH we define similarly the (U(h),KH)-modules AqH (V LH ). 2.3. Let H be the fix point set of an involutive automorphism σ of G which commutes with the Cartan involution θ. We write go = ho ⊕ so for the induced decomposition of the Lie algebra. T. Kobayashi proved [12] that the restriction of Aq to H decomposes as direct sum of irreducible representations of H if Aq is KH -admissible, i.e. if every KH -type has finite multiplicity. If Aq is discretely decomposable as an (ho,K ∩H)-module we call an irreducible (ho,H ∩K)-module πH an H-type of Aq if Hom(ho,KH)(π H , Aq) 6= 0 and the dimension of Hom(ho,KH)(πH , Aq) its multiplicity. Branching Laws for Some Unitary Representations of SL(4, R) 5 We have l = lH ⊕ l∩ s. Put uH = u∩ h. The representation of lH on u is reducible and as lH - module u = uH⊕(u∩s). Let q = l⊕u be the opposite parabolic subgroup. Then h = kH⊕uH⊕uH and (u ∩ s)⊕ u ∩ s is a lH -module. As an lH -module g = h⊕ (u ∩ s)⊕ (l ∩ s)⊕ (u ∩ s). 2.4. Now let G = SL(4, R). The skew symmetric matrices Q1 = ( J 0 0 −J ) and Q2 = ( J 0 0 J ) with J = ( 0 −1 1 0 ) represent the conjugacy classes of skew symmetric matrices under G. They define symplectic forms also denoted by Q1 and Q2. Let H1, respectively H2, be the θ-stable symplectic subgroups defined by Q1, respectively Q2. These subgroups are fix points of the involutions σi(g) = Qi · (g−1)tr ·Q−1 i , i = 1, 2. Since Q1 and Q2 are conjugate in GL(4, R), but not in SL(4, R), the symplectic groups H1 and H2 are not conjugate in SL(4, R). Let H ′ 1 and H ′ 2 be the fix points of the involutions σ′i(g) = Qi · g ·Q−1 i . Both groups H ′ 1 and H ′ 2 are isomorphic to GL1(2, C) = {T ∈ GL(2, C)| |det(T )| = 1}, but they are not conjugate in SL(4, R). 2.5. We fix x0 = Q2. It has finite order and is contained in ⋂2 i=1 Hi and in ⋂2 i=1 H ′ i. Now ix0 ∈ ig defines a θ stable parabolic subalgebra q of sl(4, C) and also θ-stable well aligned parabolic subalgebras qH of the subalgebras h. Its centralizer L = Lx0 in SL(4, R), the Levi subgroup, is isomorphic to GL(2, C) = H ′ 2. For a precise description of the parabolic see page 586 in [10]. We have L = H ′ 2, KH2 = K ∩H2 = K ∩ L, KH′ 2 = K ∩H ′ 2 = K ∩ L and KH1 = KH′ 1 . Let Aq be the representation holomorphically induced from q which has a trivial infinite- simal character. This representations is a subrepresentation of a degenerate series representa- tion induced from a one dimensional representation of the parabolic subgroup with Levi factor S(GL(2, R)×GL(2, R)) and thus all its K-types have multiplicity one. See [21] for details. The next proposition demonstrates how different imbeddings of the same subgroup (sym- plectic res. general linear complex) gives radically different branching laws. Proposition 2.1. 1. The restriction of Aq to H1 and to H ′ 1 is a direct sum of irreducible representation each appearing with finite multiplicity. 2. The restriction of Aq to H2 and to H ′ 2 is not admissible and has continuous spectrum. 6 B. Ørsted and B. Speh Proof. Since KH1 = KH′ 1 and KH2 = KH′ 2 it suffices by T. Kobayashi’s Theorem 4.2 in [12] to show that Aq is KH1 admissible. We will prove this in the next section. To prove (2) it suffices to show by Theorem 4.2 in [12] that Aq is not KH2 admissible. This is proved also in the next section. � Remark. We will prove later in the paper that the representations of H1 have at most multi- plicity one in the restriction of Aq. 3 The restriction of Aq to K ∩ Hi, i = 1, 2 We use in this section the notation introduced on pages 586–588 in [10]. 3.1. The Cartan algebra to of so(4, R) consists of 2 by 2 blocks ( 0 θj −θj 0 ) down the diagonal. We have a θ-stable Cartan subalgebra ho = to ⊕ ao where ao consists of the 2 by 2 blocks( xj 0 0 xj ) , also down the diagonal. We define ej ∈ h∗ by ej ( xj −iyj iyj xj ) = yj and fj ∈ h∗ by fj ( xj −iyj iyj xj ) = xj . Then the roots ∆(u) of (h, u) are e1 + e2 + (f1 − f2), e1 + e2 − (f1 − f2), 2e1, 2e2 and a compatible set of positive roots ∆+(l) of (h, l) are e1 − e2 + (f1 − f2), e1 − e2 − (f1 − f2). The roots α1 = e1 + e2, α2 = e1 − e2 are compatible positive roots of the Lie algebra k with respect to t. The highest weight of the minimal K-type of Aq is Λ = 3(e1 + e2). See page 588 in [10]. All other K-types are of the form Λ + m1(e1 + e2) + 2m2e1, m1,m2 ∈ N. KH2 = K∩L is isomorphic to U(2). We assume that the positive root of (t, kH2) is α2 whereas the α1 can be identified with a character of the center of KH2 . So the restriction of each K-type with highest weight (m+3)α1 to KH2 is a sum of characters dα1 with −(m+3) ≤ d ≤ (m+3). Hence Aq is not KH2-finite and thus by T. Kobayashi’s theorem Aq is not a discrete sum of irreducible representations of H2. This proves the second claim of Proposition 2.1. The groups H1 and H2 are conjugate under the outer automorphism which changes the sign of e2. Hence the simple positive root of (t, kH1) can be identified with α1 and α2 can be identified with a character of the center of KH1 (see Fig. 1). A K-type with highest weight Λ + m1(e1 + e2)+2m2 e1 is a tensor product of a representation with highest weight (3+m1+m2, 3+m1+m2) and a representation with highest weight (m2,−m2). Its restriction to KH1 is a direct sum of representations with highest weights (3 + m1 + m2 + i, 3 + m1 + m2 − i), −m2 ≤ i ≤ m2. Fig. 2 shows the highest weights of the KH1-types for the restriction of Aq to KH1 . Their multiplicities are indicated by a number. Branching Laws for Some Unitary Representations of SL(4, R) 7 Figure 1. Figure 2. Thus Aq is KH1-finite. This completes the proof of the first assertion of Proposition 2.1. Remark. A second series of representations is obtained if we define another θ-stable parabolic subalgebra q′ using the matrix Q1 ∈ g instead of Q2. We obtain a representation Aq′ which is not equivalent to Aq. The same arguments as in the previous case prove that restriction of Aq′ to H1 does not have a purely discrete spectrum whereas the restriction to H2 is a direct sum of irreducible unitary representations. The representation Aq of SL+/−(4, R) (determinant ±1) obtained by inducing representa- tion Aq is irreducible and its restriction to SL(4, R) is equal to Aq ⊕Aq′ . Hence the restriction of Aq to H1 does not have discrete spectrum. 4 The restriction of Aq to the symplectic group H1 In this section we determine H1-types of Aq. Our techniques are based on homological algebra and the construction of an “enlarged complex” whose cohomology computes the restriction. We introduce it in 4.1 for semisimple connected Lie groups H and connected reductive subgroups H. Then we will compute the restriction to H1 by restricting Aq to a subgroup conjugate to H1. The motivation for this “enlarged complex” or “branching complex” is the same as when one is restricting holomorphic functions to a complex submanifold, and identifying the functions with their normal derivatives along the submanifold. In our case we are working with (formalizations of) differential forms satisfying a similar differential equation, so it is natural to try to identify them with their “normal derivatives”; this is what is formalized in our definition. As it turns out, with the appropriate conditions (well aligned parabolic subgroups, vanishing of the cohomology in many degrees, and the non-vanishing of explicit classes corresponding to small K-types) we can indeed make the calculation of the branching law effective, at least in the examples at hand. 4.1. We define another complex for a semisimple connected Lie group G and a connected reductive subgroup H satisfying the assumptions of 2.3. Let CλH be the one dimensional representation of LH defined by λ⊗ ∧top(u ∩ s). Then C] λ = Cλ ⊗ ∧topu = CλH ⊗ ∧topuH = C] λH . 8 B. Ørsted and B. Speh Consider the complex L∗ H (HomL∩K∩H(U(g),Hom(∧irH , C] λH ))K∩H , dH). (4.1) Here rH = rG ∩ h and dH is defined analogously to the differential d in 2.2. As a left U(lH)- module U(g) = Q⊗ U(h), where Q is the symmetric algebra S(s). (See [10, 2.56].) We have HomL∩K∩H(U(g),Hom(∧irH , C] λH ))K∩H = HomL∩K∩H(Q⊗ U(h),Hom(∧irH , C] λH ))K∩H = HomL∩K∩H(U(h),Hom(∧irH , Q∗ ⊗ C] λH ))K∩H . U(g) acts on the enlarged complex from the right and a quick check shows that dH also commutes with this action and therefore we have an action of U(g) on the cohomology of the complex. We also consider the “large complex” L∗ (HomK∩L∩H(U(g),Hom(∧irG, C] λ))K∩H , d). We have rG = rH ⊕ (u ∩ s)⊕ (pL ∩ s), and so ∧irG = ⊕l+k=i ∧k rH ⊗ ∧l(u ∩ s⊕ pL ∩ s). Using this we can define a “pull back” map of forms pbi H : HomL∩K∩H(U(h),Hom(∧irH , Q∗ ⊗ C] λH ))K∩H → HomK∩L∩H(U(g),Hom(∧irG, C] λ))K∩H . The pullback map commutes with the right action of U(h) and induces a map of complexes. This is the main observation we use in order to analyze the action of H on the cohomologically induced module. 4.2. For the rest of this section we assume that G = SL(4, R). We will show that there exists a symplectic subgroup, which we denote by Hw 1 conjugate to H1 by an element w, so that the pullback induces a nontrivial map in cohomology. Since the restriction of Aq depends only on the conjugacy class of H1 this determines the restriction. Since 1 0 0 0 0 0 −1 0 0 1 0 0 0 0 0 1  Q1  1 0 0 0 0 0 1 0 0 −1 0 0 0 0 0 1  =  0 0 −1 0 0 0 0 −1 1 0 0 0 0 1 0 0  , by abuse of notation we will also write H1 and H ′ 1 for the groups defined by the skew symmetric form  0 0 −1 0 0 0 0 −1 1 0 0 0 0 1 0 0  . Thus h1 = ( A X Y −Atr ) for symmetric matrices X and Y . Branching Laws for Some Unitary Representations of SL(4, R) 9 Recall that q is defined by i Q2 = ( i J 0 0 i J ) ∈ g and that g = h1 ⊕ s1. We need the fine structure of the parabolic relative to the symmetric subgroup, in order to compare the cohomology of these complexes during the branching. Lemma 4.1. Under the above assumptions a) l ∩ h1 is isomorphic to sl(2, R)⊕ iR and dim(u ∩ h1) = 3; b) the representation of L ∩ H1 acts by a nontrivial character µ1 with differential (e1 + e2) on the one dimensional space u ∩ s1; c) l ∩ s1 is a direct sum of the trivial representation and the adjoint representation of l ∩ h1. d) u ∩ k = u ∩ k ∩ h1 has dimension 1. Proof. We have lo ∩ h1 =  a b x 0 −b a 0 x y 0 −a b 0 y −b −a  . The nilradical of a parabolic subalgebra with this Levi subalgebra has dimension 3. The dimension of l∩h1∩ k is 2. Hence the dimension of u∩ k∩h1 is 1. On the other hand the dimension of l ∩ k is 4. So the dimension of u ∩ k is 1. Since u ∩ k ∩ h1 ⊂ u ∩ k we have equality. u∩s1 is in the roots spaces for roots e1 +e2 +(f1−f2) and e1 +e2− (f1−f2). Hence l∩h1∩ k acts on u ∩ s1 by e1 + e2. l ∩ h1 acts on the 4 dimensional space l ∩ s1 via the adjoint representation. � The representation of L ∩ H1 on the symmetric algebra S((u ∩ s1) ⊕ (u ∩ s1) ⊕ (l ∩ s1)) is isomorphic to a direct sum of representations µn1 1 ⊗ µ−m1 1 ⊗ adr1 with n1,m1, r1 ∈ N. These powers of µ1 will label the constituents in the branching law; it will also be sometimes convenient to think of their differentials in additive notation. Now it is important to note, that the parameter λH1 ⊗ µn1 1 , 0 ≤ n1 is in the good range [10] and thus the representation on the cohomology in degree 1 = dim(u∩ k∩h1) of the complex L∗ H1 has composition factors isomorphic to Aq∩h1(λH1 ⊗ µn1 1 ), where 0 ≤ n1. In particular Aq∩h1(λH1) is an (h1,K∩H1)-submodule module of the cohomology of L∗ H1 . Proposition 4.2. Aq∩h1(λH1) is a composition factor of the restriction of Aq to (h1,K ∩H1). Proof. Note that dim(u ∩ k) = dim(u ∩ k ∩ h1) and that 1 = dim(u ∩ k) is the degree in which the complexes defining the representations Aq respectively Aq∩h1(λH1) both have nontrivial co- homology [10]. Considering the complex defining Aq as a subcomplex of the “large complex” L∗ the pullback pbi H1 of forms defines a (h1,K ∩H1)-equivariant map Aq → ⊕∞ n1=0Aq∩h1(µ n1 1 ⊗ λH1). 10 B. Ørsted and B. Speh Recall the definition of the K-module Rs K(λ) from V.5.70 in [10]. We have bottom layer maps of ko-modules. B(λ) : Aq → R1 K(λ0) and B(λH1) : Aq∩h1(λH1) → R1 K∩H1 (λH1), where λ0 is the trivial character of L ∩ K. These maps are defined by the inclusion of of complexes and hence of forms. See Theorem V.5.80 and its proof in [10]. The minimal K-types of Aq, respectively KH1-type of Aq∩h1(λH1) are in the bottom layer. On the other hand we have an inclusion of complexes (the notation in analogy with the case in 4.1, now for the case where we take G = K) pbi H1∩K : HomK∩L∩H1(U(k),Hom(∧i(rG ∩ k ∩ h1), C] λH1 ))K∩H1 → HomK∩L∩H1(U(k),Hom(∧i(rG ∩ k), C] λ0 ))K∩H1 . But C] λ0 = C] λH1 and rG ∩ k ∩ h1 = rG ∩ k and so using a forgetful functor we may consider HomK∩L(U(k),Hom(∧i(rG ∩ k), C] λ0 ))K as a subspace, respectively subcomplex, of HomK∩L∩H1(U(k),Hom(∧i(rG ∩ k ∩ h1), C] λ0 ))K∩H1 = HomK∩L∩H1(U(k ∩ h1),Hom(∧i(rG ∩ k ∩ h1), QH ⊗ C] λ0 ))K∩H1 , where QH is the symmetric algebra of the complement of h1∩ k in k. Note that K ∩H1 and K is again a symmetric a pair and so we have a bottom-layer map for the representation R1 K(λ0) → R1 K∩H(λH1). Since the representation R1 K(λ0) is irreducible restricted to K ∩ H1 this map is an isomor- phism. � Definition. We call Aq∩h1(λH1) the minimal H1-type of Aq. Theorem 4.3. The representation Aq restricted to H1 is the direct sum of the representations each occuring with multiplicity one, namely Aq|H1 = ⊕∞ n1=0Aq∩h1(µ n1 1 ⊗ λH1). Proof. By the proof of the lemma Aq∩h1(λH1) is a submodule of the restriction of Aq to the symplectic group H1. Its minimal KH1-type is also a minimal K-type of Aq and hence occurs with multiplicity one. Hence Aq∩h1(λH1) is a H1-type of Aq with multiplicity one. The minimal KH1-type of Aq∩h1(λ) has highest weight λ + 3e1 + 3e2. The roots of u∩ h1 ∩ p are 2e1, 2e2. Applying successively the root vectors to the highest weight vector of the minimal KH1-type of Aq∩h1(λ) we deduce that Aq∩h1(λ) contains the KH1-types with highest weight ((3 + 2r1)e1 + (3 + 2r2)e1 + λ), r1, r2 ∈ N. Theorem 8.29 in [10] show that all these KH1-types have multiplicity one. Fig. 3 shows the KH1-type multiplicities of Aq(λH1). Note that we are here using quite a bit of a priori information about the derived functor modules for the smaller group; on the other hand, the branching problem has essentially been reduced to one for compact groups, K-type by K-type. Branching Laws for Some Unitary Representations of SL(4, R) 11 Figure 3. The Borel subalgebra of k ∩ h1 acts on the one dimensional space u ∩ s1 by a character µ1 with differential (e1 + e2). Let Y 6= 0 be in u ∩ s1 and v 6= 0 a highest weight vector of the minimal K-types of Aq. Then Y n · v 6= 0 is also the highest weight of an KH1-type of highest weight (3 + n)e1 + (3 + n)e2 of Aq. Let Xk 6= 0 be in u ∩ k. The linear map Ts : U(g) → ∧1rG ⊗ C] λ0 which maps 1 to Xk ⊗ C] λ0 is non-zero in cohomology and its class [Ts] is the highest weight vector of the minimal K-type. But Y · Ts ∈ HomL∩K∩H1(s1 ⊗ U(h1),Hom(∧srH1 , C ] λH1 )), so may consider Y · Ts ∈ HomL∩K∩H1(U(h1),Hom(∧irH1 , s ∗ 1 ⊗ C] λH1 ))K∩H1 . Hence 0 6= [Y · Ts] = Y · [Ts] ∈ Aq∩h1(µ1 ⊗ λH1) and thus Aq∩h1(λH1 ⊗ µ1) is an H1-type of Aq. The same argument shows that Aq∩h1(λH1 ⊗ µn 1 ), n ∈ N, is a H1-type of Aq. Now every K-type with highest weight (n, n) has multiplicity n − 2 and is contained in exactly n − 2 composition factors. The multiplicity computations in Section 3 now show that every composition factor is equal to Aq∩h1(λH1 ⊗ µn 1 ) for some n. See Fig. 4. � Remark. Another proof of Theorem 4.3 can be obtained using Proposition 5.1 and the ideas of 6.1. By Proposition 8.11 in [10] for any (g,K)-module X we have Homg,K(X, Aq) = Homl,K∩L(Hs(u, X), C]), where Hs(u, X) is the Lie algebra homology as defined in [10] and s = dim(u∩ k). Thus we have a “Blattner type formula” for the H1-types of Aq. 12 B. Ørsted and B. Speh Figure 4. Corollary 4.4. Let V be an irreducible (h1,K H1)-module. Then dim Homh1,K∩H1(V,Aq) = ∑ i dim Hom(l∩h1,KH1∩L)(H1(u ∩ h1, V ), Si(u ∩ s1)⊗ C] H1 ). Remark. The H1(·, ·) on the right refers to homology in degree one. The maximal Abelian split subalgebra a1 in l ∩ h1 are the diagonal matrices. So the parabolic subgroup of the Langlands parameter of the H1-types of Aq is the so called “mirabolic”, i.e. the maximal parabolic subgroup with Abelian nilradical. The other parts of Langlands parameter can de determined using the algorithm in [10]. We consider in Theorem 4.3 the restriction of a “small” representation Aq of Spin(3,3) to Spin(2,3) similar to the restriction of “small” discrete series representations of SO(n + 1, n) to SO(n, n) considered by B. Gross and N. Wallach in [4]. It would be interesting to see if their techniques could be adapted to the problem discussed in the paper. 5 Restriction of Aq to the group H ′ 1 In this section we describe H ′ 1-types of Aq using the same techniques as in the previous section. 5.1. For H ′ 1 we consider the complex (HomL∩K∩H′ 1 (U(g),Hom(∧irH′ 1 , C] λH′ 1 ))K∩H′ 1 , dH′ 1 ) and the map pbi H′ 1 : HomL∩K∩H′ 1 (U(h′1),Hom(∧irH′ 1 , Q∗ ⊗ C] λH )K∩H′ 1 )K∩H′ 1 → HomK∩L∩H′ 1 (U(g),Hom(∧irG, C] λ))K∩H′ 1 . We write g = h′1 ⊕ s′1. The intersection u ∩ s′1 is 2-dimensional and the representation of the group of L ∩H ′ 1 on u ∩ s′1 is reducible and thus a sum of 2 one dimensional representations Branching Laws for Some Unitary Representations of SL(4, R) 13 χ1 ⊕ χ2. The weights of these characters are 2e1 and 2e2. So the symmetric algebra S(u ∩ s′1) is a direct sum of one dimensional representations of L ∩H ′ 1 with weights 2m1e1 + 2m2e2. In the cohomology in degree 1 of the complex L∗ H′ 1 we have composition factors Aq∩h′1 (λH′ 1 ⊗ χn1 1 ⊗ χn2 2 ) with 0 ≤ n1, n2. In particular Aq∩h′1 (λH′ 1 ) is an (h′1,K ∩H ′ 1)-submodule module of the cohomo- logy in degree 1. Proposition 5.1. Aq∩h′1 (λH′ 1 ) is a composition factor of the restriction of Aq to (h′1,H ′ 1 ∩K). Proof. The maximal compact subgroups of H1 and H ′ 1 are identical. Thus dim u ∩ k ∩ h1 = dim u ∩ k ∩ h1 = 1 and the minimal K-type is irreducible under restriction to KH′ 1 . Thus the same argument as in Lemma 4.1 completes the proof. � Definition. We call Aq∩h′1 (λH′ 1 ) the minimal H ′ 1 type of Aq. Theorem 5.2. The representation Aq restricted to H ′ 1 is the direct sum of the representations each occurring with multiplicity one, namely Aq|H′ 1 = ⊕∞ n1,n2=0Aq∩h′1 (λH′ 1 ⊗ χn1 1 ⊗ χn2 2 ). Their minimal K∩H ′ 1 -types have highest weights (3+m1+m2+i, 3+m1+m2−i), −m2 ≤ i ≤ m2. Proof. The proof is the same in the previous section where we proved that the representations Aq∩h′1 (λH′ 1 ⊗ χn1 1 ⊗ χn2 2 ), n1, n2 ∈ N appear in the restriction of the Aq to H ′ 1 The K ∩ H ′ 1 -types of all unitary representations of GL(2, C) have multiplicity one. If the minimal K ∩H ′ 1-type has highest weight l1e1 + l2e2 − 2, then the highest weights of the other K ∩ H ′ 1-types are (l1 + j)e1 + (l2 + j)e2. Multiplicity considerations of K ∩ H ′ 1-types of Aq conclude the proof. � Remark. Using Proposition 4.2, 4.1 and the ideas of 6.1 we can obtain another proof of this theorem. Fig. 5 shows the decomposition into irreducible representations. The highest weights of the K ∩H ′ 1-types of a composition factors lie on the lines. For each highest weight there is exactly one composition factor which has a K ∩H ′ 1-type with this weight as a minimal K ∩H ′ 1-type. We have again a “Blattner-type formula” for the H ′ 1 types. Corollary 5.3. Let V be an irreducible (h′1, (K ∩H ′ 1))-module, then dim Homh′1,K∩H′ 1 (V,Aq) = ∑ i dim Hom(l∩h′1),K∩H′ 1∩L(H1(u ∩ h′1, V ), Si(u ∩ s′1)⊗ C] H′ 1 ). 5.2. All the H ′ 1-types Aq∩h′1 (λH′ 1 ⊗χn1 1 ⊗χn2 2 ) of Aq are simply unitarily induced principal series representations of GL(2, C). 6 Pseudo dual pairs 6.1. Suppose now that G is a reductive connected Lie group with maximal compact subgroup K, Cartan involution θ of g. For an involution τ : G → G 14 B. Ørsted and B. Speh Figure 5. Figure 6. commuting with θ we define τ ′ = τ ◦ θ and H = Gτ , H ′ = Gτ ′ . Definition. We call H and H ′ a pseudo dual pair. Since θ, τ and τ ′ commute Lemma 6.1. Suppose that H and H ′ are a pseudo dual pair in G. Then 1) K ∩H = K ∩H ′; 2) we have p = pτ ⊕ pτ ′; 3) U(g) ∼= S(pτ ′)S(pτ )U(k) and so we can write every element in U(g) as a linear combination of terms of the form ω2ω1ωk where ωk ∈ U(k), ω1 ∈ U(h) and ω2 ∈ U(h′). Suppose now that π be an irreducible unitary (g,K)-module. Then π is K ∩H-admissible if and only if it is K∩H ′-admissible and by Theorem 4.2 of [12] its restriction to h is a direct sum of irreducible (h,K∩H)-modules if and only if π is a direct sum of irreducible (h′,K∩H ′)-modules. Suppose that π is H ∩ K admissible and that Vk ⊂ π is a minimal K-type of π. If πo is a (h,K ∩H)-module, which occurs in the restriction of π to h then πo ∩ U(h′)Vk 6= 0. 6.2. These observations allow us to better understand the restriction of Aq to the pseudo dual pair H1=Sp(2, R), H ′ 1= GL(2, C) in SL(4, R). The minimal K-type VK of Aq has highest weight 3α1 and is also irreducible under K∩H1 = K∩H ′ 1. The (h′1,K∩H ′ 1)-submodule generated by VK is the minimal H ′ 1 type and is isomorphic to a spherical principal series representation. We draw a diagram of its K ∩H ′ 1-types using the same conventions as in the previous sections. The K ∩H ′ 1-types are on the black line in Fig. 6. Each K∩H1 = K∩H ′ 1-type of this representation is the minimal K∩H1-type of an irreducible (h1,K ∩H1)-module as indicated in Fig. 7. Branching Laws for Some Unitary Representations of SL(4, R) 15 Figure 7. Figure 8. Figure 9. The K ∩ H1 types of the minimal (h1,K ∩ H1)-module generated by the minimal K-type have multiplicity one and are indicated by the dots in Fig. 8. Each of the K ∩H1-types of this (h1,K ∩H1)-module is the minimal K ∩H1 = K ∩H ′ 1-type of a (h′1,K ∩H ′ 1)-module in the restriction of Aq to H ′ 1, as illustrated in Fig. 9. 7 More branching In this section we sketch the restriction to H1 and H ′ 1 of a representation Aq(λ1) with a parame- ter λ which is no longer in the weakly fair range and hence the representation is no longer irreducible and has a composition series of length 2. We indicate a procedure to use our previous techniques to compute the restriction of both composition factors of Aq(λ1) to H1 and H ′ 1. Using the local isomorphisms SL(4, R) ∼ SO(3, 3), Sp(2, R) ∼ SO(2, 3), SL(4, R) ∩GL(2, C) ∼ SO(2)× SO(1, 3) 16 B. Ørsted and B. Speh we obtain a different proof of a result by T. Kobayashi and B. Ørsted of the branching of the minimal representation π of SO(3, 3) to SO(3, 1)× SO(2) and to SO(3, 2) [17]. 7.1. We use the notation introduced in 3.1. Using the conventions on page 586 in [10] we denote the character of L by λ = m(e1 +e2 +e3 +e4). With this parametrization the representa- tion Aq(λ) is irreducible and unitary for m > −3 (see page 588 in [10]) and Aq corresponds to the parameter m = 0. The representation Aq(λ) for m = 3 is nonzero. To simplify the notation we denote the representation Aq(λ) for λ = m(e1 + e2 + e3 + e4) by Aq(m). We consider now the representation Aq(−3). This representation is nonzero and has a trivial K-type. It is not irreducible, but has 2 composition factors. One composition factor is Aq(−2). The other composition factor is a unitarily induced representation π0 from one dimensional representation of a maximal parabolic subgroup. It is a ladder representation and the highest weights of its K-types are multiples of e1. See [17] for SO(3, 3) or [1] for GL(4, R). The restriction of Aq(−3) to H1 ∩K are m1(e1 + e2) + 2m2e1, m1,m2 ∈ N. 7.2. The same arguments as in Sections 4 and 5. allows us to compute the restriction of Aq(−3) to H1 and H ′ 1. In this case the minimal H1 type is a spherical representation πH1 0 and comparing the multiplicities of K ∩H1-types of πH1 0 and of π0 we deduce that the restriction of π0 to H1 is irreducible and equal to πH1 0 . A similar argument show that the restriction to H ′ 1 is direct sum of principal series representations of GL(2, C). Using the local isomorphism SL(4, R) and SO(3, 3) we obtain a new proof of the branching of π0 determined by B. Ørsted and T. Kobayashi in [17]. 8 A conjecture 8.1. The examples in the previous section and the calculations in [14] support the following conjecture: Let H be the connected fixpoint set of an involution σ. We write again g = h ⊕ s. Let Aq(λ) be a representation, which is K ∩H-admissible and thus decomposes discretely, when restricted to H. Suppose q, qh are defined by xo ∈ TH . Since Aq = Ap if q and p are conjugate under the compact Weyl group WK we use the following Definition. Let yo ∈ TH and let p, pH be well aligned parabolic subalgebras defined by yo. We call the well aligned parabolic subalgebras p, pH related to q, qH , if xo and yo are conjugate by an element in the compact Weyl group WK of K with respect to T. If xo and yo are not conjugate by an element in the Weyl group WK∩H of (KH , TH) then the parabolic subalgebras qH , pH of H are not conjugate in H and thus we have up to conjugacy at most WK/WH∩K different pairs of well aligned pairs of θ-stable invariant parabolic subalgebras which are related to q, qH . If G = SL(4, R), H = H1 and (q, q ∩ h1) is the pair of well aligned parabolic subalgebras defined by x0 = Q2, there there are at most 2 related pairs of well aligned parabolic subalgebras. We expect the following Blattner-type formula to hold for the restriction to H: Conjecture. There exists a pair p, pH of well aligned θ-stable parabolic subgroups related to q, qH so that every H-type V of Aq is of the form ApH (µ) for a character µ of LH and that dim Homh,KH (V,Ap) = ∑ i ∑ j (−1)s−j dim HomL∩H(Hj(u ∩ h, V ), Si(u ∩ s)⊗ CλH ). Remark. Some of the characters µ in this formula may be out of the fair range as defined in [10] and hence reducible. Branching Laws for Some Unitary Representations of SL(4, R) 17 If H is the maximal compact subgroup K, then |WK/WH∩K | = 1, all related pairs of well aligned parabolic subalgebra are conjugate to q, qH and hence we get the usual Blattner formula (5.108b on page 376 in [10]). In the example discussed in this paper, G = SL(4, R), the representation Aq and H the symplectic group considered in Section 4, all related pairs of well aligned parabolic subalgebras are conjugate to q, qh1 and thus we obtain the Blattner type formula in Corollary 4.4. 9 An application to automorphic representations We use here our results to give different constructions of some known automorphic represen- tations of Sp(2, R) and GL(2, C). We first explain the ideas in 7.1 in a more general setting. Again we may consider restrictions, this time in the obvious way of restricting functions on locally symmetric spaces to locally symmetric subspaces. 9.1. Assume first that G is a semisimple matrix group and Γ an arithmetic subgroup, H a semi- simple subgroup of G. Then ΓH = Γ ∩H is an arithmetic subgroup of H. Let Vπ ⊂ L2(G/Γ) be an irreducible (g,K)-submodule of L2(G/Γ). If f ∈ Vπ then f is a C∞-function and so we define fH as the restriction of f to H/ΓH . Lemma 9.1. The map RESH : Vπ → C∞(H/ΓH) f → fH is an (h,K ∩H)-map. Proof. Let ht = exp(tXH), ho ∈ H. Then ρ(XH)f(ho) = d dt f(h−1 f h0)t=0 = d dt fH(h−1 t h0)t=0 = ρ(XH)fH(ho). � Suppose that the irreducible unitary (g,K)-module π is a submodule of L2(G/Γ) and that its restriction to H is a direct sum of unitary irreducible representations. Proposition 9.2. Under the above assumptions RESH(π) is nonzero and its image is contained in the automorphic functions on H/ΓH . Proof. Let fH be a function in RESH(π). Then by Section 2 it is K ∩ H-finite and we may assume that it is an eigenfunction of the center of U(h). Let ||g||2 = tr(g∗g). Since sup g∈G |f(g)| ||g||−r < ∞, the same is true for fH and so fH is an automorphic function on H/ΓH . The functions in the (g,K)-module π ⊂ L2(G/Γ) are eigenfunctions of the center of the enveloping algebra U(g) and are K-finite, hence analytic. Thus if f is a K-finite function in π ⊂ L2(G/Γ) then there exists W ∈ U(g) so that Wf(e) 6= 0. Hence RESH(Wf) 6= 0. � Instead of restricting the automorphic function f to the orbit of e/Γ under H we may also consider the restriction to an orbit of γ/Γ, for rational γ. Since the rational elements are dense at least one of the restrictions is not zero. So following Oda we consider the restriction correspondence for functions on G/Γ to functions on ∏ g H/H ∩ gΓg−1. For rational g the intersection Γ ∩ gΓg−1 contains an arithmetic group Γ′ and Γ′ ∩H is an arithmetic subgroup. For more details see for example page 55 in [2]. 9.2. Now we assume that G = GL(4, R) and that Γ ⊂ GL(4, Z) is a congruence subgroup. The groups Γ1 = Γ∩H1 and Γ′1 = Γ∩H ′ 1 are arithmetic subgroups of Sp(4, R), respectively GL(2, C). 18 B. Ørsted and B. Speh Recall the definition of the (g,K)-module Aq from 3.1. It is a submodule of L2(Z\G/Γ) for Γ small enough where Z the connected component of the center of GL(4, R). We will for the remainder of this sections consider it as an automorphic representation in the residual spectrum [23]. Then RESH1(Aq) and RESH′ 1 (Aq) are nonzero. Its discrete summands are contained in the space of automorphic forms. Theorem 9.3. The discrete summands of the two representations RESH1(Aq) respectively RESH′ 1 (Aq) are subrepresentations of the discrete spectrum of L2(H1/ΓH1), respectively L2(H ′ 1/Γ′H1 ). Proof. All the functions in Aq decay rapidly at the cusps. Since the cusps of H1/ΓH1 are contained in the cusps of G/Γ this is true for the functions in RESH1(Aq). Thus they are also contained in the discrete spectrum. � For Sp(2, R) the representations constructed in the previous theorem were first described by H. Kim (see [9] and [22]). For GL(2, C) we obtain the stronger result Theorem 9.4. The representations in the discrete spectrum of RESH′ 1 (Aq) are in the cuspidal spectrum of L2(H ′ 1/ΓH′ 1 ). Proof. By 5.2 the representations in the discrete spectrum of RESH′ 1 (Aq) are unitarily in- duced principal series representations and so by a result of Wallach they are in fact cuspidal representations. � The embedding of H ′ 1 = GL(2, C) into SL(4, R) is defined as follows: Write g = A+ iB with real matrices A, B. Then g → ( A B −B A ) . Thus ΓH′ 1 is isomorphic to a congruence subgroup of GL(2, Z[i]). Since all the representations in the discrete spectrum of the restriction of Aq do have nontrivial (h,KH)-cohomology with respect to some irreducible finite dimensional nontrivial representa- tion F we obtained the well known result [5, 20]. Corollary 9.5. There exists a congruence subgroup Γ ⊂ GL(2, Z[i]) and a finite dimensional non-trivial representation F of GL(2, C) so that H i(Γ, F ) 6= 0 for i = 1, 2. Acknowledgements We would like to thank T. Kobayashi for helpful discussions during a visit of the second author at RIMS and for the suggestion to also include the restriction to GL(2, C). The second author would also like to thank the University of Southern Denmark in Odense for its hospitality during which part of the research was completed. BS partially supported by NSF grant DMS-0070561. References [1] Barbasch D., Sahi S., Speh B., Degenerate series representations for GL(2n, R) and Fourier analysis, Sym- posia Mathematica, Vol. XXXI (1988, Rome), Sympos. Math., Vol. XXXI, Academic Press, London, 1990, 45–69. [2] Clozel L., Venkataramana T.N., Restriction of the holomorphic cohomology of a Shimura variety to a smaller Shimura variety, Duke Math. J. 95 (1998), 51–106. Branching Laws for Some Unitary Representations of SL(4, R) 19 [3] Gross B., Prasad D., On the decomposition of a representation of SOn when restricted to SOn−1, Canadian J. Math. 44 (1992), 974–1002. [4] Gross B., Wallach N., Restriction of small discrete series representations to symmetric subgroups, in The Mathematical Legacy of Harish-Chandra (1998, Baltimore, MD), Proc. Sympos. Pure Math., Vol. 68, Amer. Math. Soc., Providence, RI, 2000, 255–272. [5] Harder G., On the cohomology of SL(2, O), in Lie Groups and Their Representations (Proceedings Summer School on Groups Representations of the Bolyai Janos Math. Soc. Budapest, 1971), Halsted, New York, 1975, 139–150. [6] Hecht H., Schmid W., A proof of Blatner’s conjecture, Invent. Math. 31 (1976), 129–154. [7] Howe R., Reciprocity laws in the theory of dual pairs, in Representation Theory of Reductive Groups, Editor P. Trombi, Progr. Math., Vol. 40, Birkhäuser Boston, Boston, MA, 1983, 159–175. [8] Jacobsen H.P., Vergne M., Restriction and expansions of holomorphic representations, J. Funct. Anal. 34 (1979), 29–53. [9] Kim H., The residual spectrum of Sp4, Compositio Math. 99 (1995), 129–151. [10] Knapp A.W., Vogan D.A. Jr., Cohomological induction and unitary representations, Princeton Mathematical Series, Vol. 45, Princeton University Press, Princeton, NJ, 1995. [11] Kobayashi T., Harmonic analysis on homogeneous manifolds of reductive type and unitary representation theory, in Selected Papers on Harmonic Analysis, Groups and Invariants, Editor K. Nomizu, Amer. Math. Soc. Transl. Ser. 2, Vol. 183, Amer. Math. Soc., Providence, RI, 1998, 1–31 (and references therein). [12] Kobayashi T., Discretely decomposable restrictions of unitary representations of reductive Lie groups – examples and conjectures, in Analysis on Homogeneous Spaces and Representation Theory of Lie Groups, Editor T. Kobayashi, Advanced Studies in Pure Mathematics, Vol. 26, Kinokuniya, Tokyo, 2000, 99–127. [13] Kobayashi T., Discrete series representations for the orbit spaces arising from two involutions of real reductive groups, J. Funct. Anal. 152 (1998), 100–135. [14] Kobayashi T., Discrete decomposability of the restriction of Aq(λ) with respect to reductive subgroups. III. Restriction of Harish-Chandra modules and associated varieties, Invent. Math. 131 (1997), 229–256. [15] Kobayashi T., The restriction of Aq(λ) to reductive subgroups, Proc. Japan Acad. Ser. A Math. Sci. 69 (1993), no. 7, 262–267. [16] Kobayashi T., Discrete decomposability of the restriction of Aq(λ) with respect to reductive subgroups and its applications, Invent. Math. 117 (1994), 181–205. [17] Kobayashi T., Ørsted B., Conformal geometry and branching laws for unitary representations attached to minimal nilpotent orbits, C. R. Acad. Sci. Paris 326 (1998), 925–930. [18] Loke H., Restrictions of quaternionic representations, J. Funct. Anal. 172 (2000), 377–403. [19] Martens S., The characters of the holomorphic discrete series, Proc. Nat. Acad. Sci. USA 72 (1976), 3275– 3276. [20] Rohlfs J., On the cuspidal cohomology of the Bianchi modular groups, Math. Z. 188 (1985), 253–269. [21] Sahi S., Stein E., Analysis in matrix space and Speh’s representations. Invent. Math. 101 (1990), 379–393. [22] Schwermer J., On Euler products and residual cohomology classes for Siegel modular varieties, Forum Math. 7 (1995), 1–28. [23] Speh B., Unitary representations of GL(n, R) with nontrivial (g, K)-cohomology, Invent. Math. 71 (1983) 443–465. [24] Vargas J., Restriction of some discrete series representations, Algebras Groups Geom. 18 (2001), 85–100. [25] Vargas J., Restriction of holomorphic discrete series to real forms, Rend. Sem. Mat. Univ. Politec. Torino, to appear. [26] Vogan D. Jr., Representations of real reductive Lie groups, Birkhäuser, Boston, 1981. [27] Wolf J., Representations that remain irreducible on parabolic subgroups, in Differential Geometrical Me- thods in Mathematical Physics IV (Proceedings, Aix–en–Provènce and Salamanca, 1979), Springer Lecture Notes in Mathematics, Vol. 836, Springer, Berlin, 1980, 129–144. [28] Zhang G., Berezin transform of holomorphic discrete series on real bounded symmetric domains, Trans. Amer. Math. Soc. 353 (2001), 3769–3787. 1 Introduction 2 Notation and generalities 3 The restriction of Aq to KHi, i=1,2 4 The restriction of Aq to the symplectic group H1 5 Restriction of Aq to the group H1' 6 Pseudo dual pairs 7 More branching 8 A conjecture 9 An application to automorphic representations References
id nasplib_isofts_kiev_ua-123456789-148973
institution Digital Library of Periodicals of National Academy of Sciences of Ukraine
issn 1815-0659
language English
last_indexed 2025-12-07T17:27:47Z
publishDate 2008
publisher Інститут математики НАН України
record_format dspace
spelling Ørsted, B.
Speh, B.
2019-02-19T12:19:09Z
2019-02-19T12:19:09Z
2008
Branching Laws for Some Unitary Representations of SL(4,R) / B. Ørsted, B. Speh // Symmetry, Integrability and Geometry: Methods and Applications. — 2008. — Т. 4. — Бібліогр.: 28 назв. — англ.
1815-0659
2000 Mathematics Subject Classification: 22E47; 11F70
https://nasplib.isofts.kiev.ua/handle/123456789/148973
In this paper we consider the restriction of a unitary irreducible representation of type Aq(λ) of GL(4,R) to reductive subgroups H which are the fixpoint sets of an involution. We obtain a formula for the restriction to the symplectic group and to GL(2,C), and as an application we construct in the last section some representations in the cuspidal spectrum of the symplectic and the complex general linear group. In addition to working directly with the cohmologically induced module to obtain the branching law, we also introduce the useful concept of pseudo dual pairs of subgroups in a reductive Lie group.
This paper is a contribution to the Proceedings of the 2007 Midwest Geometry Conference in honor of Thomas P. Branson. We would like to thank T. Kobayashi for helpful discussions during a visit of the second author at RIMS and for the suggestion to also include the restriction to GL(2, C). The second author would also like to thank the University of Southern Denmark in Odense for its hospitality during which part of the research was completed. BS partially supported by NSF grant DMS-0070561.
en
Інститут математики НАН України
Symmetry, Integrability and Geometry: Methods and Applications
Branching Laws for Some Unitary Representations of SL(4,R)
Article
published earlier
spellingShingle Branching Laws for Some Unitary Representations of SL(4,R)
Ørsted, B.
Speh, B.
title Branching Laws for Some Unitary Representations of SL(4,R)
title_full Branching Laws for Some Unitary Representations of SL(4,R)
title_fullStr Branching Laws for Some Unitary Representations of SL(4,R)
title_full_unstemmed Branching Laws for Some Unitary Representations of SL(4,R)
title_short Branching Laws for Some Unitary Representations of SL(4,R)
title_sort branching laws for some unitary representations of sl(4,r)
url https://nasplib.isofts.kiev.ua/handle/123456789/148973
work_keys_str_mv AT ørstedb branchinglawsforsomeunitaryrepresentationsofsl4r
AT spehb branchinglawsforsomeunitaryrepresentationsofsl4r