This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

Periods and (χ,b)(\chi,b)-factors of Cuspidal Automorphic Forms of Metaplectic Groups

Chenyan Wu School of Mathematics and Statistics, The University of Melbourne, Victoria, 3010, Australia [email protected]
Abstract.

We give constraints on the existence of (χ,b)(\chi,b)-factors in the global AA-parameter of a genuine cuspidal automorphic representation σ\sigma of a metaplectic group in terms of the invariant, lowest occurrence index, of theta lifts to odd orthogonal groups. We also give a refined result that relates the invariant, first occurrence index, to non-vanishing of period integrals of residues of Eisenstein series associated to the cuspidal datum χσ\chi\otimes\sigma. This complements our previous results for symplectic groups.

Key words and phrases:
Arthur Parameters; Poles of L-functions; Periods of Automorphic Forms; Theta Correspondence; Arthur Truncation of Eisenstein Series and Residues
The research is supported in part by General Program of National Natural Science Foundation of China (11771086), National Natural Science Foundation of China (#11601087) and by Program of Shanghai Academic/Technology Research Leader (#16XD1400400).

Introduction

Let GG be a classical group over a number field FF. Let 𝔸\mathbb{A} be the ring of adeles of FF. Let σ\sigma be an automorphic representation of G(𝔸)G(\mathbb{A}) in the discrete spectrum, though later we consider only cuspidal automorphic representations. By the theory of endoscopic classification developed by [3] and extended by [31, 24], one attaches a global AA-parameter to σ\sigma. These works depend on the stabilisation of the twisted trace formula which has been established by a series of works by Mœglin and Waldspurger. We refer the readers to their books [33, 34]. Via the Shimura–Waldspurger correspondence of the metaplectic group Mp2n(𝔸)\operatorname{\mathrm{Mp}}_{2n}(\mathbb{A}), which is the non-trivial double cover of the symplectic group Sp2n(𝔸)\operatorname{\mathrm{Sp}}_{2n}(\mathbb{A}), and odd special orthogonal groups, Gan and Ichino [9] also attached global AA-parameters to genuine automorphic representations of Mp2n(𝔸)\operatorname{\mathrm{Mp}}_{2n}(\mathbb{A}) in the discrete spectrum. This depends on the choice of an additive character ψ\psi that is used in the Shimura–Waldspurger correspondence. In this introduction, we also let GG denote Mp2n\operatorname{\mathrm{Mp}}_{2n} by abuse of notation and we suppress the dependence on ψ\psi. The AA-parameter ϕ(σ)\phi(\sigma) of σ\sigma is a formal sum

ϕ(σ)=i(τi,bi)\phi(\sigma)=\boxplus_{i}(\tau_{i},b_{i})

where τi\tau_{i} is an irreducible self-dual cuspidal automorphic representation of some GLni(𝔸)\operatorname{\mathrm{GL}}_{n_{i}}(\mathbb{A}), bib_{i} is a positive integer which represents the unique bib_{i}-dimensional irreducible representation of Arthur’s SL2()\operatorname{\mathrm{SL}}_{2}(\mathbb{C}), together with some conditions on (τi,bi)(\tau_{i},b_{i}) so that the type is compatible with the type of the dual group of GG. When GG is a unitary group, then we need to introduce a quadratic field extension of FF. As this case is not the focus of this article, we refer the readers to [42, Sec. 1.3] for details. The exact conditions for Mp2n\operatorname{\mathrm{Mp}}_{2n} are spelled out in Sec. 2. Here we have adopted the notation of [19] where the theory of (τ,b)(\tau,b) was introduced.

One principle of the (τ,b)(\tau,b)-theory is that if ϕ(σ)\phi(\sigma) has (τ,b)(\tau,b) as a simple factor, then there should exist a kernel function constructed out of (τ,b)(\tau,b) that transfers σ\sigma to a certain automorphic representation 𝒟(σ)\mathcal{D}(\sigma) in the AA-packet attached to ‘ϕ(σ)(τ,b)\phi(\sigma)\boxminus(\tau,b)’, i.e., ϕ(σ)\phi(\sigma) with the factor (τ,b)(\tau,b) removed. From the work of Rallis [36] and Kudla–Rallis [25], it is clear when τ\tau is a character χ\chi, the kernel function is the theta kernel possibly twisted by χ\chi. (See Sec. 7 of [19].)

Now we focus on the case of the metaplectic groups. We will put the additive character ψ\psi back into the notation to emphasise, for example, that the LL-functions etc. depend on it. Let XX be a 2n2n-dimensional symplectic space. We will now write G~(X)\widetilde{G}(X) for Mp2n\operatorname{\mathrm{Mp}}_{2n} to match the notation in the body of the article.

The poles of the tensor product LL-function Lψ(s,σ×τ)L_{\psi}(s,\sigma\times\tau) detect the existence of (τ,b)(\tau,b)-factors in the AA-parameter ϕψ(σ)\phi_{\psi}(\sigma). As a first step, we consider the case when τ\tau is a quadratic automorphic character χ\chi of GL1(𝔸)\operatorname{\mathrm{GL}}_{1}(\mathbb{A}). The LL-function Lψ(s,σ×χ)L_{\psi}(s,\sigma\times\chi) has been well-studied. By the regularised Rallis inner product formula [25] which was proved using the regularised Siegel-Weil formula also proved there and the doubling method construction [35] (see also [29, 6, 43]), the partial LL-function LψS(s,σ×χ)L_{\psi}^{S}(s,\sigma\times\chi) detects whether the theta lifts of σ\sigma to the odd orthogonal groups in certain Witt towers vanish or not. The complete theory that interprets the existence of poles or non-vanishing of the complete LL-function as the obstruction to the local-global principle of theta correspondence was done in [43] and then extended to the ‘second term’ range by [11]. We will relate certain invariants of the theta lifts of σ\sigma to the existence of (χ,b)(\chi,b)-factors in the AA-parameter ϕψ(σ)\phi_{\psi}(\sigma).

We now describe our main results which are concerned with the metaplectic case, while pointing out the similarity to the statements in the symplectic case. Let LOψ,χ(σ)\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma) denote the lowest occurrence index of σ\sigma in the theta correspondence to all Witt towers associated to the quadratic character χ\chi. (See Sec. 4 for the precise definition.) Let 𝒜cusp(G~(X))\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) denote the set of all irreducible genuine cuspidal automorphic representations of G~(X)(𝔸)\widetilde{G}(X)(\mathbb{A}). We note that there is no algebraic group G~(X)\widetilde{G}(X) and that the notation is used purely for aesthetic reason. Then we get the following constraint on (χ,b)(\chi,b)-factors of ϕψ(σ)\phi_{\psi}(\sigma) in terms of the invariant LOψ,χ(σ)\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma).

Theorem 0.1 (Thm. 4.4).

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and χ\chi be a quadratic automorphic character of 𝔸×\mathbb{A}^{\times}. Let ϕψ(σ)\phi_{\psi}(\sigma) denote the A-parameter of σ\sigma with respect to ψ\psi. Then the following hold.

  1. (1)

    If ϕψ(σ)\phi_{\psi}(\sigma) has a (χ,b)(\chi,b)-factor, then b12dimX+1b\leq\frac{1}{2}\dim X+1.

  2. (2)

    If ϕψ(σ)\phi_{\psi}(\sigma) has a (χ,b)(\chi,b)-factor with bb maximal among all simple factors of ϕψ(σ)\phi_{\psi}(\sigma), then LOψ,χ(σ)dimXb+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\leq\dim X-b+1.

  3. (3)

    If LOψ,χ(σ)=2j+1<dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1<\dim X+2, then ϕψ(σ)\phi_{\psi}(\sigma) cannot have a (χ,b)(\chi,b)-factor with bb maximal among all simple factors of ϕψ(σ)\phi_{\psi}(\sigma) and b>dimX2jb>\dim X-2j.

  4. (4)

    If LOψ,χ(σ)=2j+1>dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1>\dim X+2, then ϕψ(σ)\phi_{\psi}(\sigma) cannot have a (χ,b)(\chi,b)-factor with bb maximal among all simple factors of ϕψ(σ)\phi_{\psi}(\sigma).

Remark 0.2.

Coupled with the results of [23], we see that in both the Sp\operatorname{\mathrm{Sp}} and Mp\operatorname{\mathrm{Mp}} cases, if ϕ(σ)\phi(\sigma) has a (χ,b)(\chi,b)-factor with bb maximal among all simple factors, then LOχ,ψ(σ)dimXb+1\operatorname{\mathrm{LO}}_{\chi,\psi}(\sigma)\leq\dim X-b+1.

The symplectic analogue of our result on the existence of (χ,b)(\chi,b)-factors in the AA-parameter of σ\sigma is a key input to [20, Sec. 5] which gives a bound on the exponent that measures the departure from temperedness of the local components of cuspidal automorphic representations. In this sense, our results have bearings on the generalised Ramanujan conjecture as proposed in [38].

Following an idea of Mœglin’s in [30] which considered the even orthogonal and the symplectic case, we consider, instead of the partial LL-function LS(s,σ×χ)L^{S}(s,\sigma\times\chi), the Eisenstein series E(g,fs)E(g,f_{s}) attached to the cuspidal datum χσ\chi\otimes\sigma (c.f. Sec. 3). The theorem above is derived from our results on poles of E(g,fs)E(g,f_{s}). We get much more precise relation between poles of the Eisenstein series and LOψ,χ(σ)\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma). This line of investigation has been taken up by [10] in the odd orthogonal group case and by [22, 42] in the unitary group case. We treat the metaplectic group case in this paper. Let 𝒫1(χ,σ)\mathcal{P}_{1}(\chi,\sigma) denote the set of all positive poles of the Eisenstein series we consider. Then we get:

Theorem 0.3 (Thm. 6.4).

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and let s0s_{0} be the maximal element in 𝒫1(χ,σ)\mathcal{P}_{1}(\chi,\sigma). Write s0=12(dimX+1)js_{0}=\frac{1}{2}(\dim X+1)-j. Then

  1. (1)

    jj is an integer such that 14(dimX2)j<12(dimX+1)\frac{1}{4}(\dim X-2)\leq j<\frac{1}{2}(\dim X+1).

  2. (2)

    LOψ,χ(σ)=2j+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1.

Remark 0.4.

Coupled with the results of [23], we see that s0s_{0} is a non-integral half-integer in (0,14dimX+1](0,\frac{1}{4}\dim X+1] in the Mp\operatorname{\mathrm{Mp}} case and an integer in the same range in the Sp\operatorname{\mathrm{Sp}} case; and LOψ,χ(σ)=dimX+22s0\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=\dim X+2-2s_{0} in both cases.

It is known by Langlands’ theory [27] of Eisenstein series that the pole in the theorem is simple. (See also [32].) We note that the equality in the theorem is actually informed by considering periods of residues of the Eisenstein series. We get only the upper bound 2j+12j+1 by considering only poles of Eisenstein series. The odd orthogonal case was considered in [10], the symplectic case in [23] and the unitary case in [42]. Each case has its own technicalities. In this paper, we extend all results in the symplectic case to the metaplectic case to complete the other half of the picture. As pointed out in [6], unlike the orthogonal or symplectic case, the local factors change in the metaplectic case when taking contragredient. Thus it is important, in the present case, to employ complex conjugation in the definition of the global theta lift.

Let FOψY(σ)\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma) denote the first occurrence index of σ\sigma in the Witt tower of YY where YY is a quadratic space (c.f. Sec. 4). We get a result on FOψY(σ)\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma) and the non-vanishing of periods of residues of the Eisenstein series (or distinction by subgroups of G(X)G(X)). Note that FOψY(σ)\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma) is a finer invariant than LOψ,χ(σ)\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma) while the non-vanishing of periods of residues provides more information than locations of simple poles do. The following theorem is part of Cor. 6.3. Let s0(g,fs)\mathcal{E}_{s_{0}}(g,f_{s}) denote the residue of the Eisenstein series E(g,fs)E(g,f_{s}) at s=s0s=s_{0} and let θψ,X1,Y(g,1,Φ)\theta_{\psi,X_{1},Y}(g,1,\Phi) be the theta function attached to the Schwartz function Φ\Phi. The space X1X_{1} is the symplectic space formed by adjoining a hyperbolic plane to XX and similarly Z1Z_{1} is formed by adjoining the same hyperbolic place to ZZ. Thus Z1X1Z_{1}\subset X_{1}. Let LZZ1L\subset Z\subset Z_{1} be a totally isotropic subspace. Then the group J(Z1,L)J(Z_{1},L) is defined to be the subgroup of G(Z1)G(Z_{1}) that fixes LL element-wise.

Theorem 0.5.

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and let YY be an anisotropic quadratic space of odd dimension. Assume that FOψY(σ)=dimY+2r\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma)=\dim Y+2r. Let s0=12(dimX(dimY+2r)+2)s_{0}=\frac{1}{2}(\dim X-(\dim Y+2r)+2). Then s0s_{0} is a pole of E(g,fs)E(g,f_{s}) for some choice of the section fsf_{s}. Assume further that s0>0s_{0}>0. Then there exist a non-degenerate symplectic subspace ZZ of XX and an isotropic subspace LL of ZZ satisfying dimXdimZ+dimL=r\dim X-\dim Z+\dim L=r and dimLr(mod2)\dim L\equiv r\pmod{2} with dimL=0\dim L=0 or 11 such that s0(g,fs)θψ,X1,Y(g,1,Φ)¯\mathcal{E}_{s_{0}}(g,f_{s})\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)} is J(Z1,L)J(Z_{1},L)-distinguished for some choice of the section fsf_{s} and the Schwartz function Φ\Phi.

We hope our period integrals can inform problems in Arithmetic Geometry. For example, similar work in [10] has been used in [4]. (See also [5] and [14]). It should be pointed out that unlike the orthogonal or the unitary case, our period integrals may involve a Jacobi group J(Z1,L)J(Z_{1},L) when LL is non-trivial (which occurs half of the time). This is to account for the lack of ‘odd symplectic group’.

The structure of the paper is as follows. Since we aim to generalise results of symplectic groups to metaplectic groups, we try not deviate too much from the structure of [23]. Many of the results there generalise readily, in which case, we put in a few words to explain why this is so. However at several points, new input is needed to get the proof through, in which case, we derive the results in great detail, noting all the subtleties. We hope in this way, this article makes the flow of arguments more evident than [23] in which we dealt with many technicalities.

In Sec. 1, we set up some common notation and in Sec. 2, we describe the global AA-parameters of genuine automorphic representations of the metaplectic group following [9]. In Sec. 3, we introduce the Eisenstein series attached to the cuspidal datum χσ\chi\otimes\sigma and deduce results on their maximal poles. In Sec. 4, we define the two invariants, the first occurrence index and the lowest occurrence index of theta lifts. We deduce a preliminary result on the relation between the lowest occurrence index and the maximal pole of the Eisenstein series and hence get a characterisation of the locations of poles of the partial LL-function. In this way, we are able to show that the lowest occurrence index poses constraints on the existence of (χ,b)(\chi,b)-factors in the AA-parameter of σ\sigma. Then in Sec. 5, we turn to studying Fourier coefficients of theta lifts and we get results on vanishing and non-vanishing of certain periods on σ\sigma. Inspired by these period integrals, in Sec. 6, we study the augmented integrals which are periods of residues of Eisenstein series. We make use of the Arthur truncation to regularise the integrals. We derive results on first occurrence indices and the vanishing and the non-vanishing of periods of residues of Eisenstein series. To evaluate our period integral, we cut it into many pieces according to certain orbits in a flag variety in Sec. 6 and we devote Sec. 7 to the computation of each piece.

Acknowledgement

The author would like to thank her post-doctoral mentor, Dihua Jiang, for introducing her to the subject and leading her down this fun field of research.

1. Notation and Preliminaries

Since this article aims at generalising results in [23] to the case of metaplectic groups, we will adopt similar notation to what was used there.

Let FF be a number field and 𝔸=𝔸F\mathbb{A}=\mathbb{A}_{F} be its ring of adeles. Let (X,,X)(X,\langle{\ },{\ }\rangle_{X}) be a non-degenerate symplectic space over FF. For a non-negative integer aa, let a\mathcal{H}_{a} be the direct sum of aa copies of the hyperbolic plane. We form the augmented symplectic space XaX_{a} by adjoining a\mathcal{H}_{a} to XX. Let e1+,,ea+,e1,,eae_{1}^{+},\ldots,e_{a}^{+},e_{1}^{-},\ldots,e_{a}^{-} be a basis of a\mathcal{H}_{a} such that ei+,ej=δij\langle{e_{i}^{+}},{e_{j}^{-}}\rangle=\delta_{ij} and ei+,ej+=ei,ej=0\langle{e_{i}^{+}},{e_{j}^{+}}\rangle=\langle{e_{i}^{-}},{e_{j}^{-}}\rangle=0, for i,j=1,,ai,j=1,\ldots,a, where δij\delta_{ij} is the Kronecker delta. Let a+\ell_{a}^{+} (resp. a\ell_{a}^{-}) be the span of ei+e_{i}^{+}’s (resp. eie_{i}^{-}’s). Then a=a+a\mathcal{H}_{a}=\ell_{a}^{+}\oplus\ell_{a}^{-} is a polarisation of a\mathcal{H}_{a}. Let G(Xa)G(X_{a}) be the isometry group of XaX_{a} with the action on the right.

Let LL be an isotropic subspace of XX. Let Q(X,L)Q(X,L) denote the parabolic subgroup of G(X)G(X) that stabilises LL and let N(X,L)N(X,L) denote its unipotent radical. We write QaQ_{a} (resp. NaN_{a}) for Q(Xa,a)Q(X_{a},\ell_{a}^{-}) (resp. N(Xa,a)N(X_{a},\ell_{a}^{-})) as shorthand. We also write MaM_{a} for the Levi subgroup of QaQ_{a} such that with respect to the ‘basis’ a+,X,a\ell_{a}^{+},X,\ell_{a}^{-}, MaM_{a} consists of elements of the form

m(x,h)=(xhx)G(Xa)m(x,h)=\begin{pmatrix}x&&\\ &h&\\ &&x^{*}\end{pmatrix}\in G(X_{a})

for xGLax\in\operatorname{\mathrm{GL}}_{a} and hG(X)h\in G(X) where xx^{*} is the adjoint of xx. Fix a maximal compact subgroup KG(X),vK_{G(X),v} of G(X)(Fv)G(X)(F_{v}) for each place vv of FF and set KG(X)=vKG(X),vK_{G(X)}=\prod_{v}K_{G(X),v}. We require that KG(X)K_{G(X)} is good in the sense that the Iwasawa decomposition holds and that it is compatible with the Levi decomposition (c.f. [32, I.1.4]). Most often we abbreviate KG(Xa)K_{G(X_{a})} as KaK_{a}.

Next we describe the metaplectic groups. Let vv be a place of FF. Let G~(Xa)(Fv)\widetilde{G}(X_{a})(F_{v}) denote the metaplectic double cover of G(Xa)(Fv)G(X_{a})(F_{v}). It sits in the unique non-trivial central extension

1μ2G~(Xa)(Fv)G(Xa)(Fv)11\rightarrow\mu_{2}\rightarrow\widetilde{G}(X_{a})(F_{v})\rightarrow G(X_{a})(F_{v})\rightarrow 1

unless Fv=F_{v}=\mathbb{C}, in which case, the double cover splits. Let G~(Xa)(𝔸)\widetilde{G}(X_{a})(\mathbb{A}) be the double cover of G(Xa)(𝔸)G(X_{a})(\mathbb{A}) defined as the restricted product of G~(Xa)(Fv)\widetilde{G}(X_{a})(F_{v}) over all places vv modulo the group

{(ζv)vμ2|vζv=1}.\{(\zeta_{v})\in\oplus_{v}\mu_{2}|\prod_{v}\zeta_{v}=1\}.

We note that there is a canonical lift of G(X)(F)G(X)(F) to G~(X)(𝔸)\widetilde{G}(X)(\mathbb{A}) and that G~(X)(Fv)\widetilde{G}(X)(F_{v}) splits uniquely over any unipotent subgroup of G(X)(Fv)G(X)(F_{v}).

Fix a non-trivial additive character ψ:F\𝔸1\psi:F\operatorname{\backslash}\mathbb{A}\rightarrow\mathbb{C}^{1}. It will be used in the construction of the Weil representation that underlies the theta correspondence and the definition of Arthur parameters for cuspidal automorphic representations of the metaplectic group. For any subgroup HH of G(Xa)(𝔸)G(X_{a})(\mathbb{A}) (resp. G(Xa)(Fv)G(X_{a})(F_{v})) we write H~\widetilde{H} for its preimage in G~(Xa)(𝔸)\widetilde{G}(X_{a})(\mathbb{A}) (resp. G~(Xa)(Fv)\widetilde{G}(X_{a})(F_{v})). We note that GLa(Fv)\operatorname{\mathrm{GL}}_{a}(F_{v}) occurs as a direct factor of Ma(Fv)M_{a}(F_{v}) and on GL~a(Fv)\widetilde{\operatorname{\mathrm{GL}}}_{a}(F_{v}) multiplication is given by

(g1,ζ1)(g2,ζ2)=(g1g2,ζ1ζ2(det(g1),det(g2))v)(g_{1},\zeta_{1})(g_{2},\zeta_{2})=(g_{1}g_{2},\zeta_{1}\zeta_{2}(\det(g_{1}),\det(g_{2}))_{v})

which has a Hilbert symbol twist when multiplying the μ2\mu_{2}-part. Analogous to the notation m(x,h)m(x,h) above, we write

m~(x,h,ζ)=((xhx),ζ)G~(Xa)(𝔸)\widetilde{m}(x,h,\zeta)=(\begin{pmatrix}x&&\\ &h&\\ &&x^{*}\end{pmatrix},\zeta)\in\widetilde{G}(X_{a})(\mathbb{A})

for xGLa(𝔸)x\in\operatorname{\mathrm{GL}}_{a}(\mathbb{A}), hG(X)(𝔸)h\in G(X)(\mathbb{A}) and ζμ2\zeta\in\mu_{2}. There is also a local version.

As we integrate over automorphic quotients often, we write [H][H] for H(F)\H(𝔸)H(F)\operatorname{\backslash}H(\mathbb{A}) if HH is an algebraic group and [H~][\widetilde{H}] for H(F)\H~(𝔸)H(F)\operatorname{\backslash}\widetilde{H}(\mathbb{A}) if H~(𝔸)\widetilde{H}(\mathbb{A}) covers a subgroup H(𝔸)H(\mathbb{A}) of a metaplectic group.

Let 𝒜cusp(G~(X))\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) denote the set of all irreducible genuine cuspidal automorphic representations of G~(X)(𝔸)\widetilde{G}(X)(\mathbb{A}). We note that there is no algebraic group G~(X)\widetilde{G}(X) and that it is used purely for aesthetic reason.

2. Arthur Parameters

We recall the description of AA-parameters attached to genuine irreducible cuspidal automorphic representations of metaplectic groups from [9]. The AA-parameters are defined via those attached to irreducible automorphic representations of odd special orthogonal groups via Shimura–Waldspurger correspondence. In this section, we write Mp2n\operatorname{\mathrm{Mp}}_{2n} rather than G~(X)\widetilde{G}(X).

The global elliptic AA-parameters ϕ\phi for Mp2n\operatorname{\mathrm{Mp}}_{2n} are of the form:

ϕ=i(τi,bi)\phi=\boxplus_{i}(\tau_{i},b_{i})

where

  • τi\tau_{i} is an irreducible self-dual cuspidal automorphic representation of GLni(𝔸)\operatorname{\mathrm{GL}}_{n_{i}}(\mathbb{A});

  • bib_{i} is a positive integer which represents the unique bib_{i}-dimensional irreducible representation of SL2()\operatorname{\mathrm{SL}}_{2}(\mathbb{C})

such that

  • inibi=2n\sum_{i}n_{i}b_{i}=2n;

  • if bib_{i} is odd, then τi\tau_{i} is symplectic, that is, L(s,τi,2)L(s,\tau_{i},\wedge^{2}) has a pole at s=1s=1;

  • if bib_{i} is even, then τi\tau_{i} is orthogonal, that is, L(s,τi,Sym2)L(s,\tau_{i},\operatorname{\mathrm{Sym}}^{2}) has a pole at s=1s=1;

  • the factors (τi,bi)(\tau_{i},b_{i}) are pairwise distinct.

Given a global elliptic AA-parameter ϕ\phi for Mp2n\operatorname{\mathrm{Mp}}_{2n}, for each place vv of FF, we can attach a local AA-parameter

ϕv=i(ϕi,v,bi)\phi_{v}=\boxplus_{i}(\phi_{i,v},b_{i})

where ϕi,v\phi_{i,v} is the LL-parameter of τi,v\tau_{i,v} given by the local Langlands correspondence [28, 15, 13, 39] for GLni\operatorname{\mathrm{GL}}_{n_{i}}. We can write the local AA-parameter ϕv\phi_{v} as a homomorphism

ϕv:LFv×SL2()Sp2n()\phi_{v}:L_{F_{v}}\times\operatorname{\mathrm{SL}}_{2}(\mathbb{C})\rightarrow\operatorname{\mathrm{Sp}}_{2n}(\mathbb{C})

where LFvL_{F_{v}} is the local Langlands group, which is the Weil–Deligne group of FvF_{v} for vv non-archimedean and is the Weil group of FvF_{v} for vv archimedean. We associate to it the LL-parameter

φϕv:LFvSp2n()\displaystyle\varphi_{\phi_{v}}:L_{F_{v}}\rightarrow\operatorname{\mathrm{Sp}}_{2n}(\mathbb{C})
wϕv(w,(|w|12|w|12)).\displaystyle w\mapsto\phi_{v}(w,\begin{pmatrix}|w|^{\frac{1}{2}}&\\ &|w|^{-\frac{1}{2}}\end{pmatrix}).

Let L2(Mp2n)L^{2}(\operatorname{\mathrm{Mp}}_{2n}) denote the subspace of L2(Sp2n(F)\Mp2n(𝔸))L^{2}(\operatorname{\mathrm{Sp}}_{2n}(F)\operatorname{\backslash}\operatorname{\mathrm{Mp}}_{2n}(\mathbb{A})) on which μ2\mu_{2} acts as the non-trivial character. Let Ldisc2(Mp2n)L^{2}_{\operatorname{\mathrm{disc}}}(\operatorname{\mathrm{Mp}}_{2n}) denote the subspace of L2(Mp2n)L^{2}(\operatorname{\mathrm{Mp}}_{2n}) that is the direct sum of all irreducible sub-representations of L2(Mp2n)L^{2}(\operatorname{\mathrm{Mp}}_{2n}) under the action of Mp2n(𝔸)\operatorname{\mathrm{Mp}}_{2n}(\mathbb{A}). Let Lϕ,ψ2(Mp2n)L^{2}_{\phi,\psi}(\operatorname{\mathrm{Mp}}_{2n}) denote subspace of Ldisc2(Mp2n)L_{\operatorname{\mathrm{disc}}}^{2}(\operatorname{\mathrm{Mp}}_{2n}) generated by the full near equivalence class of πLdisc2(Mp2n)\pi\subset L_{\operatorname{\mathrm{disc}}}^{2}(\operatorname{\mathrm{Mp}}_{2n}) such that the LL-parameter of πv\pi_{v} with respect to ψ\psi is φϕv\varphi_{\phi_{v}} for almost all vv. We note here that for a genuine irreducible automorphic representation of the metaplectic group, its LL-parameter depends on the choice of an additive character ψ\psi. If one changes ψ\psi to ψa:=ψ(a)\psi_{a}:=\psi(a\cdot), the LL-parameter changes in the way prescribed in [9, Remark 1.3]. See also [12]. Then we have the decomposition:

Theorem 2.1 ([9, Theorem 1.1]).
Ldisc2(Mp2n)=ϕLϕ,ψ2(Mp2n).L^{2}_{\operatorname{\mathrm{disc}}}(\operatorname{\mathrm{Mp}}_{2n})=\oplus_{\phi}L^{2}_{\phi,\psi}(\operatorname{\mathrm{Mp}}_{2n}).

where ϕ\phi runs over global elliptic AA-parameters for Mp2n\operatorname{\mathrm{Mp}}_{2n}.

Thus we see that the AA-parameter of σ𝒜cusp(Mp2n)\sigma\in\mathcal{A}_{\mathrm{cusp}}(\operatorname{\mathrm{Mp}}_{2n}) has the factor (χ,b)(\chi,b) where χ\chi is a quadratic automorphic character of GL1(𝔸)\operatorname{\mathrm{GL}}_{1}(\mathbb{A}) and bb maximal among all factors if and only if the partial LL-function LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) has its rightmost pole at s=(b+1)/2s=(b+1)/2. The additive character ψ\psi used in the definition of the LL-function is required to agree with the one used in defining the AA-parameter of σ\sigma.

Remark 2.2.

We note that the partial LL-function LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) is as defined in [6] and [6, Sec. 6] shows that at each unramified place vv, the local LL-factor is equal to Lv(s,BCψ(σv)χv)L_{v}(s,\operatorname{\mathrm{BC}}_{\psi}(\sigma_{v})\otimes\chi_{v}) where BCψ\operatorname{\mathrm{BC}}_{\psi} denotes the base change of σv\sigma_{v} to GL2n(Fv)\operatorname{\mathrm{GL}}_{2n}(F_{v}) with respect to ψv\psi_{v}. The LL-function is Lψ1S(s,σχ)L^{S}_{\psi^{-1}}(s,\sigma^{\vee}\otimes\chi) in the notation of [43]. Note that the degenerate principal series Iψ(s,χ)I_{\psi}(s,\chi) defined in [43, Sec. 3.1] is IP¯(WΔ),ψ1(s,χ)I_{\bar{P}(W^{\Delta}),\psi^{-1}}(s,\chi) in the notation of [6, Sec. 3] due to the use of right action in [43] and this accounts for the of use of ψ1\psi^{-1}, but then by [43, Prop. 5.4], it is equal to LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi).

3. Eisenstein series

For σ𝒜cusp(Mp2n)\sigma\in\mathcal{A}_{\mathrm{cusp}}(\operatorname{\mathrm{Mp}}_{2n}) and a quadratic automorphic character χ\chi of 𝔸×\mathbb{A}^{\times}, the LL-function Lψ(s,σ×χ)L_{\psi}(s,\sigma\times\chi) appears in the constant term of the Eisenstein series on G~(Xa)(𝔸)\widetilde{G}(X_{a})(\mathbb{A}) attached to the maximal parabolic subgroup QaQ_{a}. We study the poles of these Eisenstein series in this section.

Let 𝔞Ma=Rat(Ma)\mathfrak{a}_{M_{a}}^{*}=\operatorname{\mathrm{Rat}}(M_{a})\otimes_{\mathbb{Z}}\mathbb{R} and 𝔞Ma,=Rat(Ma)\mathfrak{a}_{M_{a},\mathbb{C}}^{*}=\operatorname{\mathrm{Rat}}(M_{a})\otimes_{\mathbb{Z}}\mathbb{C} where Rat(Ma)\operatorname{\mathrm{Rat}}(M_{a}) denotes the group of rational characters of MaM_{a}. Let 𝔞Ma=Hom(Rat(Ma),)\mathfrak{a}_{M_{a}}=\operatorname{\mathrm{Hom}}_{\mathbb{Z}}(\operatorname{\mathrm{Rat}}(M_{a}),\mathbb{R}). As QaQ_{a} is a maximal parabolic subgroup, 𝔞Ma\mathfrak{a}_{M_{a}}^{*}\cong\mathbb{R} and we identify 𝔞Ma,\mathfrak{a}_{M_{a},\mathbb{C}}^{*} with \mathbb{C} via ss(dimX+a+12)1ρQas\mapsto s(\frac{\dim X+a+1}{2})^{-1}\rho_{Q_{a}}, following [40], where ρQa\rho_{Q_{a}} is the half sum of the positive roots in NaN_{a}. Thus we may regard ρQa\rho_{Q_{a}} as the number (dimX+a+1)/2(\dim X+a+1)/2. In fact, it is clear that ρQa(m(x,h))=|detx|𝔸(dimX+a+1)/2\rho_{Q_{a}}(m(x,h))=|\det x|_{\mathbb{A}}^{(\dim X+a+1)/2} for m(x,h)Ma(𝔸)m(x,h)\in M_{a}(\mathbb{A}).

Let HaH_{a} be the homomorphism Ma(𝔸)𝔞MaM_{a}(\mathbb{A})\rightarrow\mathfrak{a}_{M_{a}} such that for mMa(𝔸)m\in M_{a}(\mathbb{A}) and ξ𝔞Ma\xi\in\mathfrak{a}_{M_{a}}^{*} we have exp(Ha(m),ξ)=v|ξ(mv)|v\exp(\langle{H_{a}(m)},{\xi}\rangle)=\prod_{v}|\xi(m_{v})|_{v}. We may think of Ha(m(x,h))𝔞MaH_{a}(m(x,h))\in\mathfrak{a}_{M_{a}}\cong\mathbb{R} as log(|detx|𝔸)\log(|\det x|_{\mathbb{A}}). We extend HaH_{a} to G(Xa)(𝔸)G(X_{a})(\mathbb{A}) via the Iwasawa decomposition and then to G~(Xa)(𝔸)\widetilde{G}(X_{a})(\mathbb{A}) via projection.

Let χψ\chi_{\psi} be the genuine character of GL~1(Fv)\widetilde{\operatorname{\mathrm{GL}}}_{1}(F_{v}) defined by

χψ((g,ζ))=ζγ(g,ψ1/2)1\chi_{\psi}((g,\zeta))=\zeta\gamma(g,\psi_{1/2})^{-1}

where γ(,ψ1/2)\gamma(\cdot,\psi_{1/2}), valued in the 4-th roots of unity, is defined via the Weil index. We note that the notation here agrees with that in [8, page 521]. Then via the determinant map, we get a genuine character of GL~a(Fv)\widetilde{\operatorname{\mathrm{GL}}}_{a}(F_{v}) which we also denote by χψ\chi_{\psi}.

Let σ\sigma be a genuine cuspidal automorphic representation of G~(X)(𝔸)\widetilde{G}(X)(\mathbb{A}). Let χ\chi be a quadratic automorphic character of GLa(𝔸)\operatorname{\mathrm{GL}}_{a}(\mathbb{A}). Then χχψ:(g,ζ)χ(g)χψ((g,ζ))\chi\chi_{\psi}:(g,\zeta)\mapsto\chi(g)\chi_{\psi}((g,\zeta)) gives a genuine automorphic character of GL~a(𝔸)\widetilde{\operatorname{\mathrm{GL}}}_{a}(\mathbb{A}). Let 𝒜a,ψ(s,χ,σ)\mathcal{A}_{a,\psi}(s,\chi,\sigma) denote the space of \mathbb{C}-valued smooth functions ff on Na(𝔸)Ma(F)\G~(Xa)(𝔸)N_{a}(\mathbb{A})M_{a}(F)\operatorname{\backslash}\widetilde{G}(X_{a})(\mathbb{A}) that satisfy the following properties:

  1. (1)

    ff is right K~a\widetilde{K}_{a}-finite;

  2. (2)

    for any (x,ζ)GL~a(𝔸)(x,\zeta)\in\widetilde{\operatorname{\mathrm{GL}}}_{a}(\mathbb{A}) and gG~(Xa)(𝔸)g\in\widetilde{G}(X_{a})(\mathbb{A}) we have

    f(m~(x,IX,ζ)g)=χχψ((x,ζ))|det(x)|𝔸s+ρQaf(g);f(\widetilde{m}(x,I_{X},\zeta)g)=\chi\chi_{\psi}((x,\zeta))|\det(x)|_{\mathbb{A}}^{s+\rho_{Q_{a}}}f(g);
  3. (3)

    for any fixed kK~ak\in\widetilde{K}_{a}, the function hf(m~(Ia,h,ζ)k)h\mapsto f(\widetilde{m}(I_{a},h,\zeta)k) on G~(X)(𝔸)\widetilde{G}(X)(\mathbb{A}) is a smooth right K~G(X)\widetilde{K}_{G(X)}-finite vector in the space of σ\sigma.

Let f𝒜a,ψ(0,χ,σ)f\in\mathcal{A}_{a,\psi}(0,\chi,\sigma) and ss\in\mathbb{C}. Since the metaplectic group splits over G(Xa)(F)G(X_{a})(F), we can form the Eisenstein series on the metaplectic group as in the case of non-cover groups:

E(g,s,f)=E(g,fs)=γQa(F)\G(Xa)(F)fs(γg)E(g,s,f)=E(g,f_{s})=\sum_{\gamma\in Q_{a}(F)\operatorname{\backslash}G(X_{a})(F)}f_{s}(\gamma g)

where fs(g)=exp(Ha(g),s)f(g)𝒜a,ψ(s,χ,σ)f_{s}(g)=\exp(\langle{H_{a}(g)},{s}\rangle)f(g)\in\mathcal{A}_{a,\psi}(s,\chi,\sigma). By the general theory of Eisenstein series [32, IV.1], it is absolute convergent for Res>ρQa\operatorname{\mathrm{Re}}s>\rho_{Q_{a}} and has meromorphic continuation to the whole ss-plane with finitely many poles in the half plane Res>0\operatorname{\mathrm{Re}}s>0, which are all real as we identify 𝔞Ma\mathfrak{a}_{M_{a}}^{*} with \mathbb{R}.

Let 𝒫a,ψ(χ,σ)\mathcal{P}_{a,\psi}(\chi,\sigma) denote the set of positive poles of E(g,s,f)E(g,s,f) for ff running over 𝒜a,ψ(0,χ,σ)\mathcal{A}_{a,\psi}(0,\chi,\sigma).

Proposition 3.1.

Assume that 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma) is non-empty and let s0s_{0} be its maximal member. Then for all integers a1a\geq 1, s=s0+12(a1)s=s_{0}+\frac{1}{2}(a-1) lies in 𝒫a,ψ(χ,σ)\mathcal{P}_{a,\psi}(\chi,\sigma) and is its maximal member.

Proof.

We remark how to carry over the proofs in [30] which treated orthogonal/symplectic case and [22] which treated the unitary case. The proofs relied on studying constant terms of the Eisenstein series, which are integrals over unipotent groups. Since the metaplectic group splits over the unipotent groups, the proofs carry over. We just need to replace occurrences of χ\chi in [22, Prop. 2.1] with the genuine character χχψ\chi\chi_{\psi}. ∎

Proposition 3.2.

Let SS be the set of places of FF that contains the archimedean places and outside of which ψ\psi, χ\chi and σ\sigma are unramified. Assume one of the following.

  • The partial LL-function LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) has a pole at s=s0>12s=s_{0}>\frac{1}{2} and that it is holomorphic for Res>s0\operatorname{\mathrm{Re}}s>s_{0}.

  • The partial LL-function LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) is non-vanishing at s=s0=12s=s_{0}=\frac{1}{2} and is holomorphic for Res>12\operatorname{\mathrm{Re}}s>\frac{1}{2}.

Then for all integers a1a\geq 1, s=s0+12(a1)𝒫a,ψ(σ,χ)s=s_{0}+\frac{1}{2}(a-1)\in\mathcal{P}_{a,\psi}(\sigma,\chi).

Proof.

By Langlands’ theory of Eisenstein series, the poles are determined by those of its constant terms. In our case, this amounts to studying the poles of the intertwining operator M(w,s)M(w,s) attached to the longest Weyl element ww in the Bruhat decomposition of Qa(F)\G(Xa)(F)/Qa(F)Q_{a}(F)\operatorname{\backslash}G(X_{a})(F)/Q_{a}(F). Those attached to shorter Weyl elements will not be able to cancel out the pole at s=s0+12(a1)s=s_{0}+\frac{1}{2}(a-1). For vSv\not\in S, the local intertwining operator Mv(w,s)M_{v}(w,s) sends the normalised spherical vector of the local component at vv of 𝒜a,ψ(s,χ,σ)\mathcal{A}_{a,\psi}(s,\chi,\sigma) to a multiple of the normalised spherical vector in another induced representation. The Gindikin-Karpelevich formula extended to the Brylinski-Deligne extensions by [7] shows that the ratio is

1jaLψS(s12(a1)+j1,σ×χ)LψS(s12(a1)+j,σ×χ)1ijaζS(2s(a1)+i+j2)ζS(2s(a1)+i+j1)\prod_{1\leq j\leq a}\frac{L^{S}_{\psi}(s-\frac{1}{2}(a-1)+j-1,\sigma\times\chi)}{L^{S}_{\psi}(s-\frac{1}{2}(a-1)+j,\sigma\times\chi)}\cdot\prod_{1\leq i\leq j\leq a}\frac{\zeta^{S}(2s-(a-1)+i+j-2)}{\zeta^{S}(2s-(a-1)+i+j-1)}

where ζS\zeta^{S} is the partial Dedekind zeta function. A little simplification shows that it is equal to I1I2I_{1}\cdot I_{2} with

I1=LψS(s12(a1),σ×χ)LψS(s+12(a+1),σ×χ),I2=1jaζS(2s(a1)+j1)ζS(2s(a1)+2j1).I_{1}=\frac{L^{S}_{\psi}(s-\frac{1}{2}(a-1),\sigma\times\chi)}{L^{S}_{\psi}(s+\frac{1}{2}(a+1),\sigma\times\chi)},\qquad I_{2}=\prod_{1\leq j\leq a}\frac{\zeta^{S}(2s-(a-1)+j-1)}{\zeta^{S}(2s-(a-1)+2j-1)}.

If we assume the first condition, then the numerator of I1I_{1} has a pole at s=s0+12(a1)s=s_{0}+\frac{1}{2}(a-1) which cannot be cancelled out by other terms. If we assume the second condition, then ζS(2s(a1))\zeta^{S}(2s-(a-1)) has a pole s=s0+12(a1)s=s_{0}+\frac{1}{2}(a-1) which cannot be cancelled out by other terms. Also note that at ramified places the local intertwining operators are non-zero. Thus we have shown that s=s0+12(a1)𝒫a,ψ(σ,χ)s=s_{0}+\frac{1}{2}(a-1)\in\mathcal{P}_{a,\psi}(\sigma,\chi). ∎

Next we relate the Eisenstein series E(s,g,f)=E(g,fs)E(s,g,f)=E(g,f_{s}) to Siegel Eisenstein series on the ‘doubled group’ to glean more information on the locations of poles.

Let XX^{\prime} be the symplectic space with the same underlying vector space as XX but with the negative symplectic form ,X=,X\langle{\ },{\ }\rangle_{X^{\prime}}=-\langle{\ },{\ }\rangle_{X}. Let W=XXW=X\oplus X^{\prime} and form Wa=a+WaW_{a}=\ell_{a}^{+}\oplus W\oplus\ell_{a}^{-}. Let XΔ={(x,x)W|xX}X^{\Delta}=\{(x,x)\in W|x\in X\} and X={(x,x)W|xX}X^{\nabla}=\{(x,-x)\in W|x\in X\}. Then WaW_{a} has the polarisation (XΔa+)(Xa)(X^{\Delta}\oplus\ell_{a}^{+})\oplus(X^{\nabla}\oplus\ell_{a}^{-}). Let PaP_{a} be the Siegel parabolic subgroup of G(Wa)G(W_{a}) that stabilises XaX^{\nabla}\oplus\ell_{a}^{-}. For a K~G(Wa)\widetilde{K}_{G(W_{a})}-finite section 𝔽s\mathbb{F}_{s} in IndP~a(𝔸)G~(Wa)(𝔸)χχψ||𝔸s\operatorname{\mathrm{Ind}}_{\widetilde{P}_{a}(\mathbb{A})}^{\widetilde{G}(W_{a})(\mathbb{A})}\chi\chi_{\psi}|\ |_{\mathbb{A}}^{s}, we form the Siegel Eisenstein series EPa(,𝔽s)E^{P_{a}}(\cdot,\mathbb{F}_{s}).

Since G(Xa)G(X_{a}) acts on a+Xa\ell_{a}^{+}\oplus X\oplus\ell_{a}^{-} and G(X)G(X) acts on XX^{\prime}, we have the obvious embedding ι:G(Xa)(𝔸)×G(X)(𝔸)G(Wa)(𝔸)\iota:G(X_{a})(\mathbb{A})\times G(X)(\mathbb{A})\rightarrow G(W_{a})(\mathbb{A}) which induces a homomorphism ι~:G~(Xa)(𝔸)×μ2G~(X)(𝔸)G~(Wa)(𝔸)\widetilde{\iota}:\widetilde{G}(X_{a})(\mathbb{A})\times_{\mu_{2}}\widetilde{G}(X)(\mathbb{A})\rightarrow\widetilde{G}(W_{a})(\mathbb{A}). The cocycles for the cover groups are compatible by [37, Theorem 4.1].

The following is the metaplectic version of [23, Proposition 2.3] whose proof generalises immediately. We note that the integrand is non-genuine, and thus descends to a function on G(X)(𝔸)G(X)(\mathbb{A}).

Proposition 3.3.

Let 𝔽s\mathbb{F}_{s} be a K~G(Wa)\widetilde{K}_{G(W_{a})}-finite section of IndP~a(𝔸)G~(Wa)(𝔸)χχψ||𝔸s\operatorname{\mathrm{Ind}}_{\widetilde{P}_{a}(\mathbb{A})}^{\widetilde{G}(W_{a})(\mathbb{A})}\chi\chi_{\psi}|\ |_{\mathbb{A}}^{s} and ϕσ\phi\in\sigma. Define a function Fϕ,sF_{\phi,s} on G~(Xa)(𝔸)\widetilde{G}(X_{a})(\mathbb{A}) by

(3.1) Fϕ,s(ga)=G(X)(𝔸)𝔽s(ι~(ga,g))ϕ(g)𝑑g.F_{\phi,s}(g_{a})=\int_{G(X)(\mathbb{A})}\mathbb{F}_{s}(\widetilde{\iota}(g_{a},g))\phi(g)dg.

Then

  1. (1)

    It is absolutely convergent for Res>(dimX+a+1)/2\operatorname{\mathrm{Re}}s>(\dim X+a+1)/2 and has meromorphic continuation to the whole ss-plane;

  2. (2)

    It is a section in 𝒜a,ψ(s,χ,σ)\mathcal{A}_{a,\psi}(s,\chi,\sigma);

  3. (3)

    The following identity holds

    [G(X)]EPa(ι~(ga,g),𝔽s)ϕ(g)𝑑g=E(ga,Fϕ,s).\int_{[G(X)]}E^{P_{a}}(\widetilde{\iota}(g_{a},g),\mathbb{F}_{s})\phi(g)dg=E(g_{a},F_{\phi,s}).

Now we list the locations of possible poles of the Siegel Eisenstein series obtained in [17, 18].

Proposition 3.4.

The poles with Res>0\operatorname{\mathrm{Re}}s>0 of EPa(g,𝔽s)E^{P_{a}}(g,\mathbb{F}_{s}) are at most simple and are contained in the set

Ξm+a,ψ(χ)={12(dimX+a)j|j,0j<12(dimX+a)}.\Xi_{m+a,\psi}(\chi)=\{\frac{1}{2}(\dim X+a)-j|j\in\mathbb{Z},0\leq j<\frac{1}{2}(\dim X+a)\}.

Combining the above propositions, we get:

Proposition 3.5.

The maximal member s0s_{0} of 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma) is of the form s0=12(dimX+1)js_{0}=\frac{1}{2}(\dim X+1)-j for jj\in\mathbb{Z} such that 0j<12(dimX+1)0\leq j<\frac{1}{2}(\dim X+1).

Proof.

By Prop. 3.1, s0+12(a1)s_{0}+\frac{1}{2}(a-1) is the maximal member of 𝒫a,ψ(χ,σ)\mathcal{P}_{a,\psi}(\chi,\sigma). To ensure that (3.1) provides enough sections for poles of the Siegel Eisenstein series to manifest, we need to take aa large enough. See [23, Lemma 2.6] for details. Then by Prop. 3.3, it is a pole of the Siegel Eisenstein series whose possible poles are determined in Prop. 3.4. Thus s0s_{0} must be of the form s0=12(dimX+1)js_{0}=\frac{1}{2}(\dim X+1)-j for jj\in\mathbb{Z} such that 0j<12(dimX+1)0\leq j<\frac{1}{2}(\dim X+1). ∎

4. First Occurrence and Lowest Occurrence of Theta Correspondence

The locations of poles of the Eisenstein series defined in Sec. 3 are intimately related to the invariants, called the lowest occurrences of theta lifts, attached to σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)). The lowest occurrences are defined via the more familiar notion of first occurrences. In Sec. 6, we will derive a relation between periods of residues of Eisenstein series and first occurrences.

First we review briefly the definition of theta lift. For each automorphic additive character ψ\psi of 𝔸\mathbb{A}, there is a Weil representation ωψ\omega_{\psi} of the metaplectic group Mp2n(𝔸)\operatorname{\mathrm{Mp}}_{2n}(\mathbb{A}) unique up to isomorphism. In our case, X/FX/F is a symplectic space and Y/FY/F is a quadratic space. From them, we get the symplectic space YXY\otimes X. We consider the Weil representation of G~(YX)(𝔸)\widetilde{G}(Y\otimes X)(\mathbb{A}) realised on the Schwartz space 𝒮((YX)+(𝔸))\mathcal{S}((Y\otimes X)^{+}(\mathbb{A})) where (YX)+(Y\otimes X)^{+} denotes any maximal isotropic subspace of YXY\otimes X. Different choices of maximal isotropic subspaces give different Schwartz spaces which are intertwined by Fourier transforms. Thus the choice is not essential and sometimes we simply write 𝒮X,Y(𝔸)\mathcal{S}_{X,Y}(\mathbb{A}) for 𝒮((YX)+(𝔸))\mathcal{S}((Y\otimes X)^{+}(\mathbb{A})).

Let G(Y)G(Y) denote the isometric group of the quadratic space YY. We have the obvious homomorphism G(X)(𝔸)×G(Y)(𝔸)Sp(YX)(𝔸)G(X)(\mathbb{A})\times G(Y)(\mathbb{A})\rightarrow\operatorname{\mathrm{Sp}}(Y\otimes X)(\mathbb{A}). By [26], there is a homomorphism G~(X)(𝔸)×G(Y)(𝔸)Mp(YX)(𝔸)\widetilde{G}(X)(\mathbb{A})\times G(Y)(\mathbb{A})\rightarrow\operatorname{\mathrm{Mp}}(Y\otimes X)(\mathbb{A}) that covers it. Thus we arrive at the representation ωψ,X,Y\omega_{\psi,X,Y} of G~(X)(𝔸)×G(Y)(𝔸)\widetilde{G}(X)(\mathbb{A})\times G(Y)(\mathbb{A}) on 𝒮X,Y(𝔸)\mathcal{S}_{X,Y}(\mathbb{A}), which is also called the Weil representation. The explicit formulae can be found in [18], for example.

For Φ𝒮X,Y(𝔸)\Phi\in\mathcal{S}_{X,Y}(\mathbb{A}), gG~(X)(𝔸)g\in\widetilde{G}(X)(\mathbb{A}) and hG(Y)(𝔸)h\in G(Y)(\mathbb{A}), we form the theta series

θψ,X,Y(g,h,Φ)=w(YX)+(F)ωψ,X,Y(g,h)Φ(w).\theta_{\psi,X,Y}(g,h,\Phi)=\sum_{w\in(Y\otimes X)^{+}(F)}\omega_{\psi,X,Y}(g,h)\Phi(w).

It is absolutely convergent and is automorphic in both G~(X)(𝔸)\widetilde{G}(X)(\mathbb{A}) and G(Y)(𝔸)G(Y)(\mathbb{A}). In general, it is of moderate growth.

With this we define the global theta lift. Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)). For ϕσ\phi\in\sigma and Φ𝒮X,Y(𝔸)\Phi\in\mathcal{S}_{X,Y}(\mathbb{A}), define

θψ,XY(h,ϕ,Φ)=[G(X)]θψ,X,Y(g,h,Φ)ϕ(g)¯𝑑g.\theta_{\psi,X}^{Y}(h,\phi,\Phi)=\int_{[G(X)]}\theta_{\psi,X,Y}(g,h,\Phi)\overline{\phi(g)}dg.

The integrand is the product of two genuine functions on G~(X)(𝔸)\widetilde{G}(X)(\mathbb{A}) and hence can be regarded as a function on G(X)(𝔸)G(X)(\mathbb{A}). We define the global theta lift θψ,XY(σ)\theta_{\psi,X}^{Y}(\sigma) of σ\sigma to be the space spanned by the above integrals. Let χY\chi_{Y} be the quadratic character of 𝔸×\mathbb{A}^{\times} associated to YY as in [25, (0.7)].

Definition 4.1.
  1. (1)

    The first occurrence index FOψY(σ)\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma) of σ\sigma in the Witt tower of YY is defined to be

    minY{dimY|θψ,XY(σ)0},\min_{Y^{\prime}}\{\dim Y^{\prime}|\theta_{\psi,X}^{Y^{\prime}}(\sigma)\neq 0\},

    where YY^{\prime} runs through all the quadratic spaces in the same Witt tower as YY.

  2. (2)

    For a quadratic automorphic character χ\chi of 𝔸×\mathbb{A}^{\times}, define the lowest occurrence index LOψ,χ(σ)\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma) with respect to χ\chi, to be

    minY{FOψY(σ)}\min_{Y}\{\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma)\}

    where YY runs over all quadratic spaces with χY=χ\chi_{Y}=\chi and odd dimension.

With this we get results on the lowest occurrence and the location of the maximal pole of the Eisenstein series. We will strengthen the results using periods in Sec. 6.

Theorem 4.2.

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and s0s_{0} be the maximal member of 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma). Then

  1. (1)

    s0=12(dimX+1)js_{0}=\frac{1}{2}(\dim X+1)-j for some jj\in\mathbb{Z} such that 0j<12(dimX+1)0\leq j<\frac{1}{2}(\dim X+1);

  2. (2)

    LOψ,χ(σ)2j+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\leq 2j+1;

  3. (3)

    2j+1rX2j+1\geq r_{X} where rX=dimX/2r_{X}=\dim X/2 is the Witt index of XX.

Proof.

The third part is stated in terms of the Witt index of XX so that the analogy with [22, Thm. 3.1] is more obvious.

The first part is just Prop. 3.5 which we reproduce here.

For the second part we make use of the regularised Siegel-Weil formula that links residues of Siegel Eisenstein series to theta integrals. Assume that s0=12(dimX+1)js_{0}=\frac{1}{2}(\dim X+1)-j is the maximal element in 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma). By Prop. 3.1, s0+12(a1)=12(dimX+a)js_{0}+\frac{1}{2}(a-1)=\frac{1}{2}(\dim X+a)-j is the maximal element in 𝒫a,ψ(χ,σ)\mathcal{P}_{a,\psi}(\chi,\sigma). In other words, EQa(g,fs)E^{Q_{a}}(g,f_{s}) has a pole at s=12(dimX+a)js=\frac{1}{2}(\dim X+a)-j for some ff. (We put in a superscript to be clear that we are talking about the Eisenstein series associated to the parabolic subgroup QaQ_{a}.) Furthermore if aa is large enough this fsf_{s} can be taken to be of the form Fϕ,sF_{\phi,s} (see Prop. 3.3 and also the proof of Prop. 3.5). Enlarge aa if necessary to ensure that 2j<dimX+a2j<\dim X+a. Then the regularised Siegel-Weil formula shows that

Ress=12(dimX+a)jEPa(ι~(ga,g),𝔽s)=Y[G(Y)]θψ,Wa,Y(ι~(ga,g),h,ΦY)𝑑h\operatorname{\mathrm{Res}}_{s=\frac{1}{2}(\dim X+a)-j}E^{P_{a}}(\widetilde{\iota}(g_{a},g),\mathbb{F}_{s})=\sum_{Y}\int_{[G(Y)]}\theta_{\psi,W_{a},Y}(\widetilde{\iota}(g_{a},g),h,\Phi_{Y})dh

where the sum runs over quadratic spaces YY of dimension 2j+12j+1 with χY=χ\chi_{Y}=\chi and ΦY𝒮Wa,Y(𝔸)\Phi_{Y}\in\mathcal{S}_{W_{a},Y}(\mathbb{A}) are appropriate K~G(Wa)\widetilde{K}_{G(W_{a})}-finite Schwartz functions so that the theta integrals are absolutely convergent. We remark that for any Schwartz function there is a natural way to ‘truncate’ it for regularising the theta integrals. See [25] and [16] for details. Now we integrate both sides against ϕ(g)\phi(g) over [G(X)][G(X)]. Then by Prop. 3.3 the left hand side becomes a residue of EQa(ga,s,Fs,ϕ)E^{Q_{a}}(g_{a},s,F_{s,\phi}), which is non-vanishing for some choice of ϕσ\phi\in\sigma. Thus at least one term on the right hand side must be non-zero. In other words, there exists a quadratic space YY of dimension 2j+12j+1 and of character χ\chi such that

[G(X)][G(Y)]θψ,Wa,Y(ι~(ga,g),h,ΦY)ϕ(g)𝑑h𝑑g0.\int_{[G(X)]}\int_{[G(Y)]}\theta_{\psi,W_{a},Y}(\widetilde{\iota}(g_{a},g),h,\Phi_{Y})\phi(g)dhdg\neq 0.

We may replace ΦY\Phi_{Y} by ΦY(1)ΦY(2)\Phi_{Y}^{(1)}\otimes\Phi_{Y}^{(2)} with ΦY(1)𝒮Xa,Y(𝔸)\Phi_{Y}^{(1)}\in\mathcal{S}_{X_{a},Y}(\mathbb{A}) and ΦY(2)𝒮X,Y(𝔸)\Phi_{Y}^{(2)}\in\mathcal{S}_{X,Y}(\mathbb{A}) such that the inequality still holds. Then after separating the variables we get

[G(Y)]θψ,Xa,Y(ga,h,ΦY(1))[G(X)]θψ,X,Y(g,h,ΦY(2))¯ϕ(g)𝑑g𝑑h0.\int_{[G(Y)]}\theta_{\psi,X_{a},Y}(g_{a},h,\Phi_{Y}^{(1)})\int_{[G(X)]}\overline{\theta_{\psi,X,Y}(g,h,\Phi_{Y}^{(2)})}\phi(g)dgdh\neq 0.

The complex conjugate appears because we have switched from XX^{\prime} to XX. In particular, the inner integral is non-vanishing, but it is exactly the complex conjugate of the theta lift of ϕ\phi to G(Y)G(Y). Thus the lowest occurrence LOψ,χ(σ)\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma) must be lower or equal to 2j+12j+1.

For the third part, assume that the lowest occurrence is realised by YY. Thus dimY=2j+1\dim Y=2j^{\prime}+1 with jjj^{\prime}\leq j. Let π=θψ,XY(σ)\pi=\theta_{\psi,X}^{Y}(\sigma). It is non-zero and it is cuspidal because it is the first occurrence representation in the Witt tower of YY. It is also irreducible by [21, Theorem 1.3]. By stability, FOψ,YX(π)2(2j+1)\operatorname{\mathrm{FO}}_{\psi,Y}^{X}(\pi)\leq 2(2j^{\prime}+1). By the involutive property in [21, Theorem 1.3], we have

θψ,YX(π)=θψ,YX(θψ,XY(σ))=σ.\theta_{\psi,Y}^{X}(\pi)=\theta_{\psi,Y}^{X}(\theta_{\psi,X}^{Y}(\sigma))=\sigma.

Note in [21], the theta lift was defined without the complex conjugation on the theta series, which resulted in the use of ψ1\psi^{-1} in the inner theta lift. Thus we find dimX2(2j+1)2(2j+1)\dim X\leq 2(2j^{\prime}+1)\leq 2(2j+1) and we get 2j+1rX2j+1\geq r_{X}. ∎

Thus we glean some information on poles of LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) (or equivalently factors of the form (χ,b)(\chi,b) in the Arthur parameter of σ\sigma) and lowest occurrence of theta lift.

Theorem 4.3.

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and χ\chi be a quadratic automorphic character of 𝔸×\mathbb{A}^{\times}. Then the following hold.

  1. (1)

    If the partial LL-function LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) has a pole at s=12(dimX+1)j>0s=\frac{1}{2}(\dim X+1)-j>0, then jj is an integer such that 14dimX12j<12dimX\frac{1}{4}\dim X-\frac{1}{2}\leq j<\frac{1}{2}\dim X. In other words, the possible positive poles of the partial LL-function LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) are non-integral half-integers s0s_{0} such that 12<s014dimX+1\frac{1}{2}<s_{0}\leq\frac{1}{4}\dim X+1.

  2. (2)

    If the partial LL-function LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) has a pole at s=12(dimX+1)j>0s=\frac{1}{2}(\dim X+1)-j>0, then LOψ,χ(σ)2j+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\leq 2j+1.

  3. (3)

    If LOψ,χ(σ)=2j+1<dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1<\dim X+2, then LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) is holomorphic for Res>12(dimX+1)j\operatorname{\mathrm{Re}}s>\frac{1}{2}(\dim X+1)-j.

  4. (4)

    If LOψ,χ(σ)=2j+1>dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1>\dim X+2, then LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) is holomorphic for Res>12\operatorname{\mathrm{Re}}s>\frac{1}{2}.

Proof.

By [41, Prop. 6.2], the poles ss of LψS(s,σ×χ)L_{\psi}^{S}(s,\sigma\times\chi) with Res12\operatorname{\mathrm{Re}}s\geq\frac{1}{2} are contained in the set {32,52,,dimX+12}\{\frac{3}{2},\frac{5}{2},\ldots,\frac{\dim X+1}{2}\}, where the extraneous +12+\frac{1}{2} should be removed from L(s+12,π×χ,ψ)L(s+\frac{1}{2},\pi\times\chi,\psi) in the statement there. The proof there actually implies that this is the set of possible poles in Res>0\operatorname{\mathrm{Re}}s>0. See also [43, Theorem 9.1]. Let s=12(dimX+1)j0s=\frac{1}{2}(\dim X+1)-j_{0} be its maximal pole. Then 0j0<12dimX0\leq j_{0}<\frac{1}{2}\dim X. By Prop. 3.2, s=12(dimX+1)j0s=\frac{1}{2}(\dim X+1)-j_{0} is in 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma). Assume 12(dimX+1)j0\frac{1}{2}(\dim X+1)-j_{0}^{\prime} is the maximal member in 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma). Then by Thm. 4.2, we have 14dimX12j0<12(dimX+1)\frac{1}{4}\dim X-\frac{1}{2}\leq j_{0}^{\prime}<\frac{1}{2}(\dim X+1). As j0j0j_{0}^{\prime}\leq j_{0}, we get 14dimX12j0\frac{1}{4}\dim X-\frac{1}{2}\leq j_{0}. We have shown part (1).

Assume that LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) has a pole at s=12(dimX+1)j>0s=\frac{1}{2}(\dim X+1)-j>0. Let s=12(dimX+1)js=\frac{1}{2}(\dim X+1)-j^{\prime} be its maximal pole. Then by Prop. 3.2, s=12(dimX+1)js=\frac{1}{2}(\dim X+1)-j^{\prime} is in 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma). Let s=12(dimX+1)j′′s=\frac{1}{2}(\dim X+1)-j^{\prime\prime} be the maximal member in 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma). By Thm. 4.2, LOψ,χ(σ)2j′′+12j+12j+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\leq 2j^{\prime\prime}+1\leq 2j^{\prime}+1\leq 2j+1.

Assume that LOψ,χ(σ)=2j+1<dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1<\dim X+2 and LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) has a pole in Res>12(dimX+1)j\operatorname{\mathrm{Re}}s>\frac{1}{2}(\dim X+1)-j, say at s=12(dimX+1)j0s=\frac{1}{2}(\dim X+1)-j_{0} for j0<jj_{0}<j. Then by part (2), LOψ,χ(σ)2j0+1<2j+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\leq 2j_{0}+1<2j+1. We arrive at a contradiction.

Assume that LOψ,χ(σ)=2j+1>dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1>\dim X+2 and LψS(s,σ×χ)L^{S}_{\psi}(s,\sigma\times\chi) has a pole in Res>12\operatorname{\mathrm{Re}}s>\frac{1}{2}, say at s=12(dimX+1)j0s=\frac{1}{2}(\dim X+1)-j_{0} for j0<12(dimX+1)j_{0}<\frac{1}{2}(\dim X+1). Then by part (2), LOψ,χ(σ)2j0+1<dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\leq 2j_{0}+1<\dim X+2. We arrive at a contradiction. ∎

In terms of A-parameters, the theorem above says:

Theorem 4.4.

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and χ\chi be a quadratic automorphic character of 𝔸×\mathbb{A}^{\times}. Let ϕψ(σ)\phi_{\psi}(\sigma) denote the A-parameter of σ\sigma with respect to ψ\psi. Then the following hold.

  1. (1)

    If ϕψ(σ)\phi_{\psi}(\sigma) has a (χ,b)(\chi,b)-factor, then b12dimX+1b\leq\frac{1}{2}\dim X+1.

  2. (2)

    If ϕψ(σ)\phi_{\psi}(\sigma) has a (χ,b)(\chi,b)-factor with bb maximal among all simple factors of ϕψ(σ)\phi_{\psi}(\sigma), then LOψ,χ(σ)dimXb+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\leq\dim X-b+1.

  3. (3)

    If LOψ,χ(σ)=2j+1<dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1<\dim X+2, then ϕψ(σ)\phi_{\psi}(\sigma) cannot have a (χ,b)(\chi,b)-factor with bb maximal among all simple factors of ϕψ(σ)\phi_{\psi}(\sigma) and b>dimX2jb>\dim X-2j.

  4. (4)

    If LOψ,χ(σ)=2j+1>dimX+2\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1>\dim X+2, then ϕψ(σ)\phi_{\psi}(\sigma) cannot have a (χ,b)(\chi,b)-factor with bb maximal among all simple factors of ϕψ(σ)\phi_{\psi}(\sigma).

Remark 4.5.

Part (1) of Thm. 4.4 implies a similar statement in the metaplectic case to the symplectic result in [20, Theorem 3.1, Remark 3.3] which are a key input to results in [20, Sec. 5] on the generalised Ramanujan problem.

5. Fourier coefficients of theta lift and periods

In this section we compute certain Fourier coefficients of theta lifts from the metaplectic group G~(X)\widetilde{G}(X) to odd orthogonal groups and we derive some vanishing and non-vanishing results of period integrals over symplectic subgroups and Jacobi subgroups of G(X)G(X).

We define these subgroups first. Let ZZ be a non-degenerate symplectic subspace of XX and let LL be a totally isotropic subspace of ZZ. Then G(Z)G(Z) is a symplectic subgroup of G(X)G(X). Let Q(Z,L)Q(Z,L) be the parabolic subgroup of G(Z)G(Z) that stabilisers LL and J(Z,L)J(Z,L) be the Jacobi subgroup that fixes LL element-wise. When L=0L=0, then J(Z,L)J(Z,L) is just G(Z)G(Z). In this section, ZZ (resp. ZZ^{\prime}, Z′′Z^{\prime\prime}) will always be a non-degenerate symplectic subspace of XX and LL (resp. L,L′′L^{\prime},L^{\prime\prime}) will always be a totally isotropic subspace of ZZ (resp. ZZ^{\prime}, Z′′Z^{\prime\prime}). For concreteness, we define distinction.

Definition 5.1.

Let GG be a reductive group and JJ be a subgroup of GG. Let σ\sigma be an automorphic representation of GG. For fσf\in\sigma, if the period integral

(5.1) [J]f(g)𝑑g.\int_{[J]}f(g)dg.

is absolutely convergent and non-vanishing, we say that ff is JJ-distinguished. Assume that for all fσf\in\sigma, the period integral is absolutely convergent. If there exists fσf\in\sigma such that ff is JJ-distinguished, then we say σ\sigma is JJ-distinguished.

Let YY be an anisotropic quadratic space, so that it sits at the bottom of its Witt tower. We can form the augmented quadratic spaces YrY_{r} analogously by adjoining rr-copies of the hyperbolic plane to YY. Let Θψ,X,Yr\Theta_{\psi,X,Y_{r}} denote the space of theta functions θψ,X,Yr(,1,Φ)\theta_{\psi,X,Y_{r}}(\cdot,1,\Phi) for Φ\Phi running over 𝒮X,Yr(𝔸)\mathcal{S}_{X,Y_{r}}(\mathbb{A}). Then we have the following that is derived from the computation of Fourier coefficients of theta lift of σ\sigma to various G(Yr)G(Y_{r})’s.

Proposition 5.2.

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and let YY be an odd dimensional anisotropic quadratic space. Assume that FOψY(σ)=dimY+2r0\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma)=\dim Y+2r_{0}. Let ZZ be a non-degenerate symplectic subspace of XX and LL a totally isotropic subspace of ZZ. Let rr be a non-negative integer. Then the following hold.

  1. (1)

    If dimXdimZ+dimL+r<r0\dim X-\dim Z+\dim L+r<r_{0}, then σΘψ,X,Yr¯\sigma\otimes\overline{\Theta_{\psi,X,Y_{r}}} is not J(Z,L)J(Z,L)-distinguished.

  2. (2)

    If dimXdimZ+dimL=r0\dim X-\dim Z+\dim L=r_{0} and dimL=0,1\dim L=0,1, then σΘψ,X,Y¯\sigma\otimes\overline{\Theta_{\psi,X,Y}} is J(Z,L)J(Z,L)-distinguished for some choice of (Z,L)(Z,L).

Proof.

This is the metaplectic analogue of [23, Proposition 3.2]. The period integrals involved are the complex conjugates of

(5.2) [J(Z,L)]ϕ(g)¯θψ,X,Yr(g,1,Φ)𝑑g\int_{[J(Z,L)]}\overline{\phi(g)}\theta_{\psi,X,Y_{r}}(g,1,\Phi)dg

where ϕσ\phi\in\sigma and Φ𝒮X,Yr(𝔸)\Phi\in\mathcal{S}_{X,Y_{r}}(\mathbb{A}). As both factors of the integrand are genuine in G~(X)(𝔸)\widetilde{G}(X)(\mathbb{A}), the product is a well-defined function of G(X)(𝔸)G(X)(\mathbb{A}), which we can restrict to J(Z,L)(𝔸)J(Z,L)(\mathbb{A}). We note that the proof of [23, Proposition 3.2] involves taking Fourier coefficients of automorphic forms (on orthogonal groups) in the spaces of θψ,XYt(σ)\theta_{\psi,X}^{Y_{t}}(\sigma) for varying tt and these Fourier coefficients can be written as sums of integrals which have (5.2) as inner integrals. The proof there also works for odd orthogonal groups.

We have a converse in the following form.

Proposition 5.3.

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and let YY be an odd dimensional anisotropic quadratic space. Assume that σΘψ,X,Y¯\sigma\otimes\overline{\Theta_{\psi,X,Y}} is J(Z,L)J(Z,L)-distinguished for some choice of (Z,L)(Z,L) with dimL=0,1\dim L=0,1, but that it is not J(Z,L)J(Z^{\prime},L^{\prime})-distinguished for all (Z,L)(Z^{\prime},L^{\prime}) with dimL=0,1\dim L^{\prime}=0,1 and dimZdimL>dimZdimL\dim Z^{\prime}-\dim L^{\prime}>\dim Z-\dim L. Then if we set r=dimXdimZ+dimLr=\dim X-\dim Z+\dim L, then FOψY(σ)=dimY+2r\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma)=\dim Y+2r.

Combined with Prop. 5.2, we have the implication.

Proposition 5.4.

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and let YY be an odd dimensional anisotropic quadratic space. Assume that for some t>0t>0, σΘψ,X,Y¯\sigma\otimes\overline{\Theta_{\psi,X,Y}} is not J(Z,L)J(Z^{\prime},L^{\prime})-distinguished for all (Z,L)(Z^{\prime},L^{\prime}) with dimL=0,1\dim L^{\prime}=0,1 and dimZdimL>t\dim Z^{\prime}-\dim L^{\prime}>t. Then σΘψ,X,Y¯\sigma\otimes\overline{\Theta_{\psi,X,Y}} is not J(Z′′,L′′)J(Z^{\prime\prime},L^{\prime\prime})-distinguished for all (Z′′,L′′)(Z^{\prime\prime},L^{\prime\prime}) with dimZ′′dimL′′>t\dim Z^{\prime\prime}-\dim L^{\prime\prime}>t.

Both propositions can be proved in the same way as in [23, Propositions 3.4, 3.5].

6. Periods of Eisenstein series

In this section, to avoid clutter we write GG for the FF-rational points G(F)G(F) of GG etc. We also suppress the additive character ψ\psi from notation. In this section, again ZZ (resp. ZZ^{\prime}, Z′′Z^{\prime\prime}) will always be a non-degenerate symplectic subspace of XX and LL (resp. L,L′′L^{\prime},L^{\prime\prime}) will always be an isotropic subspace of ZZ (resp. ZZ^{\prime}, Z′′Z^{\prime\prime}). The periods considered in this section involve an Eisenstein series and a theta function. They are supposed to run parallel to those in Sec. 5 which involve a cuspidal automorphic form and a theta function (5.2). Through our computation, we will relate the periods of Eisenstein series to (5.2) and hence also to invariants of theta correspondence.

Assume that YY is an anisotropic quadratic space of odd dimension. Let ZZ be a non-degenerate symplectic subspace of XX. Let VV be its orthogonal complement in XX so that X=VZX=V\perp Z. Form similarly the augmented space Z1=1+Z1X1Z_{1}=\ell_{1}^{+}\oplus Z\oplus\ell_{1}^{-}\subset X_{1}. Then X1=VZ1X_{1}=V\perp Z_{1}. Let LL be a totally isotropic subspace of ZZ of dimension 0 or 11. Then the subgroup J(Z1,L)J(Z_{1},L) of G(Z1)G(Z_{1}) is defined to be the fixator of LL element-wise. Via the natural embedding of G(Z1)G(Z_{1}) into G(X1)G(X_{1}), we regard J(Z1,L)J(Z_{1},L) as a subgroup of G(X1)G(X_{1}).

Then the period integrals we consider are of the form

[J(Z1,L)]E(g,s,f)θψ,X1,Y(g,1,Φ)¯𝑑g\int_{[J(Z_{1},L)]}E(g,s,f)\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)}dg

for fs𝒜1(s,χ,σ)f_{s}\in\mathcal{A}_{1}(s,\chi,\sigma) and Φ𝒮X1,Y(𝔸)\Phi\in\mathcal{S}_{X_{1},Y}(\mathbb{A}). The integrals diverge in general, but they can be regularised by using the Arthur truncation [2, 1] (See also [32, I.2.13] which includes the metaplectic case). We write down how the Arthur truncation works in the present case. We follow closely Arthur’s notation. We note that the need for Jacobi groups is special to the symplectic/metaplectic case due to the lack of ‘odd symplectic groups’. Compare with the unitary case [42] and the orthogonal case [10].

We continue to use our notation from Sec. 3. Note that the Eisenstein series is attached to a maximal parabolic subgroup Q1Q_{1} of G(X1)G(X_{1}). In this case, 𝔞M1\mathfrak{a}_{M_{1}} is 1-dimensional and we identify it with \mathbb{R}. For c>0c\in\mathbb{R}_{>0}, set τ^c\hat{\tau}^{c} to be the characteristic function of >logc\mathbb{R}_{>\log c} and set τ^c=1τ^c\hat{\tau}_{c}=1_{\mathbb{R}}-\hat{\tau}^{c}. Then the truncated Eisenstein series is

(6.1) ΛcE(g,s,f)=E(g,s,f)γQ1\G(X1)EQ1(γg,s,f)τ^c(H(γg))\Lambda^{c}E(g,s,f)=E(g,s,f)-\sum_{\gamma\in Q_{1}\operatorname{\backslash}G(X_{1})}E_{Q_{1}}(\gamma g,s,f)\hat{\tau}^{c}(H(\gamma g))

where EQ1(,s,f)E_{Q_{1}}(\cdot,s,f) is the constant term of E(,s,f)E(\cdot,s,f) along Q1Q_{1}. The summation has only finitely many non-vanishing terms for each fixed gg. The truncated Eisenstein series is rapidly decreasing while the theta series is of moderate growth. Thus if we replace the Eisenstein series with the truncated Eisenstein series, we get a period integral that is absolutely convergent:

(6.2) [J(Z1,L)]ΛcE(g,s,f)θψ,X1,Y(g,1,Φ)¯𝑑g.\int_{[J(Z_{1},L)]}\Lambda^{c}E(g,s,f)\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)}dg.

We state our main theorems.

Theorem 6.1.

Let σ𝒜cusp(G~)\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}) and let YY be an anisotropic quadratic space of odd dimension. Assume that σΘψ,X,Y¯\sigma\otimes\overline{\Theta_{\psi,X,Y}} is J(Z,L)J(Z,L)-distinguished for some (Z,L)(Z,L) with dimL=0\dim L=0 or 11, but it is not J(Z,L)J(Z^{\prime},L^{\prime})-distinguished for all (Z,L)(Z^{\prime},L^{\prime}) such that dimL=0,,dimL+1\dim L^{\prime}=0,\ldots,\dim L+1 and dimZdimL>dimZdimL\dim Z^{\prime}-\dim L^{\prime}>\dim Z-\dim L. Set r=dimXdimZ+dimLr=\dim X-\dim Z+\dim L and s0=12(dimX(dimY+2r)+2)s_{0}=\frac{1}{2}(\dim X-(\dim Y+2r)+2). Then E(g,s,f)E(g,s,f) has a pole at s=s0s=s_{0} for some choice of fs𝒜1,ψ(s,χY,σ)f_{s}\in\mathcal{A}_{1,\psi}(s,\chi_{Y},\sigma).

For a complex number s1s_{1}, let s1(g,fs)\mathcal{E}_{s_{1}}(g,f_{s}) denote the residue of E(g,fs)E(g,f_{s}) at s=s1s=s_{1}. When s1>0s_{1}>0, we consider the period integral

(6.3) [J(Z1,L)]s1(g,fs)θψ,X1,Y(g,1,Φ)¯𝑑g.\int_{[J(Z_{1},L)]}\mathcal{E}_{s_{1}}(g,f_{s})\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)}dg.

We have the following result.

Theorem 6.2.

Adopt the same setup as in Thm. 6.1. Assume further that s0>0s_{0}>0. Then the following hold.

  1. (1)

    s0s_{0} lies in 𝒫1,ψ(σ,χ)\mathcal{P}_{1,\psi}(\sigma,\chi) and it corresponds to a simple pole.

  2. (2)

    s0(g,fs)θψ,X1,Y(g,1,Φ)¯\mathcal{E}_{s_{0}}(g,f_{s})\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)} is J(Z1,L)J(Z_{1},L)-distinguished for some choice of fs𝒜1,ψ(s,χY,σ)f_{s}\in\mathcal{A}_{1,\psi}(s,\chi_{Y},\sigma) and Φ𝒮X1,Y(𝔸)\Phi\in\mathcal{S}_{X_{1},Y}(\mathbb{A}).

  3. (3)

    If 0<s1s00<s_{1}\neq s_{0}, then s1(g,fs)θψ,X1,Y(g,1,Φ)¯\mathcal{E}_{s_{1}}(g,f_{s})\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)} is not J(Z1,L)J(Z_{1},L)-distinguished for any fs𝒜1,ψ(s,χY,σ)f_{s}\in\mathcal{A}_{1,\psi}(s,\chi_{Y},\sigma) and Φ𝒮X1,Y(𝔸)\Phi\in\mathcal{S}_{X_{1},Y}(\mathbb{A}).

  4. (4)

    For (Z′′,L′′)(Z^{\prime\prime},L^{\prime\prime}) with dimL′′=0\dim L^{\prime\prime}=0 or 11 such that dimZ′′dimL′′>dimZdimL\dim Z^{\prime\prime}-\dim L^{\prime\prime}>\dim Z-\dim L, then for any s1>0s_{1}>0, s1(g,fs)θψ,X1,Y(g,1,Φ)¯\mathcal{E}_{s_{1}}(g,f_{s})\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)} is not J(Z1′′,L′′)J(Z^{\prime\prime}_{1},L^{\prime\prime})-distinguished for any fs𝒜1,ψ(s,χY,σ)f_{s}\in\mathcal{A}_{1,\psi}(s,\chi_{Y},\sigma) and Φ𝒮X1,Y(𝔸)\Phi\in\mathcal{S}_{X_{1},Y}(\mathbb{A}).

Now we bring in the first occurrence index for σ\sigma. By Prop. 5.2, if FOψY(σ)=dimY+2r\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma)=\dim Y+2r, then σΘψ,X,Y¯\sigma\otimes\overline{\Theta_{\psi,X,Y}} is J(Z,L)J(Z,L) distinguished for some (Z,L)(Z,L) such that dimXdimZ+dimL=r\dim X-\dim Z+\dim L=r and dimLr(mod2)\dim L\equiv r\pmod{2} with dimL=0\dim L=0 or 11 and it is not J(Z,L)J(Z^{\prime},L^{\prime})-distinguished for any (Z,L)(Z^{\prime},L^{\prime}) such that dimXdimZ+dimL<r\dim X-\dim Z^{\prime}+\dim L^{\prime}<r or equivalently dimZdimL>dimZdimL\dim Z^{\prime}-\dim L^{\prime}>\dim Z-\dim L. In other words the conditions of Thm. 6.1 are satisfied. We get:

Corollary 6.3.

Let σ𝒜cusp(G~)\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}) and let YY be an anisotropic quadratic space of odd dimension. Assume that FOψY(σ)=dimY+2r\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma)=\dim Y+2r. Let s0=12(dimX(dimY+2r)+2)s_{0}=\frac{1}{2}(\dim X-(\dim Y+2r)+2). Then E(g,s,f)E(g,s,f) has a pole at s=s0s=s_{0} for some choice of fs𝒜1,ψ(s,χY,σ)f_{s}\in\mathcal{A}_{1,\psi}(s,\chi_{Y},\sigma). Assume further that s0>0s_{0}>0. Then the following hold.

  1. (1)

    s0s_{0} lies in 𝒫1,ψ(σ,χ)\mathcal{P}_{1,\psi}(\sigma,\chi) and it corresponds to a simple pole.

  2. (2)

    There exist a non-degenerate symplectic subspace ZZ of XX and an isotropic subspace LL of ZZ satisfying dimXdimZ+dimL=r\dim X-\dim Z+\dim L=r and dimLr(mod2)\dim L\equiv r\pmod{2} with dimL=0\dim L=0 or 11 such that s0(g,fs)θψ,X1,Y(g,1,Φ)¯\mathcal{E}_{s_{0}}(g,f_{s})\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)} is J(Z1,L)J(Z_{1},L)-distinguished for some choice of fs𝒜1,ψ(s,χY,σ)f_{s}\in\mathcal{A}_{1,\psi}(s,\chi_{Y},\sigma) and Φ𝒮X1,Y(𝔸)\Phi\in\mathcal{S}_{X_{1},Y}(\mathbb{A}).

  3. (3)

    If 0<s1s00<s_{1}\neq s_{0}, then s1(g,fs)θψ,X1,Y(g,1,Φ)¯\mathcal{E}_{s_{1}}(g,f_{s})\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)} is not J(Z1,L)J(Z_{1},L)-distinguished for any fs𝒜1,ψ(s,χY,σ)f_{s}\in\mathcal{A}_{1,\psi}(s,\chi_{Y},\sigma) and Φ𝒮X1,Y(𝔸)\Phi\in\mathcal{S}_{X_{1},Y}(\mathbb{A}) where ZZ is any non-degenerate symplectic subspace of XX and LL is any isotropic subspace of ZZ such that dimXdimZ+dimL=r\dim X-\dim Z+\dim L=r and dimLr(mod2)\dim L\equiv r\pmod{2} with dimL=0\dim L=0 or 11.

  4. (4)

    For (Z′′,L′′)(Z^{\prime\prime},L^{\prime\prime}) with dimL′′=0\dim L^{\prime\prime}=0 or 11 such that dimZ′′dimL′′>dimZdimL\dim Z^{\prime\prime}-\dim L^{\prime\prime}>\dim Z-\dim L and for s1>0s_{1}>0, s1(g,fs)θψ,X1,Y(g,1,Φ)¯\mathcal{E}_{s_{1}}(g,f_{s})\overline{\theta_{\psi,X_{1},Y}(g,1,\Phi)} is not J(Z1′′,L′′)J(Z^{\prime\prime}_{1},L^{\prime\prime})-distinguished for any fs𝒜1,ψ(s,χY,σ)f_{s}\in\mathcal{A}_{1,\psi}(s,\chi_{Y},\sigma) and Φ𝒮X1,Y(𝔸)\Phi\in\mathcal{S}_{X_{1},Y}(\mathbb{A}).

With these results on period integrals involving residues of Eisenstein series, we can strengthen Thm. 4.2.

Theorem 6.4.

Let σ𝒜cusp(G~(X))\sigma\in\mathcal{A}_{\mathrm{cusp}}(\widetilde{G}(X)) and let s0s_{0} be the maximal element in 𝒫1,ψ(χ,σ)\mathcal{P}_{1,\psi}(\chi,\sigma). Write s0=12(dimX+1)js_{0}=\frac{1}{2}(\dim X+1)-j. Then

  1. (1)

    jj is an integer such that 14(dimX2)j<12(dimX+1)\frac{1}{4}(\dim X-2)\leq j<\frac{1}{2}(\dim X+1).

  2. (2)

    LOψ,χ(σ)=2j+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=2j+1.

Proof.

Part (1) is a restatement of Thm. 4.2 and we have also shown that LOψ,χ(σ)2j+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\leq 2j+1 there. We just need to show the other inequality. Assume that the lowest occurrence of σ\sigma is achieved in the Witt tower of YY. Thus LOψ,χ(σ)=FOψY(σ)\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)=\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma). We assume FOψY(σ)=2j+1\operatorname{\mathrm{FO}}_{\psi}^{Y}(\sigma)=2j^{\prime}+1. Then by Cor. 6.3, 12(dimX(2j+1)+2)\frac{1}{2}(\dim X-(2j^{\prime}+1)+2) is a member of 𝒫1,ψ(σ,χ)\mathcal{P}_{1,\psi}(\sigma,\chi). Since s0=12(dimX+1)js_{0}=\frac{1}{2}(\dim X+1)-j is the maximal member, we get 12(dimX+1)j12(dimX(2j+1)+2)\frac{1}{2}(\dim X+1)-j\geq\frac{1}{2}(\dim X-(2j^{\prime}+1)+2) or jjj^{\prime}\geq j. We have shown that LOψ,χ(σ)2j+1\operatorname{\mathrm{LO}}_{\psi,\chi}(\sigma)\geq 2j+1. ∎

Now we proceed to prove the main theorems. We cut the period integral (6.2) into several parts and evaluate each part. We proceed formally and justify that each part is absolutely convergent for Res\operatorname{\mathrm{Re}}s and cc large and that it has meromorphic continuation to all ss\in\mathbb{C} at the end.

We have EQ1(γg,s,f)=fs(g)+M(w,s)fs(g)E_{Q_{1}}(\gamma g,s,f)=f_{s}(g)+M(w,s)f_{s}(g) as continued meromorphic functions in ss where M(w,s)M(w,s) is the intertwining operator associated to the longest Weyl element ww in Q1(F)\G(X1)(F)/Q1(F)Q_{1}(F)\operatorname{\backslash}G(X_{1})(F)/Q_{1}(F). When Re(s)>ρQ1\operatorname{\mathrm{Re}}(s)>\rho_{Q_{1}}, we get

ΛcE(g,s,f)=γQ1\G(X1)fs(γg)τ^c(H(γg))γQ1\G(X1)M(w,s)fs(γg)τ^c(H(γg)).\Lambda^{c}E(g,s,f)=\sum_{\gamma\in Q_{1}\operatorname{\backslash}G(X_{1})}f_{s}(\gamma g)\hat{\tau}_{c}(H(\gamma g))-\sum_{\gamma\in Q_{1}\operatorname{\backslash}G(X_{1})}M(w,s)f_{s}(\gamma g)\hat{\tau}^{c}(H(\gamma g)).

The first series is absolutely convergent for Re(s)>ρQ1\operatorname{\mathrm{Re}}(s)>\rho_{Q_{1}} while the second series has only finitely many non-vanishing terms for each fixed gg. Both series have meromorphic continuation to the whole complex plane. Set

ξc,s(g)\displaystyle\xi_{c,s}(g) =fs(g)θX1,Y(g,1,Φ)¯τ^c(H(g));\displaystyle=f_{s}(g)\overline{\theta_{X_{1},Y}(g,1,\Phi)}\hat{\tau}_{c}(H(g));
ξsc(g)\displaystyle\xi_{s}^{c}(g) =M(w,s)fs(g)θX1,Y(g,1,Φ)¯τ^c(H(g))\displaystyle=M(w,s)f_{s}(g)\overline{\theta_{X_{1},Y}(g,1,\Phi)}\hat{\tau}^{c}(H(g))

and set

I(ξ)=[J(Z1,L)]γQ1\G(X1)ξ(γg)dgI(\xi)=\int_{[J(Z_{1},L)]}\sum_{\gamma\in Q_{1}\operatorname{\backslash}G(X_{1})}\xi(\gamma g)dg

for ξ=ξc,s\xi=\xi_{c,s} or ξsc\xi_{s}^{c}. Then the period integral we are concerned with is equal to

[J(Z1,L)]ΛcE(g,s,f)θX1,Y(g,1,Φ)¯𝑑g=I(ξc,s)I(ξsc)\int_{[J(Z_{1},L)]}\Lambda^{c}E(g,s,f)\overline{\theta_{X_{1},Y}(g,1,\Phi)}dg=I(\xi_{c,s})-I(\xi_{s}^{c})

as long as the integrals defining the two terms on right hand side are absolutely convergent.

Now we cut I(ξ)I(\xi) into several parts according to J(Z1,L)J(Z_{1},L)-orbits in Q1\G(X1)Q_{1}\operatorname{\backslash}G(X_{1}), show that the parts are absolute convergent and compute their values. The set Q1\G(X1)Q_{1}\operatorname{\backslash}G(X_{1}) corresponds to isotropic lines in X1X_{1}:

Q1\G(X1)\displaystyle Q_{1}\operatorname{\backslash}G(X_{1}) {Isotropic lines in X1}\displaystyle\leftrightarrow\{\text{Isotropic lines in $X_{1}$}\}
γ\displaystyle\gamma 1γ.\displaystyle\leftrightarrow\ell_{1}^{-}\gamma.

For an isotropic line X1\ell\in X_{1}, we write γ\gamma_{\ell} for an element in G(X1)G(X_{1}) such that 1γ=\ell_{1}^{-}\gamma_{\ell}=\ell. We will exercise our freedom to choose γ\gamma_{\ell} as simple as possible.

First we consider the G(Z1)G(Z_{1})-orbits in Q1\G(X1)Q_{1}\operatorname{\backslash}G(X_{1}). If LL is non-trivial, then we will further consider the J(Z1,L)J(Z_{1},L)-orbits. Given an isotropic line in X1X_{1}, we pick a non-zero vector xx on the line and write x=v+zx=v+z according to the decomposition X1=VZ1X_{1}=V\perp Z_{1}. There are three cases, so we define:

  1. (1)

    Ω0,1\Omega_{0,1} to be the set of (isotropic) lines in X1X_{1} whose projection to VV is 0;

  2. (2)

    Ω1,0\Omega_{1,0} to be the set of (isotropic) lines in X1X_{1} whose projection to Z1Z_{1} is 0;

  3. (3)

    Ω1,1\Omega_{1,1} to be the set of (isotropic) lines in X1X_{1} whose projections to both VV and Z1Z_{1} are non-zero.

Each set is stable under the action of G(Z1)G(Z_{1}). The set Ω0,1\Omega_{0,1} forms one G(Z1)G(Z_{1})-orbit. We may take Fe1=1Fe_{1}^{-}=\ell_{1}^{-} as the orbit representative. Its stabiliser in G(Z1)G(Z_{1}) is the parabolic subgroup Q(Z1,Fe1)Q(Z_{1},Fe_{1}^{-}) that stabilises Fe1Fe_{1}^{-}. The set Ω1,0\Omega_{1,0} is acted on by G(Z1)G(Z_{1}) trivially. A set of orbit representatives is (V{0})/F×(V-\{0\})/F^{\times} and for each representative the stabiliser is G(Z1)G(Z_{1}). Finally consider the set Ω1,1\Omega_{1,1}. A line F(v+z)F(v+z) in Ω1,1\Omega_{1,1} is in the same G(Z1)G(Z_{1})-orbit as F(v+e1)F(v+e_{1}^{-}). For v1,v2V{0}v_{1},v_{2}\in V-\{0\}, F(v1+e1)F(v_{1}+e_{1}^{-}) and F(v2+e1)F(v_{2}+e_{1}^{-}) are in the same orbit, if and only if there exist γG(Z1)\gamma\in G(Z_{1}) and cF×c\in F^{\times} such that v1+e1γ=c(v2+e1)v_{1}+e_{1}^{-}\gamma=c(v_{2}+e_{1}^{-}). Thus a set of orbit representatives is F(v+e1)F(v+e_{1}^{-}) for vv running over a set of representatives of (V{0})/F×(V-\{0\})/F^{\times}. For each orbit representative, the stabiliser is J(Z1,Fe1)J(Z_{1},Fe_{1}^{-}).

Thus we cut the series over Q1\G(X1)Q_{1}\operatorname{\backslash}G(X_{1}) into three parts and we get

I(ξ)=IΩ0,1(ξ)+IΩ1,0(ξ)+IΩ1,1(ξ)I(\xi)=I_{\Omega_{0,1}}(\xi)+I_{\Omega_{1,0}}(\xi)+I_{\Omega_{1,1}}(\xi)

with

(6.4) IΩ0,1(ξ)\displaystyle I_{\Omega_{0,1}}(\xi) =[J(Z1,L)]δQ(Z1,Fe1)\G(Z1)ξ(δg)dg\displaystyle=\int_{[J(Z_{1},L)]}\sum_{\delta\in Q(Z_{1},Fe_{1}^{-})\operatorname{\backslash}G(Z_{1})}\xi(\delta g)dg
IΩ1,0(ξ)\displaystyle I_{\Omega_{1,0}}(\xi) =[J(Z1,L)]v(V{0})/F×ξ(γFvg)dg\displaystyle=\int_{[J(Z_{1},L)]}\sum_{v\in(V-\{0\})/F^{\times}}\xi(\gamma_{Fv}g)dg
IΩ1,1(ξ)\displaystyle I_{\Omega_{1,1}}(\xi) =[J(Z1,L)]δJ(Z1,Fe1)\G(Z1)v(V{0})/F×ξ(γF(v+e1)δg)dg.\displaystyle=\int_{[J(Z_{1},L)]}\sum_{\delta\in J(Z_{1},Fe_{1}^{-})\operatorname{\backslash}G(Z_{1})}\sum_{v\in(V-\{0\})/F^{\times}}\xi(\gamma_{F(v+e_{1}^{-})}\delta g)dg.
Proposition 6.5.

For ξ=ξc,s\xi=\xi_{c,s} or ξsc\xi_{s}^{c}, the integrals IΩ0,1(ξ)I_{\Omega_{0,1}}(\xi), IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi) and IΩ1,1(ξ)I_{\Omega_{1,1}}(\xi) are absolutely convergent for Res\operatorname{\mathrm{Re}}s and cc large enough and each has meromorphic continuation to the whole complex plane.

Proof.

The whole Sec. 5 of [23] deals with bounds and convergence issues for the symplectic group case. It carries over to the metaplectic case. Meromorphic continuation follows from computation in Sec. 7. ∎

Thus we are free to change the order of summation and integration when we evaluate the integrals. By using the results in Sec. 7 which is dedicated to evaluating the integrals, we can now prove Theorems. 6.1,  6.2.

Proof of Thm. 6.1.

First assume that dimL=0\dim L=0. Then the non-distinction conditions for groups ‘larger than’ G(Z)G(Z) in the assumption of the theorem mean that the conditions of Propositions 7.2 and 7.3 are satisfied. Thus the propositions show that IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi) and IΩ1,1(ξ)I_{\Omega_{1,1}}(\xi) vanish.

Assume that M(w,s)M(w,s) does not have a pole at s=s0s=s_{0}. Then by (7.1), IΩ0,1(ξsc)I_{\Omega_{0,1}}(\xi_{s}^{c}) does not have a pole at s=s0s=s_{0}. By part (3) of Prop. 7.1, the assumption of distinction by G(Z)G(Z) shows that IΩ0,1(ξc,s)I_{\Omega_{0,1}}(\xi_{c,s}) has a pole at s=s0s=s_{0}. This means that ΛcE(g,s,f)\Lambda^{c}E(g,s,f) and as a result E(g,s,f)E(g,s,f) has a pole at s=s0s=s_{0}. We get a contradiction. Thus M(w,s)M(w,s) must have a pole at s=s0s=s_{0}, which implies that E(g,s,f)E(g,s,f) has a pole at s=s0s=s_{0}.

Next assume that dimL=1\dim L=1. We note that in Sec. 7.2, IΩ0,1(ξ)I_{\Omega_{0,1}}(\xi) is further cut into 3 parts: JΩ0,1,1(ξ)J_{\Omega_{0,1},1}(\xi), JΩ0,1,2(ξ)J_{\Omega_{0,1},2}(\xi) and JΩ0,1,3(ξ)J_{\Omega_{0,1},3}(\xi) and that IΩ1,1(ξ)I_{\Omega_{1,1}}(\xi) is further cut into 3 parts: JΩ1,1,1(ξ)J_{\Omega_{1,1},1}(\xi), JΩ1,1,2(ξ)J_{\Omega_{1,1},2}(\xi) and JΩ1,1,3(ξ)J_{\Omega_{1,1},3}(\xi). The non-distinction conditions for groups ‘larger than’ J(Z,L)J(Z,L) in the assumption of the theorem mean that the conditions of Propositions 7.4, 7.6, 7.7, 7.8, 7.9, 7.10 are satisfied. Thus JΩ0,1,1(ξ)J_{\Omega_{0,1},1}(\xi), JΩ0,1,3(ξ)J_{\Omega_{0,1},3}(\xi), IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi), JΩ1,1,1(ξ)J_{\Omega_{1,1},1}(\xi), JΩ1,1,2(ξ)J_{\Omega_{1,1},2}(\xi) and JΩ1,1,3(ξ)J_{\Omega_{1,1},3}(\xi) all vanish. It remains to consider JΩ0,1,2(ξ)J_{\Omega_{0,1},2}(\xi) which is defined in (7.5).

Assume that M(w,s)M(w,s) does not have a pole at s=s0s=s_{0}, then by (7.7), JΩ0,1,2(ξsc)J_{\Omega_{0,1},2}(\xi_{s}^{c}) does not have a pole at s=s0s=s_{0}. By part (3) of Prop. 7.5, the assumption of distinction by J(Z,L)J(Z,L) shows that JΩ0,1,2(ξc,s)J_{\Omega_{0,1},2}(\xi_{c,s}) has a pole at s=s0s=s_{0}. This means that ΛcE(g,s,f)\Lambda^{c}E(g,s,f) and as a result E(g,s,f)E(g,s,f) has a pole at s=s0s=s_{0}. We get a contradiction. Thus M(w,s)M(w,s) must have a pole at s=s0s=s_{0}, which implies that E(g,s,f)E(g,s,f) has a pole at s=s0s=s_{0}. ∎

Proof of Thm. 6.2.

Let s1>0s_{1}>0. We show that the integral (6.3) is absolutely convergent and we then check if it vanishes or not.

We take residue of the second term in (6.1) and set

θc(g)\displaystyle\theta^{c}(g) =Q1\G(X1)s1,Q1(γg,fs)τ^c(H(γg))\displaystyle=\sum_{Q_{1}\operatorname{\backslash}G(X_{1})}\mathcal{E}_{s_{1},Q_{1}}(\gamma g,f_{s})\hat{\tau}^{c}(H(\gamma g))
=Q1\G(X1)ress=s1(M(w,s)fs(γg))τ^c(H(γg)).\displaystyle=\sum_{Q_{1}\operatorname{\backslash}G(X_{1})}\operatorname{\mathrm{res}}_{s=s_{1}}(M(w,s)f_{s}(\gamma g))\hat{\tau}^{c}(H(\gamma g)).

Note that this is a finite sum for fixed gg. Then the truncated residue is

Λcs1(g,fs)=s1(g,fs)θc(g).\Lambda^{c}\mathcal{E}_{s_{1}}(g,f_{s})=\mathcal{E}_{s_{1}}(g,f_{s})-\theta^{c}(g).

The integral

[J(Z1,L)]θc(g)θX1,Y(g,1,Φ)¯𝑑g\int_{[J(Z_{1},L)]}\theta^{c}(g)\overline{\theta_{X_{1},Y}(g,1,\Phi)}dg

is absolutely convergent when Re(s1)\operatorname{\mathrm{Re}}(s_{1}) and cc are large and has meromorphic continuation to all s1s_{1}\in\mathbb{C} by Prop. 6.5. It is equal to ress=s1I(ξsc)\operatorname{\mathrm{res}}_{s=s_{1}}I(\xi_{s}^{c}). Thus

[J(Z1,L)]s1(g,fs)θX1,Y(g,1,Φ)¯𝑑g\displaystyle\phantom{=}\int_{[J(Z_{1},L)]}\mathcal{E}_{s_{1}}(g,f_{s})\overline{\theta_{X_{1},Y}(g,1,\Phi)}dg
=[J(Z1,L)](Λcs1(g,fs)+θc(g))θX1,Y(g,1,Φ)¯𝑑g\displaystyle=\int_{[J(Z_{1},L)]}(\Lambda^{c}\mathcal{E}_{s_{1}}(g,f_{s})+\theta^{c}(g))\overline{\theta_{X_{1},Y}(g,1,\Phi)}dg
=ress=s1(I(ξc,s)I(ξsc))+ress=s1I(ξsc)\displaystyle=\operatorname{\mathrm{res}}_{s=s_{1}}(I(\xi_{c,s})-I(\xi_{s}^{c}))+\operatorname{\mathrm{res}}_{s=s_{1}}I(\xi_{s}^{c})
=ress=s1I(ξc,s).\displaystyle=\operatorname{\mathrm{res}}_{s=s_{1}}I(\xi_{c,s}).

In addition, the first equality shows that (6.3) is absolutely convergent.

Now if s1=s0s_{1}=s_{0}, then by Prop. 7.1 for dimL=0\dim L=0 and Prop. 7.5 for dimL=1\dim L=1, (6.3) is non-vanishing for some choice of data. If s1s0s_{1}\neq s_{0} or if we integrate over [J(Z1′′,L′′)][J(Z^{\prime\prime}_{1},L^{\prime\prime})] with (Z′′,L′′)(Z^{\prime\prime},L^{\prime\prime}) ‘larger than’ (Z,L)(Z,L), again by Prop. 7.1 for dimL=0\dim L=0 and Prop. 7.5 for dimL=1\dim L=1, (6.3) always vanishes. ∎

7. Computation of integrals

Set r=dimXdimZ+dimLr=\dim X-\dim Z+\dim L and s0=(dimX(dimY+2r)+2)/2s_{0}=(\dim X-(\dim Y+2r)+2)/2. The goal of this section is to compute IΩ0,1(ξ)I_{\Omega_{0,1}}(\xi), IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi) and IΩ1,1(ξ)I_{\Omega_{1,1}}(\xi) defined in (6.4).

7.1. Case dimL=0\dim L=0

We note that since dimL=0\dim L=0, J(Z1,L)J(Z_{1},L) is simply the symplectic group G(Z1)G(Z_{1}).

7.1.1. IΩ0,1(ξ)I_{\Omega_{0,1}}(\xi)

We collapse the integral and series. We get

IΩ0,1(ξ)\displaystyle I_{\Omega_{0,1}}(\xi) =Q(Z1,Fe1)(F)\G(Z1)(𝔸)ξ(g)𝑑g\displaystyle=\int_{Q(Z_{1},Fe_{1}^{-})(F)\operatorname{\backslash}G(Z_{1})(\mathbb{A})}\xi(g)dg
=KG(Z1)[Q(Z1,Fe1)]ξ(qk)𝑑q𝑑k\displaystyle=\int_{K_{G(Z_{1})}}\int_{[Q(Z_{1},Fe_{1}^{-})]}\xi(qk)dqdk
=KG(Z1)[G(Z1)][GL1][N(Z1,Fe1)]ξ(nm1(t)hk)|t|𝔸2ρQ(X1,Fe1)𝑑n𝑑t𝑑h𝑑k.\displaystyle=\int_{K_{G(Z_{1})}}\int_{[G(Z_{1})]}\int_{[\operatorname{\mathrm{GL}}_{1}]}\int_{[N(Z_{1},Fe_{1}^{-})]}\xi(nm_{1}(t)hk)|t|_{\mathbb{A}}^{-2\rho_{Q(X_{1},Fe_{1}^{-})}}dndtdhdk.

We note that ξ\xi is the product of two genuine factors, so it is not genuine itself. Let ξ=ξc,s\xi=\xi_{c,s}. Then

ξ(nm1(t)hk)\displaystyle\xi(nm_{1}(t)hk) =fs(nm1(t)hk)θX1,Y(nm1(t)hk,1,Φ)¯τ^c(H(nm1(t)hk))\displaystyle=f_{s}(nm_{1}(t)hk)\overline{\theta_{X_{1},Y}(nm_{1}(t)hk,1,\Phi)}\hat{\tau}_{c}(H(nm_{1}(t)hk))
=χYχψ(t)|t|𝔸s+ρQ1fs(hk)θX1,Y(nm1(t)hk,1,Φ)¯τ^c(H(m1(t))).\displaystyle=\chi_{Y}\chi_{\psi}(t)|t|_{\mathbb{A}}^{s+\rho_{Q_{1}}}f_{s}(hk)\overline{\theta_{X_{1},Y}(nm_{1}(t)hk,1,\Phi)}\hat{\tau}_{c}(H(m_{1}(t))).

We integrate over n[N(Z1,Fe1)]n\in[N(Z_{1},Fe_{1}^{-})] first. The only term involving nn is θX1,Y\theta_{X_{1},Y}. If we realise the Weil representation on the mixed model 𝒮((Y1+(YX)+)(𝔸))\mathcal{S}((Y\otimes\ell_{1}^{+}\oplus(Y\otimes X)^{+})(\mathbb{A})), then using explicit formulae for the Weil representation and noting that YY is anisotropic we get

[N(Z1,Fe1)]θX1,Y(nm1(t)hk,1,Φ)𝑑n\displaystyle\phantom{=}\int_{[N(Z_{1},Fe_{1}^{-})]}\theta_{X_{1},Y}(nm_{1}(t)hk,1,\Phi)dn
=[Hom(1+,Z)]w(YX)+(F)ωX1,Y(n(μ,0)m1(t)hk,1)Φ(0,w)dμ\displaystyle=\int_{[\operatorname{\mathrm{Hom}}(\ell_{1}^{+},Z)]}\sum_{w\in(Y\otimes X)^{+}(F)}\omega_{X_{1},Y}(n(\mu,0)m_{1}(t)hk,1)\Phi(0,w)d\mu
=w(YX)+(F)ωX1,Y(m1(t)hk,1)Φ(0,w)\displaystyle=\sum_{w\in(Y\otimes X)^{+}(F)}\omega_{X_{1},Y}(m_{1}(t)hk,1)\Phi(0,w)
=χYχψ(t)|t|𝔸dimY/2θX,Y(h,1,Φk).\displaystyle=\chi_{Y}\chi_{\psi}(t)|t|_{\mathbb{A}}^{\dim Y/2}\theta_{X,Y}(h,1,\Phi_{k}).

Here Φk()=ωX1,Y(k,1)Φ(0,)\Phi_{k}(\cdot)=\omega_{X_{1},Y}(k,1)\Phi(0,\cdot) and for μHom(1+,Z)\mu\in\operatorname{\mathrm{Hom}}(\ell_{1}^{+},Z), n(μ,0)n(\mu,0) denote the unipotent element in N(Z1,Fe1)N(Z_{1},Fe_{1}^{-}) that is characterised by the condition that the XX-component of the image of e1+e_{1}^{+} under n(μ,0)n(\mu,0) is μ(e1+)\mu(e_{1}^{+}). Next we integrate over t[GL1]t\in[\operatorname{\mathrm{GL}}_{1}]. More precisely, in the following expression, tt should be viewed as any element in the pre-image of tt in GL~1(𝔸)\widetilde{\operatorname{\mathrm{GL}}}_{1}(\mathbb{A}), but the choice does not matter. Excluding terms not involving tt, we get

[GL1]χYχψ(t)|t|𝔸s+ρQ1χYχψ(t)|t|𝔸dimY/2¯τ^c(H(m1(t)))|t|𝔸2ρQ(X1,Fe1)𝑑t\displaystyle\phantom{=}\int_{[\operatorname{\mathrm{GL}}_{1}]}\chi_{Y}\chi_{\psi}(t)|t|_{\mathbb{A}}^{s+\rho_{Q_{1}}}\overline{\chi_{Y}\chi_{\psi}(t)|t|_{\mathbb{A}}^{\dim Y/2}}\hat{\tau}_{c}(H(m_{1}(t)))|t|_{\mathbb{A}}^{-2\rho_{Q(X_{1},Fe_{1}^{-})}}dt
=vol(F×\𝔸1)0ctss0d×t.\displaystyle=\operatorname{\mathrm{vol}}(F^{\times}\operatorname{\backslash}\mathbb{A}^{1})\int_{0}^{c}t^{s-s_{0}}d^{\times}t.

For Res>s0\operatorname{\mathrm{Re}}s>s_{0}, we get

IΩ0,1(ξc,s)=vol(F×\𝔸1)css0ss0KG(Z1)[G(Z)]fs(hk)θX,Y(h,1,Φk)¯𝑑h𝑑k.I_{\Omega_{0,1}}(\xi_{c,s})=\operatorname{\mathrm{vol}}(F^{\times}\operatorname{\backslash}\mathbb{A}^{1})\frac{c^{s-s_{0}}}{s-s_{0}}\int_{K_{G(Z_{1})}}\int_{[G(Z)]}f_{s}(hk)\overline{\theta_{X,Y}(h,1,\Phi_{k})}dhdk.

This expression provides the meromorphic continuation of IΩ0,1(ξ)I_{\Omega_{0,1}}(\xi) as a function in ss.

Next let ξ=ξsc\xi=\xi^{c}_{s}. The computation is analogous and we get for Res>s0\operatorname{\mathrm{Re}}s>-s_{0},

(7.1) IΩ0,1(ξsc)=vol(F×\𝔸1)css0s+s0KG(Z1)[G(Z)]M(w,s)fs(hk)θX,Y(h,1,Φk)¯𝑑h𝑑k.I_{\Omega_{0,1}}(\xi_{s}^{c})=\operatorname{\mathrm{vol}}(F^{\times}\operatorname{\backslash}\mathbb{A}^{1})\frac{c^{-s-s_{0}}}{s+s_{0}}\int_{K_{G(Z_{1})}}\int_{[G(Z)]}M(w,s)f_{s}(hk)\overline{\theta_{X,Y}(h,1,\Phi_{k})}dhdk.

With this computation, we get immediately the first two statements of the next proposition:

Proposition 7.1.
  1. (1)

    If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not G(Z)G(Z)-distinguished, then both IΩ0,1(ξc,s)I_{\Omega_{0,1}}(\xi_{c,s}) and IΩ0,1(ξsc)I_{\Omega_{0,1}}(\xi^{c}_{s}) vanish identically.

  2. (2)

    IΩ0,1(ξc,s)I_{\Omega_{0,1}}(\xi_{c,s}) does not have a pole at ss0s\neq s_{0}.

  3. (3)

    If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is G(Z)G(Z)-distinguished, then the residue

    (7.2) vol(F×\𝔸1)KG(Z1)[G(Z)]fs(hk)θX,Y(h,1,Φk)¯𝑑h𝑑k\operatorname{\mathrm{vol}}(F^{\times}\operatorname{\backslash}\mathbb{A}^{1})\int_{K_{G(Z_{1})}}\int_{[G(Z)]}f_{s}(hk)\overline{\theta_{X,Y}(h,1,\Phi_{k})}dhdk

    of IΩ0,1(ξc,s)I_{\Omega_{0,1}}(\xi_{c,s}) at s=s0s=s_{0} does not vanish for some choice of data.

Proof.

The proof of (3) is similar to that in [23, Prop. 4.1]. We start with some choice of data such that

[G(Z)]ϕ(h)θX,Y(h,1,Ψ)¯𝑑h0.\int_{[G(Z)]}\phi(h)\overline{\theta_{X,Y}(h,1,\Psi)}dh\neq 0.

Then we can construct a section fs𝒜1(s,χ,σ)f_{s}\in\mathcal{A}_{1}(s,\chi,\sigma) that ‘extends’ ϕ\phi and a Schwartz function Φ𝒮((YFe1+(YX)+)(𝔸))\Phi\in\mathcal{S}((Y\otimes Fe_{1}^{+}\oplus(Y\otimes X)^{+})(\mathbb{A})) that ‘extends’ Ψ\Psi such that (7.2) is non-vanishing. ∎

7.1.2. IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi)

For each vV{0}v\in V-\{0\}, we look at the vv-summand of IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi):

(7.3) [G(Z1)]ξ(γFvg)𝑑g.\int_{[G(Z_{1})]}\xi(\gamma_{Fv}g)dg.

Take v+v^{+} in VV such that v+,vV=1\langle{v^{+}},{v}\rangle_{V}=1. We take γFv\gamma_{Fv} to be the element in G(X1)(F)G(X_{1})(F) that is determined by e1+v+e_{1}^{+}\leftrightarrow v^{+} and e1ve_{1}^{-}\leftrightarrow v on the span of e1+,e1,v+,ve_{1}^{+},e_{1}^{-},v^{+},v and the identity action on the orthogonal complement. Then γFvG(Z1)γFv1=G(Fv+ZFv)\gamma_{Fv}G(Z_{1})\gamma_{Fv}^{-1}=G(Fv^{+}\oplus Z\oplus Fv). Thus (7.3) is equal to

[G(Fv+ZFv)]ξ(gγFv)𝑑g.\int_{[G(Fv^{+}\oplus Z\oplus Fv)]}\xi(g\gamma_{Fv})dg.

This is a period integral on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over the subgroup G(Fv+ZFv)G(Fv^{+}\oplus Z\oplus Fv) of G(X)G(X). Thus we get

Proposition 7.2.

If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not G(Z)G(Z^{\prime})-distinguished for all ZZZ^{\prime}\supset Z with dimZ=dimZ+2\dim Z^{\prime}=\dim Z+2, then IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi) vanishes for ξ=ξc,s\xi=\xi_{c,s} and ξsc\xi_{s}^{c}.

7.1.3. IΩ1,1(ξ)I_{\Omega_{1,1}}(\xi)

We collapse the series over δ\delta and the integral to get

J(Z1,Fe1)(F)\G(Z1)(𝔸)v(V{0})/F×ξ(γF(v+e1)g)dg.\int_{J(Z_{1},Fe_{1}^{-})(F)\operatorname{\backslash}G(Z_{1})(\mathbb{A})}\sum_{v\in(V-\{0\})/F^{\times}}\xi(\gamma_{F(v+e_{1}^{-})}g)dg.

Using the Iwasawa decomposition we get that each vv-term is equal to

KG(Z1)GL1(𝔸)[J(Z1,Fe1)]ξ(γF(v+e1)gm1(t)k)|t|𝔸2ρQ(Z1,Fe1)𝑑g𝑑t𝑑k.\int_{K_{G(Z_{1})}}\int_{\operatorname{\mathrm{GL}}_{1}(\mathbb{A})}\int_{[J(Z_{1},Fe_{1}^{-})]}\xi(\gamma_{F(v+e_{1}^{-})}gm_{1}(t)k)|t|_{\mathbb{A}}^{-2\rho_{Q(Z_{1},Fe_{1}^{-})}}dgdtdk.

We take γF(v+e1)\gamma_{F(v+e_{1}^{-})} to be the element that is given by e1+v+e_{1}^{+}\mapsto v^{+}, v+e1+v+v^{+}\mapsto e_{1}^{+}-v^{+}, ve1v\mapsto e_{1}^{-} and e1v+e1+e_{1}^{-}\mapsto v+e_{1}^{+} on the span of e1+,e1,v+,ve_{1}^{+},e_{1}^{-},v^{+},v and the identity action on the orthogonal complement. Since γF(v+e1)J(Z1,Fe1)γF(v+e1)1=J(Fv+ZFv,Fv)\gamma_{F(v+e_{1}^{-})}J(Z_{1},Fe_{1}^{-})\gamma_{F(v+e_{1}^{-})}^{-1}=J(Fv^{+}\oplus Z\oplus Fv,Fv), we get the inner integral

[J(Fv+ZFv,Fv)]ξ(gm1(t)k)𝑑g\int_{[J(Fv^{+}\oplus Z\oplus Fv,Fv)]}\xi(gm_{1}(t)k)dg

which is a period integral on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over the subgroup J(Fv+ZFv,Fv)J(Fv^{+}\oplus Z\oplus Fv,Fv) of G(X)G(X). Thus we get

Proposition 7.3.

If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not J(Z,L)J(Z^{\prime},L^{\prime})-distinguished for all ZZZ^{\prime}\supset Z with dimZ=dimZ+2\dim Z^{\prime}=\dim Z+2 and LL^{\prime} an isotropic line of ZZ^{\prime} in the orthogonal complement of ZZ, then IΩ1,1(ξ)I_{\Omega_{1,1}}(\xi) vanishes for ξ=ξc,s\xi=\xi_{c,s} and ξsc\xi_{s}^{c}.

7.2. Case dimL=1\dim L=1

7.2.1. IΩ0,1(ξ)I_{\Omega_{0,1}}(\xi)

We consider the J(Z1,L)J(Z_{1},L)-orbits in Q(Z1,Fe1)\G(Z1)Q(Z_{1},Fe_{1}^{-})\operatorname{\backslash}G(Z_{1}) or equivalently in the set of isotropic lines in Z1Z_{1}. For an isotropic line \ell in Z1Z_{1}, let δ\delta_{\ell} denote any element in G(Z1)G(Z_{1}) such that Fe1δ=Fe_{1}^{-}\delta_{\ell}=\ell. There are three J(Z1,L)J(Z_{1},L)-orbits. Let f1f_{1}^{-} be any non-zero element in LL and f1+f_{1}^{+} be an element in ZZ such that f1+,f1Z=1\langle{f_{1}^{+}},{f_{1}^{-}}\rangle_{Z}=1. Write Z=Ff1+WFf1Z=Ff_{1}^{+}\oplus W\oplus Ff_{1}^{-} and form the augmented space W1=1+WW_{1}=\ell_{1}^{+}\oplus W\oplus\ell^{-}. We note that Z1=Ff1+W1Ff1Z_{1}=Ff_{1}^{+}\oplus W_{1}\oplus Ff_{1}^{-}. An isotropic line F(af1++w+bf1)F(af_{1}^{+}+w+bf_{1}^{-}) in Z1Z_{1} for a,bFa,b\in F and wW1w\in W_{1} is in the same J(Z1,L)J(Z_{1},L)-orbit as

Ff1+,if a0;\displaystyle Ff_{1}^{+},\quad\text{if $a\neq 0$};
Fe1,if a=0 and w0;\displaystyle Fe_{1}^{-},\quad\text{if $a=0$ and $w\neq 0$};
Ff1,if a=0 and w=0.\displaystyle Ff_{1}^{-},\quad\text{if $a=0$ and $w=0$}.

The stabiliser of Ff1+Ff_{1}^{+} in J(Z1,L)J(Z_{1},L) is G(W1)G(W_{1}) and we have StabJ(Z1,L)Ff1+\J(Z1,L)N(Z1,L)\operatorname{\mathrm{Stab}}_{J(Z_{1},L)}Ff_{1}^{+}\operatorname{\backslash}J(Z_{1},L)\cong N(Z_{1},L). To describe the stabiliser of Fe1Fe_{1}^{-}, let NJ1NJ_{1} be the subgroup of J(Z1,L)J(Z_{1},L) consisting of elements of the form

(10001000I0011)\begin{pmatrix}1&*&0&0&0\\ &1&0&0&0\\ &&I&0&0\\ &&&1&*\\ &&&&1\end{pmatrix}

with respect to the ‘basis’ f1+,e1+,W,e1,f1f_{1}^{+},e_{1}^{+},W,e_{1}^{-},f_{1}^{-} and NJ2NJ_{2} the subgroup of J(Z1,L)J(Z_{1},L) consisting of elements of the form

(10100I0101).\begin{pmatrix}1&0&*&*&*\\ &1&0&0&*\\ &&I&0&*\\ &&&1&0\\ &&&&1\end{pmatrix}.

Then the stabiliser of Fe1Fe_{1}^{-} in J(Z1,L)J(Z_{1},L) is NJ2Q(W1,Fe1)NJ_{2}\rtimes Q(W_{1},Fe_{1}^{-}). For Ff1Ff_{1}^{-} the stabiliser is the full J(Z1,L)J(Z_{1},L). Thus IΩ0,1(ξ)I_{\Omega_{0,1}}(\xi) is further split into three parts:

(7.4) JΩ0,1,1(ξ)\displaystyle J_{\Omega_{0,1},1}(\xi) =[J(Z1,L)]ηN(Z1,L)ξ(δFf1+ηg)dg;\displaystyle=\int_{[J(Z_{1},L)]}\sum_{\eta\in N(Z_{1},L)}\xi(\delta_{Ff_{1}^{+}}\eta g)dg;
(7.5) JΩ0,1,2(ξ)\displaystyle J_{\Omega_{0,1},2}(\xi) =[J(Z1,L)]ηNJ2Q(W1,Fe1)\J(Z1,L)ξ(ηg)dg;\displaystyle=\int_{[J(Z_{1},L)]}\sum_{\eta\in NJ_{2}\rtimes Q(W_{1},Fe_{1}^{-})\operatorname{\backslash}J(Z_{1},L)}\xi(\eta g)dg;
(7.6) JΩ0,1,3(ξ)\displaystyle J_{\Omega_{0,1},3}(\xi) =[J(Z1,L)]ξ(δFf1g)𝑑g.\displaystyle=\int_{[J(Z_{1},L)]}\xi(\delta_{Ff_{1}^{-}}g)dg.

Now we evaluate them one by one.

We collapse the series and the integral and find that (7.4) is equal to

N(Z1,L)(𝔸)[G(W1)]ξ(δFf1+gn)𝑑g𝑑n.\int_{N(Z_{1},L)(\mathbb{A})}\int_{[G(W_{1})]}\xi(\delta_{Ff_{1}^{+}}gn)dgdn.

Consider the inner integral. We may pick δFf1+\delta_{Ff_{1}^{+}} to be the element that is given by e1+f1e_{1}^{+}\leftrightarrow-f_{1}^{-} and e1f1+e_{1}^{-}\leftrightarrow f_{1}^{+} on the span of e1±,f1±e_{1}^{\pm},f_{1}^{\pm} and identity on the orthogonal complement. Since δFf1+G(W1)δFf1+1=G(Ff1+WFf1)=G(Z)\delta_{Ff_{1}^{+}}G(W_{1})\delta_{Ff_{1}^{+}}^{-1}=G(Ff_{1}^{+}\oplus W\oplus Ff_{1}^{-})=G(Z), this inner integral is a period integral on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over the subgroup G(Z)G(Z) of G(X)G(X). Thus we get

Proposition 7.4.

If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not G(Z)G(Z)-distinguished, then JΩ0,1,1(ξ)J_{\Omega_{0,1},1}(\xi) vanishes for ξ=ξc,s\xi=\xi_{c,s} and ξsc\xi_{s}^{c}.

We collapse the series and the integral and find that (7.5) is equal to

NJ1(𝔸)[NJ2]Q(W1,Fe1)(F)\G(W1)(𝔸)ξ(n2n1g)𝑑g𝑑n2𝑑n1.\int_{NJ_{1}(\mathbb{A})}\int_{[NJ_{2}]}\int_{Q(W_{1},Fe_{1}^{-})(F)\operatorname{\backslash}G(W_{1})(\mathbb{A})}\xi(n_{2}n_{1}g)dgdn_{2}dn_{1}.

Then using the Iwasawa decomposition of G(W1)(𝔸)G(W_{1})(\mathbb{A}) we get

KG(W1)NJ1(𝔸)[NJ2][N(W1,Fe1)][G(W)][GL1]ξ(n2n1nm1(t)gk)\displaystyle\phantom{=}\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[NJ_{2}]}\int_{[N(W_{1},Fe_{1}^{-})]}\int_{[G(W)]}\int_{[GL_{1}]}\xi(n_{2}n_{1}nm_{1}(t)gk)
|t|𝔸2ρQ((W1,Fe1))dtdgdndn2dn1dk\displaystyle\qquad\qquad|t|_{\mathbb{A}}^{-2\rho_{Q((W_{1},Fe_{1}^{-}))}}dtdgdndn_{2}dn_{1}dk
=KG(W1)NJ1(𝔸)[NJ2][N(W1,Fe1)][G(W)][GL1]ξ(nn2m1(t)gn1k)\displaystyle=\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[NJ_{2}]}\int_{[N(W_{1},Fe_{1}^{-})]}\int_{[G(W)]}\int_{[GL_{1}]}\xi(nn_{2}m_{1}(t)gn_{1}k)
|t|𝔸2ρQ((W1,Fe1))1dtdgdndn2dn1dk.\displaystyle\qquad\qquad|t|_{\mathbb{A}}^{-2\rho_{Q((W_{1},Fe_{1}^{-}))}-1}dtdgdndn_{2}dn_{1}dk.

Now we collapse part of NJ2NJ_{2} and G(W)G(W) to get J(Z,Ff1)J(Z,Ff_{1}^{-}). We get

KG(W1)NJ1(𝔸)[N][J(Z,f1)][GL1]ξ(nm1(t)gn1k)|t|𝔸2ρQ((W1,Fe1))1𝑑t𝑑g𝑑n𝑑k.\displaystyle\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[N^{\prime}]}\int_{[J(Z,f_{1}^{-})]}\int_{[GL_{1}]}\xi(n^{\prime}m_{1}(t)gn_{1}k)|t|_{\mathbb{A}}^{-2\rho_{Q((W_{1},Fe_{1}^{-}))}-1}dtdgdn^{\prime}dk.

Note that N=N(Z1,Fe1)N(Z1,Fe1Ff1)N^{\prime}=N(Z_{1},Fe_{1}^{-})\cap N(Z_{1},Fe_{1}^{-}\oplus Ff_{1}^{-}) is formed out of the leftover part of NJ2NJ_{2} and N(W1,Fe1)N(W_{1},Fe_{1}^{-}).

Suppose that ξ=ξc,s\xi=\xi_{c,s}. Then

ξ(nm1(t)gn1k)\displaystyle\phantom{=}\xi(n^{\prime}m_{1}(t)gn_{1}k)
=fs(nm1(t)gn1k)θX1,Y(nm1(t)gn1k,1,Φ)¯τ^c(H(nm1(t)gn1k))\displaystyle=f_{s}(n^{\prime}m_{1}(t)gn_{1}k)\overline{\theta_{X_{1},Y}(n^{\prime}m_{1}(t)gn_{1}k,1,\Phi)}\hat{\tau}_{c}(H(n^{\prime}m_{1}(t)gn_{1}k))
=χYχψ(m1(t))|t|𝔸s+ρQ1fs(gn1k)θX1,Y(nm1(t)gn1k,1,Φ)¯τ^c(H(m1(t)n1)).\displaystyle=\chi_{Y}\chi_{\psi}(m_{1}(t))|t|_{\mathbb{A}}^{s+\rho_{Q_{1}}}f_{s}(gn_{1}k)\overline{\theta_{X_{1},Y}(n^{\prime}m_{1}(t)gn_{1}k,1,\Phi)}\hat{\tau}_{c}(H(m_{1}(t)n_{1})).

The only term that involves nn^{\prime} is θX1,Y(nm1(t)gn1k,1,Φ)¯\overline{\theta_{X_{1},Y}(n^{\prime}m_{1}(t)gn_{1}k,1,\Phi)}. By the explicit formulae of the Weil representation, we get

[N]θX1,Y(nm1(t)gn1k,1,Φ)𝑑n=χYχψ(t)|t|𝔸dimY/2θX,Y(g,1,Φn1k),\int_{[N^{\prime}]}\theta_{X_{1},Y}(n^{\prime}m_{1}(t)gn_{1}k,1,\Phi)dn^{\prime}=\chi_{Y}\chi_{\psi}(t)|t|_{\mathbb{A}}^{\dim Y/2}\theta_{X,Y}(g,1,\Phi_{n_{1}k}),

where Φn1k()=ωX1,Y(n1k,1)Φ(0,)\Phi_{n_{1}k}(\cdot)=\omega_{X_{1},Y}(n_{1}k,1)\Phi(0,\cdot). In total, the exponent of |t|𝔸|t|_{\mathbb{A}} is

s+ρQ1+dimY/22ρQ((W1,Fe1))1=ss0.s+\rho_{Q_{1}}+\dim Y/2-2\rho_{Q((W_{1},Fe_{1}^{-}))}-1=s-s_{0}.

Thus JΩ0,1,1(ξc,s)J_{\Omega_{0,1},1}(\xi_{c,s}) is equal to

KG(W1)NJ1(𝔸)[J(Z,L)]fs(gn¯k)θX,Y(g,1,Φn¯k)¯[GL1]τ^c(H(m1(t)n1))|t|𝔸ss0𝑑t𝑑g𝑑n¯𝑑k\displaystyle\phantom{=}\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[J(Z,L)]}f_{s}(g\overline{n}k)\overline{\theta_{X,Y}(g,1,\Phi_{\overline{n}k})}\int_{[GL_{1}]}\hat{\tau}_{c}(H(m_{1}(t)n_{1}))|t|_{\mathbb{A}}^{s-s_{0}}dtdgd\overline{n}dk
=vol(F×\𝔸×)KG(W1)NJ1(𝔸)[J(Z,L)]fs(gn¯k)θX,Y(g,1,Φn¯k)¯(c/c(n¯))ss0ss0𝑑g𝑑n¯𝑑k,\displaystyle=\operatorname{\mathrm{vol}}(F^{\times}\operatorname{\backslash}\mathbb{A}^{\times})\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[J(Z,L)]}f_{s}(g\overline{n}k)\overline{\theta_{X,Y}(g,1,\Phi_{\overline{n}k})}\frac{(c/c(\overline{n}))^{s-s_{0}}}{s-s_{0}}dgd\overline{n}dk,

where c(n¯)=exp(H(n¯))c(\overline{n})=\exp(H(\overline{n})) where we note that H(n¯)𝔞M1H(\overline{n})\in\mathfrak{a}_{M_{1}}\cong\mathbb{R}.

Thus it can possibly have a pole only at s=s0s=s_{0} with residue

vol(F×\𝔸×)KG(W1)NJ1(𝔸)[J(Z,L)]fs0(gn¯k)θX,Y(g,1,Φn¯k)¯𝑑g𝑑n¯𝑑k.\operatorname{\mathrm{vol}}(F^{\times}\operatorname{\backslash}\mathbb{A}^{\times})\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[J(Z,L)]}f_{s_{0}}(g\overline{n}k)\overline{\theta_{X,Y}(g,1,\Phi_{\overline{n}k})}dgd\overline{n}dk.

Note that the innermost integral is a period integral on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over the subgroup J(Z,L)J(Z,L) of G(X)G(X). Similarly we evaluate JΩ0,1,1(ξsc)J_{\Omega_{0,1},1}(\xi_{s}^{c}) to get

(7.7) vol(F×\𝔸×)KG(W1)NJ1(𝔸)[J(Z,L)]M(w,s)fs(gn¯k)θX,Y(g,1,Φn¯k)¯\displaystyle\operatorname{\mathrm{vol}}(F^{\times}\operatorname{\backslash}\mathbb{A}^{\times})\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[J(Z,L)]}M(w,s)f_{s}(g\overline{n}k)\overline{\theta_{X,Y}(g,1,\Phi_{\overline{n}k})}
(c/c(n¯))ss0s+s0dgdn¯dk.\displaystyle\qquad\qquad\frac{(c/c(\overline{n}))^{-s-s_{0}}}{s+s_{0}}dgd\overline{n}dk.

Thus we get parts (1) and (2) of the following

Proposition 7.5.
  1. (1)

    If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not J(Z,L)J(Z,L)-distinguished, then JΩ0,1,2(ξ)J_{\Omega_{0,1},2}(\xi) vanishes identically for ξ=ξc,s\xi=\xi_{c,s} and ξsc\xi_{s}^{c};

  2. (2)

    JΩ0,1,2(ξ)J_{\Omega_{0,1},2}(\xi) does not have a pole at ss0s\neq s_{0};

  3. (3)

    If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is J(Z,L)J(Z,L)-distinguished, then the residue

    (7.8) vol(F×\𝔸×)KG(W1)NJ1(𝔸)[J(Z,L)]fs0(gn¯k)θX,Y(g,1,Φn¯k)¯𝑑g𝑑n¯𝑑k\operatorname{\mathrm{vol}}(F^{\times}\operatorname{\backslash}\mathbb{A}^{\times})\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[J(Z,L)]}f_{s_{0}}(g\overline{n}k)\overline{\theta_{X,Y}(g,1,\Phi_{\overline{n}k})}dgd\overline{n}dk

    of JΩ0,1,2(ξc,s)J_{\Omega_{0,1},2}(\xi_{c,s}) does not vanish for some choice of data.

Proof.

For the proof of (3), it can be checked that we can extend the proof in [23, Prop. 4.5] for the symplectic case to the metaplectic case. The proof there is quite technical due to the presence of the integration over [NJ1][NJ_{1}] which is a unipotent subgroup. We start with some choice of data such that

[J(Z,L)]ϕ(h)θX,Y(h,1,Ψ)¯𝑑h0.\int_{[J(Z,L)]}\phi(h)\overline{\theta_{X,Y}(h,1,\Psi)}dh\neq 0.

Then we can construct a section fs𝒜1(s,χ,σ)f_{s}\in\mathcal{A}_{1}(s,\chi,\sigma) that ‘extends’ ϕ\phi and a Schwartz function Φ𝒮(YFe1+(𝔸))^𝒮X,Y\Phi\in\mathcal{S}(Y\otimes Fe_{1}^{+}(\mathbb{A}))\hat{\otimes}\mathcal{S}_{X,Y} that ‘extends’ Ψ\Psi such that (7.8) is non-vanishing. ∎

Finally we evaluate (7.6). We take δFf1\delta_{Ff_{1}^{-}} to be the element that is given by e1+f1+e_{1}^{+}\leftrightarrow f_{1}^{+} and e1f1e_{1}^{-}\leftrightarrow f_{1}^{-} on the span of e1±,f1±e_{1}^{\pm},f_{1}^{\pm} and identity on the orthogonal complement. Then δFf1J(Z1,L)δFf11=J(Z1,Fe1)\delta_{Ff_{1}^{-}}J(Z_{1},L)\delta_{Ff_{1}^{-}}^{-1}=J(Z_{1},Fe_{1}^{-}). Thus (7.6) is equal to

[J(Z1,Fe1)]ξ(gδFf1)𝑑g=[N(Z1,Fe1)][G(Z)]ξ(gnδFf1)𝑑g𝑑n\int_{[J(Z_{1},Fe_{1}^{-})]}\xi(g\delta_{Ff_{1}^{-}})dg=\int_{[N(Z_{1},Fe_{1}^{-})]}\int_{[G(Z)]}\xi(gn\delta_{Ff_{1}^{-}})dgdn

whose inner integral is a period integral on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over [G(Z)][G(Z)]. Thus we get:

Proposition 7.6.

If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not G(Z)G(Z)-distinguished, then JΩ0,1,3(ξ)J_{\Omega_{0,1},3}(\xi) vanishes for ξc,s\xi_{c,s} and ξsc\xi_{s}^{c}.

7.2.2. IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi)

For each vV{0}v\in V-\{0\}, fix v+Vv^{+}\in V that is dual to vv, i.e., v+,v=1\langle{v^{+}},{v}\rangle=1. Then we take γFv\gamma_{Fv} that is determined by v+e1+v^{+}\leftrightarrow e_{1}^{+} and ve1v\leftrightarrow e_{1}^{-} on the span of e1+,e1,v+,ve_{1}^{+},e_{1}^{-},v^{+},v and identity on the orthogonal complement. Since γFvJ(Z1,L)γFv1J(Fv+ZFv,L)\gamma_{Fv}J(Z_{1},L)\gamma_{Fv}^{-1}\cong J(Fv^{+}\oplus Z\oplus Fv,L), IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi) is equal to

v(V{0}/F×)[J(Fv+ZFv,L)]ξ(gγFv)𝑑g\sum_{v\in(V-\{0\}/F^{\times})}\int_{[J(Fv^{+}\oplus Z\oplus Fv,L)]}\xi(g\gamma_{Fv})dg

which is a sum of period integrals on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over [J(Fv+ZFv,L)][J(Fv^{+}\oplus Z\oplus Fv,L)]. Thus we get

Proposition 7.7.

If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not J(Z,L)J(Z^{\prime},L)-distinguished for all ZZZ^{\prime}\supset Z such that dimZ=dimZ+2\dim Z^{\prime}=\dim Z+2, then IΩ1,0(ξ)I_{\Omega_{1,0}}(\xi) vanishes for ξ=ξc,s\xi=\xi_{c,s} and ξsc\xi_{s}^{c}.

7.2.3. IΩ1,1(ξ)I_{\Omega_{1,1}}(\xi)

We fix vV{0}v\in V-\{0\} and consider each vv-term

[J(Z1,L)]δJ(Z1,Fe1)\G(Z1)ξ(γF(v+e1)δg)dg.\displaystyle\int_{[J(Z_{1},L)]}\sum_{\delta\in J(Z_{1},Fe_{1}^{-})\operatorname{\backslash}G(Z_{1})}\xi(\gamma_{F(v+e_{1}^{-})}\delta g)dg.

We note that J(Z1,Fe1)\G(Z1)J(Z_{1},Fe_{1}^{-})\operatorname{\backslash}G(Z_{1}) parametrises the set of non-zero isotropic vectors in Z1Z_{1}. We consider the J(Z1,L)J(Z_{1},L)-orbits on this set. The analysis is similar to that in Sec. 7.2.1 where we considered isotropic lines in Z1Z_{1}. Again we have L=Ff1L=Ff_{1}^{-} and an element f1+f_{1}^{+} in ZZ such that f1+,f1Z=1\langle{f_{1}^{+}},{f_{1}^{-}}\rangle_{Z}=1. We write Z=Ff1+WFf1Z=Ff_{1}^{+}\oplus W\oplus Ff_{1}^{-} and form the augmented space W1W_{1}. We note that Z1=Ff1+W1Ff1Z_{1}=Ff_{1}^{+}\oplus W_{1}\oplus Ff_{1}^{-}. A non-zero isotropic vector af1++w+bf1af_{1}^{+}+w+bf_{1}^{-} in Z1Z_{1} for a,bFa,b\in F and wW1w\in W_{1} is in the same J(Z1,L)J(Z_{1},L)-orbit as

af1+,if a0;\displaystyle af_{1}^{+},\quad\text{if $a\neq 0$};
e1,if a=0 and w0;\displaystyle e_{1}^{-},\quad\text{if $a=0$ and $w\neq 0$};
bf1,if a=0 and w=0.\displaystyle bf_{1}^{-},\quad\text{if $a=0$ and $w=0$}.

For aF×a\in F^{\times}, the stabiliser of af1+af_{1}^{+} in J(Z1,L)J(Z_{1},L) is G(W1)G(W_{1}) and we have

StabJ(Z1,L)af1+\J(Z1,L)N(Z1,L).\operatorname{\mathrm{Stab}}_{J(Z_{1},L)}af_{1}^{+}\operatorname{\backslash}J(Z_{1},L)\cong N(Z_{1},L).

The stabiliser of e1e_{1}^{-} in J(Z1,L)J(Z_{1},L) is NJ2J(W1,Fe1)NJ_{2}\rtimes J(W_{1},Fe_{1}^{-}), where we adopt the same notation NJ1NJ_{1} and NJ2NJ_{2} as in Sec. 7.2.1. For bF×b\in F^{\times}, the stabiliser of bf1bf_{1}^{-} in J(Z1,L)J(Z_{1},L) is J(Z1,L)J(Z_{1},L). Thus IΩ1,1(ξ)I_{\Omega_{1,1}}(\xi) is further split into three parts:

(7.9) JΩ1,1,1(ξ)\displaystyle J_{\Omega_{1,1},1}(\xi) =[J(Z1,L)]aF×ηN(Z1,L)ξ(γF(v+e1)δaf1+ηg)dg;\displaystyle=\int_{[J(Z_{1},L)]}\sum_{a\in F^{\times}}\sum_{\eta\in N(Z_{1},L)}\xi(\gamma_{F(v+e_{1}^{-})}\delta_{af_{1}^{+}}\eta g)dg;
(7.10) JΩ1,1,2(ξ)\displaystyle J_{\Omega_{1,1},2}(\xi) =[J(Z1,L)]ηNJ2J(W1,Fe1)\J(Z1,L)ξ(γF(v+e1)ηg)dg;\displaystyle=\int_{[J(Z_{1},L)]}\sum_{\eta\in NJ_{2}\rtimes J(W_{1},Fe_{1}^{-})\operatorname{\backslash}J(Z_{1},L)}\xi(\gamma_{F(v+e_{1}^{-})}\eta g)dg;
(7.11) JΩ1,1,3(ξ)\displaystyle J_{\Omega_{1,1},3}(\xi) =[J(Z1,L)]bF×ξ(γF(v+e1)δbf1g)dg.\displaystyle=\int_{[J(Z_{1},L)]}\sum_{b\in F^{\times}}\xi(\gamma_{F(v+e_{1}^{-})}\delta_{bf_{1}^{-}}g)dg.

We take the same γF(v+e1)\gamma_{F(v+e_{1}^{-})} as in Sec. 7.1.3. We proceed to evaluate each part.

For each aa-term in JΩ1,1,1(ξ)J_{\Omega_{1,1},1}(\xi), we get

N(Z1,L)(𝔸)[G(W1)]ξ(γF(v+e1)δaf1+gn)𝑑g𝑑n.\int_{N(Z_{1},L)(\mathbb{A})}\int_{[G(W_{1})]}\xi(\gamma_{F(v+e_{1}^{-})}\delta_{af_{1}^{+}}gn)dgdn.

Since δaf1+G(W1)δaf1+1=G(Z)\delta_{af_{1}^{+}}G(W_{1})\delta_{af_{1}^{+}}^{-1}=G(Z) and γF(v+e1)\gamma_{F(v+e_{1}^{-})} commutes with G(Z)G(Z), the inner integral becomes

[G(Z)]ξ(gγF(v+e1)δaf1+n)𝑑g\int_{[G(Z)]}\xi(g\gamma_{F(v+e_{1}^{-})}\delta_{af_{1}^{+}}n)dg

which is a period integral on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over the subgroup G(Z)G(Z) of G(X)G(X). We get

Proposition 7.8.

If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not G(Z)G(Z)-distinguished, then JΩ1,1,1(ξ)J_{\Omega_{1,1},1}(\xi) vanishes for ξ=ξc,s\xi=\xi_{c,s} and ξsc\xi_{s}^{c}.

For JΩ1,1,2(ξ)J_{\Omega_{1,1},2}(\xi) we collapse the integral and the series to get

NJ1(𝔸)[NJ2]J(W1,Fe1)(F)\G(W1)(𝔸)ξ(γF(v+e1)n1n2g)𝑑g𝑑n2𝑑n1.\displaystyle\int_{NJ_{1}(\mathbb{A})}\int_{[NJ_{2}]}\int_{J(W_{1},Fe_{1}^{-})(F)\operatorname{\backslash}G(W_{1})(\mathbb{A})}\xi(\gamma_{F(v+e_{1}^{-})}n_{1}n_{2}g)dgdn_{2}dn_{1}.

Then using the Iwasawa decomposition for G(W1)(𝔸)G(W_{1})(\mathbb{A}) we get

KG(W1)NJ1(𝔸)[NJ2][J(W1,Fe1)]GL1(𝔸)ξ(γF(v+e1)n1n2gm1(t)k)𝑑t𝑑g𝑑n2𝑑n1𝑑k\displaystyle\phantom{=}\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{[NJ_{2}]}\int_{[J(W_{1},Fe_{1}^{-})]}\int_{GL_{1}(\mathbb{A})}\xi(\gamma_{F(v+e_{1}^{-})}n_{1}n_{2}gm_{1}(t)k)dtdgdn_{2}dn_{1}dk
=KG(W1)NJ1(𝔸)GL1(𝔸)[J(Z1,Fe1Ff1)]ξ(γF(v+e1)n1gm1(t)k)𝑑g𝑑t𝑑n1𝑑k\displaystyle=\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{GL_{1}(\mathbb{A})}\int_{[J(Z_{1},Fe_{1}^{-}\oplus Ff_{1}^{-})]}\xi(\gamma_{F(v+e_{1}^{-})}n_{1}gm_{1}(t)k)dgdtdn_{1}dk
=KG(W1)NJ1(𝔸)GL1(𝔸)[J(Z1,Fe1Ff1)]ξ(γF(v+e1)gn1m1(t)k)𝑑g𝑑t𝑑n1𝑑k.\displaystyle=\int_{K_{G(W_{1})}}\int_{NJ_{1}(\mathbb{A})}\int_{GL_{1}(\mathbb{A})}\int_{[J(Z_{1},Fe_{1}^{-}\oplus Ff_{1}^{-})]}\xi(\gamma_{F(v+e_{1}^{-})}gn_{1}m_{1}(t)k)dgdtdn_{1}dk.

Since γF(v+e1)J(Z1,Fe1Ff1)γF(v+e1)1=J(Fv+ZFv,Ff1Fv)\gamma_{F(v+e_{1}^{-})}J(Z_{1},Fe_{1}^{-}\oplus Ff_{1}^{-})\gamma_{F(v+e_{1}^{-})}^{-1}=J(Fv^{+}\oplus Z\oplus Fv,Ff_{1}^{-}\oplus Fv), the innermost integral is equal to

[J(Fv+ZFv,Ff1Fv)]ξ(gγF(v+e1)n1m1(t)k)𝑑g\int_{[J(Fv^{+}\oplus Z\oplus Fv,Ff_{1}^{-}\oplus Fv)]}\xi(g\gamma_{F(v+e_{1}^{-})}n_{1}m_{1}(t)k)dg

which is a period integral on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over J(Fv+ZFv,Ff1Fv)J(Fv^{+}\oplus Z\oplus Fv,Ff_{1}^{-}\oplus Fv). Thus we get

Proposition 7.9.

If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not J(Z,LL)J(Z^{\prime},L^{\prime}\oplus L)-distinguished for any ZZZ^{\prime}\supset Z such that dimZ=dimZ+2\dim Z^{\prime}=\dim Z+2 and LL^{\prime} an isotropic line of ZZ^{\prime} in the orthogonal complement of ZZ, then JΩ1,1,2(ξ)J_{\Omega_{1,1},2}(\xi) vanishes for ξ=ξc,s\xi=\xi_{c,s} and ξsc\xi_{s}^{c}.

For each bb-term in JΩ1,1,3(ξ)J_{\Omega_{1,1},3}(\xi), we take δbf1\delta_{bf_{1}^{-}} to be the element that is given by e1+f1+e_{1}^{+}\leftrightarrow f_{1}^{+} and e1f1e_{1}^{-}\leftrightarrow f_{1}^{-} and identity on the orthogonal complement. We evaluate

[J(Z1,L)]ξ(γF(v+e1)δbf1g)𝑑g.\int_{[J(Z_{1},L)]}\xi(\gamma_{F(v+e_{1}^{-})}\delta_{bf_{1}^{-}}g)dg.

We have δbf1J(Z1,L)δbf11=J(Z1,Fe1)\delta_{bf_{1}^{-}}J(Z_{1},L)\delta_{bf_{1}^{-}}^{-1}=J(Z_{1},Fe_{1}^{-}) and γF(v+e1)J(Z1,Fe1)γF(v+e1)1=J(Fv+ZFv,Fv)\gamma_{F(v+e_{1}^{-})}J(Z_{1},Fe_{1}^{-})\gamma_{F(v+e_{1}^{-})}^{-1}=J(Fv^{+}\oplus Z\oplus Fv,Fv). Thus we get

[J(Fv+ZFv,Fv)]ξ(gγF(v+e1)δbf1)𝑑g\int_{[J(Fv^{+}\oplus Z\oplus Fv,Fv)]}\xi(g\gamma_{F(v+e_{1}^{-})}\delta_{bf_{1}^{-}})dg

which is a period integral on σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} over J(Fv+ZFv,Fv)J(Fv^{+}\oplus Z\oplus Fv,Fv). We get

Proposition 7.10.

If σΘX,Y¯\sigma\otimes\overline{\Theta_{X,Y}} is not J(Z,L)J(Z^{\prime},L^{\prime})-distinguished for any ZZZ^{\prime}\supset Z such that dimZ=dimZ+2\dim Z^{\prime}=\dim Z+2 and LL^{\prime} an isotropic line of ZZ^{\prime} in the orthogonal complement of ZZ, then JΩ1,1,3(ξ)J_{\Omega_{1,1},3}(\xi) vanishes for ξ=ξc,s\xi=\xi_{c,s} and ξsc\xi_{s}^{c}.

References

  • Art [78] James G. Arthur. A trace formula for reductive groups. I. Terms associated to classes in G(𝐐)G({\bf Q}). Duke Math. J., 45(4):911–952, 1978.
  • Art [80] James Arthur. A trace formula for reductive groups. II. Applications of a truncation operator. Compositio Math., 40(1):87–121, 1980.
  • Art [13] James Arthur. The endoscopic classification of representations, volume 61 of American Mathematical Society Colloquium Publications. American Mathematical Society, Providence, RI, 2013. Orthogonal and symplectic groups.
  • BMM [16] Nicolas Bergeron, John Millson, and Colette Moeglin. The Hodge conjecture and arithmetic quotients of complex balls. Acta Math., 216(1):1–125, 2016.
  • BMM [17] Nicolas Bergeron, John Millson, and Colette Moeglin. Hodge type theorems for arithmetic hyperbolic manifolds. In Geometry, analysis and probability, volume 310 of Progr. Math., pages 47–56. Birkhäuser/Springer, Cham, 2017.
  • Gan [12] Wee Teck Gan. Doubling zeta integrals and local factors for metaplectic groups. Nagoya Math. J., 208:67–95, 2012.
  • Gao [18] Fan Gao. The Langlands-Shahidi LL-functions for Brylinski-Deligne extensions. Amer. J. Math., 140(1):83–137, 2018.
  • GI [14] Wee Teck Gan and Atsushi Ichino. Formal degrees and local theta correspondence. Invent. Math., 195(3):509–672, 2014.
  • GI [18] Wee Teck Gan and Atsushi Ichino. The Shimura-Waldspurger correspondence for Mp2n{\rm Mp}_{2n}. Ann. of Math. (2), 188(3):965–1016, 2018.
  • GJS [09] David Ginzburg, Dihua Jiang, and David Soudry. Poles of LL-functions and theta liftings for orthogonal groups. J. Inst. Math. Jussieu, 8(4):693–741, 2009.
  • GQT [14] Wee Teck Gan, Yannan Qiu, and Shuichiro Takeda. The regularized Siegel-Weil formula (the second term identity) and the Rallis inner product formula. Invent. Math., 198(3):739–831, 2014.
  • [12] Wee Teck Gan and Gordan Savin. Representations of metaplectic groups i: Epsilon dichotomy and local langlands correspondence. preprint.
  • Hen [00] Guy Henniart. Une preuve simple des conjectures de Langlands pour GL(n){\rm GL}(n) sur un corps pp-adique. Invent. Math., 139(2):439–455, 2000.
  • HH [12] Hongyu He and Jerome William Hoffman. Picard groups of Siegel modular 3-folds and θ\theta-liftings. J. Lie Theory, 22(3):769–801, 2012.
  • HT [01] Michael Harris and Richard Taylor. The geometry and cohomology of some simple Shimura varieties, volume 151 of Annals of Mathematics Studies. Princeton University Press, Princeton, NJ, 2001. With an appendix by Vladimir G. Berkovich.
  • Ich [01] Atsushi Ichino. On the regularized Siegel-Weil formula. J. Reine Angew. Math., 539:201–234, 2001.
  • Ike [92] Tamotsu Ikeda. On the location of poles of the triple LL-functions. Compositio Math., 83(2):187–237, 1992.
  • Ike [96] Tamotsu Ikeda. On the residue of the Eisenstein series and the Siegel-Weil formula. Compositio Math., 103(2):183–218, 1996.
  • Jia [14] Dihua Jiang. Automorphic integral transforms for classical groups i: Endoscopy correspondences. In James W. Cogdell, Freydoon Shahidi, and David Soudry, editors, Automorphic Forms and Related Geometry: Assessing the Legacy of I.I. Piatetski-Shapiro, volume 614 of Contemporary Mathematics. American Mathematical Society, Providence, RI, 2014.
  • JL [18] Dihua Jiang and Baiying Liu. Fourier coefficients and cuspidal spectrum for symplectic groups. In Geometric aspects of the trace formula, Simons Symp., pages 211–244. Springer, Cham, 2018.
  • JS [07] Dihua Jiang and David Soudry. On the genericity of cuspidal automorphic forms of SO(2n+1){\rm SO}(2n+1). II. Compos. Math., 143(3):721–748, 2007.
  • JW [16] Dihua Jiang and Chenyan Wu. On (χ,b)(\chi,b)-factors of cuspidal automorphic representations of unitary groups I. J. Number Theory, 161:88–118, 2016.
  • JW [18] Dihua Jiang and Chenyan Wu. Periods and (χ\chi, b)-factors of cuspidal automorphic forms of symplectic groups. Israel J. Math., 225(1):267–320, 2018.
  • [24] Tasho Kaletha, Alberto Minguez, Sug Woo Shin, and Paul-James White. Endoscopic classification of representations: Inner forms of unitary groups. arXiv:1409.3731.
  • KR [94] Stephen S. Kudla and Stephen Rallis. A regularized Siegel-Weil formula: the first term identity. Ann. of Math. (2), 140(1):1–80, 1994.
  • Kud [94] Stephen S. Kudla. Splitting metaplectic covers of dual reductive pairs. Israel J. Math., 87(1-3):361–401, 1994.
  • Lan [71] Robert P. Langlands. Euler products. Yale University Press, New Haven, Conn.-London, 1971. A James K. Whittemore Lecture in Mathematics given at Yale University, 1967, Yale Mathematical Monographs, 1.
  • Lan [89] R. P. Langlands. On the classification of irreducible representations of real algebraic groups. In Representation theory and harmonic analysis on semisimple Lie groups, volume 31 of Math. Surveys Monogr., pages 101–170. Amer. Math. Soc., Providence, RI, 1989.
  • LR [05] Erez M. Lapid and Stephen Rallis. On the local factors of representations of classical groups. In Automorphic representations, LL-functions and applications: progress and prospects, volume 11 of Ohio State Univ. Math. Res. Inst. Publ., pages 309–359. de Gruyter, Berlin, 2005.
  • Mœg [97] Colette Mœglin. Non nullité de certains relêvements par séries théta. J. Lie Theory, 7(2):201–229, 1997.
  • Mok [15] Chung Pang Mok. Endoscopic classification of representations of quasi-split unitary groups. Mem. Amer. Math. Soc., 235(1108):vi+248, 2015.
  • MW [95] C. Mœglin and J.-L. Waldspurger. Spectral decomposition and Eisenstein series, volume 113 of Cambridge Tracts in Mathematics. Cambridge University Press, Cambridge, 1995. Une paraphrase de l’Écriture [A paraphrase of Scripture].
  • [33] Colette Moeglin and Jean-Loup Waldspurger. Stabilisation de la formule des traces tordue. Vol. 1, volume 316 of Progress in Mathematics. Birkhäuser/Springer, Cham, 2016.
  • [34] Colette Moeglin and Jean-Loup Waldspurger. Stabilisation de la formule des traces tordue. Vol. 2, volume 317 of Progress in Mathematics. Birkhäuser/Springer, Cham, 2016.
  • PSR [87] Ilya Piatetski-Shapiro and Stephen Rallis. LL-functions for the classical groups. In Explicit constructions of automorphic LL-functions, volume 1254 of Lecture Notes in Mathematics, pages 1–52. Springer-Verlag, Berlin, 1987.
  • Ral [82] Stephen Rallis. Langlands’ functoriality and the Weil representation. Amer. J. Math., 104(3):469–515, 1982.
  • RR [93] R. Ranga Rao. On some explicit formulas in the theory of Weil representation. Pacific J. Math., 157(2):335–371, 1993.
  • Sar [05] Peter Sarnak. Notes on the generalized Ramanujan conjectures. In Harmonic analysis, the trace formula, and Shimura varieties, volume 4 of Clay Math. Proc., pages 659–685. Amer. Math. Soc., Providence, RI, 2005.
  • Sch [13] Peter Scholze. The local Langlands correspondence for GLn\rm{GL}_{n} over pp-adic fields. Invent. Math., 192(3):663–715, 2013.
  • Sha [10] Freydoon Shahidi. Eisenstein series and automorphic LL-functions, volume 58 of American Mathematical Society Colloquium Publications. American Mathematical Society, Providence, RI, 2010.
  • Wu [17] ChenYan Wu. A critical case of Rallis inner product formula. Sci. China Math., 60(2):201–222, 2017.
  • Wu [21] Chenyan Wu. On (χ,b)(\chi,b)-factors of cuspidal automorphic representations of unitary groups, II. preprint. arXiv:2104.11954v1. Submitted, 2021.
  • Yam [14] Shunsuke Yamana. L-functions and theta correspondence for classical groups. Invent. Math., 196(3):651–732, 2014.