## ORBITAL STABILITY OF STANDING WAVES FOR FRACTIONAL HARTREE EQUATION WITH UNBOUNDED POTENTIALS

JIAN ZHANG, SHIJUN ZHENG, AND SHIHUI ZHU

Abstract. We prove the existence of the set of ground states in a suitable energy space Σ s = { u : ∫ R N ¯( u -∆ + m 2 ) s u + V u | | 2 &lt; ∞} , s ∈ (0 , N 2 ) for the mass-subcritical nonlinear fractional Hartree equation with unbounded potentials. As a consequence we obtain, as a priori result, the orbital stability of the set of standing waves. The main ingredient is the observation that Σ s is compactly embedded in L 2 . This enables us to apply the concentration compactness argument in the works of Cazenave-Lions and Zhang, namely, relative compactness for any minimizing sequence in the energy space.

## 1. Introduction

Consider the nonlinear fractional Hartree equation with an unbounded potential in the following form: For 0 &lt; s &lt; N/ 2 and ( t, x ) ∈ R 1+ N

$$( 1. 2 ) \quad \ \ u ( 0, x ) = u _ { 0 } \$$

$$( 1. 1 ) & \quad \ \ \ \ \ i u _ { t } = ( -$$

where u = u t, x ( ): R × R N → C is a complex valued function and the convolution ∗ is defined by W ∗ | u | 2 := ( 1 |·| γ ∗ | u | 2 ) ( x ) = ∫ | u y ( ) | 2 | x - | y γ dy with 0 &lt; γ &lt; min 4 { s, N } . The operator ( -∆+ m 2 ) s is defined by where m ≥ 0, F and F -1 are the Fourier transform and the inverse in R N , respectively. Here the potential function V ∈ C ∞ ( R N ) is bounded from below V ( x ) ≥ -c 0 for some c 0 &gt; 0 and satisfies

$$( - \Delta + m ^ { 2 } ) ^ { s } u = \mathcal { F$$

$$& ( 1. 3 ) & & V ( x ) \to \infty \quad \text{$$

Such class of V includes unbounded potentials arising in physics, for instance, the harmonic potential V ( x ) = | x | 2 , and more generally, polynomial functions that are bounded from below. Then H s,V := ( -∆+ m 2 ) s + V is essentially self-adjoint in the Hilbert space Σ s := { v ∈ L 2 : ( -∆+ m 2 ) s/ 2 v ∈ L 2 and | V | 1 / 2 v ∈ L 2 } , as is given in Section 2.

The Hartree equation is non-integrable analog of the NLS system, which arises naturally in large quantum systems that describe the wave motion for the bosonic or fermionic particles. When s = 1, it can be derived from the mean-field limit of N -body GPE hierarchy, where W x ( ) = | x | -γ represents the long-range two-body

Key words and phrases. fractional Hartree equation, standing wave, orbital stability.

interaction potential. A special feature of the Hartree equation lies in the convolution kernel W that preserves the fine structure of micro two-body interactions of particles. This is in contrast to the NLS, which can be viewed as the limiting case W → δ and where the two-body interactions are modeled from the scattering length. When s = 1 2 , (1.1) arises as an effective description of pseudo-relativistic boson stars in the mean field limit, where u t, x ( ) is a complex-valued wave field. The study of such a perturbed system in the presence of external potential V is both physically and mathematically very important.

When V is zero or bounded, the dynamical properties of solutions for the fractional Hartree equation (1.1) have been considered in e.g., [16, 8, 13, 1, 24, 7, 12, 25]. In [24, 7], the authors studied the orbital stability for standing wave solutions, that is, ground states (the set of minimizers) for (1.1) with zero potential by profile decomposition method. Furthermore, [24] showed the strong instability in the mass-critical case. The analogous results on orbital stability for nonlinear fractional Schr¨dinger equation (FNLS) were obtained in [5, 11, 26]. o The paper [5] studied the FNLS with power nonlinearity and a decaying potential, while [11, 26] studied FNLS with power nonlinearity in the form | u | p -1 u + | u | q -1 u .

In this paper, we are concerned with the orbital stability of standing wave solutions for (1.1) in the mass-subcritical regime γ &lt; 2 . Note that when s V = 0, γ = 2 s corresponds to the mass-critical case and γ = 4 s corresponds to the energy-critical case by scaling invariance argument. The presence of an unbounded V brings in technical difficulties and the methods in [5, 11, 24] do not directly apply to (1.1). Motivated by the treatment for the classical NLS in [22, 23], we prove a new compactness lemma in Section 3, adapted to the energy space for (1.1), which leads to the solution to the variational problem 4.1 in Proposition 4.1. Thus follows the main result Theorem 4.3. The proof in Section 4 can be viewed as an adaption to the potential case, also see [3, 2] for the original treatment of NLS type equations via variational method.

## 2. Preliminaries

We will use the notations L q := L q ( R N ), ‖·‖ q := ‖·‖ L q ( R N ) , H s := H s ( R N ) and ˙ H s := ˙ H s ( R N ), the latter two denoting the usual Sobolev space and its homogeneous version. The various positive constants will be simply denoted by C . From now on throughout the paper, without loss of generality we may assume there is some positive constant c 1 such that for all x ,

$$\begin{array} {$$

If otherwise, the lower bound of V is -c 0 &lt; 0, then one can always apply the substitution u → e itC u for any C ≥ c 0 + c 1 to convert equation (1.1) into one with V bounded from below by a positive constant; see also Remark 4.4.

For V satisfying (2.1) define the energy space Σ s as

$$& \text{for $v$ satisfying (2.1)                                                                                                                                                                                                        
                                                                                                                                                                                                        \Sigma ^ { s } \coloneqq \{ v \in L ^ { 2 } | \ \int \overline { v } ( - \Delta + m ^ { 2 } ) ^ { s } v + V | v | ^ { 2 } < \infty \}. \\ & \text{Then $\Sigma ^ { s }$ is a Hilbert space equipped with the norm}$$

Then Σ s is a Hilbert space equipped with the norm

$$\hat { ( 2. 3 ) } & \frac { \cdot } { \| v \| _ { \Sigma ^ { s } } } \coloneqq \left ( \int \overline { v } ( - \Delta + m ^ { 2 } ) ^ { s } v + V | v | ^ { 2 } \right ) ^ { \frac { 1 } { 2 } },$$

which means that H s,V = ( -∆+ m 2 ) s + V is essentially self-adjoint in the quadratic form on Σ s × Σ s given by

$$\text{ on } \Sigma \times \Sigma \text{ given by} \\ \quad & q ( u, v ) \coloneqq \int \overline { ( - \Delta + m ^ { 2 } ) ^ { s / 2 } v } \, ( - \Delta + m ^ { 2 } ) ^ { s / 2 } u + \int \overline { v } V u.$$

Note that ‖ v ‖ Σ s &lt; ∞ implies ‖ v ‖ 2 is finite. When s ∈ (0 , 1) and m = 0, one can also express where c s,N = 2 2 s π N/ 2 Γ( + s N 2 ) | Γ( -s ) | .

$$( - \Delta ) ^ { s } u & = c _ { s, N } \, p. v. \, \int _ { \mathbb { R } ^ { N } } \frac { u ( x ) - u ( y ) } { | x - y | ^ { N + 2 s } } d y, \\ _ { 2 ^ { 2 s } \ \Gamma ( s + \frac { N } { 4 } ) }$$

Define the energy functional E : Σ s → R as

$$& \text{Define the energy functional } E \colon 2 ^ { s } \to \mathbb { K } \text{ as} \\ & ( 2. 4 ) \quad & E ( v ) = \frac { 1 } { 2 } \int \overline { v } ( - \Delta + m ^ { 2 } ) ^ { s } v + \frac { 1 } { 2 } \int V | v | ^ { 2 } - \frac { 1 } { 4 } \int ( \frac { 1 } { | x | ^ { \gamma } } * | v | ^ { 2 } ) | v | ^ { 2 }. \\ & \text{From the Hardv inequality } ( 3. 1 ). \text{ the functional } E ( v ) \text{ is well-defined in } \mathbb { S } ^ { s }. \text{ Note}$$

↦

↦

From the Hardy inequality (3.1), the functional E v ( ) is well-defined in Σ . s Note that if V = 0 and m = 0, γ = 4 s &lt; N corresponds to the energy-critical case due to that the scaling u → 1 λ ( N -2 ) s / 2 u ( t λ 2 s , x λ ) leaves invariant the energy and the solution to (1.1). When γ = 2 s &lt; N , it corresponds to to the mass-critical case due to that the scaling u → 1 λ N/ 2 u ( t λ 2 s , x λ ) leaves invariant the mass M u ( ) := ∫ | u | 2 and (1.1).

In this paper, we assume that the Cauchy problem (1.1)-(1.2) is well-posed in Σ , s namely, the following global in time existence, uniqueness and conservation laws hold in the mass-subcritical regime γ &lt; 2 . s

Hypothesis 1. Let N ≥ 1 and γ 2 &lt; s &lt; N/ 2 . If the initial data u 0 ∈ Σ s , then there exists a unique solution u t, x ( ) of the Cauchy problem (1.1)-(1.2) on R such that u ∈ C ( R ; Σ s ) ⋂ C 1 ( R ; H -s ) . Moreover, for all t ∈ R , u t, x ( ) satisfies the following conservation laws:

- (i) (mass)

$$M ( u ( t ) ) = M ( u _ { 0 } ).$$

- (ii) (energy)

$$E ( u ( t ) ) = E ( u _ { 0 } ).$$

Remark 2.1 . For local well-posedness in the above conjectured proposition, so far we only know about numerical result on cubic FNLS with a quadratic potential by Zhang and Kirkpatrick [15], where is suggested the long-time existence along with its dynamics for some special initial data. The theoretical proof has remained an open question concerning FNLS and Hartree equations with harmonic potentials. The main difficulty is the lack of proper dispersive or Strichartz estimates because the fractional Laplacian for 0 &lt; s &lt; 1 does not hold a control over the harmonic potential, which is shown in the deformed trajectories for the associated hamiltonian, see [15] and [19]. This is in sharp contrast to the classical NLS ( s = 1) with a harmonic potential, where the existence and stability problem has been studied quite extensively [9, 10, 18, 22, 23, 14, 6].

Heuristically the Laplacian -∆ and V = | x | 2 have balanced strength or effect so the L 1 → L ∞ time decay t -N/ 2 holds locally for e it (∆ -V ) . However, for 0 &lt; s &lt; 1, in the phase space the bound energy for fractional laplacian ( -∆ + m 2 ) s is less than | x | 2 , or, H s, 0 relative to V is like the laplacian vs. anharmonic potential of higher order. It falls within the quantum situation 'a particle at a higher altitude

falls down to the bottom of the potential in a shorter time than one at a lower altitude', which obstructs Fujiwara's theorem, cf. [17].

## 3. Proof of main result

For estimating the Hartree nonlinearity we will need Hardy's inequality, see e.g, [20]: If s ∈ (0 , N/ 2)

Lemma 3.1. Let v ∈ ˙ H s and 0 &lt; s &lt; N/ 2 . If 0 &lt; γ &lt; 2 s , then there exists a positive constant C &gt; 0 such that

$$& [ 2 0 ] \colon \Pi \, s \in [ 0, 1 N / 2 ] \\ & ( 3. 1 ) & & \sup _ { x } \int \frac { | u ( y ) | ^ { 2 } } { | x - y | ^ { 2 s } } d y \leq c ( s, N ) \| u \| _ { \dot { H } ^ { s } } ^ { 2 } \,. \\ & \Gamma \, \infty \, \infty \, \frac { 1 } { 2 } \, \infty \, \dot { H } ^ { s } \, \infty \, d \, \infty \, \infty \, N / 2 \, \infty \, \infty \, \infty \, \ t h \infty \,.$$

$$& \text{positive constant $C>0$ such that} \\ & ( 3. 2 ) & \quad \int ( \frac { 1 } { | x | ^ { \gamma } } \ast | v | ^ { 2 } ) | v | ^ { 2 } d x \leq C \| v \| _ { \dot { H } ^ { s } } ^ { \frac { \gamma } { s } } \ \| v \| _ { 2 } ^ { \frac { 4 s - \gamma } { s } }. \\ & \text{Proof. Note that}$$

Proof. Note that

$$& L ^ { \text{roo} }. \text{ Note that} \\ & ( 3. 3 ) & \int ( \frac { 1 } { | x | ^ { \gamma } } * | v | ^ { 2 } ) | v ( x ) | ^ { 2 } d x \quad = \int \int \frac { | v ( x ) | ^ { 2 } } { | x - y | ^ { \gamma } } | v ( y ) | ^ { 2 } d x d y \\ & \quad \leq \| \int \frac { | v ( x ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x \| _ { \infty } \| v ( y ) \| _ { 2 } ^ { 2 }. \\ & \text{Using H\"older inequality with $1=\frac{\gamma}{2s}$}, \, \text{we obtain}$$

$$\i m e q u a n y \ w u n \, & - \frac { \pi } { 2 s } \top \frac { } { 2 s }, \, \text{we} \, \omega \omega \Gamma \, \\ \int \frac { | v ( x ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x & = \int \frac { | v ( x ) | ^ { \frac { \gamma } { s } } } { | x - y | ^ { \gamma } } | v ( x ) | ^ { \frac { 2 s - \gamma } { s } } d x \\ & < \mathcal { C } \| | _ { \infty } \quad \ a l - s _ { \infty } | _ { \infty } \overline { \| } ^ { \frac { \gamma } { s } } \| _ { \infty } \| ^ { \frac { 2 s - \gamma } { s } }$$

Using H¨ older inequality with 1 = γ 2 s + 2 s -γ 2 s , we obtain

$$\leq C \| | x - y | ^ { - s } v ( x ) \| _ { 2 } ^ { \frac { \gamma } { s } } \, \| v \| _ { 2 } ^ { \frac { 2 s - \gamma } { s } } \\ \dots \dots \dots \frac { \gamma } { 2 } \dots \dots \frac { 2 s - \gamma } { 2 }$$

$$& \leq C \| v \| _ { \dot { H } ^ { s } } ^ { \frac { \gamma } { s } } \, \| v \| _ { 2 } ^ { \frac { 2 s - \gamma } { s } }. \\ & \tau _ { \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \colon \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cd� \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdclots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \colon \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \code \, \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \end{array}$$

In the last step of the above, we have employed (3.1). Thus, (3.2) follows from (3.3) and (3.4). /square

Lemma 3.2. Let 0 &lt; γ &lt; 2 s , 0 &lt; s &lt; N/ 2 and V satisfy (2.1) . Suppose { v n } ∞ n =1 converges weakly to U in Σ s . Then there exists a subsequence (still denoted by { v n } ) such that

$$& ( 3. 5 ) & & \| v _ { n } \| _ { 2 } ^ { 2 } \to \| U \| _ { 2 } ^ { 2 } \text{ as } \text{ } n \to \infty, \\ & \dots \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{  } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{\ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text$$

and

Remark 3.3 . Equation (3.5) indeed implies that for s &gt; 0, Σ s is compactly embedded in L 2 .

$$& a n d \\ & ( 3. 6 ) \quad \iint \frac { | v _ { n } ( x ) | ^ { 2 } | v _ { n } ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y \to \iint \frac { | U ( x ) | ^ { 2 } | U ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y \quad \text{as} \quad n \to \infty. \\ & \text{Remark} \ 3. 3 \text{$$

Proof. Since Σ s ⊂ L 2 , it is easy to see that for U ∈ Σ s ∩ L 2 , v n ⇀U weakly in Σ s and

$$v _ { n } \rightharpoonup U \text{ weakly in } \ L ^ { 2 }$$

as n →∞ . For an elementary proof of (3.7), see Proposition 5.1 in the Appendix. Since { v n } is weakly convergent in Σ , s ‖ v n ‖ Σ s is uniformly bounded. So there is a positive constant K such that

$$& \text{is a positive constant $K$ such that} \\ & ( 3. 8 ) & & \sup _ { n } \int V ( x ) | v _ { n } ( x ) | ^ { 2 } d x \leq \sup _ { n } \| v _ { n } \| _ { \Sigma ^ { s } } ^ { 2 } < K.$$

Furthermore, we will show that there is a subsequence of { v n } that strongly converges in L 2 and satisfies (3.6).

(1) First, we consider the case where U = 0. From (3.8) with V satisfying (2.1), we have for arbitray /epsilon1 &gt; 0, there exists a constant B = B &gt; /epsilon1 0 (large enough) such that 1 V ( x ) ≤ /epsilon1 when | x &gt; B | . We see that

$$\int _ { | x | > B } | v _ { n } | ^ { 2 } d x = \int _ { | x | > B } \frac { 1 } { V ( x ) } \ V ( x ) | v _ { n } | ^ { 2 } d x \leq K \epsilon.$$

For the fixed B , compact embedding property for Sobolev space on bounded domain gives that one can extract a subsequence (still denoted by { v n } ) such that

$$v _ { n } \to 0 \quad \text{strongly in } L ^ { 2 } ( \{ | x | \leq B \} ).$$

Hence, there exists L = L /epsilon1 such that for all n &gt; L , ∫ | x |≤ B | v n | 2 dx ≤ /epsilon1 . Thus, we have, if n &gt; L ,

$$& \stackrel { \dots } { \dots }, \, \stackrel { \dots } { \dots } \, -, \\ & ( 3. 1 0 ) \quad \int | v _ { n } | ^ { 2 } d x = \int _ { | x | \leq B } | v _ { n } | ^ { 2 } d x + \int _ { | x | > B } | v _ { n } | ^ { 2 } d x \leq ( K + 1 ) \epsilon.$$

Now, taking /epsilon1 = /epsilon1 k → 0 as k →∞ , a standard diagonal argument shows that there exists a subsequence of { v n } , still denoted by { v n } , such that (3.5) is true in the case U = 0. Then, it follows from (3.2) in Lemma 3.1 that

$$\dots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \\ \int \int \frac { | v _ { n } ( x ) | ^ { 2 } | v _ { n } ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y \leq C \| v _ { n } \| _ { H ^ { s } } ^ { \frac { \gamma } { s } } \ \| v _ { n } \| _ { 2 } ^ { \frac { 4 s - \gamma } { s } } \to 0 \quad \text{as} \quad n \to \infty. \\ \intertext { m. \colon \dots \dots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots }$$

This proves (3.6) when U = 0.

/negationslash

(2) Secondly, we consider the case U = 0. Take w n = v n -U . We have w n ⇀ 0 weakly in Σ s and in L 2 as n →∞ . Then, from the above discussion, we see that there is a subsequence (still denoted by { w n } ) such that w n → 0 strongly in L 2 . In other words, we have

$$\| v _ { n } - U \| _ { 2 } \to 0 \ \text{ as } \ n \to \infty.$$

To prove (3.6), we will apply (3.4). Indeed, if 0 &lt; γ &lt; 2 , we deduce that s

$$\left | \iint \frac { | v _ { n } ( x ) | ^ { 2 } | v _ { n } ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y - \iint \frac { | U ( x ) | ^ { 2 } | U ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y \right | \\ \leq & \left | \iint \frac { | v _ { n } ( x ) | ^ { 2 } | v _ { n } ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y - \iint \frac { | v _ { n } ( x ) | ^ { 2 } | U ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y \right | \\ & + \left | \iint \frac { | v _ { n } ( x ) | ^ { 2 } | U ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y - \iint \frac { | U ( x ) | ^ { 2 } | U ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y \right | \\ \leq & \| \int \frac { | v _ { n } ( x ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x \| _ { \infty } \left | \| v _ { n } \| _ { 2 } ^ { 2 } - \| U \| _ { 2 } ^ { 2 } \right | + \| \int \frac { | U ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d y \| _ { \infty } \left | \| v _ { n } \| _ { 2 } ^ { 2 } - \| U \| _ { 2 } ^ { 2 } \right | \\ \leq & C \| v _ { n } \| _ { \frac { \gamma } { H ^ { \gamma } } } ^ { 2 } \ \| v _ { n } \| _ { 2 } ^ { 2 } - \| U \| _ { 2 } ^ { 2 } \right | + \| U \| _ { H ^ { \gamma } } ^ { 2 } \ \| U \| _ { 2 } ^ { 2 } \ ^ { 2 \alpha } \ \| v _ { n } \| _ { 2 } ^ { 2 } - \| U \| _ { 2 } ^ { 2 } \right | \| U \| _ { 2 } ^ { 2 } \right | \\ \leq & C \left | \| v _ { n } \| _ { 2 } ^ { 2 } - \| U \| _ { 2 } ^ { 2 } \right | \to 0 \text{ as } n \to \infty. \\ \text{Therefore, (3.6) is true for $U\neq 0$, which completes the proof. } \quad \Box$$

Therefore, (3.6) is true for U = 0, which completes the proof.

/negationslash

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.01038v1-figure-da0ead89-0871-47c3-8d05-c078efb7e792.jpg)

## 4. Orbital stability of standing waves

Given 0 &lt; γ &lt; 2 , s s ∈ (0 , N/ 2), N ≥ 1, let m ≥ 0 and M &gt; 0. Consider the following variational problem

$$& ( 4. 1 ) \quad d _ { M } \coloneqq \inf _ { \{ v \in \Sigma ^ { s } \Big | \, \| v \| _ { 2 } ^ { 2 } = M \} } E ( v ), \\ & \text{where } E ( v ) = \frac { 1 } { 2 } \| v \| _ { \Sigma ^ { s } } ^ { 2 } - \frac { 1 } { 4 } \iint \frac { | v ( x ) | ^ { 2 } | v ( y ) | ^ { 2 } } { | x - y | ^ { \gamma } } d x d y, \, \text{as defined in } ( 2.$$

where E v ( ) = 1 2 ‖ v ‖ 2 Σ s -1 4 ∫∫ | v x ( ) | 2 | v y ( ) | 2 | x - | y γ dxdy , as defined in (2.4). The following proposition constructs a minimizer, called ground state, to the problem (4.1).

Proposition 4.1. Let M &gt; 0 . Suppose 0 &lt; γ &lt; 2 s and V satisfies (2.1), then the infimum in the variational problem can be attained. That is, there exists U ∈ Σ s such that

Moreover, any minimizing sequence to (4.1) must be relatively compact in Σ s .

$$& ( 4. 2 ) & E ( U ) = d _ { M } = \min _ { \{ v \in \Sigma ^ { s } \Big | \ \| v \| _ { 2 } ^ { 2 } = M \} } E ( v ). \\ & M o r e o v e r, \, a n y \, m i n i m i z i n g \, \text{sequence to } ( 4. 1 ) \ m u s t \, \text{ be relatively compa}$$

Proof. Firstly, we prove the variational problem (4.1) is well-defined. That is, E v ( ) has a lower bound in { v ∈ Σ s ∣ ‖ v ‖ 2 2 = M } . From Lemma 3.1, we deduce that

$$& \text{Proof} \text{. Firstly, we prove the variational problem (4.1) is well-defined. That is, E(v) } \\ & \text{has a lower bound in } \{ v \in \Sigma ^ { s } | \| v \| _ { 2 } ^ { 2 } = M \}. \text{ From Lemma 3.1, we deduce that} \\ & \text{E(v)} \geq \frac { 1 } { 2 } \int ( | \xi | ^ { 2 } + m ^ { 2 } ) ^ { s } | \widehat { v } | ^ { 2 } d \xi + \frac { 1 } { 2 } \int V | v | ^ { 2 } d x - C \| v \| _ { H ^ { s } } ^ { \frac { x } { 2 s } } \| v \| _ { 2 } ^ { 4 s - x } \\ & \geq \frac { 1 } { 2 } \int | \xi | ^ { 2 s } | \widehat { v } | ^ { 2 } d \xi - C _ { M } ^ { \prime } \left ( \int | \xi | ^ { 2 s } | \widehat { v } | ^ { 2 } d \xi \right ) ^ { \frac { x } { 2 s } } \\ & \geq - C _ { M }. \\ & \text{In the last step, we have used the elementary inequality } \frac { 1 } { 2 } X - C _ { M } ^ { \prime } X ^ { \gamma / 2 s } \geq - C _ { M } \\ \varepsilon \quad, \quad, \quad, \quad \varepsilon \quad \varepsilon \quad. \ \varepsilon \quad. \ \varepsilon \quad. \ \varepsilon \quad.$$

In the last step, we have used the elementary inequality 1 2 X -C ′ M X γ/ s 2 ≥ -C M for all X &gt; 0 and some constants C ′ M , C M &gt; 0. Thus, E v ( ) is bounded from below and the infimum d M exists.

Secondly, take any minimizing sequence { v n } of Problem (4.1) satisfying

$$( 4. 4 ) \quad \ \ E ( v _ { n } ) \to d _ { M } \quad \text{and} \quad \| v _ { n } \| _ { 2 } ^ { 2 } \to M, \quad \text{as} \, n \to \infty.$$

We see that there exists an L such that for all n ≥ L ,

$$E ( v _ { n } ) < d _ { M } + 1.$$

This, together with (4.3) implies for all n ≥ L ,

$$\frac { 1 } { 2 } \| v _ { n } \| _ { \Sigma ^ { s } } ^ { 2 } \leq C _ { M } \| v _ { n } \| _ { \dot { H } ^ { s } } ^ { \gamma / s } + d _ { M } + 1.$$

Hence, { v n } must be bounded in Σ s by virtue of the condition γ s &lt; 2.

$$v _ { n } ( x ) \rightharpoonup U ( x ) \text{ weakly in } \ \Sigma ^ { s }.$$

Thirdly, from the boundedness of { v n } , we know there exists a subsequence (still denoted by { v n } ) and U ∈ Σ s such that

By the lower semi-continuity of norm Σ , we have s

$$\| U \| _ { \Sigma ^ { s } } ^ { 2 } \leq \liminf _ { n \to \infty } \| v _ { n } \| _ { \Sigma ^ { s } } ^ { 2 } \,.$$

Combining (4.8), Lemma 3.2 and (4.4) we obtain that ‖ v n ‖ 2 2 →‖ ‖ U 2 2 = M and

$$E ( U ) \leq \liminf _ { n \to \infty } E ( v _ { n } ) = d _ { M }.$$

But from the definition of d M , we must have E U ( ) = d M . That is, U is a minimizer of (4.1). To prove the statement on relative compactness, observe that the last argument shows

$$E ( U ) = \lim _ { n \to \infty } E ( v _ { n } ).$$

This, along with Lemma 3.2 implies there exists a subsequence { v n k } such that lim k →∞ ‖ v n k ‖ Σ s = ‖ U ‖ Σ s . Therefore, in view of (4.7), the strong convergence v n k → U in Σ s follows. /square

Remark 4.2 . The existence of ground states for FNLS with unbounded V was obtained in [4] via Nehari's manifold approach. The existence and symmetry of ground state solutions were studied in [21] for Hartree equation with zero potential.

Define the set

From the Euler-Lagrange Theorem (see [2]), for any v ∈ S M ⊂ Σ , there exists s ω ∈ R such that

$$& \text{Deme the set} \\ & ( 4. 9 ) & & S _ { M } \coloneqq \{ v \in \Sigma ^ { s } \Big | \ v \text{ is the minimizer of Problem (4.1) } \}. \\ & \text{From the Euler-Lagrange Theorem (see [2]), for any } v \in S _ { M } \subset \Sigma ^ { s }, \text{ there exist} \\ & \text{, } \dots \mathbb { D } \text{ each that}$$

$$& ( 4. 1 0 ) & & ( - \triangle + m ^ { 2 } ) ^ { s } v + V ( x ) v + \omega v - ( \frac { 1 } { | x | ^ { \gamma } } * | v | ^ { 2 } ) v = 0. \\ \text{Moroco} \quad \text{/\tau} \ \, - \ e ^ { i \omega t _ { \alpha } } ( \lambda ) \text{ is a attention from } \text{and} \ \text{for} \ \, 1 \ \} \ \text{Thme}$$

Moreover, u t, x ( ) = e iωt v x ( ) is a standing wave solution for (1.1). Thus, each v in S M t is called an orbit. It is easy to check that for any t &gt; 0, if v ∈ S M , then e iω v x ( ) ∈ S M . Applying Proposition 4.1, we now prove the following orbital stability for (1.1). More precisely, assuming Hypothesis 1, we show that if the initial data is close to an orbit v ∈ S M , then the solution of evolution system (1.1)-(1.2) remains close to S M , the set of ground states, for all time.

Theorem 4.3 (orbital stability of standing waves) . Let M &gt; 0 and V satisfy (2.1). Let 0 &lt; s &lt; N/ 2 and 0 &lt; γ &lt; 2 s . Then, for arbitrary ε &gt; 0 , there exists δ &gt; 0 such that if the initial data u 0 in Σ s satisfies

$$\inf _ { v \in S _ { M } } \| u _ { 0 } - v \| _ { \Sigma ^ { s } } < \delta,$$

it holds for the solution u of the Cauchy problem (1.1)-(1.2),

$$\inf _ { v \in S _ { M } } \| u ( t, x ) - v ( x ) \| _ { \Sigma ^ { s } } < \varepsilon$$

for all t , where S M is defined in (4.9).

Proof. We prove the theorem by contradiction following the standard method for NLS (see [2, 22, 23]). Let u 0 ∈ Σ s and u be the unique solution for (1.1). From the proof of Proposition 4.1 and the conservation laws in Hypothesis 1, we obtain that for all t ,

$$\frac { 1 } { 2 } \| u ( t, \cdot ) \| _ { \Sigma ^ { s } } ^ { 2 } \leq E ( u _ { 0 } ) + C ( \| u _ { 0 } \| _ { 2 } ) \| u ( t, \cdot ) \| _ { \Sigma ^ { s } } ^ { \gamma / s }.$$

This suggests that the Σ -norm of s u is uniformly bounded for all t .

Assume that the conclusion in the theorem is false, then there exist ε 0 &gt; 0 and a sequence of initial data { u 0 ,n } ∞ n =1 such that

$$\inf _ { v \in S _ { M } } \| u _ { 0, n } - v \| _ { \Sigma ^ { s } } < \frac { 1 } { n },$$

and there exists a sequence of time { t n } ∞ n =1 such that for all n ,

$$\inf _ { v \in S _ { M } } \| u _ { n } ( t _ { n }, x ) - v \| _ { \Sigma ^ { * } } \geq \varepsilon _ { 0 }.$$

But from (4.13), the conservation laws and Lemma 3.2, it follows that there exist w ∈ Σ s and a subsequence of { u n } (still denoted by { u n } ) such that as n →∞

$$\| u _ { n } ( t _ { n }, x ) \| _ { 2 } ^ { 2 } = \| u _ { 0, n } \| _ { 2 } ^ { 2 } \to \| w \| _ { 2 } ^ { 2 } = M$$

and

$$\aleph _ { 0 } \sim \begin{array} { c } E ( u _ { n } ( t _ { n }, x ) ) = E ( u _ { 0, n } ) \to E ( w ) = d _ { M }. \\ \aleph _ { 0 } \sim \end{array}.$$

Hence, { u n ( t n , · ) } ∞ n =1 is a minimizing sequence of (4.1). According to Proposition 4.1, w ∈ S M is a minimizer such that, when passing to a subsequence if necessary,

$$( 4. 1 5 ) & & \| u _ { n } ( t _ { n }, x ) - w ( x ) \| _ { \Sigma ^ { s } } \to 0 \text{ as } n \to \infty.$$

This contradicts (4.14), which proves the theorem.

/square

Remark 4.4 . The results in Theorem 4.3 and Proposition 4.1 continue to hold if V satisfies the slightly more general condition (1.3). To see this, it suffices to observe the following properties. Let E V ( u ) := E u ( ) = 1 2 ‖ u ‖ 2 Σ s -1 4 ∫∫ | u x ( ) | 2 | u y ( ) | 2 | x - | y γ dxdy be given as in (2.4) and Σ s V := Σ s as in (2.2). Let C ≥ c 0 + c 1 be a fixed constant. Then we have:

- (1) M e ( iθ u ) = M u ( )
- (2) E V ( e iθ u ) = E V ( u )
- (4) E V + C ( u ) = E V ( u ) + C 2 M u ( )
- (3) e iθ S M = S M
- (5) The set of minimizers S M is independent of V + C
- (6) Denote by u V the solution of (1.1)-(1.2), then we have u V + C ( t, x ) = e -itC u V ( t, x ).

Remark 4.5 . The case s = 1, γ = 2 (mass-critical) was studied in [14], where the threshold for the stability of standing waves for (1.1) are obtained. Earlier result on the l.w.p. and mass and energy conservation laws for (1.1) can be found in [2] for s = 1, and γ ≤ 2. Let Q 0 be the unique radial positive ground state solution of (4.1), where V = 0. The paper [14, Theorem 4.1] followed a quite standard variational approach and proved that if s = 1, γ = 2 and M &lt; ‖ Q 0 ‖ 2 2 , then there exist ground state solutions of the minimization problem (4.1), where V = | x | 2 . Moreover, these ground state solutions are orbitally stable.

In the absence of V , when γ = 2 s (0 &lt; s &lt; 1 and N ≥ 2), Zhang and Zhu [24] proved the orbital stability via profile decomposition method. They also showed strong instability of (1.1) by constructing blowup solutions with initial data arbitrarily close to Q 0 in H s .

## 5. Appendix: Uniqueness of weak convergence

For the proof of Lemma 3.2 we need the following.

Proposition 5.1. Let s &gt; 0 and Σ s ⊂ L 2 be defined as in (2.2) with V satisfying (2.1) . Let { v n } be a sequence in Σ s . If { v n } converges weakly to f in Σ s and { v n } converges weakly to g in L 2 . Then f is identical to g in Σ s ∩ L 2 .

The domain of H = H s,V is given by

$$D ( H ) & = \{ \phi \in L ^ { 2 } \colon ( - \Delta + m ^ { 2 } ) ^ { s } \phi \in L ^ { 2 }, V \phi \in L ^ { 2 } \}. \\ \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \colon$$

It is easy to verify that D H ( ) is a complete Hilbert subspace of L 2 with respect to the norm

$$\| \phi \| _ { D ( H ) } \coloneqq \left ( \| ( - \Delta + m ^ { 2 } ) ^ { s } \phi \| _ { 2 } ^ { 2 } + \| V \phi \| _ { 2 } ^ { 2 } \right ) ^ { 1 / 2 }. \\ \text{Iomain of $H$ is defined as: $v\in O(H)\iff v\in L^{2}(\mathbb{R}^{N})$ and}$$

The form domain of H is defined as: v ∈ Q H ( ) ⇐⇒ v ∈ L 2 ( R N ) and

$$( 5. 1 ) & & ( - \Delta + m ^ { 2 } ) ^ { s / 2 } v \in L ^ { 2 } \ \ a n d \ \ V ^ { 1 / 2 } v \in L ^ { 2 }, \\ & & \quad \text{and}$$

which is complete with respect to the norm √ q v, v ( ) = ‖ v ‖ Σ s given in (2.3). We have D H ( ) ⊂ Q H ( ). The form definition for H is equivalent to the following weak form definition.

Definition 5.2. A function f ∈ Σ s = H s ∩ D ( √ V ) is in Q H ( ) if and only if for all φ ∈ H s ( R N ), there exists an h ∈ L 2 ∩ H -s s.t.

$$( \mathbb { R } ^ { N } ), & \text{there exists an $h\in L^{z}\cap H^{-s}$ s.t.} \\ & \quad \int _ { \mathbb { R } ^ { N } } f ( x ) H \phi \, d x = \int h ( x ) \phi ( x ) d x \quad \forall \phi \in H ^ { s } \\ = & \int f ( x ) ( - \Delta + m ^ { 2 } ) ^ { s } \phi \, d x + \int f ( x ) V \phi \, d x. \\.. \ \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim \sim$$

We see that Q H ( ) = D H ( ) = H 2 s ∩ D V ( ). Since on D H ( ) it holds

$$\langle ( - \Delta + m ^ { 2 } ) ^ { s } \phi, \phi \rangle + \langle V \phi, \phi \rangle \geq ( m ^ { 2 s } + c _ { 1 } ) \langle \phi, \phi \rangle,$$

we obtain that the spectrum σ H ( ) ⊂ [ c 1 , ∞ ), which implies 0 is in the resolvent set for H . Hence H -1 = ( H -0) -1 : L 2 → D H ( ) ⊂ Σ s exists and is a continuous mapping.

Proof of Proposition 5.1. For all φ ∈ D H ( ) ⊂ Σ s ⊂ L 2 , s &gt; 0, the inner product on Σ s

$$& \langle f, \phi \rangle _ { \Sigma ^ { s } } = \lim _ { n } \langle v _ { n }, \phi \rangle _ { \Sigma ^ { s } } \\ = & \lim _ { n } \langle ( - \Delta + m ^ { 2 } ) ^ { s / 2 } v _ { n }, ( - \Delta + m ^ { 2 } ) ^ { s / 2 } \phi \rangle _ { L ^ { 2 } } + \langle V ^ { 1 / 2 } v _ { n }, V ^ { 1 / 2 } \phi \rangle _ { L ^ { 2 } } \\ = & \lim _ { n } q ( v _ { n }, \phi ) = \lim _ { n } \langle v _ { n }, H \phi \rangle _ { L ^ { 2 } } = \langle g, H \phi \rangle _ { 2 }, \\ \dots \, \pi \, \frac { \pi } { \pi } \, \colon \, \dots \, \colon \, \dots \, \dots \, \pi \, \colon \, \colon \, \dots \, \dots \, \dots \, \pi \, 2 \, \epsilon \, \, \rangle \, \omega \, \dots \, \colon \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \delta \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dists \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dts \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dclots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \dots \, \ dclots \, \dclots \, \dclots \, \dclots \, \dclots \, \dclots \, \dclots \, \dclots \, \dclots \, \dclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclipclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclcclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclcllclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclcl|clclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclcldlclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclcldclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclclcl|clipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclip clipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclipclip$$

where H = H s,V is a positive self-adjoint operator in L 2 , cf. (2.3) and the quadratic form defined there. On the other hand, observe that

$$& \langle f, \phi \rangle _ { \Sigma ^ { s } } = \langle ( - \Delta + m ^ { 2 } ) ^ { s / 2 } f, ( - \Delta + m ^ { 2 } ) ^ { s / 2 } \phi \rangle _ { L ^ { 2 } } + \langle V ^ { 1 / 2 } v _ { n }, V ^ { 1 / 2 } \phi \rangle _ { L ^ { 2 } } \\ = & \langle f, H \phi \rangle _ { 2 }. \\. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &.. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &. &.$$

Now as functions (or distributions) it follows that f = g in L 2 by taking φ = H -1 ϕ for all ϕ ∈ L 2 . This proves Proposition 5.1. /square

Remark 5.3 . The proof here relies on the fact that the spectrum of H s,V is bounded below by zero, whence one sees that H V = ( -∆+ m 2 ) s + V has an inverse that continuously maps L 2 onto D H ( ).

Acknowledgment This paper was partially done when Shihui Zhu visited School of Mathematics at Georgia Institute of Technology, who would like to thank the hospitality of the School of Mathematics. This work was supported by the National Natural Science Foundation of China grant No. 11501395, No. 11371267 and Excellent Youth Foundation of Sichuan Scientific Committee grant No. 2014JQ0039 in China.

## References

- 1. W. Bao and X. Dong, Numerical methods for computing ground states and dynamics of nonlinear relativistic Hartree equation for boson stars. J. Comput. Phys. 230 (2011), 54495469.
- 2. T. Cazenave, Semilinear Schr¨dinger Equations. o Courant Lecture Notes in Mathematics 10 , NYU, CIMS, AMS 2003.
- 3. T. Cazenave and P. L. Lions, Orbital stability of standing waves for some nonlinear Schr¨dinger o equations. Commun. Math. Phys. 85 (1982), 549-561.
- 4. M. Cheng, Bound state for the fractional Schr¨dinger equation with unbounded potential. o J. Math. Phys. 53 (2012), 043507.
- 5. Y. Cho, H. Hajaiej, G. Hwang and T. Ozawa, On the orbital stability of fractional Schr¨dinger o equations. Comm. Pure Appl. Anal. 13 (2014), 1267-1282.
- 6. B. Feng, Sharp threshold of global existence and instability of standing wave for the Schr¨dinger-Hartree o equation with a harmonic potential. Nonlinear Analysis : Real World Applications 31 (2016), 132-145.
- 7. B. Feng and H. Zhang, Stability of standing waves for the fractional Schr¨dinger-Hartree o equation. J. Math. Anal. Appl. 460 (2018), 352-364.
- 8. J. Fr¨hlich and E. Lenzmann, Blowup for nonlinear wave equations describing boson stars. o Comm. Pure Appl. Math. 60 (2007), 1691-1705.
- 9. R. Fukuizumi, Stability and instability of standing waves for the nonlinear Schr¨dinger equao tion with harmonic potential. Discrete Contin. Dynam. Systems. 7 (2001), 525-544.
- 10. R. Fukuizumi and M. Ohta, Stability of standing waves for nonlinear Schr¨dinger equations o with potentials. Differential and Integral Eqs. 16 (2003), 111-128.
- 11. B. Guo and D. Huang, Existence and stability of standing waves for nonlinear fractional Schr¨dinger equations. o J. Math. Phys. 53 (2012), 083702.
- 12. Q. Guo and S. Zhu, Sharp threshold of blow-up and scattering for the fractional Hartree equation. J. Differ. Eqns . 264 (2018), 2802-2832.
- 13. C. Hainzl, E. Lenzmann, M. Lewin and B. Schlein, On blowup for time-dependent generalized Hartree-Fock Equations. Ann. Henri Poincar´ e , 11 (2010), 1023-1052.
- 14. J. Huang , J. Zhang and X. Li, Stability of standing waves for the L 2 -critical Hartree equations with harmonic potential. Applicable Analysis 92 (2013), 2076-2083.
- 15. K. Kirkpatrick and Y. Zhang, Fractional Schr¨dinger dynamics and decoherence. o Physica D : Nonlinear Phenomena 332 (2016), 41-54.
- 16. E. Lieb and H.-T. Yau, The Chandrasekhar theory of stellar collapse as the limit of quantum mechanics. Comm. Math. Phys . 112 (1987), no. 1, 147-174.
- 17. Y.-G. Oh, Cauchy problem and Ehrenfest's law of nonlinear Schr¨dinger equations with poo tentials. J. Differ. Eqns , 81 (1989), 255-274.
- 18. H. Rose and M. Weinstein, On the bound states of the nonlinear Schr¨dinger equation with o a linear potential. Physica D. 30 (1988), 207-218.
- 19. S. Secchi and M. Squassina, Soliton dynamics for fractional Schr¨dinger equations. o Applicable Analysis 93 (2014), Issue 8. 1702-1729.
- 20. T. Tao, Nonlinear Dispersive Equations: Local and Global Analysis . CBMS regional conference series in mathematics, 2006.
- 21. D. Wu, Existence and stability of standing waves for nonlinear fractional Schr¨dinger equations o with Hartree type nonlinearity. J. Math. Anal. Appl. 411 (2014), 530-542.
- 22. J. Zhang, Stability of standing waves for the nonlinear Schr¨dinger equations with unbounded o potentials. Z. Angew. Math. Phys. 51 (2000), 489-503.

- 23. J. Zhang, Stability of attractive Bose-Einstein condensates. J. Stat. Phys. 101 (2000), 731745.
- 24. J. Zhang and S. Zhu, Stability and instability of standing waves for the nonlinear fractional Schr¨dinger equation. o J. Dyn. Differ. Eqns. 29 (2017), 1017-1030.
- 25. S. Zhu, On the blow-up solutions for the nonlinear fractional Schr¨dinger equation. o J. Differ. Eqns . 261 (2016), 1506-1531.
- 26. S. Zhu, Existence of stable standing waves for the fractional Schr¨dinger equations with como bined nonlinearities. J. Evolu. Eqns. 17 (2017), 1003-1021.

(Jian Zhang) School of Mathematical Science, University of Electronic Science and Technology of China, Chengdu, Sichuan, 611731, China

E-mail address : zhangjiancdv@sina.com

(Shijun Zheng) Department of Mathematical Sciences, Georgia Southern University, Statesboro, Georgia 30460-8093, USA

E-mail address : szheng@GeorgiaSouthern.edu

(Shihui Zhu) Department of Mathematics, Sichuan Normal University, Chengdu, Sichuan, 610066, China.

E-mail address : shihuizhumath@163.com
Jian Zhang Shijun Zheng Shihui Zhu
Orbital Stability of Standing Waves for Fractional Hartree Equation with Unbounded Potentials
We prove the existence of the set of ground states in a suitable energy space
$\Sigma^s=\{u: \int_{\mathbb{R}^N} \bar{u}(-\Delta+m^2)^s u+V |u|^2<\infty\}$,
$s\in (0,\frac{N}{2})$ for the mass-subcritical nonlinear fractional Hartree
equation with unbounded potentials. As a consequence we obtain, as a priori
result, the orbital stability of the set of standing waves. The main ingredient
is the observation that $\Sigma^s$ is compactly embedded in $L^2$. This enables
us to apply the concentration compactness argument in the works of
Cazenave-Lions and Zhang, namely, relative compactness for any minimizing
sequence in the energy space.