## Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis

ARI ARAPOSTATHIS , GUODONG PANG , AND YI ZHENG † ‡ ‡

Abstract. We study the ergodic control problem for a class of controlled jump diffusions driven by a compound Poisson process. This extends the results of [ SIAM J. Control Optim. 57 (2019), no. 2, 1516-1540] to running costs that are not near-monotone. This generality is needed in applications such as optimal scheduling of large-scale parallel server networks.

We provide a full characterizations of optimality via the Hamilton-Jacobi-Bellman (HJB) equation, for which we additionally exhibit regularity of solutions under mild hypotheses. In addition, we show that optimal stationary Markov controls are a.s. pathwise optimal. Lastly, we show that one can fix a stable control outside a compact set and obtain near-optimal solutions by solving the HJB on a sufficiently large bounded domain. This is useful for constructing asymptotically optimal scheduling policies for multiclass parallel server networks.

## 1. Introduction

Control problems for jump diffusions have been studied extensively. We refer the readers to [1] and references therein for the study of the discounted problem and many applications. In [2], the ergodic control problem under a strong blanket stability condition (see [2, (1.6)]) has been studied. In [3], the authors have studied the ergodic control problem for jump diffusions when the associated L´vy measures are finite and state-dependent and have rough kernels under a neare monotone running cost function. However, in many applications the dynamics are not stable under any Markov control, nor do they have a near-monotone running cost function. In this paper we waive these assumptions, and study the ergodic control problem under the more general structural hypotheses (see Assumptions 2.1 and 2.2) first introduced in [4], and also used in [5] in the study of multiclass multi-pool queueing networks.

The class of jump diffusions studied in this paper is abstracted from the diffusion limit of multiclass queueing networks in the Halfin-Whitt regime with service interruptions [6]. The jump process in this model is compound Poisson, and thus the associated L´vy measure is finite. e However, it not have any particular regularity properties such as density. In addition, the running cost function, which typically penalizes the queue size, is not near-monotone. We abstract and generalize this model, and consider a large class of diffusions with jumps, which includes models having a near-monotone running cost function, or with uniformly stable dynamics as special cases.

We first establish the existence of an optimal stationary Markov control for the ergodic control problem, and characterize all optimal stationary Markov controls via the ergodic Hamilton-JacobiBellman (HJB) equation.

† Department of Electrical and Computer Engineering, The University of Texas at Austin, 2501 Speedway, EERC 7.824, Austin, TX 78712, USA

‡ The Harold and Inge Marcus Department of Industrial and Manufacturing Engineering, College of Engineering, Pennsylvania State University, University Park, PA 16802 E-mail addresses : ari@ece.utexas.edu, { gup3,yxz282 @psu.edu } . 2000 Mathematics Subject Classification. Primary: 93E20, 60J75, 35Q93. Secondary: 60J60, 35F21, 93E15.

Key words and phrases. controlled jump diffusions, compound Poisson process, ergodic control, Hamilton-JacobiBellman (HJB) equation, stable Markov optimal control, pathwise optimality, approximate HJB equation, spatial truncation.

It is shown in [3, Example 1.1] that the Harnack property may fail for infinitesimal generators of jump diffusions with compound Poisson jumps. Thus the approach developed in [4,7] for the study of the ergodic HJB equation associated with continuous diffusions cannot be applied here. On the other hand, the running cost function is assumed near-monotone in [3], and thus the infimum of the value function for the discounted problem is attained in a compact set (see [3, Theorem 3.2]), and the solutions of the ergodic HJB equation are bounded from below. In the present paper, we extend the technique developed in [3], and derive the ergodic HJB under Assumptions 2.1 and 2.2. This is rather delicate, and requires an estimate of the negative part of the solutions of the HJB.

Another difficulty concerns the regularity of solutions of the discounted and ergodic HJB equations associated with jump diffusions, when the L´ evy kernel is rough. In [3], we show that the solutions have locally H¨ older continuous second order derivatives when the L´vy measure has a e compact support (see [3, Remark 3.4]). In this paper, we present a gradient estimate for solutions of a class of second order nonlocal equations in Lemma 5.3 using scaling, and employ this to establish C 2 ,α regularity of the solutions of the HJB equations in Theorem 5.3.

We also study pathwise optimality of optimal controls for the ergodic control problem. For continuous diffusion processes, pathwise optimality has been studied in [7-11]. Pathwise optimality for jump diffusions with near-monotone running cost is studied in [3, Theorem 4.4]. We extend the technique in [10], using also the result on convergence of random empirical measures for jump diffusions in [3, Lemma 4.3] while providing a crucial estimate on the nonlocal term, to establish pathwise optimality for the model studied in this paper.

The ability to synthesize a near-optimal Markov control, by fixing a suitable stable control outside a large ball and solving the HJB equation inside the ball plays a crucial role in the study of asymptotic optimality for multiclass parallel server networks. This is used in [4,12-14] to construct asymptotically near-optimal scheduling policies for the prelimit system. In addressing this problem for jump diffusions, we first derive a lower bound for supersolutions of a general class of integrodifferential equations in Lemma 7.1, and then use this to establish the required result in Theorem 7.1 and Corollary 7.1. In turn, this result is used to establish the asymptotic optimality of multiclass networks with service interruptions in [15].

- 1.1. Organization of the paper. In the next subsection, we summarize the notation used in this paper. In Section 2, we introduce the model and state the assumptions. Section 3 contains some examples from queueing networks whose limiting controlled jump diffusions satisfy these assumptions. Section 4 concerns the existence of optimal stationary Markov controls. Section 5 is devoted to the study of the HJB equations on the discounted and ergodic control problems. In Section 6, we study the pathwise optimality for the ergodic control problem. The characterization of near-optimal controls is studied in Section 7.
- 1.2. Notation. The standard Euclidean norm in R d is denoted by | · | , 〈 · , · 〉 denotes the inner product, and x T denotes the transpose of x ∈ R d . The set of nonnegative real numbers is denoted by R + , N stands for the set of natural numbers, and 1 denotes the indicator function. The minimum (maximum) of two real numbers a and b is denoted by a ∧ b ( a ∨ b ), respectively, and a ± := ( ± a ) ∨ 0. The closure, boundary, and the complement of a set A ⊂ R d are denoted by ¯ , A ∂A , and A c , respectively. We also let e := (1 , . . . , 1) T . For any function f : R d → R and domain D ⊂ R we define the oscillation of f on D as follows:

We denote by τ ( A ) the first exit time of the process X from the set A R , defined by

$$\text{scillation of $f$ on $D$ as follows:} \\ \text{osc $f$ } \coloneqq \sup \left \{ f ( x ) - f ( y ) \colon x, y \in D \right \}. \\ \text{the first exit time of the process } \{ X _ { t } \} \text{ from the set $A$}$$

$$\tau ( A ) \, \coloneqq \, \inf \, \{ t > 0 \, \colon \, X _ { t } \not \in \,.$$

The open ball of radius r in R d , centered at x ∈ R d is denoted by B r ( x ). We write B r for B r (0), and let τ r := τ ( B r ), and ˘ τ r := τ ( B c r ).

/negationslash

{ t } ⊂ d { t ∈ A . }

The term domain in R d refers to a nonempty, connected open subset of the Euclidean space R d . For a domain D ⊂ R d , the space C k ( D ) ( C ∞ ( D )), k ≥ 0, refers to the class of all real-valued functions on D whose partial derivatives up to order k (of any order) exist and are continuous. By C k,α ( R d ) we denote the set of functions that are k -times continuously differentiable and whose k -th derivatives are locally H¨lder continuous with exponent o α . The space L p ( D ), p ∈ [1 , ∞ ), stands for the Banach space of (equivalence classes of) measurable functions f satisfying ∫ D | f ( x ) | p d x &lt; ∞ , and L ∞ ( D ) is the Banach space of functions that are essentially bounded in D . The standard Sobolev space of functions on D whose generalized derivatives up to order k are in L p ( D ), equipped with its natural norm, is denoted by W k,p ( D ), k ≥ 0, p ≥ 1. In general, if X is a space of real-valued functions on Q , X loc consists of all functions f such that fϕ ∈ X for every ϕ ∈ C ∞ c ( Q ). In this manner we obtain for example the space W 2 ,p loc ( Q ).

For k ∈ N , we let D k := D R ( + , R k ) denote the space of R k -valued c´dl´g functions on a a R + . When k = 1, we write D for D k .

For a nonnegative function g ∈ C ( R d ) we let O ( g ) denote the space of functions f ∈ C ( R d ) satisfying sup x ∈ R d | f ( x ) | 1+ ( g x ) &lt; ∞ . We also let o ( g ) denote the subspace of O ( g ) consisting of those functions f satisfying lim sup | x |→∞ | f ( x ) | 1+ ( g x ) = 0.

For a probability measure µ in P ( R d ), the space of Borel probability measures on R d under the Prokhorov topology, and a real-valued function f which is integrable with respect to µ we use the notation µ f ( ) := ∫ R d f ( x µ ) (d x ).

## 2. The model and assumptions

We consider a controlled jump diffusion process { X t } t ≥ 0 taking values in the d -dimensional Euclidean space R d defined by

$$d X _ { t } \, \coloneqq \, b ( X _ { t }, U _ { t } ) \, d t + \sigma ( X _ { t } ) \, d W _ { t } + \mathrm d L _ { t }$$

with X 0 = x ∈ R d . All random processes in (2.1) are defined on a complete probability space (Ω , F , P ). The process { W t } t ≥ 0 is a d -dimensional standard Wiener process, and { L t } t ≥ 0 is a L´vy e process defined as follows. Let ˜ N (d t, d ) denote a martingale measure on z R l ∗ = R l \ { 0 , } l ≥ 1, taking the form ˜ N (d t, d ) = z N (d t, d ) z -Π(d )d , where z t N is a Poisson random measure, and Π(d )d z t is the corresponding intensity measure, with Π a finite measure on R l ∗ . Then, { L t } t ≥ 0 is given by for a measurable function g : R d × R l → R d . The control process { U t } t ≥ 0 takes values in a compact, metrizable space U , U t ( ω ) is jointly measurable in ( t, ω ) ∈ [0 , ∞ × ) Ω, and is non-anticipative: for s &lt; t , ( W t -W , s N ( t, · ) -N ( s, · ) ) is independent of

$$\dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \ delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \dots \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \ delta \ delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta delta \ delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \dia \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \Delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta \delta
\quad d L _ { t } = \int _ { \mathbb { R } ^ { l } _ { * } } g ( z ) \widetilde { \mathcal { N } } ( d t, d z ) \int _ { \mathbb { R } ^ { l } _ { * } } \times \left [ 0. \infty \infty \right ] >$$

F s := the completion of σ X ,U ,W , { 0 r r N ( r, · ) : r ≤ } s relative to ( F , P ) .

Such a process U is called an admissible control, and we let U denote the set of admissible controls. We also assume that the initial conditions X 0 , W 0 and N (0 , · ) are independent.

↦

↦

To guarantee the existence of a solution to the equation (2.1), we impose the following usual assumptions on the drift, matrix σ and jump functions (compare with [3, Section 4.2]). The functions b : R d × U → R d and σ = [ σ ij ] : R d → R d × d are continuous and have at most affine growth on R d . Also, b is locally Lipschitz continuous in its first argument uniformly with respect to the second. The matrix σ is locally Lipschitz continuous and nonsingular. We also assume that ∫ R l ∗ | g z ( ) | 2 Π(d ) z &lt; ∞ . Define ν A ( ) := Π ( { z ∈ R l ∗ : g z ( ) ∈ A } ) . Thus, ν is a Radon measure on R d , and we let ν := ν ( R d ) = Π( R l ∗ ), which is finite. These hypotheses are enforced throughout the rest of the paper.

Under the above assumptions on the parameters, (2.1) has a unique strong solution under any admissible control U (see, e.g., [16, Part II, § 7]), which is right continuous w.p.1, and has the strong Feller property. Recall that Markov controls may be identified with Borel measurable map v on R + × R d , by letting U t = v t, X ( t ). For any such Markov control v , define the associated diffusion process { X ,t ◦ ≥ } 0 by

$$\L, \, \L _ { \nu } ^ { \nu } \quad \text{d} X _ { t } ^ { \circ } \, \coloneqq \, b ( X _ { t } ^ { \circ }, v ( t, X _ { t } ^ { \circ } ) ) \, \text{d} t + \sigma ( X _ { t } ^ { \circ } ) \, \text{d} W _ { t } \,,$$

with X ◦ 0 = x ◦ ∈ R d . It is well known that (2.2) has a pathwise unique strong solution [17, Theorem 2.4]. Since Π is finite, it follows by the construction of a solution in [18, Chap. 1, Theorem 14] via (2.2) that (2.1) has a unique strong solution under any Markov control. We say that a Markov control v is stationary if v t, x ( ) is independent of t , and we use the symbol U sm to denote the set of these controls.

For ϕ ∈ C 2 ( R d ), define the integro-differential operator A C : 2 ( R d ) →C ( R d × U ) by where a := 1 2 σσ T , and ˜ b x, u ( ) := b x, u ( ) + ∫ R d z ν (d z ). With u ∈ U treated as a parameter, we also define A u ϕ x ( ) := A ϕ x, u ( ). We decompose this operator as A u = L u + I , where

$$\text{For $\varphi\in\mathcal{C}^{2}(\mathbb{R}^{d})$, define the integro-differential operator $\mathcal{A} \colon\mathcal{C}^{2}(\mathbb{R}^{d})\to\mathcal{C}(\mathbb{R}^{d}\times\mathbb{U})$ by} \\ \mathcal { A } \varphi ( x, u ) \, \colon = \, a ^ { i j } ( x ) \partial _ { i j } \varphi ( x ) + \widetilde { b } ^ { i } ( x, u ) \partial _ { i } \varphi ( x ) + \int _ { \mathbb { R } ^ { d } } \left ( \varphi ( x + y ) - \varphi ( x ) \right ) \nu ( d y ) \,, \quad \, ( 2. 3 ) \\ \text{where $a \colon = \frac{1}{2}\sigma\sigma^{T}$, and $\widetilde{b} ( x, u ) \colon = b ( x, u ) + \int _ { \mathbb { R } ^ { d } } z \, \nu ( d z ). \text{ With $u\in\mathbb{U}$ treated as a parameter, we also} \\ \mathcal { A } \inf _ { \infty } \, \mathcal { M } \sim \, \mathcal { A } \sim \, \mathcal { A } \, \mathcal { X } \, \mathcal { X } \, \mathcal { X } \, \mathcal { X } \, \mathcal { X } \, \mathcal { X } \, \mathcal { W } \, \text{$d$ decommission to the non-zero $\mathcal{C}$} \, \mathcal { M} \, - \, \mathcal { C } \, \ \mathcal { T } \, \text{ where}$$

$$& \text{where} \, a \coloneqq \frac { 1 } { 2 } \sigma \sigma ^ { \prime }, \, \text{and} \, b ( x, u ) \coloneqq b ( x, u ) + J _ { R ^ { d } } \, z \, \nu ( d z ). \, \text{With} \, u \in \mathbb { U } \, \text{treated as a parameter, we also} \\ & \text{define} \, \mathcal { A } _ { u } \varphi ( x ) \coloneqq \mathcal { A } \varphi ( x, u ). \, \text{We decompose this operator} \, as \, \mathcal { A } _ { u } = \widetilde { \mathcal { L } } _ { u } + \widetilde { \mathcal { I } }, \, \text{where} \\ & \widetilde { \mathcal { L } } _ { u } \varphi ( x ) \coloneqq a ^ { i j } ( x ) \partial _ { i j } \varphi ( x ) + \widetilde { b } ^ { i } ( x, u ) \partial _ { i } \varphi ( x ) - \nu \varphi ( x ) \,, \quad \text{and} \quad \widetilde { \mathcal { I } } \varphi ( x ) \coloneqq \int _ { \mathbb { R } ^ { d } } \varphi ( x + y ) \, \nu ( d y ) \,. \, \text{(} 4. 4 ) \\ & \text{Let} \, D \, \text{be a bounded domain with } C ^ { 1, 1 } \, \text{boundary.} \, \text{Recall that } \tau ( D ) \, \text{ denotes the first exit time} \\ & \text{from} \, D. \, \text{As shown in } [ 3, \text{Lmma} \, 4. 1 ], \, \text{for any} \, f \in W _ { l _ { o o } ^ { 2 } } ^ { 2, d } ( \mathbb { R } ^ { d } ), \, \text{such that } \widetilde { \mathcal { Z } } | f | \in L _ { l _ { o o } ^ { 2 } } ^ { d } ( \mathbb { R } ^ { d } ), \, \text{we have}$$

Let D be a bounded domain with C 1 1 , boundary. Recall that τ ( D ) denotes the first exit time from D . As shown in [3, Lemma 4.1], for any f ∈ W 2 ,d loc ( R d ), such that I| f | ∈ L d loc ( R d ), we have for all x ∈ D t , ≥ 0, and U ∈ U . In addition, (2.5) holds if we replace t ∧ τ ( D ) with τ ( D ). Here, E U x denotes the expectation operator on the canonical space of the process under the control U ∈ U . Equation (2.5) arises from the well known Krylov's extension of the Itˆ's formula, and we refer to o this plainly as the Itˆ formula. o

$$& \text{be a bounded domain with $C^{\prime}+\ast$ boundary. Recall that $\tau(D)$ denotes the first exit time} \\ & \text{As shown in $[3, Lemma $4.1], for any $f\in W_{loc}^{2,d}(\mathbb{R}^{d})$, such that $\mathbb{I}|f|\in L_{loc}^{d}(\mathbb{R}^{d})$, we have} \\ & \mathbb { E } _ { x } ^ { U } [ f ( X _ { t \wedge \tau(D)}) ] \, = \, f ( x ) + \mathbb { E } _ { x } ^ { U } \left [ \int _ { 0 } ^ { t \wedge \tau(D) } \mathcal { A } f ( X _ { s }, U _ { s } ) \, \mathrm d s \right ] \quad & ( 2. 5 ) \\ & \in D, t \geq 0, \, \text{and} \, U \in \mathfrak { U }. \, \text{In addition, (2.5) holds if we replace $t\wedge \tau(D)$ with $\tau(D)$. Here, $\mathbb{E}_{rx}^{U}$}$$

- 2.1. The ergodic control problem. Given a continuous running cost function R : R d × U → R + , which is locally Lipschitz continuous in its first argument uniformly with respect to the second, we define the average (or ergodic ) penalty as

$$\L a g e ( \text{or ergoca} ) \text{ penalty as} \\ \varrho _ { U } ( x ) \coloneqq \lim \sup _ { T \to \infty } \frac { 1 } { T } \, \mathbb { E } _ { x } ^ { U } \left [ \int _ { 0 } ^ { T } \mathcal { R } ( X _ { t }, U _ { t } ) \, \mathrm d t \right ]. \\. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad. \quad.$$

for an admissible control U ∈ U . We say that U ∈ U is stabilizing if /rho1 U ( x ) &lt; ∞ for all x ∈ R d .

The ergodic control problem seeks to minimize the ergodic penalty over all admissible controls. We define

$$\varrho _ { * } ( x ) \, \coloneqq \, \inf _ { U \in \mathfrak { U } } \varrho _ { U } ( x ) \,.$$

As we show in Theorem 4.1, the optimal ergodic value /rho1 ∗ does not depend on x .

Assumption 2.1 which follows, is a slight variation of [4, Assumption 3.1], and is abstracted from the limiting diffusions arising in multiclass stochastic networks in the Halfin-Whitt regime. Note that the assumption on the running cost in [3, Section 2.2] is not met in these problems. Recall that a function f : X → R , where X is a σ -compact space, is called coercive , or inf-compact if the set { x ∈ X : f ( x ) ≤ C } is compact (or empty) for every C ∈ R .

- (i) The running cost R is coercive on K .

Assumption 2.1. There exist some open set K ⊂ R d , a ball B ◦ , and coercive nonnegative functions V ◦ ∈ C 2 ( R d ) and F ∈ C ( R d × U ) such that:

## (ii) The following inequalities hold

$$\Lambda _ { u } \mathcal { V } _ { \circ } ( x ) & \leq \mathfrak { 1 } _ { \mathfrak { B } _ { \circ } } ( x ) - F ( x, u ) \quad \forall ( x, u ) \in \mathcal { K } ^ { c } \times \mathbb { U } \,, \\ \mathcal { A } _ { u } \mathcal { V } _ { \circ } ( x ) & \leq \mathfrak { 1 } _ { \mathfrak { B } _ { \circ } } ( x ) + \mathcal { R } ( x, u ) \quad \forall ( x, u ) \in \mathcal { K } \times \mathbb { U } \,. \\ \text{as of non-partial} i v \, \text{ we assume $F$ is locally $Line$ which contains in its first argument}$$

Without loss of generality, we assume F is locally Lipschitz continuous in its first argument.

Since we can always scale B ◦ , V ◦ and F to obtain the form in (2.8), there is no need to include any other constants in these equations. It is worth noting that R is coercive on R d if K c is bounded, and the controlled jump diffusion is uniformly stable if K is bounded.

Assumption 2.2. There exist ˆ v ∈ U ssm , a positive constant ˆ, and a coercive nonnegative function κ V ∈ C 2 ( R d ) such that

We introduce an additional assumption which, together with Assumption 2.1, is sufficient for the existence of a stabilizing stationary Markov control. For v ∈ U sm , we let b v ( x ) := b ( x, v ( x ) ) , and define A v , ˜ L v , R v , and /rho1 v analogously. If under v ∈ U sm the controlled jump diffusion is positive recurrent, then v is called a stable Markov control, and the set of such controls is denoted by U ssm .

$$\mathcal { A } _ { \hat { v } } \mathcal { V } ( x ) \, \leq \, \hat { \kappa } \mathbb { I } _ { \mathcal { B } _ { \circ } } ( x ) - \mathcal { R } _ { \hat { v } } ( x ) \,, \quad \forall x \in \mathbb { R } ^ { d } \,, \\ \intertext { a common to } 9 1$$

with B ◦ as in Assumption 2.1.

Without loss of generality, we use the same ball B ◦ in Assumptions 2.1 and 2.2 in the interest of notational economy.

Remark 2.1 . The reader will note that Assumption 2.2 is not used in [4]. Instead, starting from a weak stabilizability hypothesis, namely that

$$\varrho _ { U } ( x ) < \infty \quad \text{for some } x \in \mathbb { R } ^ { d } \text{ and } U \in \mathfrak { U }, \quad \text{(2.10)} \\ \varrho _ { \cdot } \quad \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \colon$$

the existence of a control ˆ v ∈ U ssm and a coercive nonnegative function V ∈ C 2 ( R d ) satisfying (2.9) is established in [4, Lemma 3.1]. For the model studied in this paper, if we assume (2.10), then together with Assumption 2.1 we can show, that there exists a control ˆ which is stabilizing for v some coercive running cost ˜ R ≥ R (see the proof of Theorem 4.1 which appears later). Then, if ν has compact support, [3, Theorem 3.7] shows that there exists a function V ∈ W 2 ,p loc ( R d ), for any p &gt; 1, satisfying Assumption 2.2, and this implies that ˜ I V ∈ L d loc ( R d ). Thus, if ν has compact support, then the Itˆ formula in (2.5) is applicable to o V , and using this in the proofs, it follows that as far as the results of this paper are concerned, we may replace Assumption 2.2 with the weaker hypothesis in (2.10), which cannot be weakened further since it is necessary for the value of the ergodic control problem to be finite. In typical applications, the existence of a stabilizing Markov control is usually established by exhibiting a Foster-Lyapunov equation taking the form of (2.9).

As we establish in Theorem 4.1, Assumption 2.1 and (2.10) together guarantee the existence of an optimal stationary Markov control for the ergodic control problem. Thus Assumption 2.2 need not be used for the existence part. However, it plays a crucial role in the derivation of the HJB equation in Section 5 for non-compactly supported ν .

## 3. Examples

In this section, we provide examples of stochastic networks, and show that the jump diffusions involved satisfy Assumptions 2.1 and 2.2. We refer the reader to [5, Section 2] for a detailed description of multiclass multi-pool networks.

Consider a multiclass multi-pool network with d classes of customers and J server pools. Define the sets I := { 1 , . . . , d } , J := { 1 , . . . , J } , and

$$\colon \{ 1, \dots, a _ { \} }, \, & \dots = \{ 1, \dots, J _ { \} }, \, \text{and} \\ \mathbb { U } \, \coloneqq \, & \left \{ u = ( u ^ { c }, u ^ { s } ) \in \mathbb { R } _ { + } ^ { d } \times \mathbb { R } _ { + } ^ { J } \colon \langle e, u ^ { c } \rangle = \langle e, u ^ { s } \rangle = 1 \right \}.$$

Following similar arguments as in [15, Theorem 2.1], and assuming that service interruptions are asymptotically negligible under the √ n -scaling, we can show that the limiting controlled queueing processes are d -dimensional jump diffusions taking the form

$$d X _ { t } \, = \, b ( X _ { t }, U _ { t } ) \, d t + \sigma \, d W _ { t } + \theta \, d L _ { t } \,,$$

where σ is a nonsingular diagonal matrix, θ is a strictly positive vector, and { L t } t ≥ 0 is a onedimensional compound Poisson process. The L´ evy measure of θL t is denoted by ν (d z ). This is supported on { θt : t ∈ [0 , ∞ } ) . It follows by [5, Lemma 4.3] that where /lscript ∈ R d , Γ = diag( γ , . . . , γ 1 d ), M 1 is a lower-diagonal d × d matrix with positive diagonal elements, and M 2 is a d × J matrix. Without loss of generality, we assume that γ 1 = 0, γ d &gt; 0, and γ i ≥ 0, i ∈ I \ { 1 , d } . We consider the ergodic control problem in (2.7) with

$$\text{or} \, \frac { \{ \mathcal { v } \colon \, \iota \in \{ \mathcal { U }, \infty \} } { \} }. \, \text{$\mathfrak l$ follows by [0, Lemima 4.0]$ unit} \\ b ( x, u ) = \ell - M _ { 1 } ( x - \langle e, x \rangle ^ { + } u ^ { c } ) - \langle e, x \rangle ^ { + } \Gamma u ^ { c } + \langle e, x \rangle ^ { - } M _ { 2 } u ^ { s } & \\ \text{e} \, \ell \in \mathbb { R } ^ { d }, \, \Gamma = \text{diag} ( \gamma _ { 1 }, \dots, \gamma _ { d } ), \, M _ { 1 } \text{ is a lower-diagonal} \, d \times d \text{ matrix with positive diagonal} \\ \text{out} \, \text{and} \, M _ { 2 } \in \mathbb { R } \times \mathfrak l \text{ matrix with positive diagonal} \, d \times \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to  \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text` to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text { to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \text{ to } \mathfrak l \textif }$$

$$\imath \in J \ \{ 1, u \}. \ \text{ we consume one of your problem in } ( 2. 1 ) \text{ with } \\ \mathcal { R } ( x, u ) \coloneqq \sum _ { i \in \mathbb { I } } c _ { i } [ \langle e, x \rangle ^ { + } u _ { i } ^ { c } ] ^ { m } + \sum _ { j \in \mathfrak { I } } s _ { j } [ \langle e, x \rangle ^ { - } u _ { j } ^ { s } ] ^ { m } \\ > 1 \text{ and comma notit} u \text{ concat $f_{\cdot}$} \cdot i \subset \mathfrak { I } \text{ and } f_{\cdot} \cdot i \subset \mathfrak { I } \text{ } \text{This running cost function}$$

for some m ≥ 1, and some positive constants { c i : i ∈ I } and { s j : j ∈ J } . This running cost function penalizes the queue sizes and idleness. It is evident that R ( x, u ) is not near-monotone, since 〈 e, x 〉 equals 0 on a hyperplane in R d . We assume that ∫ R d | z | m ν (d z ) &lt; ∞ .

Lemma 3.1. There exist a diagonal matrix Q , some δ &gt; 0 small enough, and a positive constant C such that V ◦ = V Q,m and F x ( ) = C x | | m satisfy Assumption 2.1 with K = K δ .

We define K δ := { x ∈ R d : |〈 e, x 〉| &gt; δ x | |} with δ &gt; 0. It is clear that R is coercive on K δ for δ &gt; 0. For a positive definite symmetric matrix Q , we let g x ( ) be some positive convex smooth function which agrees with 〈 x, Qx 〉 1 2 / on B c 1 , and define the function V Q,k ( x ) = ( g x ( ) ) k for k &gt; 0.

Proof. Recall ˜ b defined in (2.3). Following the same calculation as in the proof of [5, Theorem 4.1], we obtain for some δ &gt; 0, a positive constant C 1 , and a diagonal matrix Q satisfying x T ( QM 1 + M Q x T 1 ) ≥ | | 8 x . On the other hand, using the hypothesis ∫ R d | z | m ν (d z ) &lt; ∞ , we obtain

$$\stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { \sim }, \stackrel { \sim } { } \end{ \sim } \stackrel { \sim } { \sim } \text{obtain} \, \begin{array} { c } \left \langle \widetilde { b } ( x, u ), \nabla \mathcal { V } _ { Q, m } ( x ) \right \rangle \leq \begin{cases} C _ { 1 } - m \langle x, Q x \rangle ^ { m / 2 - 1 } | x | ^ { 2 } & \forall ( x, u ) \in \mathcal { K } _ { \delta } ^ { c } \times \mathbb { U } \,, \\ C _ { 1 } ( 1 + | \langle e, x \rangle | ^ { m } ) & \forall ( x, u ) \in \mathcal { K } _ { \delta } \times \mathbb { U } \end{array} \end{cases} \\ \text{r some} \, \delta > 0, \, a \, \text{positive constant} \, C _ { 1 }, \, \text{and} \, a \, \text{diagonal matrix} \, Q \, \text{satisfying} \, x ^ { T } ( Q M _ { 1 } + M _ { 1 } ^ { T } Q ) x \geq 8 | \cdot \\ \text{in the other hand, using the hypothesis } \, \int _ { m d } | z | ^ { m } \, \nu ( d z ) < \infty, \, \text{we obtain}$$

$$\text{On the other nan}, using the nypothesis $J_{R^{d}|z|^{\prime}\prime}(\hat{z}) < \infty$, we obtain} \\ \int _ { \mathbb { R } ^ { d } } \left ( \mathcal { V } _ { Q, m } ( x + z ) - \mathcal { V } _ { Q, m } ( x ) \right ) \nu ( \mathrm d z ) & = \int _ { \mathbb { R } ^ { d } } \int _ { 0 } ^ { 1 } \left \langle z, \nabla \mathcal { V } _ { Q, m } ( x + t z ) \right \rangle d t \nu ( \mathrm d z ) \\ & \leq C _ { 2 } + \epsilon \left \langle x, Q x \right \rangle ^ { m / 2 } \\ \text{for some} \, \epsilon > 0 \text{ sufficient} v \,small. \, and a positive constant $C$.\, Thus (2.8) holds. \, This completes the}$$

for some /epsilon1 &gt; 0 sufficiently small, and a positive constant C 2 . Thus (2.8) holds. This completes the proof. /square

Remark 3.1 . Let ˜ := /lscript /lscript + ∫ R d z ν (d z ) and u c 1 = 1, and suppose that 〈 e, ( M -1 1 ) T ˜ /lscript 〉 &gt; 0. Using the leaf elimination algorithm as in [5, Theorem 4.2], we obtain a constant control ¯ = (¯ u u , u c ¯ ) s ∈ U , with ¯ u c 1 = 1, such that the last two terms on the right hand side of (3.2) are equal to 0. This implies that { X t } t ≥ 0 is transient under the control ¯ by [6, Theorem 3.1]. u Therefore, (3.1) is not uniformly stable.

Recall ˜ L and ˜ I defined in (2.4). By [5, Theorem 4.2] concerning the local operator ˜ L , and (3.4) for ˜ I , it follows that there exist u = ( u , u c s ) ∈ U with u c d = 1, and V ( x ) ∼ 〈 x, Qx ˜ 〉 m / 2 for some diagonal positive matrix ˜ satisfying Assumption 2.2. Q

We present two specific examples: the 'W' and 'V' networks.

Example 3.1. (The 'W' model with service interruptions.) See [5, Section 4.2] for the detailed definition of the 'W' model. We have I = { 1 2 3 , , } and J = { 1 2 , } . By [5, Example 4.2], M 1 and M 2 in (3.2) are given by

$$\text{) are given by} \\ M _ { 1 } \, = \, \begin{bmatrix} \mu _ { 1 1 } & 0 & 0 \\ \mu _ { 2 2 } - \mu _ { 2 1 } & \mu _ { 2 2 } & 0 \\ 0 & 0 & \mu _ { 3 2 } \end{bmatrix} \,, \quad M _ { 2 } \, = \, \begin{bmatrix} 0 & 0 \\ \mu _ { 2 1 } - \mu _ { 2 2 } & 0 \\ 0 & 0 \end{bmatrix} \\ \text{ositive constants} \, \{ \mu _ { i j } \colon i \in \mathbb { J }, j \in \mathfrak { J }, ( i, j ) \not \in \{ ( 1, 2 ), ( 3, 1 ) \} \}. \, \text{ We assume that } \gamma \,.$$

for some positive constants { µ ij : i ∈ I , j ∈ J , ( i, j ) / ∈ { (1 2) (3 1) , , , }} . We assume that γ 1 = γ 2 = 0 and γ 3 = 1, and 〈 e, ( M -1 1 ) T ˜ /lscript 〉 &gt; 0. By [19, Theorem 3.1], under any control v ∈ U sm with v 3 = 0 and v 5 = 1, { X t } t ≥ 0 is transient. On the other hand, Assumption 2.2 is satisfied for the constant control u c 3 = 1 and u s 2 = 1.

Example 3.2. (The 'V' model with service interruptions.) Equation (3.1) also describes the limiting jump diffusions of the 'V' model. Here I = 1 { , . . . , d } , J = 1 , and { }

where u takes values U = { u ∈ R d : 〈 e, u 〉 = 1 , and } M = diag( µ , 1 · · · , µ d ) is a positive diagonal matrix. Suppose that there exists a nonempty set I 0 ⊂ { 1 , · · · , d - } 1 such that γ i = 0 for i ∈ I 0 , and 〈 e, M -1 ˜ /lscript 〉 &gt; 0. In this case, [6, Theorem 3.3] asserts that { X t } t ≥ 0 is transient under any v ∈ U ssm satisfying Γv = 0. However, Assumption 2.1 is satisfied by [6, Remark 5.1], and, provided that γ i &gt; 0 for some i ∈ I , then Assumption 2.2 holds by [6, Theorem 3.5].

$$\text{sons on the } v \text{ } \text{ move. here } J = \{ 1, \dots, u _ { J }, \, \sigma = \{ 1 _ { J }, \, \text{ and } \\ b ( x, u ) \, = \, \ell - M \left ( x - \langle e, x \rangle ^ { + } u \right ) - \langle e, x \rangle ^ { + } \Gamma u \,, \\ \text{es } \mathbb { U } = \{ u \in \mathbb { R } ^ { d } \colon \langle e, u \rangle = 1 \}, \, \text{ and } M = \text{diag} ( \mu _ { 1 }, \cdots, \mu _ { d } ) \text{ is } \\ \text{$\vdots$} \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdot \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdclots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \collections }$$

Remark 3.2 . It is shown in [20] that the limiting diffusion of the 'V' model without service interruptions is uniformly ergodic over all stationary Markov controls, if either Γ &gt; 0, or the spare capacity -〈 e, M -1 /lscript 〉 is positive. This result has been extended to the limiting jump diffusion of the 'V' model with service interruptions in [21], with the difference that uniform ergodicity is over all stationary Markov controls resulting in a locally Lipschitz continuous drift. It is also shown in [19] that if the spare capacity is positive, then the limiting diffusion of the multiclass multi-pool networks with a dominant server pool (for example the 'N' and 'M' models), or class-dependent service rates, is uniformly exponentially ergodic over all stationary Markov controls. However, in general, multiclass multi-pool networks do not enjoy uniform ergodicity, but fall in the framework of Assumptions 2.1 and 2.2.

## 4. Existence of an optimal stationary Markov control

In this section we establish the existence of an optimal stationary Markov control by following a standard convex analytic argument. We adopt the relaxed control framework (see, e.g., [7, Section 2.3]), and extend the definitions of b and R accordingly, that is we let b v ( x ) = ∫ U b x, u ( ) v (d u | x ), where v x ( ) = v (d u | x ) is a measurable kernel on U given x , and analogously for R . Let µ v ∈ P ( R d ) denote the unique invariant probability measure of (2.1) under v ∈ U ssm . Define the corresponding ergodic occupation measure π v ∈ P ( R d × U ) by π v (d x, d u ) := µ v (d x v ) (d u | x ). The class of all ergodic occupation measures is denoted by G . Let C 2 0 ( R d ) denote the Banach space of functions f : R d → R that are twice continuously differentiable and their derivatives up to second order vanish at infinity, and C denote some fixed dense subset of C 2 0 ( R d ) consisting of functions with compact supports. Applying the Theorem in [22], it follows that π ∈ G if and only if

$$\int \lim e \text{erm in [2], in 100ows u a n \in \mathcal { Y } \int a n a n o n y \int \\ \int _ { \mathbb { R } ^ { d } } \mathcal { A } _ { u } f ( x ) \, \pi ( \mathrm d x, \mathrm d u ) \, = \, 0 \quad \forall \, f \in \mathcal { C } \,. \\ \mathcal { C } \, \colon \, \colon \, \colon \, \colon \, \colon \, \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \colon \end{array}$$

It is easy to show that G is a closed and convex subset of P ( R d × U ) (see, e.g., [7, Lemma 3.2.3]). Recall also the definition of empirical measures.

Definition 4.1. For U ∈ U and x ∈ R d , we define the mean empirical measures { ¯ ζ U x,t : t &gt; 0 , and } (random) empirical measures { ζ U t : t &gt; 0 } by and

$$( \text{rango} ) & \text{empirical measures } \{ \zeta _ { t } \, \colon \, \tau > 0 \} \, \text{by} \\ & \zeta _ { x, t } ^ { U } ( f ) & = \int _ { \mathbb { R } ^ { d } \times \mathbb { U } } f ( x, u ) \, \bar { \zeta } _ { x, t } ^ { U } ( \text{d} x, \text{d} u ) \, \colon = \, \frac { 1 } { t } \int _ { 0 } ^ { t } \mathbb { E } _ { x } ^ { U } \left [ \int _ { \mathbb { U } } f ( X _ { s }, u ) \, U _ { s } ( \text{d} u ) \right ] \text{d} s \,, \\ \text{and}$$

$$\zeta _ { t } ^ { U } ( f ) \, = \, \int _ { \underset { \mathbb { R } ^ { d } \times \mathbb { U } } { \mathbb { U } } } f ( x, u ) \, \mathrm d \zeta _ { t } ^ { U } ( \mathrm d x, \mathrm d u ) \, \coloneqq \, \frac { 1 } { t } \int _ { 0 } ^ { t } \int _ { \mathbb { U } } f ( X _ { s }, u ) \, U _ { s } ( \mathrm d u ) \, \mathrm d s \,,$$

respectively, for all f ∈ C b ( R d × U ).

$$& ( f ) \, = \, \int _ { \mathbb { R } ^ { d } \times \mathbb { U } } f ( x, u ) \, \mathrm d \zeta _ { t } ^ { U } ( \mathrm d x, \mathrm d u ) \, \coloneqq \, \frac { 1 } { t } \int _ { 0 } ^ { t } \int _ { \mathbb { U } } f ( X _ { s } \\ & 1 \, f \in \mathcal { C } _ { k } ( \mathbb { R } ^ { d } \times \mathbb { U } ).$$

Let R d denote the one-point compactification of R d . Then as shown in [3, Lemma 4.2], every limit ˆ ζ ∈ P ( R d × U ) of ζ Z x,t as t → ∞ takes the form ˆ = ζ δζ ′ +(1 -δ ζ ) ′′ for some δ ∈ [0 , 1], with ζ ′ ∈ G and ζ ′′ ( {∞}× U ) = 1 almost surely. The same claim holds for the mean empirical measures, without the qualifier 'almost surely'.

We borrow the technique introduced in [4]. Recall the function F and the set K in Assumption 2.1. First, define the set

We have

$$\mathcal { A } _ { u } \mathcal { V } _ { \circ } ( x, u ) & \leq \, 1 _ { \mathcal { B } _ { \circ } } ( x, u ) - F ( x, u ) \mathfrak { 1 } _ { \widetilde { \mathcal { K } } ^ { c } } ( x, u ) + \mathcal { R } ( x, u ) \mathfrak { 1 } _ { \widetilde { \mathcal { K } } } ( x, u ) \,, \quad \forall ( x, u ) \in \mathbb { R } ^ { d } \times \mathbb { U } \,. \quad \quad ( 4. 1 ) \\ \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \, \cdot \end{cases}$$

$$r s t, \, \text{define set} \\ \widetilde { \mathcal { K } } \coloneqq ( \mathcal { K } \times \mathbb { U } ) \cup \left \{ ( x, u ) \in \mathbb { R } ^ { d } \times \mathbb { U } \, \colon \mathcal { R } ( x, u ) > F ( x, u ) \right \}. \\ \\ x, u ) \, < \, 1 _ { \mathcal { R } _ { c } } ( x, u ) - F ( x, u ) 1 _ { \widetilde { \mathcal { V } } _ { c } } ( x, u ) + \mathcal { R } ( x, u ) 1 _ { \widetilde { \mathcal { V } } } ( x, u ) \,, \quad \forall ( x, u ) \in \mathbb { R } ^ { d } \times \mathbb { U }$$

As shown in [4, Lemma 3.3], there exists a coercive function ˜ F ∈ C ( R d × U ), which is locally Lipschitz in its first argument, and satisfies

R ≤ ˜ F ≤ ˜ κ ( 1 B ◦ + R 1 ˜ K + F 1 ˜ K c ) (4.2) for some positive constant ˜ κ ≥ 1. Here again we select the same ball B ◦ as in Assumption 2.1 for convenience. This can always be accomplished by adjusting the constant ˜. κ

Define the perturbed running cost R /epsilon1 := R + /epsilon1F ˜ . Since R /epsilon1 is coercive for /epsilon1 &gt; 0, the results of [3] are applicable for the ergodic control problem with the perturbed running cost. At the same time, it follows from (4.1) and (4.2) and the argument in the proof of [4, Theorem 3.1], that if a control U ∈ U is stabilizing for R , then it is also stabilizing for R /epsilon1 for any /epsilon1 &gt; 0.

Theorem 4.1. Grant Assumption 2.1 . Then every stabilizing stationary Markov control is in U ssm . In addition, if the stabilizability hypothesis in (2.10) is met, then there exists a stationary Markov control which is optimal for the ergodic control problem, and /rho1 ∗ is a constant.

Proof. By Assumption 2.1, we have ˜ I V ◦ ∈ L ∞ loc ( R d ), and thus, applying Itˆ's formula and Fatou's o lemma to (4.1), it follows by (4.2) that

$$& \text{lemma to } ( 4. 1 ), \text{it follows by } ( 4. 2 ) \text{ that } \\ & \bar { \zeta } _ { x, t } ^ { U } ( \mathcal { R } ^ { \epsilon } ) \, \leq \, \bar { \zeta } _ { x, t } ^ { U } ( \mathcal { R } ) + \epsilon \tilde { \kappa } \left ( 1 + \frac { 1 } { t } \mathcal { V } _ { \circ } ( x ) + 2 \bar { \zeta } _ { x, t } ^ { U } ( \mathcal { R } ) \right ) \quad \forall \, ( x, t ) \in \mathbb { R } ^ { d } \times ( 0, \infty ) \,, \, \forall \, U \in \mathfrak { U } \,. \quad ( 4. 3 ) \\ & \text{Since hv } ( 4 \, 3 ) \, \text{we have }$$

Since by (4.3) we have

$$\pi _ { v } ( \mathcal { R } ^ { \epsilon } ) \, \leq \, \varrho _ { v } + \epsilon \tilde { \kappa } ( 1 + 2 \varrho _ { v } ) & & ( 4. 4 ) \\ \text{array Markov control } \pi _ { v } \, \text{raw how you } \pi _ { v } ( \mathcal { P } ) \, \prec \, \sim \, \text{and the first accentation follow}$$

for any stabilizing stationary Markov control v , we have π v ( R ) &lt; ∞ , and the first assertion follows. Define /rho1 /epsilon1 U and /rho1 /epsilon1 ∗ as in (2.6) and (2.7), respectively, by replacing R with R /epsilon1 . Let ˆ /rho1 /epsilon1 ∗ := inf π ∈ G π ( R /epsilon1 ), and ˆ /rho1 ∗ := inf π ∈ G π ( R ). Since R /epsilon1 is coercive for any /epsilon1 ∈ (0 1), we have , ˆ /rho1 /epsilon1 ∗ = π v /epsilon1 ∗ ( R /epsilon1 ) for some v /epsilon1 ∗ ∈ U ssm by [7, Theorem 3.4.5], and ˆ /rho1 /epsilon1 ∗ = /rho1 /epsilon1 ∗ by Lemma 4.2 in [3] and the proof of [7, Theorem 3.4.7]. Hence, by (4.3), which implies that /rho1 /epsilon1 U ≤ /rho1 U + ˜(1 + 2 /epsilon1κ /rho1 U ), and the above definitions we have

$$\varrho _ { * } \, \leq \, \hat { \varrho } _ { * } \, \leq \, \hat { \varrho } _ { * } ^ { \epsilon } \, = \, \varrho _ { * } ^ { \epsilon } \, \leq \, \varrho _ { * } + \epsilon \tilde { \kappa } ( 1 + 2 \varrho _ { * } ) \quad \forall \, \epsilon \in ( 0, 1 ) \,.$$

This shows that /rho1 ∗ = ˆ . It remains to show that /rho1 ∗ /rho1 ∗ = π v ∗ ( R ) for some v ∗ ∈ U ssm . But this follows by using the technique in the proof of [7, Theorem 3.4.5]. This completes the proof. /square

## 5. The HJB equations

In this section, we study the α -discounted and ergodic HJB equations for the jump diffusion defined in (2.1). For the α -discounted control problem, it is rather standard to establish the existence of solutions and the characterization of optimal controls (see Theorem 5.1 below for details). We consider the Dirichlet problem on B R for the α -discounted problem with running cost R /epsilon1 . From [1, Chap. 3, Theorem 2.3 and Remark 2.3], there exists a unique solution ψ /epsilon1 α,R ∈ W 2 ,p ( B R ) ∩ W 1 ,p 0 ( B R ) to the (homogeneous) Dirichlet problem

For the Dirichlet problem with a linear integro-differential operator, existence and uniqueness of a solution are also asserted in [23, Theorem 3.1.22]. Meanwhile, for a bounded running cost function [2, (1.26)] and under the blanket stability assumption in [2, (1.6)], HJB equations on the whole space are established in [2, Remark 3.3 and Theorem 4.1]. It is clear that these assumptions are not met for multiclass stochastic networks in the Halfin-Whitt regime. For example, in (3.3), the running cost function penalizing the queueing and idleness is unbounded, and the drift in (3.1) does not satisfy [2, (1.6)].

$$W ^ { * } \nu ( B _ { R } ) \, | \, | \, W _ { 0 } ^ { * } \, ( B _ { R } ) \, \text{ to the (nomogeneous)} \, \text{Diriclet problem} \\ \min _ { u \in \mathcal { U } } \left [ \mathcal { A } _ { u } \psi ^ { \epsilon } _ { \alpha, R } + \mathcal { R } ^ { \epsilon } ( \cdot, u ) \right ] \, = \alpha \psi ^ { \epsilon } _ { \alpha, R } \, \text{ in } B _ { R } \,, \text{ \ and \ } \psi ^ { \epsilon } _ { \alpha, R } = 0 \, \text{ in } B ^ { c } _ { R } \cdot \quad \text{ (5.1)} \\ \text{For the Dirichlet problem with a linear integro-differential operator, existence and uniqueness of} \, a \,. \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdot \quad \cdots$$

Theorem 5.1. Grant Assumptions 2.1 and 2.2 . Then for any α ∈ (0 1) , and /epsilon1 ∈ [0 , κ ˜ -1 ) , the function ψ /epsilon1 α,R in (5.1) converges uniformly on compacta to a function V /epsilon1 α ∈ W 2 ,p loc ( R d ) for any p &gt; 1 , which is the minimal nonnegative solution of the HJB equation and has the stochastic representation

$$\colon & h \, \text{$is the minimal nonnegative solution of the $HJB$ equation} \\ & \min _ { u \in \mathbb { U } } \left [ \mathcal { A } _ { u } V _ { \alpha } ^ { \epsilon } ( x ) + \mathcal { R } ^ { \epsilon } ( x, u ) \right ] \, = \, \alpha V _ { \alpha } ^ { \epsilon } ( x ) \quad a. e. \, \text{in} \, \mathbb { R } ^ { d } \,, & \\ \intertext { s stochastic representation}$$

$$\underset { \substack { \text{theastic representation} \\ V _ { \alpha } ^ { \epsilon } } } ( x ) \, = \, \inf _ { U \in \mathfrak { U } } \mathbb { E } _ { x } ^ { U } \left [ \int _ { 0 } ^ { \infty } \mathbb { e } ^ { - \alpha t } \mathcal { R } ^ { \epsilon } ( X _ { t }, U _ { t } ) \, \mathrm d t \right ] \,. \, \\ \text{ontrol} \, v \in \mathfrak { U } _ { \mathfrak { W } } \, \text{ is an optimal that is. it atttains the infinityum in } ( 5. 3 ) \,. \, \text{ if and only if it}$$

In addition, a control v ∈ U sm is optimal, that is, it attains the infimum in (5.3) , if and only if it is an a.e. measurable selector from the minimizer of (5.2) .

Proof. Under Assumption 2.2, the proof for the existence of a minimal nonnegative solution V /epsilon1 α ∈ W 2 ,p loc ( R d ) is exactly same as in [3, Theorem 3.2]. A straightforward application of the comparison principle shows that the following bound holds

$$V _ { \alpha } ^ { \epsilon } ( x ) \, \leq \frac { 3 \hat { \kappa } + 2 } { \alpha } + \mathcal { V } _ { \circ } ( x ) + 3 \mathcal { V } ( x ) \quad \forall x \in \mathbb { R } ^ { d } \,, \, \forall \alpha \in ( 0, 1 ) \,, \, \forall \epsilon \in [ 0, \tilde { \kappa } ^ { - 1 } ) \,. \quad \quad ( 5. 4 )$$

From (5.4), we have ˜ I V /epsilon1 α ∈ L ∞ loc ( R d ). Thus using the Itˆ's formula in (2.5), the stochastic represeno tation and the sufficiency part of the verification of optimality are established in a standard manner (see, e.g., [7, Theorem 3.5.6 and Remark 3.5.8]). On the other hand, for any v ∈ U sm , the resolvent of the controlled diffusion defined in (2.2) has a positive density with respect to the Lebesgue measure by [7, Theorem A.3.5]. Since the L´vy measure e ν is finite, then applying [24, Lemma 2.1], we see that the same holds for the resolvent of the jump diffusion in (2.1). Thus, we may repeat the argument in [7, Theorem 3.5.6] to establish the necessity part of the verification of optimality. This completes the proof. /square

We proceed to derive the HJB equation on the ergodic control problem by using the vanishing discount method. The technique used has some important differences from [3], since here the running cost is not near-monotone when /epsilon1 = 0. To overcome this difficulty, we derive lower and upper bounds for V /epsilon1 α in the lemma which follows.

Lemma 5.1. Grant the hypotheses in Assumptions 2.1 and 2.2 . For any δ ∈ (0 , 1 2 ] , there exists ˜ = r r δ ( ) &gt; 0 such that

$$V _ { \alpha } ^ { \epsilon } \, \geq \, \inf _ { B _ { r } } V _ { \alpha } ^ { \epsilon } - \delta V _ { \circ } \quad o n \, B _ { r } ^ { c } \,, \quad \forall \, r > \tilde { r } \,,$$

for all α ∈ (0 1) , and /epsilon1 ∈ [0 , κ ˜ -1 ) . Moreover, there exists r ◦ &gt; 0 such that

$$V _ { \alpha } ^ { \epsilon } \, \leq \, \sup _ { B _ { r _ { \circ } } } V _ { \alpha } ^ { \epsilon } + \mathcal { V } _ { \circ } + 3 \mathcal { V } \quad \text{ on } \mathbb { R } ^ { d },$$

for all α ∈ (0 1) , and /epsilon1 ∈ [0 , κ ˜ -1 ) .

Proof. Let v ∗ be an optimal control in U ssm . Its existence has been asserted in Theorem 4.1. Recall that µ v ∗ denotes the invariant probability measure under v ∗ . Using (5.3), Fubini's theorem, and (4.4), we obtain for any r &gt; 0. Fix some r ◦ &gt; 0 such that B r ◦ ⊃ B ◦ . Then

$$\mu _ { v _ { * } } ( B _ { r } ) & \left ( \inf _ { B _ { r } } \alpha V _ { \alpha } ^ { \epsilon } \right ) \, \leq \, \varrho _ { * } \, \leq \, \varrho _ { * } + \epsilon \tilde { \kappa } ( 1 + 2 \varrho _ { * } ) \\ \text{some } r _ { \circ } > 0 \text{ such that } B _ { r _ { \circ } } & \supset \mathcal { B } _ { \circ }. \text{ Then}$$

$$\inf _ { B _ { r } } \alpha V _ { \alpha } ^ { \epsilon } \, \leq \, \frac { \epsilon \tilde { \kappa } + ( 1 + 2 \epsilon \tilde { \kappa } ) \varrho _ { * } } { \mu _ { v _ { * } } ( B _ { r } ) } \, \leq \, \frac { \varrho _ { * } } { \mu _ { v _ { * } } ( B _ { r _ { 0 } } ) } \,,$$

for all r &gt; r ◦ , α ∈ (0 1), and , /epsilon1 ∈ [0 , κ ˜ -1 ).

We first establish a lower bound of V /epsilon1 α . Let ψ /epsilon1 α,R satisfy (5.1), and ˆ v R ∈ U be a measurable selector from its minimizer, that is, it satisfies

$$\mathcal { A } _ { \hat { v } _ { R } } \psi _ { \alpha, R } ^ { \epsilon } - \alpha \psi _ { \alpha, R } ^ { \epsilon } \, = \, - \mathcal { R } _ { \hat { v } _ { R } } ^ { \epsilon } \quad \text{ on } B _ { R } \,. \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \ \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \end{cases}$$

Let δ ∈ ( 0 , 1 2 ] be arbitrary. By (5.7), and the coerciveness of ˜ F in (4.2), there exists ˜ = ˜( r r δ ) &gt; r ◦ such that

Let

$$\phi _ { \alpha, R } ^ { \epsilon } \, \coloneqq \, \delta \mathcal { V } _ { \circ } + \psi _ { \alpha, R } ^ { \epsilon } - \inf _ { B _ { \bar { F } } } \, \psi _ { \alpha, R } ^ { \epsilon } \,.$$

$$\inf _ { \tilde { R } } \alpha \psi _ { \alpha, R } ^ { \epsilon } \leq \delta \tilde { \kappa } ^ { - 1 } \widetilde { F } _ { \tilde { v } _ { R } } ( x ) & \text{ for all } x \in B _ { \tilde { r } } ^ { c }, \, R \geq \tilde { r } \,, \, \alpha \in ( 0, 1 ) \,, \text{ and } \epsilon \in [ 0, \tilde { \kappa } ^ { - 1 } ) \,. \quad \quad ( 5. 9 ) \\ \text{Let} & & \text{$\mathcal{A}^{\epsilon}_{\mathcal{ } } \dashrightarrow \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{                                                                                                                                                                                                        
\mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ }\mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{  \mathcal { } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{\ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal { } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{     } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal\mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ \quad \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{} \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{
\mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{\ }\mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{\} \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{ } \mathcal{\}$$

By (4.1), (4.2), (5.8), and (5.9), we have

$$\mathcal { A } \phi _ { \alpha, R } ^ { \ell } - \alpha \phi _ { \alpha, R } ^ { \ell } & \leq \inf _ { B _ { \tilde { r } } } \alpha \psi _ { \alpha, R } ^ { \ell } - \delta F _ { \tilde { v } _ { R } } \mathbb { 1 } _ { \widetilde { \mathcal { K } } ^ { c } } - ( 1 - \delta ) \mathbb { R } _ { \tilde { v } _ { R } } \mathbb { 1 } _ { \widetilde { \mathcal { K } } } \\ & \leq \inf _ { B _ { \tilde { r } } } \alpha \psi _ { \alpha, R } ^ { \ell } - \delta \widetilde { \kappa } ^ { - 1 } \widetilde { F } _ { \tilde { v } _ { R } } \\ & \leq 0 \quad \text{on } B _ { R } \, \bigotimes \, B _ { \tilde { r } } \,, \text{ for all } R \geq \tilde { r } \,. \\ _ { \alpha, R } ^ { \epsilon } \text{ converges monotonically to } V _ { \alpha } ^ { \epsilon } \, \text{as } R \to \infty \, \text{ and } \mathcal { V } _ { \alpha } \, \text{is coercive, there exists } R _ { 0 } = R _ { 0 } ( \delta, \alpha ) >$$

Since ψ /epsilon1 α,R converges monotonically to V /epsilon1 α as R →∞ and V ◦ is coercive, there exists R 0 = R 0 ( δ, α ) &gt; ˜ such that r

$$\inf _ { B _ { \bar { r } } } \psi _ { \alpha, R } ^ { \epsilon } \, \leq \, \delta \mathcal { V } _ { \circ } ( x ) \quad \forall \, x \in B _ { R } \, \sum B _ { R _ { 0 } } \,, \, R > R _ { 0 } \,.$$

Thus, since φ /epsilon1 α,R ≥ 0 on B ˜ r by (5.10), and φ /epsilon1 α,R ≥ 0 on B R \ B R 0 by (5.12), it follows that φ /epsilon1 α,R ≥ 0 on R d for all R &gt; R 0 by (5.11) and the strong maximum principle. Taking limits as R → ∞ in (5.10), we obtain

$$V _ { \alpha } ^ { \epsilon } \, \geq \, \inf _ { B _ { \tilde { r } } } \, V _ { \alpha } ^ { \epsilon } - \delta \mathcal { V } _ { \circ } \quad \text{on } B _ { \tilde { r } } ^ { c } \,,$$

which establishes (5.5).

Next we prove the upper bound. For ˆ in Assumption 2.2, we have v

$$\Phi _ { \Phi } ^ { \Phi } ( - \psi _ { \alpha, R } ^ { \epsilon } ) - \alpha ( - \psi _ { \alpha, R } ^ { \epsilon } ) \, \leq \, \mathcal { R } _ { \Phi } + \epsilon \widetilde { F } _ { \Phi } \quad \text{ on } B _ { R } \,.$$

Recall that B r ◦ ⊃ B ◦ , and select any balls D 1 and D 2 , such that B r ◦ /subsetdbl D 1 /subsetdbl D 2 . By (4.1), (4.2), (5.8), and (5.13), the function

$$\hat { \phi } ^ { \epsilon } _ { \alpha, R } \, \coloneqq \, \sup _ { B _ { r _ { \circ } } } \, \psi ^ { \epsilon } _ { \alpha, R } - \psi ^ { \epsilon } _ { \alpha, R } + \mathcal { V } _ { \circ } + 3 \mathcal { V }$$

satisfies

$$\mathcal { A } _ { \hat { v } } \hat { \phi } _ { \alpha, R } ^ { \epsilon } - \alpha \hat { \phi } _ { \alpha, R } ^ { \epsilon } \, \leq \, - \sup _ { B _ { r _ { 0 } } } \, \psi _ { \alpha, R } ^ { \epsilon } \, \leq \, 0 \quad \text{on } B _ { R } \, \sum B _ { r _ { 0 } } \,,$$

for all α ∈ (0 1) and , /epsilon1 ∈ [0 , κ ˜ -1 ). It is evident that ˆ ϕ /epsilon1 α,R ≥ 0 on B r ◦ ∪ B c R . Thus, employing the strong maximum principle, we obtain

$$\psi ^ { \epsilon } _ { \alpha, R } \, \leq \, \sup _ { B _ { r _ { \circ } } } \psi ^ { \epsilon } _ { \alpha, R } + \mathcal { V } _ { \circ } + 3 \mathcal { V } \quad \text{ on } \mathbb { R } ^ { d } \,,$$

for all α ∈ (0 1) and , /epsilon1 ∈ [0 , κ ˜ -1 ). Letting R → ∞ in (5.14), we obtain (5.6). This completes the proof. /square

We also need the following estimate. Its proof combines the technique in the proof of [3, Theorem 3.3] with Lemma 5.1.

Lemma 5.2. Grant the hypotheses in Assumptions 2.1 and 2.2 . For each R &gt; 0 , there exists a constant κ R such that

$$\underset { B _ { R } } { \text{osc} } \, V _ { \alpha } ^ { \epsilon } \, \leq \, \kappa _ { R }$$

for all α ∈ (0 1) , and /epsilon1 ∈ [0 , κ ˜ -1 ) .

Proof. We choose B r ◦ , D 1 , and D 2 as in the proof of Lemma 5.1. By (2.9) and (4.1), it is evident that ˜ I ( V ◦ +3 ) V ∈ L ∞ loc ( R d ). Let ˆ x /epsilon1 α ∈ Argmin ¯ D 2 V /epsilon1 α . The function ϕ /epsilon1 α := V /epsilon1 α -V /epsilon1 α (ˆ x /epsilon1 α ) satisfies where the inequality follows by (5.7). Using (5.6), we obtain

$$\cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdot \\ \min _ { u \in \mathbb { U } } \left [ \mathcal { A } _ { u } \varphi _ { \alpha } ^ { \epsilon } ( x ) - \alpha \varphi _ { \alpha } ^ { \epsilon } ( x ) + \mathcal { R } ^ { \epsilon } ( x, u ) \right ] \, = \, \alpha V _ { \alpha } ^ { \epsilon } ( \hat { x } _ { \alpha } ^ { \epsilon } ) \, \leq \, \frac { \varrho _ { * } } { \mu _ { v _ { * } } ( B _ { r _ { \circ } } ) } \,, \\ \text{the inequality follows by (5.7). Using (5.6), we obtain}$$

$$\text{nequality follows by} \, ( 0. i ) \, & \text{ Using$$

α ∈ (0 1) and , /epsilon1 ∈ [0 , κ ˜ -1 ). Let v /epsilon1 α be a measurable selector from the minimizer of the α -discounted problem associated with R /epsilon1 . By the local maximum principle [25, Theorem 9.20], for any p &gt; 0, there exists a constant ˜ ( C 1 p ) &gt; 0 such that

$$s a \text{ constant } \mathcal { C } _ { 1 } ( p ) > \$$

$$\mathbb { m } { 2 } & > \mathfrak { U } \, \text$$

with ‖ ϕ /epsilon1 α ‖ p D ; 1 := (∫ D 1 | ϕ /epsilon1 α ( x ) d | x ) 1 / p , and by the supersolution estimate [25, Theorem 9.22], there exist some p &gt; 0 and ˜ C 2 &gt; 0 such that

On the other hand, the inequality in (5.5) implies that inf D 1 ϕ /epsilon1 α ≤ sup D 2 V ◦ . Combining these estimates, we obtain where

$$\begin{array} {$$

$$\kappa _ { 2 } \coloneqq \tilde { C } _ { 1 } ($$

By (5.15) and (5.16), we have

$$\begin{array} { c c c }. &. \\ \sup _ { D _ { 2 } } \varphi _ { \alpha } ^ { \epsilon } \, \leq \, \kappa _ { 2 } + \| \mathcal { V } _ { \circ } + 3 \mathcal { V } \| _ { L ^ { \infty } ( D _ { 2 } ) } + \tilde { C } _ { 1 } ( p ) \, \| \widetilde { \mathcal { I } } \varphi _ { \alpha } ^ { \epsilon } \| _ { L ^ { d } ( D _ { 1 } ) } \,. \\ r \sup _ { D _ { 2 } } \varphi _ { \alpha } ^ { \epsilon } \, \leq \, 2 \kappa _ { 2 } + 2 \| \mathcal { V } _ { \circ } + 3 \mathcal { V } \| _ { L ^ { \infty } ( D _ { 2 } ) }, \, \text{which directly implies } ( 5. 7 ), \, \text{or} \\. \end{array}$$

Hence, either sup D 2 ϕ /epsilon1 α ≤ 2 κ 2 +2 ‖ V ◦ +3 V ‖ L ∞ ( D 2 ) , which directly implies (5.7), or

Suppose that (5.17) is the case. By (5.15), we have the estimate

$$\sup _ { D _ { 2 } } \varphi _ { \alpha } ^ { \epsilon } \leq 2 \tilde { C } _ { 1 } ( p ) \| \widetilde { \mathcal { I } } \varphi _ { \alpha } ^ { \epsilon } \| _ { L ^ { d } ( D _ { 1 } ) }. & & ( 5. 1 7 ) \\ \text{the case. By } ( 5. 1 5 ), \, \text{we have the estimate} \\ &, &$$

Thus, by (5.16)-(5.18), we obtain

$$\text{Suppose that $(5.17)$ is the case. By $(5.15), we have the estimate} \\ \widetilde { \mathcal { I } } ( 1 _ { D _ { 2 } ^ { c } } \varphi _ { \alpha } ^ { \epsilon } ) ( x ) \, \leq \, \left ( \sup _ { B _ { r _ { 0 } } } \varphi _ { \alpha } ^ { \epsilon } \right ) \nu ( D _ { 2 } ^ { c } ) + \widetilde { \mathcal { I } } ( 1 _ { D _ { 2 } ^ { c } } ( \mathcal { V } _ { 0 } + 3 \mathcal { V } ) ) ( x ) \quad \forall x \in D _ { 1 } \,. \quad \, & \\ \text{Thus, by $(5.16)$} ) - ( 5. 1 8 ), \, \text{we obtain} \\ \simeq \,. \quad \, & \, \simeq \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,. \,.$$

Again we distinguish two cases. If

$$\text{ thus, by (b. 16)} - ( b. 18 ), \, \text{ we obtain} \\ \sup _ { D _ { 1 } } \widetilde { \mathcal { I } } \varphi _ { \alpha } ^ { \epsilon } \, \leq \, \kappa _ { 2 } \nu + 3 \tilde { C } _ { 1 } ( p ) \nu \, \| \widetilde { \mathcal { I } } \varphi _ { \alpha } ^ { \epsilon } \| _ { L ^ { d } ( D _ { 1 } ) } + \| \widetilde { \mathcal { I } } \left ( 1 _ { D _ { 2 } ^ { c } } ( \mathcal { V } _ { o } + 3 \mathcal { V } ) \right ) \| _ { L ^ { \infty } ( D _ { 1 } ) } \,. \\ \text{gain we distinguish two cases. If} \\ \approx \, \epsilon \, \cdots \widetilde { \sim } \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \,.$$

then the proof is the same as in [3, Theorem 3.3]. It remains to consider the case

$$\sup _ { D _ { 1 } } \widetilde { \mathcal { I } } \varphi _ { \alpha } ^ { \epsilon } \, \leq \, 6 \widetilde { C } _ { 1 } ( p ) \nu \, \| \widetilde { \mathcal { I } } \varphi _ { \alpha } ^ { \epsilon } \| _ { L ^ { d } ( D _ { 1 } ) } \,, \\ \sim \, & \, \text{$2$} \, \text{$3$}. \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \, \text{$1$} \quad.$$

Let ˜ φ /epsilon1 α be the solution of the Dirichlet problem

$$\text{ot is the same as in } [ \mathfrak { s }, \, I \text{heorem } \mathfrak { s }. \mathfrak { s } ]. \, \text{It remains to consider the case} \\ \sup _ { D _ { 1 } } \widetilde { \mathcal { I } } \varphi _ { \alpha } ^ { \epsilon } \leq 2 \kappa _ { 2 } \nu + 2 \| \widetilde { \mathcal { I } } ( 1 _ { D _ { 2 } ^ { \epsilon } } ( \mathcal { V } _ { \circ } + 3 \mathcal { V } ) ) \| _ { L ^ { \infty } ( D _ { 1 } ) } \,. \quad \quad ( 5. 1 9 ) \\ \text{e solution of the Dirichlet problem} \\ \quad \,. \, \, \,$$

$$\widetilde { \mathcal { L } } _ { v _ { \alpha } ^ { \epsilon } } \tilde { \phi } _ { \alpha } ^ { \epsilon } - \alpha \tilde { \phi } _ { \alpha } ^ { \epsilon } = 0 \quad \text{ in } D _ { 1 } \quad \text{and } \quad \tilde { \phi } _ { \alpha } ^ { \epsilon } = \varphi _ { \alpha } ^ { \epsilon } \quad \text{on } \partial D _ { 1 } \,. \\ \text{k's inequality, we have } \tilde { \phi } _ { \alpha } ^ { \epsilon } \leq \tilde { C } _ { H } \tilde { \phi } _ { \alpha } ^ { \epsilon } ( \hat { x } _ { \alpha } ^ { \epsil$$

By Harnack's inequality, we have ˜ φ /epsilon1 α ≤ ˜ C H ˜ φ /epsilon1 α (ˆ x /epsilon1 α ) for all x ∈ B r ◦ , α ∈ (0 1), and , /epsilon1 ∈ [0 , κ ˜ -1 ). Thus

$$D _ { 1 },$$

and ϕ /epsilon1 α -˜ φ /epsilon1 α = 0 on ∂D 1 . On the other hand, we have

$$\int _ { \mu \colon \alpha \colon \alpha \colon \mu \colon \alpha \colon \mu \colon \alpha \colon \alpha \colon \alpha \colon \mu \colon \alpha \colon \alpha \colon \alpha \colon \mu \colon \alpha \colon \alpha \colon \alpha \colon \mu \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \colon \alpha \$$

Using (5.5), we obtain

$$\inf _ { D _ { 1 } } \widetilde { \mathcal { I } } \varphi _ { \alpha } ^ { \epsilon } \geq - \sup _ { D _ { 1 } } \widetilde { \mathcal { I } } \mathcal { V } _ { \circ } \,. \quad & ( 5. 2 1 ) \\ \text{ving the ABP weak maximum principle in [25, Theorem 9.1] to (5.20),} \\ \cdots \, \dots \, \left \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \right \| \epsilon \$$

$$\i a _ { \ } \gamma _ { \alpha } \quad \gamma _ { \alpha } - \nu \, \min \, \nu \, \iota _ { 1 }. \ \min \, \min \, \max \, \max \, \\ \widetilde { \mathcal { L } } _ { \nu _ { \alpha } ^ { \epsilon } } ( \tilde { \phi } _ { \alpha } ^ { \epsilon } - \varphi _ { \alpha } ^ { \epsilon } ) - \alpha ( \tilde$$

Since ˜ I V ◦ ∈ L ∞ loc ( R d ), applying the ABP weak maximum principle in [25, Theorem 9.1] to (5.20), and using (5.19) and (5.21), we obtain ‖ ϕ /epsilon1 α -˜ φ /epsilon1 α ‖ L ∞ ( D 1 ) ≤ ˜ C 0 for some constant ˜ C 0 which does not depend on α ∈ (0 1) , and /epsilon1 ∈ [0 , κ ˜ -1 ). Thus, employing [26, Corollary 2.2] as done in [3, Theorem 3.3], we establish (5.7). This completes the proof. /square

In Theorem 5.2 which follows, we derive the HJB equation for the ergodic control problem, and the corresponding characterization of optimal Markov controls. Compared to [3, Theorem 4.5], the important difference here is that the solutions to the HJB equation may not be bounded from below in R d , since the running cost function is not near-monotone. As a consequence, [7, Lemma 3.6.9] cannot be applied here directly to establish the stochastic representation of the solutions, and prove uniqueness. We let V α := V /epsilon1 α /epsilon1 ∣ ∣ =0 . Theorem 5.2. Grant Assumptions 2.1 and 2.2 . Then

- ( a ) As α ↘ 0 , ˜ V α := V α -V α (0) converges in C 1 ,ρ with ρ ∈ (0 1) , , uniformly on compact sets, to a function V ∗ ∈ W 2 ,p loc ( R d ) for any p &gt; 1 , which satisfies V -∗ ∈ o ( V ◦ ) , and
- ( b ) A control v ∈ U ssm is optimal for the ergodic control problem with R if and only if it is an a.e. measurable selector from the minimizer in (5.22) .

$$\ n c t i o n \, v _ { * } \in \ V v _ { l o c } ^ { \ast } ( \mathbb { R } ^ { \ast } ) \text{ for any } p > 1, \, \text{with some serious yes } v _ { * } \in \vartheta ( v _ { \circ } ), \, a n a \\ \min _ { u \in \mathbb { U } } \left [ \mathcal { A } _ { u } V _ { * } ( x ) + \mathcal { R } ( x, u )$$

- ( c ) Let ˜ U ssm := { v ∈ U ssm : /rho1 v &lt; ∞} . The function V ∗ is the unique solution (up to an additive constant) to the equation min u ∈ U [ A u V ∗ ( x ) + R ( x, u )] = /rho1 a.e. on R d , with /rho1 ≤ /rho1 ∗ , which satisfies V -∗ ∈ o ( V ◦ ) and V ∗ (0) = 0 . In addition, it has the stochastic representation

Proof. We first prove (a). By (5.2), we have

$$\ h e s { \ V _ { * } } ^ { - } \in \mathfrak { o } ( V _ { \circ } ) \ a n d \ V _ { * } ( U ) = U. \ I n \ a d d t i o n, \, t h a s \, \text{ the stochastic representation} \\ V _ { * } ( x ) \, = \, \lim _ { r \searrow 0 } \inf _ { v \in \tilde { \mathfrak { I } } _ { \text{ssm} } } \, \mathbb {$$

$$\text{We hrst prove (a). By (5.2), we have} \\ \min _ { u \in \mathbb { U } } \left [ \mathcal { A } _ { u } \widetilde { V } _ { \alpha } ( x ) + \mathcal { R } ( x, u ) \right ] = \alpha \widetilde { V } _ { \alpha } ( x ) + \alpha V _ { \alpha } ( 0 ) \quad \text{a.e. in } \mathbb { R } ^ { d }. \quad \quad \quad$$

The limit lim α ↘ 0 αV α (0) = /rho1 ∗ follows as in the proof of Theorem 3.6 in [4] using Lemma 5.2. We fix an arbitrary ball B , and using (5.5) and (5.6), we obtain

| ˜ V α ( x ) | ≤ ‖ ˜ V α ‖ L ∞ ( B ) + V ◦ ( x ) + 3 V ( x ) ∀ x ∈ R d . (5.25) By (2.9), (4.1), and (5.25), we have ˜ ˜ I| V α | ∈ L ∞ loc ( R d ). Let v α be a measurable selector for the minimizer of (5.24). Then, applying the interior estimate in [25, Theorem 9.11], we obtain where C ≡ C R,p ( ). Hence, sup α ∈ (0 1) , ‖ ˜ V α ‖ W 2 ,p ( B R ) &lt; ∞ . Thus, following a standard argument (see [7, Lemma 3.5.4]), for any sequence α n ↘ 0, the functions { ˜ V α n } converge along a subsequence in C 1 ,ρ with ρ ∈ (0 1), uniformly on compact sets, to , V ∗ . Since R is arbitrary, this proves (5.22). Letting α ↘ 0 in (5.5), which holds for all δ &gt; 0, with ˜ depending only on r δ , we obtain (with /epsilon1 = 0)

$$\limizer of ( 5. 2 4 ). \text{ Then, applying the interior estimate in [25, Theorem 9.11], we obtain} \\ \| \widetilde { V } _ { \alpha } \| _ { W ^ { 2, p } ( B _ { R } ) } \leq C \left ( \| \widetilde { V } _ { \alpha } \| _ { L ^ { p } ( B _ { 2 R } ) } + \| \alpha V _ { \alpha } ( 0 ) - \mathcal { R } _ { v _ { \alpha } } -$$

$$V _ { * } ^ { - } \in \mathfrak { o } ( \mathcal { V } _ { \circ } ) \,. & & ( 5. 2 6 ) \\ \omega & \text{ follows } h v \, [ 3 \text{ Theorem } 3 \, 5 ] \text{ Sufficiency allows exactly as in the}$$

Concerning part (b), necessity follows by [3, Theorem 3.5]. Sufficiency follows exactly as in the proof of [4, Theorem 3.4 (b)] using (5.26) and part (a).

It remains to establish uniqueness and the stochastic representation as stated in part (c). By (5.25), we also have ˜ I V ∗ ∈ L ∞ loc ( R d ). Following the same arguments as in [7, Lemma 3.6.9], we have

On the other hand, applying Itˆ's formula, we obtain o

$$\text{so} \, \Lambda \, v _ { * } \in \Lambda _ { \text{loc} } ^ { \dagger } ( \mathfrak { R } ^ { - } ). \text{ following} \, \text{ use} \, \text{gamems} \, \text{as} \, \text{in} \, [ \mathfrak { r }, \text{Lemma} \, \mathfrak { 0 } ], \, \text{we} \, \text{have} \\ V _ { * } ( x ) \, \leq \, \liminf _ { \mathfrak { r } \times 0 } \, \inf _ { \mathfrak { v } \in \mathfrak { U } _ { \text{ssm} } } \, \mathbb { E } _ { x } ^ { v } \left [ \int _ { 0 } ^ { \dagger _ { r } } ( \mathcal { R } _ { v } ( X _ { s } ) - \varrho _ { * } ) \, d s \right ]. \\ \text{er hand.} \, \text{applying} \, \text{It} \hat { \circ } ^ { \prime } s \, \text{formula}. \, \text{we obtain}$$

$$\text{other hand, applying It} \dot { o } ^ { \prime } & s \text{ formula, we obtain} \\ V _ { * } ( x ) & = \mathbb { E } _ { x } ^ { v _ { 0 } } \left [ \int _ { 0 } ^ { \check { \tau } _ { r } \wedge \tau _ { R } } \left ( \mathcal { R } _ { v _ { 0 } } ( X _ { s } ) - \varrho _ { * } \right ) d s + V _ { * } ( X _ { \check { \tau } _ { r } \wedge \tau _ { R } } ) \right ], & & ( 5. 2 8 ) \\ \text{a measurable selector for the minimizer of } ( 5. 2 2 ). \text{ Note that}$$

with v 0 a measurable selector for the minimizer of (5.22). Note that

We next show that

$$V _ { * } ( X _ { \check { \tau } _ { r } \wedge \tau _ { R } } ) \, = \, V _ { * } ( X _ { \check { \tau } _ { r } } ) \mathfrak { 1 } ( \check { \tau } _ { r } < \tau _ { R } ) + V _ { * } ( X _ { \tau _ { R } } ) \mathfrak { 1 } ( \check { \tau } _ { r } \geq \tau _ { R } ) \,.$$

$$\lim _ { R \nearrow \infty } \sup _ { R \nearrow \infty } \mathbb { E } _ { x } ^ { v _ { 0 } } [ V _ { * } ^ { - } ( X _ { \tau _ { R } } ) \mathbb { 1 } ( \breve { \tau } _ { r } \geq \tau _ { R } ) ] \, = \, 0 \,.$$

Let Φ := V ∗ + V ◦ . It follows by (5.26) that Φ is coercive and V -∗ ∈ o (Φ). It is also evident by (4.1) and (5.22) that A v 0 Φ( x ) ≤ 1 B ◦ ( x ) + /rho1 ∗ . Then, applying Itˆ's formula, we obtain o

$$\text{and} \, ( 5. 2 2 ) \, \text{that} \, \mathcal { A } _ { v _ { 0 } } \Phi ( x ) \leq \mathfrak { 1 } _ { \mathfrak { B } _ { o } } ( x ) + \varrho _ { * }. \, \text{$1$hen, applying $lt\delta^{\prime}s formula, we obtain} \\ \mathbb { E } _ { x } ^ { v _ { 0 } } \left [ \Phi ( X _ { \check { \tau } _ { r } \wedge \tau _ { R } } ) \right ] \, \leq \, ( \varrho _ { * } + 1 ) \, \mathbb { E } _ { x } ^ { v _ { 0 } } [ \check { \tau } _ { r } \wedge \tau _ { R } ] + \Phi ( x ) \, \leq \, ( \varrho _ { * } + 1 ) \, \mathbb { E } _ { x } ^ { v _ { 0 } } [ \check { \tau } _ { r } ] + \Phi ( x ) \,.$$

We also have

Note that E v 0 x [˘ ] τ r is finite since v 0 ∈ U ssm by Theorem 4.1. Since V -∗ ∈ o (Φ), it follows that sup y ∈ B c R V -∗ ( y ) Φ( ) y vanishes as R → ∞ , which in turn implies that the right hand side of (5.30) converges to 0 as R → ∞ . This proves (5.29). Letting R → ∞ in (5.28), it follows by Fatou's lemma and (5.29) that

$$\text{we also have} \\ \mathbb { E } _ { x } ^ { v _ { 0 } } \left [ V _ { * } ^ { - } ( X _ { \tau _ { R } } ) \mathbb { 1 } ( \breve { \tau } _ { r } \geq \tau _ { R } ) \right ] \, \leq \, \left ( ( \varrho _ { * } + 1 ) \mathbb { E } _ { x } ^ { v _ { 0 } } [ \breve { \tau } _ { r } ] + \Phi ( x ) \right ) \, \sup _ { y \in B _ { R } ^ { c } } \, \frac { V _ { * } ^ { - } ( y ) } { \Phi ( y ) } \,. \quad \quad ( 5. 3 0 ) \\ \text{Note that } \mathbb { E } _ { x } ^ { v _ { 0 } } [ \breve { \tau } _ { r } ] \text{ is finite since } v _ { 0 } \in \mathfrak { U } _ { \text{ssm} } \text{ by Theorem } 4. 1. \, \text{ Since } V _ { * } ^ { - } \, \in \, \mathfrak { o } ( \Phi ), \text{ it follows that}$$

and we obtain

$$\mathcal { H } \text{ nat} \\ V _ { * } ( x ) & \geq \mathbb { E } _ { x } ^ { v _ { 0 } } \left [ \int _ { 0 } ^ { \breve { \tau } _ { r } } \left ( \mathcal { R } _ { v _ { 0 } } ( X _ { s } ) - \varrho _ { * } \right ) d s + V _ { * } ( X _ { \breve { \tau } _ { r } } ) \right ], \\ r _ { r } \breve { \tau } _ { r } }$$

which together with (5.27) implies (5.23). Note that, by the argument above, (5.31) holds for any solution V of (5.22) which satisfies V -∈ o ( V ◦ ). Thus, if V is any other solution, we have V ∗ ≤ V and equality follows by the strong maximum principle. This completes the proof. /square

$$\tan \\ V _ { * } ( x ) & \geq \lim \sup _ { r \searrow 0 } \inf _ { v \in \mathfrak { U } _ { s m } } \mathbb { E } _ { x } ^ { v } \left [ \int _ { 0 } ^ { \dagger _ { r } } ( \mathcal { R } _ { v } ( X _ { s } ) - \varrho _ { * } ) d s \right ], \\ \text{ther with } ( 5. 2 7 ) \text{ implies } ( 5. 2 3 ). \text{ Note that. by the argument above. (5. 3 1) holds for any}$$

- 5.1. Regularity of solutions of the HJB. In this section, we examine the regularity of solutions of the HJB equations in Theorems 5.1 and 5.2. If the L´vy measure e ν has a compact support, then it follows by the elliptic regularity [25, Theorem 9.19] that the solutions to the HJB equations are in C 2 ,r ( R d ) for any r ∈ (0 1). , See also Remark 3.4 in [3].

We need the following gradient estimate which is also applicable to a larger class of equations.

Lemma 5.3. Let ϕ ∈ W 2 ,p loc ( R d ) , p &gt; d , be a strong solution, having at most polynomial growth of degree m&gt; 0 , to the equation where

- ( i ) the matrix a is bounded, Lipschitz continuous on R d and uniformly elliptic;

$$\L ^ { \quad \cdot \quad \cdot } _ { \quad } ^ { \quad \cdot \quad \cdot } ^ { \quad \cdot \quad \cdot } & a ^ { i j } ( x ) \partial _ { i j } \varphi ( x ) + b ^ { i } ( x ) \partial _ { i } \varphi ( x ) + c ( x ) \varphi ( x ) + \widetilde { \mathcal { I } } \varphi ( x ) \, = \, f ( x ) \quad o n \, \mathbb { R } ^ { d } \,, \\ \text{here} \\ ( i ) \, \text{ the matrix } a \, \text{ is bounded, Lipschitz continuous on } \mathbb { R } ^ { d } \, \text{ and uniformly elliptic;}$$

- ( ii ) the coefficients b and c are locally bounded and measurable, with b having at most linear growth and c having at most quadratic growth;
- ( iii ) the function f has at most polynomial growth of degree κ with κ ∈ (0 , m +2] ;

m

R

(

iv

)

the L´vy measure

e

ν

of the nonlocal operator is finite and satisfies

d

z

ν

(d

z

)

&lt;

.

Then,

I

∫

|

|

∞

ϕ x

(

)

O

(

x

m

+1

)

.

Proof. For any fixed x 0 ∈ R d , for which without loss of generality we assume | x 0 | ≥ 1, we define the scaled variables

˜

|∇

|

∈

|

|

$$\cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \\ \tilde { \varphi } ( x ) \, \coloneqq \, \varphi \left ( \frac { x } { | x _ { 0 } | ^ { 1 / 2 } } \right ), \\ \i e \, \text{equation in} \, ( 5. 3 2 ) \, \text{then} \, \text{tak}$$

and similarly for ˜, ˜ , ˜, and a b c ˜ . f The equation in (5.32) then takes the form

$$& \text{and similarly for $a,b,c,andf$. $IThe equation in ($5.32$) then takes the form} \\ & \tilde { a } ^ { i j } ( x ) \partial _ { i j } \tilde { \varphi } ( x ) + \frac { \tilde { b } ^ { i } ( x ) } { | x _ { 0 } | ^ { 1 / 2 } } \partial _ { i } \tilde { \varphi } ( x ) + \frac { \tilde { c } ( x ) } { | x _ { 0 } | ^ { 1 / 2 } } \tilde { \varphi } ( x ) + \widetilde { \mathcal { I } } \varphi \left ( \frac { x } { | x _ { 0 } | ^ { 1 / 2 } } \right ) = \frac { \tilde { f } ( x ) } { | x _ { 0 } | } \text{ on } \mathbb { R } ^ { d } \,. \quad \text{ (5.33)} \\ & \text{It is clear from $(i)-(ii)$ that the coefficients $\tilde{ a } ^ { i j }, \, | x _ { 0 } | ^ { - 1 / 2 } \tilde { b } ^ { i } \text{ and } | x _ { 0 } | ^ { - 1 } \tilde { c } \text{ are bounded in the ball} \\ & \text{$\Lambda(x\L). with a bound independent of $x\L$} \text{ and that the Lineschitz and ellipticity constants of the}$$

$$& [ 2 5, \text{Theorem 9.11} ] \text{ that, for any fixed $p>d$, we have} \\ & \| \tilde { \varphi } \| _ { W ^ { 2, p } ( B _ { 1 } ( x _ { 0 } ) ) } \leq C \Big ( \| \tilde { \varphi } \| _ { L ^ { p } ( B _ { 2 } ( x _ { 0 } ) ) } + \| \widetilde { \mathcal { I } } \varphi ( | x _ { 0 } | ^ { - 1 / 2 } \cdot ) \| _ { L ^ { p } ( B _ { 2 } ( x _ { 0 } ) ) } + | x _ { 0 } | ^ { - 1 } \| \tilde { f } \| _ { L ^ { p } ( B _ { 2 } ( x _ { 0 } ) ) } \Big ) \quad ( 5. 3 4 )$$

It is clear from (i)-(ii) that the coefficients ˜ a ij , | x 0 | -1 2 / ˜ b i and | x 0 | -1 ˜ are c bounded in the ball B 2 ( x 0 ), with a bound independent of x 0 , and that the Lipschitz and ellipticity constants of the matrix ˜ in a B 2 ( x 0 ) are independent of x 0 . Thus, it follows by (5.33) and the a priori estimate in [25, Theorem 9.11] that, for any fixed p &gt; d , we have

for some positive constant C independent of x 0 . Since ν is finite and ∫ R d | z | m ν (d z ) &lt; ∞ , it follows that ˜ I ϕ has at most polynomial growth of degree m . Then, by the assumptions of the lemma, the right hand side of (5.34) is O ( | x 0 | m / 2 ) . Therefore, by (5.34) and the compactness of the Sobolev embedding W 2 ,p ( B 1 ( x 0 ) ) ↪ →C 1 ,r ( B 1 ( x 0 ) ) , for 0 &lt; r &lt; 1 -d p , we obtain for some positive constant C 0 independent of x 0 . On the other hand,

$$\nu \, \langle \, D _ { 1 } \langle x _ { 0 } \rangle \rightarrow \, \varkappa \, \langle \, D _ { 1 } \langle x _ { 0 } \rangle \rangle, \, \text{for} \, \cup \, \infty \, \text{all} \, \\ \left \| \nabla \tilde { \varphi } \right \| _ { L ^ { \infty } ( B _ { 1 } ( x _ { 0 } ) ) } \leq C _ { 0 } \left ( 1 + | x _ { 0 } | ^ { m / 2 } \right ) \quad \forall \, x _ { 0 } \in \mathbb { R } ^ { d } \\ \text{sitive constant} \, C _ { 0 } \text{ independent of} \, x _ { 0 }. \, On the other hand, \\ = \, & \, \left ( \, \right ) \, x _ { 0 } \, \bigcup \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \end{array}$$

m +1 This completes the proof. /square

$$\text{constant } C _ { 0 } & \text{independent of } x _ { 0 }. \text{ On the other hand,} \\ \nabla \varphi & \left ( \frac { x _ { 0 } } { | x _ { 0 } | ^ { 1 / 2 } } \right ) \, = \, | x _ { 0 } | ^ { 1 / 2 } \nabla \tilde { \varphi } ( x _ { 0 } ) \quad \forall \, x _ { 0 } \in \mathbb { R } ^ { d } \,, \\ \text{th (5.35)} & \text{implv } | \nabla \varphi ( x ) | \in \mathcal { O } ( | x | ^ { m + 1 } ). \text{ This completes the proc}$$

which together with (5.35) imply |∇ ϕ x ( ) | ∈ O ( | x | ).

Consider the following assumption on the growth of the coefficients and the functions V ◦ and V .

Assumption 5.1. (i) The running cost function has at most polynomial growth of degree m ◦ ≥ 1, that is, R ( x, u ) ≤ C ◦ (1 + | x | m ◦ ), for all ( x, u ) ∈ R d × U and some positive constant C ◦ .

- (ii) Assumptions 2.1 and 2.2 hold with V and V ◦ having at most polynomial growth of degree m ◦ .

Remark 5.1 . Provided that ∫ R d | z | m +1 ν (d z ) &lt; ∞ , it is clear that Assumption 5.1 holds for the limiting controlled diffusion in Section 3.

- (iii) The L´ evy measure ν satisfies ∫ R d | z | m ◦ +1 d z &lt; ∞ .

We have the following theorem.

Theorem 5.3. Grant Assumption 5.1 . The solutions V /epsilon1 α of (5.2) , and V ∗ of (5.22) are in C 2 ,r ( R d ) for any r ∈ (0 1) , .

$$\text{Lipschitz continuous. To prove the claim, we fix some } x _ { 0 } \in \mathbb { R } ^ { d }, \text{ and write} \\ \left | \widetilde { \mathcal { I } } V _ { * } ( x _ { 0 } + x ^ { \prime } ) - \widetilde { \mathcal { I } } V _ { * } ( x _ { 0 } + x ^ { \prime \prime } ) \right | & \leq \int _ { \mathbb { R } ^ { d } } \int _ { 0 } ^ { 1 } \left | \langle \nabla V _ { * } ( x _ { 0 } + \theta ( x ^ { \prime } - x ^ { \prime \prime } ) + y ), x ^ { \prime } - x ^ { \prime \prime } \rangle \right | d \theta \nu ( d y ) \\ & \leq \left | x ^ { \prime } - x ^ { \prime \prime } \right | \int _ { \mathbb { R } ^ { d } } \| \nabla V _ { * } \| _ { L ^ { \infty } ( B _ { 2 } ( x _ { 0 } + y ) ) } \nu ( d y ) \\ \text{for all } x ^ { \prime }, x ^ { \prime \prime } \in B _ { 1 }. \text{ By } ( 5. 2 2 ) \text{ and Lemma } 5. 3 \text{ we obtain} \\ & \| \nabla V _ { * } \| _ { r ^ { \infty } / R _ { * } / \cdots } \in \mathcal { O } ( | z | ^ { m _ { 0 } + 1 } ) \,.$$

Proof. Consider V ∗ . Since V ∗ ∈ O V ( ◦ +3 ) by (5.25), then V ˜ I V ∗ ∈ L ∞ loc ( R d ) by (2.8) and (2.9), and V ∗ has at most polynomial growth of degree m ◦ by Assumption 5.1. We claim that ˜ I V ∗ is locally Lipschitz continuous. To prove the claim, we fix some x 0 ∈ R d , and write for all x , x ′ ′′ ∈ B 1 . By (5.22) and Lemma 5.3 we obtain

which together with Assumption 5.1 (iii) and (5.36) proves the claim. It then follows by (5.22) and elliptic regularity (see [25, Theorem 9.19]) that V ∗ is in C 2 ,r ( R d ) for any r ∈ (0 1). , The proof of the same property for V /epsilon1 α is completely analogous. /square

$$\| \nabla V _ { * } \| _ { L ^ { \infty } ( B _ { 2 } ( z ) ) } \in \mathcal { O } ( | z | ^ { m _ { \circ } + 1 } ) \,, \\ \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \cdot \colon$$

## 6. Pathwise optimality

The pathwise formulation of the ergodic control problem seeks to a.s. minimize over U ∈ U

where { X U t } t ≥ 0 denotes the process governed by (2.1) under the control U . If the running cost is near-monotone or a uniform stability condition holds, it follows by [3, Theorem 4.4] that every average cost optimal stationary Markov control is also optimal with respect to the pathwise ergodic

$$\colon & t h e \text{ergodic control problem seeks to} \\ & \lim \sup _ { t \to \infty } \frac { 1 } { t } \int _ { 0 } ^ { t } \mathcal { R } ( X _ { s } ^ { U }, U _ { s } ) \, d s \,, \\ & \text{rocess} \, \text{converted} \, h v \, ( 2 \, 1 ) \, \text{under the} \,.$$

criterion. In this section, we extend the results of the diffusion model in [10] to the jump-diffusion model. We modify Assumption 2.1 as follows.

Assumption 6.1. Assumption 2.1 holds with F = φ ◦ V ◦ , where φ : R + → R + is smooth increasing concave function, satisfying φ z ( ) → ∞ as z → ∞ . In addition, the functions σ and ∇ V ◦ 1+ φ ◦ V ◦ are bounded on R d .

Remark 6.1 . For the examples in Section 3, we may rescale F x ( ) in Lemma 3.1 so that F x ( ) = C V Q,m ( x ) for some positive constant C . Thus, if we choose φ x ( ) = Cx , then Assumption 6.1 holds.

Theorem 6.1. Grant Assumption 6.1 . Then, if U ∈ U is such that /rho1 U ( x ) &lt; ∞ , the family of random empirical measures { ζ U t : t &gt; 0 } in Definition 4.1 is tight a.s. In particular, every average cost optimal stationary Markov control is pathwise optimal.

Proof. The technique is similar to that of [10, Theorem 3.1], but here we need to account for the nonlocal term. We define ψ N : R + → R + , for N ∈ N , by

$$\mathfrak { I } _ { + } \to \mathfrak { I } _ { + }, \, \text{for } \mathfrak { I } \, \in \, \mathfrak { I } \,, \, \text{by} \\ \psi _ { N } ( z ) \, \coloneqq \, \int _ { 0 } ^ { z } \frac { 1 } { N + \phi ( y ) } \, d y \,, \\ \mathcal { I } \dots \, \in \, \begin{array} { c } \mathfrak { I } \\ \mathfrak { I } \dots \end{array} \times \, \begin{array} { c } \mathfrak { I } \dots \end{array} \times \, \mathfrak { I } \dots \end{array} \times \, \begin{array} { c } \mathfrak { I } \dots \end{array} \times \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { I } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \cdots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak{ J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \,  \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J } \dots \, \mathfrak { J }$$

and ϕ N : R d → R + by ϕ N := ψ N ◦ V ◦ , where ' ' denotes composition of functions. ◦ Let U ∈ U be some admissible control such that

$$\mathcal { I } \text{ such that} \\ \lim _ { n \to \infty } \int _ { \mathbb { R } ^ { d } \times \mathbb { U } } \mathcal { R } ( x, z ) \, \zeta _ { t _ { n } } ^ { U } ( d x, d z ) \, < \, \infty \,, \\ \dots \, \dots \, \dots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \dots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \cdots \, \tau \, \colon$$

for some increasing divergent sequence { t n } . Since R is coercive on K× U , it follows that ζ U t n is a.s. tight when restricted to B ( K× U ), the Borel σ -algebra of K× U .

$$\text{Since $\nabla\varphi_{N}$ and $\sigma$ are bounded, by It} \delta ^ { \prime } s \text{ formula and (2.8)} \text{ we obtain} \\ \frac { \varphi _ { N } ( X _ { t } ) - \varphi _ { N } ( X _ { 0 } ) } { t } = \frac { 1 } { t } \int _ { 0 } ^ { t } \mathcal { A } _ { U _ { s } } \varphi _ { N } ( X _ { s } ) \, d s + \frac { 1 } { t } \int _ { 0 } ^ { t } \langle \nabla \varphi _ { N } ( X _ { s } ), \sigma ( X _ { s } ) \, d W _ { s } \rangle \\ & + \frac { 1 } { t } \int _ { 0 } ^ { t } \int _ { R _ { s } ^ { m } } \left ( \varphi _ { N } ( X _ { s - } + g ( \xi ) ) - \varphi _ { N } ( X _ { s - } ) \right ) \widetilde { \mathcal { N } } ( d s, d \xi ) \,. \\ \text{Then, the second and third terms on the right hand side of (6.1) converge to 0 a.s. as $t\to\infty$, by} \\ \text{the proof of Lemma $4.2$ in $[3].}$$

Since ∇ ϕ N and σ are bounded, by Itˆ's formula and (2.8) we obtain o

Then, the second and third terms on the right hand side of (6.1) converge to 0 a.s. as t →∞ , by the proof of Lemma 4.2 in [3].

An easy computation shows that where

$$\i \text{easy computation shows that} \\ \mathcal { A } _ { z } \varphi _ { N } ( x ) \, \leq \, \begin{cases} \frac { 1 - \phi ( \mathcal { V } _ { \circ } ( x ) ) } { N + \phi ( \mathcal { V } _ { \circ } ( x ) ) } + F _ { 1, N } ( x ) + F _ { 2, N } ( x ) \quad & \text{on} \, \mathcal { K } ^ { c }, \\ \frac { 1 + \mathcal { R } ( x, z ) } { N + \phi ( \mathcal { V } _ { \circ } ( x ) ) } + F _ { 1, N } ( x ) + F _ { 2, N } ( x ) \quad & \text{on} \, \mathcal { K }, \end{cases} \\ \i \text{s} \\ \mathcal { R } \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \, \cdots \, \quad \, \iota / \in \,  \end{cases}$$

and

$$F _ { 1, N } ( x ) & \, \colon = \, - \phi ^ { \prime } \left ( \mathcal { V } _ { \circ } ( x ) \right ) \frac { \left | \sigma ^ { T } ( x ) \nabla \mathcal { V } _ { \circ } ( x ) \right | ^ { 2 } } { \left ( N + \phi ( \mathcal { V } _ { \circ } ( x ) ) \right ) ^ { 2 } }, \quad x \in \mathbb { R } ^ { d }, \\ \\ \vdots \quad \, \int \, \int \, 1 \quad \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \, \int \end{array}$$

To estimate (6.4), we use

$$& \text{To estimate} \, ( 6. 4 ), \, \text{we use} \\ & \left | \int _ { \mathbb { R } ^ { d } } \int _ { \mathcal { V } _ { \circ } ( x ) } ^ { \mathcal { V } _ { \circ } ( x + \xi ) } \frac { \phi ( \mathcal { V } _ { \circ } ( x ) ) - \phi ( y ) } { N + \phi ( y ) } \, \text{d} \right ) \, \text{v} ( \text{d} \xi ) \right | \leq \, \text{v} ( \mathbb { R } ^ { d } ) \, \| \phi ^ { \prime } \| _ { L ^ { \infty } ( \mathbb { R } ) } \left \| \frac { \nabla \mathcal { V } _ { \circ } } { N + \varphi \circ \mathcal { V } _ { \circ } } \right \| _ { L ^ { \infty } ( \mathbb { R } ^ { d } ) }.$$

$$\text{ad} \\ F _ { 2, N } ( x ) \coloneqq \frac { 1 } { N + \phi ( \mathcal { V } _ { \circ } ( x ) ) } \int _ { \mathbb { R } ^ { d } } \int _ { \mathcal { V } _ { \circ } ( x ) } ^ { \mathcal { V } _ { \circ } ( x + \xi ) } \frac { \phi ( \mathcal { V } _ { \circ } ( x ) ) - \phi ( y ) } { N + \phi ( y ) } \, d y \, \nu ( d \xi ) \,. \\ \text{$o$ estimate (6.4), we use} \\ \text{$i$ estimate (6.4), we use}$$

Then combining this with (6.1)-(6.4), we obtain for some constant C , from which it follows that ζ U t n is a.s. tight when restricted to B ( K × c U ). Therefore, it is a.s. tight in P ( R d × U ). This completes the proof. /square

$$\text{his with (6.1)-(6.4), we obtain} \\ \limsup _ { n \to \infty } \int _ { \mathcal { K } ^ { c } \times \mathbb { U } } \frac { \phi ( \mathcal { V } _ { \circ } ( x ) ) } { N + \phi ( \mathcal { V } _ { \circ } ( x ) ) } \, \zeta _ { t _ { n } } ^ { U } ( d x, d z ) \, \leq \, \frac { C } { N } \\ C, \, \text{from which it follows that } \zeta _ { t _ { n } } ^ { U } \text{ is a.s. tight when restrict} \\ \colon \text{tioht in } \mathcal { D } ( \mathbb { R } ^ { d } \times \mathbb { I I } ) \text{ This comletes the nroof}$$

## 7. An approximate HJB equation

In this section, we use an approximate HJB equation to construct /epsilon1 -optimal controls. Its purpose is twofold. First, it is used to establish asymptotic optimality in [15]. Second, the approximating HJB equation is a semilinear equation on a sufficiently large ball, and a linear equation on its complement, which is beneficial to numerical methods. This result was first reported in [4, Section 4] for a continuous diffusion. The proof in that paper crucially relied on the the following property of a positive recurrent nondegenerate diffusion of the form d X t = ( b X t )d t + σ ( X t )d W t : If a function f : R d → R is integrable under the invariant probability measure µ of the diffusion, then E [ f ( X t )] → µ f ( ) as t →∞ . The proof of this property in [27, Proposition 2.6] relies on the Harnack property which we do not have for the model in this paper. Thus, a different approach is adopted.

We first consider the ergodic control problem with a suitable control which satisfies Assumption 2.2 fixed outside a ball of arbitrarily large radius. Then, we show that /epsilon1 -optimal controls are obtained by choosing the radius of the ball sufficiently large. Assumption 7.1 replaces Assumption 2.2 in this section.

## Assumption 7.1. The following hold:

- (i) The function ˜ F in (4.2) is in C 2 ( R d ), has at most polynomial growth of degree ˜ m ≥ 1, and satisfies

(ii) There exist ˜ v ∈ U ssm and ˜ V ∈ C 2 ( R d ), with ˜ V ∈ O ( ˜ F ), satisfying A ˜ v ˜ V ≤ ˜ C -˜ F for some positive constant ˜ C ; (iii) The L´ evy measure ν satisfies ∫ R d | z | ˜ m ν (d z ) &lt; ∞ . The jump diffusion with a 'truncated' control space is defined as following.

$$| x \| \nabla \widetilde { F } | + | x | ^ { 2 } \| \nabla ^ { 2 } \widetilde { F } \| \, \in \, \mathcal { O } ( \widetilde { F } ) \,. \\ \text{and } \widetilde { \mathcal { V } } \in \mathcal { C } ^ { 2 } ( \mathbb { R } ^ { d } ), \, \text{with } \widetilde { \mathcal { V } } \in \mathcal { O } ( \widetilde { F } ), \, \text{satisfyir} \\ \mathcal { A } \widetilde { \mathcal { V } } \, > \, \widetilde { \mathcal { C } } \quad \widetilde { \mathcal { R } }$$

Definition 7.1. With ˜ v ∈ U ssm as in Assumption 7.1 and each R &gt; 0, we define

Let A R u denote the operator associated with the controlled jump diffusion

$$. 1. \text{ With } \tilde { v } \in \mathfrak { U } _ { \text{ssm} } & \text{in Assumption 7.1 and each } R > 0, \, \text{we define} \\ b ^ { R } ( x, u ) \, \coloneqq \, \begin{cases} b ( x, u ) \,, & \text{if } ( x, u ) \in B _ { R } \times \mathbb { U } \,, \\ b ( x, \tilde { v } ) \right ) \,, & \text{if } x \in B _ { R } ^ { c } \,, \end{cases} \\ \mathfrak { R } ^ { R } ( x, u ) \, \coloneqq \, \begin{cases} \mathcal { R } ( x, u ) \,, & \text{if } ( x, u ) \in B _ { R } \times \mathbb { U } \,, \\ \mathcal { R } ( x, \tilde { v } ) \right ) \,, & \text{if } x \in B _ { R } ^ { c } \,. \end{cases} \\ \text{e the operator associated with the controlled jump diffusion} \\ A Y. \, \real - \, h ^ { R } ( Y. \, H. \, \mathcal { U } \, \mathcal { U } \, \pm \, \mathcal { A } ( Y. \, \mathcal { U } \, \mathcal { W }. \, \pm \, \mathcal { A } \, H. \,.$$

$$\mathrm d X _ { t } \, \coloneqq \, b ^ { R } ( X _ { t }, U _ { t } ) \, \mathrm d t + \sigma ( X _ { t } ) \, \mathrm d W _ { t } + \mathrm d L _ { t } \,,$$

with X 0 = x ∈ R d , and define where U sm (˜ v, R ) denotes the class of stationary Markov controls which agree with ˜ v ∈ U ssm on B c R .

$$\mathcal { R } ^ { \epsilon, R } \, \coloneqq \, \mathcal { R } ^ { R } + \epsilon \widetilde { F } \,, \quad \text{and} \quad \varrho _ { * } ^ { \epsilon, R } \, = \, \inf _ { v \in \mathfrak { U } _ { s m } ( \tilde { v }, R ) } \pi _ { v } ( \mathcal { R } ^ { \epsilon } ) \,, \\ R ) \, \text{ denotes the class of stationary Markov controls which agree with $\tilde{v} \, \epsilon$}$$

By Theorem 5.2, for each R &gt; 0 and /epsilon1 ∈ (0 1), , there exists a unique V R /epsilon1 ∈ W 2 ,p loc ( R d ), for any p &gt; 1, which is bounded from below in R d and satisfies V R /epsilon1 (0) = 0, and

In addition, there exists a constant C such that

$$\text{ouuueu nom Devow in } n, \text{ and assumes } v _ { \epsilon } \, \left ( 0 \right ) = 0, \text{ and } \\ \min _ { u \in \mathbb { U } } \left [ \mathcal { A } _ { u } ^ { R } V _ { \epsilon } ^ { R } ( x ) + \mathcal { R } ^ { \epsilon, R } ( x, u ) \right ] \, = \, \varrho _ { * } ^ { \epsilon, R } \quad \text{a.e. in } \mathbb { R } ^ { d }. \\ \text{re exists a constant $C$ such that}$$

V R /epsilon1 ≤ C (1 + 2 ˜ V ) ∀ R &gt; 0 . (7.1) It is clear that /rho1 /epsilon1,R ∗ is nonincreasing. Let ˆ /rho1 /epsilon1 := lim R →∞ ∗ /rho1 /epsilon1,R . As in the proof of Theorem 5.2, V R /epsilon1 → ̂ V /epsilon1 ∈ W 2 ,p loc ( R d ), for any p &gt; 1, which satisfies

Recall that R /epsilon1 , defined in the proof of Theorem 4.1, is the optimal ergodic value for the controlled diffusion in (2.1) with running cost R /epsilon1 . We wish to show that ˆ /rho1 /epsilon1 = /rho1 /epsilon1 ∗ . To establish this we need the following lemma, which provides a lower bound for supersolutions of a general class of integrodifferential equations.

$$\text{oc} ^ { \mathrm R } \,, \, \text{for any $p>1$, which assumes} \\ \min _ { u \in \mathrm U } \left [ \mathcal { A } _ { u } \widehat { V } _ { \epsilon } ( x ) + \mathcal { R } ^ { \epsilon } ( x, u ) \right ] \, = \, \hat { \varrho } ^ { \epsilon } \quad \text{a.e. in $R^{d}$}. \\ \mathrm R ^ { \epsilon }, \, \text{defined in the proof of Theorem 4.1, is the optimal ergodic value for the controlled} \\ 1 ) \, \text{with running cost } \mathcal { R } ^ { \epsilon }. \, \text{We wish to show that } \hat { \varrho } ^ { \epsilon } = \varrho ^ { \epsilon }. \, \text{To establish this we need}$$

Lemma 7.1. Let ϕ ∈ W 2 ,d loc ( R d ) , be a supersolution of the equation which is bounded below in R d . Assume the following:

- ( i ) the matrix a is nonsingular and satisfies

$$a ^ { i j } ( x ) \partial _ { i j } \varphi ( x ) + b ^ { i } ( x ) \partial _ { i } \varphi ( x ) + \mathcal { I } \varphi ( x ) + \widetilde { F } ( x ) \, = \, 0 \quad o n \, \mathbb { R } ^ { d } \,, \\ \text{ounded below in } \mathbb { R } ^ { d }. \ A s s u m e \, t h e f o l l o w i n g \colon \\ \ e \ m a t r i x \, a \, i s \ n o n s i n a u l a r \, a n d \ s t i s f i e s$$

$$\lim _ { | x | \to \infty } \frac { \| a ( x ) \| } { | x | ^ { 2 } } \, < \, \infty \, ; \\........................................................................................................................................................................................................$$

- ( ii ) the drift b is measurable and has at most linear growth;

↦

- ( iii ) the function ˜ F is as in Assumption 7.1 ; ( iv ) the operator I : C 1 ( R d ) →C ( R d ) is given by

$$\iota o r \, \mathcal { L } \colon \mathcal { C } ^ { * } ( \mathbb { R } ^ { * } ) & \mapsto \mathcal { C } ( \mathbb { R } ^ { * } ) \ i s \ g v e n \ o y \\ \mathcal { I } h ( x ) & = \int _ { \mathbb { R } _ { * } ^ { d } } h ( x + y ) - h ( x ) - \langle y, \nabla h ( x ) \rangle \, \nu ( \mathrm d y ) \\ \iota / \mathfrak { m } d \lor \dots \ i n \ i n \ e \dots \dots \dots \dots \ e \dots$$

for h ∈ C 1 ( R d ) and the L´vy measure e ν satisfies

$$\L a n a \, \L t e { \L L e v y \, \text{measure} } \, \nu \, \text{saxsjes} \\ \int _ { \mathbb { R } _ { * } ^ { d } } | z | ^ { \widetilde { m } } \, \nu ( \mathrm d z ) + \int _ { B _ { 1 } \langle 0 \} } | z | ^ { 2 } \, \nu ( \mathrm d z ) < \infty \,.$$

Then, ˜ F ∈ O ( ϕ ) . Proof. We have

A ϕ x ( ) := a ij ( x ∂ ) ij ϕ x ( ) + b i ( x ∂ ϕ x ) i ( ) + I ϕ x ( ) ≤ -˜ F x ( ) ∀ x ∈ R d . (7.3) By using (i)-(iii), it is clear that A ˜ F -I ˜ F ∈ O ( ˜ F ). By (iii) and (iv), it follows by [6, Lemma 5.1] that I ˜ F ∈ O ( ˜ F ). Thus, there exists ˆ r &gt; 0 such that | A ˜ F x ( ) | ≤ C (1 + ˜ F x ( )) ∀ x ∈ B , c ˆ r (7.4) for some positive constant C . Let φ n ( x ) be a smooth cutoff function satisfying φ n ( x ) = 1 on B n and φ n ( x ) = 0 on B c n +1 , for n ∈ N . By (7.4) and (iii), we can choose r &gt; r ˆ large enough and /epsilon1 ∈ (0 1) sufficiently small so that for any , n ∈ N ,

$$- \widetilde { F } ( x ) - \epsilon \mathcal { A } \widetilde { F } ( x ) \phi _ { n } ( x ) \, \leq \, 0 \quad \forall \, x \in B _ { r } ^ { c } \,.$$

Let M be a lower bound for ϕ , and n &gt; r . We define the function ˆ ϕ n /epsilon1 ( x ) := ϕ x ( ) -/epsilon1F ˜ ( x φ ) n ( x ) -( M -sup B r ˜ F ). Then, applying (7.3) and (7.5), we have A ˆ ϕ n /epsilon1 ( x ) ≤ -˜ F x ( ) -/epsilon1 A ˜ F x φ ( ) n ( x ) ≤ 0 ∀ x ∈ B n +1 \ B . r It is evident that ϕ x ( ) -( M -sup B r ˜ F ) ≥ 0 on B c n +1 , and ϕ x ( ) -/epsilon1F ˜ ( x ) -( M -sup B r ˜ F ) ≥ 0 on B r . Thus, applying the strong maximum principle, we obtain ˆ ϕ n /epsilon1 ( x ) ≥ 0 in R d . It follows that ϕ x ( ) ≥ /epsilon1F ˜ ( x φ ) n ( x ) + ( M -sup B r ˜ F ) in R d for all n large enough. This completes the proof. /square The main result of this section is the following.

Theorem 7.1. Grant Assumption 7.1 . Then, ˆ /rho1 /epsilon1 = /rho1 /epsilon1 ∗ .

Proof. Let V /epsilon1 ∈ W 2 ,p loc ( R d ), p &gt; 1, be the unique solution of the equation which is bounded below in R d and satisfies V /epsilon1 (0) = 0. Applying Itˆ's formula to (7.6), we obtain o

$$\, = \, v _ { \text{loc} } ( \mathbb { R } ^ { - } ), \, p > 1, \, \text{be use unique solution of use equation} \\ \min _ { u \in \mathbb { U } } \left [ \mathcal { A } _ { u } V _ { \epsilon } ( x ) + \mathcal { R } ^ { \epsilon } ( x, u ) \right ] \, = \, \varrho _ { * } ^ { \epsilon } \quad \text{a.e. in } \mathbb { R } ^ { d }, \quad \quad ( 7. 6 ) \\ \, \text{led below in } \mathbb { R } ^ { d } \, \text{and satisfies } V _ { \epsilon } ( 0 ) = 0. \, \text{Applying It} \hat { o } ^ { \prime } s \, \text{formula to } ( 7. 6 ), \, \text{we obtain}$$

$$\text{which is bounded below in } \mathbb { K } ^ { * } \text{ and satisfies } V _ { \epsilon } ( U ) = U. \, \text{Applying into $>$ formula to (7.0), we obtain} \\ \mathbb { E } _ { x } ^ { v _ { * } } \left [ V _ { \epsilon } ( X _ { T \wedge \tau _ { r } } ) \right ] \, = \, V _ { \epsilon } ( x ) - \mathbb { E } _ { x } ^ { v _ { * } ^ { * } } \left [ \int _ { 0 } ^ { T \wedge \tau _ { r } } \mathfrak { K } _ { v _ { * } ^ { * } } ( X _ { s } ) \, d s \right ] + \varrho _ { * } ^ { \epsilon } \mathbb { E } _ { x } ^ { v _ { * } ^ { * } } [ T \wedge \tau _ { r } ] \,, \quad \, ( 7. 7 ) \\ \text{with } v _ { * } ^ { \epsilon } \text{ a measurable selector from the minimizer of } ( 7. 7 ). \, \text{ It is clear from } ( 7. 7 ) \text{ that } G ( T ) \, \coloneqq$$

$$\mathfrak { a } \mathrm { I o } ^ { \prime } & s \mathrm { \mathrm { \text{formula} } }, \, \mathrm { e o t a n } \\ \lim _ { T \to \infty } \, \frac { 1 } { T } \, \mathbb { E } _ { x ^ { * } } ^ { v _ { * } ^ { \epsilon } } \left [ \int _ { 0 } ^ { T } \mathcal { R } _ { v _ { * } ^ { \epsilon } } ^ { \epsilon } ( X _ { s } ) \, d s \right ] \, \geq \, \hat { \varrho } ^ { \epsilon } \,, \\ \mathrm { \text{hat} } \, \varrho _ { * } ^ { \epsilon } & \geq \hat { \varrho } ^ { \epsilon }. \, \mathrm { \mathrm { \text{This of course implies that } } \, \varrho _ { * } ^ { \epsilon } = \hat { \varrho } ^ { \epsilon }, \, \sin$$

with v /epsilon1 ∗ a measurable selector from the minimizer of (7.7). It is clear from (7.7) that G T ( ) := lim r →∞ E v /epsilon1 ∗ x [ V /epsilon1 ( X T ∧ τ r ) ] exists and satisfies lim sup 1 T G T ( ) → 0 by Birkhoff's ergodic theorem. By Lemma 7.1, we have R /epsilon1 v /epsilon1 ∗ ∈ O ( V /epsilon1 ), and this implies that ̂ V /epsilon1 ∈ O ( V /epsilon1 ) by Assumption 7.1 (ii) and (7.1). Therefore, if ̂ G T ( ) := lim sup r →∞ E v /epsilon1 ∗ x [ ̂ V /epsilon1 ( X T ∧ τ r ) ] , then lim sup T →∞ 1 T ̂ G T ( ) → 0. Thus, evaluating (7.2) at v /epsilon1 ∗ , and applying Itˆ's formula, we obtain o from which it follows that /rho1 /epsilon1 ∗ ≥ ˆ . /rho1 /epsilon1 This of course implies that /rho1 /epsilon1 ∗ = ˆ , since (7.2) has no bounded /rho1 /epsilon1 from below solutions for ˆ /rho1 /epsilon1 &lt; /rho1 /epsilon1 ∗ . /square

The following corollary concerns the construction of continuous precise /epsilon1 -optimal controls. It follows directly from Theorem 7.1 and the method in [5, Theorem 5.5].

Corollary 7.1. For any given /epsilon1 &gt; 0 and ˜ v satisfying Assumption 2.2 , there exist R = R /epsilon1 ( ) &gt; 0 and a continuous precise control v /epsilon1 ∈ U ssm such that v /epsilon1 ≡ ˜ v on ¯ B c R , and

$$\text{control } v _ { \epsilon } \in \mathfrak { U } _ { \text{ssm} } \ s u c h \ t h a t \ v _ { \epsilon } \equiv v \ o n \ B _ { R } ^ { \bullet }, \ a n d \\ \int _ { \mathbb { R } ^ { d } \times \mathbb { U } } \mathcal { R } ( x, u ) \, \pi _ { v _ { \epsilon } } ( \mathrm d x, \mathrm d u ) \, \leq \, \varrho _ { * } + \epsilon \,. \\ \bullet \, \, \,$$

## Acknowledgments

This research was supported in part by the Army Research Office through grant W911NF-17-1001, and in part by the National Science Foundation through grants DMS-1715210, CMMI-1538149 and DMS-1715875, and in part by Office of Naval Research through grant N00014-16-1-2956 and was approved for public release under DCN #43-5439-19.

## References

- [1] A. Bensoussan and J.-L. Lions, Impulse control and quasivariational inequalities , µ , Gauthier-Villars, Montrouge; Heyden &amp; Son, Inc., Philadelphia, PA, 1984. Translated from the French by J. M. Cole. MR756234

[2] J.-L. Menaldi and M. Robin, On optimal ergodic control of diffusions with jumps , Stochastic analysis, control, optimization and applications, 1999, pp. 439-456. MR1702974

- [3] A. Arapostathis, L. Caffarelli, G. Pang, and Y. Zheng, Ergodic control of a class of jump diffusions with finite L´ evy measures and rough kernels , SIAM J. Control Optim. 57 (2019), no. 2, 1516-1540. MR3942851

- [4] A. Arapostathis, A. Biswas, and G. Pang, Ergodic control of multi-class M/M/N + M queues in the Halfin-Whitt regime , Ann. Appl. Probab. 25 (2015), no. 6, 3511-3570. MR3404643
- [5] A. Arapostathis and G. Pang, Ergodic diffusion control of multiclass multi-pool networks in the Halfin-Whitt regime , Ann. Appl. Probab. 26 (2016), no. 5, 3110-3153. MR3563203
- [6] A. Arapostathis, G. Pang, and N. Sandri´, c Ergodicity of a L´vy-driven SDE arising from multiclass many-server e queues , Ann. Appl. Probab. 29 (2019), no. 2, 1070-1126. MR3910024
- [7] A. Arapostathis, V. S. Borkar, and M. K. Ghosh, Ergodic control of diffusion processes , Encyclopedia of Mathematics and its Applications, vol. 143, Cambridge University Press, Cambridge, 2012. MR2884272
- [8] P. Dai Pra, G. B. Di Masi, and B. Trivellato, Pathwise optimality in stochastic control , SIAM J. Control Optim. 39 (2000), no. 5, 1540-1557. MR1825592
- [9] P. Dai Pra, W. J. Runggaldier, and M. Tolotti, Pathwise optimality for benchmark tracking , IEEE Trans. Automat. Control 49 (2004), no. 3, 386-395. MR2062251
- [10] A. Arapostathis, Some new results on sample path optimality in ergodic control of diffusions , IEEE Trans. Automat. Control 62 (2017), no. 10, 5351-5356. MR3708911
- [11] M. K. Ghosh, A. Arapostathis, and S. I. Marcus, Ergodic control of switching diffusions , SIAM J. Control Optim. 35 (1997), no. 6, 1952-1988. MR1478649
- [12] A. Arapostathis and G. Pang, Infinite-horizon average optimality of the N-network in the Halfin-Whitt regime , Math. Oper. Res. 43 (2018), no. 3, 838-866. MR3846075
- [13] A. Arapostathis and G. Pang, Infinite horizon asymptotic average optimality for large-scale parallel server networks , Stochastic Process. Appl. 129 (2019), no. 1, 283-322. MR3906999
- [14] A. Arapostathis, A. Das, G. Pang, and Y. Zheng, Optimal control of Markov-modulated multiclass many-server queues , Stochastic Systems 9 (2019), no. 2, 155-181.
- [15] A. Arapostathis, G. Pang, and Y. Zheng, Optimal scheduling of critically loaded multiclass many-server queues with service interruptions , ArXiv e-prints (to appear).
- [16] ˘ . I ¯ . I G ¯ hman and A. V. Skorohod, i Stochastic differential equations , Springer-Verlag, New York-Heidelberg, 1972. Translated from the Russian by Kenneth Wickwire, Ergebnisse der Mathematik und ihrer Grenzgebiete, Band 72. MR0346904
- [17] I. Gy¨ngy and N. Krylov, o Existence of strong solutions for Itˆ's stochastic equations via approximations o , Probab. Theory Related Fields 105 (1996), no. 2, 143-158. MR1392450
- [18] A. V. Skorokhod, Asymptotic methods in the theory of stochastic differential equations , Translations of Mathematical Monographs, vol. 78, American Mathematical Society, Providence, RI, 1989. Translated from the Russian by H. H. McFaden. MR1020057
- [19] H. Hmedi, A. Arapostathis, and G. Pang, On uniform stability of certain parallel server networks with no abandonment in the Halfin-Whitt regime , ArXiv e-prints 1907.04793 (2019), available at https://arxiv.org/abs/1907.04793 .
- [20] A. Arapostathis, H. Hmedi, and G. Pang, On uniform exponential ergodicity of Markovian multiclass many-server queues in the Halfin-Whitt regime , ArXiv e-prints 1812.03528v1 (2018), available at https://arxiv.org/abs/1812.03528v1 .
- [21] A. Arapostathis, H. Hmedi, G. Pang, and N. Sandri´ c, Uniform polynomial rates of convergence for a class of L´ evy-driven controlled SDEs arising in multiclass many-server queues (G. Yin and Q. Zhang, eds.), Modeling, Stochastic Control, Optimization, and Applications. The IMA Volumes in Mathematics and its Applications, vol. 164, Springer, Cham, 2019.
- [22] P. Echeverr´ ıa, A criterion for invariant measures of Markov processes , Z. Wahrsch. Verw. Gebiete 61 (1982), no. 1, 1-16. MR671239
- [23] M. G. Garroni and J. L. Menaldi, Second order elliptic integro-differential problems , Chapman &amp; Hall/CRC Research Notes in Mathematics, vol. 430, Chapman &amp; Hall/CRC, Boca Raton, FL, 2002. MR1911531
- [24] C. W. Li, Lyapunov exponents of nonlinear stochastic differential equations with jumps , Stochastic inequalities and applications, 2003, pp. 339-351. MR2073440
- [25] D. Gilbarg and N. S. Trudinger, Elliptic partial differential equations of second order , Second, Grundlehren der Mathematischen Wissenschaften, vol. 224, Springer-Verlag, Berlin, 1983. MR737190
- [26] A. Arapostathis, M. K. Ghosh, and S. I. Marcus, Harnack's inequality for cooperative weakly coupled elliptic systems , Comm. Partial Differential Equations 24 (1999), no. 9-10, 1555-1571. MR1708101
- [27] N. Ichihara and S.-J. Sheu, Large time behavior of solutions of Hamilton-Jacobi-Bellman equations with quadratic nonlinearity in gradients , SIAM J. Math. Anal. 45 (2013), no. 1, 279-306. MR3032978
Ari Arapostathis Guodong Pang Yi Zheng
Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis
We study the ergodic control problem for a class of controlled jump
diffusions driven by a compound Poisson process. This extends the results of
[SIAM J. Control Optim. 57 (2019), no. 2, 1516-1540] to running costs that are
not near-monotone. This generality is needed in applications such as optimal
scheduling of large-scale parallel server networks.
  We provide a full characterization of optimality via the
Hamilton-Jacobi-Bellman (HJB) equation, for which we additionally exhibit
regularity of solutions under mild hypotheses. In addition, we show that
optimal stationary Markov controls are a.s. pathwise optimal. Lastly, we show
that one can fix a stable control outside a compact set and obtain near-optimal
solutions by solving the HJB on a sufficiently large bounded domain. This is
useful for constructing asymptotically optimal scheduling policies for
multiclass parallel server networks.