## The Not-So-Sterile 4th Neutrino: Constraints on New Gauge Interactions from Neutrino Oscillation Experiments

Joachim Kopp 1 2 , ∗ and Johannes Welter 1 †

1 Max Planck Institut f¨r Kernphysik, Saupfercheckweg 1, 69117 Heidelberg, Germany u 2 PRISMA Cluster of Excellence and Mainz Institute for Theoretical Physics, Johannes Gutenberg University, 55099 Mainz, Germany

(Dated: August 5, 2014)

Sterile neutrino models with new gauge interactions in the sterile sector are phenomenologically interesting since they can lead to novel effects in neutrino oscillation experiments, in cosmology and in dark matter detectors, possibly even explaining some of the observed anomalies in these experiments. Here, we use data from neutrino oscillation experiments, in particular from MiniBooNE, MINOS and solar neutrino experiments, to constrain such models. We focus in particular on the case where the sterile sector gauge boson A ′ couples also to Standard Model particles (for instance to the baryon number current) and thus induces a large Mikheyev-Smirnov-Wolfenstein potential. For eV-scale sterile neutrinos, we obtain strong constraints especially from MINOS, which restricts the strength of the new interaction to be less than ∼ 10 times that of the Standard Model weak interaction unless active-sterile neutrino mixing is very small (sin 2 θ 24 glyph[lessorsimilar] 10 -3 ). This rules out gauge forces large enough to affect short-baseline experiments like MiniBooNE and it imposes nontrivial constraints on signals from sterile neutrino scattering in dark matter experiments.

PACS numbers: 14.60.St, 14.60.Pq

## 1. INTRODUCTION AND MOTIVATION

The possible existence of sterile neutrinos (Standard Model singlet fermions) with masses of order eV has been a widely discussed topic in astroparticle physics over the past few years. It is motivated by several anomalous results from short-baseline neutrino oscillation experiments, in particular the excesses of ν e and ¯ ν e events in a ν µ and ¯ ν µ beam respectively observed by LSND [1] and MiniBooNE [2], the apparently lower than expected ¯ ν e flux from nuclear reactors [3-5] (see however [6]) and the deficit of ν e in radioactive source experiments [7, 8]. Global fits [9-11, 11-15] show that these anomalies could be explained if sterile neutrinos with O (eV) mass and O (10%) mixing with ν e and ν µ exist. However, global fits also reveal that it is difficult to reconcile such a scenario with existing null results from other short-baseline oscillation experiments.

Constraints come also from cosmological observations, which slightly disfavor scenarios with extra relativistic degrees of freedom in the early Universe [16]. Cosmology also imposes a tight constraint on the sum of neutrino masses ∑ j m νj &lt; 0 23, . where the sum runs over all neutrino mass eigenstates that are in thermal equilibrium in the early Universe. Note that these constraints would be relaxed if the recent BICEP-2 data on B-modes in the cosmic microwave background [17] is confirmed [18-22].

An interesting scenario that is unconstrained by cosmology is self-interacting sterile neutrinos [23, 24]. If interactions among sterile neutrinos are mediated by a scalar or gauge boson with

∗ Email: jkopp@uni-mainz.de

† Email: welter@mpi-hd.mpg.de

a mass of order MeV or lighter, sterile neutrinos will feel a strong thermal potential in the early Universe which suppresses their mixing with active neutrinos and thus prohibits their production through oscillations. Moreover, if the new interaction couples not only to sterile neutrinos, but also to dark matter, it has the potential to explain several problems with cosmic structure formation at small scales [24, 25].

If a new interaction is shared between sterile neutrinos and ordinary matter (for instance in models with gauged baryon number coupled to sterile neutrinos and in scenarios in which a sterile sector gauge boson mixes kinetically with the photon), interesting signals in direct dark matter searches are possible [26-29]. The increased neutrino-nucleus scattering cross section might even explain some of the excess events observed by several experiments. On the other hand, such scenarios are more challenging for cosmology because of an additional sterile neutrino production mechanism through the gauge interaction. (Note that these constraints are still avoided for instance in scenarios with extra entropy production in the visible sector after sterile neutrino decoupling [30].)

In this paper, we investigate how novel interactions between sterile neutrinos and ordinary matter are constrained by neutrino oscillation experiments at short and long baseline. This topic has been discussed in a previous paper [31], the conclusions of which we will update below. For definiteness, we will focus on scenarios similar to the 'baryonic sterile neutrino' scenario first introduced in [26], where the sterile neutrino couples to gauged baryon number. We emphasize, however, that our results are directly applicable to any theory in which sterile neutrinos interact with Standard Model (SM) fermions through a new gauge force under which ordinary matter carries a net charge. (The last condition excludes models in which the coupling is only through kinetic mixing between the new gauge boson and the photon.) The new gauge current creates a MikheyevSmirnov-Wolfenstein (MSW) potential for sterile neutrinos propagating through ordinary matter and has thus a potentially large impact on neutrino oscillations. Since the mass of the new gauge boson in this model can be as low as 10 MeV (see [27] for detailed constraints) and since constraints on its coupling are weak [26], the strength of the effective interaction can be more than two orders of magnitude larger than the SM weak interactions responsible for the ordinary MSW effect. This implies that resonant enhancement of the oscillation amplitude could be relevant at O (GeV) energies even for relatively large mass squared difference ∆ m 2 41 ∼ eV between the mostly sterile and mostly active mass eigenstates. The model could thus potentially allow an explanation of some of the short-baseline oscillation anomalies with significantly smaller vacuum mixing angles than in sterile neutrino scenarios without new interactions.

The structure of the paper is as follows. In section 2, we briefly review models with new interactions in the sterile sector in general, and the 'baryonic neutrino' model from [26] in particular. We map these models onto an effective field theory and discuss their implications for neutrino oscillations. In particular, we derive approximate analytical formulas for the oscillation probabilities. In section 3, we then present our main numerical results, which will set strong constraints on new forces coupling sterile neutrinos to SM particles. We will summarize and conclude in section 4.

## 2. MODELS AND FORMALISM

## 2.1. New gauge bosons in the sterile neutrino sector

In the following we shortly describe the model proposed in [26, 27], originally introduced to study the impact of a new gauge force in the sterile neutrino sector on dark matter searches. The basic idea is to introduce a fourth left-handed neutrino flavour ν b , sterile under SM interactions, which can have a relatively large coupling to baryons (10 2 -10 3 times larger than the Fermi constant G F ) without being in conflict with current experimental bounds, like for examples constraints coming

from meson decays such as K → πν ν ¯ b b [26]. It can be implemented by introducing a new U (1) B gauge symmetry under which quarks have charge g / b 3 and the baryonic neutrino ν b has charge g ′ b . We will assume g b and g ′ b to be of order 0.1-1. To cancel anomalies, the introduction of additional fermions charged under U (1) B will be necessary, but we assume that these do not mix significantly with SM neutrinos and can be neglected. The baryonic gauge boson X acquires a mass when U (1) B is broken by a new sterile sector Higgs field h b . The relevant part of the Lagrangian after symmetry breaking can be written as [26]

$$\mathcal { L } & \, \supset & \, - \frac { 1 } { 4 } F _ { X, \mu \nu } F _ { X } ^ { \mu \nu } + \frac { 1 } { 2 } m _ { X } ^ { 2 } X _ { \mu } X ^ { \mu } \\ & \, + \bar { \nu } _ { b } \gamma _ { \mu } ( i \partial ^ { \mu } + g _ { b } ^ { \prime } X ^ { \mu } ) \nu _ { b } + \sum _ { q } \bar { q } \left ( i \not \, \psi _ { \text{SM} } + \frac { 1 } { 3 } g _ { b } \gamma _ { \mu } X ^ { \mu } \right ) q + \mathcal { L } _ { m } \,,$$

where q are the SM quark fields, F X,µν ≡ ∂ X µ ν -∂ X ν µ is the field strength tensor of the baryonic vector boson X µ and m X ∼ 1 GeV is its mass. In a seesaw framework, the baryonic neutrino mixes with the SM through the terms

$$\mathcal { L } _ { m } = - \sum _ { \alpha, j } m _ { D } ^ { \alpha j } \bar { \nu } _ { L } ^ { \alpha } N _ { R } ^ { j } - \sum _ { j } m _ { b } ^ { j } \bar { \nu } _ { b L } N _ { R } ^ { j } - \frac { 1 } { 2 } \sum _ { i, j } m _ { R } ^ { i j } \overline { \left ( N _ { R } ^ { i } \right ) ^ { C } } N _ { R } ^ { j } + h. c. \,,$$

with the Dirac mass matrix m D of the active neutrinos ν α L , the Dirac mass vector of the baryonic neutrino m j b and the the Majorana mass matrix m ij R of the heavy right-handed neutrino fields N j R . The flavour index α runs over e , µ and τ , while the indices i and j run over all heavy right-handed neutrino states.

The Lagrangian of equation (1) implies the existence of a new MSW potential that sterile neutrinos experience while propagating in matter. This effect is caused by coherent elastic forward scattering on neutrons and protons and can lead to resonant enhancement of flavour oscillations. Since coherent forward scattering does not involve any momentum transfer, its amplitude can be most easily obtained from the low energy effective Lagrangian of baryonic neutral current interactions

$$\mathcal { L } _ { b, \text{eff} } \, = \, \frac { G _ { B } } { 2 } \left [ \bar { \nu } _ { b } \gamma _ { \mu } \left ( 1 - \gamma _ { 5 } \right ) \nu _ { b } \right ] \left [ \bar { p } \gamma ^ { \mu } p + \bar { n } \gamma ^ { \mu } n \right ].$$

Here, the effective coupling constant is G B ≡ g g /m b ′ b 2 X . By treating neutrons and protons as a static background field [32], we obtain the matter potential for sterile neutrinos

$$V _ { b } & = G _ { B } N _ { \text{ucl} }.$$

The potential for sterile anti-neutrinos has opposite sign. Here, N nucl is the number density of nucleons in the background matter. Note that G B can be either positive or negative, depending on the relative sign of g b and g ′ b . In the following analysis we will use the ratio of the coupling constants

$$\epsilon \equiv \frac { G _ { B } } { \sqrt { 2 } G _ { F } }$$

as a measure for the relative strength of V b compared to the potential V CC that charged current (CC) interactions with electrons induce for electron neutrinos in the SM. The baryonic potential can be written as

$$V _ { b } = V _ { \mathbb { C C } } \cdot G _ { B } / ( \sqrt { 2 } G _ { F } Y _ { e } ) = \epsilon V _ { \mathbb { C C } } / Y _ { e }$$

$$= \epsilon \cdot 7. 5 6 \cdot 1 0 ^ { - 1 4 } \ e V \cdot \left ( \frac { \rho } { g / c m ^ { 3 } } \right ),$$

where Y e is the number of electrons per nucleon.

As mentioned in the introduction, baryonic sterile neutrinos could lead to novel signals in direct dark matter searches thanks to an enhanced sterile neutrino-nucleus scattering rate. Typically, observable effects in current experiments are expected if glyph[epsilon1] glyph[greaterorsimilar] 100 [26-29]. We will see in section 3.2 that such large values of glyph[epsilon1] are largely excluded for eV scale sterile neutrinos with substantial mixing into the active sector.

We wish to stress here that, while we use baryonic sterile neutrinos as a benchmark scenario, our results will apply to any scenario in which sterile neutrinos have new gauge interactions with SM fermions. It is important to keep in mind, though, that models with new forces in the lepton sector are much more tightly constrained than new baryonic interactions (see e.g. [27] for a review).

The mass terms in equation (2) lead to flavour mixing between ν b and the active neutrinos, as can be seen by integrating out the heavy right-handed neutrinos and diagonalizing the resulting mass matrix. In this way, we obtain the 4 × 4 mixing matrix U connecting mass eigenstates | ν i 〉 and flavour eigenstates | ν α 〉 :

$$| \nu _ { \alpha } \rangle = \sum _ { i } U _ { \alpha i } ^ { * } | \nu _ { i } \rangle.$$

Since U is unitary, it can be parametrized by 6 rotation angles θ ij and 3 complex phases δ ij 1

$$U \, = \, R _ { 3 4 } \cdot R _ { 2 4 } ^ { \prime } \cdot R _ { 1 4 } ^ { \prime } \cdot R _ { 2 3 } \cdot R _ { 1 3 } ^ { \prime } \cdot R _ { 1 2 }.$$

Here, R ij describes a rotation matrix in the ij plane, while R ′ ij corresponds to a complex rotation by the angle θ ij and phase δ ij . Given the mixing matrix U and the mass squared difference ∆ m 2 41 between the mostly sterile mass eigenstate ν 4 and the mostly active mass eigenstate ν 1 , one can write down the effective Hamiltonian 2 in flavour space:

$$H _ { \text{eff} } ^ { \text{flavour} } = \frac { 1 } { 2 E } U \begin{pmatrix} 0 & & \\ & \Delta m _ { 2 1 } ^ { 2 } & \\ & & \Delta m _ { 3 1 } ^ { 2 } & \\ & & & \Delta m _ { 4 1 } ^ { 2 } \end{pmatrix} U ^ { \dagger } + \begin{pmatrix} V _ { C C } & & \\ & 0 & & \\ & & 0 & \\ & & & V _ { b } - V _ { N C } \end{pmatrix}.$$

Here, V NC ≡ -√ 2 G n / F n 2 is the contribution from SM neutral current interactions to the MSW potential. It is proportional to the number density n n of neutrons in the background material.

The oscillation probability P ν α → ν β ( ), t i.e. the probability for a neutrino of initial flavour α to be converted into flavour β after traveling a time t , can then be obtained by diagonalizing the effective Hamiltonian according to H flavour eff = ˜ diag( U λ , λ 1 2 , λ 3 , λ 4 ) ˜ U † and inserting the eigenvalues λ i and the effective mixing matrix ˜ U into the well-known formula

$$P _ { \nu _ { \alpha } \to \nu _ { \beta } } = \left | \left \langle \nu _ { \beta } | \nu _ { \alpha } ( t ) \right \rangle \right | ^ { 2 } = \left | \sum _ { j } \tilde { U } _ { \alpha j } ^ { * } \tilde { U } _ { \beta j } e ^ { - i \lambda _ { j } L } \right | ^ { 2 }.$$

1 We omit the Majorana phases here since they do not contribute to neutrino flavour oscillations.

2 Effective means that terms proportional to the unit matrix are omitted because they do not contribute to flavour oscillations. Also note that we assume a definite three-momentum that is the same for all contributing mass eigenstates so that one can approximate E i ≈ | p | + m / 2 i (2 E ). It is well-known that this approximation, though technically unjustified, leads to correct results for neutrino oscillation probabilities [33].

## 2.2. Approximate oscillation probabilities

As a prelude to the numerical fits we are going to present in section 3, we give here approximate analytic expressions for the oscillation probabilities in the baryonic sterile neutrino model and in models with new sterile neutrino-SM interactions in general. Similar calculations have been carried out previously in [31] and we will compare these results to ours in section 2.3.

Our starting point is to assume | ∆ m 2 41 | glyph[greatermuch] | ∆ m 2 31 | , ∆ m 2 21 , which is a good approximation at sufficiently short baselines. Moreover, we neglect the SM MSW potentials V NC (arising from Z exchange diagrams) and V CC (arising from W exchange diagrams) against the baryonic potential V b , which we assume to be much larger. With these approximations, mixing among the three active flavour eigenstates becomes irrelevant. (They can, however, still oscillate into each other through their mixing with ν b .) We also set U τ 4 = 0 for simplicity, following [31]. With these assumptions, diagonalization of the Hamiltonian H flavour eff from equation (10) yields for the eigenvalues λ i

$$\lambda _ { 1 } = \lambda _ { 2 } = 0, \quad \lambda _ { 3 } = \frac { 1 } { 2 } \left ( V _ { b } + \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } - A \right ), \quad \lambda _ { 4 } = \frac { 1 } { 2 } \left ( V _ { b } + \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } + A \right ). \quad \quad ( 1 2 )$$

The elements of the unitary matrix ˜ U are

$$\tilde { U } _ { \mu 1 } = \tilde { U } _ { e 1 } = 0, \quad | \tilde { U } _ { e 2 } | ^ { 2 } = \frac { | U _ { \mu 4 } | ^ { 2 } } { 1 - | U _ { s 4 } | ^ { 2 } }, \quad | \tilde { U } _ { \mu 2 } | ^ { 2 } = \frac { | U _ { e 4 } | ^ { 2 } } { 1 - | U _ { s 4 } | ^ { 2 } },$$

$$| \tilde { U } _ { e 4 } | ^ { 2 } = | U _ { e 4 } | ^ { 2 } \frac { \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } \left [ A + \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } - V _ { b } \right ] } { A \left [ A + \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } + V _ { b } \right ] }, \quad | \tilde { U } _ { \mu 4 } | ^ { 2 } = | U _ { \mu 4 } | ^ { 2 } \frac { \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } \left [ A + \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } - V _ { b } \right ] } { A \left [ A + \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } + V _ { b } \right ] }. \quad ( 1 3 )$$

Here, we have introduced the abbreviation

$$A \, = \, | V _ { b } | \cdot \sqrt { 1 + ( 4 | U _ { s 4 } | ^ { 2 } - 2 ) \, \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E V _ { b } } + \left ( \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E V _ { b } } \right ) ^ { 2 } }.$$

With these formulas at hand and using the unitarity condition ∑ i ˜ U ∗ αi ˜ U αi = 1 as well as the observation that ˜ U µ 2 ˜ U ∗ e 2 ˜ U ∗ µ 4 ˜ U e 4 is real, it is straightforward to calculate the oscillation probabilities according to equation (11). For α = µ and β = µ , e we obtain

$$P _ { \nu _ { \mu } \to \nu _ { e } } \, = \, & - 4 \frac { | U _ { e 4 } | ^ { 2 } | U _ { \mu 4 } | ^ { 2 } | U _ { s 4 } | ^ { 2 } } { 1 - | U _ { s 4 } | ^ { 2 } } \left ( \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E A } \right ) ^ { 2 } \sin ^ { 2 } \phi _ { 1 } + 2 \frac { | U _ { e 4 } | ^ { 2 } | U _ { \mu 4 } | ^ { 2 } } { ( 1 - | U _ { s 4 } | ^ { 2 } ) ^ { 2 } } \left ( 1 + \frac { V _ { b } - V _ { r e s } } { A } \right ) \sin ^ { 2 } \phi _ { 2 } \\ & + 2 \frac { | U _ { e 4 } | ^ { 2 } | U _ { \mu 4 } | ^ { 2 } } { ( 1 - | U _ { s 4 } | ^ { 2 } ) ^ { 2 } } \left ( 1 - \frac { V _ { b } - V _ { r e s } } { A } \right ) \sin ^ { 2 } \phi _ { 3 }, \\ & \quad \, \intertext { a, \dots 2 } \, \, \stackrel { 2 } { \lambda } \, \dots 2 \, \, \stackrel { 2 } { \lambda }$$

$$P _ { \nu _ { \mu } \to \nu _ { b } } \, = \, 4 | U _ { \mu 4 } | ^ { 2 } | U _ { s 4 } | ^ { 2 } \left ( \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E A } \right ) ^ { 2 } \sin ^ { 2 } \phi _ { 1 },$$

$$P _ { \nu _ { \mu } \to \nu _ { \mu } } \ = \ 1 - P _ { \nu _ { \mu } \to \nu _ { \epsilon } } - P _ { \nu _ { \mu } \to \nu _ { \theta } },$$

where the oscillation phases are

$$\phi _ { 1 } = \frac { \lambda _ { 4 } - \lambda _ { 3 } } { 2 } L = \frac { L } { 2 } A, \\. \quad \Delta _ { 1 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 } \Delta _ { 2 }$$

$$\phi _ { 2 } = \frac { \lambda _ { 3 } } { 2 } \bar { L } \quad \ = \frac { \bar { L } } { 4 } \left ( V _ { b } + \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } - A \right ),$$

$$\phi _ { 3 } = \frac { \lambda _ { 4 } } { 2 } L \quad \ = \frac { L } { 4 } \left ( V _ { b } + \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } + A \right )$$

and V res is the value of the matter potential at which A takes its minimal value | U s 4 | √ 1 -| U s 4 | 2 ∆ m /E 2 41 . It is given by

$$V _ { \text{res} } = - \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } \left ( 2 | U _ { s 4 } | ^ { 2 } - 1 \right )$$

and corresponds to the new MSW resonance condition. Whether the resonance is in the neutrino or anti-neutrino sector depends on the sign of V b , i.e. the relative sign of the charges g b and g ′ b . With the assumption sin 2 θ 24 &lt; . 0 5 and for V b &lt; 0 ( V b &gt; 0) the resonance condition can be fulfilled only in the neutrino (anti-neutrino) sector. For ∆ m 2 41 = 1 eV , a matter density of 3 g/cm 2 3 and a neutrino energy of 1 GeV, the resonance condition is fulfilled for neutrinos if glyph[epsilon1] = G / B √ 2 G F glyph[similarequal] - × 2 10 3 and for anti-neutrinos if glyph[epsilon1] has opposite sign. For oscillation experiments, we see that matter enhancement of active-to-sterile neutrino oscillations is expected predominantly in high energy ( O (GeV)) experiments and only if the new gauge force is several orders of magnitude stronger than SM weak interactions. For weaker gauge forces, the new resonance moves to higher energies that are only accessible with atmospheric or cosmic neutrinos.

Note that equation (21) has a structure similar to the expression for the standard MSW resonance condition. To see this, consider the matrix element | U s 4 | 2 in the parametrization of equation (9): | U s 4 | 2 = cos 2 θ 14 cos 2 θ 24 cos 2 θ 34 . If cos 2 θ 34 , cos 2 θ 14 ≈ 1, we have V res = -(∆ m / E 2 41 2 ) cos 2 θ 24 . However, unless ∆ m / E 2 41 2 is much larger than V b , oscillations at short baseline cannot be approximately described in an effective two-flavour framework, unlike the 3+1 model without non-standard matter effects. The reason is that, without the extra matter term, three eigenvalues of the Hamiltonian can be set to zero at short baseline, while large V b implies that this is only possible for two of them.

On the other hand, in the limit of very large matter potential, V b glyph[greatermuch] ∆ m / 2 41 (2 E ), the term proportional to sin 2 φ 2 in equation (15) dominates over the terms containing sin 2 φ 1 and sin 2 φ 3 since the latter two are of higher order in ∆ m / 2 41 (2 EV b ). If we furthermore assume the baseline is not too long, in particular (∆ m 2 41 ) 2 / (4 E V 2 b ) · L/ 2 glyph[lessmuch] 1, we can approximate φ 2 ≈ ( L/ 2)(1 -| U s 4 | 2 )∆ m / 2 41 (2 E ) and obtain for the oscillation probability of equation (15) the effective twoflavour formula

$$P _ { \nu _ { \mu } \to \nu _ { e } } \, \approx \, 4 \frac { | U _ { e 4 } | ^ { 2 } | U _ { \mu 4 } | ^ { 2 } } { ( 1 - | U _ { s 4 } | ^ { 2 } ) ^ { 2 } } \cdot \sin ^ { 2 } \left ( \frac { L } { 2 } \left ( 1 - | U _ { s 4 } | ^ { 2 } \right ) \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E } \right ) + \mathcal { O } \left ( \left ( \frac { \Delta m _ { 4 1 } ^ { 2 } } { 2 E V _ { b } } \right ) ^ { 2 } \right ).$$

As expected, in the limit of large matter potential V b , the corresponding neutrino ν b decouples from flavour oscillations, P ν µ → ν b ≈ 0 and the ν µ survival probability becomes P ν µ → ν µ ≈ 1 -P ν µ → ν e .

We do not expect that scenarios with large V b can explain the short-baseline anomalies better than conventional models without new interactions. The reactor [3-5] and gallium [7, 8] experiments were too low in energy; in LSND [1], neutrinos traveled mostly through air; MiniBooNE could in principle be sensitive to new matter effects, but resonant enhancement could only explain an anomaly in either the neutrino or the anti-neutrino sector, while the data shows similar deviations from expectations in both sectors. 3 On the other hand, we expect that MiniBooNE-along with long-baseline experiments like MINOS and with solar neutrinos-will impose tight constraints on V b .

3 Note that in earlier MiniBooNE data [34-36], there appeared to be mild tension between the neutrino and antineutrino mode data. This motivated the authors of [31] to consider resonantly enhanced active-sterile neutrino mixing even as a possible explanation of the MiniBooNE anomaly.

## 2.3. Accuracy of analytic approximations

In the following, we discuss the implications of sterile neutrinos with non-standard matter effects in terrestrial long-baseline experiments, taking MiniBooNE and MINOS as examples. In doing so, we also compare our analytic expressions (17) and (15) to a numerical computation in the full four flavour framework and to the results of [31].

To obtain the exact four-flavour oscillation probabilities, we diagonalize the effective Hamiltonian of equation (10) numerically and use the resulting eigenvalues and eigenvectors in equation (11). In doing so, we absorb the neutral current potential V NC into a redefinition of V b . 4 To average out fast oscillations that would not be resolvable by experiments, we also implement a low-pass filter by multiplying each term in the oscillation probability equation (11) by a Gaussian factor [37]. This yields:

$$P _ { \nu _ { \alpha } \to \nu _ { \beta } } \, = \, \sum _ { j, k } \tilde { U } _ { \alpha j } ^ { * } \tilde { U } _ { \beta j } \tilde { U } _ { \alpha k } \tilde { U } _ { \beta k } ^ { * } \exp \left [ - \, i L ( \lambda _ { j } - \lambda _ { k } ) \right ] \, \exp \left [ - \, L ^ { 2 } ( \lambda _ { j } - \lambda _ { k } ) ^ { 2 } \cdot \frac { \sigma _ { f } ( E ) ^ { 2 } } { 2 E ^ { 2 } } \right ],$$

where σ f ( E ) is the energy width of the filter, which is related to the energy resolution of the experiment. This form for the low-pass filter can also be motivated in a wave packet treatment, where the finite energy resolution of the production and detection processes determines the width of the neutrino wave packets (see [38] and references therein). When comparing analytical and numerical results, we also apply such a low-pass filter to the analytic expressions (15) and (17) by replacing the oscillation terms sin 2 φ i according to

↦

$$\sin ^ { 2 } \phi _ { i } \mapsto \frac { 1 } { 2 } \left ( 1 - \cos ( 2 \phi _ { i } ) \cdot \exp \left [ - \left ( 2 \phi _ { i } \right ) ^ { 2 } \frac { \sigma _ { f } ( E ) ^ { 2 } } { 2 E ^ { 2 } } \right ] \right ).$$

In the following, we choose σ f ( E ) = 0 01 GeV. .

In the calculation of the analytical formulas in [31] the eigenvalues λ i are approximated by setting A ≈ V b + ∆ m 2 41 2 E (i.e. taking | U s 4 | = 1 in equation (14)). This leads to λ 1 = λ 2 = λ 3 = 0 and λ 4 = V b +∆ m / E 2 41 2 . The oscillation phases of equations (18)-(20) then become φ 1 = φ 3 = 1 2 L V ( b + ∆ m / E 2 41 2 ) and φ 2 = 0. With this replacements our equation (15) reduces to equations (21)-(22) in [31]. In the limit of large V b we see from equation (22) that this approximation is only valid if L/ 2(1 -| U s 4 | 2 )∆ m / 2 41 (2 E ) glyph[lessmuch] 1.

Since the latter condition is fulfilled in the L/E regime at which the LSND and MiniBooNE experiments are sensitive to ν µ → ν e flavour transitions, the approximation from [31] is applicable there. This can be seen in figure 1, where the transition probabilities for neutrinos (in green) and anti-neutrinos (in blue) are shown for L = 541 m and E = 0 1-3 MeV. We have taken the . model parameters at the best fit point from [31] (which we will show to be in fact excluded by MINOS in section 3.2). Dashed curves correspond to our analytical approximation (equation (15)), which agrees extremely well with numerical results, while dotted curves show the approximation from equations (21)-(22) of [31]. The difference between the neutrino and anti-neutrino sectors originates from the different signs of the matter potential. As expected, glyph[epsilon1] &gt; 0 ( ⇔ V b &gt; 0) leads to a resonant enhancement of the anti-neutrino transition probabilities and a suppression of the neutrino transition probabilities compared to the case glyph[epsilon1] = 0 (black curve). We see that the approximations used in [31] are fairly accurate in the most relevant energy range below 1 GeV, but fail at higher energies.

4 This is only approximately correct if V b glyph[similarequal] V NC and the proton-to-neutron ratio is varying along the neutrino trajectory. Since we are mainly interested in scenarios with V b glyph[greatermuch] V NC , our results are insensitive to this subtlety.

L

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-9e441ee3-b6ca-45a0-8666-bd426c3dfcad.jpg)

L

H

@ D Figure 1: The electron neutrino (green) and anti-neutrino (blue) appearance probability in a model with a large MSW potential in the sterile sector (for instance the baryonic sterile neutrino model from [26]). We use the baseline L = 541 m and the energy range 0.1-3 GeV of the MiniBooNE experiment and take the favored model parameters from [31]: glyph[epsilon1] = G / B ( √ 2 G F ) = 1 3 . · 10 3 ( ⇔ V b = 2 · 10 -10 eV for ρ = 3 g/cm ), 3 ∆ m 2 41 = 0 47 eV , . 2 | U s 4 | 2 = 0 9, . | U e 4 | 2 = | U µ 4 | 2 = 0 05. . (We will see below, that this particular parameter point is in fact excluded by MINOS data, though.) For the standard oscillation parameters, we have used the results of the global fit 'Free Fluxes and RSBL' of [39]. In black, we show also the prediction of a sterile neutrino model without new interactions ( glyph[epsilon1] = 0). Dashed lines correspond to our analytic approximations, which coincide with numerical results (solid curves) in this baseline and energy range, while dotted lines show the results from [31].

e =

0

L

H

H

@

D

@

D

Figure 2: The figure shows the ν µ disappearance probability for the MINOS baseline of L = 735km and energies up to 10 GeV. We show the survival probability P ν µ → ν µ for glyph[epsilon1] = 0 (left panel) and glyph[epsilon1] = 1 3 . · 10 3 ( ⇔ V b = 2 10 · -10 eV for ρ = 3 g/cm ) (right panel) using the best fit parameters from the LSND/MiniBooNE 3 fit of [31]. Solid curves correspond to a numerical calculation in the full four flavour oscillation framework, using for the standard oscillation parameters the values from the fit 'Free Fluxes and RSBL' of [39]. Dashed curves show our analytic approximation, equation (17), while dotted curves correspond to equations 20 and 28 of [31]. The comparison shows that, when the new matter potential V b is switched on ( glyph[epsilon1] &gt; 0), the active-sterile oscillation mode dominates over the standard atmospheric oscillation pattern, an effect which is not captured by the approximations made in [31].

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-87b85e97-c35f-494c-9b58-06f1a31308ac.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-152b8a8f-67d3-473d-97e9-b6b74162872d.jpg)

Since standard and non-standard matter effects are most relevant at long baseline ( glyph[greaterorsimilar] few × 100 km), it is important to also study the disappearance probability 1 -P ν µ → ν µ as a function of energy for long-baseline oscillation experiments like MINOS. MINOS has measured P ν µ → ν µ at a baseline of L = 735 km in the energy range 1-50 GeV. The oscillation probabilities for this baseline and energy range are shown in figure 2 for glyph[epsilon1] &gt; 0 (right panel) and also for the Standard Model ( glyph[epsilon1] = 0, left panel). We see that, due to matter-enhanced oscillations inside the earth, a scenario with strong non-standard matter effects leads to very large muon disappearance even at energies as high as 10 GeV, well above the standard oscillation maximum at ∼ 1 5 GeV. This is in conflict . with MINOS data and we therefore expect that MINOS is able to place very strong constraints on new matter effects in the sterile neutrino sector. Figure 2 also implies that the parameters favored in [31] are ruled out by MINOS.

Comparing numerical results (solid lines) to our analytic approximation (dashed lines), we find, as expected, that the approximations of equations (15) and (17) are accurate at ∆ m L/ 2 31 (2 E ) ∼ 1 only if V b is very large. We also see that the analytic approximations from [31] (dotted curves in figure 2) are not applicable at long baseline even for large V b . For example, in the MINOS case, ∆ m L/ 2 41 (2 E ) · eV 2 ∼ 100 for ∆ m 2 41 ∼ eV , the phase 2 φ 2 (see equations (19) and (22)) becomes non-negligible. This is the reason why our conclusions regarding the importance of MINOS data for constraining sterile neutrino matter effects differ from those of [31], where φ 2 has been neglected.

## 3. CONSTRAINTS FROM OSCILLATION EXPERIMENTS

From the analysis in the previous section we expect that the baryonic sterile neutrino model (or models with new sterile neutrino-SM interactions in general) could potentially explain by resonant enhancement an event excess in the MiniBooNE neutrino or anti-neutrino data (but not in both), but is strongly constrained by data from long-baseline experiments. Therefore, we now derive limits on the model using a numerical χ 2 analysis of data from MiniBooNE, MINOS and also solar neutrino experiments.

## 3.1. Analysis method

In our analysis we fix the standard oscillation parameters at their best fit values from the global fit by Gonzalez-Garcia et al. [39] (see table I) and we assume a normal mass ordering. We have checked that our results for inverted ordering are very similar, with only the solar limits becoming somewhat weaker. (We will comment on this in more detail in section 3.2.) For simplicity we set δ 13 = δ 14 = δ 24 = 0 because none of the experiments considered here is sensitive to CP violation in the small V b limit and equations (15)-(17) show that also the leading terms in the oscillation probabilities for large V b are independent of complex phases. We fix the mixing angle θ 34 = 0 since MiniBooNE is not sensitive to this angle and MINOS has only very limited sensitivity [15]. The impact of θ 34 &gt; 0 on the constraints from solar experiments will be discussed in section 3.2. Finally, we set sin 2 2 θ 14 = 0 12 so that the reactor anomaly [3-5] can be explained. We will comment on the . effect of relaxing this assumption also in section 3.2. The constraints we impose on the parameter space are also summarized in table I. The remaining three parameters glyph[epsilon1] = G / B ( √ 2 G F ), ∆ m 2 41 and θ 24 are scanned over the ranges | glyph[epsilon1] | = 1 -32000, ∆ m /eV 2 41 2 = 0 01 . -11 and sin 2 θ 24 = 0 0001 . -1.

We now discuss the details of our fits to MINOS, MiniBooNE and solar neutrino data.

Table I: The parameter values of the baryonic sterile neutrino model that we have fixed in our parameter scan.

| sin 2 θ 12   | sin 2 θ 23   | sin 2 θ 13   | ∆ m 2 21 [eV 2 ]   | ∆ m 2 31 [eV 2 ]   |   δ 13 , δ 14 δ 24 | sin 2 2 θ 14   |   sin 2 θ 34 |
|--------------|--------------|--------------|--------------------|--------------------|--------------------|----------------|--------------|
| 0 . 302      | 0 . 413      | 0 . 0227     | 7 . 5 · 10 - 5     | 2 . 473 · 10 - 3   |                  0 | 0 . 12         |            0 |

## 3.1.1. MINOS

For MINOS, we use GLoBES [40, 41] to compute the energy dependent oscillation probabilities P near ( E ) for the near detector and P far ( E ) for the far detector numerically. We include a low pass filter according to equation (23) with σ f ( E ) = 0 06 . · E . The matter density ρ along the neutrino trajectory to the far detector is assumed to be constant at its average value

$$\langle \rho _ { \text{far} } \rangle \ = \ \frac { 2 } { L _ { \text{far} } } \int _ { \sqrt { R _ { \oplus } ^ { 2 } - ( L _ { \text{far} } / 2 ) ^ { 2 } } } ^ { R _ { \oplus } } \rho ( r ) \frac { d } { d r } \left ( \sqrt { r ^ { 2 } - R _ { \oplus } ^ { 2 } + ( L _ { \text{far} } / 2 ) ^ { 2 } } \right ) d r.$$

In this expression, which can be understood from geometric arguments, r is the distance of the neutrino from the center of the earth, R ⊕ is the radius of the earth and L far = 735km is the neutrino path length from the source to the far detector [42]. Using the matter density profile from the Preliminary Reference Earth Model (PREM) [43] we obtain 〈 ρ far 〉 ≈ 2 36 g . / cm . 3

For large V b , matter effects can be relevant even in the near detector at a baseline L target = 965m from the target. In computing the average matter density 〈 ρ 〉 near that neutrinos experience on their way to the near detector, we account for the fact that they first travel along the evacuated decay pipe with a length of L pipe = 675m. We estimate 〈 ρ 〉 near ≈ ( L target -L pipe ) /L near · 3 g cm 3 , where L near glyph[similarequal] 763 m is the average distance between the neutrino production vertex and the near detector. It is obtained from the decay length of the neutrinos' parent pions, which have an average energy of 4 -5 GeV [44].

We compute the theoretically predicted event spectrum N osc by multiplying the ratio P far ( E /P ) near ( E ) with the background-subtracted prediction for the MINOS event rate in the absence of oscillations, N no osc :

$$N _ { \text{osc} } ( E ) = \left [ N _ { \text{no osc} } ( E ) - N _ { \text{bg} } ( E ) \right ] \frac { P _ { \text{far} } ( E ) } { P _ { \text{near} } ( E ) }.$$

The no-oscllation rate N no osc ( E ) and the background rate N bg ( E ) are taken from [45], which is similar to [46] but contains data up to 50 GeV. The higher energy data is important to us since it increases the sensitivity at low matter potential V b .

To account for the finite energy resolution of the detector, we fold N osc with the detector response function f ( E,E ′ ), which maps the true event energy E ′ to the reconstructed energy E . Finally, we also add the small experimental background N bg ( E ):

$$N _ { \text{th} } ( E ) = N _ { \text{bg} } ( E ) + \int _ { \text{f} } ( E, E ^ { \prime } ) N _ { \text{osc} } ( E ^ { \prime } ) d E ^ { \prime }.$$

We assume a Gaussian shape for f ( E,E ′ ),

$$f ( E, E ^ { \prime } ) = \frac { 1 } { \sigma ( E ^ { \prime } ) \sqrt { 2 \pi } } \exp \left ( - \frac { ( E - E ^ { \prime } ) ^ { 2 } } { 2 \sigma ^ { 2 } ( E ^ { \prime } ) } \right ),$$

where we choose σ E ( ′ ) = 0 2 GeV . √ E / ′ GeV. This choice allows us to reproduce the oscillated event rates and the constraints on θ 23 and ∆ m 2 31 from [46] with good accuracy. When evaluating

equation (27) numerically, we discretize the integral so that N osc ( E ) needs to be evaluated only at fixed support points E ′ j with a step size of ∆ E ′ j = 0 25 GeV in between. . (We have checked that choosing a smaller value for ∆ E ′ j does not change our results significantly, which implies that possible aliasing effects are under control.) Following the MINOS analysis [45], events are binned for the analysis according to their reconstructed energy E . The rate in th i -th bin is given by

$$N _ { \text{th} } ^ { i } = \int _ { E _ { i } - \Delta E _ { i } / 2 } ^ { E _ { i } + \Delta E _ { i } / 2 } N _ { \text{th} } ( E ) \, d E = N _ { \text{bg} } ^ { i } + \sum _ { j } F ^ { i j } N _ { \text{osc} } ( E _ { j } ^ { \prime } ),$$

where N i bg is the total background in the i -th bin and the elements of the detector response matrix F ij are F ij ≡ = ∫ E i +∆ E / i 2 E i -∆ E / i 2 f ( E,E ′ j ) dE . It is important to note that the F ij need to be computed only once.

From equation (29) we compute χ 2 according to

$$\chi ^ { 2 } = \sum _ { i } \left ( \frac { N _ { t h } ^ { i } - N _ { \exp } ^ { i } } { \sqrt { N _ { \exp } ^ { i } } + 0. 1 \cdot N _ { \exp } ^ { i } } \right ) ^ { 2 },$$

where N i exp is the observed event rate in the i -th energy bin [45] and the sum runs over all energy bins. Note that we have included an additional uncertainty of 10% in order to account for systematic errors without modeling them in detail. Like our choice of σ E ( ′ ) in equation (28), also our simplified treatment of systematic errors has been confirmed by cross-checking our simulations against the results of [15, 46].

In figure 3, we compare our prediction for the oscillated neutrino spectrum in MINOS assuming standard 3-flavour oscillations (blue shaded histogram) to the official MINOS prediction (blue unshaded histogram) and to the data (black points with error bars). We find excellent agreement, which validates our calculations. We also show the MINOS no oscillation prediction (red histogram) which is the starting point for our predictions, as well as the survival probability P ν µ → ν µ (dashed green line; corresponding vertical scale shown on the right).

## 3.1.2. MiniBooNE

As for MINOS, the oscillation probabilities for MiniBooNE are calculated numerically in the full four flavour framework with the help of GLoBES [40, 41], including a low pass filter according to equation (23) with σ f ( E ) = 0 06 . E . Since the MiniBooNE decay pipe is only 50 m long, while the distance from the target to the detector is L = 541 m, we neglect the effect of the finite pion decay length. Instead, we take the matter density to be 〈 ρ 〉 ∼ 3 g / cm 3 along the whole neutrino trajectory.

We use a χ 2 analysis to compare our predicted oscillation probabilities with the experimentally measured probabilities, which are given in [47] as a function of L/E . The data from [47] are shown in figure 4 together with the trivial no-oscillation prediction and with our prediction for the MiniBooNE best fit points in the baryonic sterile neutrino scenario for glyph[epsilon1] &gt; 0 and glyph[epsilon1] &lt; 0.

## 3.1.3. Solar neutrinos

We analyze solar neutrino oscillation data by comparing the measured ν e survival probability P ν e → ν e at different energies to our theoretical predictions. The data points are taken from [48] and include results from Super-Kamiokande, SNO, Borexino and radiochemical experiments.

L

H

GLYPH&lt;144&gt;

L

L

H

GLYPH&lt;144&gt;

L

H

H

@ D @ D Figure 3: The measured and predicted event spectra for the MINOS ν µ (left) and ν µ (right) disappearance measurements. The red histogram is the MINOS prediction assuming no neutrino oscillation [45]. In blue, we show the predicted event spectrum including oscillations according to equation (27), assuming standard three flavour oscillations with the parameters listed in table I. The blue shaded histogram is our prediction, the unshaded histogram is the prediction by the MINOS collaboration. We overlay the survival probability P ν µ → ν µ (dashed green curve and vertical scale on the right).

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-4526033b-0d2d-4a7e-b9fd-e255bb50724a.jpg)

n

L

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-d5184eeb-f0db-499d-8b9d-2d95e7512362.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-3140f7e3-f19e-4c3c-911b-853dcbc20eab.jpg)

L

H

H

GLYPH&lt;144&gt; @ GLYPH&lt;144&gt; D GLYPH&lt;144&gt; @ GLYPH&lt;144&gt; D Figure 4: The measured MiniBooNE ν µ → ν e (left) and ¯ ν µ → ¯ ν e (right) appearance probabilities compared to the predictions of the baryonic sterile neutrino scenario for glyph[epsilon1] &gt; 0 (blue line) and glyph[epsilon1] &lt; 0 (dashed red line) at the MiniBooNE best fit points from table II. Without sterile neutrinos, the appearance probability at the MiniBooNE baseline is approximately zero (solid black line).

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-528d633b-d8e3-4489-9e40-0b73c4800e0c.jpg)

In calculating P ν e → ν e , we assume MSW flavour transitions to be fully adiabatic and we account for the fact that solar neutrinos arrive at the earth as an incoherent mixture of mass eigenstates. We obtain P ν e → ν e according to

$$P _ { \nu _ { e } \to \nu _ { e } } = \sum _ { i } | U _ { e i } | ^ { 2 } \cdot | \tilde { U } _ { e i } ( 0 ) | ^ { 2 },$$

where ˜ U ei (0) is the mixing matrix in matter at the center of the Sun ( t = 0) and U ei is the vacuum

GLYPH&lt;144&gt;

mixing matrix. We neglect earth matter effects here, but we have checked that, in the parameter ranges of interest to us, the day-night effect caused by the earth matter is of the order of few per cent, comparable to the day-night effect in the Standard Model. We thus anticipate that our limits would only change marginally if Earth matter effects were included.

In order to verify that the assumption of full adiabaticity is justified, we have examined the adiabaticity parameter γ in the two flavour approximation and we have checked that the adiabaticity condition [32]

$$\gamma ^ { - 1 } = \frac { \sin 2 \theta \frac { \Delta m _ { i j } ^ { 2 } } { 2 E } } { | \lambda _ { i } - \lambda _ { j } | ^ { 3 } } \cdot \left | \frac { d V _ { b } } { d t } \right | \ll 1$$

holds for all relevant mass squared difference ∆ m 2 ij even for large V b and the smallest relevant differences between the Hamiltonian eigenvalues λ i and λ j , which occur at the resonance position. We determine the derivative of the matter potential, ∣ ∣ dV /dt b ∣ ∣ , from the solar density profile of the standard solar model BS'05 (OP) [49].

In figure 5, we compare the measured solar neutrino oscillation probabilities P ν e → ν e to the theoretical predictions for standard three flavour oscillations and for the best fitting baryonic neutrino scenarios with glyph[epsilon1] &gt; 0 (blue) and glyph[epsilon1] &lt; 0 (red).

We observe that for glyph[epsilon1] &lt; 0, a peak-like structure appears in P ν e → ν e , which suggests that mixing of ν e with other flavors is dynamically driven to zero for specific parameter combinations. The peak occurs at parameter points where ∆ m / 2 41 (2 E , ) ∆ m / 2 31 (2 E ) glyph[greatermuch] ∆ m / 2 21 (2 E ), V b and where moreover θ 34 and θ 13 are small. To understand its origin, it is therefore helpful to determine the eigenvalues of the Hamiltonian H flavor eff (see equation (10)) using time-independent perturbation theory, with the zeroth order Hamiltonian given by

$$H _ { \text{eff} } ^ { \text{flavour}, ( 0 ) } \equiv \frac { 1 } { 2 E } U \text{diag} ( 0, 0, \Delta m _ { 3 1 } ^ { 2 }, \Delta m _ { 4 1 } ^ { 2 } ) U ^ { \dagger } \,,$$

and the perturbation being H flavour,(1) eff ≡ H flavour eff -H flavour,(0) eff . In the approximation θ 34 = θ 13 = 0, a set of zeroth order eigenvectors is obviously given by the matrix U (0) ≡ R ′ 24 R ′ 14 R 23 , where, as before, R ij and R ′ ij are real and complex rotation matrices, respectively. Since H flavour,(0) eff has zero as a double eigenvalue, we next have to find eigenvectors of H flavour,(1) eff in the subspace corresponding to this double eigenvalue. In other words, we need to compute U (0) † H flavour,(1) eff U (0) and then diagonalize the upper left 2 × 2 block. It turns out that, if the condition

$$\frac { \Delta m _ { 2 1 } ^ { 2 } } { 2 E } \sin 2 \theta _ { 1 2 } + V _ { b } \cos \theta _ { 2 3 } \sin \theta _ { 1 4 } \sin 2 \theta _ { 2 4 } \simeq 0$$

is fulfilled, this 2 × 2 block is automatically diagonal. This implies that U (0) (1 0 0 0) , , , T glyph[similarequal] (1 , 0 0 0) , , is an approximate eigenvector of H flavour eff . Hence, if (34) holds at the center of the Sun, solar neutrinos are produced in an almost pure ν 1 mass eigenstate. After adiabatic flavour conversion, the resulting ν e admixture is of order cos θ 2 12 , leading to a peak in the observed solar neutrino spectrum at Earth.

## 3.2. Results

In figures 6 and 7 our constraints on the parameter space of baryonic sterile neutrinos are presented as contour plots for glyph[epsilon1] &gt; 0 and glyph[epsilon1] &lt; 0, respectively. We show exclusion limits (lines of constant χ 2 -χ 2 min ) at the 95% and 3 σ confidence levels. In each panel, we keep either glyph[epsilon1] or ∆ m 2 41

L

H

@ D Figure 5: Comparison of the measured solar neutrino oscillation probabilities to our theoretical predictions for standard three flavour oscillations (black) and for the best fit parameter points of the baryonic sterile neutrino model with glyph[epsilon1] &gt; 0 (dotted blue) and glyph[epsilon1] &lt; 0 (dashed red).

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-7a6c8a00-1a41-4f23-ad69-a43b00f43c0b.jpg)

|           |                     | glyph[epsilon1] = G B / ( √ 2 G F )   | ∆ m 2 41 [eV 2 ]   | sin 2 θ 24   | χ 2 min / d.o.f.   |
|-----------|---------------------|---------------------------------------|--------------------|--------------|--------------------|
| MINOS     | glyph[epsilon1] > 0 | 16 . 9                                | 0 . 014            | 0 . 0024     | 37 . 7 / 49        |
| MINOS     | glyph[epsilon1] < 0 | - 19 . 2                              | 0 . 037            | 0 . 00083    | 36 . 1 / 49        |
| MiniBooNE | glyph[epsilon1] > 0 | 30634                                 | 0 . 316            | 0 . 10       | 16 . 1 / 20        |
| MiniBooNE | glyph[epsilon1] < 0 | - 32000                               | 0 . 116            | 0 . 75       | 16 . 4 / 20        |
| Solar     | glyph[epsilon1] > 0 | 0 . 20                                | insensitive        | 1 . 0        | 1 . 10 / 3         |
| Solar     | glyph[epsilon1] < 0 | - 38 . 0                              | 0 . 013            | 0 . 046      | 0 . 41 / 3         |

Table II: Best fit values resulting from our parameter scan for the different experimental data sets. For the MiniBooNE fit with glyph[epsilon1] &lt; 0 analysis the best fit value for glyph[epsilon1] is located outside the boundary of the analysis region, but χ 2 hardly depends on | glyph[epsilon1] | in this region. Also note that the solar best fit in the glyph[epsilon1] &gt; 0 case has glyph[epsilon1] &lt; 1 and is not sensitive to the exact value of ∆ m 2 41 in the interval [0 01 . , 11].

fixed at the value indicated in the plot and show constraints on the remaining two parameters. Moreover, as discussed in section 3.1, we fixed sin 2 2 θ 14 = 0 12. Blue lines correspond to constraints . from solar experiments, black lines are the limits from MINOS and the colored regions show the parameter region preferred by MiniBooNE. The best fit values for glyph[epsilon1] &gt; 0 and glyph[epsilon1] &lt; 0 are listed in table II.

We see that values of | glyph[epsilon1] | glyph[greaterorsimilar] 10 are strongly disfavored by MINOS except in the case of tiny activesterile mixing angles. For such large values of glyph[epsilon1] , the new MSW resonance at ∆ m / 2 41 (2 E ) ∼ V b lies within the MINOS energy range E &lt; 50 GeV and leads to a constraint sin 2 θ 24 glyph[lessorsimilar] 10 -3 . Such small mixing angles are, however, irrelevant for possible explanations of MiniBooNE and other short-baseline anomalies. The MINOS contours also show that in most of the mass range 10 -2 eV 2 glyph[lessorsimilar] ∆ m 2 41 glyph[lessorsimilar] 10 1 eV , values of sin 2 2 θ 24 glyph[greaterorsimilar] 0 01 are excluded, with limits becoming much . stronger at large glyph[epsilon1] .

Solar neutrinos also have some sensitivity to θ 24 , but limits on glyph[epsilon1] vary a lot with sin 2 θ 24 . For intermediate values 0 01 . glyph[lessorsimilar] sin 2 θ 24 glyph[lessorsimilar] 0 1, even values of . | glyph[epsilon1] | as large as few × 10 3 are compatible with solar neutrino data. For glyph[epsilon1] &gt; 0, we notice that solar limits on glyph[epsilon1] are weakest at sin 2 θ 24 ∼ few × 10 -2 .

Figure 6: 95% and 3 σ confidence level constraints on the parameters ∆ m 2 41 , sin 2 2 θ 24 and glyph[epsilon1] (strength of the new MSW potential) of the baryonic sterile neutrino model in the glyph[epsilon1] &gt; 0 case. Blue contours show constraints from solar experiments, black contours are for MINOS and shaded areas correspond to the region preferred by MiniBooNE. We have fixed sin 2 2 θ 14 = 0 12, as motivated by the reactor and gallium anomalies. .

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-2a849031-cc9a-4842-b453-660fc8f936c1.jpg)

Figure 7: 95% and 3 σ confidence level constraints on the parameters ∆ m 2 41 , sin 2 2 θ 24 and glyph[epsilon1] (strength of the new MSW potential) of the baryonic sterile neutrino model in the glyph[epsilon1] &lt; 0 case. Blue contours show constraints from solar experiments, black contours are for MINOS and shaded areas correspond to the region preferred by MiniBooNE. We have fixed sin 2 2 θ 14 = 0 12, as motivated by the reactor and gallium anomalies. .

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-a3acc712-296b-49b7-ac8c-c58061875933.jpg)

e

24

Figure 8: Constraints on glyph[epsilon1] and sin 2 θ 24 from solar neutrinos for fixed sin 2 2 θ 14 = 0 12 (as motivated by the . reactor and gallium anomalies), but for different values of θ 34 . The value of ∆ m 2 41 has been marginalized over in the range 10 -2 ≤ ∆ m 2 41 ≤ 1 1 . · 10 . 1

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-c3114924-60a9-4472-afe7-ed17c4544e6f.jpg)

In this regime, the additional neutrino disappearance due to nonzero θ 14 and θ 24 is partially compensated by V b -induced modifications to the MSW resonance structure. In particular, the 1-4 and 2-4 mixings imply that above the solar MSW resonance, ν 1 -ν 2 mixing is not as strongly suppressed as in the standard case. This reduces the flavour transition probability at energies above the resonance. Note that this effect is related to a sterile neutrino-induced smearing of the atmospheric resonance (which at the center of the Sun lies at about 200 MeV) to the extent that it has a small impact even at energies as low as ∼ 10 MeV. The effect is therefore absent if the neutrino mass ordering is inverted so that the atmospheric resonance lies in the anti-neutrino sector. We have checked that indeed the limits on glyph[epsilon1] from solar neutrino experiments become somewhat weaker in this case. For glyph[epsilon1] &lt; 0, the exclusion contours reveal an allowed 'island' at glyph[epsilon1] ∼ -10 . 3 In the parameter region corresponding to these islands, the non-standard MSW resonance at ∆ m / E 2 41 2 glyph[similarequal] V b mimics the effect of the standard solar resonance. Also, in this parameter region, the atmospheric MSW resonance-modified by the presence of the sterile neutrinos-has a small impact. Therefore, the 'islands' move down by almost an order of magnitude in | glyph[epsilon1] | if the neutrino mass ordering is inverted. The ∆ m 2 41 -independent 'peninsula' at glyph[epsilon1] ∼ -20, is related to the appearance of the peak structure in P ν e → ν e which we discussed in section 3.1.3 and which is independent of the mass ordering.

The allowed parameter region for the measured appearance signal in MiniBooNE is very similar to the one obtained in conventional sterile neutrino scenarios (see for instance the analysis by the MiniBooNE collaboration themselves [2]) with the exception that for large matter potentials, the allowed region is expanded towards lower sin 2 θ 24 and higher ∆ m 2 41 .

We now relax our assumption θ 34 = 0. The main sensitivity to θ 34 is expected to come from solar neutrinos [15] (and from MINOS neutral current measurements, which we did not consider in this work, though). We compare the solar neutrino limits in the sin 2 θ 24 -glyph[epsilon1] plane for different values of θ 34 in figure 8, marginalizing over the sterile neutrino mass in the range 10 -2 ≤ ∆ m 2 41 ≤ 1 1 . · 10 . 1 We see that the constraints on glyph[epsilon1] become somewhat weaker if sin 2 θ 34 ∼ 0 01 and change significantly .

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-46b43039-f5b7-41f6-84ec-4530264151e0.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-2c868e65-95f1-45df-9f47-b7a50f5c134a.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0289v1-figure-92d0e600-f578-4955-9b8f-a25a110988a1.jpg)

e

Figure 9: The effect of varying θ 14 on the constraints in the sin 2 θ 24 -glyph[epsilon1] plane. The plot in the center reproduces middle panel in the upper row of figure 6, while the left and right panels show similar constraints for smaller and larger θ 14 , respectively.

for larger values of sin 2 θ 34 . This implies that, for large θ 34 , a scenario with strong non-standard matter potential can be consistent with solar data and with MiniBooNE. Nevertheless, such a scenario would still be ruled out by MINOS.

Finally, let us also discuss the effect of choosing sin 2 2 θ 14 different from the value 0.12 preferred by the reactor neutrino anomaly. To this end, we show in figure 9 how the constraints on glyph[epsilon1] and θ 24 for fixed ∆ m 2 41 are modified if sin 2 2 θ 14 is taken a factor of 2 smaller (left panel) or a factor of 2 larger (right panel) than the preferred value. We see that the MiniBooNE preferred region, which is sensitive only to the combination sin 2 2 θ 14 sin 2 θ 24 is simply shifted by a factor of 2. Solar limits are affected in a less trivial way and we find that at large θ 14 , there is even a preference for nonzero θ 24 . Note, however, that the goodness of fit becomes slightly worse as θ 14 is increased: the minimum χ / 2 dof is 0.8/3 for sin 2 2 θ 14 = 0 6 and 2.7/3 for sin . 2 2 θ 14 = 0 24. . Finally, MINOS limits are weakened if θ 14 is large, especially at large glyph[epsilon1] . This happens because a larger mixing between ν e and ν b by unitarity implies more ν µ disappearance.

## 4. CONCLUSIONS

To summarize, we have derived constraints on models with extended sterile neutrino sectors that feature in particular a new gauge interaction between sterile neutrinos and SM particles. As a specific example, we have considered a scenario in which eV-scale sterile neutrinos are charged under gauged baryon number U (1) B . In principle, such interactions could be several orders of magnitude stronger than SM weak interactions, so the Mikheyev-Smirnov-Wolfenstein (MSW) potentials they generate could be significantly larger than the matter potential in standard three-flavour neutrino oscillations.

We have also computed approximate analytic expressions for the relevant oscillation probabilities in matter, improving and extending the expressions previously derived in [31]. We have then numerically analyzed data from the MINOS experiment, from solar neutrino measurements and from MiniBooNE to show that new gauge interactions in the sterile neutrino sector cannot be large unless the active-sterile neutrino mixing is very small. In particular, if the ratio glyph[epsilon1] of the non-standard and standard matter potentials is larger than ∼ 10, MINOS excludes mixing angles down to sin 2 2 θ 24 ∼ 10 -3 . (This limit becomes stronger if θ 14 = 0.)

We conclude that sterile neutrino searches in oscillation experiments are powerful tools to con-

strain certain models with hidden sector gauge interactions. We also conclude that such models do not help to resolve the tension in the global fit to short-baseline oscillation data.

Comparing to the interaction strength required for baryonic sterile neutrinos to yield signals in dark matter detectors [26-29], we conclude that in the case of eV scale sterile neutrinos, baryonic interactions cannot be large enough to be observable in the current generation of experiments. On the other hand, interesting signals may still be possible in future ton-scale experiments.

## Acknowledgments

It is a pleasure to thank Janet Conrad and Georgia Karagiorgi for very helpful discussions.

- [1] A. Aguilar et al. (LSND), Phys. Rev. D64 , 112007 (2001), hep-ex/0104049.
- [2] A. Aguilar-Arevalo et al. (MiniBooNE Collaboration) (2012), 1207.4809.
- [3] T. Mueller, D. Lhuillier, M. Fallot, A. Letourneau, S. Cormon, et al., Phys.Rev. C83 , 054615 (2011), 1101.2663.
- [4] G. Mention, M. Fechner, T. Lasserre, T. Mueller, D. Lhuillier, et al., Phys.Rev. D83 , 073006 (2011), 1101.2755.
- [5] P. Huber, Phys.Rev. C84 , 024617 (2011), 1106.0687.
- [6] A. Hayes, J. Friar, G. Garvey, and G. Jonkmans (2013), 1309.4146.
- [7] M. A. Acero, C. Giunti, and M. Laveder, Phys.Rev. D78 , 073009 (2008), 0711.4222.
- [8] C. Giunti and M. Laveder, Phys.Rev. C83 , 065504 (2011), 1006.3244.
- [9] J. Kopp, M. Maltoni, and T. Schwetz, Phys.Rev.Lett. 107 , 091801 (2011), 1103.4570.
- [10] C. Giunti and M. Laveder, Phys.Lett. B706 , 200 (2011), 1111.1069.
- [11] G. Karagiorgi (2011), 1110.3735.
- [12] C. Giunti and M. Laveder, Phys.Rev. D84 , 093006 (2011), 1109.4033.
- [13] C. Giunti and M. Laveder, Phys.Rev. D84 , 073008 (2011), 1107.1452.
- [14] K. Abazajian, M. Acero, S. Agarwalla, A. Aguilar-Arevalo, C. Albright, et al. (2012), 1204.5379.
- [15] J. Kopp, P. A. N. Machado, M. Maltoni, and T. Schwetz, JHEP 1305 , 050 (2013), 1303.3011.
- [16] P. Ade et al. (Planck Collaboration) (2013), 1303.5076.
- [17] P. Ade et al. (BICEP2 Collaboration) (2014), 1403.3985.
- [18] E. Giusarma, E. Di Valentino, M. Lattanzi, A. Melchiorri, and O. Mena (2014), 1403.4852.
- [19] C. Dvorkin, M. Wyman, D. H. Rudd, and W. Hu (2014), 1403.8049.
- [20] H. Li, J.-Q. Xia, and X. Zhang (2014), 1404.0238.
- [21] J.-F. Zhang, Y.-H. Li, and X. Zhang (2014), 1403.7028.
- [22] M. Archidiacono, N. Fornengo, S. Gariazzo, C. Giunti, S. Hannestad, et al. (2014), 1404.1794.
- [23] S. Hannestad, R. S. Hansen, and T. Tram, Phys.Rev.Lett. 112 , 031802 (2014), 1310.5926.
- [24] B. Dasgupta and J. Kopp, Phys.Rev.Lett. 112 , 031803 (2014), 1310.6337.
- [25] T. Bringmann, J. Hasenkamp, and J. Kersten (2013), 1312.4947.
- [26] M. Pospelov, Phys.Rev. D84 , 085008 (2011), 1103.3261.
- [27] R. Harnik, J. Kopp, and P. A. Machado, JCAP 1207 , 026 (2012), 1202.6073.
- [28] M. Pospelov and J. Pradler, Phys.Rev. D85 , 113016 (2012), 1203.0545.
- [29] M. Pospelov and J. Pradler (2013), 1311.5764.
- [30] C. M. Ho and R. J. Scherrer, Phys.Rev. D87 , 065016 (2013), 1212.1689.
- [31] G. Karagiorgi, M. Shaevitz, and J. Conrad (2012), 1202.1024.
- [32] E. K. Akhmedov (1999), hep-ph/0001264.
- [33] C. Giunti and C. W. Kim, Fundamentals of Neutrino Physics and Astrophysics (OUP Oxford, New York, 2007).
- [34] A. Aguilar-Arevalo et al. (The MiniBooNE Collaboration), Phys.Rev.Lett. 98 , 231801 (2007), 0704.1500.
- [35] A. Aguilar-Arevalo et al. (MiniBooNE Collaboration), Phys.Rev.Lett. 103 , 111801 (2009), 0904.1958.

- [36] A. Aguilar-Arevalo et al. (The MiniBooNE Collaboration), Phys.Rev.Lett. 105 , 181801 (2010), 1007.1150.
- [37] P. Huber, J. Kopp, M. Lindner, M. Rolinec, and W. Winter, Globes manual (2013), URL http: //www.mpi-hd.mpg.de/personalhomes/globes/documentation/globes-manual-3.0.8.pdf .
- [38] M. Beuthe, Phys.Rept. 375 , 105 (2003), hep-ph/0109119.
- [39] M. Gonzalez-Garcia, M. Maltoni, J. Salvado, and T. Schwetz, JHEP 1212 , 123 (2012), 1209.3023.
- [40] P. Huber, M. Lindner, and W. Winter, Comput.Phys.Commun. 167 , 195 (2005), hep-ph/0407333.
- [41] P. Huber, J. Kopp, M. Lindner, M. Rolinec, and W. Winter, Comput.Phys.Commun. 177 , 432 (2007), hep-ph/0701187.
- [42] D. Michael et al. (MINOS Collaboration), Phys.Rev.Lett. 97 , 191801 (2006), hep-ex/0607088.
- [43] D. Anderson, Theory of the Earth (Blackwell Scientific Publications, 1989), ISBN 978-0-865-42123-3.
- [44] M. Diwan, B. Viren, D. Harris, A. Marchionni, J. Morfin, et al. (2004).
- [45] J. de Jong (MINOS Collaboration), Nucl.Phys.Proc.Suppl. 237-238 , 166 (2013).
- [46] P. Adamson et al. (MINOS Collaboration), Phys.Rev.Lett. 110 , 251801 (2013), 1304.6335.
- [47] A. Aguilar-Arevalo et al. (MiniBooNE Collaboration), Phys.Rev.Lett. 110 , 161801 (2013), 1207.4809.
- [48] G. Bellini et al. (Borexino Collaboration) (2013), 1308.0443.
- [49] J. N. Bahcall, A. M. Serenelli, and S. Basu, Astrophys.J. 621 , L85 (2005), astro-ph/0412440.
Joachim Kopp Johannes Welter
The Not-So-Sterile 4th Neutrino: Constraints on New Gauge Interactions from Neutrino Oscillation Experiments
Sterile neutrino models with new gauge interactions in the sterile sector are
phenomenologically interesting since they can lead to novel effects in neutrino
oscillation experiments, in cosmology and in dark matter detectors, possibly
even explaining some of the observed anomalies in these experiments. Here, we
use data from neutrino oscillation experiments, in particular from MiniBooNE,
MINOS and solar neutrino experiments, to constrain such models. We focus in
particular on the case where the sterile sector gauge boson $A'$ couples also
to Standard Model particles (for instance to the baryon number current) and
thus induces a large Mikheyev-Smirnov-Wolfenstein potential. For eV-scale
sterile neutrinos, we obtain strong constraints especially from MINOS, which
restricts the strength of the new interaction to be less than $\sim 10$ times
that of the Standard Model weak interaction unless active-sterile neutrino
mixing is very small ($\sin^2 \theta_{24} \lesssim 10^{-3}$). This rules out
gauge forces large enough to affect short baseline experiments like MiniBooNE
and it imposes nontrivial constraints on signals from sterile neutrino
scattering in dark matter experiments.