title: Fractional order graph neural network

abstract: This paper proposes fractional order graph neural networks (FGNNs), optimized by the approximation strategy to address the challenges of local optimum of classic and fractional graph neural networks which are specialised at aggregating information from the feature and adjacent matrices of connected nodes and their neighbours to solve learning tasks on non-Euclidean data such as graphs. Meanwhile the approximate calculation of fractional order gradients also overcomes the high computational complexity of fractional order derivations. We further prove that such an approximation is feasible and the FGNN is unbiased towards global optimization solution. Extensive experiments on citation networks show that FGNN achieves great advantage over baseline models when selected appropriate fractional order.


title: Learning ergodic averages in chaotic systems

abstract: We propose a physics-informed machine learning method to predict the time average of a chaotic attractor. The method is based on the hybrid echo state network (hESN). We assume that the system is ergodic, so the time average is equal to the ergodic average. Compared to conventional echo state networks (ESN) (purely data-driven), the hESN uses additional information from an incomplete, or imperfect, physical model. We evaluate the performance of the hESN and compare it to that of an ESN. This approach is demonstrated on a chaotic time-delayed thermoacoustic system, where the inclusion of a physical model significantly improves the accuracy of the prediction, reducing the relative error from 48% to 7%. This improvement is obtained at the low extra cost of solving two ordinary differential equations. This framework shows the potential of using machine learning techniques combined with prior physical knowledge to improve the prediction of time-averaged quantities in chaotic systems.

categories: cs.LG cs.NE physics.comp-ph physics.flu-dyn


title: On the Jacobi sums over Galois rings

abstract: In this paper, we study the Jacobi sums over Galois rings of arbitrary characteristics and completely determine their absolute values, which extends the work in \cite{feng1}, where the Jacobi sums over Galois rings with characteristics a square of a prime number were discussed.


title: Tangent-Space Gradient Optimization of Tensor Network for Machine Learning

abstract: The gradient-based optimization method for deep machine learning models suffers from gradient vanishing and exploding problems, particularly when the computational graph becomes deep. In this work, we propose the tangent-space gradient optimization (TSGO) for the probabilistic models to keep the gradients from vanishing or exploding. The central idea is to guarantee the orthogonality between the variational parameters and the gradients. The optimization is then implemented by rotating parameter vector towards the direction of gradient. We explain and testify TSGO in tensor network (TN) machine learning, where the TN describes the joint probability distribution as a normalized state $\left| \psi \right\rangle $ in Hilbert space. We show that the gradient can be restricted in the tangent space of $\left\langle \psi \right.\left| \psi \right\rangle = 1$ hyper-sphere. Instead of additional adaptive methods to control the learning rate in deep learning, the learning rate of TSGO is naturally determined by the angle $\theta $ as $\eta = \tan \theta $. Our numerical results reveal better convergence of TSGO in comparison to the off-the-shelf Adam.


title: Exploiting Unlabeled Data in Smart Cities using Federated Learning

abstract: Privacy concerns are considered one of the main challenges in smart cities as sharing sensitive data brings threatening problems to people's lives. Federated learning has emerged as an effective technique to avoid privacy infringement as well as increase the utilization of the data. However, there is a scarcity in the amount of labeled data and an abundance of unlabeled data collected in smart cities, hence there is a need to use semi-supervised learning. We propose a semi-supervised federated learning method called FedSem that exploits unlabeled data. The algorithm is divided into two phases where the first phase trains a global model based on the labeled data. In the second phase, we use semi-supervised learning based on the pseudo labeling technique to improve the model. We conducted several experiments using traffic signs dataset to show that FedSem can improve accuracy up to 8% by utilizing the unlabeled data in the learning process.


title: Independent wavefront tailoring in full polarization channels by helicity-decoupled metasurface

abstract: Controlling the polarization and wavefront of light is essential for compact photonic systems in modern science and technology. This may be achieved by metasurfaces, a new platform that has radically changed the way people engineer wave-matter interactions. However, it still remains very challenging to generate versatile beams with arbitrary and independent wavefronts in each polarization channel by a single ultrathin metasurface. By modulating both the geometric and propagation phases of the metasurface, here we propose a method that can generate an assembly of circularly- and linearly-polarized beams with simultaneously the capability of independent encoding desired wavefront to each individual polarization channel, which we believe will greatly enhance the information capacities of the meta-devices. Two proof-of-concept designs are experimentally demonstrated in microwave region. Upon the excitation of an arbitrary linear polarization, the first device can generate distinct vortex beams with desired two linear and two circular orthogonal polarizations, whereas the second one can generate multi-foci containing components of full polarizations. This approach to generate versatile polarizations with tailored wavefront may pave a way to achieve advanced, flat and multifunctional meta-device for integrated systems.


title: POPCORN: Partially Observed Prediction COnstrained ReiNforcement Learning

abstract: Many medical decision-making tasks can be framed as partially observed Markov decision processes (POMDPs). However, prevailing two-stage approaches that first learn a POMDP and then solve it often fail because the model that best fits the data may not be well suited for planning. We introduce a new optimization objective that (a) produces both high-performing policies and high-quality generative models, even when some observations are irrelevant for planning, and (b) does so in batch off-policy settings that are typical in healthcare, when only retrospective data is available. We demonstrate our approach on synthetic examples and a challenging medical decision-making problem.


title: Unlocked-relative-phase states in arrays of Bose-Einstein condensates

abstract: Phase engineering techniques are used to control the dynamics of long-bosonic-Josephson-junction arrays built by linearly coupling Bose-Einstein condensates. Just at the middle point of the underlying discrete energy band of the system, unlocked-relative-phase states are shown to be stationary along with the locked-relative-phase Bloch waves. In finite, experimentally-feasible systems, such states find ranges of dynamical stability that depend on the ratio of coupling to interaction energy. The same ratio determines different decay regimes, which include the recurrence of staggered-soliton trains in the condensates around Josephson loop currents at the junctions. These transient solitons are also found in their stationary configurations, which provide striped-density states by means of either dark-soliton or bright-soliton trains. Additionally, the preparation of maximally out-of-phase (or splay) states is demonstrated to evolve into an oscillation of the uniform density of the condensates that keeps constant the total density of the system and robust against noise at low coupling.


title: Evaluating Online Public Sentiments towards China: A Case Study of English and Chinese Twitter Discourse during the 2019 Chinese National Day

abstract: As the Internet gradually penetrates into people's daily lives and empowers everyone to demonstrate and exchange opinions and sentiments online, individual citizens are increasingly participating in the agenda-setting of public affairs and the design and implementation of official policies. The current study describes an approach to analyze online public sentiments using social media data and provides an example of Twitter discourse during the 2019 Chinese National Day. Over 300,000 tweets were collected between Sept 30 and Oct 3, and a hybrid method of SVM and dictionary was applied to evaluate the sentiments of the collected tweets. This method avoids complex structures while yielding an average accuracy of over 96% in most classifiers used in the study. The results indicate alignment between the time of National Day celebration activities and the expressed sentiments revealed in both English and Chinese tweets, although the sentiments of the two languages tend to be in different directions. The sentiment of tweets also diverges from nation to nation, but is generally consistent with the country's official relations with China to varying degrees. The linguistic features of the tweets suggest different concerns for Twitter users who have different sentiments towards China. At last, possible directions for further studies are indicated.


title: On the Controllability of Matrix-weighted Networks

abstract: This letter examines the controllability of consensus dynamics on matrix-weighed networks from a graph-theoretic perspective. Unlike the scalar-weighted networks, the rank of weight matrix introduces additional intricacies into characterizing the dimension of controllable subspace for such networks. Specifically, we investigate how the definiteness of weight matrices influences the dimension of the controllable subspace. In this direction, graph-theoretic characterizations of the lower and upper bounds on the dimension of the controllable subspace are provided by employing, respectively, distance partition and almost equitable partition of matrix-weighted networks. Furthermore, the structure of an uncontrollable input for such networks is examined. Examples are then provided to demonstrate the theoretical results.


title: Gradient flow formulation and second order numerical method for motion by mean curvature and contact line dynamics on rough surface

abstract: We study the dynamics of a droplet moving on an inclined rough surface in the absence of inertial and viscous stress effects. In this case, the dynamics of the droplet is a purely geometric motion in terms of the wetting domain and the capillary surface. Using a single graph representation, we interpret this geometric motion as a gradient flow on a Hilbert manifold. We propose unconditionally stable first/second order numerical schemes to simulate this geometric motion of the droplet, which is described using motion by mean curvature coupled with moving contact lines. The schemes are based on (i) explicit moving boundaries, which decouple the dynamic updates of the contact lines and the capillary surface, (ii) a semi-Lagrangian method on moving grids and (iii) a predictor-corrector method with a nonlinear elliptic solver upto second order accuracy. For the case of quasi-static dynamics with continuous spatial variable in the numerical schemes, we prove the stability and convergence of the first/second order numerical schemes. To demonstrate the accuracy and long-time validation of the proposed schemes, several challenging computational examples - including breathing droplets, droplets on inhomogeneous rough surfaces and quasi-static Kelvin pendant droplets - are constructed and compared with exact solutions to quasi-static dynamics obtained by desingularized differential-algebraic system of equations (DAEs).


title: xGASS: Robust quantification of asymmetries in global HI spectra and their relationship to environmental processes

abstract: We present an analysis of asymmetries in global HI spectra from the extended GALEX Arecibo SDSS Survey (xGASS), a stellar mass-selected and gas fraction-limited survey which is representative of the HI properties of galaxies in the local Universe. We demonstrate that the asymmetry in a HI spectrum is strongly linked to its signal-to-noise meaning that, contrary to what was done in previous works, asymmetry distributions for different samples cannot be compared at face value. We develop a method to account for noise-induced asymmetry and find that the typical galaxy detected by xGASS exhibits higher asymmetry than what can be attributed to noise alone, with 37% of the sample showing asymmetry greater than 10% at an 80% confidence level. We find that asymmetric galaxies contain, on average, 29% less HI mass compared to their symmetric counterparts matched in both stellar mass and signal-to-noise. We also present clear evidence that satellite galaxies, as a population, exhibit more asymmetric HI spectra than centrals and that group central galaxies show a slightly higher rate of HI asymmetries compared to isolated centrals. All these results support a scenario in which environmental processes, in particular those responsible for gas removal, are the dominant driver of asymmetry in xGASS.


title: On Labeled Graph $C^*$-algebras

abstract: Given a directed graph $E$ and a labeling $\mathcal{L}$, one forms the labeled graph $C^*$-algebra by taking a weakly left--resolving labeled space $(E, \mathcal{L}, \mathcal{B})$ and considering a universal generating family of partial isometries and projections. In this paper, we work on ideals for a labeled graph $C^*$-algebra when the graph contains sinks. Using some of the tools we build, we compute $C^*(E, \mathcal{L}, \mathcal{B})$ when $E$ is a finite graph.


title: SERAD: Soft Error Resilient Asynchronous Design using a Bundled Data Protocol

abstract: The risk of soft errors due to radiation continues to be a significant challenge for engineers trying to build systems that can handle harsh environments. Building systems that are Radiation Hardened by Design (RHBD) is the preferred approach, but existing techniques are expensive in terms of performance, power, and/or area. This paper introduces a novel soft-error resilient asynchronous bundled-data design template, SERAD, which uses a combination of temporal and spatial redundancy to mitigate Single Event Transients (SETs) and upsets (SEUs). SERAD uses Error Detecting Logic (EDL) to detect SETs at the inputs of sequential elements and correct them via re-sampling. Because SERAD only pays the delay penalty in the presence of an SET, which rarely occurs, its average performance is comparable to the baseline synchronous design. We tested the SERAD design using a combination of Spice and Verilog simulations and evaluated its impact on area, frequency, and power on an open-core MIPS-like processor using a NCSU 45nm cell library. Our post-synthesis results show that the SERAD design consumes less than half of the area of the Triple Modular Redundancy (TMR), exhibits significantly less performance degradation than Glitch Filtering (GF), and consumes no more total power than the baseline unhardened design.


title: Causal Mediation Analysis with Multiple Treatments and Latent Confounders

abstract: Causal mediation analysis is used to evaluate direct and indirect causal effects of a treatment on an outcome of interest through an intermediate variable or a mediator.It is difficult to identify the direct and indirect causal effects because the mediator cannot be randomly assigned in many real applications. In this article, we consider a causal model including latent confounders between the mediator and the outcome. We present sufficient conditions for identifying the direct and indirect effects and propose an approach for estimating them. The performance of the proposed approach is evaluated by simulation studies. Finally, we apply the approach to a data set of the customer loyalty survey by a telecom company.


title: Secure V2V and V2I Communication in Intelligent Transportation using Cloudlets

abstract: Intelligent Transportation System (ITS) is a vision which offers safe, secure and smart travel experience to drivers. This futuristic plan aims to enable vehicles, roadside transportation infrastructures, pedestrian smart-phones and other devices to communicate with one another to provide safety and convenience services. Vehicle to Vehicle (V2V) and Vehicle to Infrastructure (V2I) communication in ITS offers ability to exchange speed, heading angle, position and other environment related conditions amongst vehicles and with surrounding smart infrastructures. In this intelligent setup, vehicles and users communicate and exchange data with random untrusted entities (like vehicles, smart traffic lights or pedestrians) whom they don't know or have met before. The concerns of location privacy and secure communication further deter the adoption of this smarter and safe transportation. In this paper, we present a secure and trusted V2V and V2I communication approach using edge infrastructures where instead of direct peer to peer communication, we introduce trusted cloudlets to authorize, check and verify the authenticity, integrity and ensure anonymity of messages exchanged in the system. Moving vehicles or road side infrastructure are dynamically connected to nearby cloudlets, where security policies can be implemented to sanitize or stop fake messages and prevent rogue vehicles to exchange messages with other vehicles. We also present a formal attribute-based model for V2V and V2I communication, called AB-ITS, along with proof of concept implementation of the proposed solution in AWS IoT platform. This cloudlet supported architecture complements direct V2V or V2I communication, and serves important use cases such as accident or ice-threat warning and other safety applications. Performance metrics of our proposed architecture are also discussed and compared with existing ITS technologies.


title: Minimizing Age of Information via Hybrid NOMA/OMA

abstract: This paper considers a wireless network with a base station (BS) conducting timely transmission to two clients in a slotted manner via hybrid non-orthogonal multiple access (NOMA)/orthogonal multiple access (OMA). Specifically, the BS is able to adaptively switch between NOMA and OMA for the downlink transmission to minimize the information freshness, characterized by Age of Information (AoI), of the network. If the BS chooses OMA, it can only serve one client within a time slot and should decide which client to serve; if the BS chooses NOMA, it can serve both clients simultaneously and should decide the power allocated to each client. To minimize the weighted sum of expected AoI of the network, we formulate a Markov Decision Process (MDP) problem and develop an optimal policy for the BS to decide whether to use NOMA or OMA for each downlink transmission based on the instantaneous AoI of both clients. We prove the existence of optimal stationary and deterministic policy, and perform action elimination to reduce the action space for lower computation complexity. The optimal policy is shown to have a switching-type property with obvious decision switching boundaries. A suboptimal policy with lower computation complexity is also devised, which can achieve near-optimal performance according to our simulation results. The performance of different policies under different system settings is compared and analyzed in numerical results to provide useful insights for practical system designs.


title: Magnetic Gradient: A Natural Driver of Solar Eruptions

abstract: It is well-known that there is a gradient, there will drive a flow inevitably. For example, a density-gradient may drive a diffusion flow, an electrical potential-gradient may drive an electric current in plasmas, etc. Then, what will be driven when a magnetic-gradient occurs in solar atmospheric plasmas? Considering the ubiquitous distribution of magnetic-gradient in solar plasma loops, this work demonstrates that magnetic-gradient pumping (MGP) mechanism is valid even in the partial ionized solar photosphere, chromosphere as well as in the corona. It drives energetic particle flows which carry and convey kinetic energy from the underlying atmosphere to move upwards, accumulate around the looptop and increase there temperature and pressure, and finally lead to eruptions around the looptop by triggering ballooning instabilities. This mechanism may explain the formation of the observing hot cusp-structures above flaring loops in most preflare phases, therefore, the magnetic-gradient should be a natural driver of solar eruptions. Furthermore, we may also apply to understand many other astrophysical phenomena, such as the temperature distribution above sunspots, the formation of solar plasma jets, type-II spicule, and fast solar wind above coronal holes, as well as the fast plasma jets related to white dwarfs, neutron stars and black holes.


title: Gate-tunable spin waves in antiferromagnetic atomic bilayers

abstract: The emergence of two-dimensional (2D) layered magnetic materials has opened an exciting playground for both fundamental studies of magnetism in 2D and explorations of spinbased applications. Remarkable properties, including spin filtering in magnetic tunnel junctions and gate control of magnetic states, have recently been demonstrated in 2D magnetic materials. While these studies focus on the static properties, dynamic magnetic properties such as excitation and control of spin waves have remained elusive. Here we excite spin waves and probe their dynamics in antiferromagnetic CrI3 bilayers by employing an ultrafast optical pump/magneto-optical Kerr probe technique. We identify sub-terahertz magnetic resonances under an in-plane magnetic field, from which we determine the anisotropy and interlayer exchange fields and the spin damping rates. We further show tuning of antiferromagnetic resonances by tens of gigahertz through electrostatic gating. Our results shed light on magnetic excitations and spin dynamics in 2D magnetic materials, and demonstrate their unique potential for applications in ultrafast data storage and processing.


title: Breaking hypothesis testing for failure rates

abstract: We describe the utility of point processes and failure rates and the most common point process for modeling failure rates, the Poisson point process. Next, we describe the uniformly most powerful test for comparing the rates of two Poisson point processes for a one-sided test (henceforth referred to as the "rate test"). A common argument against using this test is that real world data rarely follows the Poisson point process. We thus investigate what happens when the distributional assumptions of tests like these are violated and the test still applied. We find a non-pathological example (using the rate test on a Compound Poisson distribution with Binomial compounding) where violating the distributional assumptions of the rate test make it perform better (lower error rates). We also find that if we replace the distribution of the test statistic under the null hypothesis with any other arbitrary distribution, the performance of the test (described in terms of the false negative rate to false positive rate trade-off) remains exactly the same. Next, we compare the performance of the rate test to a version of the Wald test customized to the Negative Binomial point process and find it to perform very similarly while being much more general and versatile. Finally, we discuss the applications to Microsoft Azure. The code for all experiments performed is open source and linked in the introduction.


title: First demonstration of OH suppression in a high efficiency near-infrared spectrograph

abstract: Ground-based near-infrared astronomy is severely hampered by the forest of atmospheric emission lines resulting from the rovibrational decay of OH molecules in the upper atmosphere. The extreme brightness of these lines, as well as their spatial and temporal variability, makes accurate sky subtraction difficult. Selectively filtering these lines with OH suppression instruments has been a long standing goal for near-infrared spectroscopy. We have shown previously the efficacy of fibre Bragg gratings combined with photonic lanterns for achieving OH suppression. Here we report on PRAXIS, a unique near-infrared spectrograph that is optimised for OH suppression with fibre Bragg gratings. We show for the first time that OH suppression (of any kind) is possible with high overall throughput (18 per cent end-to-end), and provide examples of the relative benefits of OH suppression.


title: Experimental sensing quantum atmosphere of a single spin

abstract: Understanding symmetry-breaking states of materials is a major challenge in the modern physical sciences. Quantum atmosphere proposed recently sheds light on the hidden world of these symmetry broken patterns. But the requirements for exquisite sensitivity to the small shift and tremendous spatial resolution to local information pose huge obstacles to its experimental manifestation. In our experiment, we prepare time-reversal-symmetry conserved and broken quantum atmosphere of a single nuclear spin and successfully observe their symmetry properties. Our work proves in principle that finding symmetry patterns from quantum atmosphere is conceptually viable. It also opens up entirely new possibilities in the potential application of quantum sensing in material diagnosis.


title: Algebraic fibrations of certain hyperbolic 4-manifolds

abstract: Algebraically fibering group is an algebraic generalization of the fibered 3-manifold group in higher dimensions. Let $M(\mathcal{P})$ and $M(\mathcal{E})$ be the cusped and compact hyperbolic real moment-angled manifolds associated to the hyperbolic right-angled 24-cell $\mathcal{P}$ and the hyperbolic right-angled 120-cell $\mathcal{E}$, respectively. Jankiewicz-Norin-Wise showed in [13] that $\pi_1(M(\mathcal{P}))$ and $\pi_1(M(\mathcal{E}))$ are algebraic fibered. Namely, there are two exact sequences $$1\rightarrow H_{\mathcal{P}}\rightarrow \pi_1(M(\mathcal{P}))\xrightarrow{\phi_{\mathcal{P}}} \mathbb{Z}\rightarrow 1,$$ $$1\rightarrow H_{\mathcal{E}}\rightarrow \pi_1(M(\mathcal{E}))\xrightarrow{\phi_{\mathcal{E}}} \mathbb{Z}\rightarrow 1,$$ where $H_{\mathcal{P}}$ and $H_{\mathcal{E}}$ are finitely generated. In this paper, we furtherly show that the groups $H_{\mathcal{P}}$ and $H_{\mathcal{E}}$ are not $FP_2$. In particular, those fiber-kernel groups are finitely generated, but not finitely presented.


title: FastVA: Deep Learning Video Analytics Through Edge Processing and NPU in Mobile

abstract: Many mobile applications have been developed to apply deep learning for video analytics. Although these advanced deep learning models can provide us with better results, they also suffer from the high computational overhead which means longer delay and more energy consumption when running on mobile devices.To address this issue, we propose a framework called FastVA, which supports deep learning video analytics through edge processing and Neural Processing Unit (NPU) in mobile. The major challenge is to determine when to offload the computation and when to use NPU. Based on the processing time and accuracy requirement of the mobile application, we study two problems: Max-Accuracy where the goal is to maximize the accuracy under some time constraints, and Max-Utility where the goal is to maximize the utility which is a weighted function of processing time and accuracy. We formulate them as integer programming problems and propose heuristics based solutions. We have implemented FastVA on smartphones and demonstrated its effectiveness through extensive evaluations.


title: Relational State-Space Model for Stochastic Multi-Object Systems

abstract: Real-world dynamical systems often consist of multiple stochastic subsystems that interact with each other. Modeling and forecasting the behavior of such dynamics are generally not easy, due to the inherent hardness in understanding the complicated interactions and evolutions of their constituents. This paper introduces the relational state-space model (R-SSM), a sequential hierarchical latent variable model that makes use of graph neural networks (GNNs) to simulate the joint state transitions of multiple correlated objects. By letting GNNs cooperate with SSM, R-SSM provides a flexible way to incorporate relational information into the modeling of multi-object dynamics. We further suggest augmenting the model with normalizing flows instantiated for vertex-indexed random variables and propose two auxiliary contrastive objectives to facilitate the learning. The utility of R-SSM is empirically evaluated on synthetic and real time-series datasets.


title: An Adversarial Approach for the Robust Classification of Pneumonia from Chest Radiographs

abstract: While deep learning has shown promise in the domain of disease classification from medical images, models based on state-of-the-art convolutional neural network architectures often exhibit performance loss due to dataset shift. Models trained using data from one hospital system achieve high predictive performance when tested on data from the same hospital, but perform significantly worse when they are tested in different hospital systems. Furthermore, even within a given hospital system, deep learning models have been shown to depend on hospital- and patient-level confounders rather than meaningful pathology to make classifications. In order for these models to be safely deployed, we would like to ensure that they do not use confounding variables to make their classification, and that they will work well even when tested on images from hospitals that were not included in the training data. We attempt to address this problem in the context of pneumonia classification from chest radiographs. We propose an approach based on adversarial optimization, which allows us to learn more robust models that do not depend on confounders. Specifically, we demonstrate improved out-of-hospital generalization performance of a pneumonia classifier by training a model that is invariant to the view position of chest radiographs (anterior-posterior vs. posterior-anterior). Our approach leads to better predictive performance on external hospital data than both a standard baseline and previously proposed methods to handle confounding, and also suggests a method for identifying models that may rely on confounders. Code available at https://github.com/suinleelab/cxr_adv.


title: Commutative simplicial bundles

abstract: In this paper we introduce a simplicial analogue of principal bundles with commutativity structure and their classifying spaces defined for topological groups. Our construction $\overline W(\tau,K)$ is a variation of the $\overline W$-construction for simplicial groups. We show that the geometric realization of our $\overline W(\tau,K)$ is homotopy equivalent to the topological classifying space $B(\tau,|K|)$ and we study what objects does the simplicial set $\overline W(\tau,K)$ classify.


title: Geometric sharp large deviations for random projections of $\ell_p^n$ spheres and balls

abstract: Accurate estimation of tail probabilities of projections of high-dimensional probability measures is of relevance in high-dimensional statistics and asymptotic geometric analysis. Whereas large deviation principles identify the asymptotic exponential decay rate of probabilities, sharp large deviation estimates also provide the "prefactor" in front of the exponentially decaying term. For fixed $p \in (1,\infty)$, consider independent sequences $(X^{(n,p)})_{n \in \mathbb{N}}$ and $(\Theta^n)_{n \in \mathbb{N}}$ of random vectors with $\Theta^n$ distributed according to the normalized cone measure on the unit $\ell_2^n$ sphere, and $X^{(n,p)}$ distributed according to the normalized cone measure on the unit $\ell_p^n$ sphere. For almost every realization $(\theta^n)_{n\in\mathbb{N}}$ of $(\Theta^n)_{n\in\mathbb{N}}$, (quenched) sharp large deviation estimates are established for suitably normalized (scalar) projections of $X^{(n,p)}$ onto $\theta^n$, that are asymptotically exact (as the dimension $n$ tends to infinity). Furthermore, the case when $(X^{(n,p)})_{n \in \mathbb{N}}$ is replaced with $(\mathscr{X}^{(n,p)})_{n \in \mathbb{N}}$, where $\mathscr{X}^{(n,p)}$ is distributed according to the uniform (or normalized volume) measure on the unit $\ell_p^n$ ball, is also considered. In both cases, in contrast to the (quenched) large deviation rate function, the prefactor exhibits a dependence on the projection directions $(\theta^n)_{n \in\mathbb{N}}$ that encodes additional geometric information that enables one to distinguish between projections of balls and spheres. Moreover, comparison with numerical estimates obtained by direct computation and importance sampling shows that the obtained analytical expressions for tail probabilities provide good approximations even for moderate values of $n$.


title: Large and Robust Charge-to-Spin Conversion in Sputtered Conductive WTex with Disorder

abstract: Topological materials with large spin-orbit coupling and immunity to disorder-induced symmetry breaking show great promise for efficiently converting charge to spin. Here, we report that long-range disordered sputtered WTex thin films exhibit local chemical and structural order as those of Weyl semimetal WTe2 and conduction behavior that is consistent with semi-metallic Weyl fermion. We find large charge-to-spin conversion properties and electrical conductivity in thermally annealed sputtered WTex films that are comparable with those in crystalline WTe2 flakes. Besides, the strength of unidirectional spin Hall magnetoresistance in annealed WTex/Mo/CoFeB heterostructure is 5 to 20 times larger than typical SOT layer/ferromagnet heterostructures reported at room temperature. We further demonstrate room temperature damping-like SOT-driven magnetization switching of in-plane magnetized CoFeB. These large charge-to-spin conversion properties that are robust in the presence of long-range disorder and thermal annealing pave the way for industrial application of a new class of sputtered semimetals.


title: Upper Bound Scalability on Achievable Rates of Batched Codes for Line Networks

abstract: The capacity of line networks with buffer size constraints is an open, but practically important problem. In this paper, the upper bound on the achievable rate of a class of codes, called batched codes, is studied for line networks. Batched codes enable a range of buffer size constraints, and are general enough to include special coding schemes studied in the literature for line networks. Existing works have characterized the achievable rates of batched codes for several classes of parameter sets, but leave the cut-set bound as the best existing general upper bound. In this paper, we provide upper bounds on the achievable rates of batched codes as functions of line network length for these parameter sets. Our upper bounds are tight in order of the network length compared with the existing achievability results.


title: On the Resilience of Biometric Authentication Systems against Random Inputs

abstract: We assess the security of machine learning based biometric authentication systems against an attacker who submits uniform random inputs, either as feature vectors or raw inputs, in order to find an accepting sample of a target user. The average false positive rate (FPR) of the system, i.e., the rate at which an impostor is incorrectly accepted as the legitimate user, may be interpreted as a measure of the success probability of such an attack. However, we show that the success rate is often higher than the FPR. In particular, for one reconstructed biometric system with an average FPR of 0.03, the success rate was as high as 0.78. This has implications for the security of the system, as an attacker with only the knowledge of the length of the feature space can impersonate the user with less than 2 attempts on average. We provide detailed analysis of why the attack is successful, and validate our results using four different biometric modalities and four different machine learning classifiers. Finally, we propose mitigation techniques that render such attacks ineffective, with little to no effect on the accuracy of the system.


title: Efficient 3D Road Map Data Exchange for Intelligent Vehicles in Vehicular Fog Networks

abstract: Through connecting intelligent vehicles as well as the roadside infrastructure, the perception range of vehicles can be significantly extended, and hidden objects at blind spots can be efficiently detected and avoided. To realize this, accurate road map data must be downloaded in real time to these intelligent vehicles for navigation and localization purposes. Besides, the cloud must be updated with dynamic changes that happened in the road network. These involve the transmissions of high-definition 3D road map data for accurately representing the physical environments. In this work, we propose solutions under the fog computing architecture in a heterogeneous vehicular network to optimize data exchange among intelligent vehicles, the roadside infrastructure, as well as regional databases. Specifically, the efficiency of 3D road map data dissemination at roadside fog nodes is achieved by exploiting index coding techniques to reduce the overall data load, while opportunistic scheduling of heterogeneous transmissions can be done to judiciously manage network resources and minimize operating cost. In addition, 3D point cloud coding and hashing techniques are applied to expedite the updates of various dynamic changes in the network. We empirically evaluate the proposed solutions based on real-world mobility traces of vehicles and 3D LIght Detection And Ranging (LIDAR) data of city streets. The proposed system is also implemented in a multi-robotic testbed for practical evaluation.


title: Boundary value problem for a global in time parabolic equation

abstract: The aim of this paper is to draw attention to an interesting semilinear parabolic equation that arose when describing the chaotic dynamics of a polymer molecule in a liquid. This equation is nonlocal in time and contains a term, called the interaction potential, that depends on the time-integral of the solution over the entire interval of solving the problem. In fact, one needs to know the "future" in order to determine the coefficient in this term, i.e., the causality principle is violated. The existence of a weak solution of the initial boundary value problem is proven. The interaction potential satisfies fairly general conditions and can have an arbitrary growth at infinity. The uniqueness of this solution is established with restrictions on the length of the considered time interval.


title: Learning to Locomote with Deep Neural-Network and CPG-based Control in a Soft Snake Robot

abstract: In this paper, we present a new locomotion control method for soft robot snakes. Inspired by biological snakes, our control architecture is composed of two key modules: A deep reinforcement learning (RL) module for achieving adaptive goal-tracking behaviors with changing goals, and a central pattern generator (CPG) system with Matsuoka oscillators for generating stable and diverse locomotion patterns. The two modules are interconnected into a closed-loop system: The RL module, analogizing the locomotion region located in the midbrain of vertebrate animals, regulates the input to the CPG system given state feedback from the robot. The output of the CPG system is then translated into pressure inputs to pneumatic actuators of the soft snake robot. Based on the fact that the oscillation frequency and wave amplitude of the Matsuoka oscillator can be independently controlled under different time scales, we further adapt the option-critic framework to improve the learning performance measured by optimality and data efficiency. The performance of the proposed controller is experimentally validated with both simulated and real soft snake robots.


title: Software tools for quantum control: Improving quantum computer performance through noise and error suppression

abstract: Manipulating quantum computing hardware in the presence of imperfect devices and control systems is a central challenge in realizing useful quantum computers. Susceptibility to noise limits the performance and capabilities of noisy intermediate-scale quantum (NISQ) devices, as well as any future quantum computing technologies. Fortunately quantum control enables efficient execution of quantum logic operations and algorithms with built-in robustness to errors, without the need for complex logical encoding. In this manuscript we introduce software tools for the application and integration of quantum control in quantum computing research, serving the needs of hardware R&D teams, algorithm developers, and end users. We provide an overview of a set of python-based classical software tools for creating and deploying optimized quantum control solutions at various layers of the quantum computing software stack. We describe a software architecture leveraging both high-performance distributed cloud computation and local custom integration into hardware systems, and explain how key functionality is integrable with other software packages and quantum programming languages. Our presentation includes a detailed mathematical overview of central product features including a flexible optimization toolkit, filter functions for analyzing noise susceptibility in high-dimensional Hilbert spaces, and new approaches to noise and hardware characterization. Pseudocode is presented in order to elucidate common programming workflows for these tasks, and performance benchmarking is reported for numerically intensive tasks, highlighting the benefits of the selected cloud-compute architecture. Finally, we present a series of case studies demonstrating the application of quantum control solutions using these tools in real experimental settings for both trapped-ion and superconducting quantum computer hardware.


title: Deep Learning based Pedestrian Inertial Navigation: Methods, Dataset and On-Device Inference

abstract: Modern inertial measurements units (IMUs) are small, cheap, energy efficient, and widely employed in smart devices and mobile robots. Exploiting inertial data for accurate and reliable pedestrian navigation supports is a key component for emerging Internet-of-Things applications and services. Recently, there has been a growing interest in applying deep neural networks (DNNs) to motion sensing and location estimation. However, the lack of sufficient labelled data for training and evaluating architecture benchmarks has limited the adoption of DNNs in IMU-based tasks. In this paper, we present and release the Oxford Inertial Odometry Dataset (OxIOD), a first-of-its-kind public dataset for deep learning based inertial navigation research, with fine-grained ground-truth on all sequences. Furthermore, to enable more efficient inference at the edge, we propose a novel lightweight framework to learn and reconstruct pedestrian trajectories from raw IMU data. Extensive experiments show the effectiveness of our dataset and methods in achieving accurate data-driven pedestrian inertial navigation on resource-constrained devices.


title: Modeling of Pruning Techniques for Deep Neural Networks Simplification

abstract: Convolutional Neural Networks (CNNs) suffer from different issues, such as computational complexity and the number of parameters. In recent years pruning techniques are employed to reduce the number of operations and model size in CNNs. Different pruning methods are proposed, which are based on pruning the connections, channels, and filters. Various techniques and tricks accompany pruning methods, and there is not a unifying framework to model all the pruning methods. In this paper pruning methods are investigated, and a general model which is contained the majority of pruning techniques is proposed. The advantages and disadvantages of the pruning methods can be identified, and all of them can be summarized under this model. The final goal of this model is to provide a general approach for all of the pruning methods with different structures and applications.


title: ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training

abstract: This paper presents a new sequence-to-sequence pre-training model called ProphetNet, which introduces a novel self-supervised objective named future n-gram prediction and the proposed n-stream self-attention mechanism. Instead of optimizing one-step-ahead prediction in the traditional sequence-to-sequence model, the ProphetNet is optimized by n-step ahead prediction that predicts the next n tokens simultaneously based on previous context tokens at each time step. The future n-gram prediction explicitly encourages the model to plan for the future tokens and prevent overfitting on strong local correlations. We pre-train ProphetNet using a base scale dataset (16GB) and a large-scale dataset (160GB), respectively. Then we conduct experiments on CNN/DailyMail, Gigaword, and SQuAD 1.1 benchmarks for abstractive summarization and question generation tasks. Experimental results show that ProphetNet achieves new state-of-the-art results on all these datasets compared to the models using the same scale pre-training corpus.


title: Towards the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes

abstract: Neuroprosthesis, as one type of precision medicine device, is aiming for manipulating neuronal signals of the brain in a closed-loop fashion, together with receiving stimulus from the environment and controlling some part of our brain/body. In terms of vision, incoming information can be processed by the brain in millisecond interval. The retina computes visual scenes and then sends its output as neuronal spikes to the cortex for further computation. Therefore, the neuronal signal of interest for retinal neuroprosthesis is spike. Closed-loop computation in neuroprosthesis includes two stages: encoding stimulus to neuronal signal, and decoding it into stimulus. Here we review some of the recent progress about visual computation models that use spikes for analyzing natural scenes, including static images and dynamic movies. We hypothesize that for a better understanding of computational principles in the retina, one needs a hypercircuit view of the retina, in which different functional network motifs revealed in the cortex neuronal network should be taken into consideration for the retina. Different building blocks of the retina, including a diversity of cell types and synaptic connections, either chemical synapses or electrical synapses (gap junctions), make the retina an ideal neuronal network to adapt the computational techniques developed in artificial intelligence for modeling of encoding/decoding visual scenes. Altogether, one needs a systems approach of visual computation with spikes to advance the next generation of retinal neuroprosthesis as an artificial visual system.


title: Constraints on the Emission of Gamma Rays from M31 with HAWC

abstract: Cosmic rays, along with stellar radiation and magnetic fields, are known to make up a significant fraction of the energy density of galaxies such as the Milky Way. When cosmic rays interact in the interstellar medium, they produce gamma-ray emission which provides an important indication of how the cosmic rays propagate. Gamma rays from the Andromeda Galaxy (M31), located 785 kpc away, provide a unique opportunity to study cosmic-ray acceleration and diffusion in a galaxy with a structure and evolution very similar to the Milky Way. Using 33 months of data from the High Altitude Water Cherenkov Observatory, we search for TeV gamma rays from the galactic plane of M31. We also investigate past and present evidence of galactic activity in M31 by searching for Fermi Bubble-like structures above and below the galactic nucleus. No significant gamma-ray emission is observed, so we use the null result to compute upper limits on the energy density of cosmic rays $>10$ TeV in M31. The computed upper limits are approximately ten times higher than expected from the extrapolation of the Fermi LAT results.


title: Boosting Occluded Image Classification via Subspace Decomposition Based Estimation of Deep Features

abstract: Classification of partially occluded images is a highly challenging computer vision problem even for the cutting edge deep learning technologies. To achieve a robust image classification for occluded images, this paper proposes a novel scheme using subspace decomposition based estimation (SDBE). The proposed SDBE-based classification scheme first employs a base convolutional neural network to extract the deep feature vector (DFV) and then utilizes the SDBE to compute the DFV of the original occlusion-free image for classification. The SDBE is performed by projecting the DFV of the occluded image onto the linear span of a class dictionary (CD) along the linear span of an occlusion error dictionary (OED). The CD and OED are constructed respectively by concatenating the DFVs of a training set and the occlusion error vectors of an extra set of image pairs. Two implementations of the SDBE are studied in this paper: the $l_1$-norm and the squared $l_2$-norm regularized least-squares estimates. By employing the ResNet-152, pre-trained on the ILSVRC2012 training set, as the base network, the proposed SBDE-based classification scheme is extensively evaluated on the Caltech-101 and ILSVRC2012 datasets. Extensive experimental results demonstrate that the proposed SDBE-based scheme dramatically boosts the classification accuracy for occluded images, and achieves around $22.25\%$ increase in classification accuracy under $20\%$ occlusion on the ILSVRC2012 dataset.


title: Majorization and minimal energy on spheres

abstract: In the present paper, we consider the majorization theorem (also known as Karamata's inequality) and the respective minima of the majorization (the so-called M-sets) for f-energy potentials of $m$-point configurations on the unit sphere. In particular, we show the optimality of regular simplexes, describe some M-sets of small cardinality, define and discuss spherical f-designs.


title: Photometric, kinematic and variability study in the young open cluster NGC 1960

abstract: We present a comprehensive photometric analysis of a young open cluster NGC 1960 (M36) along with the long-term variability study of this cluster. Based on the kinematic data of Gaia DR2, the membership probabilities of 3871 stars are ascertained in the cluster field among which 262 stars are found to be cluster members. Considering the kinematic and trigonometric measurements of the cluster members, we estimate a mean cluster parallax of 0.86+/-0.05 mas and mean proper motions of mu_RA = -0.143+/-0.008 mas/yr, mu_Dec = -3.395+/-0.008 mas/yr. We obtain basic parameters of the cluster such as E(B-V) = 0.24+/-0.02 mag, log(Age/yr)=7.44+/-0.02, and distance = 1.17+/-0.06 kpc. The mass function slope in the cluster for the stars in the mass range of 0.72-7.32 M_solar is found to be \gamma = -1.26+/-0.19. We find that mass segregation is still taking place in the cluster which is yet to be dynamically relaxed. This work also presents first high-precision variability survey in the central 13'x13' among which 72 are periodic variables. Among them, 59 are short-period (P<1 day)and 13 are long-period (P>1 day). The variable stars have V magnitudes ranging between 9.1 to 19.4 mag and periods between 41 minutes to 10.74 days. On the basis of their locations in the H-R diagram, periods and characteristic light curves, the 20 periodic variables belong to the cluster. We classified them as 2 delta-Scuti, 3 gamma-Dor, 2 slowly pulsating B stars, 5 rotational variables, 2 non-pulsating B stars and 6 as miscellaneous variables.


title: Natural Image Matting via Guided Contextual Attention

abstract: Over the last few years, deep learning based approaches have achieved outstanding improvements in natural image matting. Many of these methods can generate visually plausible alpha estimations, but typically yield blurry structures or textures in the semitransparent area. This is due to the local ambiguity of transparent objects. One possible solution is to leverage the far-surrounding information to estimate the local opacity. Traditional affinity-based methods often suffer from the high computational complexity, which are not suitable for high resolution alpha estimation. Inspired by affinity-based method and the successes of contextual attention in inpainting, we develop a novel end-to-end approach for natural image matting with a guided contextual attention module, which is specifically designed for image matting. Guided contextual attention module directly propagates high-level opacity information globally based on the learned low-level affinity. The proposed method can mimic information flow of affinity-based methods and utilize rich features learned by deep neural networks simultaneously. Experiment results on Composition-1k testing set and alphamatting.com benchmark dataset demonstrate that our method outperforms state-of-the-art approaches in natural image matting. Code and models are available at https://github.com/Yaoyi-Li/GCA-Matting.


title: A new feasible dark matter region in the singlet scalar scotogenic model

abstract: We study a simplest viable dark matter model with a real singlet scalar, vector-like singlet and a doublet lepton. We find a considerable enhancement in the allowed region of the scalar dark matter parameter spaces under the influence of the new Yukawa coupling. The Yukawa coupling associate with the fermion sector heavily dominant the dark matter parameter spaces satisfying the current relic density of the Universe. Dilepton$+\slashed{E}_T$ signature arising from the new fermionic sector can observe at Large Hadron Collider (LHC). We perform such analysis in the context of 14 TeV LHC experiments with a future integrated luminosity of 3000 ${\rm fb^{-1}}$. We found that a large region of the parameter spaces can be probed by the LHC experiments. The projected exclusion/discovery reach of direct heavy charged fermion searches in this channels is analyzed by performing a detailed cut based collider analysis. The projected exclusion contour reaches up to $1050-1380~{\rm GeV}$ for 3000 ${\rm fb^{-1}}$ for a light dark matter $\mathcal{O}(10)$ GeV from searches in the $ pp \rightarrow E_1^\pm E_1^\mp, E_1^\pm\rightarrow l^\pm S \rightarrow ll + \slashed{E}_T$ channel.


title: Carleman estimate for complex second order elliptic operators with discontinuous Lipschitz coefficients

abstract: In this paper, we derive a local Carleman estimate for the complex second order elliptic operator with Lipschitz coefficients having jump discontinuities. Combing the result in [BL] and the arguments in [DcFLVW], we present an elementary method to derive the Carleman estimate under the optimal regularity assumption on the coefficients.


title: Numerical Sequence Prediction using Bayesian Concept Learning

abstract: When people learn mathematical patterns or sequences, they are able to identify the concepts (or rules) underlying those patterns. Having learned the underlying concepts, humans are also able to generalize those concepts to other numbers, so far as to even identify previously unseen combinations of those rules. Current state-of-the art RNN architectures like LSTMs perform well in predicting successive elements of sequential data, but require vast amounts of training examples. Even with extensive data, these models struggle to generalize concepts. From our behavioral study, we also found that humans are able to disregard noise and identify the underlying rules generating the corrupted sequences. We therefore propose a Bayesian model that captures these human-like learning capabilities to predict next number in a given sequence, better than traditional LSTMs.


title: Noncooperative Precoding for Massive MIMO HetNets: SILNR Maximization Precoding

abstract: Massive multi-input multiple-out (MIMO) is a key ingredient in improving the spectral efficiencies for next-generation cellular systems. Thanks to the channel reciprocity, in time-division-duplexing mode, each base station (BS) can acquire local channel state information at the transmitter (CSIT) for a set of users possibly located in adjacent cells. When the small cell BSs equipped with not-so-many antennas are densely deployed with marcrocells, a simple noncooperative MIMO precoding technique using local CSIT fails to achieve high spectral efficiency because of strong inter-cell-interference (ICI). In this paper, we present a novel noncooperative massive MIMO precoding technique called signal-to-interference-plus-leakage-plus-noise-ratio (SILNR) maximization precoding. The key idea of the proposed precoding is to jointly find a scheduled user set per cell, the beamforming vectors for the users, and the allocated power by simultaneously mitigating both inter-user-interference (IUI) and ICI leakage power using local CSIT. To accomplish this, we present a low-complexity algorithm that finds a local-optimal solution of the maximization problem for a lower bound of the sum spectral efficiency, i.e., a non-convex optimization problem. By system-level-simulations, we show that the proposed precoding method considerably outperforms the existing noncooperative precoding techniques in terms of the ergodic spectral efficiencies and rate distributions per user.


title: Evolution of Image Segmentation using Deep Convolutional Neural Network: A Survey

abstract: From the autonomous car driving to medical diagnosis, the requirement of the task of image segmentation is everywhere. Segmentation of an image is one of the indispensable tasks in computer vision. This task is comparatively complicated than other vision tasks as it needs low-level spatial information. Basically, image segmentation can be of two types: semantic segmentation and instance segmentation. The combined version of these two basic tasks is known as panoptic segmentation. In the recent era, the success of deep convolutional neural networks (CNN) has influenced the field of segmentation greatly and gave us various successful models to date. In this survey, we are going to take a glance at the evolution of both semantic and instance segmentation work based on CNN. We have also specified comparative architectural details of some state-of-the-art models and discuss their training details to present a lucid understanding of hyper-parameter tuning of those models. We have also drawn a comparison among the performance of those models on different datasets. Lastly, we have given a glimpse of some state-of-the-art panoptic segmentation models.


title: APEX observations of ortho-H$_2$D$^+$ towards dense cores in the Orion B9 filament

abstract: We used the APEX telescope to observe the 372 GHz o-H$_2$D$^+(J_{K_a,\,K_c}=1_{1,\,0}-1_{1,\,1})$ line towards three prestellar cores and three protostellar cores in Orion B9. We also employed our previous APEX observations of C$^{17}$O, C$^{18}$O, N$_2$H$^+$, and N$_2$D$^+$ line emission, and 870 $\mu$m dust continuum emission towards the target sources. The o-H$_2$D$^+$ line was detected in all three prestellar cores, but in only one of the protostellar cores. The corresponding o-H$_2$D$^+$ abundances were derived to be $\sim(12-30)\times10^{-11}$ and $6\times10^{-11}$. Two additional spectral lines, DCO$^+(5-4)$ and N$_2$H$^+(4-3)$, were detected in the observed frequency bands with high detection rates of $100\%$ and $83\%$, respectively. The Orion B9 cores were found to be consistent with the relationship between the o-H$_2$D$^+$ abundance and gas temperature obeyed by other low-mass dense cores. The o-H$_2$D$^+$ abundance was found to decrease as the core evolves. The o-H$_2$D$^+$ abundances in the Orion B9 cores are in line with those found in other low-mass cores and larger than derived for high-mass star-forming regions. The higher o-H$_2$D$^+$ abundance in prestellar cores compared to that in cores hosting protostars is to be expected from chemical reactions where higher concentrations of gas-phase CO and elevated gas temperature accelerate the destruction of H$_2$D$^+$. The validity of using the [o-H$_2$D$^+$]/[N$_2$D$^+$] ratio as an evolutionary indicator, which has been proposed for massive clumps, remains to be determined when applied to these target cores. Overall, as located in a dynamic environment of Orion B, the Orion B9 filament provides an interesting target system to investigate the deuterium-based chemistry, and further observations of species like para-H$_2$D$^+$ and D$_2$H$^+$ would be of particular interest.


title: Hydrogen "penta-graphene-like" structure stabilized by hafnium: a high-temperature conventional superconductor

abstract: The recent discovery of H3S and LaH10 superconductors with record high superconducting transition temperatures, Tc, at high pressure, has fueled the search for room-temperature superconductivity in the compressed superhydrides. Here we predict the existence of an unprecedented hexagonal HfH10, with an extraordinarily high Tc of around 213-234 K at 250 GPa. In HfH10, the H atoms are arranged in clusters to form a planar "penta-graphene-like" sublattice, in contrast to the covalent sixfold cubic structure in H3S and clathrate-like structure in LaH10. The Hf atom acts as a "precompressor" and electron donor to the hydrogen sublattice. This "penta-graphene-like" H10 structure is also found in ZrH10, ScH10 and LuH10 at high pressure, each material showing a high Tc ranging from 134 to 220 kelvin. Our study of dense superhydrides with "penta-graphene-like" layered structures opens the door to the exploration and exploitation of a new class of high Tc superconductors.


title: Residual Attention Net for Superior Cross-Domain Time Sequence Modeling

abstract: We present a novel architecture, residual attention net (RAN), which merges a sequence architecture, universal transformer, and a computer vision architecture, residual net, with a high-way architecture for cross-domain sequence modeling. The architecture aims at addressing the long dependency issue often faced by recurrent-neural-net-based structures. This paper serves as a proof-of-concept for a new architecture, with RAN aiming at providing the model a higher level understanding of sequence patterns. To our best knowledge, we are the first to propose such an architecture. Out of the standard 85 UCR data sets, we have achieved 35 state-of-the-art results with 10 results matching current state-of-the-art results without further model fine-tuning. The results indicate that such architecture is promising in complex, long-sequence modeling and may have vast, cross-domain applications.


title: Dirac dark matter in $U(1)_{B-L}$ with Stueckelberg mechanism

abstract: We investigate a $U(1)_{B-L}$ gauge extension of the Standard Model (SM) where the gauge boson mass is generated by the Stueckelberg mechanism. Three right-handed neutrinos are added to cancel the gauge anomaly and hence the neutrino masses can be explained. A new Dirac fermion could be a WIMP dark matter whose interaction with the SM sector is mediated by the new gauge boson. Assuming the perturbativity of the gauge coupling up to the Planck scale, we find that only the resonance region is feasible for the dark matter abundance. After applying the $\Delta N_{eff}$ constraints from the current Planck experiment, the collider search constraints as well as the dark matter direct detection limits, we observe that the $B-L$ charge of dark matter satisfies $|Q_{\chi}|>0.11$. Such a scenario might be probed conclusively by the projected CMB-S4 experiment, assuming the right-handed neutrinos are thermalized with the SM sector in the early universe.


title: $D$ meson mixing as an inverse problem

abstract: We calculate the parameters $x$ and $y$ for the $D$ meson mixing in the Standard Model by considering a dispersion relation between them. The dispersion relation for a fictitious charm quark of arbitrary mass squared $s$ is turned into an inverse problem, via which the mixing parameters at low $s$ are solved with the perturbative inputs $x(s)$ and $y(s)$ from large $s$. It is shown that nontrivial solutions for $x$ and $y$ exist, whose values around the physical charm scale agree with the data in both CP-conserving and CP-violating cases. We then predict the observables $|q/p|-1\approx 2\times 10^{-4}$ and $Arg(q/p)\approx 6\times 10^{-3}$ degrees associated with the coefficient ratio for the $D$ meson mixing, which can be confronted with more precise future measurements. Our work represents the first successful quantitative attempt to explain the $D$ meson mixing parameters in the Standard Model.


title: Perturbation analysis for the linear operator equation using pseudospectrum and condition pseudospectrum

abstract: In this article, we consider the linear operator equation in a Banach space. The relative perturbation of the solution x corresponding to the perturbation of y, the perturbation of A and the perturbation of both A, y are characterized from the pseudospectrum and the condition pseudospectrum of A. Certain examples are given to illustrate the results. A relation between the pseudospectrum and the condition pseudospectrum of an operator are established. The distance to instability and the distance to singularity of an operator are also found from the condition pseudospectrum of the operator.


title: An investigation on the factors affecting machine learning classifications in $\gamma$-ray astronomy

abstract: We have investigated a number of factors that can have significant impacts on the classification performance of $\gamma$-ray sources detected by Fermi Large Area Telescope (LAT) with machine learning techniques. We show that a framework of automatic feature selection can construct a simple model with a small set of features which yields better performance over previous results. Secondly, because of the small sample size of the training/test sets of certain classes in $\gamma$-ray, nested re-sampling and cross-validations are suggested for quantifying the statistical fluctuations of the quoted accuracy. We have also constructed a test set by cross-matching the identified active galactic nuclei (AGNs) and the pulsars (PSRs) in the Fermi LAT eight-year point source catalog (4FGL) with those unidentified sources in the previous 3$^{\rm rd}$ Fermi LAT Source Catalog (3FGL). Using this cross-matched set, we show that some features used for building classification model with the identified source can suffer from the problem of covariate shift, which can be a result of various observational effects. This can possibly hamper the actual performance when one applies such model in classifying unidentified sources. Using our framework, both AGN/PSR and young pulsar (YNG)/millisecond pulsar (MSP) classifiers are automatically updated with the new features and the enlarged training samples in 4FGL catalog incorporated. Using a two-layer model with these updated classifiers, we have selected 20 promising MSP candidates with confidence scores $>98\%$ from the unidentified sources in 4FGL catalog which can provide inputs for a multi-wavelength identification campaign.


title: Spectroscopic Evidence of Bilayer Splitting and Interlayer Pairing in an Iron Based Superconductor

abstract: In high temperature cuprate superconductors, the interlayer coupling between the CuO$_2$ planes plays an important role in dictating superconductivity, as indicated by the sensitive dependence of the critical temperature (T$_C$) on the number of CuO$_2$ planes in one structural unit. In Bi$_2$Sr$_2$CaCu$_2$O$_{8+\delta}$ superconductor with two CuO$_2$ planes in one structural unit, the interaction between the two CuO$_2$ planes gives rise to band splitting into two Fermi surface sheets (bilayer splitting) that have distinct superconducting gap. The iron based superconductors are composed of stacking of the FeAs/FeSe layers; whether the interlayer coupling can cause similar band splitting and its effect on superconductivity remain unclear. Here we report high resolution laser-based angle-resolved photoemission spectroscopy (ARPES) measurements on a newly discovered iron based superconductor, KCa$_2$Fe$_4$As$_4$F$_2$ (T$_C$=33.5\,K) which consists of stacking FeAs blocks with two FeAs layers separated by insulating Ca$_2$F$_2$ blocks. Bilayer splitting effect is observed for the first time that gives rise to totally five hole-like Fermi surface sheets around the Brilliouin zone center. Band structure calculations reproduce the observed bilayer splitting by identifying interlayer interorbital interaction between the two FeAs layers within one FeAs block. All the hole-like pockets around the zone center exhibit Fermi surface-dependent and nodeless superconducting gap. The gap functions with short-range antiferromagetic fluctuations are proposed and the gap symmetry can be well understood when the interlayer pairing is considered. The particularly strong interlayer pairing is observed for one of the bands. Our observations provide key information on the interlayer coupling and interlayer pairing in understanding superconductivity in iron based superconductors.


title: On Base Change of Local Stability in Positive Characteristics

abstract: We prove that a pointed one dimensional family of varieties $\mathcal{X}\to {b\in B}$ in positive characteristics is locally stable iff the log pair $(\mathcal{X'}, \mathcal{X}'_{b'})$ arising from its base change to the perfectoid base $b'\in B_{perf}$ is log canonical.


title: Age-Oriented Opportunistic Relaying in Cooperative Status Update Systems with Stochastic Arrivals

abstract: This paper considers a cooperative status update system with a source aiming to send randomly generated status updates to a designated destination as timely as possible with the help of a relay. We adopt a recently proposed concept, Age of Information (AoI), to characterize the timeliness of the status updates. We propose an age-oriented opportunistic relaying (AoR) protocol to reduce the AoI of the considered system. Specifically, the relay opportunistically replaces the source to retransmit the successfully received status updates that have not been correctly delivered to the destination, but the retransmission of the relay can be preempted by the arrival of a new status update at the source. By carefully analyzing the evolution of AoI, we derive a closed-form expression of the average AoI for the proposed AoR protocol. We further minimize the average AoI by optimizing the generation probability of the status updates at the source. Simulation results validate our theoretical analysis and demonstrate that the average AoI performance of the proposed AoR protocol is superior to that of the non-cooperative system.


title: Leptogenesis and Dark Matter from Low Scale Seesaw

abstract: In this paper, we perform a detail analysis on leptogenesis and dark matter form low scale seesaw. In the framework of $\nu$2HDM, we further introduce one scalar singlet $\phi$ and one Dirac fermion singlet $\chi$, which are charged under a $Z_2$ symmetry. Assuming the coupling of $\chi$ is extremely small, it serves as a FIMP dark matter. The heavy right hand neutrinos $N$ provide a common origin for tiny neutrino mass (via seesaw mechanism), leptogenesis (via $N\to \ell_L \Phi_\nu^*,\bar{\ell}_L \Phi_\nu$) and dark matter (via $N\to \chi\phi$). With hierarchical right hand neutrino masses, the explicit calculation shows that success thermal leptogenesis is viable even for TeV scale $N_1$ with $0.4 \lesssim v_\nu\lesssim1$ GeV and lightest neutrino mass $m_1\lesssim 10^{-11}$ eV. In such scenario, light FIMP dark matter in the keV to MeV range is naturally expected. The common parameter space for neutrino mass, natural leptogenesis and FIMP DM is also obtained in this paper.


title: GridMask Data Augmentation

abstract: We propose a novel data augmentation method `GridMask' in this paper. It utilizes information removal to achieve state-of-the-art results in a variety of computer vision tasks. We analyze the requirement of information dropping. Then we show limitation of existing information dropping algorithms and propose our structured method, which is simple and yet very effective. It is based on the deletion of regions of the input image. Our extensive experiments show that our method outperforms the latest AutoAugment, which is way more computationally expensive due to the use of reinforcement learning to find the best policies. On the ImageNet dataset for recognition, COCO2017 object detection, and on Cityscapes dataset for semantic segmentation, our method all notably improves performance over baselines. The extensive experiments manifest the effectiveness and generality of the new method.


title: Curvature-Dimension Condition Meets Gromov's $n$-Volumic Scalar Curvature

abstract: We study the properties of the $n$-volumic scalar curvature in this note. Lott-Sturm-Villani's curvature-dimension condition ${\rm CD}(\kappa,n)$ was showed to imply Gromov's $n$-volumic scalar curvature $\geq n\kappa$ under an additional $n$-dimensional condition and we show the stability of $n$-volumic scalar curvature $\geq \kappa$ with respect to smGH-convergence. Then we propose a new weighted scalar curvature on the weighted Riemannian manifold and show its properties.


title: Maximal and Frattini L-Subgroups of an L-Group

abstract: In this paper, the concept of a maximal L-subgroup of an L-group has been defined in the spirit of classical group theory. Then, a level subset characterization has been established for the same. Then, this notion of maximal L-subgroups has been used to define Frattini L-subgroups. Further, the concept of non-generators of an L-group has been developed and its relation with the Frattini L-subgroup of an L-group has been established like their classical counterparts. Moreover, several properties pertaining to the concepts of maximal L-subgroups and Frattini L-subgroup have also been investigated. These two notions have been illustrated through several examples.


title: Simple weight modules with finite-dimensional weight spaces over Witt superalgebras

abstract: Let $A_{m,n}$ be the tensor product of the Laurient polynomial algebra in $m$ even variables and the exterior algebra in $n$ odd variables over the complex field $\bC$, and the Witt superalgebra $W_{m,n}$ be the Lie superalgebra of superderivations of $A_{m,n}$. In this paper, we classify the simple weight $W_{m,n}$ modules with finite-dimensional weight spaces with respect to the standard Cartan algebra of $W_{m,0}$. Every such module is either a simple quotient of a tensor module or a module of highest weight type.


title: The Formation History of Subhalos and the Evolution of Satellite Galaxies

abstract: Satellites constitute an important fraction of the overall galaxy population and are believed to form in dark matter subhalos. Here we use the cosmological hydrodynamic simulation TNG100 to investigate how the formation histories of subhalos affect the properties and evolution of their host galaxies. We use a scaled formation time ($a_{\rm nf}$) to characterize the mass assembly histories of the subhalos before they are accreted by massive host halos. We find that satellite galaxies in young subhalos (low $a_{\rm nf}$) are less massive and more gas rich, and have stronger star formation and a higher fraction of ex situ stellar mass than satellites in old subhalos (high $a_{\rm nf}$). Furthermore, these low $a_{\rm nf}$ satellites require longer timescales to be quenched as a population than the high $a_{\rm nf}$ counterparts. We find very different merger histories between satellites in fast accretion (FA, $a_{\rm nf}<1.3$) and slow accretion (SA, $a_{\rm nf}>1.3$) subhalos. For FA satellites, the galaxy merger frequency dramatically increases just after accretion, which enhances the star formation at accretion. While, for SA satellites, the mergers occur smoothly and continuously across the accretion time. Moreover, mergers with FA satellites happen mainly after accretion, while a contrary trend is found for SA satellites. Our results provide insight into the evolution and star formation quenching of the satellite population.


title: Free-stream preserving finite difference schemes for ideal magnetohydrodynamics on curvilinear meshes

abstract: In this paper, a high order free-stream preserving finite difference weighted essentially non-oscillatory (WENO) scheme is developed for the ideal magnetohydrodynamic (MHD) equations on curvilinear meshes. Under the constrained transport framework, magnetic potential evolved by a Hamilton-Jacobi (H-J) equation is introduced to control the divergence error. In this work, we use the alternative formulation of WENO scheme [10] for the nonlinear hyperbolic conservation law, and design a novel method to solve the magnetic potential. Theoretical derivation and numerical results show that the scheme can preserve free-stream solutions of MHD equations, and reduce error more effectively than the standard finite difference WENO schemes for such problems.


title: Semi-supervised learning method based on predefined evenly-distributed class centroids

abstract: Compared to supervised learning, semi-supervised learning reduces the dependence of deep learning on a large number of labeled samples. In this work, we use a small number of labeled samples and perform data augmentation on unlabeled samples to achieve image classification. Our method constrains all samples to the predefined evenly-distributed class centroids (PEDCC) by the corresponding loss function. Specifically, the PEDCC-Loss for labeled samples, and the maximum mean discrepancy loss for unlabeled samples are used to make the feature distribution closer to the distribution of PEDCC. Our method ensures that the inter-class distance is large and the intra-class distance is small enough to make the classification boundaries between different classes clearer. Meanwhile, for unlabeled samples, we also use KL divergence to constrain the consistency of the network predictions between unlabeled and augmented samples. Our semi-supervised learning method achieves the state-of-the-art results, with 4000 labeled samples on CIFAR10 and 1000 labeled samples on SVHN, and the accuracy is 95.10% and 97.58% respectively.


title: A Kernel Based Unconditionally Stable Scheme for Nonlinear Parabolic Partial Differential Equations

abstract: In this paper, a class of high order numerical schemes is proposed to solve the nonlinear parabolic equations with variable coefficients. This method is based on our previous work [10] for convection-diffusion equations, which relies on a special kernel-based formulation of the solutions and successive convolution. However, disadvantages appear when we extend the previous method to our equations, such as inefficient choice of parameters and unprovable stability for high-dimensional problems. To overcome these difficulties, a new kernel-based formulation is designed to approach the spatial derivatives. It maintains the good properties of the original one, including the high order accuracy and unconditionally stable for one-dimensional problems, hence allowing much larger time step evolution compared with other explicit schemes. In additional, without extra computational cost, the proposed scheme can enlarge the available interval of the special parameter in the formulation, leading to less errors and higher efficiency. Moreover, theoretical investigations indicate that it is unconditionally stable for multi-dimensional problems as well. We present numerical tests for one- and two-dimensional scalar and system, demonstrating the designed high order accuracy and unconditionally stable property of the scheme.


title: Virial models and Anisotropy of Velocity Dispersion in e-galaxies

abstract: A tensor virial approach is used to construct detailed models of 22 flattened ellipticals. The models are combined with the new observational data: extended surface brightness distributions, the profiles of isophotes flattening and their twisting, the rotation curves and the velocity dispersion profiles. A key feature of these models is a rigorous consideration of the influence of the spatial shape of galaxies (oblate spheroid or triaxial ellipsoid) on the dynamics, as well as the structure of the internal density layers in these systems. For each galaxy the ratio of the rotational energy to the potential energy was found. Comparing this ratio with the observed it is concluded that the majority of these systems cannot have isotropic velocity dispersion tensors. The anisotropy parameter limited to the interval 0.0-0.224. A correlation was found between and flattening of the outer regions for giant E-galaxies. Our results are compared with the results of other researchers. It was found that for small fast rotators our values \b{eta} are in good agreement with those, obtained in the ATLAS project. However, for giant E-galaxies, our models provide better agreement with observations, than axisymmetric JAM models. In addition, our velocity dispersion anisotropy results are in satisfactory agreement with the results of high resolution cosmological simulations in the Illustris project


title: Landau equation and QCD sum rules for the tetraquark molecular states

abstract: The quarks and gluons are confined objects, they cannot be put on the mass-shell, it is questionable to apply the Landau equation to study the Feynman diagrams in the QCD sum rules. Furthermore, we carry out the operator product expansion in the deep Euclidean region $p^2\to -\infty$, where the Landau singularities cannot exist. The Landau equation servers as a kinematical equation in the momentum space, and is independent on the factorizable and nonfactorizable properties of the Feynman diagrams in the color space. The meson-meson scattering state and tetraquark molecular state both have four valence quarks, which form two color-neutral clusters, we cannot distinguish the contributions based on the two color-neutral clusters in the factorizable Feynman diagrams. Lucha, Melikhov and Sazdjian assert that the contributions at the order $\mathcal{O}(\alpha_s^k)$ with $k\leq1$ in the operator product expansion, which are factorizable in the color space, are exactly canceled out by the meson-meson scattering states at the hadron side, the tetraquark molecular states begin to receive contributions at the order $\mathcal{O}(\alpha_s^2)$. Such an assertion is questionable, we refute the assertion in details, and choose an axialvector current and a tensor current to examine the outcome of the assertion. After detailed analysis, we observe that the meson-meson scattering states cannot saturate the QCD sum rules, while the tetraquark molecular states can saturate the QCD sum rules. The Landau equation is of no use to study the Feynman diagrams in the QCD sum rules for the tetraquark molecular states, the tetraquark molecular states begin to receive contributions at the order $\mathcal{O}(\alpha_s^0/\alpha_s^1)$ rather than at the order $\mathcal{O}(\alpha_s^2)$.


title: Tight bound on finite-resolution quantum thermometry at low temperatures

abstract: Precise thermometry is of wide importance in science and technology in general and in quantum systems in particular. Here, we investigate fundamental precision limits for thermometry on cold quantum systems, taking into account constraints due to finite measurement resolution. We derive a tight bound on the optimal precision scaling with temperature, as the temperature approaches zero. The bound can be saturated by monitoring the non-equilibrium dynamics of a single-qubit probe. We support this finding by accurate numerical simulations of a spin-boson model. Our results are relevant both fundamentally, as they illuminate the ultimate limits to quantum thermometry, and practically, in guiding the development of sensitive thermometric techniques applicable at ultracold temperatures.


title: Reconstruction of Interbank Network using Ridge Entropy Maximization Model

abstract: We develop a network reconstruction model based on entropy maximization considering the sparsity of networks. We reconstruct the interbank network in Japan from financial data in individual banks' balance sheets using the developed reconstruction model from 2000 to 2016. The observed sparsity of the interbank network is successfully reproduced. We examine the characteristics of the reconstructed interbank network by calculating important network attributes. We obtain the following characteristics, which are consistent with the previously known stylized facts. Although we do not introduce the mechanism to generate the core and peripheral structure, we impose the constraints to consider the sparsity that is no transactions within the same bank category except for major commercial banks, the core and peripheral structure has spontaneously emerged. We identify major nodes in each community using the value of PageRank and degree to examine the changing role of each bank category. The observed changing role of banks is considered a result of the quantitative and qualitative monetary easing policy started by the Bank of Japan in April 2013.


title: Partial regularity for Navier-Stokes and liquid crystals inequalities without maximum principle

abstract: In 1985, V. Scheffer discussed partial regularity results for what he called solutions to the "Navier-Stokes inequality". These maps essentially satisfy the incompressibility condition as well as the local and global energy inequalities and the pressure equation which may be derived formally from the Navier-Stokes system of equations, but they are not required to satisfy the Navier-Stokes system itself. We extend this notion to a system considered by Fang-Hua Lin and Chun Liu in the mid 1990s related to models of the flow of nematic liquid crystals, which include the Navier-Stokes system when the "director field" $d$ is taken to be zero. In addition to an extended Navier-Stokes system, the Lin-Liu model includes a further parabolic system which implies an a priori maximum principle for $d$ which they use to establish partial regularity (specifically, $\mathcal{P}^{1}(\mathcal{S})=0$) of solutions. For the analogous "inequality" one loses this maximum principle, but here we nonetheless establish certain partial regularity results (namely $\mathcal{P}^{\frac 92 + \delta}(\mathcal{S})=0$, so that in particular the putative singular set $\mathcal{S}$ has space-time Lebesgue measure zero). Under an additional assumption on $d$ for any fixed value of a certain parameter $\sigma \in (5,6)$ (which for $\sigma =6$ reduces precisely to the boundedness of $d$ used by Lin and Liu), we obtain the same partial regularity ($\mathcal{P}^{1}(\mathcal{S})=0$) as do Lin and Liu. In particular, we recover the partial regularity result ($\mathcal{P}^{1}(\mathcal{S})=0$) of Caffarelli-Kohn-Nirenberg (1982) for "suitable weak solutions" of the Navier-Stokes system, and we verify Scheffer's assertion that the same hold for solutions of the weaker "inequality" as well.


title: Mapping diffusivity of narrow channels into one-dimension

abstract: The diffusion of particles trapped in long narrow channels occurs predominantly in one dimension. Here, molecular dynamics simulation is used to study the inertial dynamics of two-dimensional hard disks, confined to long, narrow, structureless channels with hard walls in the no-passing regime. We show that the diffusion coefficient obtained from the mean squared displacement can be mapped onto the exact results for the diffusion of the strictly one-dimensional hard rod system through an effective occupied volume fraction obtained from either the equation of state or a geometric projection of the particle interaction diameters.


title: Interactive Visualization of Saturation Attempts in Vampire

abstract: Many applications of formal methods require automated reasoning about system properties, such as system safety and security. To improve the performance of automated reasoning engines, such as SAT/SMT solvers and first-order theorem prover, it is necessary to understand both the successful and failing attempts of these engines towards producing formal certificates, such as logical proofs and/or models. Such an analysis is challenging due to the large number of logical formulas generated during proof/model search. In this paper we focus on saturation-based first-order theorem proving and introduce the SATVIS tool for interactively visualizing saturation-based proof attempts in first-order theorem proving. We build SATVIS on top of the world-leading theorem prover VAMPIRE, by interactively visualizing the saturation attempts of VAMPIRE in SATVIS. Our work combines the automatic layout and visualization of the derivation graph induced by the saturation attempt with interactive transformations and search functionality. As a result, we are able to analyze and debug (failed) proof attempts of VAMPIRE. Thanks to its interactive visualisation, we believe SATVIS helps both experts and non-experts in theorem proving to understand first-order proofs and analyze/refine failing proof attempts of first-order provers.


title: Improved Simulation Accuracy of the Split-Step Fourier Method

abstract: We investigate a modified split-step Fourier method (SSFM) by including low-pass filters in the linear steps. This method can simultaneously achieve a higher simulation accuracy and a slightly reduced complexity.


title: Deconfinement of Mott Localized Electrons into Topological and Spin-Orbit Coupled Dirac Fermions

abstract: The interplay of electronic correlations, spin-orbit coupling and topology holds promise for the realization of exotic states of quantum matter. Models of strongly interacting electrons on honeycomb lattices have revealed rich phase diagrams featuring unconventional quantum states including chiral superconductivity and correlated quantum spin Hall insulators intertwining with complex magnetic order. Material realizations of these electronic states are however scarce or inexistent. In this work, we propose and show that stacking 1T-TaSe$_{2}$ into bilayers can deconfine electrons from a deep Mott insulating state in the monolayer to a system of correlated Dirac fermions subject to sizable spin-orbit coupling in the bilayer. 1T-TaSe$_{2}$ develops a Star-of-David (SoD) charge density wave pattern in each layer. When the SoD centers belonging to two adyacent layers are stacked in a honeycomb pattern, the system realizes a generalized Kane-Mele-Hubbard model in a regime where Dirac semimetallic states are subject to significant Mott-Hubbard interactions and spin-orbit coupling. At charge neutrality, the system is close to a quantum phase transition between a quantum spin Hall and an antiferromagnetic insulator. We identify a perpendicular electric field and the twisting angle as two knobs to control topology and spin-orbit coupling in the system. Their combination can drive it across hitherto unexplored grounds of correlated electron physics including a quantum tricritical point and an exotic first-order topological phase transition.


title: Multicoding in neural information transfer suggested by mathematical analysis of the frequency-dependent synaptic plasticity in vivo

abstract: Two elements of neural information processing have primarily been proposed: firing rate and spike timing of neurons. In the case of synaptic plasticity, although spike-timing-dependent plasticity (STDP) depending on presynaptic and postsynaptic spike times had been considered the most common rule, recent studies have shown the inhibitory nature of the brain in vivo for precise spike timing, which is key to the STDP. Thus, the importance of the firing frequency in synaptic plasticity in vivo has been recognized again. However, little is understood about how the frequency-dependent synaptic plasticity (FDP) is regulated in vivo. Here, we focused on the presynaptic input pattern, the intracellular calcium decay time constants, and the background synaptic activity, which vary depending on neuron types and the anatomical and physiological environment in the brain. By analyzing a calcium-based model, we found that the synaptic weight differs depending on these factors characteristic in vivo, even if neurons receive the same input rate. This finding suggests the involvement of multifaceted factors other than input frequency in FDP and even neural coding in vivo.


title: Irreducible modules over finite simple Lie pseudoalgebras III. Primitive pseudoalgebras of type H

abstract: A Lie conformal algebra is an algebraic structure that encodes the singular part of the operator product expansion of chiral fields in conformal field theory. A Lie pseudoalgebra is a generalization of this structure, for which the algebra of polynomials k[\partial] in the indeterminate is replaced by the universal enveloping algebra U(d) of a finite-dimensional Lie algebra d over the base field k. The finite (i.e., finitely generated over U(d)) simple Lie pseudoalgebras were classified in our 2001 paper [BDK]. The complete list consists of primitive Lie pseudoalgebras of type W, S, H, and K, and of current Lie pseudoalgebras over them or over simple finite-dimensional Lie algebras. The present paper is the third in our series on representation theory of simple Lie pseudoalgebras. In the first paper, we showed that any finite irreducible module over a primitive Lie pseudoalgebra of type W or S is either an irreducible tensor module or the image of the differential in a member of the pseudo de Rham complex. In the second paper, we established a similar result for primitive Lie pseudoalgebras of type K, with the pseudo de Rham complex replaced by a certain reduction, called the contact pseudo de Rham complex. This reduction in the context of contact geometry was discovered by M. Rumin [Rum]. In the present paper, we show that for primitive Lie pseudoalgebras of type H, a similar to type K result holds with the contact pseudo de Rham complex replaced by a suitable complex. However, the type H case in more involved, since the annihilation algebra is not the corresponding Lie-Cartan algebra, as in other cases, but an irreducible central extension. When the action of the center of the annihilation algebra is trivial, this complex is related to work by M. Eastwood [E] on conformally symplectic geometry, and we call it conformally symplectic pseudo de Rham complex.


title: Characterization of many-body mobility edges with random matrices

abstract: Whether the many-body mobility edges can exist in a one-dimensional interacting quantum system is a controversial problem, mainly hampered by the limited system sizes amenable to numerical simulations. We investigate the transition from chaos to localization by constructing a combined random matrix, which has two extremes, one of Gaussian orthogonal ensemble and the other of Poisson statistics, drawn from different distributions. We find that by fixing a scaling parameter, the mobility edges can exist while increasing the matrix dimension $D\rightarrow\infty$, depending on the distribution of matrix elements of the diagonal uncorrelated matrix. By applying those results to a specific one-dimensional isolated quantum system of random diagonal elements, we confirm the existence of a many-body mobility edge, connecting it with results on the onset of level repulsion extracted from ensembles of mixed random matrices.


title: Gauge dependence of the gauge boson projector

abstract: The propagator of a gauge boson, like the massless photon or the massive vector bosons $W^\pm$ and $Z$ of the electroweak theory, can be derived in two different ways, namely via Green's functions (semi-classical approach) or via the vacuum expectation value of the time-ordered product of the field operators (field theoretical approach). Comparing the semi-classical with the field theoretical approach, the central tensorial object can be defined as the gauge boson projector, directly related to the completeness relation for the complete set of polarisation four-vectors. In this paper we explain the relation for this projector to different cases of the $R_\xi$ gauge and explain why the unitary gauge is the default gauge for massive gauge bosons.


title: Montage: A Neural Network Language Model-Guided JavaScript Engine Fuzzer

abstract: JavaScript (JS) engine vulnerabilities pose significant security threats affecting billions of web browsers. While fuzzing is a prevalent technique for finding such vulnerabilities, there have been few studies that leverage the recent advances in neural network language models (NNLMs). In this paper, we present Montage, the first NNLM-guided fuzzer for finding JS engine vulnerabilities. The key aspect of our technique is to transform a JS abstract syntax tree (AST) into a sequence of AST subtrees that can directly train prevailing NNLMs. We demonstrate that Montage is capable of generating valid JS tests, and show that it outperforms previous studies in terms of finding vulnerabilities. Montage found 37 real-world bugs, including three CVEs, in the latest JS engines, demonstrating its efficacy in finding JS engine bugs.


title: Breather Solutions of the Cubic Klein-Gordon Equation

abstract: We obtain real-valued, time-periodic and radially symmetric solutions of the cubic Klein-Gordon equation \begin{align} \partial_t^2 U - \Delta U + m^2 U = \Gamma (x) U^3 \quad \text{on } \mathbb{R} \times \mathbb{R}^3, \end{align} which are weakly localized in space. Various families of such "breather" solutions are shown to bifurcate from any given nontrivial stationary solution. The construction of weakly localized breathers in three space dimensions is, to the author's knowledge, a new concept and based on the reformulation of the cubic Klein-Gordon equation as a system of coupled nonlinear Helmholtz equations involving suitable conditions on the far field behavior.


title: On fast multiplication of a matrix by its transpose

abstract: We present a non-commutative algorithm for the multiplication of a 2x2-block-matrix by its transpose using 5 block products (3 recursive calls and 2 general products) over C or any finite field.We use geometric considerations on the space of bilinear forms describing 2x2 matrix products to obtain this algorithm and we show how to reduce the number of involved additions.The resulting algorithm for arbitrary dimensions is a reduction of multiplication of a matrix by its transpose to general matrix product, improving by a constant factor previously known reductions.Finally we propose schedules with low memory footprint that support a fast and memory efficient practical implementation over a finite field.To conclude, we show how to use our result in LDLT factorization.