title: Computational Polarization: An Information-theoretic Method for Resilient Computing

abstract: We introduce an error resilient distributed computing method based on an extension of the channel polarization phenomenon to distributed algorithms. The method leverages an algorithmic split operation that transforms two identical compute nodes to slow and fast workers, which parallels the channel split operation in Polar Codes. This operation preserves the average runtime, analogous to the conservation of Shannon capacity in channel polarization. By leveraging a recursive construction in a similar spirit to the Fast Fourier Transform, this method synthesizes virtual compute nodes with dispersed return time distributions, which we call computational polarization. We show that the runtime distributions form a functional martingale processes, identify their limiting distributions in closed-form expressions together with non-asymptotic convergence rates, and prove strong convergence results in Banach spaces. We provide an information-theoretic lower bound on the overall runtime of any coded computation method and show that the computational polarization approach asymptotically achieves the optimal runtime for computing linear functions. An important advantage is the near linear time decoding procedure, which is significantly cheaper than Maximum Distance Separable codes.


title: Unsupervised Detection and Clustering of Malicious TLS Flows

abstract: Malware abuses TLS to encrypt its malicious traffic, preventing examination by content signatures and deep packet inspection. Network detection of malicious TLS flows is an important, but challenging, problem. Prior works have proposed supervised machine learning detectors using TLS features. However, by trying to represent all malicious traffic, supervised binary detectors produce models that are too loose, thus introducing errors. Furthermore, they do not distinguish flows generated by different malware. On the other hand, supervised multi-class detectors produce tighter models and can classify flows by malware family, but require family labels, which are not available for many samples. To address these limitations, this work proposes a novel unsupervised approach to detect and cluster malicious TLS flows. Our approach takes as input network traces from sandboxes. It clusters similar TLS flows using 90 features that capture properties of the TLS client, TLS server, certificate, and encrypted payload; and uses the clusters to build an unsupervised detector that can assign a malicious flow to the cluster it belongs to, or determine it is benign. We evaluate our approach using 972K traces from a commercial sandbox and 35M TLS flows from a research network. Our clustering shows very high precision and recall with an F1 score of 0.993. We compare our unsupervised detector with two state-of-the-art approaches, showing that it outperforms both. The false detection rate of our detector is 0.032% measured over four months of traffic.


title: Emergence of memory manifolds

abstract: The ability to store continuous variables in the state of a biological system (e.g. a neural network) is critical for many behaviours. Most models for implementing such a memory manifold require hand-crafted symmetries in the interactions or precise fine-tuning of parameters. We present a general principle that we refer to as {\it frozen stabilisation} (FS), which allows a family of neural networks to self-organise to a critical state exhibiting multiple memory manifolds without parameter fine-tuning or symmetries. Memory manifolds arising from FS exhibit a wide range of emergent relaxational timescales and can be used as general purpose integrators for inputs aligned with the manifold. Moreover, FS allows robust memory manifolds in small networks, and this is relevant to debates of implementing continuous attractors with a small number of neurons in light of recent experimental discoveries.


title: Integrated and Adaptive Guidance and Control for Endoatmospheric Missiles via Reinforcement Learning

abstract: We apply a reinforcement meta-learning framework to optimize an integrated and adaptive guidance and flight control system for an air-to-air missile. The system is implemented as a policy that maps navigation system outputs directly to commanded rates of change for the missile's control surface deflections. The system induces intercept trajectories against a maneuvering target that satisfy control constraints on fin deflection angles, and path constraints on look angle and load. We test the optimized system in a six degrees-of-freedom simulator that includes a non-linear radome model and a strapdown seeker model, and demonstrate that the system adapts to both a large flight envelope and off-nominal flight conditions including perturbation of aerodynamic coefficient parameters and center of pressure locations, and flexible body dynamics. Moreover, we find that the system is robust to the parasitic attitude loop induced by radome refraction and imperfect seeker stabilization. We compare our system's performance to a longitudinal model of proportional navigation coupled with a three loop autopilot, and find that our system outperforms this benchmark by a large margin. Additional experiments investigate the impact of removing the recurrent layer from the policy and value function networks, performance with an infrared seeker, and flexible body dynamics.


title: Sensitivity of accelerator-based neutrino experiments to neutrino-dark matter interaction: Elko as a viable dark matter candidate

abstract: We analyze the potential of accelerator-based neutrino experiments, such as the Deep Underground Neutrino Experiment, to constrain a five dimensional operator mediating a beyond standard model interaction between mass dimension one fermion fields, labeled elko, and neutrino. We identify the parameter space where elko is a viable dark matter candidate.


title: On the estimation of discrete choice models to capture irrational customer behaviors

abstract: The Random Utility Maximization model is by far the most adopted framework to estimate consumer choice behavior. However, behavioral economics has provided strong empirical evidence of irrational choice behavior, such as halo effects, that are incompatible with this framework. Models belonging to the Random Utility Maximization family may therefore not accurately capture such irrational behavior. Hence, more general choice models, overcoming such limitations, have been proposed. However, the flexibility of such models comes at the price of increased risk of overfitting. As such, estimating such models remains a challenge. In this work, we propose an estimation method for the recently proposed Generalized Stochastic Preference choice model, which subsumes the family of Random Utility Maximization models and is capable of capturing halo effects. Specifically, we show how to use partially-ranked preferences to efficiently model rational and irrational customer types from transaction data. Our estimation procedure is based on column generation, where relevant customer types are efficiently extracted by expanding a tree-like data structure containing the customer behaviors. Further, we propose a new dominance rule among customer types whose effect is to prioritize low orders of interactions among products. An extensive set of experiments assesses the predictive accuracy of the proposed approach. Our results show that accounting for irrational preferences can boost predictive accuracy by 12.5% on average, when tested on a real-world dataset from a large chain of grocery and drug stores.


title: Spectral density of individual trajectories of an active Brownian particle

abstract: We study analytically the single-trajectory spectral density (STSD) of an active Brownian motion as exhibited, for example, by the dynamics of a chemically-active Janus colloid. We evaluate the standardly-defined spectral density, i.e. the STSD averaged over a statistical ensemble of trajectories in the limit of an infinitely long observation time $T$, and also go beyond the standard analysis by considering the coefficient of variation $\gamma$ of the distribution of the STSD. Moreover, we analyse the finite-$T$ behaviour of the STSD and $\gamma$, determine the cross-correlations between spatial components of the STSD, and address the effects of translational diffusion on the functional forms of spectral densities. The exact expressions that we obtain unveil many distinctive features of active Brownian motion compared to its passive counterpart, which allow to distinguish between these two classes based solely on the spectral content of individual trajectories.


title: Double transition in kinetic exchange opinion models with activation dynamics

abstract: In this work we study a model of opinion dynamics considering activation/deactivation of agents. In other words, individuals are not static and can become inactive and drop out from the discussion. A probability $w$ governs the deactivation dynamics, whereas social interactions are ruled by kinetic exchanges, considering competitive positive/negative interactions. Inactive agents can become active due to interactions with active agents. Our analytical and numerical results show the existence of two distinct nonequilibrium phase transitions, with the occurrence of three phases, namely ordered (ferromagnetic-like), disordered (paramagnetic-like) and absorbing phases. The absorbing phase represents a collective state where all agents are inactive, i.e., they do not participate on the dynamics, inducing a frozen state. We determine the critical value $w_c$ above which the system is in the absorbing phase independently of the other parameters. We also verify a distinct critical behavior for the transitions among different phases.


title: A new shape function and some specific wormhole solutions in braneworld scenario

abstract: Considering a energy density of the form $\rho=q\left({\frac{r}{r_0}}\right)^{-n}$( where $q$ is an arbitrary positive constant with dimension of energy density and $n>0$), a shape function is obtained by using field equations of braneworld gravity theory in this paper. Under isotropic scenario wormhole solutions are obtained considering six different redshift functions along with the obtained new shape function. For anisotropic case wormhole solutions are obtained under the consideration of five different shape functions along with the redshift function $\phi=\beta ln(\frac{r}{r_0})$, where $\beta$ is an arbitrary constant. In each case all the energy conditions are examined and it is found that for some cases all energy conditions are satisfied in the vicinity of the wormhole throat and for the rest cases all energy conditions are satisfied except strong energy condition.


title: Signature of half-metallicity in $\text{BiFeO}_\text{3}$

abstract: $\text{BiFeO}_\text{3}$ has drawn a great attention over last several decades due to its promising multiferroic character. In the ground state the bulk $\text{BiFeO}_\text{3}$ is found to be in the rhombohedral phase. However, it has been possible to stabilize $\text{BiFeO}_\text{3}$ with tetragonal structure. The importance of tetragonal phase is due to its much larger value of the electric polarization and the possible stabilization of ferromagnetism as in the rhombohedral phase. Furthermore, the tetragonal structure of $\text{BiFeO}_\text{3}$ has been reported with different $c/a$ ratio, opening up the possibility of a much richer set of electronic phases. In this work, we have used density functional theory based first-principle method to study the ferromagnetic phase of the tetragonal $\text{BiFeO}_\text{3}$ structure as a function of the $c/a$ ratio. We have found that as the $c/a$ ratio decreases from $1.264$ to $1.016$, the tetragonal $\text{BiFeO}_\text{3}$ evolve from a ferromagnetic semiconductor to a ferromagnetic metal, while passing through a \emph{half-metallic} phase. This evolution of the electronic properties becomes even more interesting when viewed with respect to the volume of each structure. The most stable half-metallic phase initially counter-intuitively evolve to the magnetic-semiconducting phase with a reduction in the volume, and after further reduction in the volume it finally becomes a metal. So far, this type of metal to insulator transition on compression was known to exist only in alkali metals, especially in Lithium, in heavy alkaline earth metals, and in some binary compound.


title: Quark condensate from confinement in QCD

abstract: The scalar confinement in QCD is shown to produce the nonzero quark condensate for any current quark mass. Mechanisms for the Chiral Symmetry breaking and for the nonzero quark condensates are revealed. For the light and strange flavors the condensates are essentially chiral (proportional to (string tension)$^{3/2}$). The expressions for the quark condensates are obtained as a sum over non-chiral meson states, and, using the operator product expansion, as an explicit expression that involves the confining string tension and the current quark mass. The numerical results are fairly close to the lattice data.


title: Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems

abstract: Transformer models have achieved state-of-the-art results in a wide range of NLP tasks including summarization. Training and inference using large transformer models can be computationally expensive. Previous work has focused on one important bottleneck, the quadratic self-attention mechanism in the encoder. Modified encoder architectures such as LED or LoBART use local attention patterns to address this problem for summarization. In contrast, this work focuses on the transformer's encoder-decoder attention mechanism. The cost of this attention becomes more significant in inference or training approaches that require model-generated histories. First, we examine the complexity of the encoder-decoder attention. We demonstrate empirically that there is a sparse sentence structure in document summarization that can be exploited by constraining the attention mechanism to a subset of input sentences, whilst maintaining system performance. Second, we propose a modified architecture that selects the subset of sentences to constrain the encoder-decoder attention. Experiments are carried out on abstractive summarization tasks, including CNN/DailyMail, XSum, Spotify Podcast, and arXiv.


title: Noise-induced network bursts and coherence in a calcium-mediated neural network

abstract: Noise-induced population bursting has been widely identified to play important roles in the information process. We constructed a mathematical model for a random and sparse neural network where bursting can be induced from the resting state by the global stochastic stimulus. Importantly, the noise-induced bursting dynamics of this network are mediated by calcium conductance. We use two spectral measures to evaluate the network coherence in the context of network bursts, the spike trains of all neurons and the individual bursts of all neurons. Our results show that the coherence of the network is optimized by an optimal level of stochastic stimulus, which is known as coherence resonance (CR). We also demonstrate that the interplay of calcium conductance and noise intensity can modify the degree of CR.


title: Model Explanations via the Axiomatic Causal Lens

abstract: Explaining the decisions of black-box models is a central theme in the study of trustworthy ML. Numerous measures have been proposed in the literature; however, none of them take an axiomatic approach to causal explainability. In this work, we propose three explanation measures which aggregate the set of all but-for causes -- a necessary and sufficient explanation -- into feature importance weights. Our first measure is a natural adaptation of Chockler and Halpern's notion of causal responsibility, whereas the other two correspond to existing game-theoretic influence measures. We present an axiomatic treatment for our proposed indices, showing that they can be uniquely characterized by a set of desirable properties. We also extend our approach to derive a new method to compute the Shapley-Shubik and Banzhaf indices for black-box model explanations. Finally, we analyze and compare the necessity and sufficiency of all our proposed explanation measures in practice using the Adult-Income dataset. Thus, our work is the first to formally bridge the gap between model explanations, game-theoretic influence, and causal analysis.


title: SORNet: Spatial Object-Centric Representations for Sequential Manipulation

abstract: Sequential manipulation tasks require a robot to perceive the state of an environment and plan a sequence of actions leading to a desired goal state. In such tasks, the ability to reason about spatial relations among object entities from raw sensor inputs is crucial in order to determine when a task has been completed and which actions can be executed. In this work, we propose SORNet (Spatial Object-Centric Representation Network), a framework for learning object-centric representations from RGB images conditioned on a set of object queries, represented as image patches called canonical object views. With only a single canonical view per object and no annotation, SORNet generalizes zero-shot to object entities whose shape and texture are both unseen during training. We evaluate SORNet on various spatial reasoning tasks such as spatial relation classification and relative direction regression in complex tabletop manipulation scenarios and show that SORNet significantly outperforms baselines including state-of-the-art representation learning techniques. We also demonstrate the application of the representation learned by SORNet on visual-servoing and task planning for sequential manipulation on a real robot.


title: Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models

abstract: We investigate the use of multimodal information contained in images as an effective method for enhancing the commonsense of Transformer models for text generation. We perform experiments using BART and T5 on concept-to-text generation, specifically the task of generative commonsense reasoning, or CommonGen. We call our approach VisCTG: Visually Grounded Concept-to-Text Generation. VisCTG involves captioning images representing appropriate everyday scenarios, and using these captions to enrich and steer the generation process. Comprehensive evaluation and analysis demonstrate that VisCTG noticeably improves model performance while successfully addressing several issues of the baseline generations, including poor commonsense, fluency, and specificity.


title: Interpretable Run-Time Prediction and Planning in Co-Robotic Environments

abstract: Mobile robots are traditionally developed to be reactive and avoid collisions with surrounding humans, often moving in unnatural ways without following social protocols, forcing people to behave very differently from human-human interaction rules. Humans, on the other hand, are seamlessly able to understand why they may interfere with surrounding humans and change their behavior based on their reasoning, resulting in smooth, intuitive avoiding behaviors. In this paper, we propose an approach for a mobile robot to avoid interfering with the desired paths of surrounding humans. We leverage a library of previously observed trajectories to design a decision-tree based interpretable monitor that: i) predicts whether the robot is interfering with surrounding humans, ii) explains what behaviors are causing either prediction, and iii) plans corrective behaviors if interference is predicted. We also propose a validation scheme to improve the predictive model at run-time. The proposed approach is validated with simulations and experiments involving an unmanned ground vehicle (UGV) performing go-to-goal operations in the presence of humans, demonstrating non-interfering behaviors and run-time learning.


title: Sub-diffusive wave transport and weak localization transition in three-dimensional stealthy hyperuniform disordered systems

abstract: The purpose of this work is to understand the fundamental connection between structural correlations and light localization in three-dimensional (3D) open scattering systems of finite size. We numerically investigate the transport of vector electromagnetic waves scattered by resonant electric dipoles spatially arranged in 3D space by stealthy hyperuniform disordered point patterns. Three-dimensional stealthy hyperuniform disordered systems (3D-SHDS) are engineered with different structural correlation properties determined by their degree of stealthiness $\chi$. Such fine control of exotic states of amorphous matter enables the systematic design of optical media that interpolate in a tunable fashion between uncorrelated random structures and crystalline materials. By solving the electromagnetic multiple scattering problem using Green's matrix spectral method, we establish a transport phase diagram that demonstrates a distinctive transition from a diffusive to a weak localization regime beyond a critical scattering density that depends on $\chi$. The transition is characterized by studying the Thouless number and the spectral statistics of the scattering resonances. In particular, by tuning the $\chi$ parameter, we demonstrate large spectral gaps and suppressed sub-radiant proximity resonances, facilitating light localization. Moreover, consistently with previous studies, our results show a region of the transport phase diagram where the investigated scattering systems become transparent. Our work provides a systematic description of the transport and weak localization properties of light in stealthy hyperuniform structures and motivates the engineering of novel photonic systems with enhanced light-matter interactions for applications to both classical and quantum devices.


title: Free uniformly complete vector lattices

abstract: We define a free uniformly complete vector lattice over a set of generators and give its concrete representation as a space of continuous positively homogeneous functions.


title: A Survey Length for AGN Variability Studies

abstract: The damped random walk (DRW) process is one of the most commonly used and simplest stochastic models to describe variability of active galactic nuclei (AGN). An AGN light curve can be converted to just two DRW model parameters - the signal decorrelation timescale $\tau$ and the asymptotic amplitude ${SF}_{\infty}$. By simulation means, we have recently shown that in order to measure the decorrelation timescale accurately, the experiment or the light curve length must be at least 10 times the underlying decorrelation timescale. In this paper, we investigate the origin of this requirement and find that typical AGN light curves do not sufficiently represent the intrinsic stationary process. We simulated extremely long (10,000$\tau$) AGN light curves using DRW, and then measured the variance and the mean of short light curves spanning 1-1000$\tau$. We modeled these light curves with DRW to obtain both the signal decorrelation timescale $\tau$ and the asymptotic amplitude ${SF}_{\infty}$. The variance in light curves shorter than $\approx30\tau$ is smaller than that of the input process, as estimated by both a simple calculation from the light curve and by DRW modeling. This means that while the simulated stochastic process is intrinsically stationary, short light curves do not adequately represent the stationary process. Since the variance and timescale are correlated, underestimated variances in short light curves lead to underestimated timescales as compared to the input process. It seems, that a simulated AGN light curve does not fully represent the underlying DRW process until its length reaches even $\approx30$ decorrelation timescales. Modeling short AGN light curves with DRW leads to biases in measured parameters of the model - the amplitude being too small and the timescale being too short.


title: Borel Summation and Analytic Continuation of the Heat Kernel on Hyperbolic Space

abstract: The heat kernel expansion on even-dimensional hyperbolic spaces is asymptotic at both short and long times, with interestingly different Borel properties for these short and long time expansions. Resummations in terms of incomplete gamma functions provide accurate extrapolations and analytic continuations, relating the heat kernel to the Schrodinger kernel, and the heat kernel on hyperbolic space to the heat kernel on spheres. For the diagonal heat kernel there is also a duality between short and long times which mixes the scalar and spinor heat kernels.


title: Spectrum of weighted Birkhoff average

abstract: Let $\{s_n\}_{n\in\N}$ be a decreasing nonsummable sequence of positive reals. In this paper, we investigate the weighted Birkhoff average $\frac{1}{S_n}\sum_{k=0}^{n-1}s_k\phi(T^kx)$ on aperiodic irreducible subshift of finite type $\Sigma_{\bf A}$ where $\phi: \Sigma_{\bf A}\mapsto \R$ is a continuous potential. Firstly, we show the entropy spectrum of the weighed Birkhoff averages remains the same as that of the Birkhoff averages. Then we calculate the packing spectrum of the weighed Birkhoff averages. It turns out that we can have two cases, either the packing dimension of every level set equals to its Hausdorff dimension or for every nonempty level set it is equal to the packing dimension of the whole space.


title: A Co-Scaling Grid for Athena++

abstract: We present a co-scaling grid formalism and its implementation in the magnetohydrodynamics code Athena++. The formalism relies on flow symmetries in astrophysical problems involving expansion, contraction, and center-of-mass motion. The grid is evolved at the same time order as the fluid variables. The user specifies grid evolution laws, which can be independent of the fluid motion. Applying our implementation to standard hydrodynamic test cases leads to improved results and higher efficiency, compared to the fixed-grid solutions.


title: Machine learning modeling of family wide enzyme-substrate specificity screens

abstract: Biocatalysis is a promising approach to sustainably synthesize pharmaceuticals, complex natural products, and commodity chemicals at scale. However, the adoption of biocatalysis is limited by our ability to select enzymes that will catalyze their natural chemical transformation on non-natural substrates. While machine learning and in silico directed evolution are well-posed for this predictive modeling challenge, efforts to date have primarily aimed to increase activity against a single known substrate, rather than to identify enzymes capable of acting on new substrates of interest. To address this need, we curate 6 different high-quality enzyme family screens from the literature that each measure multiple enzymes against multiple substrates. We compare machine learning-based compound-protein interaction (CPI) modeling approaches from the literature used for predicting drug-target interactions. Surprisingly, comparing these interaction-based models against collections of independent (single task) enzyme-only or substrate-only models reveals that current CPI approaches are incapable of learning interactions between compounds and proteins in the current family level data regime. We further validate this observation by demonstrating that our no-interaction baseline can outperform CPI-based models from the literature used to guide the discovery of kinase inhibitors. Given the high performance of non-interaction based models, we introduce a new structure-based strategy for pooling residue representations across a protein sequence. Altogether, this work motivates a principled path forward in order to build and evaluate meaningful predictive models for biocatalysis and other drug discovery applications.


title: Renovation of EdgeCloudSim: An Efficient Discrete-Event Approach

abstract: Due to the growing popularity of the Internet of Things, edge computing concept has been widely studied to relieve the load on the original cloud and networks while improving the service quality for end-users. To simulate such a complex environment involving edge and cloud computing, EdgeCloudSim has been widely adopted. However, it suffers from certain efficiency and scalability issues due to the ignorance of the deficiency in the originally adopted data structures and maintenance strategies. Specifically, it generates all events at beginning of the simulation and stores unnecessary historical information, both result in unnecessarily high complexity for search operations. In this work, by fixing the mismatches on the concept of discrete-event simulation, we propose enhancement of EdgeCloudSim which improves not only the runtime efficiency of simulation, but also the flexibility and scalability. Through extensive experiments with statistical methods, we show that the enhancement does not affect the expressiveness of simulations while obtaining 2 orders of magnitude speedup, especially when the device count is large.


title: Simplified Quantum Algorithm for the Oracle Identification Problem

abstract: In the oracle identification problem we have oracle access to bits of an unknown string $x$ of length $n$, with the promise that it belongs to a known set $C\subseteq\{0,1\}^n$. The goal is to identify $x$ using as few queries to the oracle as possible. We develop a quantum query algorithm for this problem with query complexity $O\left(\sqrt{\frac{n\log M }{\log(n/\log M)+1}}\right)$, where $M$ is the size of $C$. This bound is already derived by Kothari in 2014, for which we provide a more elegant simpler proof.


title: ELIT: Emory Language and Information Toolkit

abstract: We introduce ELIT, the Emory Language and Information Toolkit, which is a comprehensive NLP framework providing transformer-based end-to-end models for core tasks with a special focus on memory efficiency while maintaining state-of-the-art accuracy and speed. Compared to existing toolkits, ELIT features an efficient Multi-Task Learning (MTL) model with many downstream tasks that include lemmatization, part-of-speech tagging, named entity recognition, dependency parsing, constituency parsing, semantic role labeling, and AMR parsing. The backbone of ELIT's MTL framework is a pre-trained transformer encoder that is shared across tasks to speed up their inference. ELIT provides pre-trained models developed on a remix of eight datasets. To scale up its service, ELIT also integrates a RESTful Client/Server combination. On the server side, ELIT extends its functionality to cover other tasks such as tokenization and coreference resolution, providing an end user with agile research experience. All resources including the source codes, documentation, and pre-trained models are publicly available at https://github.com/emorynlp/elit.


title: Time-frequency analysis of microwave signals based on stimulated Brillouin scattering

abstract: A novel photonic approach to the time-frequency analysis of microwave signals is proposed based on the stimulated Brillouin scattering (SBS)-assisted frequency-to-time mapping (FTTM). Two types of time-frequency analysis links, namely parallel SBS link and time-division SBS link are proposed. The parallel SBS link can be utilized to perform real-time time-frequency analysis of microwave signal, which provides a promising solution for real-time time-frequency analysis, especially when it is combined with the photonic integration technique. A simulation is made to verify its feasibility by analyzing signals in multiple formats. The time-division SBS link has a simpler and reconfigurable structure, which can realize an ultra-high-resolution time-frequency analysis for periodic signals using the time segmentation and accumulation technique. An experiment is performed for the time-division SBS link. The multi-dimensional reconfigurability of the system is experimentally studied. An analysis bandwidth of 3.9 GHz, an analysis frequency up to 20 GHz, and a frequency resolution of 15 MHz are demonstrated, respectively.


title: A Convergence Analysis of the Parallel Schwarz Solution of the Continuous Closest Point Method

abstract: The discretization of surface intrinsic PDEs has challenges that one might not face in the flat space. The closest point method (CPM) is an embedding method that represents surfaces using a function that maps points in the flat space to their closest points on the surface. This mapping brings intrinsic data onto the embedding space, allowing us to numerically approximate PDEs by the standard methods in the tubular neighborhood of the surface. Here, we solve the surface intrinsic positive Helmholtz equation by the CPM paired with finite differences which usually yields a large, sparse, and non-symmetric system. Domain decomposition methods, especially Schwarz methods, are robust algorithms to solve these linear systems. While there have been substantial works on Schwarz methods, Schwarz methods for solving surface differential equations have not been widely analyzed. In this work, we investigate the convergence of the CPM coupled with Schwarz method on 1-manifolds in d-dimensional space of real numbers.


title: Dynamic Locomotion Teleoperation of a Wheeled Humanoid Robot Reduced Model with a Whole-Body Human-Machine Interface

abstract: Bilateral teleoperation provides humanoid robots with human planning intelligence while enabling the human to feel what the robot feels. It has the potential to transform physically capable humanoid robots into dynamically intelligent ones. However, dynamic bilateral locomotion teleoperation remains as a challenge due to the complex dynamics it involves. This work presents our initial step to tackle this challenge via the concept of wheeled humanoid robot locomotion teleoperation by body tilt. Specifically, we developed a force-feedback-capable whole-body human-machine interface (HMI), and designed a force feedback mapping and two teleoperation mappings that map the human's body tilt to the robot's velocity or acceleration. We compared the two mappings and studied the force feedback's effect via an experiment, where seven human subjects teleoperated a simulated robot with the HMI to perform dynamic target tracking tasks. The experimental results suggest that all subjects accomplished the tasks with both mappings after practice, and the force feedback improved their performances. However, the subjects exhibited two distinct teleoperation styles, which benefited from the force feedback differently. Moreover, the force feedback affected the subjects' preferences on the teleoperation mappings, though most subjects performed better with the velocity mapping.


title: A Generalized Theory of Power

abstract: The complex representation of real-valued instantaneous power may be written as the sum of two complex powers, one Hermitian and the other non-Hermitian, or complementary. A virtue of this representation is that it consists of a power triangle rotating around a fixed phasor, thus clarifying what should be meant by the power triangle. The in-phase and quadrature components of complementary power encode for active and non-active power. When instantaneous power is defined for a Thevenin equivalent circuit, these are time-varying real and reactive power components. These claims hold for sinusoidal voltage and current, and for non-sinusoidal voltage and current. Spectral representations of Hermitian, complementary, and instantaneous power show that, frequency-by-frequency, these powers behave exactly as they behave in the single frequency sinusoidal case. Simple hardware diagrams show how instantaneous active and non-active power may be extracted from metered voltage and current, even in certain non-sinusoidal cases.


title: Iterative Respacing of Polygonal Curves

abstract: A $\textit{polygonal curve}$ is a collection of $m$ connected line segments specified as the linear interpolation of a list of points $\{p_0, p_1, \ldots, p_m\}$. These curves may be obtained by sampling points from an oriented curve in $\mathbb{R}^n$. In applications it can be useful for this sample of points to be close to \textit{equilateral}, with equal distance between consecutive points. We present a computationally efficient method for respacing the points of a polygonal curve and show that iteration of this method converges to an equilateral polygonal curve.


title: Quantifying symmetric exchange in ultrathin ferromagnetic films with chirality

abstract: The symmetric (Heisenberg) exchange interaction is fundamental to magnetism and assumes critical importance in designing magnetic materials for novel emergent phenomena and device applications. However, quantifying exchange is extremely challenging for ultrathin ($\sim$ 1 nm) magnetic films, as techniques and approximations reliably used for bulk materials are largely inapplicable in the two-dimensional (2D) limit. Here we present and contrast the measurement of exchange stiffness, $A$, by several methods on a series of five Co/Pt-based ultrathin ($1-2$ nm) films. We compare results from (a) spin-wave spectroscopy by Brillouin light scattering (BLS), (b) three analytical models describing the temperature dependence of magnetization obtained by magnetometry, (c) microscopic domain periodicity measurements and simulations, and (d) ab initio density functional theory (DFT) calculations. While different methods present some qualitatively consistent trends across samples, we note, for any given sample, considerable differences (up to $5\times$) in the absolute values of $A$ across the techniques, consistent with discrepancies of $A$ reported in literature for nominally similar samples. We analyze possible sources of the discrepancies across various methods, notably including their relationship to the spin-wave dispersion, and the wave-vector ranges probed. We compare the strengths and limitations of the techniques, and outline directions for their future use in characterizing exchange interactions in ultrathin films.


title: A Recipe For Arbitrary Text Style Transfer with Large Language Models

abstract: In this paper, we leverage large language models (LMs) to perform zero-shot text style transfer. We present a prompting method that we call augmented zero-shot learning, which frames style transfer as a sentence rewriting task and requires only a natural language instruction, without model fine-tuning or exemplars in the target style. Augmented zero-shot learning is simple and demonstrates promising results not just on standard style transfer tasks such as sentiment, but also on arbitrary transformations such as "make this melodramatic" or "insert a metaphor."


title: Model Theory and Groups

abstract: This is a largely expository paper about how groups arise or are of interest in model theory. Included are the following topics: classifying groups definable in specific structures or theories and the relation to algebraic groups, groups definable in stable, simple and NIP theories, definable compactifications of groups, definable Galois theory (including differential Galois theory), connections with topological dynamics, model theory of the free group.


title: Weighted tensor Golub-Kahan-Tikhonov-type methods applied to image processing using a t-product

abstract: This paper discusses weighted tensor Golub-Kahan-type bidiagonalization processes using the t-product. This product was introduced in [M. E. Kilmer and C. D. Martin, Factorization strategies for third order tensors, Linear Algebra Appl., 435 (2011), pp.~641--658]. A few steps of a bidiagonalization process with a weighted least squares norm are carried out to reduce a large-scale linear discrete ill-posed problem to a problem of small size. The weights are determined by symmetric positive definite (SPD) tensors. Tikhonov regularization is applied to the reduced problem. An algorithm for tensor Cholesky factorization of SPD tensors is presented. The data is a laterally oriented matrix or a general third order tensor. The use of a weighted Frobenius norm in the fidelity term of Tikhonov minimization problems is appropriate when the noise in the data has a known covariance matrix that is not the identity. We use the discrepancy principle to determine both the regularization parameter in Tikhonov regularization and the number of bidiagonalization steps. Applications to image and video restoration are considered.


title: BMS: Secure Decentralized Reconfiguration for Blockchain and BFT Systems

abstract: Reconfiguration of long-lived blockchain and Byzantine fault-tolerant (BFT) systems poses fundamental security challenges. In case of state-of-the-art Proof-of-Stake (PoS) blockchains, stake reconfiguration enables so-called long-range attacks, which can lead to forks. Similarly, permissioned blockchain systems, typically based on BFT, reconfigure internally, which makes them susceptible to a similar "I still work here" attack. In this work, we propose BMS (Blockchain/BFT Membership Service) offering a secure and dynamic reconfiguration service for BFT and blockchain systems, preventing long-range and similar attacks. In particular: (1) we propose a root BMS for permissioned blockchains, implemented as an Ethereum smart contract and evaluate it reconfiguring the recently proposed Mir-BFT protocol, (2) we discuss how our BMS extends to PoS blockchains and how it can reduce PoS stake unbonding time from weeks/months to the order of minutes, and (3) we discuss possible extensions of BMS to hierarchical deployments as well as to multiple root BMSs.


title: Ensemble Fine-tuned mBERT for Translation Quality Estimation

abstract: Quality Estimation (QE) is an important component of the machine translation workflow as it assesses the quality of the translated output without consulting reference translations. In this paper, we discuss our submission to the WMT 2021 QE Shared Task. We participate in Task 2 sentence-level sub-task that challenge participants to predict the HTER score for sentence-level post-editing effort. Our proposed system is an ensemble of multilingual BERT (mBERT)-based regression models, which are generated by fine-tuning on different input settings. It demonstrates comparable performance with respect to the Pearson's correlation and beats the baseline system in MAE/ RMSE for several language pairs. In addition, we adapt our system for the zero-shot setting by exploiting target language-relevant language pairs and pseudo-reference translations.


title: Follow the guides: disentangling human and algorithmic curation in online music consumption

abstract: The role of recommendation systems in the diversity of content consumption on platforms is a much-debated issue. The quantitative state of the art often overlooks the existence of individual attitudes toward guidance, and eventually of different categories of users in this regard. Focusing on the case of music streaming, we analyze the complete listening history of about 9k users over one year and demonstrate that there is no blanket answer to the intertwinement of recommendation use and consumption diversity: it depends on users. First we compute for each user the relative importance of different access modes within their listening history, introducing a trichotomy distinguishing so-called `organic' use from algorithmic and editorial guidance. We thereby identify four categories of users. We then focus on two scales related to content diversity, both in terms of dispersion -- how much users consume the same content repeatedly -- and popularity -- how popular is the content they consume. We show that the two types of recommendation offered by music platforms -- algorithmic and editorial -- may drive the consumption of more or less diverse content in opposite directions, depending also strongly on the type of users. Finally, we compare users' streaming histories with the music programming of a selection of popular French radio stations during the same period. While radio programs are usually more tilted toward repetition than users' listening histories, they often program more songs from less popular artists. On the whole, our results highlight the nontrivial effects of platform-mediated recommendation on consumption, and lead us to speak of `filter niches' rather than `filter bubbles'. They hint at further ramifications for the study and design of recommendation systems.


title: Statistical Geometry and Hessian Structures on Pre-Leibniz Algebroids

abstract: We introduce statistical, conjugate connection and Hessian structures on anti-commutable pre-Leibniz algebroids. Anti-commutable pre-Leibniz algebroids are special cases of local pre-Leibniz algebroids, which are still general enough to include many physically motivated algebroids such as Lie, Courant, metric and higher-Courant algebroids. They create a natural framework for generalizations of differential geometric structures on a smooth manifold. The symmetrization of the bracket on an anti-commutable pre-Leibniz algebroid satisfies a certain property depending on a choice of an equivalence class of connections which are called admissible. These admissible connections are shown to be necessary to generalize aforementioned structures on pre-Leibniz algebroids. Consequently, we prove that, provided certain conditions, statistical and conjugate connection structures are equivalent when defined for admissible connections. Moreover, we also show that for `projected-torsion-free' connections, one can generalize Hessian metrics and Hessian structures. We prove that any Hessian structure yields a statistical structure, where these results are completely parallel to the ones in the manifold setting. We also prove a mild generalization of the fundamental theorem of statistical geometry. Moreover, we generalize $\alpha$-connections, strongly conjugate connections and relative torsion operator, and prove some analogous results.


title: $C^0$-Robustness of topological entropy for geodesic flows

abstract: In this paper, we study the regularity of topological entropy, as a function on the space of Riemannian metrics endowed with the $C^0$ topology. We establish several instances of entropy robustness (persistence of entropy non-vanishing after small $C^0$ perturbations). A large part of this paper is dedicated to metrics on the 2-dimensional torus, for which our main results are that metrics with a contractible closed geodesic have robust entropy (thus generalizing and quantifying a result of Denvir-Mackay) and that metrics with robust positive entropy on the torus are $C^{\infty}$ generic. Moreover, we quantify the asymptotic behavior of volume entropy in the Teichm\~A{\OE}ller space of hyperbolic metrics on a punctured torus, which bounds from below the topological entropy for these metrics. For general closed manifolds of dimension at least 2 we prove that the set of metrics with robust and high positive entropy is $C^0$-large in the sense that it is dense, contains cones and arbitrarily large balls.


title: Quality-Diversity Meta-Evolution: customising behaviour spaces to a meta-objective

abstract: Quality-Diversity (QD) algorithms evolve behaviourally diverse and high-performing solutions. To illuminate the elite solutions for a space of behaviours, QD algorithms require the definition of a suitable behaviour space. If the behaviour space is high-dimensional, a suitable dimensionality reduction technique is required to maintain a limited number of behavioural niches. While current methodologies for automated behaviour spaces focus on changing the geometry or on unsupervised learning, there remains a need for customising behavioural diversity to a particular meta-objective specified by the end-user. In the newly emerging framework of QD Meta-Evolution, or QD-Meta for short, one evolves a population of QD algorithms, each with different algorithmic and representational characteristics, to optimise the algorithms and their resulting archives to a user-defined meta-objective. Despite promising results compared to traditional QD algorithms, QD-Meta has yet to be compared to state-of-the-art behaviour space automation methods such as Centroidal Voronoi Tessellations Multi-dimensional Archive of Phenotypic Elites Algorithm (CVT-MAP-Elites) and Autonomous Robots Realising their Abilities (AURORA). This paper performs an empirical study of QD-Meta on function optimisation and multilegged robot locomotion benchmarks. Results demonstrate that QD-Meta archives provide improved average performance and faster adaptation to a priori unknown changes to the environment when compared to CVT-MAP-Elites and AURORA. A qualitative analysis shows how the resulting archives are tailored to the meta-objectives provided by the end-user.


title: Age-Aware Stochastic Hybrid Systems: Stability, Solutions, and Applications

abstract: In this paper, we analyze status update systems modeled through the Stochastic Hybrid Systems (SHSs) tool. Contrary to previous works, we allow the system's transition dynamics to be polynomial functions of the Age of Information (AoI). This dependence allows us to encapsulate many applications and opens the door for more sophisticated systems to be studied. However, this same dependence on the AoI engenders technical and analytical difficulties that we address in this paper. Specifically, we first showcase several characteristics of the age processes modeled through the SHSs tool. Then, we provide a framework to establish the Lagrange stability and positive recurrence of these processes. Building on this, we provide an approach to compute the m-th moment of the age processes. Interestingly, this technique allows us to approximate the average age by solving a simple set of linear equations. Equipped with this approach, we also provide a sequential convex approximation method to optimize the average age by calibrating the parameters of the system. Finally, we consider an age-dependent CSMA environment where the backoff duration depends on the instantaneous age. By leveraging our analysis, we contrast its performance to the age-blind CSMA and showcase the age performance gain provided by the former.


title: Inverse Optimization: Theory and Applications

abstract: Inverse optimization describes a process that is the "reverse" of traditional mathematical optimization. Unlike traditional optimization, which seeks to compute optimal decisions given an objective and constraints, inverse optimization takes decisions as input and determines an objective and/or constraints that render these decisions approximately or exactly optimal. In recent years, there has been an explosion of interest in the mathematics and applications of inverse optimization. This paper provides a comprehensive review of both the methodological and application-oriented literature in inverse optimization.


title: Well-posedness of the mixed-Fractional Nonlinear Schr\"odinger Equation on $\mathbb{R}^2$

abstract: We investigate the well-posedness theory of the 2-D fractional nonlinear Schr\"odinger equation (NLSE) with a mixed degree of derivatives. Motivated by models in optics and photonics where the light propagation is governed by non-quadratic, fractional, and anisotropic dispersion profile, this paper presents first results in this direction. Dispersive estimates are developed in the context of anisotropic Sobolev spaces defined by inhomogeneous symbols. The main model is shown to exhibit scattering for small data in the scaling-critical space. Furthermore the continuity of solution with respect to the dispersion parameter is shown on a compact time interval.


title: Coset-wise affine functions and cycle types of complete mappings

abstract: Let $K$ be a finite field of characteristic $p$. We study a certain class of functions $K\rightarrow K$ that agree with an $\mathbb{F}_p$-affine function $K\rightarrow K$ on each coset of a given additive subgroup $W$ of $K$ - we call them $W$-coset-wise $\mathbb{F}_p$-affine functions of $K$. We show that these functions form a permutation group on $K$ with the structure of an imprimitive wreath product and characterize which of them are complete mappings of $K$. As a consequence, we are able to provide various new examples of cycle types of complete mappings of $K$, including that $K$ has a complete mapping moving all elements of $K$ in one cycle if $p>2$.


title: Finding a Widely Digitally Delicate Prime

abstract: This paper describes the construction of the first explicitly known widely digitally delicate prime.


title: Flares, Rotation, and Planets of the AU Mic System from TESS Observations

abstract: AU Mic is a young ($\sim$24 Myr), pre-Main Sequence M~dwarf star that was observed in the first month of science observations of the Transiting Exoplanet Survey Satellite (TESS) and re-observed two years later. This target has photometric variability from a variety of sources that is readily apparent in the TESS light curves; spots induce modulation in the light curve, flares are present throughout (manifesting as sharp rises with slow exponential decay phases), and transits of AU Mic b may be seen by eye as dips in the light curve. We present a combined analysis of both TESS Sector 1 and Sector 27 AU Mic light curves including the new 20-second cadence data from TESS Year 3. We compare flare rates between both observations and analyze the spot evolution, showing that the activity levels increase slightly from Sector 1 to Sector 27. Furthermore, the 20-second data collection allows us to detect more flares, smaller flares, and better resolve flare morphology in white light as compared to the 2-minute data collection mode. We also refine the parameters for AU Mic b by fitting three additional transits of AU Mic b from Sector 27 using a model that includes stellar activity. We show that the transits exhibit clear transit timing variations (TTVs) with an amplitude of $\sim$80 seconds. We also detect three transits of a 2.8 $R_\oplus$ planet, AU Mic c, which has a period of 18.86 days.


title: Apsidal motion and physical parameters in the eclipsing system V490 Sct

abstract: We report long-termed UBVRIRcIc photometry of the highly eccentric 12.04 day detached eclipsing binary V490 Sct (V =13.1, B9.5+A0, e = 0.40), which we use to determine its relative and absolute parameters. The absolute masses, radii, and temperatures are Ma = 2.33+/-0.1 Msun, Ra = 1.91+/-0.04 Rsun, and Ta = 9960+/-60 K for the primary and Mb = 2.24+/-0.1 Msun, Rb = 1.86+/-0.04 Rsun, and Tb = 9700+/-80 K for the secondary. The system displays a slow periastron advance that is dominated by general relativity (GR). Our measurement, dw/dt = 0.86 deg/century, is 32% less then the expected rate, dw/dt = 1.24 deg/century, which has an 83% contribution from GR. A comparison with current stellar evolution models shows a good match to the measured properties at an age of about 130 mln. years and Solar abundance. The photometrical parallax of the system pi = 0.77 +/- 0.02 mas, matches quite well the GAIA DR2 value, pi = 0.76 +/- 0.04 mas.


title: Transformers in the loop: Polarity in neural models of language

abstract: Representation of linguistic phenomena in computational language models is typically assessed against the predictions of existing linguistic theories of these phenomena. Using the notion of polarity as a case study, we show that this is not always the most adequate set-up. We probe polarity via so-called 'negative polarity items' (in particular, English 'any') in two pre-trained Transformer-based models (BERT and GPT-2). We show that - at least for polarity - metrics derived from language models are more consistent with data from psycholinguistic experiments than linguistic theory predictions. Establishing this allows us to more adequately evaluate the performance of language models and also to use language models to discover new insights into natural language grammar beyond existing linguistic theories. This work contributes to establishing closer ties between psycholinguistic experiments and experiments with language models.


title: Relativistic wind from a magnetic monopole rotator

abstract: A rotating star with a monopole (or split monopole) magnetic field gives the simplest, prototype model of a rotationally driven stellar wind. Winds from compact objects, in particular neutron stars, carry strong magnetic fields with modest plasma loading, and develop ultra-relativistic speeds. We investigate the relativistic wind launched from a dense, gravitationally bound, atmosphere on the stellar surface. We first examine the problem analytically and then perform global kinetic plasma simulations. Our results show how the wind acceleration mechanism changes from centrifugal (magnetohydrodynamic) to electrostatic (charge-separated) depending on the parameters of the problem. The two regimes give winds with different angular distributions and different scalings with the magnetization parameter.


title: Stabilisation of Waves on Product Manifolds by Boundary Strips

abstract: We show that a transversely geometrically controlling boundary damping strip is sufficient but not necessary for $t^{-1/2}$-decay of waves on product manifolds. We give a general scheme to turn resolvent estimates for impedance problems on cross-sections to wave decay on product manifolds.


title: Independence inheritance and Diophantine approximation for systems of linear forms

abstract: The classical Khintchine-Groshev theorem is a generalization of Khintchine's theorem on simultaneous Diophantine approximation, from approximation of points in $\mathbb R^m$ to approximation of systems of linear forms in $\mathbb R^{nm}$. In this paper, we present an inhomogeneous version of the Khintchine-Groshev theorem which does not carry a monotonicity assumption when $nm>2$. Our results bring the inhomogeneous theory almost in line with the homogeneous theory, where it is known by a result of Beresnevich and Velani (2010) that monotonicity is not required when $nm>1$. That result resolved a conjecture of Beresnevich, Bernik, Dodson, and Velani (2009), and our work resolves almost every case of the natural inhomogeneous generalization of that conjecture. Regarding the two cases where $nm=2$, we are able to remove monotonicity by assuming extra divergence of a measure sum, akin to a linear forms version of the Duffin-Schaeffer conjecture. When $nm=1$ it is known by work of Duffin and Schaeffer (1941) that the monotonicity assumption cannot be dropped. The key new result is an independence inheritance phenomenon; the underlying idea is that the sets involved in the $((n+k)\times m)$-dimensional Khintchine-Groshev theorem ($k\geq 0$) are always $k$-levels more probabilistically independent than the sets involved the $(n\times m)$-dimensional theorem. Hence, it is shown that Khintchine's theorem itself underpins the Khintchine-Groshev theory.


title: Matrix Completion of World Trade

abstract: This work applies Matrix Completion (MC) -- a class of machine-learning methods commonly used in the context of recommendation systems -- to analyse economic complexity. MC is applied to reconstruct the Revealed Comparative Advantage (RCA) matrix, whose elements express the relative advantage of countries in given classes of products, as evidenced by yearly trade flows. A high-accuracy binary classifier is derived from the application of MC, with the aim of discriminating between elements of the RCA matrix that are, respectively, higher or lower than one. We introduce a novel Matrix cOmpletion iNdex of Economic complexitY (MONEY) based on MC, which is related to the predictability of countries' RCA (the lower the predictability, the higher the complexity). Differently from previously-developed indices of economic complexity, the MONEY index takes into account the various singular vectors of the matrix reconstructed by MC, whereas other indices are based only on one/two eigenvectors of a suitable symmetric matrix, derived from the RCA matrix. Finally, MC is compared with a state-of-the-art economic complexity index (GENEPY). We show that the false positive rate per country of a binary classifier constructed starting from the average entry-wise output of MC can be used as a proxy of GENEPY.


title: Lie derivatives and structure Jacobi operator on real hypersurfaces in complex projective spaces II

abstract: Let $M$ be a real hypersurface in complex projective space. The almost contact metric structure on $M$ allows us to consider, for any nonnull real number $k$, the corresponding $k$-th generalized Tanaka-Webster connection on $M$ and, associated to it, a differential operator of first order of Lie type. Considering such a differential operator and Lie derivative we define, from the structure Jacobi operator $R_{\xi}$ on $M$ a tensor field of type (1,2), $R_{{\xi}_T}^{(k)}$. We obtain some classifications of real hypersurfaces for which $R_{{\xi}_T}^{(k)}$ is either symmetric or skew symmetric.


title: Estimation for recurrent events through conditional estimating equations

abstract: We present new estimators for the statistical analysis of the dependence of the mean gap time length between consecutive recurrent events, on a set of explanatory random variables and in the presence of right censoring. The dependence is expressed through regression-like and overdispersion parameters, estimated via conditional estimating equations. The mean and variance of the length of each gap time, conditioned on the observed history of prior events and other covariates, are known functions of parameters and covariates. Under certain conditions on censoring, we construct normalized estimating functions that are asymptotically unbiased and contain only observed data. We discuss the existence, consistency and asymptotic normality of a sequence of estimators of the parameters, which are roots of these estimating equations. Simulations suggest that our estimators could be used successfully with a relatively small sample size in a study of short duration.


title: Effect of prestress on phononic band gaps induced by inertial amplification

abstract: We report about the effect of an applied external mechanical load on a periodic structure exhibiting band gaps induced by inertial amplification mechanism. If compared to the cases of Bragg scattering and ordinary local resonant metamaterials, we observe here a more remarkable curve shift, modulated through large but fully reversible compression(stretch) of the unit cell, eventually triggering significant (up to two times) enlargement(reduction) of the width of a specific band gap. An important up(down)-shift of some dispersion branches over specific wavenumber values is also observed, showing that this selective variation may lead to negative group velocities over larger(smaller) wavenumber ranges. The possibility for a non-monotone trend of the lower limit of the first BG under the same type of external applied prestrain is found and explained through an analytical model, which unequivocally proves that this behavior derives from the different unit cell effective mass and stiffness variations as the prestrain level increases. The effect of the prestress on the dispersion diagram is investigated through the development of a 2-step calculation method: first, an Updated Lagrangian scheme, including a static geometrically nonlinear analysis of a representative unit cell undergoing the action of an applied external load is derived, and then the Floquet-Bloch decomposition is applied to the linearized equations of the acousto-elasticity for the unit cell in the deformed configuration. The results presented herein provide insights in the behavior of band gaps induced by inertial amplification and suggest new opportunities for real-time tunable wave manipulation.


title: Resistive Neural Hardware Accelerators

abstract: Deep Neural Networks (DNNs), as a subset of Machine Learning (ML) techniques, entail that real-world data can be learned and that decisions can be made in real-time. However, their wide adoption is hindered by a number of software and hardware limitations. The existing general-purpose hardware platforms used to accelerate DNNs are facing new challenges associated with the growing amount of data and are exponentially increasing the complexity of computations. An emerging non-volatile memory (NVM) devices and processing-in-memory (PIM) paradigm is creating a new hardware architecture generation with increased computing and storage capabilities. In particular, the shift towards ReRAM-based in-memory computing has great potential in the implementation of area and power efficient inference and in training large-scale neural network architectures. These can accelerate the process of the IoT-enabled AI technologies entering our daily life. In this survey, we review the state-of-the-art ReRAM-based DNN many-core accelerators, and their superiority compared to CMOS counterparts was shown. The review covers different aspects of hardware and software realization of DNN accelerators, their present limitations, and future prospectives. In particular, comparison of the accelerators shows the need for the introduction of new performance metrics and benchmarking standards. In addition, the major concerns regarding the efficient design of accelerators include a lack of accuracy in simulation tools for software and hardware co-design.


title: Axisymmetric pulsar magnetosphere revisited

abstract: We present a global kinetic plasma simulation of an axisymmetric pulsar magnetosphere with self-consistent $e^\pm$ pair production. We use the particle-in-cell method and log-spherical coordinates with a grid size $4096\times 4096$. This allows us to achieve a high voltage induced by the pulsar rotation and investigate pair creation in a young pulsar far from the death line. We find the following. (1) The energy release and $e^\pm$ creation are strongly concentrated in the thin, Y-shaped current sheet, with a peak localized in a small volume at the Y-point. (2) The Y-point is shifted inward from the light cylinder by $\sim 15\%$, and "breathes" with a small amplitude. (3) The dense $e^\pm$ cloud at the Y-point is in ultra-relativistic rotation, which we call super-rotation, because it exceeds co-rotation with the star. The cloud receives angular momentum flowing from the star along the poloidal magnetic lines. (4) Gamma-ray emission peaks at the Y-point and is collimated in the azimuthal direction, tangent to the Y-point circle. (5) The separatrix current sheet between the closed magnetosphere and the open magnetic field lines is sustained by the electron backflow from the Y-point cloud. Its thickness is self-regulated to marginal charge starvation. (6) Only a small fraction of dissipation occurs in the separatrix inward of the Y-point. A much higher power is released in the equatorial plane, especially at the Y-point where the created dense $e^\pm$ plasma is spun up and intermittently ejected through the nozzle between the two open magnetic fluxes.


title: General Relativity's energy and positivity -- a brief history

abstract: I give a brief review of the search for a proper definition of energy in General Relativity (GR), a far from trivial quest, which was only completed after four and a half decades. The equally (or perhaps more) difficult task of establishing its positivity -- it was to take another fifteen plus years -- will then be summarized. Extension to cosmological GR is included. Mention is made of some recent offshoots.


title: Spiraling light: from donut modes to a Magnus effect analogy

abstract: The insight that optical vortex beams carry orbital angular momentum (OAM), which emerged in Leiden about 30 years ago, has since led to an ever expanding range of applications and follow-up studies. This paper starts with a short personal account of how these concepts arose. This is followed by a description of some recent ideas where the coupling of transverse orbital and spin angular momentum (SAM) in tightly focused laser beams produces interesting new effects. The deflection of a focused light beam by an atom in the focus is reminiscent of the Magnus effect known from aerodynamics. Momentum conservation dictates an accompanying light force on the atom, transverse to the optical axis. As a consequence, an atom held in an optical tweezer will be trapped at a small distance of up to $\lambda/2\pi$ away from the optical axis, which depends on the spin state of the atom and the magnetic field direction. This opens up new avenues to control the state of motion of atoms in optical tweezers as well as potential applications in quantum gates and interferometry.


title: Capacity and Stability Regions for Layered Packet Erasure Broadcast Channels with Feedback

abstract: This paper focuses on the Layered Packet Erasure Broadcast Channel (LPE-BC) with Channel Output Feedback (COF) available at the transmitter. The LPE-BC is a high-SNR approximation of the fading Gaussian BC recently proposed by Tse and Yates, who characterized the capacity region for any number of users and any number of layers when there is no COF. This paper provides a comparative overview of this channel model along the following lines: First, inner and outer bounds to the capacity region (set of achievable rates with backlogged arrivals) are presented: a) a new outer bound based on the idea of the physically degraded broadcast channel, and b) an inner bound of the LPE-BC with COF for the case of two users and any number of layers. Next, an inner bound on the stability region (set of exogenous arrival rates for which packet arrival queues are stable) for the same model is derived. The capacity region inner bound generalizes past results for the two-user erasure BC, which is a special case of the LPE-BC with COF with only one layer. The novelty lies in the use of inter-user and inter-layer network coding retransmissions (for those packets that have only been received by the unintended user), where each random linear combination may involve packets intended for any user originally sent on any of the layers. For the case of $K = 2$ users and $Q \geq 1$ layers, the inner bounds to the capacity region and the stability region coincide; both strategically employ the novel retransmission protocol. For the case of $Q = 2$ layers, sufficient conditions are derived by Fourier-Motzkin elimination for the inner bound on the stability region to coincide with the capacity outer bound, thus showing that in those cases the capacity and stability regions coincide.


title: What's Hidden in a One-layer Randomly Weighted Transformer?

abstract: We demonstrate that, hidden within one-layer randomly weighted neural networks, there exist subnetworks that can achieve impressive performance, without ever modifying the weight initializations, on machine translation tasks. To find subnetworks for one-layer randomly weighted neural networks, we apply different binary masks to the same weight matrix to generate different layers. Hidden within a one-layer randomly weighted Transformer, we find that subnetworks that can achieve 29.45/17.29 BLEU on IWSLT14/WMT14. Using a fixed pre-trained embedding layer, the previously found subnetworks are smaller than, but can match 98%/92% (34.14/25.24 BLEU) of the performance of, a trained Transformer small/base on IWSLT14/WMT14. Furthermore, we demonstrate the effectiveness of larger and deeper transformers in this setting, as well as the impact of different initialization methods. We released the source code at https://github.com/sIncerass/one_layer_lottery_ticket.


title: Optimizing timetable and network reopen plans for public transportation networks during a COVID19-like pandemic

abstract: The recovery of the public transportation system is critical for both social re-engagement and economic rebooting after the shutdown during pandemic like COVID-19. In this study, we focus on the integrated optimization of service line reopening plan and timetable design. We model the transit system as a space-time network. In this network, the number of passengers on each vehicle at the same time can be represented by arc flow. We then apply a simplified spatial compartmental model of epidemic (SCME) to each vehicle and platform to model the spread of pandemic in the system as our objective, and calculate the optimal open plan and timetable. We demonstrate that this optimization problem can be decomposed into a simple integer programming and a linear multi-commodity network flow problem using Lagrangian relaxation techniques. Finally, we test the proposed model using real-world data from the Bay Area Rapid Transit (BART) and give some useful suggestions to system managers.


title: Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference

abstract: While recent research on natural language inference has considerably benefited from large annotated datasets, the amount of inference-related knowledge (including commonsense) provided in the annotated data is still rather limited. There have been two lines of approaches that can be used to further address the limitation: (1) unsupervised pretraining can leverage knowledge in much larger unstructured text data; (2) structured (often human-curated) knowledge has started to be considered in neural-network-based models for NLI. An immediate question is whether these two approaches complement each other, or how to develop models that can bring together their advantages. In this paper, we propose models that leverage structured knowledge in different components of pre-trained models. Our results show that the proposed models perform better than previous BERT-based state-of-the-art models. Although our models are proposed for NLI, they can be easily extended to other sentence or sentence-pair classification problems.


title: A Formal Description of Sorani Kurdish Morphology

abstract: Sorani Kurdish, also known as Central Kurdish, has a complex morphology, particularly due to the patterns in which morphemes appear. Although several aspects of Kurdish morphology have been studied, such as pronominal endoclitics and Izafa constructions, Sorani Kurdish morphology has received trivial attention in computational linguistics. Moreover, some morphemes, such as the emphasis endoclitic =\^i\c{s}, and derivational morphemes have not been previously studied. To tackle the complex morphology of Sorani, we provide a thorough description of Sorani Kurdish morphological and morphophonological constructions in a formal way such that they can be used as finite-state transducers for morphological analysis and synthesis.


title: Sharp regret bounds for empirical Bayes and compound decision problems

abstract: We consider the classical problems of estimating the mean of an $n$-dimensional normally (with identity covariance matrix) or Poisson distributed vector under the squared loss. In a Bayesian setting the optimal estimator is given by the prior-dependent conditional mean. In a frequentist setting various shrinkage methods were developed over the last century. The framework of empirical Bayes, put forth by Robbins (1956), combines Bayesian and frequentist mindsets by postulating that the parameters are independent but with an unknown prior and aims to use a fully data-driven estimator to compete with the Bayesian oracle that knows the true prior. The central figure of merit is the regret, namely, the total excess risk over the Bayes risk in the worst case (over the priors). Although this paradigm was introduced more than 60 years ago, little is known about the asymptotic scaling of the optimal regret in the nonparametric setting. We show that for the Poisson model with compactly supported and subexponential priors, the optimal regret scales as $\Theta((\frac{\log n}{\log\log n})^2)$ and $\Theta(\log^3 n)$, respectively, both attained by the original estimator of Robbins. For the normal mean model, the regret is shown to be at least $\Omega((\frac{\log n}{\log\log n})^2)$ and $\Omega(\log^2 n)$ for compactly supported and subgaussian priors, respectively, the former of which resolves the conjecture of Singh (1979) on the impossibility of achieving bounded regret; before this work, the best regret lower bound was $\Omega(1)$. In addition to the empirical Bayes setting, these results are shown to hold in the compound setting where the parameters are deterministic. As a side application, the construction in this paper also leads to improved or new lower bounds for density estimation of Gaussian and Poisson mixtures.


title: Control of reactive collisions by quantum interference

abstract: In this study, we achieved magnetic control of reactive scattering in an ultracold mixture of $^{23}$Na atoms and $^{23}$Na$^{6}$Li molecules. In most molecular collisions, particles react or are lost near short range with unity probability, leading to the so-called universal rate. By contrast, the Na{+}NaLi system was shown to have only $\sim4\%$ loss probability in a fully spin-polarized state. By controlling the phase of the scattering wave function via a Feshbach resonance, we modified the loss rate by more than a factor of $100$, from far below to far above the universal limit. The results are explained in analogy with an optical Fabry-Perot resonator by interference of reflections at short and long range. Our work demonstrates quantum control of chemistry by magnetic fields with the full dynamic range predicted by our models.


title: Vulnerabilities and Attacks Against Industrial Control Systems and Critical Infrastructures

abstract: Critical infrastructures (CI) and industrial organizations aggressively move towards integrating elements of modern Information Technology (IT) into their monolithic Operational Technology (OT) architectures. Yet, as OT systems progressively become more and more interconnected, they silently have turned into alluring targets for diverse groups of adversaries. Meanwhile, the inherent complexity of these systems, along with their advanced-in-age nature, prevents defenders from fully applying contemporary security controls in a timely manner. Forsooth, the combination of these hindering factors has led to some of the most severe cybersecurity incidents of the past years. This work contributes a full-fledged and up-to-date survey of the most prominent threats against Industrial Control Systems (ICS) along with the communication protocols and devices adopted in these environments. Our study highlights that threats against CI follow an upward spiral due to the mushrooming of commodity tools and techniques that can facilitate either the early or late stages of attacks. Furthermore, our survey exposes that existing vulnerabilities in the design and implementation of several of the OT-specific network protocols may easily grant adversaries the ability to decisively impact physical processes. We provide a categorization of such threats and the corresponding vulnerabilities based on various criteria. As far as we are aware, this is the first time an exhaustive and detailed survey of this kind is attempted.


title: Quantitative form of Ball's Cube slicing in $\mathbb{R}^n$ and equality cases in the min-entropy power inequality

abstract: We prove a quantitative form of the celebrated Ball's theorem on cube slicing in $\mathbb{R}^n$ and obtain, as a consequence, equality cases in the min-entropy power inequality. Independently, we also give a quantitative form of Khintchine's inequality in the special case $p=1$.


title: SensiX++: Bringing MLOPs and Multi-tenant Model Serving to Sensory Edge Devices

abstract: We present SensiX++ - a multi-tenant runtime for adaptive model execution with integrated MLOps on edge devices, e.g., a camera, a microphone, or IoT sensors. SensiX++ operates on two fundamental principles - highly modular componentisation to externalise data operations with clear abstractions and document-centric manifestation for system-wide orchestration. First, a data coordinator manages the lifecycle of sensors and serves models with correct data through automated transformations. Next, a resource-aware model server executes multiple models in isolation through model abstraction, pipeline automation and feature sharing. An adaptive scheduler then orchestrates the best-effort executions of multiple models across heterogeneous accelerators, balancing latency and throughput. Finally, microservices with REST APIs serve synthesised model predictions, system statistics, and continuous deployment. Collectively, these components enable SensiX++ to serve multiple models efficiently with fine-grained control on edge devices while minimising data operation redundancy, managing data and device heterogeneity, reducing resource contention and removing manual MLOps. We benchmark SensiX++ with ten different vision and acoustics models across various multi-tenant configurations on different edge accelerators (Jetson AGX and Coral TPU) designed for sensory devices. We report on the overall throughput and quantified benefits of various automation components of SensiX++ and demonstrate its efficacy to significantly reduce operational complexity and lower the effort to deploy, upgrade, reconfigure and serve embedded models on edge devices.


title: Signature of a massive rotating metal-poor star imprinted in the Phoenix stellar stream

abstract: The Phoenix stellar stream has a low intrinsic dispersion in velocity and metallicity that implies the progenitor was probably a low mass globular cluster. In this work we use Magellan/MIKE high-dispersion spectroscopy of eight Phoenix stream red giants to confirm this scenario. In particular, we find negligible intrinsic scatter in metallicity ($\sigma(\mathrm{[Fe~II/H]}) = 0.04^{+0.11}_{-0.03}$) and a large peak-to-peak range in [Na/Fe] and [Al/Fe] abundance ratios, consistent with the light element abundance patterns seen in the most metal-poor globular clusters. However, unlike any other globular cluster, we also find an intrinsic spread in [Sr II/Fe] spanning $\sim$1 dex, while [Ba II/Fe] shows nearly no intrinsic spread ($\sigma(\mathrm{[Ba~II/H]}) = {0.03}^{+0.10}_{-0.02}$). This abundance signature is best interpreted as slow neutron capture element production from a massive fast-rotating metal-poor star ($15-20 \mathrm{M}_\odot$, $v_\mathrm{ini}/v_\mathrm{crit} = 0.4$, $[\mathrm{Fe/H}] = -3.8$). The low inferred cluster mass suggests the system would have been unable to retain supernovae ejecta, implying that any massive fast-rotating metal-poor star that enriched the interstellar medium must have formed and evolved before the globular cluster formed. Neutron capture element production from asymptotic giant branch stars or magneto-rotational instabilities in core-collapse supernovae provide poor fits to the observations. We also report one Phoenix stream star to be a lithium-rich giant ($A(\mathrm{Li}) = 3.1 \pm 0.1$). At $[\mathrm{Fe/H}] = -2.93$ it is among the most metal-poor lithium-rich giants known.


title: Differentially private methods for managing model uncertainty in linear regression models

abstract: In this work, we propose differentially private methods for hypothesis testing, model averaging, and model selection for normal linear models. We consider Bayesian methods based on mixtures of $g$-priors and non-Bayesian methods based on likelihood-ratio statistics and information criteria. The procedures are asymptotically consistent and straightforward to implement with existing software. We focus on practical issues such as adjusting critical values so that hypothesis tests have adequate type I error rates and quantifying the uncertainty introduced by the privacy-ensuring mechanisms.


title: Study of the Subtyping Machine of Nominal Subtyping with Variance (full version)

abstract: This is a study of the computing power of the subtyping machine behind Kennedy and Pierce's nominal subtyping with variance. We depict the lattice of fragments of Kennedy and Pierce's type system and characterize their computing power in terms of regular, context-free, deterministic, and non-deterministic tree languages. Based on the theory, we present Treetop -- a generator of C# implementations of subtyping machines. The software artifact constitutes the first feasible (yet POC) fluent API generator to support context-free API protocols in a decidable type system fragment.


title: Learning the Physics of Particle Transport via Transformers

abstract: Particle physics simulations are the cornerstone of nuclear engineering applications. Among them radiotherapy (RT) is crucial for society, with 50% of cancer patients receiving radiation treatments. For the most precise targeting of tumors, next generation RT treatments aim for real-time correction during radiation delivery, necessitating particle transport algorithms that yield precise dose distributions in sub-second times even in highly heterogeneous patient geometries. This is infeasible with currently available, purely physics based simulations. In this study, we present a data-driven dose calculation algorithm predicting the dose deposited by mono-energetic proton beams for arbitrary energies and patient geometries. Our approach frames particle transport as sequence modeling, where convolutional layers extract important spatial features into tokens and the transformer self-attention mechanism routes information between such tokens in the sequence and a beam energy token. We train our network and evaluate prediction accuracy using computationally expensive but accurate Monte Carlo (MC) simulations, considered the gold standard in particle physics. Our proposed model is 33 times faster than current clinical analytic pencil beam algorithms, improving upon their accuracy in the most heterogeneous and challenging geometries. With a relative error of 0.34% and very high gamma pass rate of 99.59% (1%, 3 mm), it also greatly outperforms the only published similar data-driven proton dose algorithm, even at a finer grid resolution. Offering MC precision 400 times faster, our model could overcome a major obstacle that has so far prohibited real-time adaptive proton treatments and significantly increase cancer treatment efficacy. Its potential to model physics interactions of other particles could also boost heavy ion treatment planning procedures limited by the speed of traditional methods.


title: Attributing Fair Decisions with Attention Interventions

abstract: The widespread use of Artificial Intelligence (AI) in consequential domains, such as healthcare and parole decision-making systems, has drawn intense scrutiny on the fairness of these methods. However, ensuring fairness is often insufficient as the rationale for a contentious decision needs to be audited, understood, and defended. We propose that the attention mechanism can be used to ensure fair outcomes while simultaneously providing feature attributions to account for how a decision was made. Toward this goal, we design an attention-based model that can be leveraged as an attribution framework. It can identify features responsible for both performance and fairness of the model through attention interventions and attention weight manipulation. Using this attribution framework, we then design a post-processing bias mitigation strategy and compare it with a suite of baselines. We demonstrate the versatility of our approach by conducting experiments on two distinct data types, tabular and textual.


title: Cold CH radicals for laser cooling and trapping

abstract: Ultracold CH radicals promise a fruitful testbed for probing quantum-state controllable organic chemistry. In this work, we calculate CH vibrational branching ratios (VBRs) and rotational branching ratios (RBRs) with ground state mixing. We subsequently use these values to inform optical cycling proposals and consider two possible radiative cooling schemes using the $X^{2}\Pi \leftarrow A^{2}\Delta$ and $X^{2}\Pi \leftarrow B^{2}\Sigma^{-}$ transitions. As a first step towards laser cooled CH, we characterize the effective buffer gas cooling of this species and produce $\sim5\times10^{10}$ CH molecules per pulse with a rotational temperature of 2(1) K and a translational temperature of 7(2) K. We also determine the CH-helium collisional cross section to be $2.4(8)\times10^{-14}$ cm$^{2}$. This value is crucial to correctly account for collisional broadening and accurately extract the in-cell CH density. These cold CH molecules mark an ideal starting point for future laser cooling and trapping experiments and tests of cold organic chemistry.


title: A hard open X-band RF accelerating structure made by two halves

abstract: High-gradient linacs of next generation require novel accelerating structures which are compact, robust and cost-effective. Dedicated research and development have been launched in the linear-collider community. This paper focuses on the technological developments directed to show the viability of novel welding techniques and related applications, in order to benefit from the superior high-gradient performance of accelerating structures made of hard-copper alloys. The structure geometry that we propose allows getting a high longitudinal shunt impedance of the accelerating mode and increasing the mode separation frequencies.


title: NU:BRIEF -- A Privacy-aware Newsletter Personalization Engine for Publishers

abstract: Newsletters have (re-) emerged as a powerful tool for publishers to engage with their readers directly and more effectively. Despite the diversity in their audiences, publishers' newsletters remain largely a one-size-fits-all offering, which is suboptimal. In this paper, we present NU:BRIEF, a web application for publishers that enables them to personalize their newsletters without harvesting personal data. Personalized newsletters build a habit and become a great conversion tool for publishers, providing an alternative readers-generated revenue model to a declining ad/clickbait-centered business model.


title: AdjointNet: Constraining machine learning models with physics-based codes

abstract: Physics-informed Machine Learning has recently become attractive for learning physical parameters and features from simulation and observation data. However, most existing methods do not ensure that the physics, such as balance laws (e.g., mass, momentum, energy conservation), are constrained. Some recent works (e.g., physics-informed neural networks) softly enforce physics constraints by including partial differential equation (PDE)-based loss functions but need re-discretization of the PDEs using auto-differentiation. Training these neural nets on observational data showed that one could solve forward and inverse problems in one shot. They evaluate the state variables and the parameters in a PDE. This re-discretization of PDEs is not necessarily an attractive option for domain scientists that work with physics-based codes that have been developed for decades with sophisticated discretization techniques to solve complex process models and advanced equations of state. This paper proposes a physics constrained machine learning framework, AdjointNet, allowing domain scientists to embed their physics code in neural network training workflows. This embedding ensures that physics is constrained everywhere in the domain. Additionally, the mathematical properties such as consistency, stability, and convergence vital to the numerical solution of a PDE are still satisfied. We show that the proposed AdjointNet framework can be used for parameter estimation (and uncertainty quantification by extension) and experimental design using active learning. The applicability of our framework is demonstrated for four flow cases. Results show that AdjointNet-based inversion can estimate process model parameters with reasonable accuracy. These examples demonstrate the applicability of using existing software with no changes in source code to perform accurate and reliable inversion of model parameters.

categories: math.NA cs.LG cs.NA physics.comp-ph physics.flu-dyn


title: Hunting $\varepsilon$: The origin and validity of quasi-steady-state reductions in enzyme kinetics

abstract: The estimation of the kinetic parameters requires the careful design of experiments under a constrained set of conditions. Many estimates reported in the literature incorporate protocols that leverage simplified mathematical models known as quasi-steady-state reductions. Such reductions often - but not always - emerge as the result of a singular perturbation scenario. However, the utilization of the singular perturbation reduction method requires knowledge of a dimensionless parameter, $\varepsilon$, that is proportional to the ratio of the reaction's fast and slow timescales. Using techniques from differential equations, Fenichel theory, and center manifold theory, we derive the appropriate $\varepsilon$ whose magnitude regulates the validity of the quasi-steady-state reduction employed in the reported experimental procedures for intermolecular autocatalytic zymogen activation reaction. Although the model equations are two-dimensional, the fast/slow dynamics are rich. The phase plane exhibits a dynamic transcritical bifurcation point in a particular singular limit. The existence of such a bifurcation is relevant, because the critical manifold losses normal hyperbolicity and classical Fenichel theory is inapplicable. Furthermore, we show that in some cases chemical reversibility can be interpreted dynamically as an imperfection, since the presence of reversibility can destroy the bifurcation structure present in the singular limit. We show that the reduction method by which QSS reductions are justified can depend on the path taken in parameter space. Specifically, we show that the standard quasi-steady-state reduction for this reaction is justifiable by center manifold theory in one limit, and via Fenichel theory in a different limit.


title: TrAISformer -- A Transformer Network with Sparse Augmented Data Representation and Cross Entropy Loss for AIS-based Vessel Trajectory Prediction

abstract: Vessel trajectory prediction plays a pivotal role in numerous maritime applications and services. While the Automatic Identification System (AIS) offers a rich source of information to address this task, forecasting vessel trajectory using AIS data remains challenging, even for modern machine learning techniques, because of the inherent heterogeneous and multimodal nature of motion data. In this paper, we propose a novel approach to tackle these challenges. We introduce a discrete, high-dimensional representation of AIS data and a new loss function designed to explicitly address heterogeneity and multimodality. The proposed model-referred to as TrAISformer-is a modified transformer network that extracts long-term temporal patterns in AIS vessel trajectories in the proposed enriched space to forecast the positions of vessels several hours ahead. We report experimental results on real, publicly available AIS data. TrAISformer significantly outperforms state-of-the-art methods, with an average prediction performance below 10 nautical miles up to ~10 hours.


title: Well-posedness of an interaction model on Riemannian manifolds

abstract: We investigate a model for collective behaviour with intrinsic interactions on smooth Riemannian manifolds. For regular interaction potentials, we establish the local well-posedness of measure-valued solutions defined via optimal mass transport. We also extend our result to the global well-posedness of solutions for manifolds with nonpositive bounded sectional curvature. The core concept underlying the proofs is that of Lipschitz continuous vector fields in the sense of parallel transport.


title: Rates of convergence to non-degenerate asymptotic profiles for fast diffusion via energy methods

abstract: This paper is concerned with a quantitative analysis of asymptotic behaviors of (possibly sign-changing) solutions to the Cauchy-Dirichlet problem for the fast diffusion equation posed on bounded domains with Sobolev subcritical exponents. More precisely, rates of convergence to non-degenerate asymptotic profiles will be revealed via an energy method. The sharp rate of convergence to \emph{positive} ones was recently discussed by Bonforte and Figalli (2021, CPAM) based on an entropy method. An alternative proof for their result will also be provided. Furthermore, dynamics of fast diffusion flows with changing signs will be discussed more specifically under concrete settings; in particular, exponential stability of some sign-changing asymptotic profiles will be proved in dumbbell domains for initial data with certain symmetry.


title: Improving Building Segmentation for Off-Nadir Satellite Imagery

abstract: Automatic building segmentation is an important task for satellite imagery analysis and scene understanding. Most existing segmentation methods focus on the case where the images are taken from directly overhead (i.e., low off-nadir/viewing angle). These methods often fail to provide accurate results on satellite images with larger off-nadir angles due to the higher noise level and lower spatial resolution. In this paper, we propose a method that is able to provide accurate building segmentation for satellite imagery captured from a large range of off-nadir angles. Based on Bayesian deep learning, we explicitly design our method to learn the data noise via aleatoric and epistemic uncertainty modeling. Satellite image metadata (e.g., off-nadir angle and ground sample distance) is also used in our model to further improve the result. We show that with uncertainty modeling and metadata injection, our method achieves better performance than the baseline method, especially for noisy images taken from large off-nadir angles.


title: Learning-based Moving Horizon Estimation through Differentiable Convex Optimization Layers

abstract: To control a dynamical system it is essential to obtain an accurate estimate of the current system state based on uncertain sensor measurements and existing system knowledge. An optimization-based moving horizon estimation (MHE) approach uses a dynamical model of the system, and further allows for integration of physical constraints on system states and uncertainties, to obtain a trajectory of state estimates. In this work, we address the problem of state estimation in the case of constrained linear systems with parametric uncertainty. The proposed approach makes use of differentiable convex optimization layers to formulate an MHE state estimator for systems with uncertain parameters. This formulation allows us to obtain the gradient of a squared and regularized output error, based on sensor measurements and state estimates, with respect to the current belief of the unknown system parameters. The parameters within the MHE problem can then be updated online using stochastic gradient descent (SGD) to improve the performance of the MHE. In a numerical example of estimating temperatures of a group of manufacturing machines, we show the performance of tuning the unknown system parameters and the benefits of integrating physical state constraints in the MHE formulation.