title: Impact of freeze-in on dark matter isocurvature

abstract: Dark matter freeze-in is a compelling cosmological production mechanism in which all or some of the observed abundance of dark matter is generated through feeble interactions it has with the Standard Model. In this work we present the first analysis of freeze-in dark matter fluctuations and consider two benchmark models: freeze-in through the direct decay of a heavy vector boson and freeze-in through pair annihilation of Standard Model particles in the thermal bath. We provide a theoretical framework for determining the impact of freeze-in on curvature and dark matter isocurvature perturbations. We determine freeze-in dark matter fluid properties from first principles, tracking its evolution from its relativistic production to its final cold state, and calculate the evolution of the dark matter isocurvature perturbation. We find that in the absence of initial isocurvature, the freeze-in production of dark matter does not source isocurvature. However, for an initial isocurvature perturbation seeded by inflation, the nonthermal freeze-in process may allow for a fraction of the isocurvature to persist, in contrast to the exponential suppression it receives in the case of thermal dark matter. In either case, the evolution of the curvature mode is unaffected by the freeze-in process. We show sensitivity projections of future cosmic microwave background experiments to the amplitude of uncorrelated, totally anticorrelated, and totally correlated dark matter isocurvature perturbations. From these projections, we infer the sensitivity to the abundance of freeze-in dark matter that sustains some fraction of the primordial isocurvature.


title: Characterisation of the NUV and Optical Emission and Temperature of Flares from Ross 733 with Swift and TESS

abstract: We present the results of a coordinated campaign to simultaneously observe the M star binary Ross 733 simultaneously in the optical and near-ultraviolet (NUV) with TESS and Swift respectively. We observed two flares in the Swift NUV light curve. One of these was decay phase of a flare that was also detected with TESS and the other was only detected in the NUV. We used the TESS light curve to measure the white-light flare rate of Ross 733, and calculate that the system flares with an energy of $10^{33}$ erg once every 1.5 days. We used our simultaneous observations to measure a pseudo-continuum temperature of $7340^{+810}_{-900}$K during the flare decay. We also used our observations to test the NUV predictions of the 9000 K blackbody flare model, and find that it underestimates number of flares we detect in our Swift NUV light curve. We discuss the reasons for this and attribute it to the unaccounted contributions from emission lines and continuum temperatures above 9000 K. We discuss how additional observations are required to break the degeneracy between the two in future multi-wavelength flare campaigns.


title: Dynamical phases transitions in periodically driven Bardeen-Cooper-Schrieffer systems

abstract: We present a systematic study of the dynamical phase diagram of a periodically driven BCS system as a function of drive strength and frequency. Three different driving mechanism are considered and compared: oscillating density of states, oscillating pairing interaction and oscillating external paring field. We identify the locus in parameter space of parametric resonances and four dynamical phases: Rabi-Higgs, gapless, synchronized Higgs and time-crystal. We demonstrate that the main features of the phase diagram are quite robust to different driving protocols and discuss the order of the transitions. By mapping the BCS problem to a collection of nonlinear and interacting classical oscillators, we shed light on the origin of time-crsytalline phases and parametric resonances appearing for subgap excitations.


title: Giant Vortices and the Regge Limit

abstract: In recent years it has been shown that strongly coupled systems become analytically tractable in the regime of large quantum numbers, such as large spin or large charge. The effective theories that emerge in these two limits are Regge theory and superfluid theory, respectively. Here we make a proposal for a new phase, the ``giant vortex,'' describing an intermediate regime with large spin and charge. The new phase connects superfluid theory with the large-spin expansion. The giant vortex admits a semi-classical effective theory description with peculiar chiral excitations (moving at the speed of light) and a Fock space of states that is reminiscent of the multi-twist operators in Regge theory, including the leading and daughter Regge trajectories. A similar giant vortex phase appears for Bose-Einstein condensates in a rotating trap, and our results should be applicable in that context as well. We show that the transition from the giant vortex to the Regge regime is accompanied by the scaling dimension turning from being larger than to being smaller than the mean field theory value, i.e. gravity switches from being the weakest force at small AdS distance to being the strongest force at large AdS distance.


title: D4-branes wrapped on four-dimensional orbifolds through consistent truncation

abstract: We construct a consistent truncation of six-dimensional matter coupled $F(4)$ gauged supergravity on a cornucopia of two-dimensional surfaces including a spindle, disc, domain wall and other novel backgrounds to four-dimensional minimal gauged supergravity. Using our consistent truncation we uplift known AdS$_2\times {\Sigma}_1$ solutions giving rise to four-dimensional orbifold solutions, AdS$_2\times{\Sigma}_1\ltimes{\Sigma}_2$. We further uplift our solutions to massive type IIA supergravity by constructing the full uplift formulae for six-dimensional U$(1)^2$-gauged supergravity including all fields and arbitrary Romans mass and gauge coupling. The solutions we construct are naturally interpreted as the near-horizon geometries of asymptotically AdS$_6$ black holes with a four-dimensional orbifold horizon. Alternatively, one may view them as the holographic duals of superconformal quantum mechanical theories constructed by compactifying five-dimensional USp$(2N)$ theory living on a stack of D4-D8 branes on the four-dimensional orbifolds. As a first step to identifying these quantum mechanical theories we compute the Bekenstein--Hawking entropy holographically.


title: COMET-QE and Active Learning for Low-Resource Machine Translation

abstract: Active learning aims to deliver maximum benefit when resources are scarce. We use COMET-QE, a reference-free evaluation metric, to select sentences for low-resource neural machine translation. Using Swahili, Kinyarwanda and Spanish for our experiments, we show that COMET-QE significantly outperforms two variants of Round Trip Translation Likelihood (RTTL) and random sentence selection by up to 5 BLEU points for 20k sentences selected by Active Learning on a 30k baseline. This suggests that COMET-QE is a powerful tool for sentence selection in the very low-resource limit.


title: Sharp polynomial decay for polynomially singular damping on the torus

abstract: We study energy decay rates for the damped wave equation with unbounded damping, without the geometric control condition. Our main decay result is sharp polynomial energy decay for polynomially controlled singular damping on the torus. We also prove that for normally $L^p$-damping on compact manifolds, the Schr\"odinger observability gives $p$-dependent polynomial decay, and finite time extinction cannot occur. We show that polynomially controlled singular damping on the circle gives exponential decay.


title: Dynamics of a relativistic jet through magnetized media

abstract: The merger of two neutron stars (NSs) produces the emission of gravitational waves, the formation of a compact object surrounded by a dense and magnetized environment, and the launching of a collimated and relativistic jet, which will eventually produce a short gamma-ray burst (SGRB). The interaction of the jet with the environment has been shown to play a major role in shaping the structure of the outflow that eventually powers the gamma-ray emission. In this paper, we present a set of 2.5 dimensional RMHD simulations that follow the evolution of a relativistic non-magnetized jet through a medium with different magnetization levels, as produced after the merger of two NSs. We find that the predominant consequence of a magnetized ambient medium is that of suppressing instabilities within the jet, and preventing the formation of a series of collimation shocks. One implication of this is that internal shocks lose efficiency, causing bursts with low-luminosity prompt emission. On the other hand, the jet-head velocity and the induced magnetization within the jet are fairly independent from the magnetization of the ambient medium. Future numerical studies with a larger domain are necessary to obtain light curves and spectra in order to better understand the role of magnetized media.


title: A Magnified Compact Galaxy at Redshift 9.51 with Strong Nebular Emission Lines

abstract: Ultraviolet light from early galaxies is thought to have ionized gas in the intergalactic medium. However, there are few observational constraints on this epoch because of the faintness of those galaxies and the redshift of their optical light into the infrared. We report the observation, in JWST imaging, of a distant galaxy that is magnified by gravitational lensing. JWST spectroscopy of the galaxy, at rest-frame optical wavelengths, detects strong nebular emission lines that are attributable to oxygen and hydrogen. The measured redshift is z = 9.51 +- 0.01, corresponding to 510 million years after the Big Bang. The galaxy has a radius of 16.2+4.6-7.2 parsecs, which is substantially more compact than galaxies with equivalent luminosity at z = 6 to 8, leading to a high star formation rate surface density.


title: TAD: Transfer Learning-based Multi-Adversarial Detection of Evasion Attacks against Network Intrusion Detection Systems

abstract: Nowadays, intrusion detection systems based on deep learning deliver state-of-the-art performance. However, recent research has shown that specially crafted perturbations, called adversarial examples, are capable of significantly reducing the performance of these intrusion detection systems. The objective of this paper is to design an efficient transfer learning-based adversarial detector and then to assess the effectiveness of using multiple strategically placed adversarial detectors compared to a single adversarial detector for intrusion detection systems. In our experiments, we implement existing state-of-the-art models for intrusion detection. We then attack those models with a set of chosen evasion attacks. In an attempt to detect those adversarial attacks, we design and implement multiple transfer learning-based adversarial detectors, each receiving a subset of the information passed through the IDS. By combining their respective decisions, we illustrate that combining multiple detectors can further improve the detectability of adversarial traffic compared to a single detector in the case of a parallel IDS design.


title: Do Pre-trained Models Benefit Equally in Continual Learning?

abstract: Existing work on continual learning (CL) is primarily devoted to developing algorithms for models trained from scratch. Despite their encouraging performance on contrived benchmarks, these algorithms show dramatic performance drops in real-world scenarios. Therefore, this paper advocates the systematic introduction of pre-training to CL, which is a general recipe for transferring knowledge to downstream tasks but is substantially missing in the CL community. Our investigation reveals the multifaceted complexity of exploiting pre-trained models for CL, along three different axes, pre-trained models, CL algorithms, and CL scenarios. Perhaps most intriguingly, improvements in CL algorithms from pre-training are very inconsistent an underperforming algorithm could become competitive and even state-of-the-art when all algorithms start from a pre-trained model. This indicates that the current paradigm, where all CL methods are compared in from-scratch training, is not well reflective of the true CL objective and desired progress. In addition, we make several other important observations, including that CL algorithms that exert less regularization benefit more from a pre-trained model; and that a stronger pre-trained model such as CLIP does not guarantee a better improvement. Based on these findings, we introduce a simple yet effective baseline that employs minimum regularization and leverages the more beneficial pre-trained model, coupled with a two-stage training pipeline. We recommend including this strong baseline in the future development of CL algorithms, due to its demonstrated state-of-the-art performance.


title: An integrated microwave-to-optics interface for scalable quantum computing

abstract: Microwave-to-optics transduction is emerging as a vital technology for scaling quantum computers and quantum networks. To establish useful entanglement links between qubit processing units, several key conditions have to be simultaneously met: the transducer must add less than a single quantum of input referred noise and operate with high-efficiency, as well as large bandwidth and high repetition rate. Here we present a new design for an integrated transducer based on a planar superconducting resonator coupled to a silicon photonic cavity through a mechanical oscillator made of lithium niobate on silicon. We experimentally demonstrate its unique performance and potential for simultaneously realizing all of the above conditions, measuring added noise that is limited to a few photons, transduction efficiencies as high as 0.9%, with a bandwidth of 14.8 MHz and a repetition rate of up to 100 kHz. Our device couples directly to a 50-Ohm transmission line and can easily be scaled to a large number of transducers on a single chip, paving the way for distributed quantum computing.


title: Palindromic Polynomials over Finite Fields

abstract: For any finite field $\mathbb{F}$ and any positive integer $n$ we count the number of monic polynomials of degree $n$ over $\mathbb{F}$ with nonzero constant coefficient and a self-reciprocal factor of any specified degree. An application is given for systems of linear equations over $\mathbb{F}$ of index $2$.


title: Rotating $(2+1)$-dimensional Black Holes in Einstein-Maxwell-Dilaton Theory

abstract: We consider Einstein-Maxwell-Dilaton theory in $(2+1)$-dimensions where the coupling between the scalar field and the Maxwell invariant is the dilatonic coupling $f(\phi) = \exp (-2\alpha \phi)$ and obtain novel exact rotating black hole solutions. The dilatonic parameter $\alpha$ impacts the metric function, affecting the rotating properties of the black hole, its mass and also its thermodynamics. Calculating the entropy we find that it is always positive and the dilatonic black holes may have higher entropy than the BTZ black hole. Depending on the parameters, the dilatonic BTZ-like black hole may be thermodynamically preferred than the BTZ black hole which is recovered when $\alpha=0$.


title: Distorted-Toroidal Flux Rope model for Heliospheric Flux Ropes

abstract: The three-dimensional characterization of magnetic flux-ropes observed in the heliosphere has been a challenging task for decades. This is mainly due to the limitation to infer the 3D global topology and the physical properties from the 1D time series from any spacecraft. To advance our understanding of magnetic flux-ropes whose configuration departs from the typical stiff geometries, here we present the analytical solution for a 3D flux-rope model with an arbitrary cross-section and a toroidal global shape. This constitutes the next level of complexity following the elliptic-cylindrical (EC) geometry. The mathematical framework was established by Nieves-Chinchilla et al. (2018) ApJ, with the EC flux-rope model that describes the magnetic topology with elliptical cross-section as a first approach to changes in the cross-section. In the distorted-toroidal flux rope model, the cross-section is described by a general function. The model is completely described by a non-orthogonal geometry and the Maxwell equations can be consistently solved to obtain the magnetic field and relevant physical quantities. As a proof of concept, this model is generalized in terms of the radial dependence of current density components. The last part of this paper is dedicated to a specific function, $F(\varphi)=\delta(1-\lambda\cos\varphi)$, to illustrate possibilities of the model. This model paves the way to investigate complex distortions of the magnetic structures in the solar wind. Future investigations will in-depth explore these distortions by analyzing specific events, the implications in the physical quantities, such as magnetic fluxes, heliciy or energy, and evaluating the force balance with the ambient solar wind that allows such distortions.


title: Fast broadband cluster spin-glass dynamics in PbFe$_{1/2}$Nb$_{1/2}$O$_{3}$

abstract: PbFe$_{1/2}$Nb$_{1/2}$O$_{3}$ (PFN) is a relaxor ferroelectric (T$_{c}$ $\sim$ 400 K) consisting of disordered magnetic Fe$^{3+}$ (S=${5\over2}$, L$\approx$0) ions resulting in a low temperature ``cluster glass" phase (W. Kleemann $\textit{et al.}$ Phys. Rev. Lett. ${\bf{105}}$, 257202 (2010)). We apply neutron scattering to investigate the dynamic magnetism of this phase in a large single crystal which displays a low temperature spin glass transition (T$_{g} \sim$ 15 K), but no observable spatially long-range antiferromagnetic order. The static response in the cluster glass phase (sampled on the timescale set by our resolution) is found to be characterized by an average magnetic spin direction that lacks any preferred direction. The dynamics that drive this phase are defined by a magnetic correlation length that gradually increases with decreasing temperature. However, below $\sim$ 50 K the spatial correlations gradually becoming more short range indicative of increasing disorder on cooling, thereby unravelling magnetism, until the low temperature glass phase sets in at T$_{g}$ $\sim$ 15 K. Neutron spectroscopy is used to characterize the spin fluctuations in the cluster glass phase and are found to be defined by a broadband of frequencies on the scale of $\sim$ THz, termed here ``fast" fluctuations. The frequency bandwidth driving the magnetic fluctuations mimics the correlation length and decreases until $\sim$ 50 K, and then increases again until the glass transition. Through investigating the low-energy acoustic phonons we find evidence of multiple distinct structural regions which form the basis of the clusters, generating a significant amount of local disorder. We suggest that random molecular fields originating from conflicting interactions between clusters is important for the destruction of magnetic order and the eventual formation of the cluster glass in PFN.


title: FedAudio: A Federated Learning Benchmark for Audio Tasks

abstract: Federated learning (FL) has gained substantial attention in recent years due to the data privacy concerns related to the pervasiveness of consumer devices that continuously collect data from users. While a number of FL benchmarks have been developed to facilitate FL research, none of them include audio data and audio-related tasks. In this paper, we fill this critical gap by introducing a new FL benchmark for audio tasks which we refer to as FedAudio. FedAudio includes four representative and commonly used audio datasets from three important audio tasks that are well aligned with FL use cases. In particular, a unique contribution of FedAudio is the introduction of data noises and label errors to the datasets to emulate challenges when deploying FL systems in real-world settings. FedAudio also includes the benchmark results of the datasets and a PyTorch library with the objective of facilitating researchers to fairly compare their algorithms. We hope FedAudio could act as a catalyst to inspire new FL research for audio tasks and thus benefit the acoustic and speech research community. The datasets and benchmark results can be accessed at https://github.com/zhang-tuo-pdf/FedAudio.


title: Superposing the Magnetic spiral structure of the Milky Way, on the stellar spiral arms -- Matching the unique galactic magnetic field reversal Zone with two galactic spiral arm Segments

abstract: To pinpoint the peak location of the synchrotron total intensity emission in a spiral arm, we use a map of the spiralarm locations (from the observed arm tangent). Thus In a typical spiral arm in Galactic Quadrant I, we find the peak of the synchrotron radiation to be located about 220 +/-40 pc away from the inner arm edge (hot dust lane) inside the spiral arm. While most of the galactic disk has a clockwise largescale magnetic field, we make a statistical analysis to delimitate more precisely the smaller reverse annulus wiith a counterclockwise galactic magnetic field. We find an annulus width of 2.1 +/-0.3 kpc (measured along the Galactic radius), located from 5.5 to 7.6 kpc from the Galactic Center). The annulus does not overlay with a single spiral arm -- it encompasses segments of two different spiral arms. Using a recent delineation of the position of spiral arms, the field-reversed annulus is seen to encompass the Crux-Centaurus arm (in Galactic Quadrant IV) and the Sagittarius arm (in Galactic Quadrant I).


abstract: Algorithmic recourse recommendations, such as Karimi et al.'s (2021) causal recourse (CR), inform stakeholders of how to act to revert unfavourable decisions. However, some actions lead to acceptance (i.e., revert the model's decision) but do not lead to improvement (i.e., may not revert the underlying real-world state). To recommend such actions is to recommend fooling the predictor. We introduce a novel method, Improvement-Focused Causal Recourse (ICR), which involves a conceptual shift: Firstly, we require ICR recommendations to guide towards improvement. Secondly, we do not tailor the recommendations to be accepted by a specific predictor. Instead, we leverage causal knowledge to design decision systems that predict accurately pre- and post-recourse. As a result, improvement guarantees translate into acceptance guarantees. We demonstrate that given correct causal knowledge, ICR, in contrast to existing approaches, guides towards both acceptance and improvement.


title: Quantum Mechanics: Statistical Balance Prompts Caution in Assessing Conceptual Implications

abstract: Throughout quantum mechanics there is statistical balance, in the collective response of an ensemble of systems to differing measurement types. Statistical balance is a core feature of quantum mechanics, underlying quantum mechanical states, and not yet explained. The concept of "statistical balance" is here explored, comparing its meaning since 2019 with its original meaning in 2001. Statistical balance now refers to a feature of contexts in which: (a) there is a prescribed probability other than 0 or 1 for the collective response of an ensemble to one measurement type; and (b) the collective response of the same ensemble to another measurement type demonstrates that no well-defined value can be attributed, for the property relevant to the original measurement type, to individual members of the ensemble. In some unexplained way, the outcomes of single runs of a measurement of the original type "balance" each other to give an overall result in line with the prescribed probability. Unexplained statistical balance prompts caution in assessing the conceptual implications of entanglement, measurement, uncertainty, and two-slit and Bell-type analyses. Physicists have a responsibility to the wider population to be conceptually precise about quantum mechanics, and to make clear that many possible conceptual implications are uncertain.


title: Re-looking at the View Update Problem

abstract: Relational databases have always had a means for creating a pseudo-table, called a view, defined by a query. Views are like tables in most ways, except that they are read-only and cannot be updated. The problem of how to update views has attracted a lot of attention in the 1980s but is unsolved. The best approach from that time was by Bancilhon and Spyratos. I use one of their overlooked theorems and find a number of simple solutions for common relational operators.


title: A mathematical framework for dynamical social interactions with dissimulation

abstract: Modeling social interactions is a challenging task that requires flexible frameworks. For instance, dissimulation and externalities are relevant features influencing such systems -- elements that are often neglected in popular models. This paper is devoted to investigating general mathematical frameworks for understanding social situations where agents dissimulate, and may be sensitive to exogenous objective information. Our model comprises a population where the participants can be honest, persuasive, or conforming. Firstly, we consider a non-cooperative setting, where we establish existence, uniqueness and some properties of the Nash equilibria of the game. Secondly, we analyze a cooperative setting, identifying optimal strategies within the Pareto front. In both cases, we develop numerical algorithms allowing us to computationally assess the behavior of our models under various settings.


title: Channel State Information-Free Artificial Noise-Aided Location-Privacy Enhancement

abstract: In this paper, an artificial noise-aided strategy is presented for location-privacy preservation. A novel framework for the reduction of location-privacy leakage is introduced, where structured artificial noise is designed to degrade the structure of the illegitimate devices' channel, without the aid of channel state information at the transmitter. Then, based on the location-privacy enhancement framework, a transmit beamformer is proposed to efficiently inject the structured artificial noise. Furthermore, the securely shared information is characterized to enable the legitimate devices to localize accurately. Numerical results show a 9dB degradation of illegitimate devices' localization accuracy is achieved, and validate the efficacy of structured artificial noise versus unstructured Gaussian noise.


title: List Agreement Expansion from Coboundary Expansion

abstract: One of the key components in PCP constructions are agreement tests. In agreement test the tester is given access to subsets of fixed size of some set, each equipped with an assignment. The tester is then tasked with testing whether these local assignments agree with some global assignment over the entire set. One natural generalization of this concept is the case where, instead of a single assignment to each local view, the tester is given access to $l$ different assignments for every subset. The tester is then tasked with testing whether there exist $l$ global functions that agree with all of the assignments of all of the local views. In this work we present sufficient condition for a set system to exhibit this generalized definition of list agreement expansion. This is, to our knowledge, the first work to consider this natural generalization of agreement testing. Despite initially appearing very similar to agreement expansion, list agreement expansion seem to require a different set of techniques. This is due to the fact that the natural extension of agreement testing does not suffice when testing for list agreement, as list agreement crucially relies on a global structure. It follows that if a local assignments satisfy list agreement they must not only agree locally but also exhibit some additional structure. In order to test for the existence of this additional structure we use a connection between covering spaces of a high dimensional complex and its coboundaries. We use this connection as a form of ``decoupling''. Moreover, we show that any set system that exhibits list agreement expansion also supports direct sum testing. This is the first scheme for direct sum testing that works regardless of the parity of the sizes of the local sets. Prior to our work the schemes for direct sum testing were based on the parity of the sizes of the local tests.


title: Simulating realistic speech overlaps improves multi-talker ASR

abstract: Multi-talker automatic speech recognition (ASR) has been studied to generate transcriptions of natural conversation including overlapping speech of multiple speakers. Due to the difficulty in acquiring real conversation data with high-quality human transcriptions, a na\"ive simulation of multi-talker speech by randomly mixing multiple utterances was conventionally used for model training. In this work, we propose an improved technique to simulate multi-talker overlapping speech with realistic speech overlaps, where an arbitrary pattern of speech overlaps is represented by a sequence of discrete tokens. With this representation, speech overlapping patterns can be learned from real conversations based on a statistical language model, such as N-gram, which can be then used to generate multi-talker speech for training. In our experiments, multi-talker ASR models trained with the proposed method show consistent improvement on the word error rates across multiple datasets.


title: Magnetic Solitons due to interfacial chiral interactions

abstract: We study solitons in a zig-zag lattice of magnetic dipoles. The lattice comprises two sublattices of parallel chains with magnetic dipoles at their vertices. Due to orthogonal easy planes of rotation for dipoles belonging to different sublattices, the total dipolar energy of this system is separable into a sum of symmetric and chiral long-ranged interactions between the magnets where the last takes the form of Dzyaloshinskii-Moriya coupling. For a specific range of values of the offset between sublattices, the dipoles realize an equilibrium magnetic state in the lattice plane, consisting of one chain settled in an antiferromagnetic parallel configuration and the other in a collinear ferromagnetic fashion. If the offset grows beyond this value, the internal Dzyaloshinskii-Moriya field stabilizes two Bloch domain walls at the edges of the antiferromagnetic chain. The dynamics of these solitons is studied by deriving the long-wavelength lagrangian density for the easy axis antiferromagnet. We find that the chiral couplings between sublattices give rise to an effective magnetic field that stabilizes the solitons in the antiferromagnet. When the chains displace respect to each other, an emergent Lorentz force accelerates the domain walls along the lattice.


title: Einstein Lorentzian solvable unimodular Lie groups

abstract: The goal of this paper is to show that many key results found in the study of Einstein Lorentzian nilpotent Lie algebras can still hold in the more general settings of unimodular Lie algebras and (completely) solvable Lie algebras.


title: QUILL: Query Intent with Large Language Models using Retrieval Augmentation and Multi-stage Distillation

abstract: Large Language Models (LLMs) have shown impressive results on a variety of text understanding tasks. Search queries though pose a unique challenge, given their short-length and lack of nuance or context. Complicated feature engineering efforts do not always lead to downstream improvements as their performance benefits may be offset by increased complexity of knowledge distillation. Thus, in this paper we make the following contributions: (1) We demonstrate that Retrieval Augmentation of queries provides LLMs with valuable additional context enabling improved understanding. While Retrieval Augmentation typically increases latency of LMs (thus hurting distillation efficacy), (2) we provide a practical and effective way of distilling Retrieval Augmentation LLMs. Specifically, we use a novel two-stage distillation approach that allows us to carry over the gains of retrieval augmentation, without suffering the increased compute typically associated with it. (3) We demonstrate the benefits of the proposed approach (QUILL) on a billion-scale, real-world query understanding system resulting in huge gains. Via extensive experiments, including on public benchmarks, we believe this work offers a recipe for practical use of retrieval-augmented query understanding.


title: Characterization of AlW oxide coatings on aluminum formed by pulsed direct current plasma electrolytic oxidation at ultralow duty cycles

abstract: The growth of thin oxide coatings on the aluminum substrate in water-based sodium tungstate electrolyte by plasma electrolytic oxidation (PEO) is discussed and experimentally illustrated. The growth is carried out using a distinctive ultra-low duty cycle pulsed direct current (DC) power supply. During the PEO processing elements present in micro-discharges are identified using standard optical emission spectroscopy (OES) technique. The spectral line shape analysis of the first two hydrogen Balmer lines shows the presence of two types of micro-discharges. Obtained coatings are also characterized with respect to their morphology and chemical and phase composition. It is shown that coatings are composed of Al, O, and W, featuring low roughness and porosity. Partial crystallization of the coatings resulted in identification of WO3, W3O8, and gamma-Al2O3 crystalline phases.


title: Solving the Schrodinger equation with genetic algorithms: a practical approach

abstract: The Schrodinger equation is one of the most important equations in physics and chemistry and can be solved in the simplest cases by computer numerical methods. Since the beginning of the 70s of the last century the computer began to be used to solve this equation in elementary quantum systems, e.g. and in the most complex case a hydrogen-like system. Obtaining the solution means finding the wave function, which allows predicting the physical and chemical properties of the quantum system. However, when a quantum system is more complex than a hydrogen-like system then we must be satisfied with an approximate solution of the equation. During the last decade the application of algorithms and principles of quantum computation in disciplines other than physics and chemistry, such as biology and artificial intelligence, has led to the search for alternative techniques with which to obtain approximate solutions of the Schrodinger equation. In this paper, we review and illustrate the application of genetic algorithms, i.e. stochastic optimization procedures inspired by Darwinian evolution, in elementary quantum systems and in quantum models of artificial intelligence. In this last field, we illustrate with two toy models how to solve the Schrodinger equation in an elementary model of a quantum neuron and in the synthesis of quantum circuits controlling the behavior of a Braitenberg vehicle.


title: GraphMAD: Graph Mixup for Data Augmentation using Data-Driven Convex Clustering

abstract: We develop a novel data-driven nonlinear mixup mechanism for graph data augmentation and present different mixup functions for sample pairs and their labels. Mixup is a data augmentation method to create new training data by linearly interpolating between pairs of data samples and their labels. Mixup of graph data is challenging since the interpolation between graphs of potentially different sizes is an ill-posed operation. Hence, a promising approach for graph mixup is to first project the graphs onto a common latent feature space and then explore linear and nonlinear mixup strategies in this latent space. In this context, we propose to (i) project graphs onto the latent space of continuous random graph models known as graphons, (ii) leverage convex clustering in this latent space to generate nonlinear data-driven mixup functions, and (iii) investigate the use of different mixup functions for labels and data samples. We evaluate our graph data augmentation performance on benchmark datasets and demonstrate that nonlinear data-driven mixup functions can significantly improve graph classification.


title: PatchRot: A Self-Supervised Technique for Training Vision Transformers

abstract: Vision transformers require a huge amount of labeled data to outperform convolutional neural networks. However, labeling a huge dataset is a very expensive process. Self-supervised learning techniques alleviate this problem by learning features similar to supervised learning in an unsupervised way. In this paper, we propose a self-supervised technique PatchRot that is crafted for vision transformers. PatchRot rotates images and image patches and trains the network to predict the rotation angles. The network learns to extract both global and local features from an image. Our extensive experiments on different datasets showcase PatchRot training learns rich features which outperform supervised learning and compared baseline.


title: Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation

abstract: We present an approach for selecting objectively informative and subjectively helpful annotations to social media posts. We draw on data from on an online environment where contributors annotate misinformation and simultaneously rate the contributions of others. Our algorithm uses a matrix-factorization (MF) based approach to identify annotations that appeal broadly across heterogeneous user groups - sometimes referred to as "bridging-based ranking." We pair these data with a survey experiment in which individuals are randomly assigned to see annotations to posts. We find that annotations selected by the algorithm improve key indicators compared with overall average and crowd-generated baselines. Further, when deployed on Twitter, people who saw annotations selected through this bridging-based approach were significantly less likely to reshare social media posts than those who did not see the annotations.


title: Strong formulations of the generalised Navier-Stokes momentum equation

abstract: In this paper, the strong formulation of the generalised Navier-Stokes momentum equation is investigated. Specifically, the formulation of shear-stress divergence is investigated, due to its effect on the performance and accuracy of computational methods. It is found that the term may be expressed in two different ways. While the first formulation is commonly used, the alternative derivation is found to be potentially more convenient for direct numerical manipulation. The alternative formulation relocates a part of strain information under the variable-coefficient Laplacian operator, thus making future computational schemes potentially simpler with larger time-step sizes.


title: The Adiabatic Wigner-Weisskopf Model

abstract: We consider a slowly varying time dependent d-level atom interacting with a photon field. Restricted to the single excitation atom-field sector, the model is a time-dependent generalization of the Wigner-Weisskopf model describing spontaneous emission of an atomic excitation into the radiation field. We analyze the dynamics of the atom and of the radiation field in the adiabatic and small coupling approximations, in various regimes. In particular, starting with an excited atomic state, we provide a description of both the radiative decay of the atom and of the buildup of the photon excitation in the field.


title: Deterministic Localization of Strain-induced Single-photon Emitters in Multilayer GaSe

abstract: Nanoscale strain has emerged as a powerful tool for controlling single-photon emitters (SPEs) in atomically thin transition metal dichalcogenides (TMDCs)(1, 2). However, quantum emitters in monolayer TMDCs are typically unstable in ambient conditions. Multilayer two-dimensional (2D) TMDCs could be a solution, but they suffer from low quantum efficiency, resulting in low brightness of the SPEs. Here, we report the deterministic spatial localization of strain-induced single-photon emitters in multilayer GaSe by nanopillar arrays. The strain-controlled quantum confinement effect introduces well-isolated sub-bandgap photoluminescence and corresponding suppression of the broad band edge photoluminescence. Clear photon-antibunching behavior is observed from the quantum dot-like GaSe sub-bandgap exciton emission at 3.5 Kelvin. The strain-dependent confinement potential and the brightness are found to be strongly correlated, suggesting a promising route for tuning and controlling SPEs. The comprehensive investigations of strain-engineered GaSe SPEs provide a solid foundation for the development of 2D devices for quantum photonic technologies.


title: The sample complexity of sparse multi-reference alignment and single-particle cryo-electron microscopy

abstract: Multi-reference alignment (MRA) is the problem of recovering a signal from its multiple noisy copies, each acted upon by a random group element. MRA is mainly motivated by single-particle cryo-electron microscopy (cryo-EM) that has recently joined X-ray crystallography as one of the two leading technologies to reconstruct biological molecular structures. Previous papers have shown that in the high noise regime, the sample complexity of MRA and cryo-EM is $n=\omega(\sigma^{2d})$, where $n$ is the number of observations, $\sigma^2$ is the variance of the noise, and $d$ is the lowest-order moment of the observations that uniquely determines the signal. In particular, it was shown that in many cases, $d=3$ for generic signals, and thus the sample complexity is $n=\omega(\sigma^6)$. In this paper, we analyze the second moment of the MRA and cryo-EM models. First, we show that in both models the second moment determines the signal up to a set of unitary matrices, whose dimension is governed by the decomposition of the space of signals into irreducible representations of the group. Second, we derive sparsity conditions under which a signal can be recovered from the second moment, implying sample complexity of $n=\omega(\sigma^4)$. Notably, we show that the sample complexity of cryo-EM is $n=\omega(\sigma^4)$ if at most one third of the coefficients representing the molecular structure are non-zero; this bound is near-optimal. The analysis is based on tools from representation theory and algebraic geometry. We also derive bounds on recovering a sparse signal from its power spectrum, which is the main computational problem of X-ray crystallography.


title: OPEs of rank two W-algebras

abstract: In this short note, we provide OPEs for several affine W-algebras associated with Lie algebras of rank two and give some direct applications.


title: On weighted estimates for the stream function of axially symmetric solutions to the Navier-Stokes equations in a bounded cylinder

abstract: Higher-order estimates in weighted Sobolev spaces for solutions to a singular elliptic equation for the stream function in an axially symmetric cylinder are provided. These estimates are essential for investigating the existence of axially symmetric solutions to incompressible Navier-Stokes equations in axially symmetric cylinders. To derive the estimates the technique of Kondratiev is incorporated. The weight has a form of a power function of the distance to the axis of symmetry.


title: On the kernel of the $(\kappa,a)$-generalized Fourier transform

abstract: For the kernel $B_{\kappa,a}(x,y)$ of the $(\kappa,a)$-generalized Fourier transform $\mathcal{F}_{\kappa,a}$, acting in $L^{2}(\mathbb{R}^{d})$ with the weight $|x|^{a-2}v_{\kappa}(x)$, where $v_{\kappa}$ is the Dunkl weight, we study the important question of when $\|B_{\kappa,a}\|_{\infty}=B_{\kappa,a}(0,0)=1$. The positive answer was known for $d\ge 2$ and $\frac{2}{a}\in\mathbb{N}$. We investigate the case $d=1$ and $\frac{2}{a}\in\mathbb{N}$. Moreover, we give sufficient conditions on parameters for $\|B_{\kappa,a}\|_{\infty}>1$ to hold with $d\ge 1$ and any $a$. We also study the image of the Schwartz space under the $\mathcal{F}_{\kappa,a}$ transform. In particular, we obtain that $\mathcal{F}_{\kappa,a}(\mathcal{S}(\mathbb{R}^d))=\mathcal{S}(\mathbb{R}^d)$ only if $a=2$. Finally, extending the Dunkl transform, we introduce non-deformed transforms generated by $\mathcal{F}_{\kappa,a}$ and study their main properties.


title: Beyond Homophily with Graph Echo State Networks

abstract: Graph Echo State Networks (GESN) have already demonstrated their efficacy and efficiency in graph classification tasks. However, semi-supervised node classification brought out the problem of over-smoothing in end-to-end trained deep models, which causes a bias towards high homophily graphs. We evaluate for the first time GESN on node classification tasks with different degrees of homophily, analyzing also the impact of the reservoir radius. Our experiments show that reservoir models are able to achieve better or comparable accuracy with respect to fully trained deep models that implement ad hoc variations in the architectural bias, with a gain in terms of efficiency.


title: Joint Uplink-Downlink Capacity and Coverage Optimization via Site-Specific Learning of Antenna Settings

abstract: We propose a novel framework for optimizing antenna parameter settings in a heterogeneous cellular network. We formulate an optimization problem for both coverage and capacity - in both the downlink (DL) and uplink (UL) - which configures the tilt angle, vertical half-power beamwidth (HPBW), and horizontal HPBW of each cell's antenna array across the network. The novel data-driven framework proposed for this non-convex problem, inspired by Bayesian optimization (BO) and differential evolution algorithms, is sample-efficient and converges quickly, while being scalable to large networks. By jointly optimizing DL and UL performance, we take into account the different signal power and interference characteristics of these two links, allowing a graceful trade-off between coverage and capacity in each one. Our experiments on a state-of-the-art 5G NR cellular system-level simulator developed by AT&T Labs show that the proposed algorithm consistently and significantly outperforms the 3GPP default settings, random search, and conventional BO. In one realistic setting, and compared to conventional BO, our approach increases the average sum-log-rate by over 60% while decreasing the outage probability by over 80%. Compared to the 3GPP default settings, the gains from our approach are considerably larger. The results also indicate that the practically important combination of DL throughput and UL coverage can be greatly improved by joint UL-DL optimization.


title: A Connection Behind the Terwilliger Algebras of $H(D,2)$ and $\frac{1}{2} H(D,2)$

abstract: The universal enveloping algebra $U(\mathfrak{sl}_2)$ of $\mathfrak{sl}_2$ is a unital associative algebra over $\mathbb C$ generated by $E,F,H$ subject to the relations \begin{align*} [H,E]=2E, \qquad [H,F]=-2F, \qquad [E,F]=H. \end{align*} The distinguished central element $$ \Lambda=EF+FE+\frac{H^2}{2} $$ is called the Casimir element of $U(\mathfrak{sl}_2)$. The universal Hahn algebra $\mathcal H$ is a unital associative algebra over $\mathbb C$ with generators $A,B,C$ and the relations assert that $[A,B]=C$ and each of \begin{align*} \alpha=[C,A]+2A^2+B, \qquad \beta=[B,C]+4BA+2C \end{align*} is central in $\mathcal H$. The distinguished central element $$ \Omega=4ABA+B^2-C^2-2\beta A+2(1-\alpha)B $$ is called the Casimir element of $\mathcal H$. By investigating the relationship between the Terwilliger algebras of the hypercube and its halved graph, we discover the algebra homomorphism $\natural:\mathcal H\rightarrow U(\mathfrak{sl}_2)$ that sends \begin{eqnarray*} A &\mapsto & \frac{H}{4}, \\ B & \mapsto & \frac{E^2+F^2+\Lambda-1}{4}-\frac{H^2}{8}, \\ C & \mapsto & \frac{E^2-F^2}{4}. \end{eqnarray*} We determine the image of $\natural$ and show that the kernel of $\natural$ is the two-sided ideal of $\mathcal H$ generated by $\beta$ and $16 \Omega-24 \alpha+3$. By pulling back via $\natural$ each $U(\mathfrak{sl}_2)$-module can be regarded as an $\mathcal H$-module. For each integer $n\geq 0$ there exists a unique $(n+1)$-dimensional irreducible $U(\mathfrak{sl}_2)$-module $L_n$ up to isomorphism. We show that the $\mathcal H$-module $L_n$ ($n\geq 1$) is a direct sum of two non-isomorphic irreducible $\mathcal H$-modules.


title: Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models

abstract: End-to-end spoken language understanding (SLU) systems are gaining popularity over cascaded approaches due to their simplicity and ability to avoid error propagation. However, these systems model sequence labeling as a sequence prediction task causing a divergence from its well-established token-level tagging formulation. We build compositional end-to-end SLU systems that explicitly separate the added complexity of recognizing spoken mentions in SLU from the NLU task of sequence labeling. By relying on intermediate decoders trained for ASR, our end-to-end systems transform the input modality from speech to token-level representations that can be used in the traditional sequence labeling framework. This composition of ASR and NLU formulations in our end-to-end SLU system offers direct compatibility with pre-trained ASR and NLU systems, allows performance monitoring of individual components and enables the use of globally normalized losses like CRF, making them attractive in practical scenarios. Our models outperform both cascaded and direct end-to-end models on a labeling task of named entity recognition across SLU benchmarks.


title: Cyclicity in de Branges--Rovnyak spaces

abstract: In this paper, we study the cyclicity problem with respect to the forward shift operator $S_b$ acting on the de Branges--Rovnyak space $\mathscr{H}(b)$ associated to a function $b$ in the closed unit ball of $H^\infty$ and satisfying $\log(1-|b|)\in L^1(\mathbb T)$. We present a characterisation of cyclic vectors for $S_b$ when $b$ is a rational function which is not a finite Blaschke product. This characterisation can be derived from the description, given in [S. Luo, C. Gu, S. Richter, Higher order local Dirichlet integrals and de Branges--Rovnyak spaces, \emph{Adv. Math., \textbf{385} (2021), paper No. 107748, 47], of invariant subspaces of $S_b$ in this case, but we provide here an elementary proof. We also study the situation where $b$ has the form $b=(1+I)/2$, where $I$ is a non-constant inner function such that the associated model space $K_I=\mathscr{H}(I)$ has an orthonormal basis of reproducing kernels.


title: Quantitative John--Nirenberg inequality for stochastic processes of bounded mean oscillation

abstract: Stroock and Varadhan in 1997 and Geiss in 2005 independently introduced stochastic processes with bounded mean oscillation (BMO) and established their exponential integrability with some unspecified exponential constant. This result is an analogue of the John--Nirenberg inequality for functions of bounded mean oscillation. In this work, we quantify the size of the exponential constant by the modulus of mean oscillation. Some new applications of BMO processes in rough stochastic differential equations, numerical approximations and regularization by noise are discussed.


title: Counting Conjugacy Classes of Elements of Finite Order in Exceptional Lie Groups

abstract: This paper completes the study of two numbers that are associated with Lie groups. The first number is $N(G,m)$, the number of conjugacy classes of elements in $G$ whose order divides $m$. The second number is $N(G,m,s)$, the number of conjugacy classes of elements in $G$ whose order divides $m$ and which have $s$ distinct eigenvalues, where we view $G$ as a matrix group in its smallest-degree faithful representation. We describe systematic algorithms for computing both numbers for any connected and simply-connected exceptional Lie group. We also provide explicit results for all of $N(G,m)$, $N(G_2,m,s)$, and $N(F_4,m,s)$. The numbers $N(G,m,s)$ were previously known only for the classical Lie groups; our results for $N(G,m)$ agree with those already in the literature but are obtained differently.


title: Entropy of Quantum Measurements

abstract: If $a$ is a quantum effect and $\rho$ is a state, we define the $\rho$-entropy $S_a(\rho )$ which gives the amount of uncertainty that a measurement of $a$ provides about $\rho$. The smaller $S_a(\rho )$ is, the more information a measurement of $a$ gives about $\rho$. In Section~2, we provide bounds on $S_a(\rho )$ and show that if $a+b$ is an effect, then $S_{a+b}(\rho )\ge S_a(\rho )+S_b(\rho )$. We then prove a result concerning convex mixtures of effects. We also consider sequential products of effects and their $\rho$-entropies. In Section~3, we employ $S_a(\rho )$ to define the $\rho$-entropy $S_A(\rho )$ for an observable $A$. We show that $S_A(\rho )$ directly provides the $\rho$-entropy $S_\iscript (\rho )$ for an instrument $\iscript$. We establish bounds for $S_A(\rho )$ and prove characterizations for when these bounds are obtained. These give simplified proofs of results given in the literature. We also consider $\rho$-entropies for measurement models, sequential products of observables and coarse-graining of observables. Various examples that illustrate the theory are provided.


title: Constraining properties of asymmetric dark matter candidates from gravitational-wave observations

abstract: The accumulation of certain types of dark matter particles in neutron star cores due to accretion over long timescales can lead to the formation of a mini black hole. In this scenario, the neutron star is destabilized and implodes to form a black hole without significantly increasing its mass. When this process occurs in neutron stars in coalescing binaries, one or both stars might be converted to a black hole before they merge. Thus, in the mass range of $\sim \mbox{1--2}\, M_\odot,$ the Universe might contain three distinct populations of compact binaries: one containing only neutron stars, the second population of only black holes, and a third, mixed population consisting of a neutron star and a black hole. However, it is unlikely to have a mixed population as the various timescales allow for both neutron stars to remain or collapse within a short timescale. In this paper, we explore the capability of future gravitational-wave detector networks, including upgrades of Advanced LIGO and Virgo, and new facilities such as the Cosmic Explorer and Einstein Telescope (XG network), to discriminate between different populations by measuring the effective tidal deformability of the binary, which is zero for binary black holes but nonzero for binary neutron stars. Furthermore, we show that observing the relative abundances of the different populations can be used to infer the timescale for neutron stars to implode into black holes, and in turn, provide constraints on the particle nature of dark matter. The XG network will infer the implosion timescale to within an accuracy of 0.01 Gyr at 90% credible interval and determine the dark matter mass and interaction cross section to within a factor of 2 GeV and 10 cm$^{-2}$, respectively.


title: Formal Semantics for the Halide Language

abstract: We present the first formalization and metatheory of language soundness for a user-schedulable language, the widely used array processing language Halide. User-schedulable languages strike a balance between abstraction and control in high-performance computing by separating the specification of what a program should compute from a schedule for how to compute it. In the process, they make a novel language soundness claim: the result of a program should always be the same, regardless of how it is scheduled. This soundness guarantee is tricky to provide in the presence of schedules that introduce redundant recomputation and computation on uninitialized data, rather than simply reordering statements. In addition, Halide ensures memory safety through a compile-time bounds inference engine that determines safe sizes for every buffer and loop in the generated code, presenting a novel challenge: formalizing and analyzing a language specification that depends on the results of unreliable program synthesis algorithms. Our formalization has revealed flaws and led to improvements in the practical Halide system, and we believe it provides a foundation for the design of new languages and tools that apply programmer-controlled scheduling to other domains.


title: Spatio-temporal predictive tasks for abnormal event detection in videos

abstract: Abnormal event detection in videos is a challenging problem, partly due to the multiplicity of abnormal patterns and the lack of their corresponding annotations. In this paper, we propose new constrained pretext tasks to learn object level normality patterns. Our approach consists in learning a mapping between down-scaled visual queries and their corresponding normal appearance and motion characteristics at the original resolution. The proposed tasks are more challenging than reconstruction and future frame prediction tasks which are widely used in the literature, since our model learns to jointly predict spatial and temporal features rather than reconstructing them. We believe that more constrained pretext tasks induce a better learning of normality patterns. Experiments on several benchmark datasets demonstrate the effectiveness of our approach to localize and track anomalies as it outperforms or reaches the current state-of-the-art on spatio-temporal evaluation metrics.


title: Coarsening, condensates and extremes in aggregation-fragmentation models

abstract: We use extreme value statistics to study the dynamics of coarsening in aggregation-fragmentation models which form condensates in the steady state. The dynamics is dominated by the formation of local condensates on a coarsening length scale which grows in time in both the zero range process and conserved mass aggregation model. The local condensate mass distribution exhibits scaling, which implies anomalously large fluctuations, with mean and standard deviation both proportional to the coarsening length. Remarkably, the state of the system during coarsening is governed not by the steady state, but rather a pre-asymptotic state in which the condensate mass fluctuates strongly.


title: Picard sheaves, local Brauer groups, and topological modular forms

abstract: We prove that the Brauer group of TMF is isomorphic to the Brauer group of the derived moduli stack of elliptic curves. Then, we compute the local Brauer group, i.e., the subgroup of the Brauer group of elements trivialized by some \'etale cover of the moduli stack, up to a finite 2-torsion group.


title: Duals of Tirilman spaces have unique subsymmetric basic sequences

abstract: The Tirilman spaces $Ti(p,\gamma)$, $1<p<\infty$, were introduced by Casazza and Shura as variations of the spaces constructed by Tzafriri. We prove that all subsymmetric basic sequences in the dual space $Ti^*(p,\gamma)$ are equivalent to its canonical subsymmetic but not symmetric basis.


title: DICTION: DynamIC robusT whIte bOx watermarkiNg scheme

abstract: Deep neural network (DNN) watermarking is a suitable method for protecting the ownership of deep learning (DL) models derived from computationally intensive processes and painstakingly compiled and annotated datasets. It secretly embeds an identifier (watermark) within the model, which can be retrieved by the owner to prove ownership. In this paper, we first provide a unified framework for white box DNN watermarking schemes. It includes current state-of-the art methods outlining their theoretical inter-connections. In second, we introduce DICTION, a new white-box Dynamic Robust watermarking scheme, we derived from this framework. Its main originality stands on a generative adversarial network (GAN) strategy where the watermark extraction function is a DNN trained as a GAN discriminator, and the target model to watermark as a GAN generator taking a GAN latent space as trigger set input. DICTION can be seen as a generalization of DeepSigns which, to the best of knowledge, is the only other Dynamic white-box watermarking scheme from the literature. Experiments conducted on the same model test set as Deepsigns demonstrate that our scheme achieves much better performance. Especially, and contrarily to DeepSigns, with DICTION one can increase the watermark capacity while preserving at best the model accuracy and ensuring simultaneously a strong robustness against a wide range of watermark removal and detection attacks.


title: On groups that can be covered by conjugates of finitely many cyclic or procyclic subgroups

abstract: Given a discrete (resp. profinite) group $G$, we define $NCC(G)$ to be the smallest number of cyclic (resp. procyclic) subgroups of $G$ whose conjugates cover $G$. In this paper we determine all residually finite discrete groups with finite NCC and give an almost complete characterization of profinite groups with finite NCC. As a consequence we can show, for example, that for any $k\in\mathbb N$ and any prime $p>3$ the number of finite $p$-groups $P$ with more than $3$ generators and $NCC(P)=k$ is finite.


title: Scattering solution of interacting Hamiltonian for electronic control of molecular spin qubits

abstract: We theoretically study how a scattered electron can entangle molecular spin qubits (MSQs). This requires solving the inelastic transport of a single electron through a scattering region described by a tight-binding interacting Hamiltonian. We accomplish this using a Green's function solution. We can model realistic physical implementations of MSQs by parameterizing the tight-binding Hamiltonian with first-principles descriptions of magnetic anisotropy and exchange interactions. We find that for two-MSQ systems with inversion symmetry, the spin degree of freedom of the scattered electron offers probabilistic control of the degree of entanglement between the MSQs.


title: DESSERT: An Efficient Algorithm for Vector Set Search with Vector Set Queries

abstract: We study the problem of $\textit{vector set search}$ with $\textit{vector set queries}$. This task is analogous to traditional near-neighbor search, with the exception that both the query and each element in the collection are $\textit{sets}$ of vectors. We identify this problem as a core subroutine for semantic search applications and find that existing solutions are unacceptably slow. Towards this end, we present a new approximate search algorithm, DESSERT (${\bf D}$ESSERT ${\bf E}$ffeciently ${\bf S}$earches ${\bf S}$ets of ${\bf E}$mbeddings via ${\bf R}$etrieval ${\bf T}$ables). DESSERT is a general tool with strong theoretical guarantees and excellent empirical performance. When we integrate DESSERT into ColBERT, a state-of-the-art semantic search model, we find a 2-5x speedup on the MS MARCO and LoTTE retrieval benchmarks with minimal loss in recall, underscoring the effectiveness and practical applicability of our proposal.


title: Investigating exclusive $\rho^0$ photoproduction within the Regge phenomenology approach

abstract: The elastic differential and integrated total cross section for the exclusive $\rho^0$ photoproduction in electron-proton ($ep$) collisions are evaluated taking into account nonperturbative Pomeron exchange approach. By using three different models based on Regge phenomenology the results are compared to recent measurements by H1 Collaboration in $ep$ collisions and by the CMS collaboration from ultraperipheral proton-lead collisions. The analysis is expanded by calculating the coherent nuclear cross section, $\sigma (\gamma A\rightarrow \rho^0 A)$, which is applied to $\rho^0$ production in ultraperipheral lead-lead and xenon-xenon collisions. The predictions are compared to the measurements performed by ALICE Collaboration. Aspects of the theoretical uncertainties and limitations of the formalism are scrutinized.


title: One-Shot Acoustic Matching Of Audio Signals -- Learning to Hear Music In Any Room/ Concert Hall

abstract: The acoustic space in which a sound is created and heard plays an essential role in how that sound is perceived by affording a unique sense of \textit{presence}. Every sound we hear results from successive convolution operations intrinsic to the sound source and external factors such as microphone characteristics and room impulse responses. Typically, researchers use an excitation such as a pistol shot or balloon pop as an impulse signal with which an auralization can be created. The room "impulse" responses convolved with the signal of interest can transform the input sound into the sound played in the acoustic space of interest. Here we propose a novel architecture that can transform a sound of interest into any other acoustic space(room or hall) of interest by using arbitrary audio recorded as a proxy for a balloon pop. The architecture is grounded in simple signal processing ideas to learn residual signals from a learned acoustic signature and the input signal. Our framework allows a neural network to adjust gains of every point in the time-frequency representation, giving sound qualitative and quantitative results.


title: Planning with Spatial-Temporal Abstraction from Point Clouds for Deformable Object Manipulation

abstract: Effective planning of long-horizon deformable object manipulation requires suitable abstractions at both the spatial and temporal levels. Previous methods typically either focus on short-horizon tasks or make strong assumptions that full-state information is available, which prevents their use on deformable objects. In this paper, we propose PlAnning with Spatial-Temporal Abstraction (PASTA), which incorporates both spatial abstraction (reasoning about objects and their relations to each other) and temporal abstraction (reasoning over skills instead of low-level actions). Our framework maps high-dimension 3D observations such as point clouds into a set of latent vectors and plans over skill sequences on top of the latent set representation. We show that our method can effectively perform challenging sequential deformable object manipulation tasks in the real world, which require combining multiple tool-use skills such as cutting with a knife, pushing with a pusher, and spreading the dough with a roller.


title: Constrained Predictive Coding as a Biologically Plausible Model of the Cortical Hierarchy

abstract: Predictive coding has emerged as an influential normative model of neural computation, with numerous extensions and applications. As such, much effort has been put into mapping PC faithfully onto the cortex, but there are issues that remain unresolved or controversial. In particular, current implementations often involve separate value and error neurons and require symmetric forward and backward weights across different brain regions. These features have not been experimentally confirmed. In this work, we show that the PC framework in the linear regime can be modified to map faithfully onto the cortical hierarchy in a manner compatible with empirical observations. By employing a disentangling-inspired constraint on hidden-layer neural activities, we derive an upper bound for the PC objective. Optimization of this upper bound leads to an algorithm that shows the same performance as the original objective and maps onto a biologically plausible network. The units of this network can be interpreted as multi-compartmental neurons with non-Hebbian learning rules, with a remarkable resemblance to recent experimental findings. There exist prior models which also capture these features, but they are phenomenological, while our work is a normative derivation. The network we derive does not involve one-to-one connectivity or signal multiplexing, which the phenomenological models required, indicating that these features are not necessary for learning in the cortex. The normative nature of our algorithm in the simplified linear case allows us to prove interesting properties of the framework and analytically understand the computational role of our network's components. The parameters of our network have natural interpretations as physiological quantities in a multi-compartmental model of pyramidal neurons, providing a concrete link between PC and experimental measurements carried out in the cortex.


title: Current-induced quasiparticle magnetic multipole moments

abstract: Magnetic ordering beyond the standard dipolar order has attracted significant attention in recent years, but it remains an open question how to effectively manipulate such nontrivial order parameters using external perturbations. In this context, we present a theory for Cartesian magnetic multipole moments and their currents created by electric currents based on a general gauge-invariant formula for arbitrary-order spin magnetic multipole moments of Bloch wave packets. As a concrete example, we point out that the low-energy quasiparticles in phosphorene subject to a perpendicular electric field have a valley structure that hosts magnetic octupole moments. The quasiparticle magnetic octupole moments can be exhibited by an in-plane electric current and lead to accumulation of staggered spin densities at the corners of a rectangular-shaped sample. A current carrying the octupole moments can further be induced through nonlinear response. Our work paves the way to systematically searching for and utilizing quasiparticles with higher-order magnetic multipole moments in crystal materials.


title: Proceedings of the ACII Affective Vocal Bursts Workshop and Competition 2022 (A-VB): Understanding a critically understudied modality of emotional expression

abstract: This is the Proceedings of the ACII Affective Vocal Bursts Workshop and Competition (A-VB). A-VB was a workshop-based challenge that introduces the problem of understanding emotional expression in vocal bursts -- a wide range of non-verbal vocalizations that includes laughs, grunts, gasps, and much more. With affective states informing both mental and physical wellbeing, the core focus of the A-VB workshop was the broader discussion of current strategies in affective computing for modeling vocal emotional expression. Within this first iteration of the A-VB challenge, the participants were presented with four emotion-focused sub-challenges that utilize the large-scale and `in-the-wild' Hume-VB dataset. The dataset and the four sub-challenges draw attention to new innovations in emotion science as it pertains to vocal expression, addressing low- and high-dimensional theories of emotional expression, cultural variation, and `call types' (laugh, cry, sigh, etc.).


title: Confident Approximate Policy Iteration for Efficient Local Planning in $q^\pi$-realizable MDPs

abstract: We consider approximate dynamic programming in $\gamma$-discounted Markov decision processes and apply it to approximate planning with linear value-function approximation. Our first contribution is a new variant of Approximate Policy Iteration (API), called Confident Approximate Policy Iteration (CAPI), which computes a deterministic stationary policy with an optimal error bound scaling linearly with the product of the effective horizon $H$ and the worst-case approximation error $\epsilon$ of the action-value functions of stationary policies. This improvement over API (whose error scales with $H^2$) comes at the price of an $H$-fold increase in memory cost. Unlike Scherrer and Lesner [2012], who recommended computing a non-stationary policy to achieve a similar improvement (with the same memory overhead), we are able to stick to stationary policies. This allows for our second contribution, the application of CAPI to planning with local access to a simulator and $d$-dimensional linear function approximation. As such, we design a planning algorithm that applies CAPI to obtain a sequence of policies with successively refined accuracies on a dynamically evolving set of states. The algorithm outputs an $\tilde O(\sqrt{d}H\epsilon)$-optimal policy after issuing $\tilde O(dH^4/\epsilon^2)$ queries to the simulator, simultaneously achieving the optimal accuracy bound and the best known query complexity bound, while earlier algorithms in the literature achieve only one of them. This query complexity is shown to be tight in all parameters except $H$. These improvements come at the expense of a mild (polynomial) increase in memory and computational costs of both the algorithm and its output policy.


title: Scaling up Superconducting Quantum Computers with Cryogenic RF-photonics

abstract: Today's hundred-qubit quantum computers require a dramatic scale up to millions of qubits to become practical for solving real-world problems. Although a variety of qubit technologies have been demonstrated, scalability remains a major hurdle. Superconducting (SC) qubits are one of the most mature and promising technologies to overcome this challenge. However, these qubits reside in a millikelvin cryogenic dilution fridge, isolating them from thermal and electrical noise. They are controlled by a rack-full of external electronics through extremely complex wiring and cables. Although thousands of qubits can be fabricated on a single chip and cooled down to millikelvin temperatures, scaling up the control and readout electronics remains an elusive goal. This is mainly due to the limited available cooling power in cryogenic systems constraining the wiring capacity and cabling heat load management. In this paper, we focus on scaling up the number of XY-control lines by using cryogenic RF-photonic links. This is one of the major roadblocks to build a thousand qubit superconducting QC. We will first review and study the challenges of state-of-the-art proposed approaches, including cryogenic CMOS and deep-cryogenic photonic methods, to scale up the control interface for SC qubit systems. We will discuss their limitations due to the active power dissipation and passive heat leakage in detail. By analytically modeling the noise sources and thermal budget limits, we will show that our solution can achieve a scale up to a thousand of qubits. Our proposed method can be seamlessly implemented using advanced silicon photonic processes, and the number of required optical fibers can be further reduced by using wavelength division multiplexing (WDM).


title: A general method for multiresolutional analysis of mesoscale features in dark-field x-ray microscopy images

abstract: Dark-field x-ray microscopy utilizes Bragg diffraction to collect full-field x-ray images of "mesoscale" structure of ordered materials. Information regarding the structural heterogeneities and their physical implications is gleaned through the quantitative analyses of these images. Namely, one must be able to extract diffraction features that arise from lattice modulations or inhomogeneities, quantify said features, and identify and track patterns in the relevant quantitative properties in subsequent images. Due to the necessity to track features with a wide array of shapes and length scales while maintaining spatial resolution, wavelet transforms were chosen as a potent signal analysis tool. In addition to addressing multiple length scales, this method can be used in conjunction with other signal processing methods such as image binarization for increased functionality. In this article, we demonstrate three effective use of wavelet analyses pertaining to DFXM. We show how to extract and track smooth linear features-which are diffraction manifestations of twin boundaries-as the sample orientation changes as it is rotated about momentum transfer. Secondly, we show that even the simplest wavelet transform, the Haar transform, can be used to capture the primary features in DFXM images, over a range of length scales in different regions of interest within a single image enabling localized reconstruction. As a final application, we extend these techniques to determine when a DFXM image is in focus.


title: Suppression of electroconvection due to van der Waals attraction of polymer additives towards the metal electrode

abstract: Electroconvection in rechargeable batteries enhances the growth of dendrites at the electrode surface. The addition of low molecular weight polymers to the electrolyte in batteries results in the formation of a thin layer of higher polymer concentration near the electrode. This is due to van der Waals forces of attraction between the metal electrode and the polymers dissolved in the electrolyte. The van der Waals forces act as a restoring body force on the electrolyte and oppose the growth of perturbations. Using linear stability analysis, we show that this force opposes electroconvective flow. This increases the critical voltage required for the onset of electroconvection.


title: Self-supervised language learning from raw audio: Lessons from the Zero Resource Speech Challenge

abstract: Recent progress in self-supervised or unsupervised machine learning has opened the possibility of building a full speech processing system from raw audio without using any textual representations or expert labels such as phonemes, dictionaries or parse trees. The contribution of the Zero Resource Speech Challenge series since 2015 has been to break down this long-term objective into four well-defined tasks -- Acoustic Unit Discovery, Spoken Term Discovery, Discrete Resynthesis, and Spoken Language Modeling -- and introduce associated metrics and benchmarks enabling model comparison and cumulative progress. We present an overview of the six editions of this challenge series since 2015, discuss the lessons learned, and outline the areas which need more work or give puzzling results.


title: Towards Improving Workers' Safety and Progress Monitoring of Construction Sites Through Construction Site Understanding

abstract: An important component of computer vision research is object detection. In recent years, there has been tremendous progress in the study of construction site images. However, there are obvious problems in construction object detection, including complex backgrounds, varying-sized objects, and poor imaging quality. In the state-of-the-art approaches, elaborate attention mechanisms are developed to handle space-time features, but rarely address the importance of channel-wise feature adjustments. We propose a lightweight Optimized Positioning (OP) module to improve channel relation based on global feature affinity association, which can be used to determine the Optimized weights adaptively for each channel. OP first computes the intermediate optimized position by comparing each channel with the remaining channels for a given set of feature maps. A weighted aggregation of all the channels will then be used to represent each channel. The OP-Net module is a general deep neural network module that can be plugged into any deep neural network. Algorithms that utilize deep learning have demonstrated their ability to identify a wide range of objects from images nearly in real time. Machine intelligence can potentially benefit the construction industry by automatically analyzing productivity and monitoring safety using algorithms that are linked to construction images. The benefits of on-site automatic monitoring are immense when it comes to hazard prevention. Construction monitoring tasks can also be automated once construction objects have been correctly recognized. Object detection task in construction site images is experimented with extensively to demonstrate its efficacy and effectiveness. A benchmark test using SODA demonstrated that our OP-Net was capable of achieving new state-of-the-art performance in accuracy while maintaining a reasonable computational overhead.


title: On character sums with determinants

abstract: We estimate weighted character sums with determinants $ad-bc $ of $2\times 2$ matrices modulo a prime $p$ with entries $a,b,c,d $ varying over the interval $ [1,N]$. Our goal is to obtain nontrivial bounds for values of $N$ as small as possible. In particular, we achieve this goal, with a power saving, for $N \ge p^{1/8+\varepsilon}\ $ with any fixed $\varepsilon>0$, which is very likely to be the best possible unless the celebrated Burgess bound is improved. By other techniques, we also treat more general sums but sometimes for larger values of $N$.


title: Nearest Neighbor Language Models for Stylistic Controllable Generation

abstract: Recent language modeling performance has been greatly improved by the use of external memory. This memory encodes the context so that similar contexts can be recalled during decoding. This similarity depends on how the model learns to encode context, which can be altered to include other attributes, such as style. We construct and evaluate an architecture for this purpose, using corpora annotated for politeness, formality, and toxicity. Through extensive experiments and human evaluation we demonstrate the potential of our method to generate text while controlling style. We find that style-specific datastores improve generation performance, though results vary greatly across styles, and the effect of pretraining data and specific styles should be explored in future work.


title: Bootstrapped Block Lanczos for large-dimension eigenvalue problems

abstract: The Lanczos algorithm has proven itself to be a valuable matrix eigensolver for problems with large dimensions, up to hundreds of millions or even tens of billions. The computational cost of using any Lanczos algorithm is dominated by the number of sparse matrix-vector multiplications until suitable convergence is reached. Block Lanczos replaces sparse matrix-vector multiplication with sparse matrix-matrix multiplication, which is more efficient, but for a randomly chosen starting block (or pivot), more multiplications are required to reach convergence. We find that a bootstrapped pivot block, that is, an initial block constructed from approximate eigenvectors computed in a truncated space, leads to a dramatically reduced number of multiplications, significantly outperforming both standard vector Lanczos and block Lanczos with a random pivot. A key condition for speed-up is that the pivot block have a non-trivial overlap with the final converged vectors. We implement this approach in a configuration-interaction code for nuclear structure, and find a reduction in time-to-solution by a factor of two or more, up to a factor of ten.


title: Noise Injection Node Regularization for Robust Learning

abstract: We introduce Noise Injection Node Regularization (NINR), a method of injecting structured noise into Deep Neural Networks (DNN) during the training stage, resulting in an emergent regularizing effect. We present theoretical and empirical evidence for substantial improvement in robustness against various test data perturbations for feed-forward DNNs when trained under NINR. The novelty in our approach comes from the interplay of adaptive noise injection and initialization conditions such that noise is the dominant driver of dynamics at the start of training. As it simply requires the addition of external nodes without altering the existing network structure or optimization algorithms, this method can be easily incorporated into many standard problem specifications. We find improved stability against a number of data perturbations, including domain shifts, with the most dramatic improvement obtained for unstructured noise, where our technique outperforms other existing methods such as Dropout or $L_2$ regularization, in some cases. We further show that desirable generalization properties on clean data are generally maintained.

categories: cs.LG cond-mat.dis-nn cond-mat.stat-mech cs.AI stat.ML


title: An Adversarial Active Sampling-based Data Augmentation Framework for Manufacturable Chip Design

abstract: Lithography modeling is a crucial problem in chip design to ensure a chip design mask is manufacturable. It requires rigorous simulations of optical and chemical models that are computationally expensive. Recent developments in machine learning have provided alternative solutions in replacing the time-consuming lithography simulations with deep neural networks. However, the considerable accuracy drop still impedes its industrial adoption. Most importantly, the quality and quantity of the training dataset directly affect the model performance. To tackle this problem, we propose a litho-aware data augmentation (LADA) framework to resolve the dilemma of limited data and improve the machine learning model performance. First, we pretrain the neural networks for lithography modeling and a gradient-friendly StyleGAN2 generator. We then perform adversarial active sampling to generate informative and synthetic in-distribution mask designs. These synthetic mask images will augment the original limited training dataset used to finetune the lithography model for improved performance. Experimental results demonstrate that LADA can successfully exploits the neural network capacity by narrowing down the performance gap between the training and testing data instances.


title: Enhancements in cloud condensation nuclei concentrations from turbulent fluctuations in supersaturation

abstract: The effect of aerosol emissions on the properties and distribution of clouds is a large source of uncertainty in predictions of weather and climate. These aerosol-cloud interactions depend critically on the ability of aerosol particles to activate into cloud condensation nuclei (CCN). A key challenge in modeling CCN activation and the formation of cloud droplets is the representation of interactions between turbulence and cloud microphysics. Turbulent mixing leads to small-scale fluctuations of water vapor and temperature that are not resolved in large-scale atmospheric models. We used Lagrangian parcel simulations driven by a high-resolution Large Eddy Simulation of a convective cloud chamber to quantify the impact of these small-scale fluctuations on CCN activation. We show that small-scale fluctuations in environmental properties strongly enhance CCN activation, which suggests that conventional Large Eddy Simulations and Earth System Models that neglect these fluctuations underestimate cloud droplet formation.


title: Gathering Strength, Gathering Storms: The One Hundred Year Study on Artificial Intelligence (AI100) 2021 Study Panel Report

abstract: In September 2021, the "One Hundred Year Study on Artificial Intelligence" project (AI100) issued the second report of its planned long-term periodic assessment of artificial intelligence (AI) and its impact on society. It was written by a panel of 17 study authors, each of whom is deeply rooted in AI research, chaired by Michael Littman of Brown University. The report, entitled "Gathering Strength, Gathering Storms," answers a set of 14 questions probing critical areas of AI development addressing the major risks and dangers of AI, its effects on society, its public perception and the future of the field. The report concludes that AI has made a major leap from the lab to people's lives in recent years, which increases the urgency to understand its potential negative effects. The questions were developed by the AI100 Standing Committee, chaired by Peter Stone of the University of Texas at Austin, consisting of a group of AI leaders with expertise in computer science, sociology, ethics, economics, and other disciplines.


title: Density and infrared band strength of interstellar carbon monoxide (CO) ice analogues

abstract: The motivation to study experimentally CO ice under mimicked interstellar conditions is supported by the large CO gas abundances and ubiquitous presence of CO in icy grain mantles. Upon irradiation in its pure ice form, this highly stable species presents a limited ion and photon-induced chemistry, and an efficient non-thermal desorption. Using infrared spectroscopy, single laser interference, and quadrupole mass spectrometry during CO ice deposition, the CO ice density was estimated as a function of deposition temperature. Only minor variations in the density were found. The proposed methodology can be used to obtain the density of other ice components at various deposition temperatures provided that this value of the density is known for one of these temperatures, which is typically the temperature corresponding to the crystalline form. The apparent tendency of the CO ice density to decrease at deposition temperatures below 14 K is in line with recently published colorimetric measurements. This work allowed to revisit the value of the infrared band strength needed for calculation of the CO ice column density in infrared observations, $8.7 \times 10^{-18} ~ {\rm cm ~ molecule}^{-1}$ at 20 K deposition temperature.


title: Fully-attentive and interpretable: vision and video vision transformers for pain detection

abstract: Pain is a serious and costly issue globally, but to be treated, it must first be detected. Vision transformers are a top-performing architecture in computer vision, with little research on their use for pain detection. In this paper, we propose the first fully-attentive automated pain detection pipeline that achieves state-of-the-art performance on binary pain detection from facial expressions. The model is trained on the UNBC-McMaster dataset, after faces are 3D-registered and rotated to the canonical frontal view. In our experiments we identify important areas of the hyperparameter space and their interaction with vision and video vision transformers, obtaining 3 noteworthy models. We analyse the attention maps of one of our models, finding reasonable interpretations for its predictions. We also evaluate Mixup, an augmentation technique, and Sharpness-Aware Minimization, an optimizer, with no success. Our presented models, ViT-1 (F1 score 0.55 +- 0.15), ViViT-1 (F1 score 0.55 +- 0.13), and ViViT-2 (F1 score 0.49 +- 0.04), all outperform earlier works, showing the potential of vision transformers for pain detection. Code is available at https://github.com/IPDTFE/ViT-McMaster


title: Open-Source Numerical Solver for Neutrino Collective Effects -- I: Isotropic Neutrino Gas

abstract: In this paper, we introduce a new open-source code to find numerical solutions for the neutrino evolution considering neutrino-neutrino interactions, which result in the so-called collective effects. We first describe the theoretical background of this type of evolution, explaining the polarization vector formalism in which we implement our numerical code. We then show the results for different neutrino systems. In this first paper, we focus on the case of an isotropic neutrino gas, exploring a mono-energetic scenario and one with a spectral distribution. The resulting code of this work is available at https://github.com/pedrodedin/Neutrino-Collective-Effects.


title: Second to first order phase transition; coevolutionary versus structural balance

abstract: In social networks, the balance theory has been studied by considering either the triple interactions between the links (structural balance) or the triple interaction of nodes and links (coevolutionary balance). In the structural balance theory, the links are not independent from each other, implying a global effect of this term and it leads to a discontinuous phase transition in the system's balanced states as a function of temperature. However, in the coevolutionary balance the links only connect two local nodes and a continuous phase transition emerges. In this paper, we consider a combination of both in order to understand which of these types of interactions will identify the stability of the network. We are interested to see how adjusting the robustness of each term versus the other might affect the system to reach a balanced state. We use statistical mechanics methods and the mean field theory and also the Monte-Carlo numerical simulations to investigate the behaviour of the order parameters and the total energy of the system. We find the phase diagram of the system which demonstrates the competition of these two terms at different ratios against each other and different temperatures. The system shows a tricritical point above which the phase transition switches from continuous to discrete. Also the superiority of the local perspective is observed at low temperatures and the global view will be the dominant term in determining the stability of the system at higher temperatures.


title: Adiabatic sweep theorem for three-dimensional dipolar Bose gases

abstract: The variational theorem for the scattering length in the presence of the dipole-dipole interaction is developed. The theorem is applied to the spinless dipolar Bose gas in three dimensions. We calculated analytically the long-range tails of the single-particle momentum distribution and static structure factor, and the pair distribution function at short distances. The momentum distribution is inversely proportional to $q^4$ with the anisotropic prefactor. In the absence of the dipole-dipole interaction, Tan's adiabatic sweep theorem is reproduced as a particular case. For the homogeneous dilute Bose gas, all the relations are calculated analytically.


title: Data-Driven Thermal Anomaly Detection in Large Battery Packs

abstract: The early detection and tracing of anomalous operations in battery packs are critical to improving performance and ensuring safety. This paper presents a data-driven approach for online anomaly detection in battery packs that uses real-time voltage and temperature data from multiple Li-ion battery cells. Mean-based residuals are generated for cell groups and evaluated using Principal Component Analysis. The evaluated residuals are then thresholded using a cumulative sum control chart to detect anomalies. The mild external short circuits associated with cell balancing are detected in the voltage signals and necessitate voltage retraining after balancing. Temperature residuals prove to be critical, enabling anomaly detection of module balancing events within 14 min that are unobservable from the voltage residuals. Statistical testing of the proposed approach is performed on the experimental data from a battery electric locomotive injected with model-based anomalies. The proposed anomaly detection approach has a low false-positive rate and accurately detects and traces the synthetic voltage and temperature anomalies. The performance of the proposed approach compared with direct thresholding of mean-based residuals shows a 56% faster detection time, 42% fewer false negatives, and 60% fewer missed anomalies while maintaining a comparable false-positive rate.


title: Sharp log-Sobolev inequalities in ${\sf CD}(0,N)$ spaces with applications

abstract: Given $p,N>1,$ we prove the sharp $L^p$-log-Sobolev inequality on noncompact metric measure spaces satisfying the ${\sf CD}(0,N)$ condition, where the optimal constant involves the asymptotic volume ratio of the space. This proof is based on a sharp isoperimetric inequality in ${\sf CD}(0,N)$ spaces, symmetrisation, and a careful scaling argument. As an application we establish a sharp hypercontractivity estimate for the Hopf-Lax semigroup in ${\sf CD}(0,N)$ spaces. The proof of this result uses Hamilton-Jacobi inequality and Sobolev regularity properties of the Hopf-Lax semigroup, which turn out to be essential in the present setting of nonsmooth and noncompact spaces. Furthermore, a sharp Gaussian-type $L^2$-log-Sobolev inequality is also obtained in ${\sf RCD}(0,N)$ spaces. Our results are new, even in the smooth setting of Riemannian/Finsler manifolds. In particular, an extension of the celebrated rigidity result of Ni (J. Geom. Anal., 2004) on Riemannian manifolds will be a simple consequence of our sharp log-Sobolev inequality.


title: Evaluating context-invariance in unsupervised speech representations

abstract: Unsupervised speech representations have taken off, with benchmarks (SUPERB, ZeroSpeech) demonstrating major progress on semi-supervised speech recognition, speech synthesis, and speech-only language modelling. Inspiration comes from the promise of ``discovering the phonemes'' of a language or a similar low-bitrate encoding. However, one of the critical properties of phoneme transcriptions is context-invariance: the phonetic context of a speech sound can have massive influence on the way it is pronounced, while the text remains stable. This is what allows tokens of the same word to have the same transcriptions -- key to language understanding. Current benchmarks do not measure context-invariance. We develop a new version of the ZeroSpeech ABX benchmark that measures context-invariance, and apply it to recent self-supervised representations. We demonstrate that the context-independence of representations is predictive of the stability of word-level representations. We suggest research concentrate on improving context-independence of self-supervised and unsupervised representations.


title: The Unequal Incidence of Payroll Taxes with Imperfect Competition: Theory and Evidence

abstract: This paper provides a comprehensive examination of a Brazilian corporate tax reform targeted at the sector and product level. Difference-in-differences estimates instrumented by sector eligibility show that a 20 percentage point cut on payroll tax rates caused a 9% employment increase at the firm level, mostly driven by small firms. This expansion is not driven by formalization of existing workers, and it is explained by reduction on separations rather than additional hires. In terms of earnings, there is a significant 4% earnings increase in the long run, which is concentrated at leadership positions. The unequal pass-through worsen within-firm wage inequality. I exploit the exogenous variation on labor cost to document substantial labor market power in Brazil, where wages are marked down by 36%. Consistent with the empirical findings, I develop a model of factor demand with imperfect competition in the goods and labor market to shed light on the mechanism through which imperfect competition drives corporate tax incidence. The model is identified by the reduced form elasticities, and allows me to structurally estimate the capital-labor elasticity of substitution, which differs from the benchmark case of perfect competition.