title: The HIBEAM program: search for neutron oscillations at the ESS

abstract: With the construction of the European Spallation Source, a remarkable opportunity has emerged to conduct high sensitivity searches for neutron oscillations, including a first search for thirty years for free neutrons converting to antineutrons. Furthermore, searches can be made for transitions of neutrons and antineutrons to sterile neutron states. Upgrades to the ESS infrastructure allow an improved HIBEAM design that would provide an increase in sensitivity by an order of magnitude compared to previous work. The HIBEAM program focuses on processes that violate baryon number by one or two units. The observation of a process satisfying one of the Sakharov conditions addresses the open question of the origin of the matter-antimatter asymmetry in the Universe. Sterile neutron states would belong to a `dark' sector of particles which may explain dark matter. As electrically neutral, meta-stable objects that can be copiously produced and studied, neutrons represent an attractive portal to a `dark' sector. The HIBEAM instrument can also be utilised for other purposes such as direct searches for ultralight axion dark matter. This paper describes the capability, design, infrastructure, and potential of the HIBEAM program. This includes a dedicated beamline, neutron optical system, magnetic shielding and control, and detectors for neutrons and antineutrons.


title: Supergranule aggregation: a Prandtl number-independent feature of constant heat flux-driven convection flows

abstract: Supergranule aggregation, i.e., the gradual aggregation of convection cells to horizontally extended networks of flow structures, is a unique feature of constant heat flux-driven turbulent convection. In the present study, we address the question if this mechanism of self-organisation of the flow is present for any fluid. Therefore, we analyse three-dimensional Rayleigh-B\'enard convection at a fixed Rayleigh number $\textrm{Ra} \approx 2.0 \times 10^{5}$ across $4$ orders of Prandtl numbers $\Pr \in \left[ 10^{-2}, 10^{2} \right]$ by means of direct numerical simulations in horizontally extended periodic domains with aspect ratio $\Gamma = 60$. Our study confirms the omnipresence of the mechanism of supergranule aggregation for the entire range of investigated fluids. Moreover, we analyse the effect of $\Pr$ on the global heat and momentum transport, and clarify the role of a potential stable stratification in the bulk of the fluid layer. The ubiquity of the investigated mechanism of flow self-organisation underlines its relevance for pattern formation in geophysical and astrophysical convection flows, the latter of which are often driven by prescribed heat fluxes.


title: A PRISMA-driven systematic mapping study on system assurance weakeners

abstract: Context: An assurance case is a structured hierarchy of claims aiming at demonstrating that a given mission-critical system supports specific requirements (e.g., safety, security, privacy). The presence of assurance weakeners (i.e., assurance deficits, logical fallacies) in assurance cases reflects insufficient evidence, knowledge, or gaps in reasoning. These weakeners can undermine confidence in assurance arguments, potentially hindering the verification of mission-critical system capabilities. Objectives: As a stepping stone for future research on assurance weakeners, we aim to initiate the first comprehensive systematic mapping study on this subject. Methods: We followed the well-established PRISMA 2020 and SEGRESS guidelines to conduct our systematic mapping study. We searched for primary studies in five digital libraries and focused on the 2012-2023 publication year range. Our selection criteria focused on studies addressing assurance weakeners at the modeling level, resulting in the inclusion of 39 primary studies in our systematic review. Results: Our systematic mapping study reports a taxonomy (map) that provides a uniform categorization of assurance weakeners and approaches proposed to manage them at the modeling level. Conclusion: Our study findings suggest that the SACM (Structured Assurance Case Metamodel) -- a standard specified by the OMG (Object Management Group) -- may be the best specification to capture structured arguments and reason about their potential assurance weakeners.


title: KTRL+F: Knowledge-Augmented In-Document Search

abstract: We introduce a new problem KTRL+F, a knowledge-augmented in-document search task that necessitates real-time identification of all semantic targets within a document with the awareness of external sources through a single natural query. KTRL+F addresses following unique challenges for in-document search: 1)utilizing knowledge outside the document for extended use of additional information about targets, and 2) balancing between real-time applicability with the performance. We analyze various baselines in KTRL+F and find limitations of existing models, such as hallucinations, high latency, or difficulties in leveraging external knowledge. Therefore, we propose a Knowledge-Augmented Phrase Retrieval model that shows a promising balance between speed and performance by simply augmenting external knowledge in phrase embedding. We also conduct a user study to verify whether solving KTRL+F can enhance search experience for users. It demonstrates that even with our simple model, users can reduce the time for searching with less queries and reduced extra visits to other sources for collecting evidence. We encourage the research community to work on KTRL+F to enhance more efficient in-document information access.


title: Generative De-Quantization for Neural Speech Codec via Latent Diffusion

abstract: In low-bitrate speech coding, end-to-end speech coding networks aim to learn compact yet expressive features and a powerful decoder in a single network. A challenging problem as such results in unwelcome complexity increase and inferior speech quality. In this paper, we propose to separate the representation learning and information reconstruction tasks. We leverage an end-to-end codec for learning low-dimensional discrete tokens and employ a latent diffusion model to de-quantize coded features into a high-dimensional continuous space, relieving the decoder's burden of de-quantizing and upsampling. To mitigate the issue of over-smooth generation, we introduce midway-infilling with less noise reduction and stronger conditioning. In ablation studies, we investigate the hyperparameters for midway-infilling and latent diffusion space with different dimensions. Subjective listening tests show that our model outperforms the state-of-the-art at two low bitrates, 1.5 and 3 kbps. Codes and samples of this work are available on our webpage.


title: Radio Galaxy Zoo: Leveraging latent space representations from variational autoencoder

abstract: We propose to learn latent space representations of radio galaxies, and train a very deep variational autoencoder (\protect\Verb+VDVAE+) on RGZ DR1, an unlabeled dataset, to this end. We show that the encoded features can be leveraged for downstream tasks such as classifying galaxies in labeled datasets, and similarity search. Results show that the model is able to reconstruct its given inputs, capturing the salient features of the latter. We use the latent codes of galaxy images, from MiraBest Confident and FR-DEEP NVSS datasets, to train various non-neural network classifiers. It is found that the latter can differentiate FRI from FRII galaxies achieving \textit{accuracy} $\ge 76\%$, \textit{roc-auc} $\ge 0.86$, \textit{specificity} $\ge 0.73$ and \textit{recall} $\ge 0.78$ on MiraBest Confident dataset, comparable to results obtained in previous studies. The performance of simple classifiers trained on FR-DEEP NVSS data representations is on par with that of a deep learning classifier (CNN based) trained on images in previous work, highlighting how powerful the compressed information is. We successfully exploit the learned representations to search for galaxies in a dataset that are semantically similar to a query image belonging to a different dataset. Although generating new galaxy images (e.g. for data augmentation) is not our primary objective, we find that the \protect\Verb+VDVAE+ model is a relatively good emulator. Finally, as a step toward detecting anomaly/novelty, a density estimator -- Masked Autoregressive Flow (\protect\Verb+MAF+) -- is trained on the latent codes, such that the log-likelihood of data can be estimated. The downstream tasks conducted in this work demonstrate the meaningfulness of the latent codes.


title: Graph Curve Matroids

abstract: We introduce a new class of matroids, called graph curve matroids. A graph curve matroid is associated to a graph and defined on the vertices of the graph as a ground set. We prove that these matroids provide a combinatorial description of hyperplane sections of degenerate canonical curves in algebraic geometry. Our focus lies on graphs that are 2-connected and trivalent, which define identically self-dual graph curve matroids, but we also develop generalizations. Finally, we provide an algorithm to compute the graph curve matroid associated to a given graph, as well as an implementation and data of examples that can be used in Macaulay2.


title: Calibration of an Elastic Humanoid Upper Body and Efficient Compensation for Motion Planning

abstract: High absolute accuracy is an essential prerequisite for a humanoid robot to autonomously and robustly perform manipulation tasks while avoiding obstacles. We present for the first time a kinematic model for a humanoid upper body incorporating joint and transversal elasticities. These elasticities lead to significant deformations due to the robot's own weight, and the resulting model is implicitly defined via a torque equilibrium. We successfully calibrate this model for DLR's humanoid Agile Justin, including all Denavit-Hartenberg parameters and elasticities. The calibration is formulated as a combined least-squares problem with priors and based on measurements of the end effector positions of both arms via an external tracking system. The absolute position error is massively reduced from 21mm to 3.1mm on average in the whole workspace. Using this complex and implicit kinematic model in motion planning is challenging. We show that for optimization-based path planning, integrating the iterative solution of the implicit model into the optimization loop leads to an elegant and highly efficient solution. For mildly elastic robots like Agile Justin, there is no performance impact, and even for a simulated highly flexible robot with 20 times higher elasticities, the runtime increases by only 30%.


title: Eruptive novae in symbiotic systems

abstract: We conduct numerical simulations of multiple nova eruptions in detached, widely separated symbiotic systems that include an asymptotic giant branch (AGB) companion to investigate the impact of white dwarf (WD) mass and binary separation on the evolution of the system. The accretion rate is determined using the Bondi-Hoyle-Lyttleton method, incorporating orbital momentum loss caused by factors such as gravitational radiation, magnetic braking, and drag. The WD in such a system accretes matter coming from the strong wind of an AGB companion until it finishes shedding its envelope. This occurs on an evolutionary time scale of $\approx 3 \times 10^5$ years. Throughout all simulations, we use a consistent AGB model with an initial mass of $1.0 \mathrm {M_\odot}$ while varying the WD mass and binary separation, as they are the critical factors influencing nova eruption behavior. We find that the accretion rate fluctuates between high and low rates during the evolutionary period, significantly impacted by the AGB's mass loss rate. We show that unlike novae in cataclysmic variables, the orbital period may either increase or decrease during evolution, depending on the model, while the separation consistently decreases. Furthermore, we have identified cases in which the WDs produce weak, non-ejective novae and experience mass gain. This suggests that provided the accretion efficiency can be achieved by a more massive WD and maintained for long enough, they could potentially serve as progenitors for type Ia supernovae.


title: Distinguishing immunological and behavioral effects of vaccination

abstract: The interpretation of vaccine efficacy estimands is subtle, even in randomized trials designed to quantify immunological effects of vaccination. In this article, we introduce terminology to distinguish between different vaccine efficacy estimands and clarify their interpretations. This allows us to explicitly consider immunological and behavioural effects of vaccination, and establish that policy-relevant estimands can differ substantially from those commonly reported in vaccine trials. We further show that a conventional vaccine trial allows identification and estimation of different vaccine estimands under plausible conditions, if one additional post-treatment variable is measured. Specifically, we utilize a ``belief variable'' that indicates the treatment an individual believed they had received. The belief variable is similar to ``blinding assessment'' variables that are occasionally collected in placebo-controlled trials in other fields. We illustrate the relations between the different estimands, and their practical relevance, in numerical examples based on an influenza vaccine trial.


title: Exploring Variational Auto-Encoder Architectures, Configurations, and Datasets for Generative Music Explainable AI

abstract: Generative AI models for music and the arts in general are increasingly complex and hard to understand. The field of eXplainable AI (XAI) seeks to make complex and opaque AI models such as neural networks more understandable to people. One approach to making generative AI models more understandable is to impose a small number of semantically meaningful attributes on generative AI models. This paper contributes a systematic examination of the impact that different combinations of Variational Auto-Encoder models (MeasureVAE and AdversarialVAE), configurations of latent space in the AI model (from 4 to 256 latent dimensions), and training datasets (Irish folk, Turkish folk, Classical, and pop) have on music generation performance when 2 or 4 meaningful musical attributes are imposed on the generative model. To date there have been no systematic comparisons of such models at this level of combinatorial detail. Our findings show that MeasureVAE has better reconstruction performance than AdversarialVAE which has better musical attribute independence. Results demonstrate that MeasureVAE was able to generate music across music genres with interpretable musical dimensions of control, and performs best with low complexity music such a pop and rock. We recommend that a 32 or 64 latent dimensional space is optimal for 4 regularised dimensions when using MeasureVAE to generate music across genres. Our results are the first detailed comparisons of configurations of state-of-the-art generative AI models for music and can be used to help select and configure AI models, musical features, and datasets for more understandable generation of music.


title: Comparison of model selection techniques for seafloor scattering statistics

abstract: In quantitative analysis of seafloor imagery, it is common to model the collection of individual pixel intensities scattered by the seafloor as a random variable with a given statistical distribution. There is a considerable literature on statistical models for seafloor scattering, mostly focused on areas with statistically homogeneous properties (i.e. exhibiting spatial stationarity). For more complex seafloors, the pixel intensity distribution is more appropriately modeled using a mixture of simple distributions. For very complex seafloors, fitting 3 or more mixture components makes physical sense, but the statistical model becomes much more complex in these cases. Therefore, picking the number of components of the mixture model is a decision that must be made, using a priori information, or using a data driven approach. However, this information is time consuming to collect, and depends on the skill and experience of the human. Therefore, a data-driven approach is advantageous to use, and is explored in this work. Criteria for choosing a model always need to balance the trade-off for the best fit for the data on the one hand and the model complexity on the other hand. In this work, we compare several statistical model selection criteria, e.g., the Bayesian information criterion. Examples are given for SAS data collected by an autonomous underwater vehicle in a rocky environment off the coast of Bergen, Norway using data from the HISAS-1032 synthetic aperture sonar system.


title: Self-Contained Calibration of an Elastic Humanoid Upper Body Using Only a Head-Mounted RGB Camera

abstract: When a humanoid robot performs a manipulation task, it first makes a model of the world using its visual sensors and then plans the motion of its body in this model. For this, precise calibration of the camera parameters and the kinematic tree is needed. Besides the accuracy of the calibrated model, the calibration process should be fast and self-contained, i.e., no external measurement equipment should be used. Therefore, we extend our prior work on calibrating the elastic upper body of DLR's Agile Justin by now using only its internal head-mounted RGB camera. We use simple visual markers at the ends of the kinematic chain and one in front of the robot, mounted on a pole, to get measurements for the whole kinematic tree. To ensure that the task-relevant cartesian error at the end-effectors is minimized, we introduce virtual noise to fit our imperfect robot model so that the pixel error has a higher weight if the marker is further away from the camera. This correction reduces the cartesian error by more than 20%, resulting in a final accuracy of 3.9mm on average and 9.1mm in the worst case. This way, we achieve the same precision as in our previous work, where an external cartesian tracking system was used.


title: Undesignable RNA Structure Identification via Rival Structure Generation and Structure Decomposition

abstract: RNA design is the search for a sequence or set of sequences that will fold into predefined structures, also known as the inverse problem of RNA folding. While numerous RNA design methods have been invented to find sequences capable of folding into a target structure, little attention has been given to the identification of undesignable structures according to the minimum free energy (MFE) criterion under the Turner model. In this paper, we address this gap by first introducing mathematical theorems outlining sufficient conditions for recognizing undesignable structures, then proposing efficient algorithms, guided by these theorems, to verify the undesignability of RNA structures. Through the application of these theorems and algorithms to the Eterna100 puzzles, we demonstrate the ability to efficiently establish that 15 of the puzzles indeed fall within the category of undesignable structures. In addition, we provide specific insights from the study of undesignability, in the hope that it will enable more understanding of RNA folding and RNA design.


title: Causal Message Passing: A Method for Experiments with Unknown and General Network Interference

abstract: Randomized experiments are a powerful methodology for data-driven evaluation of decisions or interventions. Yet, their validity may be undermined by network interference. This occurs when the treatment of one unit impacts not only its outcome but also that of connected units, biasing traditional treatment effect estimations. Our study introduces a new framework to accommodate complex and unknown network interference, moving beyond specialized models in the existing literature. Our framework, termed causal message-passing, is grounded in high-dimensional approximate message passing methodology. It is tailored for multi-period experiments and is particularly effective in settings with many units and prevalent network interference. The framework models causal effects as a dynamic process where a treated unit's impact propagates through the network via neighboring units until equilibrium is reached. This approach allows us to approximate the dynamics of potential outcomes over time, enabling the extraction of valuable information before treatment effects reach equilibrium. Utilizing causal message-passing, we introduce a practical algorithm to estimate the total treatment effect, defined as the impact observed when all units are treated compared to the scenario where no unit receives treatment. We demonstrate the effectiveness of this approach across five numerical scenarios, each characterized by a distinct interference structure.


title: A fractional matter sector for general relativity

abstract: In this work, we construct a fractional matter sector for general relativity. In particular, we propose a suitable fractional anisotropy function relating both the tangential and radial pressure of a spherically symmetric fluid based on the Gr\"unwald-Letnikov fractional derivative. The system is closed by implementing the polytropic equation of state for the radial pressure. We solve the system of integro-differential equations by Euler's method and explore the behavior of the physical quantities, namely, the normalized density energy, the normalized mass function, and the compactness.


title: Sparse Linear Regression with Constraints: A Flexible Entropy-based Framework

abstract: This work presents a new approach to solve the sparse linear regression problem, i.e., to determine a k-sparse vector w in R^d that minimizes the cost ||y - Aw||^2_2. In contrast to the existing methods, our proposed approach splits this k-sparse vector into two parts -- (a) a column stochastic binary matrix V, and (b) a vector x in R^k. Here, the binary matrix V encodes the location of the k non-zero entries in w. Equivalently, it encodes the subset of k columns in the matrix A that map w to y. We demonstrate that this enables modeling several non-trivial application-specific structural constraints on w as constraints on V. The vector x comprises of the actual non-zero values in w. We use Maximum Entropy Principle (MEP) to solve the resulting optimization problem. In particular, we ascribe a probability distribution to the set of all feasible binary matrices V, and iteratively determine this distribution and the vector x such that the associated Shannon entropy gets minimized, and the regression cost attains a pre-specified value. The resulting algorithm employs homotopy from the convex entropy function to the non-convex cost function to avoid poor local minimum. We demonstrate the efficacy and flexibility of our proposed approach in incorporating a variety of practical constraints, that are otherwise difficult to model using the existing benchmark methods.


title: Eigenvalues of random matrices from compact classical groups in Wasserstein metric

abstract: The circular unitary ensemble and its generalizations concern a random matrix from a compact classical group $\mathrm{U}(N)$, $\mathrm{SU}(N)$, $\mathrm{O}(N)$, $\mathrm{SO}(N)$ or $\mathrm{USp}(N)$ distributed according to the Haar measure. The eigenvalues are known to be very evenly distributed on the unit circle. In this paper, we study the distance from the empirical measure of the eigenvalues to uniformity in the quadratic Wasserstein metric $W_2$. After finding the exact value of the expected value and the variance, we deduce a limit law for the square of the Wasserstein distance. We reformulate our results in terms of the $L^2$ average of the number of eigenvalues in circular arcs, and also in terms of the characteristic polynomial of the matrix on the unit circle.


title: Geodesic analysis and steady accretion on a traversable wormhole

abstract: In this work, we analyze the behavior of light and matter as they pass near and through a traversable wormhole. In particular, we study the trajectories of massive and massless particles and the dust accretion around a traversable wormhole previously reported in Eur. Phys. J. C \textbf{82} (2022) no.7, 605. For massive particles, we integrate the trajectory equation for ingoing and outgoing geodesics and classify the orbits of particles scattered by the wormhole in accordance with their asymptotic behavior far from the throat. We represent all the time--like trajectories in an embedding surface where it is shown explicitly the trajectories of i) particles that deviate from the throat and remain in the same universe, ii) particles that traverse the wormhole to another universe, and iii) particles that get trapped in the wormhole in unstable circular orbits. For the massless particles, we numerically integrate the trajectory equation to show the ray-tracing around the wormhole specifying the particles that traverse the wormhole and those that are only deviated by the throat. For the study of accretion, we consider the steady and spherically symmetric accretion of dust. Our results show that the wormhole parameters can significantly affect the behavior of light and matter near the wormhole. Some comparisons with the behavior of matter around black holes are made.


title: Speeding Up Optimization-based Motion Planning through Deep Learning

abstract: Planning collision-free motions for robots with many degrees of freedom is challenging in environments with complex obstacle geometries. Recent work introduced the idea of speeding up the planning by encoding prior experience of successful motion plans in a neural network. However, this "neural motion planning" did not scale to complex robots in unseen 3D environments as needed for real-world applications. Here, we introduce "basis point set", well-known in computer vision, to neural motion planning as a modern compact environment encoding enabling efficient supervised training networks that generalize well over diverse 3D worlds. Combined with a new elaborate training scheme, we reach a planning success rate of 100%. We use the network to predict an educated initial guess for an optimization-based planner (OMP), which quickly converges to a feasible solution, massively outperforming random multi-starts when tested on previously unseen environments. For the DLR humanoid Agile Justin with 19DoF and in challenging obstacle environments, optimal paths can be generated in 200ms using only a single CPU core. We also show a first successful real-world experiment based on a high-resolution world model from an integrated 3D sensor.


title: Modelling two Energetic Storm Particle Events Observed by Solar Orbiter Using the Combined EUHFORIA and iPATH Models

abstract: By coupling the EUropean Heliospheric FORcasting Information Asset (EUHFORIA) and the improved Particle Acceleration and Transport in the Heliosphere (iPATH) model, two energetic storm particle (ESP) events, originating from the same active region (AR 13088) and observed by Solar Orbiter (SolO) on August 31 2022 and September 05 2022, are modelled. While both events originated from the same active region, they exhibited notable differences, including: 1) the August ESP event lasted for 7 hours, while the September event persisted for 16 hours; 2) The time intensity profiles for the September event showed a clear cross-over upstream of the shock where the intensity of higher energy protons exceeds those of lower energy protons, leading to positive (``reverse'') spectral indices prior to the shock passage. For both events, our simulations replicate the observed duration of the shock sheath, depending on the deceleration history of the CME. Imposing different choices of escaping length scale, which is related to the decay of upstream turbulence, the modelled time intensity profiles prior to the shock arrival also agree with observations. In particular, the cross-over of this time profile in the September event is well reproduced. We show that a ``reverse'' upstream spectrum is the result of the interplay between two length scales. One characterizes the decay of upstream shock accelerated particles, which are controlled by the energy-dependent diffusion coefficient, and the other characterizes the decay of upstream turbulence power, which is related to the process of how streaming protons upstream of the shock excite Alfv\'{e}n waves. Simulations taking into account real-time background solar wind, the dynamics of the CME propagation, and upstream turbulence at the shock front are necessary to thoroughly understand the ESP phase of large SEP events.


title: High-efficiency single-photon source above the loss-tolerant threshold for efficient linear optical quantum computing

abstract: Photon loss is the biggest enemy for scalable photonic quantum information processing. This problem can be tackled by using quantum error correction, provided that the overall photon loss is below a threshold of 1/3. However, all reported on-demand and indistinguishable single-photon sources still fall short of this threshold. Here, by using tailor shaped laser pulse excitation on a high-quantum efficiency single quantum dot deterministically coupled to a tunable open microcavity, we demonstrate a high-performance source with a single-photon purity of 0.9795(6), photon indistinguishability of 0.9856(13), and an overall system efficiency of 0.712(18), simultaneously. This source for the first time reaches the efficiency threshold for scalable photonic quantum computing. With this source, we further demonstrate 1.89(14) dB intensity squeezing, and consecutive 40-photon events with 1.67 mHz count rate.


title: MC$^2$: Towards Transparent and Culturally-Aware NLP for Minority Languages in China

abstract: Current large language models demonstrate deficiencies in understanding low-resource languages, particularly the minority languages in China. This limitation stems from the scarcity of available pre-training data. To address this accessibility challenge, we present MC$^2$, a Multilingual Corpus of Minority Languages in China, which is the largest open-source corpus of its kind so far. MC$^2$ includes four underrepresented languages: Tibetan, Uyghur, Kazakh, and Mongolian. Notably, we focus on the less common writing systems of Kazakh and Mongolian, i.e., Kazakh Arabic script and traditional Mongolian script, respectively, which have been long neglected in previous corpus construction efforts. Recognizing the prevalence of language contamination within existing corpora, we adopt a quality-centric solution for collecting MC$^2$, prioritizing accuracy while enhancing diversity. Furthermore, we underscore the importance of attending to the multiplicity of writing systems, which is closely related to the cultural awareness of the resulting models. The MC$^2$ corpus and related models are made public to the community.


title: AI-generated text boundary detection with RoFT

abstract: Due to the rapid development of large language models, people increasingly often encounter texts that may start as written by a human but continue as machine-generated. Detecting the boundary between human-written and machine-generated parts of such texts is a challenging problem that has not received much attention in literature. We attempt to bridge this gap and examine several ways to adapt state of the art artificial text detection classifiers to the boundary detection setting. We push all detectors to their limits, using the Real or Fake text benchmark that contains short texts on several topics and includes generations of various language models. We use this diversity to deeply examine the robustness of all detectors in cross-domain and cross-model settings to provide baselines and insights for future research. In particular, we find that perplexity-based approaches to boundary detection tend to be more robust to peculiarities of domain-specific data than supervised fine-tuning of the RoBERTa model; we also find which features of the text confuse boundary detection algorithms and negatively influence their performance in cross-domain settings.


title: ChoralSynth: Synthetic Dataset of Choral Singing

abstract: Choral singing, a widely practiced form of ensemble singing, lacks comprehensive datasets in the realm of Music Information Retrieval (MIR) research, due to challenges arising from the requirement to curate multitrack recordings. To address this, we devised a novel methodology, leveraging state-of-the-art synthesizers to create and curate quality renditions. The scores were sourced from Choral Public Domain Library(CPDL). This work is done in collaboration with a diverse team of musicians, software engineers and researchers. The resulting dataset, complete with its associated metadata, and methodology is released as part of this work, opening up new avenues for exploration and advancement in the field of singing voice research.


title: A Gaussian Convexity for Logarithmic Moment Generating Functions

abstract: For any convex function $F$ of $n$-dimensional Gaussian vector $g$ with $\mathbb{E} e^{\lambda F(g)}<\infty$ for any $\lambda>0$, we show that $\lambda^{-1}\ln \mathbb{E} e^{\lambda F(g)}$ is convex in $\lambda\in\mathbb{R}$. Based on this convexity, we draw two applications. The first deduces an improvement of the Paouris-Valettas small deviation inequality in convex geometry. The second establishes a quantitative bound for the Dotsenko-Franz-M\'ezard conjecture arising from the study of the Sherrington-Kirkpatrick mean-field spin glass model, which states that the logarithmic anneal partition function of negative replica is asymptotically equal to the free energy.


title: Sampling theorems with derivatives in shift-invariant spaces generated by periodic exponential B-splines

abstract: We derive sufficient conditions for sampling with derivatives in shift-invariant spaces generated by a periodic exponential B-spline. The sufficient conditions are expressed with a new notion of measuring the gap between consecutive samples. These conditions are near optimal, and, in particular, they imply the existence of sampling sets with lower Beurling density arbitrarily close to the necessary density.


title: Isolated Neutron Stars

abstract: Non-accreting neutron stars display diverse characteristics, leading us to classify them into several groups. This chapter is an observational driven review in which we survey the properties of the different classes of isolated neutron stars: from the 'normal' rotation-powered pulsars, to magnetars, the most magnetic neutron stars in the Universe we know of; from central compact objects (sometimes called also anti-magnetars) in supernova remnants, to the X-ray dim isolated neutron stars. We also highlight a few sources that have exhibited features straddling those of different sub-groups, blurring the apparent diversity of the neutron star zoo and pointing to a gran unification.


title: Hierarchical Experience-informed Navigation for Multi-modal Quadrupedal Rebar Grid Traversal

abstract: This study focuses on a layered, experience-based, multi-modal contact planning framework for agile quadrupedal locomotion over a constrained rebar environment. To this end, our hierarchical planner incorporates locomotion-specific modules into the high-level contact sequence planner and solves kinodynamically-aware trajectory optimization as the low-level motion planner. Through quantitative analysis of the experience accumulation process and experimental validation of the kinodynamic feasibility of the generated locomotion trajectories, we demonstrate that the experience planning heuristic offers an effective way of providing candidate footholds for a legged contact planner. Additionally, we introduce a guiding torso path heuristic at the global planning level to enhance the navigation success rate in the presence of environmental obstacles. Our results indicate that the torso-path guided experience accumulation requires significantly fewer offline trials to successfully reach the goal compared to regular experience accumulation. Finally, our planning framework is validated in both dynamics simulations and real hardware implementations on a quadrupedal robot provided by Skymul Inc.


title: Mustango: Toward Controllable Text-to-Music Generation

abstract: The quality of the text-to-music models has reached new heights due to recent advancements in diffusion models. The controllability of various musical aspects, however, has barely been explored. In this paper, we propose Mustango: a music-domain-knowledge-inspired text-to-music system based on diffusion. Mustango aims to control the generated music, not only with general text captions, but with more rich captions that can include specific instructions related to chords, beats, tempo, and key. At the core of Mustango is MuNet, a Music-Domain-Knowledge-Informed UNet guidance module that steers the generated music to include the music-specific conditions, which we predict from the text prompt, as well as the general text embedding, during the reverse diffusion process. To overcome the limited availability of open datasets of music with text captions, we propose a novel data augmentation method that includes altering the harmonic, rhythmic, and dynamic aspects of music audio and using state-of-the-art Music Information Retrieval methods to extract the music features which will then be appended to the existing descriptions in text format. We release the resulting MusicBench dataset which contains over 52K instances and includes music-theory-based descriptions in the caption text. Through extensive experiments, we show that the quality of the music generated by Mustango is state-of-the-art, and the controllability through music-specific text prompts greatly outperforms other models such as MusicGen and AudioLDM2.


title: A Two-Step Rayleigh-Schr\"odinger Brillouin-Wigner Approach to Transition Energies

abstract: Perturbative methods are attractive to describe the electronic structure of molecular systems because of their low-computational cost and systematically improvable character. In this work, a two-step perturbative approach is introduced combining multi-state Rayleigh-Schr\"odinger (effective Hamiltonian theory) and state-specific Brillouin-Wigner schemes to treat degenerate configurations and yield an efficient evaluation of multiple energies. The first step produces model functions and an updated definition of the perturbative partitioning of the Hamiltonian. The second step inherits the improved starting point provided in the first step, enabling then faster processing of the perturbative corrections for each individual state. The here-proposed two-step method is exemplified on a model-Hamiltonian of increasing complexity.


title: Sparsity-Preserving Differentially Private Training of Large Embedding Models

abstract: As the use of large embedding models in recommendation systems and language applications increases, concerns over user data privacy have also risen. DP-SGD, a training algorithm that combines differential privacy with stochastic gradient descent, has been the workhorse in protecting user privacy without compromising model accuracy by much. However, applying DP-SGD naively to embedding models can destroy gradient sparsity, leading to reduced training efficiency. To address this issue, we present two new algorithms, DP-FEST and DP-AdaFEST, that preserve gradient sparsity during private training of large embedding models. Our algorithms achieve substantial reductions ($10^6 \times$) in gradient size, while maintaining comparable levels of accuracy, on benchmark real-world datasets.


title: The Gaia-ESO Survey: 3D dynamics of young groups and clusters from GES and Gaia EDR3

abstract: We present the first large-scale 3D kinematic study of ~2000 spectroscopically-confirmed young stars (<20 Myr) in 18 star clusters and OB associations (hereafter groups) from the combination of Gaia astrometry and Gaia-ESO Survey spectroscopy. We measure 3D velocity dispersions for all groups, which range from 0.61 to 7.4 km/s (1D velocity dispersions of 0.35 to 4.3 km/s). We find the majority of groups have anisotropic velocity dispersions, suggesting they are not dynamically relaxed. From the 3D velocity dispersions, measured radii and estimates of total mass we estimate the virial state and find that all systems are super-virial when only the stellar mass is considered, but that some systems are sub-virial when the mass of the molecular cloud is taken into account. We observe an approximately linear correlation between the 3D velocity dispersion and the group mass, which would imply that the virial state of groups scales as the square root of the group mass. However, we do not observe a strong correlation between virial state and group mass. In agreement with their virial state we find that nearly all of the groups studied are in the process of expanding and that the expansion is anisotropic, implying that groups were not spherical prior to expansion. One group, Rho Oph, is found to be contracting and in a sub-virial state (when the mass of the surrounding molecular cloud is considered). This work provides a glimpse of the potential of the combination of Gaia and data from the next generation of spectroscopic surveys.


title: Rotation-Agnostic Image Representation Learning for Digital Pathology

abstract: This paper addresses complex challenges in histopathological image analysis through three key contributions. Firstly, it introduces a fast patch selection method, FPS, for whole-slide image (WSI) analysis, significantly reducing computational cost while maintaining accuracy. Secondly, it presents PathDino, a lightweight histopathology feature extractor with a minimal configuration of five Transformer blocks and only 9 million parameters, markedly fewer than alternatives. Thirdly, it introduces a rotation-agnostic representation learning paradigm using self-supervised learning, effectively mitigating overfitting. We also show that our compact model outperforms existing state-of-the-art histopathology-specific vision transformers on 12 diverse datasets, including both internal datasets spanning four sites (breast, liver, skin, and colorectal) and seven public datasets (PANDA, CAMELYON16, BRACS, DigestPath, Kather, PanNuke, and WSSS4LUAD). Notably, even with a training dataset of 6 million histopathology patches from The Cancer Genome Atlas (TCGA), our approach demonstrates an average 8.5% improvement in patch-level majority vote performance. These contributions provide a robust framework for enhancing image analysis in digital pathology, rigorously validated through extensive evaluation. Project Page: https://kimialabmayo.github.io/PathDino-Page/


title: The Transient Nature of Emergent In-Context Learning in Transformers

abstract: Transformer neural networks can exhibit a surprising capacity for in-context learning (ICL) despite not being explicitly trained for it. Prior work has provided a deeper understanding of how ICL emerges in transformers, e.g. through the lens of mechanistic interpretability, Bayesian inference, or by examining the distributional properties of training data. However, in each of these cases, ICL is treated largely as a persistent phenomenon; namely, once ICL emerges, it is assumed to persist asymptotically. Here, we show that the emergence of ICL during transformer training is, in fact, often transient. We train transformers on synthetic data designed so that both ICL and in-weights learning (IWL) strategies can lead to correct predictions. We find that ICL first emerges, then disappears and gives way to IWL, all while the training loss decreases, indicating an asymptotic preference for IWL. The transient nature of ICL is observed in transformers across a range of model sizes and datasets, raising the question of how much to "overtrain" transformers when seeking compact, cheaper-to-run models. We find that L2 regularization may offer a path to more persistent ICL that removes the need for early stopping based on ICL-style validation tasks. Finally, we present initial evidence that ICL transience may be caused by competition between ICL and IWL circuits.


title: Eisenstein points on the Hilbert cuspidal eigenvariety

abstract: We present a comprehensive study of the geometry of Hilbert $p$-adic eigenvarieties at parallel weight one intersection points of their cuspidal and Eisenstein loci. The Galois theoretic approach presents genuine difficulties due to the lack of good deformation theory for pseudo-characters irregular at $p$ and reflects the rich local geometry at such points. We believe that our geometric results lead to deeper insight into the arithmetic of Hilbert automorphic forms and we produce several applications in Iwasawa theory to support that.


title: Transformers can optimally learn regression mixture models

abstract: Mixture models arise in many regression problems, but most methods have seen limited adoption partly due to these algorithms' highly-tailored and model-specific nature. On the other hand, transformers are flexible, neural sequence models that present the intriguing possibility of providing general-purpose prediction methods, even in this mixture setting. In this work, we investigate the hypothesis that transformers can learn an optimal predictor for mixtures of regressions. We construct a generative process for a mixture of linear regressions for which the decision-theoretic optimal procedure is given by data-driven exponential weights on a finite set of parameters. We observe that transformers achieve low mean-squared error on data generated via this process. By probing the transformer's output at inference time, we also show that transformers typically make predictions that are close to the optimal predictor. Our experiments also demonstrate that transformers can learn mixtures of regressions in a sample-efficient fashion and are somewhat robust to distribution shifts. We complement our experimental observations by proving constructively that the decision-theoretic optimal procedure is indeed implementable by a transformer.


title: Evaporation Ages: a New Dating Method for Young Star Clusters

abstract: The ages of young star clusters are fundamental clocks to constrain the formation and evolution of pre-main-sequence stars and their protoplanetary disks and exoplanets. However, dating methods for very young clusters often disagree, casting doubts on the accuracy of the derived ages. We propose a new method to derive the kinematic age of star clusters based on the evaporation ages of their stars. The method is validated and calibrated using hundreds of clusters identified in a supernova-driven simulation of the interstellar medium forming stars for approximately 40 Myr within a 250 pc region. We demonstrate that the clusters' evaporation-age uncertainty can be as small as about 10% for clusters with a large enough number of evaporated stars and small but realistic observational errors. We have obtained evaporation ages for a pilot sample of 10 clusters, finding a good agreement with their published isochronal ages. The evaporation ages will provide important constraints for modeling the pre-main-sequence evolution of low-mass stars, as well as to investigate the star-formation and gas-evaporation history of young clusters. These ages can be more accurate than isochronal ages for very young clusters, for which observations and models are more uncertain.


title: Plum: Prompt Learning using Metaheuristic

abstract: Since the emergence of large language models, prompt learning has become a popular method for optimizing and customizing these models. Special prompts, such as Chain-of-Thought, have even revealed previously unknown reasoning capabilities within these models. However, the progress of discovering effective prompts has been slow, driving a desire for general prompt optimization methods. Unfortunately, few existing prompt learning methods satisfy the criteria of being truly "general", i.e., automatic, discrete, black-box, gradient-free, and interpretable all at once. In this paper, we introduce metaheuristics, a branch of discrete non-convex optimization methods with over 100 options, as a promising approach to prompt learning. Within our paradigm, we test six typical methods: hill climbing, simulated annealing, genetic algorithms with/without crossover, tabu search, and harmony search, demonstrating their effectiveness in white-box and black-box prompt learning. Furthermore, we show that these methods can be used to discover more human-understandable prompts that were previously unknown in both reasoning and image generation tasks, opening the door to a cornucopia of possibilities in prompt optimization. We release all the codes in \url{https://github.com/research4pan/Plum}.


title: Local asymptotics of selection models

abstract: Selection models are ubiquitous in statistics. In recent years, they have regained considerable popularity as the working inferential models in many selective inference problems. In this paper, we derive an asymptotic expansion of the local likelihood ratios of selection models. We show that under mild regularity conditions, they are asymptotically equivalent to a sequence of Gaussian selection models. This generalizes the Local Asymptotic Normality framework of Le Cam (1960). Furthermore, we derive the asymptotic shape of Bayesian posterior distributions constructed from selection models, and show that they can be significantly miscalibrated in a frequentist sense.


title: Random Surfaces and Higher Algebra

abstract: The space of surfaces $\mathbf{X}: [0,1]^2 \to \mathbb{R}^d$ is equipped with natural horizontal and vertical concatenation operations, and we study representations of surfaces which preserve this algebraic structure. The framework of higher category theory allows us to formalize this notion in terms of a functor between double groupoids. We construct such functors by generalizing the classical concept of the path-ordered exponential as a nonabelian path integral. This generalization yields a notion of nonabelian surface integration, and is known in higher gauge theory as surface holonomy (or higher parallel transport). We extend these constructions from smooth surfaces to bounded controlled $p$-variation surfaces in the Young regime, with $p < 2$. By focusing on surface holonomy valued in higher generalizations of the classical matrix groups, called matrix double groups, we obtain explicit computations for piecewise linear approximations. Furthermore, we generalize the nonabelian Stokes' and Fubini theorems to the Young regime. Finally, we use these matrix surface holonomy functors to construct characteristic functions for random surfaces such as fractional Brownian sheets with Hurst parameter $h> \frac{1}{2}$.


title: Arboricity-Dependent Algorithms for Edge Coloring

abstract: The problem of edge coloring has been extensively studied over the years. Recently, this problem has received significant attention in the dynamic setting, where we are given a dynamic graph evolving via a sequence of edge insertions and deletions and our objective is to maintain an edge coloring of the graph. Currently, it is not known whether it is possible to maintain a $(\Delta+ O(\Delta^{1 - \mu}))$-edge coloring in $\tilde{O}(1)$ update time, for any constant $\mu > 0$, where $\Delta$ is the maximum degree of the graph. In this paper, we show how to efficiently maintain a $(\Delta + O(\alpha))$-edge coloring in $\tilde O(1)$ amortized update time, where $\alpha$ is the arboricty of the graph. Thus, we answer this question in the affirmative for graphs of sufficiently small arboricity.


title: Magnetic dynamics driven integer and fractional high harmonic generation arising from highly nonlinear instantaneous energy levels

abstract: We demonstrate that the strongly nonlinear regime of the magnetic dynamics driven high harmonic generation (HHG) can be captured through an adiabatic treatment. The underlying instantaneous energy dispersion reveal a highly nonlinear term that mirrors the high-frequency excitations present in non-equilibrium transport quantities. We stress out that the instantaneous energy levels dynamics carry much information on HHG and thereby provide a simplified understanding of the effect. Further, we exploit the present approach to predict the emergence of tunable integer and fractional high harmonics in the presence of a time-modulated spin-orbit interaction. Finally, we apply the approach to the case of the light driven HHG to figure out differently emerging non-linearities. Our findings initiate a new direction for harnessing HHG in both laser and precession driven ultrafast carrier dynamics.


title: How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text Detection

abstract: To combat the misuse of Large Language Models (LLMs), many recent studies have presented LLM-generated-text detectors with promising performance. When users instruct LLMs to generate texts, the instruction can include different constraints depending on the user's need. However, most recent studies do not cover such diverse instruction patterns when creating datasets for LLM detection. In this paper, we reveal that even task-oriented constraints -- constraints that would naturally be included in an instruction and are not related to detection-evasion -- cause existing powerful detectors to have a large variance in detection performance. We focus on student essay writing as a realistic domain and manually create task-oriented constraints based on several factors for essay quality. Our experiments show that the standard deviation (SD) of current detector performance on texts generated by an instruction with such a constraint is significantly larger (up to an SD of 14.4 F1-score) than that by generating texts multiple times or paraphrasing the instruction. We also observe an overall trend where the constraints can make LLM detection more challenging than without them. Finally, our analysis indicates that the high instruction-following ability of LLMs fosters the large impact of such constraints on detection performance.


title: SimpleSafetyTests: a Test Suite for Identifying Critical Safety Risks in Large Language Models

abstract: The past year has seen rapid acceleration in the development of large language models (LLMs). However, without proper steering and safeguards, LLMs will readily follow malicious instructions, provide unsafe advice, and generate toxic content. We introduce SimpleSafetyTests (SST) as a new test suite for rapidly and systematically identifying such critical safety risks. The test suite comprises 100 test prompts across five harm areas that LLMs, for the vast majority of applications, should refuse to comply with. We test 11 open-access and open-source LLMs and four closed-source LLMs, and find critical safety weaknesses. While some of the models do not give a single unsafe response, most give unsafe responses to more than 20% of the prompts, with over 50% unsafe responses in the extreme. Prepending a safety-emphasising system prompt substantially reduces the occurrence of unsafe responses, but does not completely stop them from happening. Trained annotators labelled every model response to SST (n = 3,000). We use these annotations to evaluate five AI safety filters (which assess whether a models' response is unsafe given a prompt) as a way of automatically evaluating models' performance on SST. The filters' performance varies considerably. There are also differences across the five harm areas, and on the unsafe versus safe responses. The widely-used Perspective API has 72% accuracy and a newly-created zero-shot prompt to OpenAI's GPT-4 performs best with 89% accuracy. Content Warning: This paper contains prompts and responses that relate to child abuse, suicide, self-harm and eating disorders, scams and fraud, illegal items, and physical harm.


title: USLR: an open-source tool for unbiased and smooth longitudinal registration of brain MR

abstract: We present USLR, a computational framework for longitudinal registration of brain MRI scans to estimate nonlinear image trajectories that are smooth across time, unbiased to any timepoint, and robust to imaging artefacts. It operates on the Lie algebra parameterisation of spatial transforms (which is compatible with rigid transforms and stationary velocity fields for nonlinear deformation) and takes advantage of log-domain properties to solve the problem using Bayesian inference. USRL estimates rigid and nonlinear registrations that: (i) bring all timepoints to an unbiased subject-specific space; and (i) compute a smooth trajectory across the imaging time-series. We capitalise on learning-based registration algorithms and closed-form expressions for fast inference. A use-case Alzheimer's disease study is used to showcase the benefits of the pipeline in multiple fronts, such as time-consistent image segmentation to reduce intra-subject variability, subject-specific prediction or population analysis using tensor-based morphometry. We demonstrate that such approach improves upon cross-sectional methods in identifying group differences, which can be helpful in detecting more subtle atrophy levels or in reducing sample sizes in clinical trials. The code is publicly available in https://github.com/acasamitjana/uslr


title: Aid Nexus : A Blockchain Based Financial Distribution System

abstract: Blockchain technology has emerged as a disruptive force with transformative potential across numerous industries, promising efficient and automated solutions that can revolutionize traditional systems. By leveraging decentralized ledger systems, blockchain offers enhanced security, transparency, and transaction verification without the need for intermediaries. The finance sector is exploring blockchain-based solutions for payments, remittances, lending, and investments, while healthcare adopts the technology for medical record keeping, supply chain tracking, and data management. Similarly, supply chain management benefits from blockchain's ability to enhance transparency, traceability, and accountability from raw materials to finished products. Other sectors, including real estate, energy, and government, are also investigating blockchain-based solutions to improve efficiency, security, and transparency. Furthermore, smart contracts within the blockchain enable process automation, reducing manual intervention in distribution workflows. AidNeux, a consortium-based blockchain DApp, reimagines the distribution of financial assistance by addressing inefficiencies and opaqueness. Using smart contracts ensures the security and directness of money transfers. Its robust digital identity verification and real-time auditability reduce fraud risks and strengthen accountability, thereby presenting a scalable, transparent solution to problems inherent to conventional financial aid systems.


title: Proceedings of the 18th International Workshop on the ACL2 Theorem Prover and Its Applications

abstract: This volume contains the proceedings of the Eighteenth International Workshop on the ACL2 Theorem Prover and Its Applications (ACL2-2023), a two-day workshop held at the University of Texas at Austin and online, on November 13-14. These workshops provide a major technical forum for users of the ACL2 theorem prover to present research related to ACL2 and its applications.


title: A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Texts

abstract: In the realm of text manipulation and linguistic transformation, the question of authorship has been a subject of fascination and philosophical inquiry. Much like the Ship of Theseus paradox, which ponders whether a ship remains the same when each of its original planks is replaced, our research delves into an intriguing question: Does a text retain its original authorship when it undergoes numerous paraphrasing iterations? Specifically, since Large Language Models (LLMs) have demonstrated remarkable proficiency in both the generation of original content and the modification of human-authored texts, a pivotal question emerges concerning the determination of authorship in instances where LLMs or similar paraphrasing tools are employed to rephrase the text--i.e., whether authorship should be attributed to the original human author or the AI-powered tool. Therefore, we embark on a philosophical voyage through the seas of language and authorship to unravel this intricate puzzle. Using a computational approach, we discover that the diminishing performance in text classification models, with each successive paraphrasing iteration, is closely associated with the extent of deviation from the original author's style, thus provoking a reconsideration of the current notion of authorship.


title: Proceedings 19th International Conference on Quantum Physics and Logic

abstract: This volume contains the proceedings of the 19th International Conference on Quantum Physics and Logic (QPL 2022), which was held June 27-July 1, 2022 at Wolfson College, University of Oxford, UK. QPL is an annual conference that brings together academic and industry researchers working on mathematical foundations of quantum computation, quantum physics, and related areas. The main focus is on the use of algebraic and categorical structures, formal languages, semantic methods, as well as other mathematical and computer scientific techniques applicable to the study of physical systems, physical processes, and their composition.


title: Ensemble sampling for linear bandits: small ensembles suffice

abstract: We provide the first useful and rigorous analysis of ensemble sampling for the stochastic linear bandit setting. In particular, we show that, under standard assumptions, for a $d$-dimensional stochastic linear bandit with an interaction horizon $T$, ensemble sampling with an ensemble of size of order $\smash{d \log T}$ incurs regret at most of the order $\smash{(d \log T)^{5/2} \sqrt{T}}$. Ours is the first result in any structured setting not to require the size of the ensemble to scale linearly with $T$ -- which defeats the purpose of ensemble sampling -- while obtaining near $\smash{\sqrt{T}}$ order regret. Ours is also the first result that allows infinite action sets.


title: Learning to Filter Context for Retrieval-Augmented Generation

abstract: On-the-fly retrieval of relevant knowledge has proven an essential element of reliable systems for tasks such as open-domain question answering and fact verification. However, because retrieval systems are not perfect, generation models are required to generate outputs given partially or entirely irrelevant passages. This can cause over- or under-reliance on context, and result in problems in the generated output such as hallucinations. To alleviate these problems, we propose FILCO, a method that improves the quality of the context provided to the generator by (1) identifying useful context based on lexical and information-theoretic approaches, and (2) training context filtering models that can filter retrieved contexts at test time. We experiment on six knowledge-intensive tasks with FLAN-T5 and LLaMa2, and demonstrate that our method outperforms existing approaches on extractive question answering (QA), complex multi-hop and long-form QA, fact verification, and dialog generation tasks. FILCO effectively improves the quality of context, whether or not it supports the canonical output.


title: New examples of $G_2$-instantons on $\mathbb{R}^4 \times S^3$

abstract: We study the existence of $\text{SU}(2)^2$-invariant $G_2$-instantons on $\mathbb{R}^4 \times S^3$ with the coclosed $G_2$-structures found on [arXiv:2209.02761]. We find an explicit 1-parameter family of $\text{SU}(2)^3$-invariant $G_2$-instantons on the trivial bundle on $\mathbb{R}^4 \times S^3$ and study its ''bubbling'' behaviour. We prove the existence a 1-parameter family on the identity bundle. We also provide existence results for locally defined $\text{SU}(2)^2$-invariant $G_2$-instantons.


title: Scheming AIs: Will AIs fake alignment during training in order to get power?

abstract: This report examines whether advanced AIs that perform well in training will be doing so in order to gain power later -- a behavior I call "scheming" (also sometimes called "deceptive alignment"). I conclude that scheming is a disturbingly plausible outcome of using baseline machine learning methods to train goal-directed AIs sophisticated enough to scheme (my subjective probability on such an outcome, given these conditions, is roughly 25%). In particular: if performing well in training is a good strategy for gaining power (as I think it might well be), then a very wide variety of goals would motivate scheming -- and hence, good training performance. This makes it plausible that training might either land on such a goal naturally and then reinforce it, or actively push a model's motivations towards such a goal as an easy way of improving performance. What's more, because schemers pretend to be aligned on tests designed to reveal their motivations, it may be quite difficult to tell whether this has occurred. However, I also think there are reasons for comfort. In particular: scheming may not actually be such a good strategy for gaining power; various selection pressures in training might work against schemer-like goals (for example, relative to non-schemers, schemers need to engage in extra instrumental reasoning, which might harm their training performance); and we may be able to increase such pressures intentionally. The report discusses these and a wide variety of other considerations in detail, and it suggests an array of empirical research directions for probing the topic further.


title: Direct Preference Optimization for Neural Machine Translation with Minimum Bayes Risk Decoding

abstract: Minimum Bayes Risk (MBR) decoding can significantly improve translation performance of Multilingual Large Language Models (MLLMs). However, MBR decoding is computationally expensive. We show how the recently developed Reinforcement Learning technique, Direct Preference Optimization (DPO), can fine-tune MLLMs to get the gains of MBR without any additional computation in inference. Our method uses only a small monolingual fine-tuning set and yields significantly improved performance on multiple NMT test sets compared to MLLMs without DPO.


title: Automated detection of laser cooling schemes for ultracold molecules

abstract: One of the demanding frontiers in ultracold science is identifying laser cooling schemes for complex atoms and molecules, out of their vast spectra of internal states. Motivated by a need to expand the set of available ultracold molecules for applications in fundamental physics, chemistry, astrochemistry, and quantum simulation, we propose and demonstrate an automated graph-based search approach for viable laser cooling schemes. The method is time efficient and the outcomes greatly surpass the results of manual searches used so far. We discover new laser cooling schemes for C$_2$, OH$^+$, CN, YO, and CO$_2$ that can be viewed as surprising or counterintuitive compared to previously identified laser cooling schemes. In addition, a central insight of this work is that the reinterpretation of quantum states and transitions between them as a graph can dramatically enhance our ability to identify new quantum control schemes for complex quantum systems. As such, this approach will also be applicable to complex atoms and, in fact, any complex many-body quantum system with a discrete spectrum of internal states.


title: Mott insulating negative thermal expansion perovskite TiF3

abstract: We characterize perovskite TiF_3, a material which displays significant negative thermal expansion at elevated temperatures above its cubic-to-rhombohedral structural phase transition at 330 K. We find the optical response favors an insulating state in both structural phases, which we show can be produced in density functional theory calculations only through the introduction of an on-site Coulomb repulsion. Analysis of the magnetic susceptibility data gives a S=1/2 local moment per Ti+3 ion and an antiferromagnetic exchange coupling. Together, these results show that TiF_3 is a strongly correlated electron system, a fact which constrains possible mechanisms of strong negative thermal expansion in the Sc_1-xTi_xF3 system. We consider the relative strength of the Jahn-Teller and electric dipole interactions in driving the structural transition.


title: Choosing Outdated Information to Achieve Reliability in Age-Based Gossiping

abstract: We consider a system model with two sources, a reliable source and an unreliable source, who are responsible for disseminating updates regarding a process to an age-based gossip network of $n$ nodes. Nodes wish to have fresh information, however, they have preference for packets that originated at the reliable source and are willing to sacrifice their version age of information by up to $G$ versions to switch from an unreliable packet to a reliable packet. We study how this protocol impacts the prevalence of unreliable packets at nodes in the network and their version age. Using a stochastic hybrid system (SHS) framework, we formulate analytical equations to characterize two quantities: expected fraction of nodes with unreliable packets and expected version age of information at network nodes. We show that as $G$ increases, fewer nodes have unreliable packet, however, their version age increases as well, thereby inducing a freshness-reliability trade-off in the network. We present numerical results to support our findings.


title: Offline Data Enhanced On-Policy Policy Gradient with Provable Guarantees

abstract: Hybrid RL is the setting where an RL agent has access to both offline data and online data by interacting with the real-world environment. In this work, we propose a new hybrid RL algorithm that combines an on-policy actor-critic method with offline data. On-policy methods such as policy gradient and natural policy gradient (NPG) have shown to be more robust to model misspecification, though sometimes it may not be as sample efficient as methods that rely on off-policy learning. On the other hand, offline methods that depend on off-policy training often require strong assumptions in theory and are less stable to train in practice. Our new approach integrates a procedure of off-policy training on the offline data into an on-policy NPG framework. We show that our approach, in theory, can obtain a best-of-both-worlds type of result -- it achieves the state-of-art theoretical guarantees of offline RL when offline RL-specific assumptions hold, while at the same time maintaining the theoretical guarantees of on-policy NPG regardless of the offline RL assumptions' validity. Experimentally, in challenging rich-observation environments, we show that our approach outperforms a state-of-the-art hybrid RL baseline which only relies on off-policy policy optimization, demonstrating the empirical benefit of combining on-policy and off-policy learning. Our code is publicly available at https://github.com/YifeiZhou02/HNPG.


title: ChOiRe: Characterizing and Predicting Human Opinions with Chain of Opinion Reasoning

abstract: Aligning language models (LMs) with human opinion is challenging yet vital to enhance their grasp of human values, preferences, and beliefs. We present ChOiRe, a four-step framework to predict human opinion which differentially models the user explicit personae (i.e. demographic or ideological attributes) that are manually declared, and implicit personae inferred from user historical opinions. ChOiRe consists of (i) an LM analyzing the user explicit personae to filter out irrelevant attributes; (ii) the LM ranking the implicit persona opinions into a preferential list; (iii) Chain-of-Opinion (CoO) reasoning, where the LM sequentially analyzes the explicit personae and the most relevant implicit personae to perform opinion prediction; (iv) and where ChOiRe executes Step (iii) CoO multiple times with increasingly larger lists of implicit personae to overcome insufficient personae information to infer a final result. ChOiRe achieves new state-of-the-art effectiveness with limited inference calls, improving previous techniques significantly by 3.22%. We also show that ChOiRe Steps (i) and (ii) can significantly better fine-tune opinion-aligned models, by up to 18.44%.


title: Capacity of Summation over a Symmetric Quantum Erasure MAC with Partially Replicated Inputs

abstract: The optimal quantum communication cost of computing a classical sum of distributed sources is studied over a quantum erasure multiple access channel (QEMAC). K classical messages comprised of finite-field symbols are distributed across $S$ servers, who also share quantum entanglement in advance. Each server $s\in[S]$ manipulates its quantum subsystem $\mathcal{Q}_s$ according to its own available classical messages and sends $\mathcal{Q}_s$ to the receiver who then computes the sum of the messages based on a joint quantum measurement. The download cost from Server $s\in [S]$ is the logarithm of the dimension of $\mathcal{Q}_s$. The rate $R$ is defined as the number of instances of the sum computed at the receiver, divided by the total download cost from all the servers. The main focus is on the symmetric setting with $K= {S \choose \alpha} $ messages where each message is replicated among a unique subset of $\alpha$ servers, and the answers from any $\beta$ servers may be erased. If no entanglement is initially available to the receiver, then we show that the capacity (maximal rate) is precisely $C= \max\left\{ \min \left\{ \frac{2(\alpha-\beta)}{S}, \frac{S-2\beta}{S} \right\}, \frac{\alpha-\beta}{S} \right\}$. The capacity with arbitrary levels of prior entanglement $(\Delta_0)$ between the $S$ data-servers and the receiver is also characterized, by including an auxiliary server (Server $0$) that has no classical data, so that the communication cost from Server $0$ is a proxy for the amount of receiver-side entanglement that is available in advance. The challenge on the converse side resides in the optimal application of the weak monotonicity property, while the achievability combines ideas from classical network coding and treating qudits as classical dits, as well as new constructions based on the $N$-sum box abstraction that rely on absolutely maximally entangled quantum states.


title: Hilbert evolution algebras, weighted digraphs, and nilpotency

abstract: Hilbert evolution algebras generalize evolution algebras through a framework of Hilbert spaces. In this work we focus on infinite-dimensional Hilbert evolution algebras and their representation through a suitably defined weighted digraph. By means of studying such a digraph we obtain new properties for these structures extending well-known results related to the nilpotency of finite dimensional evolution algebras. We show that differently from what happens for the finite dimensional evolution algebras, the notions of nil and nilpotency are not equivalent for Hilbert evolution algebras. Furthermore, we exhibit necessary and sufficient conditions under which a given Hilbert evolution algebra is nil or nilpotent. Our approach includes illustrative examples.


title: Proposing a Physical Mechanism to Explain Various Observed Sources of QPOs by Simulating the Dynamics of Accretion Disks around the Black Holes

abstract: We propose a mechanism to explain the low-frequency QPOs observed in X-ray binary systems and AGNs. To achieve this, we perturbed stable accretion disks around Kerr and EGB black holes at different angular velocities, revealing characteristics of shock waves and oscillations on the disk. By applying this perturbation to scenarios with varying alpha values for EGB black holes and different spin parameters for Kerr black holes, we numerically observed changes in the disk dynamic structure and its oscillations. Through various numerical models, we found that the formation of one- and two-armed spiral shock waves on the disk serves as a mechanism for generating QPOs. We compared the QPOs obtained from numerical calculations with the low-frequency QPOs observed in $X$-ray binary systems and AGN sources, finding high consistency with observations. We observed that the shock mechanism, leading to QPOs, explains the X-ray binaries and AGNs studied in this article. Our numerical findings indicate that QPOs are more strongly dependent on the EGB constant than on the black hole spin parameter. However, we highlighted that the primary impact on oscillations and QPOs is driven by the perturbation angular velocity. The results from the models showed that the perturbation asymptotic speed at V_{\infty}=0.2 independently generates QPO frequencies, regardless of the black hole spin parameter and the EGB coupling constant. Therefore, for the moderate value of V_{\infty}, a two-armed spiral shock wave formed around the black hole is suggested as a decisive mechanism in explaining low-frequency QPOs.


title: TSST: A Benchmark and Evaluation Models for Text Speech-Style Transfer

abstract: Text style is highly abstract, as it encompasses various aspects of a speaker's characteristics, habits, logical thinking, and the content they express. However, previous text-style transfer tasks have primarily focused on data-driven approaches, lacking in-depth analysis and research from the perspectives of linguistics and cognitive science. In this paper, we introduce a novel task called Text Speech-Style Transfer (TSST). The main objective is to further explore topics related to human cognition, such as personality and emotion, based on the capabilities of existing LLMs. Considering the objective of our task and the distinctive characteristics of oral speech in real-life scenarios, we trained multi-dimension (i.e. filler words, vividness, interactivity, emotionality) evaluation models for the TSST and validated their correlation with human assessments. We thoroughly analyze the performance of several large language models (LLMs) and identify areas where further improvement is needed. Moreover, driven by our evaluation models, we have released a new corpus that improves the capabilities of LLMs in generating text with speech-style characteristics. In summary, we present the TSST task, a new benchmark for style transfer and emphasizing human-oriented evaluation, exploring and advancing the performance of current LLMs.


title: On What Basis? Predicting Text Preference Via Structured Comparative Reasoning

abstract: Comparative reasoning plays a crucial role in text preference prediction; however, large language models (LLMs) often demonstrate inconsistencies in their reasoning. While approaches like Chain-of-Thought improve accuracy in many other settings, they struggle to consistently distinguish the similarities and differences of complex texts. We introduce SC, a prompting approach that predicts text preferences by generating structured intermediate comparisons. SC begins by proposing aspects of comparison, followed by generating textual comparisons under each aspect. We select consistent comparisons with a pairwise consistency comparator that ensures each aspect's comparisons clearly distinguish differences between texts, significantly reducing hallucination and improving consistency. Our comprehensive evaluations across various NLP tasks, including summarization, retrieval, and automatic rating, demonstrate that SC equips LLMs to achieve state-of-the-art performance in text preference prediction.


title: A Material Lens on Coloniality in NLP

abstract: Coloniality, the continuation of colonial harms beyond "official" colonization, has pervasive effects across society and scientific fields. Natural Language Processing (NLP) is no exception to this broad phenomenon. In this work, we argue that coloniality is implicitly embedded in and amplified by NLP data, algorithms, and software. We formalize this analysis using Actor-Network Theory (ANT): an approach to understanding social phenomena through the network of relationships between human stakeholders and technology. We use our Actor-Network to guide a quantitative survey of the geography of different phases of NLP research, providing evidence that inequality along colonial boundaries increases as NLP builds on itself. Based on this, we argue that combating coloniality in NLP requires not only changing current values but also active work to remove the accumulation of colonial ideals in our foundational data and algorithms.


title: Iterative Network Pricing for Ridesharing Platforms

abstract: Ridesharing platforms match riders and drivers, using dynamic pricing to balance supply and demand. The origin-based "surge pricing", however, does not take into consideration market conditions at trip destinations, leading to inefficient driver flows in space and incentivizes drivers to strategize. In this work, we introduce the Iterative Network Pricing mechanism, addressing a main challenge in the practical implementation of optimal origin-destination (OD) based prices, that the model for rider demand is hard to estimate. Assuming that the platform's surge algorithm clears the market for each origin in real-time, our mechanism updates the OD-based price adjustments week-over-week, using only information immediately observable during the same time window in the prior weeks. For stationary market conditions, we prove that our mechanism converges to an outcome that is approximately welfare-optimal. Using data from the City of Chicago, we illustrate (via simulation) the iterative updates under our mechanism for morning rush hours, demonstrating substantial welfare improvements despite significant fluctuations of market conditions from early 2019 through the end of 2020.


title: MVSA-Net: Multi-View State-Action Recognition for Robust and Deployable Trajectory Generation

abstract: The learn-from-observation (LfO) paradigm is a human-inspired mode for a robot to learn to perform a task simply by watching it being performed. LfO can facilitate robot integration on factory floors by minimizing disruption and reducing tedious programming. A key component of the LfO pipeline is a transformation of the depth camera frames to the corresponding task state and action pairs, which are then relayed to learning techniques such as imitation or inverse reinforcement learning for understanding the task parameters. While several existing computer vision models analyze videos for activity recognition, SA-Net specifically targets robotic LfO from RGB-D data. However, SA-Net and many other models analyze frame data captured from a single viewpoint. Their analysis is therefore highly sensitive to occlusions of the observed task, which are frequent in deployments. An obvious way of reducing occlusions is to simultaneously observe the task from multiple viewpoints and synchronously fuse the multiple streams in the model. Toward this, we present multi-view SA-Net, which generalizes the SA-Net model to allow the perception of multiple viewpoints of the task activity, integrate them, and better recognize the state and action in each frame. Performance evaluations on two distinct domains establish that MVSA-Net recognizes the state-action pairs under occlusion more accurately compared to single-view MVSA-Net and other baselines. Our ablation studies further evaluate its performance under different ambient conditions and establish the contribution of the architecture components. As such, MVSA-Net offers a significantly more robust and deployable state-action trajectory generation compared to previous methods.


title: Superconformal Gravity And The Topology Of Diffeomorphism Groups

abstract: Twisted four-dimensional supersymmetric Yang-Mills theory famously gives a useful point of view on the Donaldson and Seiberg-Witten invariants of four-manifolds. In this paper we generalize the construction to include a path integral formulation of generalizations of Donaldson invariants for smooth families of four-manifolds. Mathematically these are equivariant cohomology classes for the action of the oriented diffeomorphism group on the space of metrics on the manifold. In principle these cohomology classes should contain nontrivial information about the topology of the diffeomorphism group of the four-manifold. We show that the invariants may be interpreted as the standard topologically twisted path integral of four-dimensional $\mathcal{N}=2$ supersymmetric Yang-Mills coupled to topologically twisted background fields of conformal supergravity.


title: Exploring Be phenomena in OBA stars: a Mid-infrared search

abstract: As early-type stars with a rotation speed close to their critical velocity, Be stars experience an event called the Be phenomenon. The material in their equator is ejected into outside space during the Be phenomenon and forms a circumstellar disk. The mechanism triggering these events remains poorly understood, and observations of these events are limited because the duration of these events ranges from months to years. Long-term epoch photometry in the infrared bands is expected to be ideal for detecting Be phenomena because the brightness variation is larger, and the effect of interstellar extinction is weaker as well. We conducted a systematic search for Be phenomena among Milky Way OBA stars in the mid-infrared. We examined the brightness and colour variations of known classical Be stars using the WISE W1 and W2 photometry bands to quantify their characteristics. Subsequently, we established a set of criteria to identify similar photometric variations in a large sample of OBA stars. We found 916 OBA stars that show Be phenomena in the past 13 years, 736 of which are newly discovered. The peak-to-peak variations in magnitude and colour were found to be correlated, indicating that a decretion disk is common. The increase in colour was observed to be strongly correlated with the emission of the H-alpha line, providing further evidence of the association with circumstellar disks. The brightness variation of a star with Be phenomena can be up to 1.5 mag, and the colour variations can be up to 0.4 mag. The median durations for the disk build-up and decay phases are 474 and 524 days, respectively (durations shorter than 180 days are not sampled). The search for Be phenomena in the WISE bands greatly enlarges the number of stars showing disk variation, and it enables multi-band photometry analysis of these events with the help of current and future optical photometry surveys.


title: Zero-shot audio captioning with audio-language model guidance and audio context keywords

abstract: Zero-shot audio captioning aims at automatically generating descriptive textual captions for audio content without prior training for this task. Different from speech recognition which translates audio content that contains spoken language into text, audio captioning is commonly concerned with ambient sounds, or sounds produced by a human performing an action. Inspired by zero-shot image captioning methods, we propose ZerAuCap, a novel framework for summarising such general audio signals in a text caption without requiring task-specific training. In particular, our framework exploits a pre-trained large language model (LLM) for generating the text which is guided by a pre-trained audio-language model to produce captions that describe the audio content. Additionally, we use audio context keywords that prompt the language model to generate text that is broadly relevant to sounds. Our proposed framework achieves state-of-the-art results in zero-shot audio captioning on the AudioCaps and Clotho datasets. Our code is available at https://github.com/ExplainableML/ZerAuCap.


title: Giant Resistance Switch in Twisted Transition Metal Dichalcogenide Tunnel Junctions

abstract: Resistance switching in multilayer structures are typically based on materials possessing ferroic orders. Here we predict an extremely large resistance switching based on the relative spin-orbit splitting in twisted transition metal dichalcogenide (TMD) monolayers tunnel junctions. Because of the valence band spin splitting which depends on the valley index in the Brillouin zone, the perpendicular electronic transport through the junction depends on the relative reciprocal space overlap of the spin-dependent Fermi surfaces of both layers, which can be tuned by twisting one layer. Our quantum transport calculations reveal a switching resistance of up to $10^6 \%$ when the relative alignment of TMDs goes from $0^{\circ}$ to $60^{\circ}$ and when the angle is kept fixed at $60^{\circ}$ and the Fermi level is varied. By creating vacancies, we evaluate how inter-valley scattering affects the efficiency and find that the resistance switching remains large ($10^4 \%$) for typical values of vacancy concentration. Not only this resistance switching should be observed at room temperature due to the large spin splitting, but our results show how twist angle engineering and control of van der Waals heterostructures could be used for next-generation memory and electronic applications.


title: Are Large Language Models Temporally Grounded?

abstract: Are Large language models (LLMs) temporally grounded? Since LLMs cannot perceive and interact with the environment, it is impossible to answer this question directly. Instead, we provide LLMs with textual narratives and probe them with respect to their common-sense knowledge of the structure and duration of events, their ability to order events along a timeline, and self-consistency within their temporal model (e.g., temporal relations such as after and before are mutually exclusive for any pair of events). We evaluate state-of-the-art LLMs (such as LLaMA 2 and GPT-4) on three tasks reflecting these abilities. Generally, we find that LLMs lag significantly behind both human performance as well as small-scale, specialised LMs. In-context learning, instruction tuning, and chain-of-thought prompting reduce this gap only to a limited degree. Crucially, LLMs struggle the most with self-consistency, displaying incoherent behaviour in at least 27.23% of their predictions. Contrary to expectations, we also find that scaling the model size does not guarantee positive gains in performance. To explain these results, we study the sources from which LLMs may gather temporal information: we find that sentence ordering in unlabelled texts, available during pre-training, is only weakly correlated with event ordering. Moreover, public instruction tuning mixtures contain few temporal tasks. Hence, we conclude that current LLMs lack a consistent temporal model of textual narratives. Code, datasets, and LLM outputs are available at https://github.com/yfqiu-nlp/temporal-llms.


title: Constant Query Local Decoding Against Deletions Is Impossible

abstract: Locally decodable codes (LDC's) are error-correcting codes that allow recovery of individual message indices by accessing only a constant number of codeword indices. For substitution errors, it is evident that LDC's exist -- Hadamard codes are examples of $2$-query LDC's. Research on this front has focused on finding the optimal encoding length for LDC's, for which there is a nearly exponential gap between the best lower bounds and constructions. Ostrovsky and Paskin-Cherniavsky (ICITS 2015) introduced the notion of local decoding to the insertion and deletion setting. In this context, it is not clear whether constant query LDC's exist at all. Indeed, in contrast to the classical setting, Block et al. conjecture that they do not exist. Blocki et al. (FOCS 2021) make progress towards this conjecture, proving that any potential code must have at least exponential encoding length. Our work definitively resolves the conjecture and shows that constant query LDC's do not exist in the insertion/deletion (or even deletion-only) setting. Using a reduction shown by Blocki et al., this also implies that constant query locally correctable codes do not exist in this setting.


title: Towards Open-Ended Visual Recognition with Large Language Model

abstract: Localizing and recognizing objects in the open-ended physical world poses a long-standing challenge within the domain of machine perception. Recent methods have endeavored to address the issue by employing a class-agnostic mask (or box) proposal model, complemented by an open-vocabulary classifier (e.g., CLIP) using pre-extracted text embeddings. However, it is worth noting that these open-vocabulary recognition models still exhibit limitations in practical applications. On one hand, they rely on the provision of class names during testing, where the recognition performance heavily depends on this predefined set of semantic classes by users. On the other hand, when training with multiple datasets, human intervention is required to alleviate the label definition conflict between them. In this paper, we introduce the OmniScient Model (OSM), a novel Large Language Model (LLM) based mask classifier, as a straightforward and effective solution to the aforementioned challenges. Specifically, OSM predicts class labels in a generative manner, thus removing the supply of class names during both training and testing. It also enables cross-dataset training without any human interference, exhibiting robust generalization capabilities due to the world knowledge acquired from the LLM. By combining OSM with an off-the-shelf mask proposal model, we present promising results on various benchmarks, and demonstrate its effectiveness in handling novel concepts. Code/model are available at https://github.com/bytedance/OmniScient-Model.


title: Fine-tuning Language Models for Factuality

abstract: The fluency and creativity of large pre-trained language models (LLMs) have led to their widespread use, sometimes even as a replacement for traditional search engines. Yet language models are prone to making convincing but factually inaccurate claims, often referred to as 'hallucinations.' These errors can inadvertently spread misinformation or harmfully perpetuate misconceptions. Further, manual fact-checking of model responses is a time-consuming process, making human factuality labels expensive to acquire. In this work, we fine-tune language models to be more factual, without human labeling and targeting more open-ended generation settings than past work. We leverage two key recent innovations in NLP to do so. First, several recent works have proposed methods for judging the factuality of open-ended text by measuring consistency with an external knowledge base or simply a large model's confidence scores. Second, the direct preference optimization algorithm enables straightforward fine-tuning of language models on objectives other than supervised imitation, using a preference ranking over possible model responses. We show that learning from automatically generated factuality preference rankings, generated either through existing retrieval systems or our novel retrieval-free approach, significantly improves the factuality (percent of generated claims that are correct) of Llama-2 on held-out topics compared with RLHF or decoding strategies targeted at factuality. At 7B scale, compared to Llama-2-chat, we observe 58% and 40% reduction in factual error rate when generating biographies and answering medical questions, respectively.


title: Retrieve and Copy: Scaling ASR Personalization to Large Catalogs

abstract: Personalization of automatic speech recognition (ASR) models is a widely studied topic because of its many practical applications. Most recently, attention-based contextual biasing techniques are used to improve the recognition of rare words and domain specific entities. However, due to performance constraints, the biasing is often limited to a few thousand entities, restricting real-world usability. To address this, we first propose a "Retrieve and Copy" mechanism to improve latency while retaining the accuracy even when scaled to a large catalog. We also propose a training strategy to overcome the degradation in recall at such scale due to an increased number of confusing entities. Overall, our approach achieves up to 6% more Word Error Rate reduction (WERR) and 3.6% absolute improvement in F1 when compared to a strong baseline. Our method also allows for large catalog sizes of up to 20K without significantly affecting WER and F1-scores, while achieving at least 20% inference speedup per acoustic frame.


title: Instant3D: Instant Text-to-3D Generation

abstract: Text-to-3D generation has attracted much attention from the computer vision community. Existing methods mainly optimize a neural field from scratch for each text prompt, relying on heavy and repetitive training cost which impedes their practical deployment. In this paper, we propose a novel framework for fast text-to-3D generation, dubbed Instant3D. Once trained, Instant3D is able to create a 3D object for an unseen text prompt in less than one second with a single run of a feedforward network. We achieve this remarkable speed by devising a new network that directly constructs a 3D triplane from a text prompt. The core innovation of our Instant3D lies in our exploration of strategies to effectively inject text conditions into the network. In particular, we propose to combine three key mechanisms: cross-attention, style injection, and token-to-plane transformation, which collectively ensure precise alignment of the output with the input text. Furthermore, we propose a simple yet effective activation function, the scaled-sigmoid, to replace the original sigmoid function, which speeds up the training convergence by more than ten times. Finally, to address the Janus (multi-head) problem in 3D generation, we propose an adaptive Perp-Neg algorithm that can dynamically adjust its concept negation scales according to the severity of the Janus problem during training, effectively reducing the multi-head effect. Extensive experiments on a wide variety of benchmark datasets demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods both qualitatively and quantitatively, while achieving significantly better efficiency. The code, data, and models are available at https://github.com/ming1993li/Instant3DCodes.


title: Centrality and Partition of Idempotents

abstract: We show that an idempotent lies in the center if it commutes with the other idempotents in the ring. Next, we introduce a partition of the set of idempotents and show that the automorphisms of the ring act transitively on each equivalence class.


title: On centrally-extended Jordan endomorophisms in rings

abstract: The aim of this article is to introduce the concept of centrally-extended Jordan endomorphisms and proving that if $R$ is a non-commutative prime ring of characteristic not two, and $G$ is a CE- Jordan epimorphism such that $[G(x), x] \in Z(R)$ ($[G(x), x^*] \in Z(R)$) for all $x \in R$, then $R$ is an order in a central simple algebra of dimension at most $4$ over its center or there is an element $\lambda$ in the extended of $R$ such that $G(x) = \lambda x$ ($G(x) = \lambda^* x^*$) for all $x \in R$.