title: Towards Building an End-to-End Multilingual Automatic Lyrics Transcription Model

abstract: Multilingual automatic lyrics transcription (ALT) is a challenging task due to the limited availability of labelled data and the challenges introduced by singing, compared to multilingual automatic speech recognition. Although some multilingual singing datasets have been released recently, English continues to dominate these collections. Multilingual ALT remains underexplored due to the scale of data and annotation quality. In this paper, we aim to create a multilingual ALT system with available datasets. Inspired by architectures that have been proven effective for English ALT, we adapt these techniques to the multilingual scenario by expanding the target vocabulary set. We then evaluate the performance of the multilingual model in comparison to its monolingual counterparts. Additionally, we explore various conditioning methods to incorporate language information into the model. We apply analysis by language and combine it with the language classification performance. Our findings reveal that the multilingual model performs consistently better than the monolingual models trained on the language subsets. Furthermore, we demonstrate that incorporating language information significantly enhances performance.


title: The Topological Behavior of Preferential Attachment Graphs

abstract: We investigate the higher-order connectivity of scale-free networks using algebraic topology. We model scale-free networks as preferential attachment graphs, and we study the algebraic-topological properties of their clique complexes. We focus on the Betti numbers and the homotopy-connectedness of these complexes. We determine the asymptotic almost sure orders of magnitude of the Betti numbers. We also establish the occurence of homotopical phase transitions for the infinite complexes, and we determine the critical thresholds at which the homotopy-connectivity changes. This partially verifies Weinberger's conjecture on the homotopy type of the infinite complexes. We conjecture that the mean-normalized Betti numbers converge to power-law distributions, and we present numerical evidence. Our results also highlight the subtlety of the scaling limit of topology, which arises from the tension between topological operations and analytical limiting process. We discuss such tension at the end of the Introduction.


title: OCCAM: Online Continuous Controller Adaptation with Meta-Learned Models

abstract: Control tuning and adaptation present a significant challenge to the usage of robots in diverse environments. It is often nontrivial to find a single set of control parameters by hand that work well across the broad array of environments and conditions that a robot might encounter. Automated adaptation approaches must utilize prior knowledge about the system while adapting to significant domain shifts to find new control parameters quickly. In this work, we present a general framework for online controller adaptation that deals with these challenges. We combine meta-learning with Bayesian recursive estimation to learn prior predictive models of system performance that quickly adapt to online data, even when there is significant domain shift. These predictive models can be used as cost functions within efficient sampling-based optimization routines to find new control parameters online that maximize system performance. Our framework is powerful and flexible enough to adapt controllers for four diverse systems: a simulated race car, a simulated quadrupedal robot, and a simulated and physical quadrotor.


title: Quasiphase transition of a single-file water chain influenced by atomic charges in water model using orientational-biased replica exchange Monte Carlo simulations

abstract: The recently observed temperature-dependent quasiphase transition of the single-file water chain confined within a carbon nanotube in experiments has been validated by simple lattice theory and molecular dynamic simulations. It has been pointed out that atomic charges in water model is an important issue, yet how the values will affect the structural details and thermodynamic properties of the quasiphase transition has not been fully revealed. In this work, we performed orientational-biased replica exchange Monte Carlo simulations in the canonical ensemble to explore the effect of atomic charges in SPC/E water model on the quasiphase transition of a single-file water chain. Based on the atomic charge values reported from literature, three distinct quasiphases are reproduced, comprising a fully hydrogen-bonded water chain at lower temperatures, a more ordered dipolar orientation along the x-axis at intermediate temperatures, and a completely disordered structure at higher temperatures. Then by increasing the atomic charge value, we find that the fragmentation of the entire water chain into shorter water segments, the orientational ordering of water dipoles, and the transition towards complete disorder are all inhibited. Consequently, the transition temperatures between three quasiphases have been shifted to higher temperatures. The thermodynamic analysis demonstrates that the increased atomic charge values enhance the hydrogen bonding between neighbouring water molecules also the electrostatic attraction within the water chain, leading to a longer water dipole correlation length even at higher temperatures. These findings shed light on the vital role of atomic charges in water models and also the electrostatic interaction in regulating the orientational ordering of water molecules under nanoconfinement.


title: Recurrence and transience of the critical random walk snake in random conductances

abstract: In this paper we study the recurrence and transience of the $\mathbb{Z}^d$-valued branching random walk in random environment indexed by a critical Bienaym\'e-Galton-Watson tree, conditioned to survive. The environment is made either of random conductances or of random traps on each vertex. We show that when the offspring distribution is non degenerate with a finite third moment and the environment satisfies some suitable technical assumptions, then the process is recurrent up to dimension four, and transient otherwise. The proof is based on a truncated second moment method, which only requires to have good estimates on the quenched Green's function. Notably, this provides an alternate proof to the previous argument of Benjamini and Curien in the case of a deterministic, homogeneous environment.


title: Cluster-glass behaviour and large magnetocaloric effect in frustrated hyperkagome ferromagnet Li$_2$MgMn$_3$O$_8$

abstract: A detailed study of the structural and magnetic properties of the spin-$3/2$ hyperkagome lattice compound Li$_2$MgMn$_3$O$_8$ is reported. This material shows ferromagnetic response below $T_{\rm C} \simeq 20.6$ K, the temperature almost three times lower than the Curie-Weiss temperature $\theta_{\rm CW} \simeq 56.6$ K. Density-functional band-structure calculations suggest that this reduction in $T_{\rm C}$ may be caused by long-range antiferromagnetic couplings that frustrate nearest-neighbor ferromagnetic couplings on the hyperkagome lattice. Large magnetocaloric effect is observed around the $T_{\rm C}$ with a maximum value of isothermal entropy change $\Delta S_{\rm m}\simeq 20$ J/kg-K and a maximum relative cooling power of $RCP\simeq 840$ J/kg for the 7 T magnetic field change. Critical analysis of the magnetization data and scaling analysis of the magnetocaloric effect suggest the 3D Heisenberg/XY universality class of the transition. The DC and AC magnetization measurements further reveal glassy nature of the ferromagnetic transition. A detailed study of the non-equilibrium dynamics via magnetic relaxation and memory effect measurements demonstrates that the system evolves through a large number of intermediate metastable states and manifests significant memory effect in the cluster-glass state.


title: Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models

abstract: As large language models (LLMs) appear to behave increasingly human-like in text-based interactions, more and more researchers become interested in investigating personality in LLMs. However, the diversity of psychological personality research and the rapid development of LLMs have led to a broad yet fragmented landscape of studies in this interdisciplinary field. Extensive studies across different research focuses, different personality psychometrics, and different LLMs make it challenging to have a holistic overview and further pose difficulties in applying findings to real-world applications. In this paper, we present a comprehensive review by categorizing current studies into three research problems: self-assessment, exhibition, and recognition, based on the intrinsic characteristics and external manifestations of personality in LLMs. For each problem, we provide a thorough analysis and conduct in-depth comparisons of their corresponding solutions. Besides, we summarize research findings and open challenges from current studies and further discuss their underlying causes. We also collect extensive publicly available resources to facilitate interested researchers and developers. Lastly, we discuss the potential future research directions and application scenarios. Our paper is the first comprehensive survey of up-to-date literature on personality in LLMs. By presenting a clear taxonomy, in-depth analysis, promising future directions, and extensive resource collections, we aim to provide a better understanding and facilitate further advancements in this emerging field.


title: Using skateboarding to develop a culturally relevant tutorial on static equilibrium

abstract: Culturally relevant pedagogy (CRP), initially developed by Ladson-Billings, is an instructional framework for supporting diverse learners by drawing on their cultural backgrounds and experiences. In line with the CRP framework, we developed a tutorial on static equilibrium using skateboarding, a popular activity on university campuses, as a culturally relevant context. To address specific student conceptions about static equilibrium documented in the physics education research (PER) literature, we used the elicit-confront-resolve (ECR) strategy to develop the tutorial. In this paper, we provide a detailed account of how we operationalized the ECR strategy in designing the sequences of questions in the tutorial. Additionally, we present anecdotal evidence to show that the culturally relevant tutorial appears to effectively engage students and motivate their interest in learning physics.


title: CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference

abstract: As large language models (LLMs) constantly evolve, ensuring their safety remains a critical research problem. Previous red-teaming approaches for LLM safety have primarily focused on single prompt attacks or goal hijacking. To the best of our knowledge, we are the first to study LLM safety in multi-turn dialogue coreference. We created a dataset of 1,400 questions across 14 categories, each featuring multi-turn coreference safety attacks. We then conducted detailed evaluations on five widely used open-source LLMs. The results indicated that under multi-turn coreference safety attacks, the highest attack success rate was 56% with the LLaMA2-Chat-7b model, while the lowest was 13.9% with the Mistral-7B-Instruct model. These findings highlight the safety vulnerabilities in LLMs during dialogue coreference interactions.


title: Querying Labeled Time Series Data with Scenario Programs

abstract: In order to ensure autonomous vehicles are safe for on-road deployment, simulation-based testing has become an integral complement to on-road testing. The rise in simulation testing and validation reflects a growing need to verify that AV behavior is consistent with desired outcomes even in edge case scenarios $-$ which may seldom or never appear in on-road testing data. This raises a critical question: to what extent are AV failures in simulation consistent with data collected from real-world testing? As a result of the gap between simulated and real sensor data (sim-to-real gap), failures in simulation can either be spurious (simulation- or simulator-specific issues) or relevant (safety-critical AV system issues). One possible method for validating if simulated time series failures are consistent with real world time series sensor data could involve retrieving instances of the failure scenario from a real-world time series dataset, in order to understand AV performance in these scenarios. Adopting this strategy, we propose a formal definition of what constitutes a match between a real-world labeled time series data item and a simulated scenario written from a fragment of the Scenic probabilistic programming language for simulation generation. With this definition of a match, we develop a querying algorithm that identifies the subset of a labeled time series dataset matching a given scenario. To allow this approach to be used to verify the safety of other cyber-physical systems (CPS), we present a definition and algorithm for matching scalable beyond the autonomous vehicles domain. Experiments demonstrate the precision and scalability of the algorithm for a set of challenging and uncommon time series scenarios identified from the nuScenes autonomous driving dataset. We include a full system implementation of the querying algorithm freely available for use across a wide range of CPS.


title: Video Inpainting Localization with Contrastive Learning

abstract: Deep video inpainting is typically used as malicious manipulation to remove important objects for creating fake videos. It is significant to identify the inpainted regions blindly. This letter proposes a simple yet effective forensic scheme for Video Inpainting LOcalization with ContrAstive Learning (ViLocal). Specifically, a 3D Uniformer encoder is applied to the video noise residual for learning effective spatiotemporal forensic features. To enhance the discriminative power, supervised contrastive learning is adopted to capture the local inconsistency of inpainted videos through attracting/repelling the positive/negative pristine and forged pixel pairs. A pixel-wise inpainting localization map is yielded by a lightweight convolution decoder with a specialized two-stage training strategy. To prepare enough training samples, we build a video object segmentation dataset of 2500 videos with pixel-level annotations per frame. Extensive experimental results validate the superiority of ViLocal over state-of-the-arts. Code and dataset will be available at https://github.com/multimediaFor/ViLocal.


title: Interpreting the Spectro-Temporal Properties of the Black Hole Candidate Swift J151857.0-572147 during its First Outburst in 2024

abstract: For the first time, in March 2024, the transient Galactic black hole candidate Swift J151857.0-572147 experienced an outburst. Using publicly available archived {\it Insight}-HXMT data, we analyze the timing and spectral features of this source. Through model fitting of the power density spectrum, we were able to extract the properties of quasi-periodic oscillations, and based on those properties, we have determined that the QPOs are of type C. We also conclude that the shock instabilities in the transonic advective accretion processes surrounding black holes may be the source of the QPOs. This shock instability could produce variabilities of flux up to 48 keV, as we checked from the QPO energy dependence. High-frequency QPO is not observed during this period. In the broad energy band of $2-100$ keV, simultaneous data from the three on-board instruments of \textit{Insight}-HXMT were used to perform the spectral analysis. A combination of models, including broken power-law, multi-color disk-blackbody continuum, interstellar absorption, and reflection in both neutral and ionized medium were needed for spectral fitting to obtain the best fit. We discovered that at the beginning of the analysis period, the source was in an intermediate state and was transitioning toward the softer states based on the spectral features. It has a hydrogen column density of $(4.3-6.9) \times 10^{22}$ cm$^{-2}$.


title: KANQAS: Kolmogorov Arnold Network for Quantum Architecture Search

abstract: Quantum architecture search~(QAS) is a promising direction for optimization and automated design of quantum circuits towards quantum advantage. Recent techniques in QAS focus on machine learning-based approaches from reinforcement learning, like deep Q-network. While multi-layer perceptron-based deep Q-networks have been applied for QAS, their interpretability remains challenging due to the high number of parameters. In this work, we evaluate the practicality of KANs in quantum architecture search problems, analyzing their efficiency in terms of the probability of success, frequency of optimal solutions and their dependencies on various degrees of freedom of the network. In a noiseless scenario, the probability of success and the number of optimal quantum circuit configurations to generate the multi-qubit maximally entangled states are significantly higher than MLPs. Moreover in noisy scenarios, KAN can achieve a better fidelity in approximating maximally entangled state than MLPs, where the performance of the MLP significantly depends on the choice of activation function. Further investigation reveals that KAN requires a very small number of learnable parameters compared to MLPs, however, the average time of executing each episode for KAN is much higher.


title: Tight Toughness and Isolated Toughness for $\{K_2,C_n\}$-factor critical avoidable graph

abstract: A spannning subgraph $F$ of $G$ is a $\{K_2,C_n\}$-factor if each component of $F$ is either $K_{2}$ or $C_{n}$. A graph $G$ is called a $(\{K_2,C_n\},n)$-factor critical avoidable graph if $G-X-e$ has a $\{K_2,C_n\}$-factor for any $S\subseteq V(G)$ with $|X|=n$ and $e\in E(G-X)$. In this paper, we first obtain a sufficient condition with regard to isolated toughness of a graph $G$ such that $G$ is $\{K_2,C_{n}\}$-factor critical avoidable. In addition, we give a sufficient condition with regard to tight toughness and isolated toughness of a graph $G$ such that $G$ is $\{K_2,C_{2i+1}|i \geqslant 2\}$-factor critical avoidable respectively.


title: Transient spin modes from relaxational axial kinetic theory

abstract: We study the dynamics of spin mode by solving the axial kinetic equations under the relaxation time approximation in the presence of dissipative sources. We find transient spin modes in response to electric field with spacetime inhomogeneity, fluid acceleration and shear. To the lowest order in spatial gradient $k$, we find the responses to electric field and acceleration can be interpreted as retarded response to time variations of magnetic field and vorticity respectively. The response to shear can lead to a global spin polarization suppressed by powers of $k$. Beyond lowest order, the responses to all three sources are non-local with branch cut in the dispersions. We argue that the non-locality is a consequence of the quasi-particle picture underlying the kinetic description. We also analyze the mixing between spin modes and shear modes alone using the response we have obtained, finding the spin modes split into three with two of them developing oscillatory behavior. The correction to damping dispersions occur at $O(k^{4/3})$, which is parametrically larger than the existing one due to mixing of spin modes with shear and vorticity modes. It also indicates possible breakdown of gradient expansion.


title: Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels

abstract: Computational social science (CSS) practitioners often rely on human-labeled data to fine-tune supervised text classifiers. We assess the potential for researchers to augment or replace human-generated training data with surrogate training labels from generative large language models (LLMs). We introduce a recommended workflow and test this LLM application by replicating 14 classification tasks and measuring performance. We employ a novel corpus of English-language text classification data sets from recent CSS articles in high-impact journals. Because these data sets are stored in password-protected archives, our analyses are less prone to issues of contamination. For each task, we compare supervised classifiers fine-tuned using GPT-4 labels against classifiers fine-tuned with human annotations and against labels from GPT-4 and Mistral-7B with few-shot in-context learning. Our findings indicate that supervised classification models fine-tuned on LLM-generated labels perform comparably to models fine-tuned with labels from human annotators. Fine-tuning models using LLM-generated labels can be a fast, efficient and cost-effective method of building supervised text classifiers.


title: Topological Classification of Symmetry Breaking and Vacuum Degeneracy

abstract: We argue that a general system of scalar fields and gauge fields manifesting vacuum degeneracy induces a principal groupoid bundle over spacetime and that the pattern of spontaneous symmetry breaking and the Higgs mechanism are encoded by the singular foliation canonically induced on the moduli space of scalar vacuum expectation values by the Lie groupoid structure. Recent mathematical results in the classification of singular foliations then provide a qualitative classification of the possible patterns of vacuum degeneracy.


title: Higgs Mass Predictions in the CP-Violating High-Scale NMSSM

abstract: In a supersymmetric theory, large mass hierarchies can lead to large uncertainties in fixed-order calculations of the Standard Model (SM)-like Higgs mass. A reliable prediction is then obtained by performing the calculation in an effective field theory (EFT) framework, involving a matching to the full supersymmetric theory at the high scale to include contributions from the heavy particles, and a subsequent renormalisation-group running down to the low scale. We report on the prediction of the SM-like Higgs mass within the CP-violating Next-to-Minimal Supersymmetric extension of the SM (NMSSM) in a scenario where all non-SM particles feature TeV-scale masses. The matching conditions are calculated at full one-loop order using two approaches. These are the matching of the quartic Higgs couplings as well as of the SM-like Higgs pole masses of the low- and high-scale theory. A comparison between the two methods allows us to estimate the size of terms suppressed by the heavy mass scale that are neglected in a pure EFT calculation as given by the quartic-coupling matching. Furthermore, we study the different sources of uncertainty which enter our calculation as well as the effect of CP-violating phases on the Higgs mass prediction. The matching calculation is implemented in a new version of the public program package NMSSMCALC.


title: Aligning Diffusion Models with Noise-Conditioned Perception

abstract: Recent advancements in human preference optimization, initially developed for Language Models (LMs), have shown promise for text-to-image Diffusion Models, enhancing prompt alignment, visual appeal, and user preference. Unlike LMs, Diffusion Models typically optimize in pixel or VAE space, which does not align well with human perception, leading to slower and less efficient training during the preference alignment stage. We propose using a perceptual objective in the U-Net embedding space of the diffusion model to address these issues. Our approach involves fine-tuning Stable Diffusion 1.5 and XL using Direct Preference Optimization (DPO), Contrastive Preference Optimization (CPO), and supervised fine-tuning (SFT) within this embedding space. This method significantly outperforms standard latent-space implementations across various metrics, including quality and computational cost. For SDXL, our approach provides 60.8\% general preference, 62.2\% visual appeal, and 52.1\% prompt following against original open-sourced SDXL-DPO on the PartiPrompts dataset, while significantly reducing compute. Our approach not only improves the efficiency and quality of human preference alignment for diffusion models but is also easily integrable with other optimization techniques. The training code and LoRA weights will be available here: https://huggingface.co/alexgambashidze/SDXL\_NCP-DPO\_v0.1


title: Nowcasting in triple-system estimation

abstract: When samples that each cover part of a population for a certain reference date become available slowly over time, an estimate of the population size can be obtained when at least two samples are available. Ideally one uses all the available samples, but if some samples become available much later one may want to use the samples that are available earlier, to obtain a preliminary or nowcast estimate. However, a limited number of samples may no longer lead to asymptotically unbiased estimates, in particularly in case of two early available samples that suffer from pairwise dependence. In this paper we propose a multiple system nowcasting model that deals with this issue by combining the early available samples with samples from a previous reference date and the expectation-maximisation algorithm. This leads to a nowcast estimate that is asymptotically unbiased under more relaxed assumptions than the dual-system estimator. The multiple system nowcasting model is applied to the problem of estimating the number of homeless people in The Netherlands, which leads to reasonably accurate nowcast estimates.


title: Towards Hypernuclei from Nuclear Lattice Effective Field Theory

abstract: Understanding the strong interactions within baryonic systems beyond the up and down quark sector is pivotal for a comprehensive description of nuclear forces. This study explores the interactions involving hyperons, particularly the $\Lambda$ particle, within the framework of nuclear lattice effective field theory (NLEFT). By incorporating $\Lambda$ hyperons into the NLEFT framework, we extend our investigation into the $S = -1$ sector, allowing us to probe the third dimension of the nuclear chart. We calculate the $\Lambda$ separation energies ($B_{\Lambda}$) of hypernuclei up to the medium-mass region, providing valuable insights into hyperon-nucleon ($YN$) and hyperon-nucleon-nucleon ($YNN$) interactions. Our calculations employ high-fidelity chiral interactions at N${}^3$LO for nucleons and extend it to $\Lambda$ hyperons with leading-order S-wave $YN$ interactions as well as $YNN$ forces constrained only by the $A=4,5$ systems. Our results contribute to a deeper understanding of the SU(3) symmetry breaking and establish a foundation for future improvements in hypernuclear calculations.


title: Mitigate the Gap: Investigating Approaches for Improving Cross-Modal Alignment in CLIP

abstract: Contrastive Language--Image Pre-training (CLIP) has manifested remarkable improvements in zero-shot classification and cross-modal vision-language tasks. Yet, from a geometrical point of view, the CLIP embedding space has been found to have a pronounced modality gap. This gap renders the embedding space overly sparse and disconnected, with different modalities being densely distributed in distinct subregions of the hypersphere. In this work, we aim at answering two main questions: 1. Does sharing the parameter space between the multi-modal encoders reduce the modality gap? 2. Can the gap be mitigated by pushing apart the uni-modal embeddings via intra-modality separation? We design AlignCLIP, in order to answer these questions and show that answers to both questions are positive. Through extensive experiments, we show that AlignCLIP achieves noticeable enhancements in the cross-modal alignment of the embeddings, and thereby, reduces the modality gap, while maintaining the performance across several downstream evaluations, such as zero-shot image classification, zero-shot multi-modal retrieval and zero-shot semantic text similarity.


title: BayTTA: Uncertainty-aware medical image classification with optimized test-time augmentation using Bayesian model averaging

abstract: Test-time augmentation (TTA) is a well-known technique employed during the testing phase of computer vision tasks. It involves aggregating multiple augmented versions of input data. Combining predictions using a simple average formulation is a common and straightforward approach after performing TTA. This paper introduces a novel framework for optimizing TTA, called BayTTA (Bayesian-based TTA), which is based on Bayesian Model Averaging (BMA). First, we generate a model list associated with different variations of the input data created through TTA. Then, we use BMA to combine model predictions weighted by their respective posterior probabilities. Such an approach allows one to take into account model uncertainty, and thus to enhance the predictive performance of the related machine learning or deep learning model. We evaluate the performance of BayTTA on various public data, including three medical image datasets comprising skin cancer, breast cancer, and chest X-ray images and two well-known gene editing datasets, CRISPOR and GUIDE-seq. Our experimental results indicate that BayTTA can be effectively integrated into state-of-the-art deep learning models used in medical image analysis as well as into some popular pre-trained CNN models such as VGG-16, MobileNetV2, DenseNet201, ResNet152V2, and InceptionRes-NetV2, leading to the enhancement in their accuracy and robustness performance.


title: The experience of humans' and robots' mutual (im)politeness in enacted service scenarios: An empirical study

abstract: The paper reports an empirical study of the effect of human treatment of a robot on the social perception of the robot's behavior. The study employed an enacted interaction between an anthropomorphic "waiter" robot and two customers. The robot and one of the customers (acted out by a researcher) were following four different interaction scripts, representing all combinations of mutual politeness and impoliteness of the robot and the customer. The participants (N=24, within-subject design) were assigned the role of an "included observer", that is, a fellow customer who was present in the situation without being actively involved in the interactions. The participants assessed how they experienced the interaction scenarios by providing Likert scale scores and free-text responses. The results indicate that while impolite robots' behavior was generally assessed negatively, it was commonly perceived as more justifiable and fairer if the robot was treated impolitely by the human. Politeness reciprocity expectations in the context of the social perception of robots are discussed.


title: Banishing LLM Hallucinations Requires Rethinking Generalization

abstract: Despite their powerful chat, coding, and reasoning abilities, Large Language Models (LLMs) frequently hallucinate. Conventional wisdom suggests that hallucinations are a consequence of a balance between creativity and factuality, which can be mitigated, but not eliminated, by grounding the LLM in external knowledge sources. Through extensive systematic experiments, we show that these traditional approaches fail to explain why LLMs hallucinate in practice. Specifically, we show that LLMs augmented with a massive Mixture of Memory Experts (MoME) can easily memorize large datasets of random numbers. We corroborate these experimental findings with a theoretical construction showing that simple neural networks trained to predict the next token hallucinate when the training loss is above a threshold as it usually does in practice when training on internet scale data. We interpret our findings by comparing against traditional retrieval methods for mitigating hallucinations. We use our findings to design a first generation model for removing hallucinations -- Lamini-1 -- that stores facts in a massive mixture of millions of memory experts that are retrieved dynamically.


title: Circular motion in (anti-)de Sitter spacetime: thermality versus finite size

abstract: Anti-de Sitter spacetime and the static patch of de Sitter spacetime are arenas for investigating thermal and finite-size effects seen by an accelerated quantum observer. We consider an Unruh-DeWitt detector in uniform circular motion coupled to a conformal scalar field in $(2+1)$-dimensional de Sitter and anti-de Sitter spacetimes in the limit of a small cosmological constant $\Lambda$. In anti-de Sitter spacetime, where $\Lambda$ mimics spatial confinement, we find that the resonance peaks in the detector's response closely match those of a detector in Minkowski space with a cylindrical boundary, but with curvature corrections, more significant when the field has an ambient temperature. In the static patch of de Sitter spacetime, in the Euclidean vacuum, we show that the leading curvature correction to the detector's response is proportional to $\Lambda$, as in zero temperature anti-de Sitter, whilst the temperature corrections decay exponentially as $\Lambda \to 0$.


title: Numerical simulations for the SAXO+ upgrade: Performance analysis of the adaptive optics system

abstract: SPHERE, operating at the VLT since 2014, is currently one of the high-contrast instruments with a higher performance. Its adaptive optics system, known as SAXO, will be upgraded to SAXO+, which features the addition of a second stage of adaptive optics. This stage will use a near-infrared pyramid wavefront sensor to record images of fainter exoplanets around redder stars. In this work, we compare the performance of SAXO and SAXO+. We look for the optimal values of the key system parameters of SAXO+ for various science cases and turbulence conditions. We performed numerical simulations using COMPASS, an end-to-end adaptive optics simulation tool. We simulated perfect coronagraph images of an on-axis point source, and we minimized the residual starlight intensity between 3 and 5 ${\lambda}/D$ as a performance criterion. The explored parameter space includes science cases, turbulence conditions, and key system parameters. In every science case and turbulence condition, SAXO+ reduces the residual starlight intensity inside the correction zone of the second stage by a factor of ten compared to SAXO. The optimal first stage gain is lower for SAXO+ than for SAXO alone. We quantified the gain in performance of SAXO+ when changing the second stage frequency from 2 kHz to 3 kHz, and we conclude that 2 kHz may be sufficient for most realistic conditions. We give the optimal first stage gain as well as the first and second stage frequencies for every seeing, coherence time, and science case. Finally, we find that a 2 ${\lambda_{\mathrm{WFS}}}/D$ pyramid modulation radius is a good trade-off between performance and robustness against varying turbulence conditions. This study shows that the future SAXO+ system will outperform the current SAXO system in all studied cases.


title: Simulating moir\'e quantum matter with neural network

abstract: Moir\'e materials provide an ideal platform for exploring quantum phases of matter. However, solving the many-electron problem in moir\'e systems is challenging due to strong correlation effects. We introduce a powerful variational representation of quantum states, many-body neural Bloch wavefunction, to solve many-electron problems in moir\'e materials accurately and efficiently. Applying our method to the semiconductor heterobilayer WSe2/WS2 , we obtain a generalized Wigner crystal at filling factor n = 1/3, a Mott insulator n = 1, and a correlated insulator with local magnetic moments and antiferromagnetic spin correlation at n = 2. Our neural network approach improves the simulation accuracy of strongly interacting moir\'e materials and paves the way for discovery of new quantum phases with variational learning principle in a unified framework.


title: Stellar s-process neutron capture cross section of Ce isotopes

abstract: Stellar abundances of cerium are of high current interest based both on observations and theoretical models, especially with regard to the neutron--magic $^{140}$Ce isotope. A large discrepancy of $s-$process stellar models relative to cerium abundance observed in globular clusters was highlighted, pointing to possible uncertainties in experimental nuclear reaction rates. In this work, the stellar neutron capture cross section of the stable cerium isotopes $^{136}$Ce, $^{138}$Ce, $^{140}$Ce, and $^{142}$Ce, were re-measured. A $^{nat}$Ce sample was irradiated with quasi-Maxwellian neutrons at $kT = 34.2$ keV using the $^{7}$Li($p,n$) reaction. The neutron field with an intensity of $3-5 \times 10^{10}$ n/s was produced by irradiating the liquid-lithium target (LiLiT) with a mA proton beam at an energy (1.92 MeV) just above the threshold at Soreq Applied Research Accelerator Facility (SARAF). The activities of the $^{nat}$Ce neutron capture products were measured using a shielded High Purity Germanium detector. Cross sections were extracted relative to that of the $^{197}$Au(n,$\gamma$) reaction and the Maxwellian-averaged cross section (MACS) of the Ce isotopes were derived. The MACS values extracted from this experiment are generally consistent with previous measurements and show for $^{140}$Ce a value $\approx 15$\% smaller than most recent experimental values.


title: Variationist: Exploring Multifaceted Variation and Bias in Written Language Data

abstract: Exploring and understanding language data is a fundamental stage in all areas dealing with human language. It allows NLP practitioners to uncover quality concerns and harmful biases in data before training, and helps linguists and social scientists to gain insight into language use and human behavior. Yet, there is currently a lack of a unified, customizable tool to seamlessly inspect and visualize language variation and bias across multiple variables, language units, and diverse metrics that go beyond descriptive statistics. In this paper, we introduce Variationist, a highly-modular, extensible, and task-agnostic tool that fills this gap. Variationist handles at once a potentially unlimited combination of variable types and semantics across diversity and association metrics with regards to the language unit of choice, and orchestrates the creation of up to five-dimensional interactive charts for over 30 variable type-semantics combinations. Through our case studies on computational dialectology, human label variation, and text generation, we show how Variationist enables researchers from different disciplines to effortlessly answer specific research questions or unveil undesired associations in language data. A Python library, code, documentation, and tutorials are made publicly available to the research community.


title: Revising Properties of Planet-Host Binary Systems. IV. The Radius Distribution of Small Planets in Binary Star Systems is Dependent on Stellar Separation

abstract: Small planets ($R_{p} \leq 4 R_{\oplus}$) are divided into rocky super-Earths and gaseous sub-Neptunes separated by a radius gap, but the mechanisms that produce these distinct planet populations remain unclear. Binary stars are the only main-sequence systems with an observable record of the protoplanetary disk lifetime and mass reservoir, and the demographics of planets in binaries may provide insights into planet formation and evolution. To investigate the radius distribution of planets in binary star systems, we observed 207 binary systems hosting 283 confirmed and candidate transiting planets detected by the Kepler mission, then recharacterized the planets while accounting for the observational biases introduced by the secondary star. We found that the population of planets in close binaries ($\rho \leq 100$ au) is significantly different from the planet population in wider binaries ($\rho > 300$ au) or single stars. In contrast to planets around single stars, planets in close binaries appear to have a unimodal radius distribution with a peak near the expected super-Earth peak of $R_{p} \sim 1.3 R_{\oplus}$ and a suppressed population of sub-Neptunes. We conclude that we are observing the direct impact of a reduced disk lifetime, smaller mass reservoir, and possible altered distribution of solids reducing the sub-Neptune formation efficiency. Our results demonstrate the power of binary stars as a laboratory for exploring planet formation and as a controlled experiment of the impact of varied initial conditions on mature planet populations.


title: Privacy Preserving Reinforcement Learning for Population Processes

abstract: We consider the problem of privacy protection in Reinforcement Learning (RL) algorithms that operate over population processes, a practical but understudied setting that includes, for example, the control of epidemics in large populations of dynamically interacting individuals. In this setting, the RL algorithm interacts with the population over $T$ time steps by receiving population-level statistics as state and performing actions which can affect the entire population at each time step. An individual's data can be collected across multiple interactions and their privacy must be protected at all times. We clarify the Bayesian semantics of Differential Privacy (DP) in the presence of correlated data in population processes through a Pufferfish Privacy analysis. We then give a meta algorithm that can take any RL algorithm as input and make it differentially private. This is achieved by taking an approach that uses DP mechanisms to privatize the state and reward signal at each time step before the RL algorithm receives them as input. Our main theoretical result shows that the value-function approximation error when applying standard RL algorithms directly to the privatized states shrinks quickly as the population size and privacy budget increase. This highlights that reasonable privacy-utility trade-offs are possible for differentially private RL algorithms in population processes. Our theoretical findings are validated by experiments performed on a simulated epidemic control problem over large population sizes.


title: ELIZA Reinterpreted: The world's first chatbot was not intended as a chatbot at all

abstract: ELIZA, often considered the world's first chatbot, was written by Joseph Weizenbaum in the early 1960s. Weizenbaum did not intend to invent the chatbot, but rather to build a platform for research into human-machine conversation and the important cognitive processes of interpretation and misinterpretation. His purpose was obscured by ELIZA's fame, resulting in large part from the fortuitous timing of it's creation, and it's escape into the wild. In this paper I provide a rich historical context for ELIZA's creation, demonstrating that ELIZA arose from the intersection of some of the central threads in the technical history of AI. I also briefly discuss how ELIZA escaped into the world, and how its accidental escape, along with several coincidental turns of the programming language screws, led both to the misapprehension that ELIZA was intended as a chatbot, and to the loss of the original ELIZA to history for over 50 years.


title: Leveraging Large Language Models for Software Model Completion: Results from Industrial and Public Datasets

abstract: Modeling structure and behavior of software systems plays a crucial role in the industrial practice of software engineering. As with other software engineering artifacts, software models are subject to evolution. Supporting modelers in evolving software models with recommendations for model completions is still an open problem, though. In this paper, we explore the potential of large language models for this task. In particular, we propose an approach, retrieval-augmented generation, leveraging large language models, model histories, and retrieval-augmented generation for model completion. Through experiments on three datasets, including an industrial application, one public open-source community dataset, and one controlled collection of simulated model repositories, we evaluate the potential of large language models for model completion with retrieval-augmented generation. We found that large language models are indeed a promising technology for supporting software model evolution (62.30% semantically correct completions on real-world industrial data and up to 86.19% type-correct completions). The general inference capabilities of large language models are particularly useful when dealing with concepts for which there are few, noisy, or no examples at all.


title: Time-varying Extremum Graphs

abstract: We introduce time-varying extremum graph (TVEG), a topological structure to support visualization and analysis of a time-varying scalar field. The extremum graph is a substructure of the Morse-Smale complex. It captures the adjacency relationship between cells in the Morse decomposition of a scalar field. We define the TVEG as a time-varying extension of the extremum graph and demonstrate how it captures salient feature tracks within a dynamic scalar field. We formulate the construction of the TVEG as an optimization problem and describe an algorithm for computing the graph. We also demonstrate the capabilities of \TVEG towards identification and exploration of topological events such as deletion, generation, split, and merge within a dynamic scalar field via comprehensive case studies including a viscous fingers and a 3D von K\'arm\'an vortex street dataset.


title: Algorithmic Fault Tolerance for Fast Quantum Computing

abstract: Fast, reliable logical operations are essential for the realization of useful quantum computers, as they are required to implement practical quantum algorithms at large scale. By redundantly encoding logical qubits into many physical qubits and using syndrome measurements to detect and subsequently correct errors, one can achieve very low logical error rates. However, for most practical quantum error correcting (QEC) codes such as the surface code, it is generally believed that due to syndrome extraction errors, multiple extraction rounds -- on the order of the code distance d -- are required for fault-tolerant computation. Here, we show that contrary to this common belief, fault-tolerant logical operations can be performed with constant time overhead for a broad class of QEC codes, including the surface code with magic state inputs and feed-forward operations, to achieve "algorithmic fault tolerance". Through the combination of transversal operations and novel strategies for correlated decoding, despite only having access to partial syndrome information, we prove that the deviation from the ideal measurement result distribution can be made exponentially small in the code distance. We supplement this proof with circuit-level simulations in a range of relevant settings, demonstrating the fault tolerance and competitive performance of our approach. Our work sheds new light on the theory of fault tolerance, potentially reducing the space-time cost of practical fault-tolerant quantum computation by orders of magnitude.


title: MDHA: Multi-Scale Deformable Transformer with Hybrid Anchors for Multi-View 3D Object Detection

abstract: Multi-view 3D object detection is a crucial component of autonomous driving systems. Contemporary query-based methods primarily depend either on dataset-specific initialization of 3D anchors, introducing bias, or utilize dense attention mechanisms, which are computationally inefficient and unscalable. To overcome these issues, we present MDHA, a novel sparse query-based framework, which constructs adaptive 3D output proposals using hybrid anchors from multi-view, multi-scale input. Fixed 2D anchors are combined with depth predictions to form 2.5D anchors, which are projected to obtain 3D proposals. To ensure high efficiency, our proposed Anchor Encoder performs sparse refinement and selects the top-k anchors and features. Moreover, while existing multi-view attention mechanisms rely on projecting reference points to multiple images, our novel Circular Deformable Attention mechanism only projects to a single image but allows reference points to seamlessly attend to adjacent images, improving efficiency without compromising on performance. On the nuScenes val set, it achieves 46.4% mAP and 55.0% NDS with a ResNet101 backbone. MDHA significantly outperforms the baseline, where anchor proposals are modelled as learnable embeddings.


title: Hartogs type extension theorem for the complement of effective and numerically effective divisors

abstract: In these notes we generalize the Ohsawa's results on the Hartogs extension phenomenon in the complement of effective divisors in K\"ahler manifolds with semipositive non-flat normal bundle. Namely, we prove that the Hartogs extension phenomenon occurs in the complement of effective and nef divisors with connected supports in K\"ahler manifolds. We use homological algebra methods instead of a construction of the $(n-1)$-convex exhaustion function. Also, the Demailly-Peternell vanishing theorem is a crucial argument for us. Moreover, we obtain geometric characterizations of the Hartogs phenomenon for the complement of basepoint-free divisors.


title: Optimization of Approximate Maps for Linear Systems Arising in Discretized PDEs

abstract: Generally, discretization of partial differential equations (PDEs) creates a sequence of linear systems $A_k x_k = b_k, k = 0, 1, 2, ..., N$ with well-known and structured sparsity patterns. Preconditioners are often necessary to achieve fast convergence When solving these linear systems using iterative solvers. We can use preconditioner updates for closely related systems instead of computing a preconditioner for each system from scratch. One such preconditioner update is the sparse approximate map (SAM), which is based on the sparse approximate inverse preconditioner using a least squares approximation. A SAM then acts as a map from one matrix in the sequence to another nearby one for which we have an effective preconditioner. To efficiently compute an effective SAM update (i.e., one that facilitates fast convergence of the iterative solver), we seek to compute an optimal sparsity pattern. In this paper, we examine several sparsity patterns for computing the SAM update to characterize optimal or near-optimal sparsity patterns for linear systems arising from discretized PDEs.


title: A Multidimensional Rado Theorem

abstract: We extend Deuber's theorem on $(m,p,c)$-sets to hold over the multidimensional positive integer lattices. This leads to a multidimensional Rado theorem where we are guaranteed monochromatic multidimensional points in all finite colorings of $\left(\mathbb{Z}^+\right)^d$ where the $i^{\mathrm{th}}$ set of coordinates satisfies the $i^{\mathrm{th}}$ given linear Rado system.


title: Systematic integral evaluation for spin-resummed binary dynamics

abstract: Computation of spin-resummed observables in post-Minkowskian dynamics typically involve evaluation of Feynman integrals deformed by an exponential factor, where the exponent is a linear sum of the momenta being integrated. Such integrals can be viewed as tensor integral generating functions, which provide alternative approaches to tensor reduction of Feynman integrals. We develop a systematic method to evaluate tensor integral generating functions using conventional multiloop integration techniques. The spin-resummed aligned-spin eikonal at second post-Minkowskian order is considered as a phenomenologically relevant example where evaluation of tensor integral generating functions is necessary.


title: DKPROMPT: Domain Knowledge Prompting Vision-Language Models for Open-World Planning

abstract: Vision-language models (VLMs) have been applied to robot task planning problems, where the robot receives a task in natural language and generates plans based on visual inputs. While current VLMs have demonstrated strong vision-language understanding capabilities, their performance is still far from being satisfactory in planning tasks. At the same time, although classical task planners, such as PDDL-based, are strong in planning for long-horizon tasks, they do not work well in open worlds where unforeseen situations are common. In this paper, we propose a novel task planning and execution framework, called DKPROMPT, which automates VLM prompting using domain knowledge in PDDL for classical planning in open worlds. Results from quantitative experiments show that DKPROMPT outperforms classical planning, pure VLM-based and a few other competitive baselines in task completion rate.


title: Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients

abstract: Large language model (LLM) training and finetuning are often bottlenecked by limited GPU memory. While existing projection-based optimization methods address this by projecting gradients into a lower-dimensional subspace to reduce optimizer state memory, they typically rely on dense projection matrices, which can introduce computational and memory overheads. In this work, we propose Grass (GRAdient Stuctured Sparsification), a novel approach that leverages sparse projections to transform gradients into structured sparse updates. This design not only significantly reduces memory usage for optimizer states but also minimizes gradient memory footprint, computation, and communication costs, leading to substantial throughput improvements. Extensive experiments on pretraining and finetuning tasks demonstrate that Grass achieves competitive performance to full-rank training and existing projection-based methods. Notably, Grass enables half-precision pretraining of a 13B parameter LLaMA model on a single 40GB A100 GPU--a feat infeasible for previous methods--and yields up to a $2\times$ throughput improvement on an 8-GPU system. Code can be found at https://github.com/aashiqmuhamed/GRASS .


title: Neuro-Modeling Infused EMT Analytics

abstract: The paper presents a systematic approach to developing Physics-Informed neuro-Models (PIM) for the transient analysis of power grids interconnected with renewables. PIM verifies itself as an adequate digital twin of power components, taking full advantage of physical constraints while requiring only a small fraction of data for training. Three new contributions are presented: 1) An PINN-enabled neuro-modeling approach is devised to construct an accurate EMT model; 2) A data-physics hybrid learning approach is substantiated to demonstrate its data efficiency and adaptability at various levels of data; 3) A balanced-adaptive PIM exemplifies its applicability when multiple terms are predicted simultaneously while maintaining alignment with physical principles. Under various operational scenarios, tests on rotating and static electric components as well as an IEEE test system verifies the efficacy and efficiency of the new learning-infused transient grid analytics.


title: A piezoelectric ski-jump laser beam scanning chip-to-free space photonic link

abstract: A seamless interface between integrated photonic processors and targets in free-space enables wide-ranging advancements in telescopy, free-space communication, optical ranging, materials processing, biomedical imaging, near eye display, machine optical intelligence and quantum control. An optimal solution allows for 2D scanning from anywhere on a photonic chip over a large number of diffraction limited spots in the far field. Leading approaches rely on scanners where the numerical aperture and actuator size are linked, resulting in a trade off between resolution, speed and footprint, whereas scanning fibers have been limited to bulk optical and mechanical components. Here, we introduce a CMOS fabricated photonic "ski-jump" composed of a broadband, single mode silicon nitride waveguide monolithically integrated atop a piezo-actuated cantilever. The ski-jump passively curl 90 degrees out-of-plane via mechanical meta-stress engineering in a footprint of less than 0.1 mm squared and emit submicron diffraction-limited optical modes with piezoelectric steering. They also exhibit kHz-rate longitudinal and lateral mechanical resonances with displacement ranges exceeding 400 micron and 180 micron, respectively, and quality factors Q>10,000 under vacuum. These resonances enable 2D beam scanning at footprint-adjusted spot-rates of 68.6 Megaspot/s-mm squared surpassing state-of-the-art MEMS mirrors by more than 50. Using these devices, we demonstrate arbitrary 2D image projection and the repeatable initialization and readout of single photons from silicon vacancies in diamond waveguides. Based on current device performance, we identify pathways for achieving >1 Giga-spots in a square cm area to provide a seamless, scalable optical pipeline between integrated photonic processors and the free-space world.


title: LLM-ARC: Enhancing LLMs with an Automated Reasoning Critic

abstract: We introduce LLM-ARC, a neuro-symbolic framework designed to enhance the logical reasoning capabilities of Large Language Models (LLMs), by combining them with an Automated Reasoning Critic (ARC). LLM-ARC employs an Actor-Critic method where the LLM Actor generates declarative logic programs along with tests for semantic correctness, while the Automated Reasoning Critic evaluates the code, runs the tests and provides feedback on test failures for iterative refinement. Implemented using Answer Set Programming (ASP), LLM-ARC achieves a new state-of-the-art accuracy of 88.32% on the FOLIO benchmark which tests complex logical reasoning capabilities. Our experiments demonstrate significant improvements over LLM-only baselines, highlighting the importance of logic test generation and iterative self-refinement. We achieve our best result using a fully automated self-supervised training loop where the Actor is trained on end-to-end dialog traces with Critic feedback. We discuss potential enhancements and provide a detailed error analysis, showcasing the robustness and efficacy of LLM-ARC for complex natural language reasoning tasks.


title: Magnetic Force Microscopy: High Quality Factor Two-Pass Mode

abstract: Magnetic force microscopy (MFM) is a well-established technique in scanning probe microscopy (SPM) that allows the imaging of magnetic samples with spatial resolution of tens of nm and stray fields down to the mT range. Spatial resolution and field sensitivity can be improved significantly by measuring in vacuum conditions. This effect originates from the higher quality factor (Q-factor) of the cantilevers oscillation in vacuum compared to ambient conditions. However, while high Q-factors are desirable as they directly improve the magnetic measurement signal, they pose a challenge when pursuing a standard MFM two-pass (lift) mode measurement. At high Q-factors amplitude-based topography measurements become impossible and MFM phase response behaves non-linear. Here we present an implementation of a modified two-pass mode into a vacuum atomic force microscope (AFM) that overcomes these issues. By controlling Q in the first pass and using a phase-locked loop (PLL) technique in the second pass, high Q-factor measurements in vacuum are enabled. By measuring the cantilevers frequency shift instead of phase shift, otherwise emerging non-linearities are eliminated. The achievable improvements in resolution and sensitivity are demonstrated on patterned magnetic nanostructured samples. Elimination of non-linear response is showcased by a measurement of a very well-known calculable multilayer reference sample that is used for tip calibration in quantitative MFM (qMFM).


title: Perovskite nanocrystal self-assemblies in 3D hollow templates

abstract: Highly ordered nanocrystal (NC) assemblies, namely superlattices (SLs), have been investigated as novel building blocks of optical and optoelectronic devices due to their unique properties based on interactions among neighboring NCs. In particular, lead halide perovskite NC SLs have attracted significant attention, owing to their extraordinary optical characteristics of individual NCs and collective emission processes like superfluorescence (SF). So far, the primary method for preparing perovskite NC SLs has been the drying-mediated self-assembly method, in which the colloidal NCs spontaneously assemble into SLs during solvent evaporation. However, this method lacks controllability because NCs form random-sized SLs at random positions on the substrate rendering NC assemblies in conjunction with device structures such as photonic waveguides or microcavities challenging. Here, we demonstrate template-assisted self-assembly to deterministically place perovskite NC SLs and control their geometrical properties. A solution of CsPbBr3 NCs is drop-casted on a substrate with lithographically-defined hollow structures. After solvent evaporation and removal of excess NCs from the substrate surface, NCs only remain in the templates thereby defining the position and size of these NC assemblies. We performed photoluminescence (PL) measurements on these NC assemblies and observed signatures of SF, similar as in spontaneously assembled SLs. Our findings are crucial for optical devices that harness embedded perovskite NC assemblies and prepare fundamental studies on how these collective effects can be tailored through the SL geometry.

categories: cond-mat.soft cond-mat.mes-hall physics.app-ph physics.chem-ph


title: Transformer-based segmentation of adnexal lesions and ovarian implants in CT images

abstract: Two self-supervised pretrained transformer-based segmentation models (SMIT and Swin UNETR) fine-tuned on a dataset of ovarian cancer CT images provided reasonably accurate delineations of the tumors in an independent test dataset. Tumors in the adnexa were segmented more accurately by both transformers (SMIT and Swin UNETR) than the omental implants. AI-assisted labeling performed on 72 out of 245 omental implants resulted in smaller manual editing effort of 39.55 mm compared to full manual correction of partial labels of 106.49 mm and resulted in overall improved accuracy performance. Both SMIT and Swin UNETR did not generate any false detection of omental metastases in the urinary bladder and relatively few false detections in the small bowel, with 2.16 cc on average for SMIT and 7.37 cc for Swin UNETR respectively.


title: This Paper Had the Smartest Reviewers -- Flattery Detection Utilising an Audio-Textual Transformer-Based Approach

abstract: Flattery is an important aspect of human communication that facilitates social bonding, shapes perceptions, and influences behavior through strategic compliments and praise, leveraging the power of speech to build rapport effectively. Its automatic detection can thus enhance the naturalness of human-AI interactions. To meet this need, we present a novel audio textual dataset comprising 20 hours of speech and train machine learning models for automatic flattery detection. In particular, we employ pretrained AST, Wav2Vec2, and Whisper models for the speech modality, and Whisper TTS models combined with a RoBERTa text classifier for the textual modality. Subsequently, we build a multimodal classifier by combining text and audio representations. Evaluation on unseen test data demonstrates promising results, with Unweighted Average Recall scores reaching 82.46% in audio-only experiments, 85.97% in text-only experiments, and 87.16% using a multimodal approach.


title: The blow-down map in Lie algebroid cohomology

abstract: We study the blow-down map in cohomology in the context of real projective blowups of Lie algebroids. Using the blow-down map in cohomology we compute the Lie algebroid cohomology of the blowup of transversals of arbitrary codimension, generalising the Mazzeo-Melrose theorem on b-cohomology. To prove the result we develop a Gysin sequence for Lie algebroids. As another example we use the developed tools to compute the Lie algebroid cohomology of the action Lie algebroid $\mathfrak{so}(3)\ltimes \mathbb{R}^3$, a result known in Poisson geometry literature. Moreover, we use similar techniques to compute the de Rham cohomology of real projective blowups.


title: Capacity-Achieving Gray Codes

abstract: To ensure differential privacy, one can reveal an integer fuzzily in two ways: (a) add some Laplace noise to the integer, or (b) encode the integer as a binary string and add iid BSC noise. The former is simple and natural while the latter is flexible and affordable, especially when one wants to reveal a sparse vector of integers. In this paper, we propose an implementation of (b) that achieves the capacity of the BSC with positive error exponents. Our implementation adds error-correcting functionality to Gray codes by mimicking how software updates back up the files that are getting updated ("coded Gray code"). In contrast, the old implementation of (b) interpolates between codewords of a black-box error-correcting code ("Grayed code").


title: Brain Tumor Classification using Vision Transformer with Selective Cross-Attention Mechanism and Feature Calibration

abstract: Brain tumor classification is a challenging task in medical image analysis. In this paper, we propose a novel approach to brain tumor classification using a vision transformer with a novel cross-attention mechanism. Our approach leverages the strengths of transformers in modeling long-range dependencies and multi-scale feature fusion. We introduce two new mechanisms to improve the performance of the cross-attention fusion module: Feature Calibration Mechanism (FCM) and Selective Cross-Attention (SCA). FCM calibrates the features from different branches to make them more compatible, while SCA selectively attends to the most informative features. Our experiments demonstrate that the proposed approach outperforms other state-of-the-art methods in brain tumor classification, achieving improved accuracy and efficiency. The proposed FCM and SCA mechanisms can be easily integrated into other vision transformer architectures, making them a promising direction for future research in medical image analysis. Experimental results confirm that our approach surpasses existing methods, achieving state-of-the-art performance in brain tumor classification tasks.


title: Unraveling the binary nature of HQ Tau: A brown dwarf companion revealed using multi-variate Gaussian process

abstract: Context. Both the stellar activity and the accretion processes of young stellar objects can induce variations in their radial velocity (RV). This variation is often modulated on the stellar rotation period and may hide a RV signal from a planetary or even a stellar companion. Aims. The aim of this study is to detect the companion of HQ Tau, the existence of which is suspected based on our previous study of this object. We also aim to derive the orbital elements of the system. Methods. We used multi-variate Gaussian process regression on the RV and the bisector inverse slope of a six-month high-resolution spectroscopic follow-up observation of the system to model the stellar activity. This allowed us to extract the Keplerian RV modulation induced by the suspected companion. Results. Our analysis yields the detection of a $\sim$50 M$_{\rm jup}$ brown dwarf companion orbiting HQ Tau with a $\sim$126 day orbital period. Although this is consistent with the modulation seen on this dataset, it does not fit the measurements from our previous work three years earlier. In order to include these measurements in our analysis, we hypothesise the presence of a third component with orbital elements that are consistent with those of the secondary according to our previous analysis (M$_{\rm B}$ $\sim$48 M$_{\rm jup}$, P$_{\rm orb,B}$ $\sim$126 days), and a $\sim$465 M$_{\rm jup}$ tertiary with a $\sim$767 day orbital period. However, the hypothesis of a single companion with M$_{\rm B}$ $\sim$188 M$_{\rm jup}$ and P$_{\rm orb}$ $\sim$247 days can fit both datasets and cannot be completely excluded at this stage of the analysis. Conclusions. At minima, HQ Tau is a single-lined spectroscopic binary, and several factors indicate that the companion is a brown dwarf and that a third component is responsible for larger RV variation on a longer timescale.


title: SpecMaskGIT: Masked Generative Modeling of Audio Spectrograms for Efficient Audio Synthesis and Beyond

abstract: Recent advances in generative models that iteratively synthesize audio clips sparked great success to text-to-audio synthesis (TTA), but with the cost of slow synthesis speed and heavy computation. Although there have been attempts to accelerate the iterative procedure, high-quality TTA systems remain inefficient due to hundreds of iterations required in the inference phase and large amount of model parameters. To address the challenges, we propose SpecMaskGIT, a light-weighted, efficient yet effective TTA model based on the masked generative modeling of spectrograms. First, SpecMaskGIT synthesizes a realistic 10s audio clip by less than 16 iterations, an order-of-magnitude less than previous iterative TTA methods. As a discrete model, SpecMaskGIT outperforms larger VQ-Diffusion and auto-regressive models in the TTA benchmark, while being real-time with only 4 CPU cores or even 30x faster with a GPU. Next, built upon a latent space of Mel-spectrogram, SpecMaskGIT has a wider range of applications (e.g., the zero-shot bandwidth extension) than similar methods built on the latent wave domain. Moreover, we interpret SpecMaskGIT as a generative extension to previous discriminative audio masked Transformers, and shed light on its audio representation learning potential. We hope our work inspires the exploration of masked audio modeling toward further diverse scenarios.


title: LaTable: Towards Large Tabular Models

abstract: Tabular data is one of the most ubiquitous modalities, yet the literature on tabular generative foundation models is lagging far behind its text and vision counterparts. Creating such a model is hard, due to the heterogeneous feature spaces of different tabular datasets, tabular metadata (e.g. dataset description and feature headers), and tables lacking prior knowledge (e.g. feature order). In this work we propose LaTable: a novel tabular diffusion model that addresses these challenges and can be trained across different datasets. Through extensive experiments we find that LaTable outperforms baselines on in-distribution generation, and that finetuning LaTable can generate out-of-distribution datasets better with fewer samples. On the other hand, we explore the poor zero-shot performance of LaTable, and what it may teach us about building generative tabular foundation models with better zero- and few-shot generation capabilities.


title: Optimal partial transport for metric pairs

abstract: In this article we study Figalli and Gigli's formulation of optimal transport between non-negative Radon measures in the setting of metric pairs. We carry over classical characterisations of optimal plans to this setting and prove that the resulting spaces of measures, $\mathcal{M}_p(X,A)$, are complete, separable and geodesic whenever the underlying space, $X$, is so. We also prove that, for $p>1$, $\mathcal{M}_p(X,A)$ preserves the property of being non-branching, and for $p=2$ it preserves non-negative curvature in the Alexandrov sense. Finally, we prove isometric embeddings of generalised spaces of persistence diagrams $\mathcal{D}_p(X,A)$ into the corresponding spaces $\mathcal{M}_p(X,A)$, generalising a result by Divol and Lacombe. As an application of this framework, we show that several known geometric properties of spaces of persistence diagrams follow from those of $\mathcal{M}_p(X,A)$, including the fact that $\mathcal{D}_2(X,A)$ is an Alexandrov space of non-negative curvature whenever $X$ is a proper non-negatively curved Alexandrov space.


title: Quantifying AI Psychology: A Psychometrics Benchmark for Large Language Models

abstract: Large Language Models (LLMs) have demonstrated exceptional task-solving capabilities, increasingly adopting roles akin to human-like assistants. The broader integration of LLMs into society has sparked interest in whether they manifest psychological attributes, and whether these attributes are stable-inquiries that could deepen the understanding of their behaviors. Inspired by psychometrics, this paper presents a framework for investigating psychology in LLMs, including psychological dimension identification, assessment dataset curation, and assessment with results validation. Following this framework, we introduce a comprehensive psychometrics benchmark for LLMs that covers six psychological dimensions: personality, values, emotion, theory of mind, motivation, and intelligence. This benchmark includes thirteen datasets featuring diverse scenarios and item types. Our findings indicate that LLMs manifest a broad spectrum of psychological attributes. We also uncover discrepancies between LLMs' self-reported traits and their behaviors in real-world scenarios. This paper demonstrates a thorough psychometric assessment of LLMs, providing insights into reliable evaluation and potential applications in AI and social sciences.


title: Understanding phase transitions of $\alpha$-quartz under dynamic compression conditions by machine-learning driven atomistic simulations

abstract: Characteristic shock effects in silica serve as a key indicator of historical impacts at geological sites. Despite this geological significance, atomistic details of structural transformations under high pressure and shock compression remain poorly understood. This ambiguity is evidenced by conflicting experimental observations of both amorphization and crystallization transitions. Utilizing a newly developed machine-learning interatomic potential, we examine the response of $\alpha$-quartz to shock compression with a peak pressure of 60 GPa over nano-second timescales. We initially observe amorphization before recrystallization into a d-NiAs-structured silica with disorder on the silicon sublattice, accompanied by the formation of domains with partial order of silicon. Investigating a variety of strain conditions enables us to identify the non-hydrostatic stress and strain states that allow the direct diffusionless formation of rosiaite-structured silica.


title: Lifting of locally initial objects and universal (co)acting Hopf algebras

abstract: The universal (co)acting bi/Hopf algebras introduced by Yu.\,I.~Manin, M.~Sweedler and D.~Tambara, the universal Hopf algebra of a given (co)module structure, as well as the universal group of a grading, introduced by J.~Patera and H.~Zassenhaus, find their applications in the classification of quantum symmetries. Typically, universal (co)acting objects are defined as initial or terminal in the corresponding categories and, as such, they do not always exist. In order to ensure their existence, we introduce the support of a given object, which generalizes the support of a grading and is used to restrict the class of objects under consideration. The existence problems for universal objects are formulated and studied in a purely categorical manner by seeing them as particular cases of the lifting problem for a locally initial object. We prove the existence of a lifting and, consequently, of the universal (co)acting objects under some assumptions on the base (braided or symmetric monoidal) category. In contrast to existing constructions, our approach is self-dual in the sense that we can use the same proof to obtain the existence of universal actions and coactions. In particular, when the base category is the category of vector spaces over a field, the category of sets or their duals, we recover known existence results for the aforementioned universal objects. The proposed approach allows us to apply our results not only to the classical categories of sets and vectors spaces and their duals but also to (co)modules over bi/Hopf algebras, differential graded vector spaces, $G$-sets and graded sets.


title: X-Shooting ULLYSES: Massive Stars at low metallicity VIII. Stellar and wind parameters of newly revealed stripped stars in Be binaries

abstract: On the route towards merging neutron stars and stripped-envelope supernovae, binary population synthesis predicts a large number of post-interaction systems with massive stars that have stripped off their outer layers. Yet, observations of such stars in the intermediate-mass regime below the Wolf-Rayet masses are rare. Using X-Shooting ULLYSES (XShootU) data, we discovered three partially stripped star + Be/Oe binaries in the Magellanic Clouds. We analyzed the UV and optical spectra using the PoWR model atmosphere code by superimposing model spectra corresponding to each component. The estimated current masses of the partially stripped stars fall within the intermediate mass range of 4-8 $M_{\odot}$. These objects are overluminous for their stellar masses, matching core He-burning luminosities. Their Be/Oe secondaries have much higher masses than their stripped primaries (mass ratio > 2). All three partially stripped stars show significant nitrogen enrichment and carbon and oxygen depletion on their surfaces. Additionally, one of our sample stars exhibits significant helium enrichment. Our study provides the first comprehensive determination of the wind parameters of partially stripped stars in the intermediate mass range. The wind mass-loss rates of these stars are found to be on the order of $10^{-7} M_\odot$ yr$^{-1}$, which is over ten times higher than that of OB stars of the same luminosity. Current evolutionary models characterizing this phase typically employ OB or WR mass-loss rates, which underestimate or overestimate stripped stars' mass-loss rates by an order of magnitude. Binary evolution models indicate that the observed primaries had initial masses of 12-17 $M_{\odot}$, making them potential candidates for stripped-envelope supernovae that form neutron stars. If they survive the explosion, these systems may become Be X-ray binaries and later double neutron stars.


title: Local-to-Global Cross-Modal Attention-Aware Fusion for HSI-X Semantic Segmentation

abstract: Hyperspectral image (HSI) classification has recently reached its performance bottleneck. Multimodal data fusion is emerging as a promising approach to overcome this bottleneck by providing rich complementary information from the supplementary modality (X-modality). However, achieving comprehensive cross-modal interaction and fusion that can be generalized across different sensing modalities is challenging due to the disparity in imaging sensors, resolution, and content of different modalities. In this study, we propose a Local-to-Global Cross-modal Attention-aware Fusion (LoGoCAF) framework for HSI-X classification that jointly considers efficiency, accuracy, and generalizability. LoGoCAF adopts a pixel-to-pixel two-branch semantic segmentation architecture to learn information from HSI and X modalities. The pipeline of LoGoCAF consists of a local-to-global encoder and a lightweight multilayer perceptron (MLP) decoder. In the encoder, convolutions are used to encode local and high-resolution fine details in shallow layers, while transformers are used to integrate global and low-resolution coarse features in deeper layers. The MLP decoder aggregates information from the encoder for feature fusion and prediction. In particular, two cross-modality modules, the feature enhancement module (FEM) and the feature interaction and fusion module (FIFM), are introduced in each encoder stage. The FEM is used to enhance complementary information by combining the feature from the other modality across direction-aware, position-sensitive, and channel-wise dimensions. With the enhanced features, the FIFM is designed to promote cross-modality information interaction and fusion for the final semantic prediction. Extensive experiments demonstrate that our LoGoCAF achieves superior performance and generalizes well. The code will be made publicly available.


title: End-to-End Autonomous Driving without Costly Modularization and 3D Manual Annotation

abstract: We propose UAD, a method for vision-based end-to-end autonomous driving (E2EAD), achieving the best open-loop evaluation performance in nuScenes, meanwhile showing robust closed-loop driving quality in CARLA. Our motivation stems from the observation that current E2EAD models still mimic the modular architecture in typical driving stacks, with carefully designed supervised perception and prediction subtasks to provide environment information for oriented planning. Although achieving groundbreaking progress, such design has certain drawbacks: 1) preceding subtasks require massive high-quality 3D annotations as supervision, posing a significant impediment to scaling the training data; 2) each submodule entails substantial computation overhead in both training and inference. To this end, we propose UAD, an E2EAD framework with an unsupervised proxy to address all these issues. Firstly, we design a novel Angular Perception Pretext to eliminate the annotation requirement. The pretext models the driving scene by predicting the angular-wise spatial objectness and temporal dynamics, without manual annotation. Secondly, a self-supervised training strategy, which learns the consistency of the predicted trajectories under different augment views, is proposed to enhance the planning robustness in steering scenarios. Our UAD achieves 38.7% relative improvements over UniAD on the average collision rate in nuScenes and surpasses VAD for 41.32 points on the driving score in CARLA's Town05 Long benchmark. Moreover, the proposed method only consumes 44.3% training resources of UniAD and runs 3.4 times faster in inference. Our innovative design not only for the first time demonstrates unarguable performance advantages over supervised counterparts, but also enjoys unprecedented efficiency in data, training, and inference. Code and models will be released at https://github.com/KargoBot_Research/UAD.


title: VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation

abstract: As large language models achieve impressive scores on traditional benchmarks, an increasing number of researchers are becoming concerned about benchmark data leakage during pre-training, commonly known as the data contamination problem. To ensure fair evaluation, recent benchmarks release only the training and validation sets, keeping the test set labels closed-source. They require anyone wishing to evaluate his language model to submit the model's predictions for centralized processing and then publish the model's result on their leaderboard. However, this submission process is inefficient and prevents effective error analysis. To address this issue, we propose to variabilize benchmarks and evaluate language models dynamically. Specifically, we extract variables from each test case and define a value range for each variable. For each evaluation, we sample new values from these value ranges to create unique test cases, thus ensuring a fresh evaluation each time. We applied this variable perturbation method to four datasets: GSM8K, ARC, CommonsenseQA, and TruthfulQA, which cover mathematical generation and multiple-choice tasks. Our experimental results demonstrate that this approach provides a more accurate assessment of the true capabilities of language models, effectively mitigating the contamination problem.


title: Efficient classical algorithm for simulating boson sampling with inhomogeneous partial distinguishability

abstract: Boson sampling is one of the leading protocols for demonstrating a quantum advantage, but the theory of how this protocol responds to noise is still incomplete. We extend the theory of classical simulation of boson sampling with partial distinguishability to the case where the degree of indistinguishability between photon pairs is different between different pairs.


title: Asymptotic Properties of Random Homology Induced by Diffusion Processes

abstract: We investigate the asymptotic behavior, in the long time limit, of the random homology associated to realizations of stochastic diffusion processes on a compact Riemannian manifold. In particular a rigidity result is established: if the rate is quadratic, then the manifold is a locally trivial fiber bundle over a flat torus, with fibers being minimal in a weighted sense (that is, regarding the manifold as a metric measured space, with the invariant probability being the weight measure). Surprisingly, this entails that at least for some classes of manifolds, the homology of non-reversible processes relaxes to equilibrium slower than its reversible counterpart (as opposed to the respective empirical measure, which relaxes faster).


title: Dualities for universal (co)acting Hopf monoids

abstract: In general, universal (co)measuring (co)monoids and universal (co)acting bi/Hopf monoids, which prove to be a useful tool in the classification of quantum symmetries, do not always exist. In order to ensure their existence, the support of a given object was recently introduced in \cite{AGV3} and used to restrict the class of objects considered when defining universal (co)acting objects. It is well-known that, in contrast with the universal coacting Hopf algebra, for actions on algebras over a field it is usually difficult to describe the universal acting Hopf algebra explicitly and this turns the duality theorem into an important investigation tool. In the present paper we establish duality results for universal (co)measuring (co)monoids and universal (co)acting bi/Hopf monoids in pre-rigid braided monoidal categories $\mathcal C$. In addition, when the base category $\mathcal C$ is closed monoidal, we provide a convenient uniform approach to the aforementioned universal objects in terms of the cosupports, which in this case become subobjects of internal hom-objects. In order to explain our constructions, we use the language of locally initial objects. Known results from the literature are recovered when the base category is the category of vector spaces over a field. New cases where our results can be applied are explored, including categories of (co)modules over (co)quasitriangular Hopf algebras, Yetter-Drinfeld modules and dg-vector spaces.


title: CMBFSCNN: Cosmic Microwave Background Polarization Foreground Subtraction with Convolutional Neural Network

abstract: In our previous study, we introduced a machine-learning technique, namely CMBFSCNN, for the removal of foreground contamination in cosmic microwave background (CMB) polarization data. This method was successfully employed on actual observational data from the Planck mission. In this study, we extend our investigation by considering the CMB lensing effect in simulated data and utilizing the CMBFSCNN approach to recover the CMB lensing B-mode power spectrum from multi-frequency observational maps. Our method is first applied to simulated data with the performance of CMB-S4 experiment. We achieve reliable recovery of the noisy CMB Q (or U) maps with a mean absolute difference of $0.016\pm0.008\ \mu$K (or $0.021\pm0.002\ \mu$K) for the CMB-S4 experiment. To address the residual instrumental noise in the foreground-cleaned map, we employ a "half-split maps" approach, where the entire dataset is divided into two segments sharing the same sky signal but having uncorrelated noise. Using cross-correlation techniques between two recovered half-split maps, we effectively reduce instrumental noise effects at the power spectrum level. As a result, we achieve precise recovery of the CMB EE and lensing B-mode power spectra. Furthermore, we also extend our pipeline to full-sky simulated data with the performance of LiteBIRD experiment. As expected, various foregrounds are cleanly removed from the foreground contamination observational maps, and recovered EE and lensing B-mode power spectra exhibit excellent agreement with the true results. Finally, we discuss the dependency of our method on the foreground models.


title: The wave-like disk oscillations of mono-age stellar populations in the Solar neighbourhood from Gaia DR3

abstract: The North-South asymmetry in the number density and bulk velocity of stars in the solar neighborhood provides valuable insights into the formation and evolution of the Milky Way disk. Our objective is to investigate the wave-like disk oscillations of mono-age stellar populations in the Solar neighbourhood using data from Gaia Data Release 3. We have selected a comprehensive sample of main sequence turn off stars. The ages of these stars can be accurately determined using isochrone fitting methods. Our findings indicate that the north-south density and mean vertical velocity asymmetries remain consistent across all age groups.The uniformity of perturbations across all subsamples suggests that all populations are responding to the same external influence, which likely affects them irrespective of their age. Moreover, the fact that these perturbations appear consistently implies they could be either ongoing or recent. Regarding vertical velocity dispersions, we observe that older stars exhibit larger dispersions.


title: Optical Spectropolarimetric Variability Properties in Blazars PKS 0637-75 and PKS 1510-089

abstract: Spectropolarimetry is a powerful tool to investigate the central regions of active galactic nuclei (AGNs) as polarization signatures are key to probing magnetic field structure, evolution, and the physics of particle acceleration in jets. Optical linear polarization of blazars is typically greater than a few percent, indicating the emission is dominated by nonthermal synchrotron radiation, while polarization less than a few percent is common for other type 1 AGNs. We present a spectropolarimetric study of PKS 0637-75 and PKS 1510-089 to determine how the head-on orientation of a jet and dominant emission processes influence polarimetric variations in the broad lines and continuum. Observations were obtained biweekly from the Robert Stobie Spectrograph on the Southern African Large Telescope. Variability in the continuum polarization is detected for both PKS 0637-75 and PKS 1510-089, with a total average level of 2.5% +/- 0.1% and 7.5% +/- 0.1%, respectively. There is no clear polarization in the broad Balmer emission lines and weak polarization in Mg II as the average level across all observations is 0.2% +/- 0.1% for Hbeta, 0.2% +/- 0.3% for Hgamma, and 0.6% +/- 0.2% for Mg II. We find that polarization measurements confirm the conclusions drawn from spectral energy distribution modeling of the disk-jet contributions to the emission as optical polarization and time variability for PKS 0637-75 are shown to be dominated by accretion disk emission while those of PKS 1510-089 are due to both disk and jet emission, with greater jet contribution during flaring states.


title: Unified Auto-Encoding with Masked Diffusion

abstract: At the core of both successful generative and self-supervised representation learning models there is a reconstruction objective that incorporates some form of image corruption. Diffusion models implement this approach through a scheduled Gaussian corruption process, while masked auto-encoder models do so by masking patches of the image. Despite their different approaches, the underlying similarity in their methodologies suggests a promising avenue for an auto-encoder capable of both de-noising tasks. We propose a unified self-supervised objective, dubbed Unified Masked Diffusion (UMD), that combines patch-based and noise-based corruption techniques within a single auto-encoding framework. Specifically, UMD modifies the diffusion transformer (DiT) training process by introducing an additional noise-free, high masking representation step in the diffusion noising schedule, and utilizes a mixed masked and noised image for subsequent timesteps. By integrating features useful for diffusion modeling and for predicting masked patch tokens, UMD achieves strong performance in downstream generative and representation learning tasks, including linear probing and class-conditional generation. This is achieved without the need for heavy data augmentations, multiple views, or additional encoders. Furthermore, UMD improves over the computational efficiency of prior diffusion based methods in total training time. We release our code at https://github.com/philippe-eecs/small-vision.


title: Robust Gray Codes Approaching the Optimal Rate

abstract: Robust Gray codes were introduced by (Lolck and Pagh, SODA 2024). Informally, a robust Gray code is a (binary) Gray code $\mathcal{G}$ so that, given a noisy version of the encoding $\mathcal{G}(j)$ of an integer $j$, one can recover $\hat{j}$ that is close to $j$ (with high probability over the noise). Such codes have found applications in differential privacy. In this work, we present near-optimal constructions of robust Gray codes. In more detail, we construct a Gray code $\mathcal{G}$ of rate $1 - H_2(p) - \varepsilon$ that is efficiently encodable, and that is robust in the following sense. Supposed that $\mathcal{G}(j)$ is passed through the binary symmetric channel $\text{BSC}_p$ with cross-over probability $p$, to obtain $x$. We present an efficient decoding algorithm that, given $x$, returns an estimate $\hat{j}$ so that $|j - \hat{j}|$ is small with high probability.


title: On Explicit Solutions for Coupled Reaction-Diffusion and Burgers-Type Equations with Variable Coefficients Through a Riccati System

abstract: This work is concerned with the study of explicit solutions for generalized coupled reaction-diffusion and Burgers-type systems with variable coefficients. Including nonlinear models with variable coefficients such as diffusive Lotka-Volterra model, the Gray-Scott model, the Burgers equations. The equations' integrability (via the explicit formulation of the solutions) is accomplished by using similarity transformations and requiring that the coefficients fulfill a Riccati system. We present traveling wave type solutions, as well as solutions with more complex dynamics and relevant features such as bending. A Mathematica file has been prepared as supplementary material, verifying the Riccati systems used in the construction of the solutions.


title: A sharp quantitative Alexandrov inequality and applications to volume preserving geometric flows in 3D

abstract: We study the asymptotic behavior of the volume preserving mean curvature and the Mullins-Sekerka flat flow in three dimensional space. Motivated by this we establish a 3D sharp quantitative version of the Alexandrov inequality for $C^2$-regular sets with a perimeter bound.


title: From Distributional to Overton Pluralism: Investigating Large Language Model Alignment

abstract: The alignment process changes several properties of a large language model's (LLM's) output distribution. We analyze two aspects of post-alignment distributional shift of LLM responses. First, we re-examine previously reported reductions in response diversity post-alignment. Our analysis suggests that an apparent drop in the diversity of responses is largely explained by quality control and information aggregation. Alignment suppresses irrelevant and unhelpful content while shifting the output distribution toward longer responses that cover information spanning several responses from the base LLM, essentially presenting diverse information in a single response. Finding little evidence that alignment suppresses useful information, it is natural to ask the opposite question: do aligned models surface information that cannot be recovered from base models? Our second investigation shows this is not the case and the behavior of aligned models is recoverable from base models without fine-tuning. A combination of in-context examples and lower-resolution semantic hints about response content can elicit responses from base LLMs that are as similar to alignment-tuned LLM responses as alignment-tuned LLM responses are to each other. Taken together, these results indicate that current alignment techniques capture but do not extend the useful subset of assistant-like base LLM behavior, providing further evidence for the Superficial Alignment Hypothesis. They also show that in-context alignment can go surprisingly far as a strategy for imitating aligned LLMs without fine-tuning. Our code and data is available at https://github.com/thomlake/investigating-alignment.


title: Positive and monotone fragments of FO and LTL

abstract: We study the positive logic FO+ on finite words, and its fragments, pursuing and refining the work initiated in [Kuperberg 2023]. First, we transpose notorious logic equivalences into positive first-order logic: FO+ is equivalent to LTL+ , and its two-variable fragment FO2+ with (resp. without) successor available is equivalent to UTL+ with (resp. without) the "next" operator X available. This shows that despite previous negative results, the class of FO+-definable languages exhibits some form of robustness. We then exhibit an example of an FO-definable monotone language on one predicate, that is not FO+-definable, refining the example from [Kuperberg 2023] with 3 predicates. Moreover, we show that such a counter-example cannot be FO2-definable.


title: Protecting the 'Stop Using My Data' Right through Blockchain-assisted Evidence Generation

abstract: In order to provide personalized services to users, Internet-based platforms collect and utilize user-generated behavioral data. Although the 'stop using my data' right should be a fundamental data right, which allows individuals to request their personal data to be no longer utilized by online platforms, the existing preventive data protection measures (e.g., cryptographic data elimination, differential privacy) are unfortunately not applicable. This work aims to develop the first Evidence Generation Framework for deterring post-acquisition data right violations. We formulated the 'stop using my data' problem, which captures a vantage facet of the multi-faceted notion of 'right to be forgotten'. We designed and implemented the first blockchain-assisted system to generate evidence for deterring the violations of the 'stop using my data' right. Our system employs a novel two-stage evidence generation protocol whose efficacy is ensured by a newly proposed Lemma. To validate our framework, we conducted a case study on recommendation systems with systematic evaluation experiments using two real-world datasets: the measured success rate exceeds 99%.