title: Isotropy of cosmic rays beyond $10^{20}$ eV favors their heavy mass composition

abstract: We report an estimation of the injected mass composition of ultra-high energy cosmic rays (UHECRs) at energies higher than 10 EeV. The composition is inferred from an energy-dependent sky distribution of UHECR events observed by the Telescope Array surface detector by comparing it to the Large Scale Structure of the local Universe. In the case of negligible extra-galactic magnetic fields the results are consistent with a relatively heavy injected composition at E ~ 10 EeV that becomes lighter up to E ~ 100 EeV, while the composition at E > 100 EeV is very heavy. The latter is true even in the presence of highest experimentally allowed extra-galactic magnetic fields, while the composition at lower energies can be light if a strong EGMF is present. The effect of the uncertainty in the galactic magnetic field on these results is subdominant.


title: Task-splitting in home healthcare routing and scheduling

abstract: This paper introduces the concept of task-splitting into home healthcare (HHC) routing and scheduling. It focuses on the design of routes and timetables for caregivers providing services at patients' homes. Task-splitting is the division of a (lengthy) patient visit into separate visits that can be performed by different caregivers at different times. The resulting split parts may have reduced caregiver qualification requirements, relaxed visiting time windows, or a shorter/longer combined duration. However, additional temporal dependencies can arise between them. To incorporate task-splitting decisions into the planning process, we introduce two different mixed integer linear programming formulations, a Miller-Tucker-Zemlin and a time-indexed variant. These formulations aim to minimize operational costs while simultaneously deciding which visits to split and imposing a potentially wide range of temporal dependencies. We also propose pre-processing routines for the time-indexed formulation and two heuristic procedures. These methods are embedded into the branch-and-bound approach as primal and improvement heuristics. The results of our computational study demonstrate the additional computational difficulty introduced by task-splitting and the associated additional synchronization, and the usefulness of the proposed heuristic procedures. From a planning perspective, our results indicate that introducing task-splitting reduces staff requirements, decreases HHC operational costs, and allows caregivers to spend relatively more time on tasks aligned with their qualifications. Moreover, we observe that the potential of task-splitting is not specific to the chosen planning objective; it can also be beneficial when minimizing travel time instead.


title: Joint Channel and Data Estimation for Multiuser Extremely Large-Scale MIMO Systems

abstract: This paper proposes a joint channel and data estimation (JCDE) algorithm for uplink multiuser extremely large-scale multiple-input-multiple-output (XL-MIMO) systems. The initial channel estimation is formulated as a sparse reconstruction problem based on the angle and distance sparsity under the near-field propagation condition. This problem is solved using non-orthogonal pilots through an efficient low complexity two-stage compressed sensing algorithm. Furthermore, the initial channel estimates are refined by employing a JCDE framework driven by both non-orthogonal pilots and estimated data. The JCDE problem is solved by sequential expectation propagation (EP) algorithms, where the channel and data are alternately updated in an iterative manner. In the channel estimation phase, integrating Bayesian inference with a model-based deterministic approach provides precise estimations to effectively exploit the near-field characteristics in the beam-domain. In the data estimation phase, a linear minimum mean square error (LMMSE)-based filter is designed at each sub-array to address the correlation due to energy leakage in the beam-domain arising from the near-field effects. Numerical simulations reveal that the proposed initial channel estimation and JCDE algorithm outperforms the state-ofthe-art approaches in terms of channel estimation, data detection, and computational complexity.


title: Human Modelling and Pose Estimation Overview

abstract: Human modelling and pose estimation stands at the crossroads of Computer Vision, Computer Graphics, and Machine Learning. This paper presents a thorough investigation of this interdisciplinary field, examining various algorithms, methodologies, and practical applications. It explores the diverse range of sensor technologies relevant to this domain and delves into a wide array of application areas. Additionally, we discuss the challenges and advancements in 2D and 3D human modelling methodologies, along with popular datasets, metrics, and future research directions. The main contribution of this paper lies in its up-to-date comparison of state-of-the-art (SOTA) human pose estimation algorithms in both 2D and 3D domains. By providing this comprehensive overview, the paper aims to enhance understanding of 3D human modelling and pose estimation, offering insights into current SOTA achievements, challenges, and future prospects within the field.


title: Wikipedia Citations: Reproducible Citation Extraction from Multilingual Wikipedia

abstract: Wikipedia is an essential component of the open science ecosystem, yet it is poorly integrated with academic open science initiatives. Wikipedia Citations is a project that focuses on extracting and releasing comprehensive datasets of citations from Wikipedia. A total of 29.3 million citations were extracted from English Wikipedia in May 2020. Following this one-off research project, we designed a reproducible pipeline that can process any given Wikipedia dump in the cloud-based settings. To demonstrate its usability, we extracted 40.6 million citations in February 2023 and 44.7 million citations in February 2024. Furthermore, we equipped the pipeline with an adapted Wikipedia citation template translation module to process multilingual Wikipedia articles in 15 European languages so that they are parsed and mapped into a generic structured citation template. This paper presents our open-source software pipeline to retrieve, classify, and disambiguate citations on demand from a given Wikipedia dump.


title: From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data

abstract: Recent studies have shown that Large Language Models (LLMs) struggle to accurately retrieve information and maintain reasoning capabilities when processing long-context inputs. To address these limitations, we propose a finetuning approach utilizing a carefully designed synthetic dataset comprising numerical key-value retrieval tasks. Our experiments on models like GPT-3.5 Turbo and Mistral 7B demonstrate that finetuning LLMs on this dataset significantly improves LLMs' information retrieval and reasoning capabilities in longer-context settings. We present an analysis of the finetuned models, illustrating the transfer of skills from synthetic to real task evaluations (e.g., $10.5\%$ improvement on $20$ documents MDQA at position $10$ for GPT-3.5 Turbo). We also find that finetuned LLMs' performance on general benchmarks remains almost constant while LLMs finetuned on other baseline long-context augmentation data can encourage hallucination (e.g., on TriviaQA, Mistral 7B finetuned on our synthetic data cause no performance drop while other baseline data can cause a drop that ranges from $2.33\%$ to $6.19\%$). Our study highlights the potential of finetuning on synthetic data for improving the performance of LLMs on longer-context tasks.


title: Polarization-controlled Brillouin scattering in elliptical optophononic resonators

abstract: The fast-growing development of optomechanical applications has motivated advancements in Brillouin scattering research. In particular, the study of high frequency acoustic phonons at the nanoscale is interesting due to large range of interactions with other excitations in matter. However, standard Brillouin spectroscopy schemes rely on fixed wavelength filtering, which limits the usefulness for the study of tunable optophononic resonators. It has been recently demonstrated that elliptical optophononic micropillar resonators induce different energy-dependent polarization states for the Brillouin and the elastic Rayleigh scattering, and that a polarization filtering setup could be implemented to increase the contrast between the inelastic and elastic scattering of the light. An optimal filtering configuration can be reached when the polarization states of the laser and the Brillouin signal are orthogonal from each other. In this work, we theoretically investigate the parameters of such polarization-based filtering technique to enhance the efficiency of Brillouin scattering detection. For the filtering optimization, we explore the initial wavelength and polarization state of the incident laser, as well as in the ellipticity of the micropillars, and reach an almost optimal configuration for nearly background-free Brillouin detection. Our findings are one step forward on the efficient detection of Brillouin scattering in nanostructures for potential applications in fields such as optomechanics and quantum communication.


title: Short presentations for transformation monoids

abstract: Due to the theorems of Cayley and Vagner-Preston, the full transformation monoids and the symmetric inverse monoids play analogous roles in the theory of monoids and inverse monoids, as the symmetric group does in the theory of groups. Every presentation for the finite full transformation monoids $T_n$, symmetric inverse monoids $I_n$, and partial transformation monoids $PT_n$ contains a monoid presentation for the symmetric group. In this paper we show that the number of relations required, in addition to those for the symmetric group, for each of these monoids are at least $4$, $3$, and $8$, respectively. We also give presentations for: $T_n$ with $4$ additional relations when $n$ is odd and $n\geq 5$; and $5$ additional relations for all $n\geq 4$; for $I_n$ with $3$ additional relations for all $n \geq 3$; and for $PT_n$ with $9$ relations for all $n\geq 4$. The presentations for $T_n$ and $I_n$ answer open problems in the literature.


title: M31 nucleus: molecular and ionised gas content upper limits

abstract: We report NOEMA and ALMA observations of the nucleus of Andromeda (M31), putting strong constraints on the presence of gas in the form of cold or warm phase, as proposed by Chang et al. M31 hosts the largest supermassive black hole (SMBH) closer than 1 Mpc from us. Its nucleus is silent with some murmurs at the level of 4 10$^{-9}$ L$_{Edd}$, and is surrounded by a 5-pc-radius disk of old stars. The mass-loss from these stars is expected to fill a molecular gas disk within the tidal truncation of 1 pc (0.26"), of 10$^4$ Mo, corresponding to a CO(1-0) signal of 2mJy with a linewidth of 1000km/s. We observed the nucleus with NOEMA in CO(2-1) and with ALMA in CO(3-2) with angular resolutions of 0.5" (1.9 pc) and 0.12" (0.46 pc) respectively. We exclude the presence of gas with a 3$\sigma$ upper limit of 195 Mo. The CO(3-2) upper limit also constrains warm gas, escaping detection in CO(1-0). The scenario proposed by Chang et al. is not verified, and instead the hot gas, expelled by the stellar winds, might never cool nor fall onto the disc. Alternatively, the stellar wind mass-loss rate can have been overestimated by a factor 50, and/or the ionised gas escaped from the nucleus. The SMBH in M31 is obviously in a low state of activity, similar to what is observed for Sgr A* in the Milky Way (MW). Recently, a cool (10$^4$ K) ionised accretion disc has been detected around Sgr A* in the H30$\alpha$ recombination line with ALMA. Re-scaling sizes, masses and fluxes according to the mass of M31's black hole (35 times higher than in the MW) and the distances, a similar disc could be easily detectable around M31 nucleus with an expected signal 8 times weaker that the signal detected in SgrA*. We searched for an ionised gas disc around M31 nucleus with NOEMA, and put a 3$\sigma$ upper limit on the H30$\alpha$ recombination line at a level twice lower than expected with a simple scaling of the SgrA*.


title: Vehicle-to-Grid Technology meets Packetized Energy Management: A Co-Simulation Study

abstract: The global energy landscape is experiencing a significant transformation driven by increased awareness of climate change and rapid technological advancements in renewable energy and electric vehicles (EVs). Packetized energy management (PEM) schemes are gaining attention as a potential solution for power management for effective load control. This study presents the development of a co-simulation platform to investigate integration of vehicle-to-grid (V2G) with packetized energy trading (PET) in microgrid scenarios. The platform facilitates the interaction between EVs and prosumers, with a focus on responsive loads, and solar photovoltaic (PV) as intermittently available resources. Using the developed co-simulation, this study evaluates how V2G-capable EVs can enhance the stability and efficiency of PET-based microgrids. The results demonstrate the capability of V2G EVs to act as an energy reservoir, effectively managing demand-side load, thus mitigating its fluctuation from available supply while maintaining quality-of-service.


title: Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation

abstract: Continual learning focuses on incrementally training a model on a sequence of tasks with the aim of learning new tasks while minimizing performance drop on previous tasks. Existing approaches at the intersection of Continual Learning and Visual Question Answering (VQA) do not study how the multimodal nature of the input affects the learning dynamics of a model. In this paper, we demonstrate that each modality evolves at different rates across a continuum of tasks and that this behavior occurs in established encoder-only models as well as modern recipes for developing Vision & Language (VL) models. Motivated by this observation, we propose a modality-aware feature distillation (MAFED) approach which outperforms existing baselines across models of varying scale in three multimodal continual learning settings. Furthermore, we provide ablations showcasing that modality-aware distillation complements experience replay. Overall, our results emphasize the importance of addressing modality-specific dynamics to prevent forgetting in multimodal continual learning.


title: Compositional Image Decomposition with Diffusion Models

abstract: Given an image of a natural scene, we are able to quickly decompose it into a set of components such as objects, lighting, shadows, and foreground. We can then envision a scene where we combine certain components with those from other images, for instance a set of objects from our bedroom and animals from a zoo under the lighting conditions of a forest, even if we have never encountered such a scene before. In this paper, we present a method to decompose an image into such compositional components. Our approach, Decomp Diffusion, is an unsupervised method which, when given a single image, infers a set of different components in the image, each represented by a diffusion model. We demonstrate how components can capture different factors of the scene, ranging from global scene descriptors like shadows or facial expression to local scene descriptors like constituent objects. We further illustrate how inferred factors can be flexibly composed, even with factors inferred from other models, to generate a variety of scenes sharply different than those seen in training time. Website and code at https://energy-based-model.github.io/decomp-diffusion.


title: PNeRV: A Polynomial Neural Representation for Videos

abstract: Extracting Implicit Neural Representations (INRs) on video data poses unique challenges due to the additional temporal dimension. In the context of videos, INRs have predominantly relied on a frame-only parameterization, which sacrifices the spatiotemporal continuity observed in pixel-level (spatial) representations. To mitigate this, we introduce Polynomial Neural Representation for Videos (PNeRV), a parameter-wise efficient, patch-wise INR for videos that preserves spatiotemporal continuity. PNeRV leverages the modeling capabilities of Polynomial Neural Networks to perform the modulation of a continuous spatial (patch) signal with a continuous time (frame) signal. We further propose a custom Hierarchical Patch-wise Spatial Sampling Scheme that ensures spatial continuity while retaining parameter efficiency. We also employ a carefully designed Positional Embedding methodology to further enhance PNeRV's performance. Our extensive experimentation demonstrates that PNeRV outperforms the baselines in conventional Implicit Neural Representation tasks like compression along with downstream applications that require spatiotemporal continuity in the underlying representation. PNeRV not only addresses the challenges posed by video data in the realm of INRs but also opens new avenues for advanced video processing and analysis.


title: scTree: Discovering Cellular Hierarchies in the Presence of Batch Effects in scRNA-seq Data

abstract: We propose a novel method, scTree, for single-cell Tree Variational Autoencoders, extending a hierarchical clustering approach to single-cell RNA sequencing data. scTree corrects for batch effects while simultaneously learning a tree-structured data representation. This VAE-based method allows for a more in-depth understanding of complex cellular landscapes independently of the biasing effects of batches. We show empirically on seven datasets that scTree discovers the underlying clusters of the data and the hierarchical relations between them, as well as outperforms established baseline methods across these datasets. Additionally, we analyze the learned hierarchy to understand its biological relevance, thus underpinning the importance of integrating batch correction directly into the clustering procedure.


title: MCNC: Manifold Constrained Network Compression

abstract: The outstanding performance of large foundational models across diverse tasks-from computer vision to speech and natural language processing-has significantly increased their demand. However, storing and transmitting these models pose significant challenges due to their massive size (e.g., 350GB for GPT-3). Recent literature has focused on compressing the original weights or reducing the number of parameters required for fine-tuning these models. These compression methods typically involve constraining the parameter space, for example, through low-rank reparametrization (e.g., LoRA) or quantization (e.g., QLoRA) during model training. In this paper, we present MCNC as a novel model compression method that constrains the parameter space to low-dimensional pre-defined and frozen nonlinear manifolds, which effectively cover this space. Given the prevalence of good solutions in over-parameterized deep neural networks, we show that by constraining the parameter space to our proposed manifold, we can identify high-quality solutions while achieving unprecedented compression rates across a wide variety of tasks. Through extensive experiments in computer vision and natural language processing tasks, we demonstrate that our method, MCNC, significantly outperforms state-of-the-art baselines in terms of compression, accuracy, and/or model reconstruction time.


title: Mapping Land Naturalness from Sentinel-2 using Deep Contextual and Geographical Priors

abstract: In recent decades, the causes and consequences of climate change have accelerated, affecting our planet on an unprecedented scale. This change is closely tied to the ways in which humans alter their surroundings. As our actions continue to impact natural areas, using satellite images to observe and measure these effects has become crucial for understanding and combating climate change. Aiming to map land naturalness on the continuum of modern human pressure, we have developed a multi-modal supervised deep learning framework that addresses the unique challenges of satellite data and the task at hand. We incorporate contextual and geographical priors, represented by corresponding coordinate information and broader contextual information, including and surrounding the immediate patch to be predicted. Our framework improves the model's predictive performance in mapping land naturalness from Sentinel-2 data, a type of multi-spectral optical satellite imagery. Recognizing that our protective measures are only as effective as our understanding of the ecosystem, quantifying naturalness serves as a crucial step toward enhancing our environmental stewardship.


title: Compatibility of Drinfeld presentations for split affine Kac-Moody quantum symmetric pairs

abstract: Let $(\mathbf{U}, \mathbf{U}^\imath)$ be a split affine quantum symmetric pair of type $\mathsf{B}_n^{(1)}, \mathsf{C}_n^{(1)}$ or $\mathsf{D}_n^{(1)}$. We prove factorization and coproduct formulae for the Drinfeld-Cartan operators $\Theta_i(z)$ in the Lu-Wang Drinfeld-type presentation, generalizing the type $\mathsf{A}_n^{(1)}$ result from [Prz23]. As an application, we show that a boundary analogue of the $q$-character map, defined via the spectra of these operators, is compatible with the usual $q$-character map. As an auxiliary result, we also produce explicit reduced expressions for the fundamental weights in the extended affine Weyl groups of classical types.


title: Understanding Routing-Induced Censorship Changes Globally

abstract: Internet censorship is pervasive, with significant effort dedicated to understanding what is censored, and where. Prior censorship work however have identified significant inconsistencies in their results; experiments show unexplained non-determinism thought to be caused by censor load, end-host geographic diversity, or incomplete censorship -- inconsistencies which impede reliable, repeatable and correct understanding of global censorship. In this work we investigate the extent to which Equal-cost Multi-path (ECMP) routing is the cause for these inconsistencies, developing methods to measure and compensate for them. We find ECMP routing significantly changes observed censorship across protocols, censor mechanisms, and in 17 countries. We identify that previously observed non-determinism or regional variations are attributable to measurements between fixed end-hosts taking different routes based on Flow-ID; i.e., choice of intra-subnet source IP or ephemeral source port leads to differences in observed censorship. To achieve this we develop new route-stable censorship measurement methods that allow consistent measurement of DNS, HTTP, and HTTPS censorship. We find ECMP routing yields censorship changes across 42% of IPs and 51% of ASes, but that impact is not uniform. We identify numerous causes of the behavior, ranging from likely failed infrastructure, to routes to the same end-host taking geographically diverse paths which experience differences in censorship en-route. Finally, we explore our results in the context of prior global measurement studies, exploring first the applicability of our findings to prior observed variations, and then demonstrating how specific experiments from two studies could be impacted by, and specific results are explainable by, ECMP routing. Our work points to methods for improving future studies, reducing inconsistencies and increasing repeatability.


title: A Max Pressure Algorithm for Traffic Signals Considering Pedestrian Queues

abstract: This paper proposes a novel max-pressure (MP) algorithm that incorporates pedestrian traffic into the MP control architecture. Pedestrians are modeled as being included in one of two groups: those walking on sidewalks and those queued at intersections waiting to cross. Traffic dynamics models for both groups are developed. Under the proposed control policy, the signal timings are determined based on the queue length of both vehicles and pedestrians waiting to cross the intersection. The proposed algorithm maintains the decentralized control structure, and the paper proves that it also exhibits the maximum stability property for both vehicles and pedestrians. Microscopic traffic simulation results demonstrate that the proposed model can improve the overall operational efficiency -- i.e., reduce person travel delays -- under various vehicle demand levels compared to the original queue-based MP (Q-MP) algorithm and a recently developed rule-based MP algorithm considering pedestrians. The Q-MP ignores the yielding behavior of right-turn vehicles to conflicting pedestrian movements, which leads to high delay for vehicles. On the other hand, the delay incurred by pedestrians is high from the rule-based model since it imposes large waiting time tolerance to guarantee the operational efficiency of vehicles. The proposed algorithm outperforms both models since the states of both vehicles and pedestrians are taken into consideration to determine signal timings.


title: Vector Resonant Relaxation and Statistical Closure Theory. I. Direct Interaction Approximation

abstract: Stars orbiting a supermassive black hole in the center of galaxies undergo very efficient diffusion in their orbital orientations. This is "Vector Resonant Relaxation", a diffusion process formally occurring on the unit sphere. Such a dynamics is intrinsically non-linear, stochastic, and correlated, hence bearing deep similarities with turbulence in fluid mechanics or plasma physics. In that context, we show how generic methods stemming from statistical closure theory, namely the celebrated "Martin-Siggia-Rose formalism", can be used to characterize the correlations describing the redistribution of orbital orientations. In particular, limiting ourselves to the leading order truncation in this closure scheme, the so-called "Direct Interaction Approximation", and placing ourselves in the limit of an isotropic distribution of orientations, we explicitly compare the associated prediction for the two-point correlation function with measures from numerical simulations. We discuss the successes and limitations of this approach and present possible future venues.


title: The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning

abstract: Understanding commonsense causality is a unique mark of intelligence for humans. It helps people understand the principles of the real world better and benefits the decision-making process related to causation. For instance, commonsense causality is crucial in judging whether a defendant's action causes the plaintiff's loss in determining legal liability. Despite its significance, a systematic exploration of this topic is notably lacking. Our comprehensive survey bridges this gap by focusing on taxonomies, benchmarks, acquisition methods, qualitative reasoning, and quantitative measurements in commonsense causality, synthesizing insights from over 200 representative articles. Our work aims to provide a systematic overview, update scholars on recent advancements, provide a pragmatic guide for beginners, and highlight promising future research directions in this vital field.


title: Dressed-State Spectroscopy and Magic Trapping of Microwave-Shielded NaCs Molecules

abstract: We report on the optical polarizability of microwave-shielded ultracold NaCs molecules in an optical dipole trap. While dressing a pair of rotational states with a microwave field, we observe a marked dependence of the optical polarizability on the intensity and detuning of the dressing field. To precisely characterize differential energy shifts between dressed rotational states, we establish dressed-state spectroscopy. For strong dressing fields, we find that a magic rotational transition can be engineered and demonstrate its insensitivity to laser intensity fluctuations. The results of this work have direct relevance for evaporative cooling and the recent demonstration of molecular Bose-Einstein condensates [Bigagli, et al., Nature (2024)] and may open a door to precision microwave spectroscopy in interacting many-body systems of microwave-shielded molecules.


title: Which Neurons Matter in IR? Applying Integrated Gradients-based Methods to Understand Cross-Encoders

abstract: With the recent addition of Retrieval-Augmented Generation (RAG), the scope and importance of Information Retrieval (IR) has expanded. As a result, the importance of a deeper understanding of IR models also increases. However, interpretability in IR remains under-explored, especially when it comes to the models' inner mechanisms. In this paper, we explore the possibility of adapting Integrated Gradient-based methods in an IR context to identify the role of individual neurons within the model. In particular, we provide new insights into the role of what we call "relevance" neurons, as well as how they deal with unseen data. Finally, we carry out an in-depth pruning study to validate our findings.


title: Imaging semiconductor-to-metal transition and topological flat bands of twisted bilayer MoTe2

abstract: Two-dimensional (2D) moir\'e materials have emerged as a highly tunable platform for investigating novel quantum states of matter arising from strong electronic correlations and nontrivial band topology. Recently, topological flat bands formed in 2D semiconducting moir\'e superlattices have attracted great interests. In particular, a series of topological quantum phases, including the long-sought fractional quantum anomalous Hall (FQAH) effect, have recently been experimentally observed in twisted bilayer MoTe2 (tMoTe2). However, the microscopic information of tMoTe2 moir\'e superlattice and its electronic structure is still lacking. Here, we present scanning tunneling microscopy and spectroscopy (STM/STS) studies of the tMoTe2 moir\'e superlattice, with twist angles ranging from about 2.3{\deg} to 2.8{\deg}. We developed a contact-STM mode to apply pressure on tMoTe2 and observed a phase transition from band insulator to metal of tMoTe2 under pressure at the charge neutrality point. STM imaging reveals a pronounced in-plane lattice reconstruction with periodic strain redistribution in the tMoTe2, which serves as gauge fields for generating topological moir\'e bands. Importantly, the electronic states of the low-energy moir\'e flat bands primarily concentrate at the XM and MX regions as revealed by STS imaging. Such spatial distributions are nicely reproduced by our first principal calculations with a large-scale basis, suggesting the low-energy moir\'e flat bands are formed through the hybridization of K valley bands of the top layer and K' valley bands of the bottom layer. Overall, our findings provide compelling real-space evidence of electronic structure under pressure and topological flat bands of tMoTe2, paving the way for further STM/STS investigations of correlated topological states within the topological flat band in gate-tunable tMoTe2 devices.


title: Zero-Query Adversarial Attack on Black-box Automatic Speech Recognition Systems

abstract: In recent years, extensive research has been conducted on the vulnerability of ASR systems, revealing that black-box adversarial example attacks pose significant threats to real-world ASR systems. However, most existing black-box attacks rely on queries to the target ASRs, which is impractical when queries are not permitted. In this paper, we propose ZQ-Attack, a transfer-based adversarial attack on ASR systems in the zero-query black-box setting. Through a comprehensive review and categorization of modern ASR technologies, we first meticulously select surrogate ASRs of diverse types to generate adversarial examples. Following this, ZQ-Attack initializes the adversarial perturbation with a scaled target command audio, rendering it relatively imperceptible while maintaining effectiveness. Subsequently, to achieve high transferability of adversarial perturbations, we propose a sequential ensemble optimization algorithm, which iteratively optimizes the adversarial perturbation on each surrogate model, leveraging collaborative information from other models. We conduct extensive experiments to evaluate ZQ-Attack. In the over-the-line setting, ZQ-Attack achieves a 100% success rate of attack (SRoA) with an average signal-to-noise ratio (SNR) of 21.91dB on 4 online speech recognition services, and attains an average SRoA of 100% and SNR of 19.67dB on 16 open-source ASRs. For commercial intelligent voice control devices, ZQ-Attack also achieves a 100% SRoA with an average SNR of 15.77dB in the over-the-air setting.


title: On Transition Constructions for Automata -- A Categorical Perspective

abstract: We investigate the transition monoid construction for deterministic automata in a categorical setting and establish it as an adjunction. We pair this adjunction with two other adjunctions to obtain two endofunctors on deterministic automata, a comonad and a monad, which are closely related, respectively, to the largest set of equations and the smallest set of coequations satisfied by an automaton. Furthermore, we give similar transition algebra constructions for lasso and {\Omega}-automata, and show that they form adjunctions. We present some initial results on sets of equations and coequations for lasso automata.


title: Generalised hook lengths and Schur elements for Hecke algebras

abstract: We compare two generalisations of the notion of hook lengths for partitions. We apply this in the context of the modular representation theory of Ariki-Koike algebras. We show that the Schur element of a simple module is divisible by the Schur element of the associated (generalised) core. In the case of Hecke algebras of type $A$, we obtain an even stronger result: the Schur element of a simple module is equal to the product of the Schur element of its core and the Schur element of its quotient.


title: LiveBench: A Challenging, Contamination-Free LLM Benchmark

abstract: Test set contamination, wherein test data from a benchmark ends up in a newer model's training set, is a well-documented obstacle for fair LLM evaluation and can quickly render benchmarks obsolete. To mitigate this, many recent benchmarks crowdsource new prompts and evaluations from human or LLM judges; however, these can introduce significant biases, and break down when scoring hard questions. In this work, we introduce a new benchmark for LLMs designed to be immune to both test set contamination and the pitfalls of LLM judging and human crowdsourcing. We release LiveBench, the first benchmark that (1) contains frequently-updated questions from recent information sources, (2) scores answers automatically according to objective ground-truth values, and (3) contains a wide variety of challenging tasks, spanning math, coding, reasoning, language, instruction following, and data analysis. To achieve this, LiveBench contains questions that are based on recently-released math competitions, arXiv papers, news articles, and datasets, and it contains harder, contamination-free versions of tasks from previous benchmarks such as Big-Bench Hard, AMPS, and IFEval. We evaluate many prominent closed-source models, as well as dozens of open-source models ranging from 0.5B to 110B in size. LiveBench is difficult, with top models achieving below 65% accuracy. We release all questions, code, and model answers. Questions will be added and updated on a monthly basis, and we will release new tasks and harder versions of tasks over time so that LiveBench can distinguish between the capabilities of LLMs as they improve in the future. We welcome community engagement and collaboration for expanding the benchmark tasks and models.


title: The AMS-02 cosmic ray deuteron flux is consistent with a secondary origin

abstract: The recent measurements of cosmic ray deuteron fluxes by AMS-02 show that the rigidity dependence of deuterons is similar with that of protons but flatter than $^3$He, which has been attributed to the existence of primary deuterons with abundance much higher than that from the Big Bang nucleosynthesis. The requirement of highly deuteron-abundant sources imposes a serious challenge on the modern astrophysics since there is no known process to produce a large amount of deuterons without violating other constraints \cite{1976Natur.263..198E}. In this work we demonstrate that the fragmentation of heavy nuclei up to iron plays a crucial role in shaping/enhancing the spectrum/flux of the cosmic ray deuterons. Based on the latest cosmic ray data, the predicted secondary fluxes of deuterons and $^3$He are found to be reasonably consistent with the AMS-02 measurements and a primary deuteron component is not needed. The apparent difference between D/$^4$He (D/p) and $^3$He/$^4$He ($^3$He/p) is probably due to a combined effect of the kinetic-energy-to-rigidity conversion and the solar modulation. More precise measurements of the fragmentation cross sections of various nuclei to produce deuterons, tritons, and $^3$He in a wide energy range will be very helpful in further testing the secondary origin of cosmic ray deuterons.


title: Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generation

abstract: This work focuses on training dataset enhancement of informative relational triplets for Scene Graph Generation (SGG). Due to the lack of effective supervision, the current SGG model predictions perform poorly for informative relational triplets with inadequate training samples. Therefore, we propose two novel training dataset enhancement modules: Feature Space Triplet Augmentation (FSTA) and Soft Transfer. FSTA leverages a feature generator trained to generate representations of an object in relational triplets. The biased prediction based sampling in FSTA efficiently augments artificial triplets focusing on the challenging ones. In addition, we introduce Soft Transfer, which assigns soft predicate labels to general relational triplets to make more supervisions for informative predicate classes effectively. Experimental results show that integrating FSTA and Soft Transfer achieve high levels of both Recall and mean Recall in Visual Genome dataset. The mean of Recall and mean Recall is the highest among all the existing model-agnostic methods.


title: Jump Starting Bandits with LLM-Generated Prior Knowledge

abstract: We present substantial evidence demonstrating the benefits of integrating Large Language Models (LLMs) with a Contextual Multi-Armed Bandit framework. Contextual bandits have been widely used in recommendation systems to generate personalized suggestions based on user-specific contexts. We show that LLMs, pre-trained on extensive corpora rich in human knowledge and preferences, can simulate human behaviours well enough to jump-start contextual multi-armed bandits to reduce online learning regret. We propose an initialization algorithm for contextual bandits by prompting LLMs to produce a pre-training dataset of approximate human preferences for the bandit. This significantly reduces online learning regret and data-gathering costs for training such models. Our approach is validated empirically through two sets of experiments with different bandit setups: one which utilizes LLMs to serve as an oracle and a real-world experiment utilizing data from a conjoint survey experiment.


title: On $p$-adic solutions to KZ equations, ordinary crystals, and $p^s$-hypergeometric solutions

abstract: We consider the KZ connection associated with a family of hyperelliptic curves of genus $g$ over the ring of $p$-adic integers $\mathbb{Z}_p$. Then the dual connection is the Gauss-Manin connection of that family. We observe that the Gauss-Manin connection has an ordinary $F$-crystal structure and its unit root subcrystal is of rank $g$. We prove that all local flat sections of the KZ connection annihilate the unite root subcrystal, and the space of all local flat sections of the KZ connection is a free $\mathbb{Z}_p$-module of rank $g$. We also consider the reduction modulo $p^s$ of the unit root subcrystal for any $s\geq 1$. We prove that its annihilator is generated by the so-called $p^s$-hypergeometric flat sections of the KZ connection. In particular, that means that the reduction modulo $p^s$ of an arbitrary local flat section of the KZ connection over $\mathbb{Z}_p$ is a linear combination of the $p^s$-hypergeometric flat sections.


title: Distributive lattices of varieties of Novikov algebras

abstract: We prove that a variety of Novikov algebras has a distributive lattice of subvarieties if and only if the lattice of its subvarieties defined by identities of degree three is distributive, thus answering, in the case of Novikov algebras, a question of Bokut from about fifty years ago. As a byproduct, we classify all Koszul operads with one binary generator of which the Novikov operad is a quotient.


title: Efficient World Models with Context-Aware Tokenization

abstract: Scaling up deep Reinforcement Learning (RL) methods presents a significant challenge. Following developments in generative modelling, model-based RL positions itself as a strong contender. Recent advances in sequence modelling have led to effective transformer-based world models, albeit at the price of heavy computations due to the long sequences of tokens required to accurately simulate environments. In this work, we propose $\Delta$-IRIS, a new agent with a world model architecture composed of a discrete autoencoder that encodes stochastic deltas between time steps and an autoregressive transformer that predicts future deltas by summarizing the current state of the world with continuous tokens. In the Crafter benchmark, $\Delta$-IRIS sets a new state of the art at multiple frame budgets, while being an order of magnitude faster to train than previous attention-based approaches. We release our code and models at https://github.com/vmicheli/delta-iris.


title: Fractional Gaussian forms and gauge theory: an overview

abstract: Fractional Gaussian fields are scalar-valued random functions or generalized functions on an $n$-dimensional manifold $M$, indexed by a parameter $s$. They include white noise ($s = 0$), Brownian motion ($s=1, n=1$), the 2D Gaussian free field ($s = 1, n=2$) and the membrane model ($s = 2$). These simple objects are ubiquitous in math and science, and can be used as a starting point for constructing non-Gaussian theories. The $\textit{differential form}$ analogs of these objects are equally natural: for example, instead of considering an instance $h(x)$ of the GFF on $\mathbb R^2$, one might write $h_1(x)dx_1 + h_2(x) dx_2$ where $h_1$ and $h_2$ are independent GFF instances. In general, given $k \in \{0,1,\ldots,n\}$, an instance of the $\textit{fractional Gaussian $k$-form}$ with parameter $s \in \mathbb R$ (abbreviated $\mathrm{FGF}_s^k(M)$) is given by $(-\Delta)^{-\frac{s}{2}} W_k,$ where $W_k$ is a $k$-form-valued white noise. We write $$\textrm{FGF}_s^k(M)_{d=0} \quad \textrm{and} \quad \textrm{FGF}_s^k(M)_{d^*=0}$$ for the $L^2$ orthogonal projections of $\textrm{FGF}_s^k(M)$ onto the space of $k$-forms on which $d$ (resp.\ $d^*$) vanishes. We explain how $\mathrm{FGF}_s^k(M)$ and its projections transform under $d$ and $d^*$, as well as wedge/Hodge-star operators, subspace restrictions, and axial projections. We discuss how the $1$-form $\textrm{FGF}_1^1(M)$ and its $\textit{gauge-fixed}$ projection $\textrm{FGF}_1^1(M)_{d^*=0}$ are related to gauge theories, and we formulate several conjectures and open problems about scaling limits, including possible off-critical/non-Gaussian limits, whose construction in the Yang-Mills setting is a famous open problem.


title: Nonuniqueness in Defining the Polarization: Nonlocal Surface Charges and the Electrostatic, Energetic, and Transport Perspectives

abstract: Ionic crystals play a central role in functional applications. Mesoscale descriptions of these crystals are based on the continuum polarization density field to represent the effective physics of charge distribution at the scale of the atomic lattice. However, a long-standing difficulty is that the classical electrostatic definition of the macroscopic polarization -- as the dipole or first moment of the charge density in a unit cell -- is not unique. This unphysical non-uniqueness has been shown to arise from starting directly with an infinite system rather than starting with a finite body and taking appropriate limits. This limit process shows that the electrostatic description requires not only the bulk polarization density, but also the surface charge density, as the effective macroscopic descriptors; that is, a nonlocal effective description. Other approaches to resolve this difficulty include relating the change in polarization to the transport of charge; or, to define the polarization as the energy-conjugate to the electric field. This work examines the relation between the classical electrostatic definition of polarization, and the transport and energy-conjugate definitions of polarization. We show the following: (1) The transport of charge does not correspond to the change in polarization in general; instead, one requires additional simplifying assumptions on the electrostatic definition of polarization for these approaches to give rise to the same macroscopic electric fields. Thus, the electrostatic definition encompasses the transport definition as a special case. (2) The energy-conjugate definition has both bulk and surface contributions; while traditional approaches neglect the surface contribution, we find that accounting for the nonlocal surface contributions is essential to obtain the correct macroscopic electric fields.


title: Multimodal Visual-haptic pose estimation in the presence of transient occlusion

abstract: Human-robot collaboration requires the establishment of methods to guarantee the safety of participating operators. A necessary part of this process is ensuring reliable human pose estimation. Established vision-based modalities encounter problems when under conditions of occlusion. This article describes the combination of two perception modalities for pose estimation in environments containing such transient occlusion. We first introduce a vision-based pose estimation method, based on a deep Predictive Coding (PC) model featuring robustness to partial occlusion. Next, capacitive sensing hardware capable of detecting various objects is introduced. The sensor is compact enough to be mounted on the exterior of any given robotic system. The technology is particularly well-suited to detection of capacitive material, such as living tissue. Pose estimation from the two individual sensing modalities is combined using a modified Luenberger observer model. We demonstrate that the results offer better performance than either sensor alone. The efficacy of the system is demonstrated on an environment containing a robot arm and a human, showing the ability to estimate the pose of a human forearm under varying levels of occlusion.


title: Towards 2-dimensional non-commutative integrals

abstract: We collect evidence that the notion of path-ordered non-abelian integration admits an extension to two dimensions. We propose the corresponding notion of non-abelian 2-form along the lines of Lie algebroid theory and argue it is an appropriate one. The processes of parallel transport and integration turn out to be subtly different in the 2-dimensional case; we discuss parallel transport along surfaces and present an indirect definition of a non-abelian integral. This integral includes, for specific choices of 2-forms, both abelian integrals and the continuous limit of Baker-Campbell-Hausdorff formula as special cases; it interpolates between those cases and broadly generalizes them, allowing, for example, an analog of path-exponential with local, point-depending commutators to be spoken about. We comment on all these objects, their relations, gauge symmetries and geometrical meaning, and roughly sketch a plausible order-by-order procedure for obtaining formulas for non-abelian integrals. The exposition is reasonably concrete, relying on no notions more abstract than sections of vector bundles and homotopies.


title: A Superfluid Dark Matter Cosmic String Wake

abstract: We study the effects of superfluid dark matter on the structure of a cosmic string wake, considering both the effects of regular and quantum pressure terms. We consider the total fluid to consist of a combination of baryons and dark matter. Hence, we are also able to study the effects of superfluid dark matter on the distribution of baryons inside the wake. We focus on parameter values for the superfluid dark matter which allow a MONDian explanation of galaxy rotation curves.


title: Simple homotopy invariance of the loop coproduct

abstract: We prove a transformation formula for the Goresky-Hingston loop coproduct in string topology under homotopy equivalences of manifolds. The formula involves the trace of the Whitehead torsion of the homotopy equivalence. In particular, it implies that the loop coproduct is invariant under simple homotopy equivalences. In a sense, our results determine the Dennis trace of the simple homotopy type of a closed manifold from its framed configuration spaces of $\leq 2$ points. We also explain how the loop coproduct arises as a secondary operation in a 2-dimensional TQFT which elucidates a topological origin of the transformation formula.


title: Spectroscopy of magnetized black holes and topological stars

abstract: We study the linear response of four dimensional magnetized black holes and regular topological stars arising from dimensional compactification of Einstein-Maxwell theory in five dimensions. We consider both radial and nonradial perturbations and study the stability of these solutions, both in the frequency and in the time domain. Due to the presence of magnetic fluxes in the background, axial (i.e., odd-parity) gravitational perturbations are coupled to polar (i.e., even-parity) electromagnetic perturbations (Type-I sector) whereas polar gravitational and scalar perturbations are coupled to axial electromagnetic ones (Type-II sector). We provide a comprehensive analytical and numerical study of the radial perturbations and of the Type I sector, finding no evidence of linear instabilities (besides the already known Gregory-Laflamme instability of black strings occurring only in a certain range of the parameters), even despite the fact that the effective potential for radial perturbations of topological stars is negative and divergent near the inner boundary. Ultracompact topological stars exhibit long-lived trapped modes that give rise to echoes in the time-domain response. Their prompt response is very similar to that of the corresponding black hole with comparable charge-to-mass ratio. This provides a concrete realization of ultracompact objects arising from a well-defined theory. The numerical analysis of the Type-II sector will appear in a companion paper.


title: Subtractive Training for Music Stem Insertion using Latent Diffusion Models

abstract: We present Subtractive Training, a simple and novel method for synthesizing individual musical instrument stems given other instruments as context. This method pairs a dataset of complete music mixes with 1) a variant of the dataset lacking a specific stem, and 2) LLM-generated instructions describing how the missing stem should be reintroduced. We then fine-tune a pretrained text-to-audio diffusion model to generate the missing instrument stem, guided by both the existing stems and the text instruction. Our results demonstrate Subtractive Training's efficacy in creating authentic drum stems that seamlessly blend with the existing tracks. We also show that we can use the text instruction to control the generation of the inserted stem in terms of rhythm, dynamics, and genre, allowing us to modify the style of a single instrument in a full song while keeping the remaining instruments the same. Lastly, we extend this technique to MIDI formats, successfully generating compatible bass, drum, and guitar parts for incomplete arrangements.


title: Group gradings on finite-dimensional incidence algebras. II

abstract: We complete the description of group gradings on finite-dimensional incidence algebras. Moreover, we classify the finite-dimensional graded algebras that can be realized as incidence algebras endowed with a group grading.


title: Non-spinning tops are stable

abstract: We consider coupled gravitational and electromagnetic perturbations of a family of five-dimensional Einstein-Maxwell solutions that describes both magnetized black strings and horizonless topological stars. We find that the odd perturbations of this background lead to a master equation with five Fuchsian singularities and compute its quasinormal mode spectrum using three independent methods: Leaver, WKB and numerical integration. Our analysis confirms that odd perturbations always decay in time, while spherically symmetric even perturbations may exhibit for certain ranges of the magnetic fluxes instabilities of Gregory-Laflamme type for black strings and of Gross-Perry-Yaffe type for topological stars. This constitutes evidence that topological stars and black strings are classically stable in a finite domain of their parameter space.


title: Determining all biunitary triperfect numbers of a certain form

abstract: We shall show that $2160$ is the only biunitary triperfect number divisible by $27=3^3$.


title: Utility of virtual qubits in trapped-ion quantum computers

abstract: We propose encoding multiple qubits inside ions in existing trapped-ion quantum computers to access more qubits and to simplify circuits implementing standard algorithms. By using such `virtual' qubits, some inter-ion gates can be replaced by intra-ion gates, reducing the use of vibrational modes of the ion chain, leading to less noise. We discuss specific examples such as the Bernstein-Vazirani algorithm and random circuit sampling, using a small number of virtual qubits. Additionally, virtual qubits enable using larger number of data qubits for an error correcting code, and we consider the repetition code as an example. We also lay out practical considerations to be made when choosing states to encode virtual qubits in $^{137}\mathrm{Ba}^+$ ions, and for preparing states and performing measurements.


title: Accelerating Multiphase Flow Simulations with Denoising Diffusion Model Driven Initializations

abstract: This study introduces a hybrid fluid simulation approach that integrates generative diffusion models with physics-based simulations, aiming at reducing the computational costs of flow simulations while still honoring all the physical properties of interest. These simulations enhance our understanding of applications such as assessing hydrogen and CO$_2$ storage efficiency in underground reservoirs. Nevertheless, they are computationally expensive and the presence of nonunique solutions can require multiple simulations within a single geometry. To overcome the computational cost hurdle, we propose a hybrid method that couples generative diffusion models and physics-based modeling. We introduce a system to condition the diffusion model with a geometry of interest, allowing to produce variable fluid saturations in the same geometry. While training the model, we simultaneously generate initial conditions and perform physics-based simulations using these conditions. This integrated approach enables us to receive real-time feedback on a single compute node equipped with both CPUs and GPUs. By efficiently managing these processes within one compute node, we can continuously evaluate performance and stop training when the desired criteria are met. To test our model, we generate realizations in a real Berea sandstone fracture which shows that our technique is up to 4.4 times faster than commonly used flow simulation initializations.


title: Multi-RIS-Empowered Multiple Access: A Distributed Sum-Rate Maximization Approach

abstract: The plethora of wirelessly connected devices, whose deployment density is expected to largely increase in the upcoming sixth Generation (6G) of wireless networks, will naturally necessitate substantial advances in multiple access schemes. Reconfigurable Intelligent Surfaces (RISs) constitute a candidate 6G technology capable to offer dynamic over-the-air signal propagation programmability, which can be optimized for efficient non-orthogonal access of a multitude of devices. In this paper, we study the downlink of a wideband communication system comprising multiple multi-antenna Base Stations (BSs), each wishing to serve an associated single-antenna user via the assistance of a Beyond Diagonal (BD) and frequency-selective RIS. Under the assumption that each BS performs Orthogonal Frequency Division Multiplexing (OFDM) transmissions and exclusively controls a distinct RIS, we focus on the sum-rate maximization problem and present a distributed joint design of the linear precoders at the BSs as well as the tunable capacitances and the switch selection matrices at the multiple BD RISs. The formulated non-convex design optimization problem is solved via successive concave approximation necessitating minimal cooperation among the BSs. Our extensive simulation results showcase the performance superiority of the proposed cooperative scheme over non-cooperation benchmarks, indicating the performance gains with BD RISs via the presented optimized frequency selective operation for various scenarios.


title: $L^\infty$-sizes of the spaces Siegel cusp forms of degree $n$ via Poincar\'e series

abstract: We prove the conjectures on the ($L^{\infty}$)-sizes of the spaces of Siegel cusp forms of degree $n$, weight $k$, for any congruence subgroup in the weight aspect as well as for all principal congruence subgroups in the level aspect, in particular. This size is measured by the size of the Bergman kernel of the space. More precisely we show that the aforementioned size is $\asymp_{n} k^{3n(n+1)/4}$. Our method uses the Fourier expansion of the Bergman kernel, and has wide applicability. We illustrate this by a simple algorithm. We also include some of the applications of our method, including individual sup-norms of small weights and non-vanishing of Poincar\'e series.


title: LiverUSRecon: Automatic 3D Reconstruction and Volumetry of the Liver with a Few Partial Ultrasound Scans

abstract: 3D reconstruction of the liver for volumetry is important for qualitative analysis and disease diagnosis. Liver volumetry using ultrasound (US) scans, although advantageous due to less acquisition time and safety, is challenging due to the inherent noisiness in US scans, blurry boundaries, and partial liver visibility. We address these challenges by using the segmentation masks of a few incomplete sagittal-plane US scans of the liver in conjunction with a statistical shape model (SSM) built using a set of CT scans of the liver. We compute the shape parameters needed to warp this canonical SSM to fit the US scans through a parametric regression network. The resulting 3D liver reconstruction is accurate and leads to automatic liver volume calculation. We evaluate the accuracy of the estimated liver volumes with respect to CT segmentation volumes using RMSE. Our volume computation is statistically much closer to the volume estimated using CT scans than the volume computed using Childs' method by radiologists: p-value of 0.094 (>0.05) says that there is no significant difference between CT segmentation volumes and ours in contrast to Childs' method. We validate our method using investigations (ablation studies) on the US image resolution, the number of CT scans used for SSM, the number of principal components, and the number of input US scans. To the best of our knowledge, this is the first automatic liver volumetry system using a few incomplete US scans given a set of CT scans of livers for SSM.


title: A Contact Binary Satellite of the Asteroid (152830) Dinkinesh

abstract: Asteroids with diameters less than about 5 km have complex histories because they are small enough for radiative torques, YORP, to be a notable factor in their evolution. (152830) Dinkinesh is a small asteroid orbiting the Sun near the inner edge of the Main Asteroid Belt with a heliocentric semimajor axis of 2.19 AU; its S type spectrum is typical of bodies in this part of the Main Belt. Here we report observations by the Lucy spacecraft as it passed within 431 km of Dinkinesh. Lucy revealed Dinkinesh, which has an effective diameter of only $\sim$720 m, to be unexpectedly complex. Of particular note is the presence of a prominent longitudinal trough overlain by a substantial equatorial ridge, and the discovery of the first confirmed contact binary satellite, now named (152830) Dinkinesh I Selam. Selam consists of two near-equal sized lobes with diameters of $\sim$210 m and $\sim$230 m. It orbits Dinkinesh at a distance of 3.1 km with an orbital period of about 52.7 hr, and is tidally locked. The dynamical state, angular momentum, and geomorphologic observations of the system lead us to infer that the ridge and trough of Dinkinesh are probably the result of mass failure resulting from spin-up by YORP followed by the partial reaccretion of the shed material. Selam probably accreted from material shed by this event.


title: Synthetic Embedding of Hidden Information in Industrial Control System Network Protocols for Evaluation of Steganographic Malware

abstract: For the last several years, the embedding of hidden information by steganographic techniques in network communications is increasingly used by attackers in order to obscure data infiltration, exfiltration or command and control in IT (information technology) and OT (operational technology) systems. Especially industrial control systems (ICS) and critical infrastructures have increased protection requirements. Currently, network defense mechanisms are unfortunately quite ineffective against novel attacks based on network steganography. Thus, on the one hand huge amounts of network data with steganographic embedding is required to train, evaluate and improve defense mechanisms. On the other hand, the real-time embedding of hidden information in productive ICS networks is crucial due to safety violations. Additionally it is time consuming because it needs special laboratory setup. To address this challenge, this work introduces an embedding concept to gene ate synthetic steganographic network data to automatically produce significant amounts of data for training and evaluation of defense mechanisms. The concept enables the possibility to manipulate a network packet wherever required and outperforms the state-of-the-art in terms of embedding pace significantly.


title: Rational Empirical Interpolation Methods with Applications

abstract: We present a rational empirical interpolation method for interpolating a family of parametrized functions to rational polynomials with invariant poles, leading to efficient numerical algorithms for space-fractional differential equations, parameter-robust preconditioning, and evaluation of matrix functions. Compared to classical rational approximation algorithms, the proposed method is more efficient for approximating a large number of target functions. In addition, we derive a convergence estimate of our rational approximation algorithm using the metric entropy numbers. Numerical experiments are included to demonstrate the effectiveness of the proposed method.


title: Moment map flow on real reductive Lie groups and GIT estimates

abstract: A finite dimensional real vector space carrying an action of a real reductive group possesses a moment map and a stratification as defined by Kirwan and Ness. In this article we investigate the properties of the moment map, the Kirwan-Ness stratification, and Lauret's application from a more functorial, algebraic point of view.


title: Learning Visual Conditioning Tokens to Correct Domain Shift for Fully Test-time Adaptation

abstract: Fully test-time adaptation aims to adapt the network model based on sequential analysis of input samples during the inference stage to address the cross-domain performance degradation problem of deep neural networks. This work is based on the following interesting finding: in transformer-based image classification, the class token at the first transformer encoder layer can be learned to capture the domain-specific characteristics of target samples during test-time adaptation. This learned token, when combined with input image patch embeddings, is able to gradually remove the domain-specific information from the feature representations of input samples during the transformer encoding process, thereby significantly improving the test-time adaptation performance of the source model across different domains. We refer to this class token as visual conditioning token (VCT). To successfully learn the VCT, we propose a bi-level learning approach to capture the long-term variations of domain-specific characteristics while accommodating local variations of instance-specific characteristics. Experimental results on the benchmark datasets demonstrate that our proposed bi-level visual conditioning token learning method is able to achieve significantly improved test-time adaptation performance by up to 1.9%.


title: Unconditional Stability Analysis of N-Port Networks Based on Structured Singular Value Computation

abstract: In this paper, a novel approach based on robust stability concepts and tools is introduced to evaluate the unconditional stability of microwave active $\textit{n}$-port devices. An efficient calculation of the Structured Singular Value of the $\textit{n}$x$\textit{n}$ scattering matrix is proposed to obtain the stability characteristics of the device. The presented method is validated in two ways. First, it is applied to a referential 4x4 scattering parameter set for independent verification. Second, the method is applied to a 4-port GaAs FET amplifier fabricated in hybrid technology. The results confirm the validity and computational efficiency of the proposed approach.


title: Carrollian Amplitudes from Holographic Correlators

abstract: Carrollian amplitudes are flat space amplitudes written in position space at null infinity which can be re-interpreted as correlators in a putative dual Carrollian CFT. We argue that these amplitudes are the natural objects obtained in the flat space limit of AdS Lorentzian boundary correlators. The flat limit is taken entirely in position space by introducing Bondi coordinates in the bulk. From the bulk perspective, this procedure makes it manifest that the flat limit of any Witten diagram is the corresponding flat space Feynman diagram. It also makes explicit the fact that the flat limit in the bulk is implemented by a Carrollian limit at the boundary. We systematically analyse tree-level two, three and four-point correlators. Familiar features such as the distributional nature of Carrollian amplitudes and the presence of a bulk point singularity arise naturally as a consequence of requiring a finite and non-trivial Carrollian limit.


title: On joint returns to zero of Bessel processes

abstract: In this article, we consider joint returns to zero of $n$ Bessel processes ($n\geq 2$): our main goal is to estimate the probability that they avoid having joint returns to zero for a long time. More precisely, considering $n$ independent Bessel processes $(X_t^{(i)})_{1\leq i \leq n}$ of dimension $\delta \in (0,1)$, we are interested in the first joint return to zero of any two of them: \[ H_n := \inf\big\{ t>0, \exists 1\leq i <j \leq n \text{ such that } X_t^{(i)} = X_t^{(j)} =0 \big\} \,. \] We prove the existence of a persistence exponent $\theta_n$ such that $\mathbb{P}(H_n>t) = t^{-\theta_n+o(1)}$ as $t\to\infty$, and we provide some non-trivial bounds on $\theta_n$. In particular, when $n=3$, we show that $2(1-\delta)\leq \theta_3 \leq 2 (1-\delta) + f(\delta)$ for some (explicit) function $f(\delta)$ with $\sup_{[0,1]} f(\delta) \approx 0.079$.


title: A Third Order Dynamical System for Mixed Variational Inequalities

abstract: In this paper, we introduce and study a class of resolvent dynamical systems to investigate some inertial proximal methods for solving mixed variational inequalities. These proposed methods along with their discretizations and derived rates of convergences require only the monotonicity for mixed variational inequalities under some mild conditions. We establish the global asymptotically and exponentially stability of the solution of the resolvent dynamical system for monotone operators. Ideas and techniques of this paper may be extended for other classes of variational inequalities and equilibrium problems.


title: Eliciting prior information from clinical trials via calibrated Bayes factor

abstract: In the Bayesian framework power prior distributions are increasingly adopted in clinical trials and similar studies to incorporate external and past information, typically to inform the parameter associated to a treatment effect. Their use is particularly effective in scenarios with small sample sizes and where robust prior information is actually available. A crucial component of this methodology is represented by its weight parameter, which controls the volume of historical information incorporated into the current analysis. This parameter can be considered as either fixed or random. Although various strategies exist for its determination, eliciting the prior distribution of the weight parameter according to a full Bayesian approach remains a challenge. In general, this parameter should be carefully selected to accurately reflect the available prior information without dominating the posterior inferential conclusions. To this aim, we propose a novel method for eliciting the prior distribution of the weight parameter through a simulation-based calibrated Bayes factor procedure. This approach allows for the prior distribution to be updated based on the strength of evidence provided by the data: The goal is to facilitate the integration of historical data when it aligns with current information and to limit it when discrepancies arise in terms, for instance, of prior-data conflicts. The performance of the proposed method is tested through simulation studies and applied to real data from clinical trials.


title: Thermal Dynamics of Heat Pipes with Sub-Critical Nanopores

abstract: Sub-critical nanopores are known to inhibit continuous evaporation within heat pipes, posing a challenge in understanding the limitations of nanopore size on wicking action. This study addresses this by systematically investigating the wicking capabilities in nanoscale heat pipes using coarse-grained molecular dynamics simulations. The results reveal that temperature-induced flow in these heat pipes is primarily driven by surface interactions rather than traditional wicking action. Additionally, the water fill ratio and thermal gradient significantly influence the performance of these systems. These insights can substantially benefit heat transfer research, providing a foundation for improving thermal performance through nanoscale design innovations.


title: Theory of superconductivity in twisted transition metal dichalcogenide homobilayers

abstract: For the first time, robust superconductivity has been independently observed in twisted WSe$_2$ bilayers by two separate groups [Y. Xia et al., arXiv:2405.14784; Y. Guo et al., arXiv:2406.03418.]. In light of this, we explore the possibility of a universal superconducting pairing mechanism in twisted WSe$_2$ bilayers. Using a continuum band structure model and a phenomenological boson-mediated effective electron-electron attraction, we find that intervalley intralayer pairing predominates over interlayer pairing. Notably, despite different experimental conditions, both twisted WSe$_2$ samples exhibit a comparable effective attraction strength. This consistency suggests that the dominant pairing glue is likely independent of the twist angle and layer polarization, pointing to a universal underlying boson-induced pairing mechanism.


title: IndoToxic2024: A Demographically-Enriched Dataset of Hate Speech and Toxicity Types for Indonesian Language

abstract: Hate speech poses a significant threat to social harmony. Over the past two years, Indonesia has seen a ten-fold increase in the online hate speech ratio, underscoring the urgent need for effective detection mechanisms. However, progress is hindered by the limited availability of labeled data for Indonesian texts. The condition is even worse for marginalized minorities, such as Shia, LGBTQ, and other ethnic minorities because hate speech is underreported and less understood by detection tools. Furthermore, the lack of accommodation for subjectivity in current datasets compounds this issue. To address this, we introduce IndoToxic2024, a comprehensive Indonesian hate speech and toxicity classification dataset. Comprising 43,692 entries annotated by 19 diverse individuals, the dataset focuses on texts targeting vulnerable groups in Indonesia, specifically during the hottest political event in the country: the presidential election. We establish baselines for seven binary classification tasks, achieving a macro-F1 score of 0.78 with a BERT model (IndoBERTweet) fine-tuned for hate speech classification. Furthermore, we demonstrate how incorporating demographic information can enhance the zero-shot performance of the large language model, gpt-3.5-turbo. However, we also caution that an overemphasis on demographic information can negatively impact the fine-tuned model performance due to data fragmentation.


title: Dynamical Analysis of Autobidding Systems

abstract: It has become the default in markets such as ad auctions for participants to bid in an auction through automated bidding agents (autobidders) which adjust bids over time to satisfy return-over-spend constraints. Despite the prominence of such systems for the internet economy, their resulting dynamical behavior is still not well understood. Although one might hope that such relatively simple systems would typically converge to the equilibria of their underlying auctions, we provide a plethora of results that show the emergence of complex behavior, such as bi-stability, periodic orbits and quasi periodicity. We empirically observe how the market structure (expressed as motifs) qualitatively affects the behavior of the dynamics. We complement it with theoretical results showing that autobidding systems can simulate both linear dynamical systems as well logical boolean gates.


title: A comment on comparing optimization on D-Wave and IBM quantum processors

abstract: Recent work [Sachdeva et al.] presented an iterative hybrid quantum variational optimization algorithm designed by Q-CTRL and executed on IBM gate-based quantum processing units (QPUs), claiming a significant performance advantage against a D-Wave quantum annealer. Here we point out major methodological problems with this comparison. Using a simple unoptimized workflow for quantum annealing, we show success probabilities multiple orders of magnitude higher than those reported by [Sachdeva et al.]. These results, which can be reproduced using open-source code and free trial access to a D-Wave quantum annealer, contradict Q-CTRL's claims of superior performance. We also provide a direct comparison between quantum annealing and a recent demonstration of digitized quantum annealing on an IBM processor, showing that analog quantum annealing on a D-Wave QPU reaches far lower energies than digitized quantum annealing on an IBM QPU.


title: Periodic phenomena in equivariant stable homotopy theory

abstract: Building off of many recent advances in the subject by many different researchers, we describe a picture of A-equivariant chromatic homotopy theory which mirrors the now classical non-equivariant picture of Morava, Miller-Ravenel-Wilson, and Devinatz-Hopkins-Smith, where A is a finite abelian p-group. Specifically, we review the structure of the Balmer spectrum of the category of A-spectra, and the work of Hausmann-Meier connecting this to MU_A and equivariant formal group laws. Generalizing work of Bhattacharya-Guillou-Li, we introduce equivariant analogs of v_n-self maps, and generalizing work of Carrick and Balderrama, we introduce equivariant analogs of the chromatic tower, and give equivariant analogs of the smash product and chromatic convergence theorems. The equivariant monochromatic theory is also discussed. We explore computational examples of this theory in the case of A = C_2, where we connect equivariant chromatic theory with redshift phenomena in Mahowald invariants.


title: CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement

abstract: Understanding how humans cooperatively rearrange household objects is critical for VR/AR and human-robot interaction. However, in-depth studies on modeling these behaviors are under-researched due to the lack of relevant datasets. We fill this gap by presenting CORE4D, a novel large-scale 4D human-object-human interaction dataset focusing on collaborative object rearrangement, which encompasses diverse compositions of various object geometries, collaboration modes, and 3D scenes. With 1K human-object-human motion sequences captured in the real world, we enrich CORE4D by contributing an iterative collaboration retargeting strategy to augment motions to a variety of novel objects. Leveraging this approach, CORE4D comprises a total of 11K collaboration sequences spanning 3K real and virtual object shapes. Benefiting from extensive motion patterns provided by CORE4D, we benchmark two tasks aiming at generating human-object interaction: human-object motion forecasting and interaction synthesis. Extensive experiments demonstrate the effectiveness of our collaboration retargeting strategy and indicate that CORE4D has posed new challenges to existing human-object interaction generation methodologies. Our dataset and code are available at https://github.com/leolyliu/CORE4D-Instructions.


title: Fundamental Problems With Model Editing: How Should Rational Belief Revision Work in LLMs?

abstract: The model editing problem concerns how language models should learn new facts about the world over time. While empirical research on model editing has drawn widespread attention, the conceptual foundations of model editing remain shaky -- perhaps unsurprisingly, since model editing is essentially belief revision, a storied problem in philosophy that has eluded succinct solutions for decades. Model editing nonetheless demands a solution, since we need to be able to control the knowledge within language models. With this goal in mind, this paper critiques the standard formulation of the model editing problem and proposes a formal testbed for model editing research. We first describe 12 open problems with model editing, based on challenges with (1) defining the problem, (2) developing benchmarks, and (3) assuming LLMs have editable beliefs in the first place. Many of these challenges are extremely difficult to address, e.g. determining far-reaching consequences of edits, labeling probabilistic entailments between facts, and updating beliefs of agent simulators. Next, we introduce a semi-synthetic dataset for model editing based on Wikidata, where we can evaluate edits against labels given by an idealized Bayesian agent. This enables us to say exactly how belief revision in language models falls short of a desirable epistemic standard. We encourage further research exploring settings where such a gold standard can be compared against. Our code is publicly available at: https://github.com/peterbhase/LLM-belief-revision


title: A class of ghost-free theories in symmetric teleparallel geometry

abstract: Theories formulated in the arena of teleparallel geometries are generically plagued by ghost-like instabilities or other pathologies that are ultimately caused by the breaking of some symmetries. In this work, we construct a class of ghost-free theories based on a symmetry under Transverse Diffeomorphisms that is naturally realised in symmetric teleparallelism. We explicitly show their equivalence to a family of theories with an extra scalar field plus a global degree of freedom and how Horndeski theories and healthy couplings to matter fields can be readily accommodated.


title: DiVERT: Distractor Generation with Variational Errors Represented as Text for Math Multiple-choice Questions

abstract: High-quality distractors are crucial to both the assessment and pedagogical value of multiple-choice questions (MCQs), where manually crafting ones that anticipate knowledge deficiencies or misconceptions among real students is difficult. Meanwhile, automated distractor generation, even with the help of large language models (LLMs), remains challenging for subjects like math. It is crucial to not only identify plausible distractors but also understand the error behind them. In this paper, we introduce DiVERT (Distractor Generation with Variational Errors Represented as Text), a novel variational approach that learns an interpretable representation of errors behind distractors in math MCQs. Through experiments on a real-world math MCQ dataset with 1,434 questions used by hundreds of thousands of students, we show that DiVERT, despite using a base open-source LLM with 7B parameters, outperforms state-of-the-art approaches using GPT-4o on downstream distractor generation. We also conduct a human evaluation with math educators and find that DiVERT leads to error labels that are of comparable quality to human-authored ones.


title: A fully analytical equation of motion approach for the double quantum dot in the Coulomb blockade regime

abstract: A fully analytical approach based on the equation of motion technique to investigate the spectral properties and orbital occupations in an interacting double quantum dot in equilibrium is presented. By solving a linear system for the density correlators analytically, an explicit expression for the one body Green's function in terms of local occupations, intra- and inter-dot Coulomb interactions, and the model parameters is derived. In the uncontacted limit, the results coincide with those obtained from the grand canonical ensemble. The analytical results compare favourably with numerical results obtained with the Non-Crossing Approximation and the Hierarchical Equation of Motion methods accurately reproducing peak positions and spectral weight distributions in the Coulomb blockade regime.


title: The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models

abstract: Sentiment analysis serves as a pivotal component in Natural Language Processing (NLP). Advancements in multilingual pre-trained models such as XLM-R and mT5 have contributed to the increasing interest in cross-lingual sentiment analysis. The recent emergence in Large Language Models (LLM) has significantly advanced general NLP tasks, however, the capability of such LLMs in cross-lingual sentiment analysis has not been fully studied. This work undertakes an empirical analysis to compare the cross-lingual transfer capability of public Small Multilingual Language Models (SMLM) like XLM-R, against English-centric LLMs such as Llama-3, in the context of sentiment analysis across English, Spanish, French and Chinese. Our findings reveal that among public models, SMLMs exhibit superior zero-shot cross-lingual performance relative to LLMs. However, in few-shot cross-lingual settings, public LLMs demonstrate an enhanced adaptive potential. In addition, we observe that proprietary GPT-3.5 and GPT-4 lead in zero-shot cross-lingual capability, but are outpaced by public models in few-shot scenarios.


title: Lommel functions, Pad\'e approximants and hypergeometric functions

abstract: We consider the Lommel functions $s_{\mu,\nu}(z)$ for different values of the parameters $(\mu,\nu)$. We show that if $(\mu,\nu)$ are half integers, then it is possible to describe these functions with an explicit combination of polynomials and trigonometric functions. The polynomials turn out to give Pad\'e approximants for the trigonometric functions. Numerical properties of the zeros of the polynomials are discussed. Also, when $\mu$ is an integer, $s_{\mu,\nu}(z)$ can be written as an integral involving an explicit combination of trigonometric functions. A closed formula for $_2F_1\left(\frac{1}{2}+\nu,\frac{1}{2}-\nu;\mu+\frac{1}{2};\sin(\frac{\theta}{2})^2\right)$ with $\mu$ an integer is given.


title: Modular Hamiltonian and modular flow of massless fermions on a cylinder

abstract: We determine explicitly the modular flow and the modular Hamiltonian for massless free fermions in diamonds on a cylinder in 1+1 dimensions. We consider both periodic and antiperiodic boundary conditions, the ground state in the antiperiodic case and the most general family of quasi-free zero-energy ground states in the periodic case, which depend on four parameters and are generally mixed. While for the antiperiodic ground state and one periodic ground state (the maximally mixed zero-temperature state) the modular data is known, our results for the generic ground state in the periodic case are completely new. We find that generically both the modular flow and the modular Hamiltonian are non-local, and we show that in the parametric limit where the state becomes pure the modular data becomes local. Moreover, even in the local case the modular flow generically mixes the two chiralities. This kind of behavior has not been observed previously.


title: Atomic sheaves on hyper-K\"ahler manifolds via Bridgeland moduli spaces

abstract: In this paper, we provide new examples of 1-obstructed and atomic sheaves on an infinite series of locally complete families of projective hyper-K\"ahler manifolds. More precisely, (1) we prove that the fixed loci of the natural anti-symplectic involutions on the moduli spaces of stable objects in the Kuznetsov component $\mathcal{K}u(X)$ of a Gushel-Mukai fourfold $X$ are 1-obstructed Lagrangian submanifolds, and (2) we construct a family of immersed atomic Lagrangian submanifolds on each moduli space of stable objects in $\mathcal{K}u(X)$. Additionally, we discuss examples of atomic Lagrangian submanifolds satisfying $b_1=20$ in a family of hyper-K\"ahler manifolds of $\mathrm{K3^{[2]}}$-type, as well as atomic sheaves supported on non-atomic Lagrangians.


title: STAL3D: Unsupervised Domain Adaptation for 3D Object Detection via Collaborating Self-Training and Adversarial Learning

abstract: Existing 3D object detection suffers from expensive annotation costs and poor transferability to unknown data due to the domain gap, Unsupervised Domain Adaptation (UDA) aims to generalize detection models trained in labeled source domains to perform robustly on unexplored target domains, providing a promising solution for cross-domain 3D object detection. Although Self-Training (ST) based cross-domain 3D detection methods with the assistance of pseudo-labeling techniques have achieved remarkable progress, they still face the issue of low-quality pseudo-labels when there are significant domain disparities due to the absence of a process for feature distribution alignment. While Adversarial Learning (AL) based methods can effectively align the feature distributions of the source and target domains, the inability to obtain labels in the target domain forces the adoption of asymmetric optimization losses, resulting in a challenging issue of source domain bias. To overcome these limitations, we propose a novel unsupervised domain adaptation framework for 3D object detection via collaborating ST and AL, dubbed as STAL3D, unleashing the complementary advantages of pseudo labels and feature distribution alignment. Additionally, a Background Suppression Adversarial Learning (BS-AL) module and a Scale Filtering Module (SFM) are designed tailored for 3D cross-domain scenes, effectively alleviating the issues of the large proportion of background interference and source domain size bias. Our STAL3D achieves state-of-the-art performance on multiple cross-domain tasks and even surpasses the Oracle results on Waymo $\rightarrow$ KITTI and Waymo $\rightarrow$ KITTI-rain.


title: Tradition or Innovation: A Comparison of Modern ASR Methods for Forced Alignment

abstract: Forced alignment (FA) plays a key role in speech research through the automatic time alignment of speech signals with corresponding text transcriptions. Despite the move towards end-to-end architectures for speech technology, FA is still dominantly achieved through a classic GMM-HMM acoustic model. This work directly compares alignment performance from leading automatic speech recognition (ASR) methods, WhisperX and Massively Multilingual Speech Recognition (MMS), against a Kaldi-based GMM-HMM system, the Montreal Forced Aligner (MFA). Performance was assessed on the manually aligned TIMIT and Buckeye datasets, with comparisons conducted only on words correctly recognized by WhisperX and MMS. The MFA outperformed both WhisperX and MMS, revealing a shortcoming of modern ASR systems. These findings highlight the need for advancements in forced alignment and emphasize the importance of integrating traditional expertise with modern innovation to foster progress. Index Terms: forced alignment, phoneme alignment, word alignment


title: SimTxtSeg: Weakly-Supervised Medical Image Segmentation with Simple Text Cues

abstract: Weakly-supervised medical image segmentation is a challenging task that aims to reduce the annotation cost while keep the segmentation performance. In this paper, we present a novel framework, SimTxtSeg, that leverages simple text cues to generate high-quality pseudo-labels and study the cross-modal fusion in training segmentation models, simultaneously. Our contribution consists of two key components: an effective Textual-to-Visual Cue Converter that produces visual prompts from text prompts on medical images, and a text-guided segmentation model with Text-Vision Hybrid Attention that fuses text and image features. We evaluate our framework on two medical image segmentation tasks: colonic polyp segmentation and MRI brain tumor segmentation, and achieve consistent state-of-the-art performance.


title: Thermodynamics of underdamped Brownian collisional engines: New insights and resonant phenomena

abstract: Collisional Brownian engines have been proposed as alternatives for nonequilibrium nanoscale engines. However, most studies have focused on the simpler overdamped case, leaving the role of inertia much less explored. In this work, we introduce the idea of collisional engines to underdamped Brownian particles, where each stage is sequentially subjected to a distinct driving force. A careful comparison between the performance of underdamped and overdamped Brownian work-to-work engines has been undertaken. The results show that underdamped Brownian engines generally outperform their overdamped counterparts. A key difference is the presence of a resonant regime in underdamped engines, in which both efficiency and power output are enhanced across a broad set of parameters. Our study highlights the importance of carefully selecting dynamics and driving protocols to achieve optimal engine performance.

categories: cond-mat.stat-mech cond-mat.mes-hall cond-mat.other cond-mat.soft


title: On the torsion locus of the Ceresa normal function

abstract: We prove that the positive-dimensional part of the torsion locus of the Ceresa normal function in $\mathcal{M}_g$ is not Zariski dense when $g\geq 3$. Moreover, it has only finitely many components with generic Mumford-Tate group equal to $\mathrm{GSp}_{2g}$; these components are defined over $\overline{\mathbb{Q}}$, and their union is closed under the action of $\mathrm{Gal}(\overline{\mathbb{Q}}/\mathbb Q)$. More generally, we study the distribution of the torsion locus of arbitrary admissible normal functions.


title: PUREPath: A Deep Latent Variational Model for Estimating CMB Posterior over Large Angular Scales of the Sky

abstract: We present a comprehensive neural architecture, the PUREPath, which leverages a nested Probabilistic multi-modal U- Net framework, augmented by the inclusion of probabilistic ResNet blocks in the Expanding Pathway of the decoders, to estimate the posterior density of the Cosmic Microwave Background (CMB) signal conditioned on the observed CMB data and the training dataset. By seamlessly integrating Bayesian statistics and variational methods our model effectively minimizes foreground contamination in the observed CMB maps. The model is trained using foreground and noise contaminated CMB temperature maps simulated at Planck LFI and HFI frequency channels 30 - 353 GHz using publicly available Code for Anisotropies in the Microwave Background (CAMB) and Python Sky Model (PySM) packages. During training, our model transforms initial prior distribution on the model parameters to posterior distributions based on the training data. From the joint full posterior of the model parameters, during inference, a predicitve CMB posterior and summary statistics such as the predictive mean, variance etc of the cleaned CMB map is estimated. The predictive standard deviation map provides a direct and interpretable measure of uncertainty per pixel in the predicted mean CMB map. The cleaned CMB map along with the error estimates can be used for more accurate measurements of cosmological parameters and other cosmological analyses.


title: Integrated Triply Resonant Electro-Optic Frequency Comb in Lithium Tantalate

abstract: Integrated frequency comb generators based on Kerr parametric oscillation have led to chip-scale, gigahertz-spaced combs with new applications spanning hyperscale telecommunications, low-noise microwave synthesis, LiDAR, and astrophysical spectrometer calibration. Recent progress in lithium niobate (LN) photonic integrated circuits (PICs) has resulted in chip-scale electro-optic (EO) frequency combs, offering precise comb-line positioning and simple operation without relying on the formation of dissipative Kerr solitons. However, current integrated EO combs face limited spectral coverage due to the large microwave power required to drive the non-resonant capacitive electrodes and the strong intrinsic birefringence of Lithium Niobate. Here, we overcome both challenges with an integrated triply resonant architecture, combining monolithic microwave integrated circuits (MMICs) with PICs based on the recently emerged thin-film lithium tantalate. With resonantly enhanced EO interaction and reduced birefringence in Lithium Tantalate, we achieve a four-fold comb span extension and a 16-fold power reduction compared to the conventional non-resonant microwave design. Driven by a hybrid-integrated laser diode, the comb spans over 450nm (60THz) with >2000 lines, and the generator fits within a compact 1cm^2 footprint. We additionally observe that the strong EO coupling leads to an increased comb existence range approaching the full free spectral range of the optical microresonator. The ultra-broadband comb generator, combined with detuning-agnostic operation, could advance chip-scale spectrometry and ultra-low-noise millimeter wave synthesis and unlock octave-spanning EO combs. The methodology of co-designing microwave and optical resonators can be extended to a wide range of integrated electro-optics applications.


title: Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model

abstract: Transformer-based segmentation methods face the challenge of efficient inference when dealing with high-resolution images. Recently, several linear attention architectures, such as Mamba and RWKV, have attracted much attention as they can process long sequences efficiently. In this work, we focus on designing an efficient segment-anything model by exploring these different architectures. Specifically, we design a mixed backbone that contains convolution and RWKV operation, which achieves the best for both accuracy and efficiency. In addition, we design an efficient decoder to utilize the multiscale tokens to obtain high-quality masks. We denote our method as RWKV-SAM, a simple, effective, fast baseline for SAM-like models. Moreover, we build a benchmark containing various high-quality segmentation datasets and jointly train one efficient yet high-quality segmentation model using this benchmark. Based on the benchmark results, our RWKV-SAM achieves outstanding performance in efficiency and segmentation quality compared to transformers and other linear attention models. For example, compared with the same-scale transformer model, RWKV-SAM achieves more than 2x speedup and can achieve better segmentation performance on various datasets. In addition, RWKV-SAM outperforms recent vision Mamba models with better classification and semantic segmentation results. Code and models will be publicly available.


title: Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space

abstract: Modern generative models demonstrate impressive capabilities, likely stemming from an ability to identify and manipulate abstract concepts underlying their training data. However, fundamental questions remain: what determines the concepts a model learns, the order in which it learns them, and its ability to manipulate those concepts? To address these questions, we propose analyzing a model's learning dynamics via a framework we call the concept space, where each axis represents an independent concept underlying the data generating process. By characterizing learning dynamics in this space, we identify how the speed at which a concept is learned, and hence the order of concept learning, is controlled by properties of the data we term concept signal. Further, we observe moments of sudden turns in the direction of a model's learning dynamics in concept space. Surprisingly, these points precisely correspond to the emergence of hidden capabilities, i.e., where latent interventions show the model possesses the capability to manipulate a concept, but these capabilities cannot yet be elicited via naive input prompting. While our results focus on synthetically defined toy datasets, we hypothesize a general claim on emergence of hidden capabilities may hold: generative models possess latent capabilities that emerge suddenly and consistently during training, though a model might not exhibit these capabilities under naive input prompting.