title: S-matrix on effective string and compactified membrane

abstract: Expanding Nambu-Goto action near infinitely long string vacuum one can compute scattering amplitudes of 2d massless fields representing transverse string coordinates. As was shown in arXiv:1203.1054, the resulting S-matrix is integrable, in agreement with the known free string spectrum and also with an interpretation of the static-gauge NG action as a $T\bar T$ deformation of a free massless theory. We consider a generalization of this computation to the case of a membrane, expanding its 3d action near an infinite membrane vacuum that has cylindrical $\mathbb R \times S^1$ shape (we refer to such membrane as "compactified"). Representing 3d fields as Fourier series in $S^1$ coordinate we get an effective 2d model in which the massless string modes are coupled to an infinite KK tower of massive 2d modes. We find that the resulting 2d S-matrix is not integrable already at the tree level. We also compute 1-loop scattering amplitude of massless string modes with all compactified membrane modes propagating in the loop. The result is UV finite and is a non-trivial function of the kinematic variables. In the large momentum limit or when the radius of $S^1$ is taken to infinity we recover the expression for the 1-loop scattering amplitude of the uncompactified $\mathbb R^2$ membrane. We also consider a 2d model which is the $T\bar T$ deformation to the free theory with the same massless plus infinite massive tower of modes. The corresponding 2d S-matrix is found, as expected, to be integrable.


title: The Hereditary Closure of the Unigraphs

abstract: A graph with degree sequence $\pi$ is a \emph{unigraph} if it is isomorphic to every graph that has degree sequence $\pi$. The class of unigraphs is not hereditary and in this paper we study the related hereditary class HCU, the hereditary closure of unigraphs, consisting of all graphs induced in a unigraph. We characterize the class HCU in multiple ways making use of the tools of a decomposition due to Tyshkevich and a partial order on degree sequences due to Rao. We also provide a new characterization of the class that consists of unigraphs for which all induced subgraphs are also unigraphs.


title: Sign Language Translation with Iterative Prototype

abstract: This paper presents IP-SLT, a simple yet effective framework for sign language translation (SLT). Our IP-SLT adopts a recurrent structure and enhances the semantic representation (prototype) of the input sign language video via an iterative refinement manner. Our idea mimics the behavior of human reading, where a sentence can be digested repeatedly, till reaching accurate understanding. Technically, IP-SLT consists of feature extraction, prototype initialization, and iterative prototype refinement. The initialization module generates the initial prototype based on the visual feature extracted by the feature extraction module. Then, the iterative refinement module leverages the cross-attention mechanism to polish the previous prototype by aggregating it with the original video feature. Through repeated refinement, the prototype finally converges to a more stable and accurate state, leading to a fluent and appropriate translation. In addition, to leverage the sequential dependence of prototypes, we further propose an iterative distillation loss to compress the knowledge of the final iteration into previous ones. As the autoregressive decoding process is executed only once in inference, our IP-SLT is ready to improve various SLT systems with acceptable overhead. Extensive experiments are conducted on public benchmarks to demonstrate the effectiveness of the IP-SLT.


title: Robustness Analysis of Continuous-Depth Models with Lagrangian Techniques

abstract: This paper presents, in a unified fashion, deterministic as well as statistical Lagrangian-verification techniques. They formally quantify the behavioral robustness of any time-continuous process, formulated as a continuous-depth model. To this end, we review LRT-NG, SLR, and GoTube, algorithms for constructing a tight reachtube, that is, an over-approximation of the set of states reachable within a given time-horizon, and provide guarantees for the reachtube bounds. We compare the usage of the variational equations, associated to the system equations, the mean value theorem, and the Lipschitz constants, in achieving deterministic and statistical guarantees. In LRT-NG, the Lipschitz constant is used as a bloating factor of the initial perturbation, to compute the radius of an ellipsoid in an optimal metric, which over-approximates the set of reachable states. In SLR and GoTube, we get statistical guarantees, by using the Lipschitz constants to compute local balls around samples. These are needed to calculate the probability of having found an upper bound, of the true maximum perturbation at every timestep. Our experiments demonstrate the superior performance of Lagrangian techniques, when compared to LRT, Flow*, and CAPD, and illustrate their use in the robustness analysis of various continuous-depth models.


title: Self-Supervised Knowledge-Driven Deep Learning for 3D Magnetic Inversion

abstract: The magnetic inversion method is one of the non-destructive geophysical methods, which aims to estimate the subsurface susceptibility distribution from surface magnetic anomaly data. Recently, supervised deep learning methods have been widely utilized in lots of geophysical fields including magnetic inversion. However, these methods rely heavily on synthetic training data, whose performance is limited since the synthetic data is not independently and identically distributed with the field data. Thus, we proposed to realize magnetic inversion by self-supervised deep learning. The proposed self-supervised knowledge-driven 3D magnetic inversion method (SSKMI) learns on the target field data by a closed loop of the inversion and forward models. Given that the parameters of the forward model are preset, SSKMI can optimize the inversion model by minimizing the mean absolute error between observed and re-estimated surface magnetic anomalies. Besides, there is a knowledge-driven module in the proposed inversion model, which makes the deep learning method more explicable. Meanwhile, comparative experiments demonstrate that the knowledge-driven module can accelerate the training of the proposed method and achieve better results. Since magnetic inversion is an ill-pose task, SSKMI proposed to constrain the inversion model by a guideline in the auxiliary loop. The experimental results demonstrate that the proposed method is a reliable magnetic inversion method with outstanding performance.


title: Inferring Human Intentions from Predicted Action Probabilities

abstract: Predicting the next action that a human is most likely to perform is key to human-AI collaboration and has consequently attracted increasing research interests in recent years. An important factor for next action prediction are human intentions: If the AI agent knows the intention it can predict future actions and plan collaboration more effectively. Existing Bayesian methods for this task struggle with complex visual input while deep neural network (DNN) based methods do not provide uncertainty quantifications. In this work we combine both approaches for the first time and show that the predicted next action probabilities contain information that can be used to infer the underlying intention. We propose a two-step approach to human intention prediction: While a DNN predicts the probabilities of the next action, MCMC-based Bayesian inference is used to infer the underlying intention from these predictions. This approach not only allows for independent design of the DNN architecture but also the subsequently fast, design-independent inference of human intentions. We evaluate our method using a series of experiments on the Watch-And-Help (WAH) and a keyboard and mouse interaction dataset. Our results show that our approach can accurately predict human intentions from observed actions and the implicit information contained in next action probabilities. Furthermore, we show that our approach can predict the correct intention even if only few actions have been observed.


title: A motivic Fundamental Lemma

abstract: In this paper we prove motivic versions of the Langlands-Shelstad Fundamental Lemma and Ng\^o's Geometric Stabilization. To achieve this, we follow the strategy from the recent proof by Groechenig, Wyss and Ziegler which avoided the use of perverse sheaves using instead $p$-adic integration and Tate duality. We make a key use of a construction of Denef and Loeser which assigns a virtual motive to any definable set in the theory of pseudo-finite fields.


title: Turing patterns on a two-component isotropic growing system. Part 1: Homogeneous state and stability of perturbations in absence of diffusion

abstract: The reaction-diffusion processes in a growing domain involves a dilution term that modifies the properties of the homogeneous state that, in contrast to a fixed domain, depends on time. We study how the dilution term changes the steady concentrations and modifies the stability properties of the perturbations. We propose a solution for the homogeneous state that incorporates these factors and is valid for slow variation of the size of the domain which is based on a linear approach and has been tested against numerical solutions for different types of growing: exponential, linear, quadratic and oscillatory. We prove that the deviation of the steady state is proportional to the fixed point concentration, and occurs most notably for exponential growth. Systems with linear or quadratic growth tend to recover the state that would have in absence of diffusion, whereas the oscillatory variation of the domain size produce temporal oscillations of the concentration. Regarding the Turing conditions for the apparition of spatial patterns, we study those related to stability in absence of diffusion and establish that in a growing domain it depends upon: the change in the steady state concentrations, the local change of volume that affects the concentration and the stability that the reactive system would have in absence of dilution. These conditions provide richer conditions for the emergence of patterns than those found in a fixed domain. The formal results provided in this work are verified against numerical simulations of the homogeneous state for the Brusselator and BVAM reactions and we discuss how these variations of the homogeneous state can give raise to crucial differences in the formation of Turing patterns in growing domains.


title: Finite time singularities to the 3D incompressible Euler equations for solutions in $C^{\infty}(\mathbb{R}^3 \setminus \{0\})\cap C^{1,\alpha}\cap L^2$

abstract: We introduce a novel mechanism that reveals finite time singularities within the 1D De Gregorio model and the 3D incompressible Euler equations. Remarkably, we do not construct our blow up using self-similar coordinates, but build it from infinitely many regions with vorticity, separated by vortex-free regions in between. It yields solutions of the 3D incompressible Euler equations in $\mathbb{R}^3\times [-T,0]$ such that the velocity is in the space $C^{\infty}(\mathbb{R}^3 \setminus \{0\})\cap C^{1,\alpha}\cap L^2$ for times $t\in (-T,0)$ and is not $C^1$ at time 0.


title: Hierarchical Beam Alignment for Millimeter-Wave Communication Systems: A Deep Learning Approach

abstract: Fast and precise beam alignment is crucial for high-quality data transmission in millimeter-wave (mmWave) communication systems, where large-scale antenna arrays are utilized to overcome the severe propagation loss. To tackle the challenging problem, we propose a novel deep learning-based hierarchical beam alignment method for both multiple-input single-output (MISO) and multiple-input multiple-output (MIMO) systems, which learns two tiers of probing codebooks (PCs) and uses their measurements to predict the optimal beam in a coarse-to-fine search manner. Specifically, a hierarchical beam alignment network (HBAN) is developed for MISO systems, which first performs coarse channel measurement using a tier-1 PC, then selects a tier-2 PC for fine channel measurement, and finally predicts the optimal beam based on both coarse and fine measurements. The propounded HBAN is trained in two steps: the tier-1 PC and the tier-2 PC selector are first trained jointly, followed by the joint training of all the tier-2 PCs and beam predictors. Furthermore, an HBAN for MIMO systems is proposed to directly predict the optimal beam pair without performing beam alignment individually at the transmitter and receiver. Numerical results demonstrate that the proposed HBANs are superior to the state-of-art methods in both alignment accuracy and signaling overhead reduction.


title: Towards Real-Time Analysis of Broadcast Badminton Videos

abstract: Analysis of player movements is a crucial subset of sports analysis. Existing player movement analysis methods use recorded videos after the match is over. In this work, we propose an end-to-end framework for player movement analysis for badminton matches on live broadcast match videos. We only use the visual inputs from the match and, unlike other approaches which use multi-modal sensor data, our approach uses only visual cues. We propose a method to calculate the on-court distance covered by both the players from the video feed of a live broadcast badminton match. To perform this analysis, we focus on the gameplay by removing replays and other redundant parts of the broadcast match. We then perform player tracking to identify and track the movements of both players in each frame. Finally, we calculate the distance covered by each player and the average speed with which they move on the court. We further show a heatmap of the areas covered by the player on the court which is useful for analyzing the gameplay of the player. Our proposed framework was successfully used to analyze live broadcast matches in real-time during the Premier Badminton League 2019 (PBL 2019), with commentators and broadcasters appreciating the utility.


title: Uniform Integrality of critical values of the Rankin-Selberg $L$-function for ${\rm GL}_{n}\times {\rm GL}_{n-1}$

abstract: After introducing the notion of uniform integrality of critical values of the Rankin-Selberg $L$-functions for $\mathrm{GL}_{n}\times \mathrm{GL}_{n-1}$, we study it when the base field is totally imaginary. For this purpose, we adopt specific models of highest weight representations of the general linear groups, construct the Eichler-Shimura classes for $\mathrm{GL}_{n}$ and $\mathrm{GL}_{n-1}$ in an explicit manner, and then evaluate the cohomological cup product of them, by making the best use of Gel'fand-Tsetlin basis.


title: A foolish consistency? Aligning interface objects hinders location recall and may induce collinear errors

abstract: During our nearly constant use of digital devices, perhaps our most frequent need is to visually identify icons representing our content and invoke the actions to manipulate them. Almost since the inception of user interface design in the 1970s, with rare exception it has become the tendency for programmers to prescribe the arrangement these things in uniform rectilinear rows and columns. This was imported from theories for print design and ultimately brought into widespread practice for graphical user interfaces (GUIs). Whether consistent rectilinearity actually does better than less rectilinear arrangements to maximize selection efficiency has not been challenged on considerations of speed or any other measure. In a series of four experiments, we explore how alignment may in fact discourage easy recallability of screen object locations and hence increase search intensity. A second objective is to present a methodological model where we deliberately attempt to begin with psychophysical cognitive evidence at the environmental schematic low end (beginning with contextual cueing paradigm), then move progressively upwards in naturalism in the experiments to something that approximates actual human work at the higher end, all along attempting to keep one important environmental property constant. Two experiments using contextual cueing paradigm confirm that collinearly aligned arrays do not encourage recallability of location, while noncollinear arrays appear to create traces that can be recalled automatically. Two other experiments give further demonstration of explicit recollection and location recall, showing that collinear arrangements may in fact induce location recall errors to neighboring collinear objects. We discuss surrounding theoretical, historical, and practical questions.


title: Curriculum Learning with Adam: The Devil Is in the Wrong Details

abstract: Curriculum learning (CL) posits that machine learning models -- similar to humans -- may learn more efficiently from data that match their current learning progress. However, CL methods are still poorly understood and, in particular for natural language processing (NLP), have achieved only limited success. In this paper, we explore why. Starting from an attempt to replicate and extend a number of recent curriculum methods, we find that their results are surprisingly brittle when applied to NLP. A deep dive into the (in)effectiveness of the curricula in some scenarios shows us why: when curricula are employed in combination with the popular Adam optimisation algorithm, they oftentimes learn to adapt to suboptimally chosen optimisation parameters for this algorithm. We present a number of different case studies with different common hand-crafted and automated CL approaches to illustrate this phenomenon, and we find that none of them outperforms optimisation with only Adam with well-chosen hyperparameters. As such, our results contribute to understanding why CL methods work, but at the same time urge caution when claiming positive results.


title: A Robust ADMM-Based Optimization Algorithm For Underwater Acoustic Channel Estimation

abstract: Accurate estimation of the Underwater acoustic (UWA) is a key part of underwater communications, especially for coherent systems. The severe multipath effects and large delay spreads make the estimation problem large-scale. The non-stationary, non-Gaussian, and impulsive nature of ocean ambient noise poses further obstacles to the design of estimation algorithms. Under the framework of compressed sensing (CS), this work addresses the issue of robust channel estimation when measurements are contaminated by impulsive noise. A first-order algorithm based on alternating direction method of multipliers (ADMM) is proposed. Numerical simulations of time-varying channel estimation are performed to show its improved performance in highly impulsive noise environments.


title: Zip stacks and moduli stacks of local Shtukas

abstract: Let $k$ be a field and $G$ be a connected reductive group over $k$. We denote the positive loop group of $G$ by ${\mathcal{L}}^+G$ and $\mathcal{K}_1$ the kernel of the canonical reduction map $\mathcal{L}^+G \to G$. For any cocharacter $\mu$ of $G$, we show that Viehmann's double coset spaces, namely the set-valued (rather than groupoid-valued) fpqc sheaf ${}_1\mathcal{C}_1^\mu:= \mathcal{K}_1\backslash \mathcal{L}^+Gt^{\mu}\mathcal{L}^+G/\mathcal{K}_1$, and its mixed characteristic analogue when $k$ is a perfect field of posi{t}ive characteristic, are represented by a common smooth homogeneous $G\times_k G$-spherical variety. These are, in fact, isomorphic to Lusztig varieties. Such a representability result allows us to initiate the study of comparison between the moduli stack of local Shtukas and zip stacks. When the base field is a perfect field of characteristic $p>0$, we establish a direct homeomorphism between the coarse moduli stack of 1-1-truncated local $G$-Shtukas and that of $G$-zips\comment{ (which morally are linearized 1-truncated $p$-divisible groups)} of the same type. The results are applied to our work on zip period maps of Shimura varieties. An open problem is proposed in the last section.


title: Quantum engines with interacting Bose-Einstein condensates

abstract: We consider a quantum Otto cycle with an interacting Bose-Einstein condensate at finite temperature. We present a procedure to evolve this system in time in three spatial dimensions, in which closed (adiabatic) strokes are described by the Gross-Pitaevskii equation, and open (isochoric) strokes are modeled using a stochastic Ginzburg-Landau equation. We analyze the effect on the thermodynamic efficiency of the strength of interactions, the frequency of the harmonic trap, and the temperatures of the reservoirs. The efficiency has little sensitivity to changes in the temperatures, but decreases as interactions increase. However, stronger interactions allow for faster cycles and for substantial increases in power.


title: Plastic deformation mechanisms during nanoindentation of W, Mo, V body-centered cubic single crystals and their corresponding W-Mo, W-V equiatomic random solid solutions

abstract: Deformation plasticity mechanisms in alloys and compounds may unveil the material capacity towards optimal mechanical properties. We conduct a series of molecular dynamics (MD) simulations to investigate plasticity mechanisms due to nanoindentation in pure tungsten, molybdenum and vanadium body-centered cubic single crystals, as well as the also body-centered cubic, equiatomic, random solid solutions (RSS) of tungsten--molybdenum and tungsten--vanadium alloys. Our analysis focuses on a thorough, side-by-side comparison of dynamic deformation processes, defect nucleation, and evolution, along with corresponding stress--strain curves. We also check the surface morphology of indented samples through atomic shear strain mapping. As expected, the presence of Mo and V atoms in W matrices introduces lattice strain and distortion, increasing material resistance to deformation and slowing down dislocation mobility of dislocation loops with a Burgers vector of 1/2 $\langle 111 \rangle$. Our side-by-side comparison displays a remarkable suppression of the plastic zone size in equiatomic W--V RSS, but not in equiatomic W--Mo RSS alloys, displaying a clear prediction for optimal hardening response equiatomic W--V RSS alloys. If the small-depth nanoindentation plastic response is indicative of overall mechanical performance, it is possible to conceive a novel MD-based pathway towards material design for mechanical applications in complex, multi-component alloys.


title: Non-zero temperature study of spin 1/2 charmed baryons using lattice gauge theory

abstract: We study the behaviour of spin $1/2$ charmed baryons as the temperature increases. We make use of anisotropic lattice QCD simulations with $N_f = 2 + 1$ dynamical flavours. After determining the positive and negative parity ground state masses at the lowest temperature, we investigate the effect of rising temperature using ratios of thermal lattice correlators with both so-called reconstructed correlators and with simple model correlators. This avoids difficulties associated with non-zero temperature fitting or spectral reconstruction. We find that temperature effects are prominent throughout the hadronic phase for all negative parity channels considered and for some positive parity channels. Subsequently and where possible, we determine the masses of the ground states as a function of temperature. Finally we consider the effect of chiral symmetry restoration and extract an estimate of the pseudocritical temperature from singly charmed baryonic correlators.


title: The Snapshot Problem for the Wave equation

abstract: By definition, a wave is a $C^\infty$ solution $u(x,t)$ of the wave equation on $\mathbb R^n$, and a snapshot of the wave $u$ at time $t$ is the function $u_t$ on $\mathbb R^n$ given by $u_t(x)=u(x,t)$. We show that there are infinitely many waves with given $C^\infty$ snapshots $f_0$ and $f_1$ at times $t=0$ and $t=1$ respectively, but that all such waves have the same snapshots at integer times. We present a necessary condition for the uniqueness, and a compatibility condition for the existence, of a wave $u$ to have three given snapshots at three different times, and we show how this compatibility condition leads to the problem of small denominators and Liouville numbers. We extend our results to shifted wave equations on noncompact symmetric spaces. Finally, we consider the two-snapshot problem and corresponding small denominator results for the shifted wave equation on the $n$-sphere.


title: A Heuristic Informative-Path-Planning Algorithm for Autonomous Mapping of Unknown Areas

abstract: Informative path planning algorithms are of paramount importance in applications like disaster management to efficiently gather information through a priori unknown environments. This is, however, a complex problem that involves finding a globally optimal path that gathers the maximum amount of information (e.g., the largest map with a minimum travelling distance) while using partial and uncertain local measurements. This paper addresses this problem by proposing a novel heuristic algorithm that continuously estimates the potential mapping gain for different sub-areas across the partially created map, and then uses these estimations to locally navigate the robot. Furthermore, this paper presents a novel algorithm to calculate a benchmark solution, where the map is a priori known to the planar, to evaluate the efficacy of the developed heuristic algorithm over different test scenarios. The findings indicate that the efficiency of the proposed algorithm, measured in terms of the mapped area per unit of travelling distance, ranges from 70% to 80% of the benchmark solution in various test scenarios. In essence, the algorithm demonstrates the capability to generate paths that come close to the globally optimal path provided by the benchmark solution.


title: ULDP-FL: Federated Learning with Across Silo User-Level Differential Privacy

abstract: Differentially Private Federated Learning (DP-FL) has garnered attention as a collaborative machine learning approach that ensures formal privacy. Most DP-FL approaches ensure DP at the record-level within each silo for cross-silo FL. However, a single user's data may extend across multiple silos, and the desired user-level DP guarantee for such a setting remains unknown. In this study, we present Uldp-FL, a novel FL framework designed to guarantee user-level DP in cross-silo FL where a single user's data may belong to multiple silos. Our proposed algorithm directly ensures user-level DP through per-user weighted clipping, departing from group-privacy approaches. We provide a theoretical analysis of the algorithm's privacy and utility. Additionally, we enhance the utility of the proposed algorithm with an enhanced weighting strategy based on user record distribution and design a novel private protocol that ensures no additional information is revealed to the silos and the server. Experiments on real-world datasets show substantial improvements in our methods in privacy-utility trade-offs under user-level DP compared to baseline methods. To the best of our knowledge, our work is the first FL framework that effectively provides user-level DP in the general cross-silo FL setting.


title: Recording of 50 Business Assignments

abstract: One of the main use cases of process mining is to discover and analyze how users follow business assignments, providing valuable insights into process efficiency and optimization. In this paper, we present a comprehensive dataset consisting of 50 real business processes. The dataset holds significant potential for research in various applications, including task mining and process automation which is a valuable resource for researchers and practitioners.


title: Learning to Learn Financial Networks for Optimising Momentum Strategies

abstract: Network momentum provides a novel type of risk premium, which exploits the interconnections among assets in a financial network to predict future returns. However, the current process of constructing financial networks relies heavily on expensive databases and financial expertise, limiting accessibility for small-sized and academic institutions. Furthermore, the traditional approach treats network construction and portfolio optimisation as separate tasks, potentially hindering optimal portfolio performance. To address these challenges, we propose L2GMOM, an end-to-end machine learning framework that simultaneously learns financial networks and optimises trading signals for network momentum strategies. The model of L2GMOM is a neural network with a highly interpretable forward propagation architecture, which is derived from algorithm unrolling. The L2GMOM is flexible and can be trained with diverse loss functions for portfolio performance, e.g. the negative Sharpe ratio. Backtesting on 64 continuous future contracts demonstrates a significant improvement in portfolio profitability and risk control, with a Sharpe ratio of 1.74 across a 20-year period.


title: CLIPN for Zero-Shot OOD Detection: Teaching CLIP to Say No

abstract: Out-of-distribution (OOD) detection refers to training the model on an in-distribution (ID) dataset to classify whether the input images come from unknown classes. Considerable effort has been invested in designing various OOD detection methods based on either convolutional neural networks or transformers. However, zero-shot OOD detection methods driven by CLIP, which only require class names for ID, have received less attention. This paper presents a novel method, namely CLIP saying no (CLIPN), which empowers the logic of saying no within CLIP. Our key motivation is to equip CLIP with the capability of distinguishing OOD and ID samples using positive-semantic prompts and negation-semantic prompts. Specifically, we design a novel learnable no prompt and a no text encoder to capture negation semantics within images. Subsequently, we introduce two loss functions: the image-text binary-opposite loss and the text semantic-opposite loss, which we use to teach CLIPN to associate images with no prompts, thereby enabling it to identify unknown samples. Furthermore, we propose two threshold-free inference algorithms to perform OOD detection by utilizing negation semantics from no prompts and the text encoder. Experimental results on 9 benchmark datasets (3 ID datasets and 6 OOD datasets) for the OOD detection task demonstrate that CLIPN, based on ViT-B-16, outperforms 7 well-used algorithms by at least 2.34% and 11.64% in terms of AUROC and FPR95 for zero-shot OOD detection on ImageNet-1K. Our CLIPN can serve as a solid foundation for effectively leveraging CLIP in downstream OOD tasks. The code is available on https://github.com/xmed-lab/CLIPN.


title: VERITAS observations of the Be/X-ray binary system LS V +44 17 during a major outburst

abstract: The Be/X-ray binary system LS V +44 17 (RX J0440.9+4431) is a potential member of the rare class of gamma-ray binaries. The system is comprised of a Be star and a neutron star companion with an orbital period of 150 days. In December of 2022, MAXI detected an X-ray outburst from the source, which peaked in early January before declining and then re-brightening. During the second peak, the flux exceeded 1 Crab in the 15-50 keV range, and exhibited a pulsed emission component with a pulse period of 208 seconds. VERITAS observations were conducted close to the peak of the second outburst, from January 24 to January 27, 2023. We report here on the search for very high energy (VHE) gamma-ray emission in these data.


title: The Challenges of Machine Learning for Trust and Safety: A Case Study on Misinformation Detection

abstract: We examine the disconnect between scholarship and practice in applying machine learning to trust and safety problems, using misinformation detection as a case study. We survey literature on automated detection of misinformation across a corpus of 248 well-cited papers in the field. We then examine subsets of papers for data and code availability, design missteps, reproducibility, and generalizability. Our paper corpus includes published work in security, natural language processing, and computational social science. Across these disparate disciplines, we identify common errors in dataset and method design. In general, detection tasks are often meaningfully distinct from the challenges that online services actually face. Datasets and model evaluation are often non-representative of real-world contexts, and evaluation frequently is not independent of model training. We demonstrate the limitations of current detection methods in a series of three representative replication studies. Based on the results of these analyses and our literature survey, we conclude that the current state-of-the-art in fully-automated misinformation detection has limited efficacy in detecting human-generated misinformation. We offer recommendations for evaluating applications of machine learning to trust and safety problems and recommend future directions for research.


title: SG-Former: Self-guided Transformer with Evolving Token Reallocation

abstract: Vision Transformer has demonstrated impressive success across various vision tasks. However, its heavy computation cost, which grows quadratically with respect to the token sequence length, largely limits its power in handling large feature maps. To alleviate the computation cost, previous works rely on either fine-grained self-attentions restricted to local small regions, or global self-attentions but to shorten the sequence length resulting in coarse granularity. In this paper, we propose a novel model, termed as Self-guided Transformer~(SG-Former), towards effective global self-attention with adaptive fine granularity. At the heart of our approach is to utilize a significance map, which is estimated through hybrid-scale self-attention and evolves itself during training, to reallocate tokens based on the significance of each region. Intuitively, we assign more tokens to the salient regions for achieving fine-grained attention, while allocating fewer tokens to the minor regions in exchange for efficiency and global receptive fields. The proposed SG-Former achieves performance superior to state of the art: our base size model achieves \textbf{84.7\%} Top-1 accuracy on ImageNet-1K, \textbf{51.2mAP} bbAP on CoCo, \textbf{52.7mIoU} on ADE20K surpassing the Swin Transformer by \textbf{+1.3\% / +2.7 mAP/ +3 mIoU}, with lower computation costs and fewer parameters. The code is available at \href{https://github.com/OliverRensu/SG-Former}{https://github.com/OliverRensu/SG-Former}


title: Funnel MPC for nonlinear systems with arbitrary relative degree

abstract: The Model Predictive Control (MPC) scheme Funnel MPC enables output tracking of smooth reference signals with prescribed error bounds for nonlinear multi-input multi-output systems with stable internal dynamics. Earlier works achieved the control objective for system with relative degree restricted to one or incorporated additional feasibility constraints in the optimal control problem. Here we resolve these limitations by introducing a modified stage cost function relying on a weighted sum of the tracking error derivatives. The weights need to be sufficiently large and we state explicit lower bounds. Under these assumptions we are able to prove initial and recursive feasibility of the novel Funnel MPC scheme for systems with arbitrary relative degree - without requiring any terminal conditions, a sufficiently long prediction horizon or additional output constraints.


title: CIParsing: Unifying Causality Properties into Multiple Human Parsing

abstract: Existing methods of multiple human parsing (MHP) apply statistical models to acquire underlying associations between images and labeled body parts. However, acquired associations often contain many spurious correlations that degrade model generalization, leading statistical models to be vulnerable to visually contextual variations in images (e.g., unseen image styles/external interventions). To tackle this, we present a causality inspired parsing paradigm termed CIParsing, which follows fundamental causal principles involving two causal properties for human parsing (i.e., the causal diversity and the causal invariance). Specifically, we assume that an input image is constructed by a mix of causal factors (the characteristics of body parts) and non-causal factors (external contexts), where only the former ones cause the generation process of human parsing.Since causal/non-causal factors are unobservable, a human parser in proposed CIParsing is required to construct latent representations of causal factors and learns to enforce representations to satisfy the causal properties. In this way, the human parser is able to rely on causal factors w.r.t relevant evidence rather than non-causal factors w.r.t spurious correlations, thus alleviating model degradation and yielding improved parsing ability. Notably, the CIParsing is designed in a plug-and-play fashion and can be integrated into any existing MHP models. Extensive experiments conducted on two widely used benchmarks demonstrate the effectiveness and generalizability of our method.


title: Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning

abstract: The recent surge of generative AI has been fueled by the generative power of diffusion probabilistic models and the scalable capabilities of large language models. Despite their potential, it remains elusive whether diffusion language models can solve general language tasks comparable to their autoregressive counterparts. This paper demonstrates that scaling diffusion models w.r.t. data, sizes, and tasks can effectively make them strong language learners. We build competent diffusion language models at scale by first acquiring knowledge from massive data via masked language modeling pretraining thanks to their intrinsic connections. We then reprogram pretrained masked language models into diffusion language models via diffusive adaptation, wherein task-specific finetuning and instruction finetuning are explored to unlock their versatility in solving general language tasks. Experiments show that scaling diffusion language models consistently improves performance across downstream language tasks. We further discover that instruction finetuning can elicit zero-shot and few-shot in-context learning abilities that help tackle many unseen tasks by following natural language instructions, and show promise in advanced and challenging abilities such as reasoning.


title: The blow-up rate for a loglog non-scaling invariant semilinear wave equation

abstract: We consider blow-up solutions of a semilinear wave equation with a loglog perturbation of the power nonlinearity in the subconformal case, and show that the blow-up rate is given by the solution of the associated ODE which has the same blow-up time. In fact, our result shows an upper bound and a lower bound of the blow-up rate, both proportional to the blow-up solution of the associated ODE. The main difficulty comes from the fact that the PDE is not scaling invariant.


title: Critical Learning Periods Emerge Even in Deep Linear Networks

abstract: Critical learning periods are periods early in development where temporary sensory deficits can have a permanent effect on behavior and learned representations. Despite the radical differences between biological and artificial networks, critical learning periods have been empirically observed in both systems. This suggests that critical periods may be fundamental to learning and not an accident of biology. Yet, why exactly critical periods emerge in deep networks is still an open question, and in particular it is unclear whether the critical periods observed in both systems depend on particular architectural or optimization details. To isolate the key underlying factors, we focus on deep linear network models, and show that, surprisingly, such networks also display much of the behavior seen in biology and artificial networks, while being amenable to analytical treatment. We show that critical periods depend on the depth of the model and structure of the data distribution. We also show analytically and in simulations that the learning of features is tied to competition between sources. Finally, we extend our analysis to multi-task learning to show that pre-training on certain tasks can damage the transfer performance on new tasks, and show how this depends on the relationship between tasks and the duration of the pre-training stage. To the best of our knowledge, our work provides the first analytically tractable model that sheds light into why critical learning periods emerge in biological and artificial networks.


title: Improving cold atmospheric pressure plasma efficacy on breast cancer cells control-ability and mortality by using vitamin C and static magnetic field

abstract: Since the last decades, there have been numerous reports about the interaction of magnetic field (MF) and cold atmospheric plasma (CAP) with the biological systems, separately. In this manuscript, we have investigated the combined effect of CAP with the static magnetic field (SMF) as an effective method for cancer cells treatment. MDA-MB-231 breast cancer cells were cultured and treated with CAP in different input power and different exposure time in the presence and absence of the SMF. Vitamin C is used in medium, and cell viability is investigated in the presence and absence of this antioxidant compound. The MTT assay has been employed to measure cell survival, and then T-test and one-way ANOVA are used to assess the significance level of quantitative data. In order to determine the migration rate of cancer cells, wound healing assay has been carried out. Results show that presence of the SMF and vitamin C as well as increasing the input power has a significant role on the attenuation of the survival and migration rate of the cells. The results of the present investigation will greatly contribute to improve the CAP efficiency in cancer therapy through using the SMF and vitamin C as a complement to conventional CAP therapies.

categories: physics.med-ph physics.atom-ph physics.bio-ph physics.plasm-ph


title: Physically Consistent Modelling of Wireless Links with Reconfigurable Intelligent Surfaces Using Multiport Network Analysis

abstract: RISs are an emerging technology for engineering the channels of future wireless communication systems. The vast majority of research publications on RIS are focussing on system-level optimization and are based on very simplistic models ignoring basic physical laws. There are only a few publications with a focus on physical modeling. Nevertheless, the widely employed model is still inconsistent with basic physical laws. We will show that even with a very simple abstract model based on isotropic radiators, ignoring any mismatch, mutual coupling, and losses, each RIS element cannot be modeled to simply reflect the incident signal by manipulating its phase only and letting the amplitude unchanged. We will demonstrate the inconsistencies with the aid of very simple toy examples, even with only one or two RIS elements. Based on impedance parameters, the problems associated with scattering parameters can be identified enabling a correct interpretation of the derived solutions.


title: Enhancing cardiovascular risk prediction through AI-enabled calcium-omics

abstract: Background. Coronary artery calcium (CAC) is a powerful predictor of major adverse cardiovascular events (MACE). Traditional Agatston score simply sums the calcium, albeit in a non-linear way, leaving room for improved calcification assessments that will more fully capture the extent of disease. Objective. To determine if AI methods using detailed calcification features (i.e., calcium-omics) can improve MACE prediction. Methods. We investigated additional features of calcification including assessment of mass, volume, density, spatial distribution, territory, etc. We used a Cox model with elastic-net regularization on 2457 CT calcium score (CTCS) enriched for MACE events obtained from a large no-cost CLARIFY program (ClinicalTri-als.gov Identifier: NCT04075162). We employed sampling techniques to enhance model training. We also investigated Cox models with selected features to identify explainable high-risk characteristics. Results. Our proposed calcium-omics model with modified synthetic down sampling and up sampling gave C-index (80.5%/71.6%) and two-year AUC (82.4%/74.8%) for (80:20, training/testing), respectively (sampling was applied to the training set only). Results compared favorably to Agatston which gave C-index (71.3%/70.3%) and AUC (71.8%/68.8%), respectively. Among calcium-omics features, numbers of calcifications, LAD mass, and diffusivity (a measure of spatial distribution) were important determinants of increased risk, with dense calcification (>1000HU) associated with lower risk. The calcium-omics model reclassified 63% of MACE patients to the high risk group in a held-out test. The categorical net-reclassification index was NRI=0.153. Conclusions. AI analysis of coronary calcification can lead to improved results as compared to Agatston scoring. Our findings suggest the utility of calcium-omics in improved prediction of risk.


title: [Existence of multiple solutions for a Schr\"ondiger logarithmic equation

abstract: This paper concerns the existence of multiple solutions for a Schr\"odinger logarithmic equation of the form \begin{equation} \left\{\begin{aligned} -\varepsilon^2\Delta u + V(x)u & =u\log u^2,\;\;\mbox{in}\;\;\mathbb{R}^{N},\nonumber u \in H^{1}(\mathbb{R}^{N}), \end{aligned} \right.\leqno{(P_\varepsilon)} \end{equation} where $V:\mathbb{R}^N\longrightarrow \mathbb{R}$ is a continuous function that satisfies some technical conditions and $\varepsilon$ is a positive parameter. We will establish the multiplicity of solution for $(P_\varepsilon)$ by using the notion of Lusternik-Schnirelmann category, by introducing a new function space where the energy functional is $C^1$.


title: Enhanced bunching of nearly indistinguishable bosons

abstract: In multiphon interference processes, the commonly assumed direct link between boson bunching and particle indistinguishability has recently been challenged in Seron $\textit{et al.}$ [Nat. Photon. 17, 702 (2023)]. Exploiting the connection between optical interferometry and matrix permanents, it appeared that bunching effects may surprisingly be enhanced in some interferometers by preparing specific states of partially distinguishable photons. Interestingly, all the states giving rise to such an anomalous bunching were found to be $\textit{far from}$ the state of perfectly indistinguishable particles, raising the question of whether this intriguing phenomenon might even exist for $\textit{nearly indistinguishable}$ particles. Here, we answer positively this physically motivated question by exploiting some mathematical conjecture on matrix permanents, whose physical interpretation had not yet been unveiled. Using a recently found counterexample to this conjecture, we demonstrate that there is an optical set-up involving 8~photons in 10~modes for which the probability that all photons bunch into two output modes can be enhanced by applying a suitable perturbation to the polarization states starting from photons with the same polarization. We also find out that the perturbation that decreases the bunching probability the most is not the one that takes the perfectly indistinguishable state towards a fully distinguishable state, as could naively be expected.


title: Semiparametric Modeling and Analysis for Longitudinal Network Data

abstract: We introduce a semiparametric latent space model for analyzing longitudinal network data. The model consists of a static latent space component and a time-varying node-specific baseline component. We develop a semiparametric efficient score equation for the latent space parameter by adjusting for the baseline nuisance component. Estimation is accomplished through a one-step update estimator and an appropriately penalized maximum likelihood estimator. We derive oracle error bounds for the two estimators and address identifiability concerns from a quotient manifold perspective. Our approach is demonstrated using the New York Citi Bike Dataset.


title: Electromagnets Under the Table: an Unobtrusive Magnetic Navigation System for Microsurgery

abstract: Miniature magnetic tools have the potential to enable minimally invasive surgical techniques to be applied to space-restricted surgical procedures in areas such as neurosurgery. However, typical magnetic navigation systems, which create the magnetic fields to drive such tools, either cannot generate large enough fields, or surround the patient in a way that obstructs surgeon access to the patient. This paper introduces the design of a magnetic navigation system with eight electromagnets arranged completely under the operating table, to endow the system with maximal workspace accessibility, which allows the patient to lie down on the top surface of the system without any constraints. The found optimal geometric layout of the electromagnets maximizes the field strength and uniformity over a reasonable neurosurgical operating volume. The system can generate non-uniform magnetic fields up to 38 mT along the x and y axes and 47 mT along the z axis at a working distance of 120 mm away from the actuation system workbench, deep enough to deploy magnetic microsurgical tools in the brain. The forces which can be exerted on millimeter-scale magnets used in prototype neurosurgical tools are validated experimentally. Due to its large workspace, this system could be used to control milli-robots in a variety of surgical applications.


title: Uniform probability in cosmology

abstract: Problems with uniform probabilities on an infinite support show up in contemporary cosmology. This paper focuses on the context of inflation theory, where it complicates the assignment of a probability measure over pocket universes. The measure problem in cosmology, whereby it seems impossible to pick out a uniquely well-motivated measure, is associated with a paradox that occurs in standard probability theory and crucially involves uniformity on an infinite sample space. This problem has been discussed by physicists, albeit without reference to earlier work on this topic. The aim of this article is both to introduce philosophers of probability to these recent discussions in cosmology and to familiarize physicists and philosophers working on cosmology with relevant foundational work by Kolmogorov, de Finetti, Jaynes, and other probabilists. As such, the main goal is not to solve the measure problem, but to clarify the exact origin of some of the current obstacles. The analysis of the assumptions going into the paradox indicates that there exist multiple ways of dealing consistently with uniform probabilities on infinite sample spaces. Taking a pluralist stance towards the mathematical methods used in cosmology shows there is some room for progress with assigning probabilities in cosmological theories.


title: Analysis of transient and intermittent flows using a multidimensional empirical mode decomposition

abstract: Modal decomposition techniques are important tools for the analysis of unsteady flows and, in order to provide meaningful insights with respect to coherent structures and their characteristic frequencies, the modes must possess a robust spatial support. In this context, although widely used, methods based on singular value decomposition (SVD) may produce modes that are difficult to interpret when applied to problems dominated by intermittent and transient events. Fortunately, specific modal decomposition techniques have been recently developed to analyze such problems. However, a proper comparison between existing methods is still lacking from the literature. Therefore, this work compares two recent methods: the fast adaptive multivariate empirical mode decomposition (FA-MVEMD) and the multi-resolution dynamic mode decomposition (mrDMD). These techniques are employed here for the study of flow databases involving transient and intermittent dynamics. Specifically, the investigated problems include an SD7003 airfoil subjected to deep dynamic stall conditions, and a steady NACA0012 airfoil operating at a transitional Reynolds number. In the former case, the methods are employed to investigate the onset and evolution of the dynamic stall vortex (DSV), while in the latter case, intermittent vortex pairing is analyzed. We show that the combination of a multidimensional EMD with the Hilbert transform provides modes with superior spatial support when compared to the mrDMD, also allowing the characterization of instantaneous frequencies of coherent structures. Moreover, the EMD also condenses a larger amount of information within a single intrinsic mode function (IMF).


title: SPPNet: A Single-Point Prompt Network for Nuclei Image Segmentation

abstract: Image segmentation plays an essential role in nuclei image analysis. Recently, the segment anything model has made a significant breakthrough in such tasks. However, the current model exists two major issues for cell segmentation: (1) the image encoder of the segment anything model involves a large number of parameters. Retraining or even fine-tuning the model still requires expensive computational resources. (2) in point prompt mode, points are sampled from the center of the ground truth and more than one set of points is expected to achieve reliable performance, which is not efficient for practical applications. In this paper, a single-point prompt network is proposed for nuclei image segmentation, called SPPNet. We replace the original image encoder with a lightweight vision transformer. Also, an effective convolutional block is added in parallel to extract the low-level semantic information from the image and compensate for the performance degradation due to the small image encoder. We propose a new point-sampling method based on the Gaussian kernel. The proposed model is evaluated on the MoNuSeg-2018 dataset. The result demonstrated that SPPNet outperforms existing U-shape architectures and shows faster convergence in training. Compared to the segment anything model, SPPNet shows roughly 20 times faster inference, with 1/70 parameters and computational cost. Particularly, only one set of points is required in both the training and inference phases, which is more reasonable for clinical applications. The code for our work and more technical details can be found at https://github.com/xq141839/SPPNet.


title: Une approche combinatoire pour le r\'esultant multivari\'e. Le r\'esultant multivari\'e pour les enfants motiv\'es

abstract: We provide, in a 474 pages study, a comprehensive and self-contained treatment of Resultant Theory for a homogeneous system of polynomials with several variables (as many variables as of polynomials). In a non classical way, we use the multiplicative structure of finite free resolutions, by applying it to the complex homogeneous components of the Koszul complex of the system, and this in any degree. Moreover, these complexes have Macaulay decompositions. These three pillars, multiplicative structure, Koszul complex, Macaulay decomposition, allow to establish, surprisingly to us, remarkable binomial relations between 3 families of scalars resulting from the differentials of that complexes. These binomial relations generate several notable results, like a determinantal expression of a certain denominator, depending only on the first differential, and provide in particular formulas expressing the resultant. We have explored more deeply the case of the critical degree delta. This degree produces a fundamental linear form on the homogeneous polynomial component of degree delta, including the resultant. And this fundamental linear form has allowed us to highlight a certain number of remarkable properties. Key words: Elimination theory, homogeneous polynomial system, resultant, determinant of complexes, Cayley determinant, computational algebra, finitefree resolution, Koszul complex, Euler characteristic, Grade, Multiplicative structure, Macaulay decomposition, Fitting invariants, MacRae invariant, regular sequence.


title: Zero-field optical magnetometer based on spin-alignment

abstract: Optically-pumped magnetometers are an important instrument for imaging biological magnetic signals without the need for cryogenic cooling. These magnetometers are presently available in the commercial market and utilize the principles of atomic alignment or orientation, enabling remarkable sensitivity and precision in the measurement of magnetic fields. This research focuses on utilizing a spin-aligned atomic ensemble for magnetometry at zero-field. A novel approach is introduced, which involves evaluating how the linear polarization of light rotates as it passes through the atomic vapor to null the magnetic field. Analytical expressions are derived for the resulting spin alignment and photodetection signals. Experimental results are provided, demonstrating good agreement with the theoretical predictions. The sensitivity and bandwidth of the magnetometer are characterized based on the detected polarization rotation signal. Lastly, the practical utility of the magnetometer for medical applications is demonstrated by successfully detecting a synthetic cardiac signal.


title: MolGrapher: Graph-based Visual Recognition of Chemical Structures

abstract: The automatic analysis of chemical literature has immense potential to accelerate the discovery of new materials and drugs. Much of the critical information in patent documents and scientific articles is contained in figures, depicting the molecule structures. However, automatically parsing the exact chemical structure is a formidable challenge, due to the amount of detailed information, the diversity of drawing styles, and the need for training data. In this work, we introduce MolGrapher to recognize chemical structures visually. First, a deep keypoint detector detects the atoms. Second, we treat all candidate atoms and bonds as nodes and put them in a graph. This construct allows a natural graph representation of the molecule. Last, we classify atom and bond nodes in the graph with a Graph Neural Network. To address the lack of real training data, we propose a synthetic data generation pipeline producing diverse and realistic results. In addition, we introduce a large-scale benchmark of annotated real molecule images, USPTO-30K, to spur research on this critical topic. Extensive experiments on five datasets show that our approach significantly outperforms classical and learning-based methods in most settings. Code, models, and datasets are available.


title: An improved eigenvalue estimate for embedded minimal hypersurfaces in the sphere

abstract: Suppose that $\Sigma^n\subset\mathbb{S}^{n+1}$ is a closed embedded minimal hypersurface. We prove that the first non-zero eigenvalue $\lambda_1$ of the induced Laplace-Beltrami operator on $\Sigma$ satisfies $\lambda_1 \geq \frac{n}{2}+ a_n(\Lambda^6 + b_n)^{-1}$, where $a_n$ and $b_n$ are explicit dimensional constants and $\Lambda$ is an upper bound for the length of the second fundamental form of $\Sigma$. This provides the first explicitly computable improvement on Choi & Wang's lower bound $\lambda_1 \geq \frac{n}{2}$ without any further assumptions on $\Sigma$.


title: A Generalized Double Chaplygin Model for Anisotropic Matter: The Newtonian Case

abstract: In this work, we investigate astrophysical systems in a Newtonian regime using anisotropic matter. For this purpose, we considered that both radial and tangential pressures satisfy a generalized Chaplygin-type equation of state. Using this model, we found the Lane--Emden equation for this system and solved it numerically for several sets of parameters. Finally, we explored the mass supported by this physical system and compared it with the Chandrasekhar mass.


title: Extension properties of orbit spaces of proper actions revisited

abstract: Let $G$ be a locally compact Hausdorff group. We study orbit spaces of equivariant absolute neighborhood extensors ($G$-${\rm ANE}$'s) in the class of all proper $G$-spaces that are metrizable by a $G$-invariant metric. We prove that if a proper $G$-space $X$ is a $G$-${\rm ANE}$ and all $G $-orbits in $X$ are metrizable, then the $G$-orbit space $X/G$ is an {\rm ANE}. If $G$ is a Lie group and $H$ is a closed normal subgroup of $G$, then the $H$-orbit space $X/H$ is a $G/H$-{\rm ANE}.


title: NimbRo wins ANA Avatar XPRIZE Immersive Telepresence Competition: Human-Centric Evaluation and Lessons Learned

abstract: Robotic avatar systems can enable immersive telepresence with locomotion, manipulation, and communication capabilities. We present such an avatar system, based on the key components of immersive 3D visualization and transparent force-feedback telemanipulation. Our avatar robot features an anthropomorphic upper body with dexterous hands. The remote human operator drives the arms and fingers through an exoskeleton-based operator station, which provides force feedback both at the wrist and for each finger. The robot torso is mounted on a holonomic base, providing omnidirectional locomotion on flat floors, controlled using a 3D rudder device. Finally, the robot features a 6D movable head with stereo cameras, which stream images to a VR display worn by the operator. Movement latency is hidden using spherical rendering. The head also carries a telepresence screen displaying an animated image of the operator's face, enabling direct interaction with remote persons. Our system won the \$10M ANA Avatar XPRIZE competition, which challenged teams to develop intuitive and immersive avatar systems that could be operated by briefly trained judges. We analyze our successful participation in the semifinals and finals and provide insight into our operator training and lessons learned. In addition, we evaluate our system in a user study that demonstrates its intuitive and easy usability.


title: Cyclic Orderings of Paving Matroids

abstract: A matroid M is cyclically orderable if there is a cyclic permutation of the elements of M such that any r consecutive elements form a basis in M. An old conjecture of Kajitani, Miyano, and Ueno states that a matroid M is cyclically orderable if and only if for all nonempty subsets X in E(M), |X|/r(M) is less than or equal to |E(M)|/r(M). In this paper, we verify this conjecture for all paving matroids.


title: Score diffusion models without early stopping: finite Fisher information is all you need

abstract: Diffusion models are a new class of generative models that revolve around the estimation of the score function associated with a stochastic differential equation. Subsequent to its acquisition, the approximated score function is then harnessed to simulate the corresponding time-reversal process, ultimately enabling the generation of approximate data samples. Despite their evident practical significance these models carry, a notable challenge persists in the form of a lack of comprehensive quantitative results, especially in scenarios involving non-regular scores and estimators. In almost all reported bounds in Kullback Leibler (KL) divergence, it is assumed that either the score function or its approximation is Lipschitz uniformly in time. However, this condition is very restrictive in practice or appears to be difficult to establish. To circumvent this issue, previous works mainly focused on establishing convergence bounds in KL for an early stopped version of the diffusion model and a smoothed version of the data distribution, or assuming that the data distribution is supported on a compact manifold. These explorations have lead to interesting bounds in either Wasserstein or Fortet-Mourier metrics. However, the question remains about the relevance of such early-stopping procedure or compactness conditions. In particular, if there exist a natural and mild condition ensuring explicit and sharp convergence bounds in KL. In this article, we tackle the aforementioned limitations by focusing on score diffusion models with fixed step size stemming from the Ornstein-Ulhenbeck semigroup and its kinetic counterpart. Our study provides a rigorous analysis, yielding simple, improved and sharp convergence bounds in KL applicable to any data distribution with finite Fisher information with respect to the standard Gaussian distribution.


title: LLMRec: Benchmarking Large Language Models on Recommendation Task

abstract: Recently, the fast development of Large Language Models (LLMs) such as ChatGPT has significantly advanced NLP tasks by enhancing the capabilities of conversational models. However, the application of LLMs in the recommendation domain has not been thoroughly investigated. To bridge this gap, we propose LLMRec, a LLM-based recommender system designed for benchmarking LLMs on various recommendation tasks. Specifically, we benchmark several popular off-the-shelf LLMs, such as ChatGPT, LLaMA, ChatGLM, on five recommendation tasks, including rating prediction, sequential recommendation, direct recommendation, explanation generation, and review summarization. Furthermore, we investigate the effectiveness of supervised finetuning to improve LLMs' instruction compliance ability. The benchmark results indicate that LLMs displayed only moderate proficiency in accuracy-based tasks such as sequential and direct recommendation. However, they demonstrated comparable performance to state-of-the-art methods in explainability-based tasks. We also conduct qualitative evaluations to further evaluate the quality of contents generated by different models, and the results show that LLMs can truly understand the provided information and generate clearer and more reasonable results. We aspire that this benchmark will serve as an inspiration for researchers to delve deeper into the potential of LLMs in enhancing recommendation performance. Our codes, processed data and benchmark results are available at https://github.com/williamliujl/LLMRec.


title: Recent Developments in Pandora's Box Problem: Variants and Applications

abstract: In 1979, Weitzman introduced Pandora's box problem as a framework for sequential search with costly inspections. Recently, there has been a surge of interest in Pandora's box problem, particularly among researchers working at the intersection of economics and computation. This survey provides an overview of the recent literature on Pandora's box problem, including its latest extensions and applications in areas such as market design, decision theory, and machine learning.


title: Multi-Objective Optimization for Sparse Deep Multi-Task Learning

abstract: Different conflicting optimization criteria arise naturally in various Deep Learning scenarios. These can address different main tasks (i.e., in the setting of Multi-Task Learning), but also main and secondary tasks such as loss minimization versus sparsity. The usual approach is a simple weighting of the criteria, which formally only works in the convex setting. In this paper, we present a Multi-Objective Optimization algorithm using a modified Weighted Chebyshev scalarization for training Deep Neural Networks (DNNs) with respect to several tasks. By employing this scalarization technique, the algorithm can identify all optimal solutions of the original problem while reducing its complexity to a sequence of single-objective problems. The simplified problems are then solved using an Augmented Lagrangian method, enabling the use of popular optimization techniques such as Adam and Stochastic Gradient Descent, while efficaciously handling constraints. Our work aims to address the (economical and also ecological) sustainability issue of DNN models, with a particular focus on Deep Multi-Task models, which are typically designed with a very large number of weights to perform equally well on multiple tasks. Through experiments conducted on two Machine Learning datasets, we demonstrate the possibility of adaptively sparsifying the model during training without significantly impacting its performance, if we are willing to apply task-specific adaptations to the network weights. Code is available at https://github.com/salomonhotegni/MDMTN


title: Multiplicative relations among differences of singular moduli

abstract: Let $n \in \mathbb{Z}_{>0}$. We prove that there exist a finite set $V$ and finitely many algebraic curves $T_1, \ldots, T_k$ with the following property: if $(x_1, \ldots, x_n, y)$ is an $(n+1)$-tuple of pairwise distinct singular moduli such that $\prod_{i=1}^n (x_i - y)^{a_i}=1$ for some $a_1, \ldots, a_n \in \mathbb{Z} \setminus \{0\}$, then $(x_1, \ldots, x_n, y) \in V \cup T_1 \cup \ldots \cup T_k$. Further, the curves $T_1, \ldots, T_k$ may be determined explicitly for a given $n$.


title: On the isoperimetric and isodiametric inequalities and the minimisation of eigenvalues of the Laplacian

abstract: We consider the problem of minimising the $k$-th eigenvalue of the Laplacian with some prescribed boundary condition over collections of convex domains of prescribed perimeter or diameter. It is known that these minimisation problems are well-posed for Dirichlet eigenvalues in any dimension $d\geq 2$ and any sequence of minimisers converges to the ball of unit perimeter or diameter respectively as $k\to +\infty$. In this paper, we show that the same is true in the case of Neumann eigenvalues under diameter constraint in any dimension and under perimeter constraint in dimension $d=2$. We also consider these problems for mixed Dirichlet-Neumann eigenvalues, under an additional geometric constraint, and discuss some applications of our proof techniques.


title: Feasibility of a trapped atom interferometer with accelerating optical traps

abstract: In order to increase the measured phase of an atom interferometer and improve its sensitivity, researchers attempt to increase the enclosed space-time area using two methods: creating larger separations between the interferometer arms and having longer evolution times. However, increasing the evolution time reduces the bandwidth that can be sampled, whereas decreasing the evolution time worsens the sensitivity. In this paper, we attempt to address this by proposing a setup for high-bandwidth applications, with improved overall sensitivity. This is realized by accelerating and holding the atoms using optical dipole traps. We find that accelerations of up to $10^{3}$-$10^{5}$ m/s$^2$ can be achieved using acousto-optic deflectors (AODs) to move the traps. By comparing the sensitivity of our approach to acceleration as a baseline to traditional atom interferometry, we find a substantial improvement to the state of the art. In the limit of appropriate beam and optics stabilization, sensitivities approaching 10$^{-14}$ (m/s$^2$)/$\sqrt{\rm Hz}$ may be achievable at 1 Hz, while detection at 1 kHz with a sensitivity an order of magnitude better than traditional free-fall atom interferometers is possible with today's systems.


title: How to Protect Copyright Data in Optimization of Large Language Models?

abstract: Large language models (LLMs) and generative AI have played a transformative role in computer research and applications. Controversy has arisen as to whether these models output copyrighted data, which can occur if the data the models are trained on is copyrighted. LLMs are built on the transformer neural network architecture, which in turn relies on a mathematical computation called Attention that uses the softmax function. In this paper, we show that large language model training and optimization can be seen as a softmax regression problem. We then establish a method of efficiently performing softmax regression, in a way that prevents the regression function from generating copyright data. This establishes a theoretical method of training large language models in a way that avoids generating copyright data.


title: Holographic RIS Empowered THz Communications with Hardware Imperfections under Adverse Weather Conditions

abstract: This paper focuses on providing a theoretical framework for the evaluation of the performance of holographic reconfigurable intelligent surface (HRIS) empowered terahertz (THz) wireless systems under fog conditions. In more detail, we present a comprehensive methodology for evaluating the geometric losses of the end-to-end channel. Moreover, the stochastic nature of the end-to-end channel is characterized by novel closed-form probability density and cumulative distribution functions. Building upon them, the outage probability and the throughput of the system are extracted in closed form. These formulas account for the impact of transceiver hardware imperfections and are expected to become useful tools for the design of HRIS empowered THz wireless systems due to its remarkable engineering insights.


title: QED Fermions in a noisy magnetic field background: The effective action approach

abstract: We consider the effects of a noisy magnetic field background over the fermion propagator in QED, as an approximation to the spatial inhomogeneities and time-fluctuations that would naturally arise in certain physical scenarios, such as heavy-ion collisions or the quark-gluon plasma in the early stages of the evolution of the Universe. We considered a classical, finite and uniform average magnetic field background $\langle \mathbf{B}(\mathbf{x})\rangle_{\Delta} = \mathbf{B}$, subject to white-noise fluctuations with auto-correlation of magnitude $\Delta_B$. By means of the Schwinger representation of the propagator in the average magnetic field as a reference system, we used the replica formalism to study the effects of the magnetic noise at the mean field level, in terms of a vector order parameter $Q_j = \ii e \Delta_B\langle\langle \bar{\psi}\gamma_j\psi \rangle\rangle_{\Delta}$ whose magnitude represents the ensemble average (over magnetic noise) of the fermion currents. We identified the region where this order parameter acquires a finite value, thus breaking the $U(1)$-symmetry of the model due to the presence of the magnetic noise.


title: Fast near-infrared photodetectors based on nontoxic and solution-processable AgBiS2

abstract: Solution-processable near-infrared (NIR) photodetectors are urgently needed for a wide range of next-generation electronics, including sensors, optical communications and bioimaging. However, there is currently a compromise between low toxicity and slow (<300 kHz cut-off frequency) organic materials versus faster detectors (>300 kHz cut-off frequency) based on compounds containing toxic lead or cadmium. Herein, we circumvent this trade-off by developing solution-processed AgBiS2 photodetectors with high cut-off frequencies under both white light (>1 MHz) and NIR (approaching 500 kHz) illumination. These high cut-off frequencies are due to the short transit distances of charge-carriers in the AgBiS2 photodetectors, which arise from the strong light absorption of these materials, such that film thicknesses well below 120 nm are adequate to absorb >65% of near-infrared to visible light. By finely controlling the thickness of the photoactive layer, we can modulate the charge-collection efficiency, achieve low dark current densities, and minimize the effects of ion migration to realize fast photodetectors that are stable in air. These outstanding characteristics enable real-time heartbeat sensors based on NIR AgBiS2 photodetectors. # equal contribution, * corresponding authors


title: Regular black holes from higher-derivative and nonlocal gravity: The smeared delta source approximation

abstract: In this work we study static spherically symmetric solutions of effective field equations related to local and nonlocal higher-derivative gravity models, based on the effective delta source approximation. We discuss several possibilities for the equations of state, and how they influence the solutions. In particular, we present an equation of state such that the solutions match the Newtonian-limit metric in both regimes of large and small $r$. A significant part of the work is dedicated to the study of the regularity of the solutions and the comparison with the linearized solutions. Explicit solutions are presented for some cases of local and nonlocal models. The results obtained here can be regarded as a possible link between the previous researches on linearized higher-derivative gravity and the solutions of the nonlinear complete field equations.


title: How Safe Am I Given What I See? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy

abstract: End-to-end learning has emerged as a major paradigm for developing autonomous systems. Unfortunately, with its performance and convenience comes an even greater challenge of safety assurance. A key factor of this challenge is the absence of the notion of a low-dimensional and interpretable dynamical state, around which traditional assurance methods revolve. Focusing on the online safety prediction problem, this paper proposes a configurable family of learning pipelines based on generative world models, which do not require low-dimensional states. To implement these pipelines, we overcome the challenges of learning safety-informed latent representations and missing safety labels under prediction-induced distribution shift. These pipelines come with statistical calibration guarantees on their safety chance predictions based on conformal prediction. We perform an extensive evaluation of the proposed learning pipelines on two case studies of image-controlled systems: a racing car and a cartpole.


title: Evaluation of SNOLAB background mitigation procedures through the use of an ICP-MS based dust monitoring methodology

abstract: Dust particulate fallout on materials in use for rare-event searches is a concerning source of radioactive backgrounds due to the presence of naturally occurring radionuclides K-40, Th-232, U-238, and their progeny in dust. Much effort is dedicated to inform radioactive backgrounds from dust and evaluate the efficacy of mitigation procedures. A great portion of such effort relies on fallout models and assumed dust composition. In this work, an ICP-MS based methodology was employed for a direct determination of fallout rates of radionuclides and stable isotopes of interest from dust particulate at the SNOLAB facility. Hosted in an active mine, the SNOLAB underground laboratory strives to maintain experimental areas at class 2000 cleanroom level. This work validates the mitigation procedures in place at SNOLAB, and informs dust backgrounds during laboratory activities. Fallout rates of major constituent of the local rock were measured two to three orders of magnitude lower in the clean experimental areas compared to non-clean transition areas from the mine to the laboratory. A ca. two order of magnitude increase in stable Pb fallout rate was determined in an experimental area during activities involving handling of Pb bricks. Increased K-40, Th-232, and U-238 fallout rates were measured in clean experimental areas during activities generating particulate.


title: A Drinfeld type presentation of twisted Yangians

abstract: We develop a Gauss decomposition approach to establish a Drinfeld type current presentation for Olshanski's twisted Yangians associated to the orthogonal Lie algebras (also called twisted Yangians of type AI), settling a longstanding open problem. We expect that this will open the door for finding current presentations for other twisted Yangians.


title: Absorbing boundary conditions for the Helmholtz equation using Gauss-Legendre quadrature reduced integrations

abstract: We introduce a new class of absorbing boundary conditions (ABCs) for the Helmholtz equation. The proposed ABCs are obtained by using $L$ discrete layers and the $Q_N$ Lagrange finite element in conjunction with the $N$-point Gauss-Legendre quadrature reduced integration rule in a specific formulation of perfectly matched layers. The proposed ABCs are classified by a tuple $(L,N)$, and achieve reflection error of order $O(R^{2LN})$ for some $R<1$. The new ABCs generalise the perfectly matched discrete layers proposed by Guddati and Lim [Int. J. Numer. Meth. Engng 66 (6) (2006) 949-977], including them as type $(L,1)$. An analysis of the proposed ABCs is performed motivated by the work of Ainsworth [J. Comput. Phys. 198 (1) (2004) 106-130]. The new ABCs facilitate numerical implementations of the Helmholtz problem with ABCs if $Q_N$ finite elements are used in the physical domain as well as give more insight into this field for the further advancement.


title: Learning from Negative User Feedback and Measuring Responsiveness for Sequential Recommenders

abstract: Sequential recommenders have been widely used in industry due to their strength in modeling user preferences. While these models excel at learning a user's positive interests, less attention has been paid to learning from negative user feedback. Negative user feedback is an important lever of user control, and comes with an expectation that recommenders should respond quickly and reduce similar recommendations to the user. However, negative feedback signals are often ignored in the training objective of sequential retrieval models, which primarily aim at predicting positive user interactions. In this work, we incorporate explicit and implicit negative user feedback into the training objective of sequential recommenders in the retrieval stage using a "not-to-recommend" loss function that optimizes for the log-likelihood of not recommending items with negative feedback. We demonstrate the effectiveness of this approach using live experiments on a large-scale industrial recommender system. Furthermore, we address a challenge in measuring recommender responsiveness to negative feedback by developing a counterfactual simulation framework to compare recommender responses between different user actions, showing improved responsiveness from the modeling change.


title: On Orbit Spaces of Distributive Binary $G$-Spaces

abstract: The orbit space of a distributive binary $G$-space is studied. A number of its properties in the case of a compact binarily acting group $G$ are established.


title: Innovating Computer Programming Pedagogy: The AI-Lab Framework for Generative AI Adoption

abstract: Over the last year, the ascent of Generative AI (GenAI) has raised concerns about its impact on core skill development, such as problem-solving and algorithmic thinking, in Computer Science students. Preliminary anonymous surveys show that at least 48.5% of our students use GenAI for homework. With the proliferation of these tools, the academic community must contemplate the appropriate role of these tools in education. Neglecting this might culminate in a phenomenon we term the "Junior-Year Wall," where students struggle in advanced courses due to prior over-dependence on GenAI. Instead of discouraging GenAI use, which may unintentionally foster covert usage, our research seeks to answer: "How can educators guide students' interactions with GenAI to preserve core skill development during their foundational academic years?" We introduce "AI-Lab," a pedagogical framework for guiding students in effectively leveraging GenAI within core collegiate programming courses. This framework accentuates GenAI's benefits and potential as a pedagogical instrument. By identifying and rectifying GenAI's errors, students enrich their learning process. Moreover, AI-Lab presents opportunities to use GenAI for tailored support such as topic introductions, detailed examples, corner case identification, rephrased explanations, and debugging assistance. Importantly, the framework highlights the risks of GenAI over-dependence, aiming to intrinsically motivate students towards balanced usage. This approach is premised on the idea that mere warnings of GenAI's potential failures may be misconstrued as instructional shortcomings rather than genuine tool limitations. Additionally, AI-Lab offers strategies for formulating prompts to elicit high-quality GenAI responses. For educators, AI-Lab provides mechanisms to explore students' perceptions of GenAI's role in their learning experience.


title: Data-driven Identification of Parametric Governing Equations of Dynamical Systems Using the Signed Cumulative Distribution Transform

abstract: This paper presents a novel data-driven approach to identify partial differential equation (PDE) parameters of a dynamical system. Specifically, we adopt a mathematical "transport" model for the solution of the dynamical system at specific spatial locations that allows us to accurately estimate the model parameters, including those associated with structural damage. This is accomplished by means of a newly-developed mathematical transform, the signed cumulative distribution transform (SCDT), which is shown to convert the general nonlinear parameter estimation problem into a simple linear regression. This approach has the additional practical advantage of requiring no a priori knowledge of the source of the excitation (or, alternatively, the initial conditions). By using training data, we devise a coarse regression procedure to recover different PDE parameters from the PDE solution measured at a single location. Numerical experiments show that the proposed regression procedure is capable of detecting and estimating PDE parameters with superior accuracy compared to a number of recently developed machine learning methods. Furthermore, a damage identification experiment conducted on a publicly available dataset provides strong evidence of the proposed method's effectiveness in structural health monitoring (SHM) applications. The Python implementation of the proposed system identification technique is integrated as a part of the software package PyTransKit (https://github.com/rohdelab/PyTransKit).


title: Estimating Causal Effects for Binary Outcomes Using Per-Decision Inverse Probability Weighting

abstract: Micro-randomized trials are commonly conducted for optimizing mobile health interventions such as push notifications for behavior change. In analyzing such trials, causal excursion effects are often of primary interest, and their estimation typically involves inverse probability weighting (IPW). However, in a micro-randomized trial additional treatments can often occur during the time window over which an outcome is defined, and this can greatly inflate the variance of the causal effect estimator because IPW would involve a product of numerous weights. To reduce variance and improve estimation efficiency, we propose a new estimator using a modified version of IPW, which we call "per-decision IPW". It is applicable when the outcome is binary and can be expressed as the maximum of a series of sub-outcomes defined over sub-intervals of time. We establish the estimator's consistency and asymptotic normality. Through simulation studies and real data applications, we demonstrate substantial efficiency improvement of the proposed estimator over existing estimators (relative efficiency up to 1.45 and sample size savings up to 31% in realistic settings). The new estimator can be used to improve the precision of primary and secondary analyses for micro-randomized trials with binary outcomes.


title: Prompt2Model: Generating Deployable Models from Natural Language Instructions

abstract: Large language models (LLMs) enable system builders today to create competent NLP systems through prompting, where they only need to describe the task in natural language and provide a few examples. However, in other ways, LLMs are a step backward from traditional special-purpose NLP models; they require extensive computational resources for deployment and can be gated behind APIs. In this paper, we propose Prompt2Model, a general-purpose method that takes a natural language task description like the prompts provided to LLMs, and uses it to train a special-purpose model that is conducive to deployment. This is done through a multi-step process of retrieval of existing datasets and pretrained models, dataset generation using LLMs, and supervised fine-tuning on these retrieved and generated datasets. Over three tasks, we demonstrate that given the same few-shot prompt as input, Prompt2Model trains models that outperform the results of a strong LLM, gpt-3.5-turbo, by an average of 20% while being up to 700 times smaller. We also show that this data can be used to obtain reliable performance estimates of model performance, enabling model developers to assess model reliability before deployment. Prompt2Model is available open-source at https://github.com/neulab/prompt2model.


title: Transformer-based Nonlinear Equalization for DP-16QAM Coherent Optical Communication Systems

abstract: Compensating for nonlinear effects using digital signal processing (DSP) is complex and computationally expensive in long-haul optical communication systems due to intractable interactions between Kerr nonlinearity, chromatic dispersion (CD), and amplified spontaneous emission (ASE) noise from inline amplifiers. The application of machine learning architectures has demonstrated promising advancements in enhancing transmission performance through the mitigation of fiber nonlinear effects. In this paper, we apply a Transformer-based model to dual-polarisation (DP)-16QAM coherent optical communication systems. We test the performance of the proposed model for different values of fiber lengths and launched optical powers and show improved performance compared to the state-of-the-art digital backpropagation (DBP) algorithm, fully connected neural network (FCNN) and bidirectional long short term memory (BiLSTM) architecture.


title: Footprinting in a course on energy

abstract: Footprints provide a way to estimate the relative impact of processes and products on the global climate. Including footprint analysis in a course on energy simultaneously provides students with an understanding of this tool and a quantitative guide to approaches that address climate change. College-level classroom activities for (primarily) process-based life cycle carbon footprinting are discussed.


title: Enhancing Energy-Awareness in Deep Learning through Fine-Grained Energy Measurement

abstract: With the increasing usage, scale, and complexity of Deep Learning (DL) models, their rapidly growing energy consumption has become a critical concern. Promoting green development and energy awareness at different granularities is the need of the hour to limit carbon emissions of DL systems. However, the lack of standard and repeatable tools to accurately measure and optimize energy consumption at a fine granularity (e.g., at method level) hinders progress in this area. This paper introduces FECoM (Fine-grained Energy Consumption Meter), a framework for fine-grained DL energy consumption measurement. FECoM enables researchers and developers to profile DL APIs from energy perspective. FECoM addresses the challenges of measuring energy consumption at fine-grained level by using static instrumentation and considering various factors, including computational load and temperature stability. We assess FECoM's capability to measure fine-grained energy consumption for one of the most popular open-source DL frameworks, namely TensorFlow. Using FECoM, we also investigate the impact of parameter size and execution time on energy consumption, enriching our understanding of TensorFlow APIs' energy profiles. Furthermore, we elaborate on the considerations, issues, and challenges that one needs to consider while designing and implementing a fine-grained energy consumption measurement tool. This work will facilitate further advances in DL energy measurement and the development of energy-aware practices for DL systems.


title: Network Navigation with Online Delays is PSPACE-complete

abstract: In public transport networks disruptions may occur and lead to travel delays. It is thus interesting to determine whether a traveler can be resilient to delays that occur unexpectedly, ensuring that they can reach their destination in time regardless. We model this as a game between the traveler and a delay-introducing adversary. We study the computational complexity of the problem of deciding whether the traveler has a winning strategy in this game. Our main result is that this problem is PSPACE-complete.


title: Age of Gossip on Generalized Rings

abstract: We consider a gossip network consisting of a source forwarding updates and $n$ nodes placed geometrically in a ring formation. Each node gossips with $f(n)$ nodes on either side, thus communicating with $2f(n)$ nodes in total. $f(n)$ is a sub-linear, non-decreasing and positive function. The source keeps updates of a process, that might be generated or observed, and shares them with the nodes in the ring network. The nodes in the ring network communicate with their neighbors and disseminate these version updates using a push-style gossip strategy. We use the version age metric to quantify the timeliness of information at the nodes. Prior to this work, it was shown that the version age scales as $O(n^{\frac{1}{2}})$ in a ring network, i.e., when $f(n)=1$, and as $O(\log{n})$ in a fully-connected network, i.e., when $2f(n)=n-1$. In this paper, we find an upper bound for the average version age for a set of nodes in such a network in terms of the number of nodes $n$ and the number of gossiped neighbors $2 f(n)$. We show that if $f(n) = \Omega(\frac{n}{\log^2{n}})$, then the version age still scales as $\theta(\log{n})$. We also show that if $f(n)$ is a rational function, then the version age also scales as a rational function. In particular, if $f(n)=n^\alpha$, then version age is $O(n^\frac{1-\alpha}{2})$. Finally, through numerical calculations we verify that, for all practical purposes, if $f(n) = \Omega(n^{0.6})$, the version age scales as $O(\log{n})$.


title: Bugsplainer: Leveraging Code Structures to Explain Software Bugs with Neural Machine Translation

abstract: Software bugs cost the global economy billions of dollars each year and take up ~50% of the development time. Once a bug is reported, the assigned developer attempts to identify and understand the source code responsible for the bug and then corrects the code. Over the last five decades, there has been significant research on automatically finding or correcting software bugs. However, there has been little research on automatically explaining the bugs to the developers, which is essential but a highly challenging task. In this paper, we propose Bugsplainer, a novel web-based debugging solution that generates natural language explanations for software bugs by learning from a large corpus of bug-fix commits. Bugsplainer leverages code structures to reason about a bug and employs the fine-tuned version of a text generation model, CodeT5, to generate the explanations. Tool video: https://youtu.be/xga-ScvULpk


title: Extremal, enumerative and probabilistic results on ordered hypergraph matchings

abstract: An ordered $r$-matching is an $r$-uniform hypergraph matching equipped with an ordering on its vertices. These objects can be viewed as natural generalisations of $r$-dimensional orders. The theory of ordered 2-matchings is well-developed and has connections and applications to extremal and enumerative combinatorics, probability, and geometry. On the other hand, in the case $r \ge 3$ much less is known, largely due to a lack of powerful bijective tools. Recently, Dudek, Grytczuk and Ruci\'nski made some first steps towards a general theory of ordered $r$-matchings, and in this paper we substantially improve several of their results and introduce some new directions of study. Many intriguing open questions remain.


title: Observation of Nagaoka Polarons in a Fermi-Hubbard Quantum Simulator

abstract: Quantum interference can deeply alter the nature of many-body phases of matter. In the paradigmatic case of the Hubbard model, Nagaoka famously proved that introducing a single itinerant charge can transform a paramagnetic insulator into a ferromagnet through path interference. However, a microscopic observation of such kinetic magnetism induced by individually imaged dopants has been so far elusive. Here we demonstrate the emergence of Nagaoka polarons in a Hubbard system realized with strongly interacting fermions in a triangular optical lattice. Using quantum gas microscopy, we reveal these polarons as extended ferromagnetic bubbles around particle dopants arising from the local interplay of coherent dopant motion and spin exchange. In contrast, kinetic frustration due to the triangular geometry promotes antiferromagnetic polarons around hole dopants, as proposed by Haerter and Shastry. Our work augurs the exploration of exotic quantum phases driven by charge motion in strongly correlated systems and over sizes that are challenging for numerical simulation.


title: Language Reward Modulation for Pretraining Reinforcement Learning

abstract: Using learned reward functions (LRFs) as a means to solve sparse-reward reinforcement learning (RL) tasks has yielded some steady progress in task-complexity through the years. In this work, we question whether today's LRFs are best-suited as a direct replacement for task rewards. Instead, we propose leveraging the capabilities of LRFs as a pretraining signal for RL. Concretely, we propose $\textbf{LA}$nguage Reward $\textbf{M}$odulated $\textbf{P}$retraining (LAMP) which leverages the zero-shot capabilities of Vision-Language Models (VLMs) as a $\textit{pretraining}$ utility for RL as opposed to a downstream task reward. LAMP uses a frozen, pretrained VLM to scalably generate noisy, albeit shaped exploration rewards by computing the contrastive alignment between a highly diverse collection of language instructions and the image observations of an agent in its pretraining environment. LAMP optimizes these rewards in conjunction with standard novelty-seeking exploration rewards with reinforcement learning to acquire a language-conditioned, pretrained policy. Our VLM pretraining approach, which is a departure from previous attempts to use LRFs, can warmstart sample-efficient learning on robot manipulation tasks in RLBench.