title: ClassiPyGRB: Machine Learning-Based Classification and Visualization of Gamma Ray Bursts using t-SNE

abstract: Gamma-ray burst (GRBs) are the brightest events in the universe. For decades, astrophysicists have known about their cosmological nature. Every year, space missions such as Fermi and SWIFT detect hundreds of them. In spite of this large sample, GRBs show a complex taxonomy in the first seconds after their appearance, which makes it very difficult to find similarities between them using conventional techniques. It is known that GRBs originate from the death of a massive star or from the merger of two compact objects. GRB classification is typically based on the duration of the burst (Kouveliotou et al., 1993). Nevertheless, events such as GRB 211211A (Yang et al., 2022), whose duration of about 50 seconds lies in the group of long GRBs, has challenged this categorization by the evidence of features related with the short GRB population (the kilonova emission and the properties of its host galaxy). Therefore, a classification based only on their gamma-ray duration does not provide a completely reliable determination of the progenitor. Motivated by this problem, Jespersen et al. (2020) and Steinhardt et al. (2023) carried out analysis of GRB light curves by using the t-SNE algorithm, showing that Swift/BAT GRBs database, consisting of light curves in four energy bands (15-25 keV, 25-50 keV, 50-100 keV, 100-350 keV), clusters into two groups corresponding with the typical long/short classification. However, in this case, this classification is based on the information provided by their gamma-ray emission light curves. ClassiPyGRB is a Python 3 package to download, process, visualize and classify GRBs database from the Swift/BAT Instrument (up to July 2022). It is distributed over the GNU General Public License Version 2 (1991). We also included a noise-reduction and an interpolation tools for achieving a deeper analysis of the data.


title: A tropical version of Hilbert function

abstract: For a tropical prevariety $V\subset \RR^n$ (being a finite union of rational polyhedra) two tropical polynomials belong to the same congruence class iff they coincide on $V$. We define a tropical Hilbert function $TH_V(k)$ as the dimension of the family of congruence classes of tropical polynomials with tropical degree at most $k$. It is shown that $TH_V(k)$ coincides with a polynomial of degree $\dim V$ for sufficiently big $k$ when $V$ is a polyhedron. For an arbitrary tropical prevariety we formulate it as a conjecture. The conjecture is justified in case $\dim V =0$.


title: A minimal solution to the axion isocurvature problem from a non-minimal coupling

abstract: The main limitation for pre-inflationary breaking of Peccei-Quinn (PQ) symmetry is the upper bound on the Hubble rate during inflation from axion isocurvature fluctuations. This leads to a tension between high scale inflation and QCD axions with Grand Unified Theory (GUT) scale decay constants, which reduces the potential for a detection of tensor modes at next generation CMB experiments. We propose a mechanism that excplicitly breaks PQ symmetry via non-minimal coupling to gravity, that lifts the axion mass above the Hubble scale during inflation and has negligible impact on today's axion potential. The initially heavy axion gets trapped at an intermediate minimum during inflation given by the phase of the non-minimal coupling, before it moves to its true CP-conserving minimum after inflation. During this stage it undergoes coherent oscillations around an adiabatically decreasing minimum, which slightly dilutes the axion energy density, while still being able to explain the observed dark matter relic abundance. This scenario can be tested by the combination of next generation CMB surveys like CMB-S4 and LiteBIRD with haloscopes such as ABRACADABRA or CASPEr-Electric.


title: QueSTMaps: Queryable Semantic Topological Maps for 3D Scene Understanding

abstract: Understanding the structural organisation of 3D indoor scenes in terms of rooms is often accomplished via floorplan extraction. Robotic tasks such as planning and navigation require a semantic understanding of the scene as well. This is typically achieved via object-level semantic segmentation. However, such methods struggle to segment out topological regions like "kitchen" in the scene. In this work, we introduce a two-step pipeline. First, we extract a topological map, i.e., floorplan of the indoor scene using a novel multi-channel occupancy representation. Then, we generate CLIP-aligned features and semantic labels for every room instance based on the objects it contains using a self-attention transformer. Our language-topology alignment supports natural language querying, e.g., a "place to cook" locates the "kitchen". We outperform the current state-of-the-art on room segmentation by ~20% and room classification by ~12%. Our detailed qualitative analysis and ablation studies provide insights into the problem of joint structural and semantic 3D scene understanding.


title: Multi-scale Dynamic and Hierarchical Relationship Modeling for Facial Action Units Recognition

abstract: Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions show stronger relationships than those of different facial regions. While none of existing approach thoroughly model such hierarchical inter-dependencies among AUs, this paper proposes to comprehensively model multi-scale AU-related dynamic and hierarchical spatio-temporal relationship among AUs for their occurrences recognition. Specifically, we first propose a novel multi-scale temporal differencing network with an adaptive weighting block to explicitly capture facial dynamics across frames at different spatial scales, which specifically considers the heterogeneity of range and magnitude in different AUs' activation. Then, a two-stage strategy is introduced to hierarchically model the relationship among AUs based on their spatial distribution (i.e., local and cross-region AU relationship modelling). Experimental results achieved on BP4D and DISFA show that our approach is the new state-of-the-art in the field of AU occurrence recognition. Our code is publicly available at https://github.com/CVI-SZU/MDHR.


title: Cosmic Clues: DESI, Dark Energy, and the Cosmological Constant Problem

abstract: Several attempts to solve the cosmological constant problem, which concerns the value of the cosmological constant being extremely smaller than the Standard Model mass scales, have introduced a scalar field with a very flat potential that can be approximated as linear around any given position. The scalar field scans the cosmological constant in such a way that the current small value is explained. Recently, Dark Energy Spectroscopic Instrument (DESI) reported the results of the first year. Combining the data with CMB, Pantheon, Union3, and/or DES-SN5YR, there is a preference or anomaly, indicating that the dark energy in the current Universe slightly deviates from that in the $\Lambda$CDM model and varies over time. In this paper, I show that the simple linear potential of a scalar field that may explain the small cosmological constant can explain the DESI anomaly. In particular, the model proposed by the present author in 2108.04246, which relaxes the cosmological constant by the condition that inflation ends, predicts a time-dependence of the dark energy close to the one favored by the data.


title: Extremal minimal bipartite matching covered graphs

abstract: A connected graph, on four or more vertices, is matching covered if every edge is present in some perfect matching. An ear decomposition theorem (similar to the one for $2$-connected graphs) exists for bipartite matching covered graphs due to Hetyei. From the results and proofs of Lov\'asz and Plummer, that rely on Hetyei's theorem, one may deduce that any minimal bipartite matching covered graph has at least $2(m-n+2)$ vertices of degree two (where minimal means that deleting any edge results in a graph that is not matching covered); such a graph is said to be extremal if it attains the stated lower bound. In this paper, we provide a complete characterization of the class of extremal minimal bipartite matching covered graphs. In particular, we prove that every such graph $G$ is obtained from two copies of a tree devoid of degree two vertices, say $T$ and $T'$, by adding edges -- each of which joins a leaf of $T$ with the corresponding leaf of $T'$. Apart from the aforementioned bound, there are four other bounds that appear in, or may be deduced from, the work of Lov\'asz and Plummer. Each of these bounds leads to a notion of extremality. In this paper, we obtain a complete characterization of all of these extremal classes and also establish relationships between them. Two of our characterizations are in the same spirit as the one stated above. For the remaining two extremal classes, we reduce each of them to one of the already characterized extremal classes using standard matching theoretic operations.


title: An effective version of Fekete's theorem

abstract: A classical result of Fekete gives necessary conditions on a compact set in the complex plane so that it contains infinitely many sets of conjugate algebraic integers. We prove an effective version of Fekete's theorem in terms of a height function. As an application, we give a lower bound on the growth of the leading coefficient of certain polynomial sequences, generalizing a result by Schur. Lastly, we give an upper bound on minimal asymptotics of height over sequences of algebraic numbers.


title: The Central Spanning Tree Problem

abstract: Spanning trees are an important primitive in many data analysis tasks, when a data set needs to be summarized in terms of its "skeleton", or when a tree-shaped graph over all observations is required for downstream processing. Popular definitions of spanning trees include the minimum spanning tree and the optimum distance spanning tree, a.k.a. the minimum routing cost tree. When searching for the shortest spanning tree but admitting additional branching points, even shorter spanning trees can be realized: Steiner trees. Unfortunately, both minimum spanning and Steiner trees are not robust with respect to noise in the observations; that is, small perturbations of the original data set often lead to drastic changes in the associated spanning trees. In response, we make two contributions when the data lies in a Euclidean space: on the theoretical side, we introduce a new optimization problem, the "(branched) central spanning tree", which subsumes all previously mentioned definitions as special cases. On the practical side, we show empirically that the (branched) central spanning tree is more robust to noise in the data, and as such is better suited to summarize a data set in terms of its skeleton. We also propose a heuristic to address the NP-hard optimization problem, and illustrate its use on single cell RNA expression data from biology and 3D point clouds of plants.


title: Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models

abstract: Recently, there has been a surge in the development of advanced intelligent generative content (AIGC), especially large language models (LLMs). However, for many downstream tasks, it is necessary to fine-tune LLMs using private data. While federated learning offers a promising privacy-preserving solution to LLM fine-tuning, the substantial size of an LLM, combined with high computational and communication demands, makes it hard to apply to downstream tasks. More importantly, private edge servers often possess varying computing and network resources in real-world scenarios, introducing additional complexities to LLM fine-tuning. To tackle these problems, we design and implement an automated federated pipeline, named FedPipe, to fine-tune LLMs with minimal training cost but without adding any inference latency. FedPipe firstly identifies the weights to be fine-tuned based on their contributions to the LLM training. It then configures a low-rank adapter for each selected weight to train local low-rank adapters on an edge server, and aggregate local adapters of all edge servers to fine-tune the whole LLM. Finally, it appropriately quantizes the parameters of LLM to reduce memory space according to the requirements of edge servers. Extensive experiments demonstrate that FedPipe expedites the model training and achieves higher accuracy than state-of-the-art benchmarks.


title: Deep-Learning Database of Density Functional Theory Hamiltonians for Twisted Materials

abstract: Moir\'e-twisted materials have garnered significant research interest due to their distinctive properties and intriguing physics. However, conducting first-principles studies on such materials faces challenges, notably the formidable computational cost associated with simulating ultra-large twisted structures. This obstacle impedes the construction of a twisted materials database crucial for datadriven materials discovery. Here, by using high-throughput calculations and state-of-the-art neural network methods, we construct a Deep-learning Database of density functional theory (DFT) Hamiltonians for Twisted materials named DDHT. The DDHT database comprises trained neural-network models of over a hundred homo-bilayer and hetero-bilayer moir\'e-twisted materials. These models enable accurate prediction of the DFT Hamiltonian for these materials across arbitrary twist angles, with an averaged mean absolute error of approximately 1.0 meV or lower. The database facilitates the exploration of flat bands and correlated materials platforms within ultra-large twisted structures.


title: Distorted static black holes with a bubble

abstract: We construct a family of local static, vacuum five-dimensional solutions with two commuting spatial isometries describing a black hole with a $S^3$ horizon and a 2-cycle `bubble' in the domain of outer communications. The solutions are obtained by adding distortions to an asymptotically flat seed solution. We show that the conical singularities in the undistorted geometry can be removed by an appropriate choice of the distortion.


title: SmartControl: Enhancing ControlNet for Handling Rough Visual Conditions

abstract: Human visual imagination usually begins with analogies or rough sketches. For example, given an image with a girl playing guitar before a building, one may analogously imagine how it seems like if Iron Man playing guitar before Pyramid in Egypt. Nonetheless, visual condition may not be precisely aligned with the imaginary result indicated by text prompt, and existing layout-controllable text-to-image (T2I) generation models is prone to producing degraded generated results with obvious artifacts. To address this issue, we present a novel T2I generation method dubbed SmartControl, which is designed to modify the rough visual conditions for adapting to text prompt. The key idea of our SmartControl is to relax the visual condition on the areas that are conflicted with text prompts. In specific, a Control Scale Predictor (CSP) is designed to identify the conflict regions and predict the local control scales, while a dataset with text prompts and rough visual conditions is constructed for training CSP. It is worth noting that, even with a limited number (e.g., 1,000~2,000) of training samples, our SmartControl can generalize well to unseen objects. Extensive experiments on four typical visual condition types clearly show the efficacy of our SmartControl against state-of-the-arts. Source code, pre-trained models, and datasets are available at https://github.com/liuxiaoyu1104/SmartControl.


title: PAAM: A Framework for Coordinated and Priority-Driven Accelerator Management in ROS 2

abstract: This paper proposes a Priority-driven Accelerator Access Management (PAAM) framework for multi-process robotic applications built on top of the Robot Operating System (ROS) 2 middleware platform. The framework addresses the issue of predictable execution of time- and safety-critical callback chains that require hardware accelerators such as GPUs and TPUs. PAAM provides a standalone ROS executor that acts as an accelerator resource server, arbitrating accelerator access requests from all other callbacks at the application layer. This approach enables coordinated and priority-driven accelerator access management in multi-process robotic systems. The framework design is directly applicable to all types of accelerators and enables granular control over how specific chains access accelerators, making it possible to achieve predictable real-time support for accelerators used by safety-critical callback chains without making changes to underlying accelerator device drivers. The paper shows that PAAM also offers a theoretical analysis that can upper bound the worst-case response time of safety-critical callback chains that necessitate accelerator access. This paper also demonstrates that complex robotic systems with extensive accelerator usage that are integrated with PAAM may achieve up to a 91\% reduction in end-to-end response time of their critical callback chains.


title: PURE: Turning Polysemantic Neurons Into Pure Features by Identifying Relevant Circuits

abstract: The field of mechanistic interpretability aims to study the role of individual neurons in Deep Neural Networks. Single neurons, however, have the capability to act polysemantically and encode for multiple (unrelated) features, which renders their interpretation difficult. We present a method for disentangling polysemanticity of any Deep Neural Network by decomposing a polysemantic neuron into multiple monosemantic "virtual" neurons. This is achieved by identifying the relevant sub-graph ("circuit") for each "pure" feature. We demonstrate how our approach allows us to find and disentangle various polysemantic units of ResNet models trained on ImageNet. While evaluating feature visualizations using CLIP, our method effectively disentangles representations, improving upon methods based on neuron activations. Our code is available at https://github.com/maxdreyer/PURE.


title: Superdense Coding and Stabiliser Codes with Ising-coupled Entanglement

abstract: A new class of quantum states is introduced by demanding that the computational measurement statistics approach the Boltzmann distribution of higher-order strongly coupled Ising models. The states, referred to as $n$-coupled states, are superpositions of even or odd parity $n$-qubit states, generalize Bell states, and form an orthonormal basis for the $n$-qubit Hilbert space. For any $n$, the states are maximally connected and locally maximally entangled. It is proven that the $n$-qubit W and GHZ multipartite entanglement classes have vanishing hyperdeterminant for all $n\geq 3$ and $n\geq 4$, respectively, and that the $n$-coupled states fall in the latter. Still, multiple novel protocols for multi-party secure dense coding and stabiliser code construction are presented, which rely on the structure of $n$-coupled states as well as symmetry-breaking phase perturbations.


title: A comparative analysis of deep learning models for lung segmentation on X-ray images

abstract: Robust and highly accurate lung segmentation in X-rays is crucial in medical imaging. This study evaluates deep learning solutions for this task, ranking existing methods and analyzing their performance under diverse image modifications. Out of 61 analyzed papers, only nine offered implementation or pre-trained models, enabling assessment of three prominent methods: Lung VAE, TransResUNet, and CE-Net. The analysis revealed that CE-Net performs best, demonstrating the highest values in dice similarity coefficient and intersection over union metric.


title: Sharp Propagation of Chaos for the Ensemble Langevin Sampler

abstract: The aim of this note is to revisit propagation of chaos for a Langevin-type interacting particle system used for sampling probability measures. The interacting particle system we consider coincides, in the setting of a log-quadratic target distribution, with the ensemble Kalman sampler, for which propagation of chaos was first proved by Ding and Li. Like these authors, we prove propagation of chaos using a synchronous coupling as a starting point, as in Sznitman's classical argument. Instead of relying on a boostrapping argument, however, we use a technique based on stopping times in order to handle the presence of the empirical covariance in the coefficients of the dynamics. This approach originates from numerical analysis and was recently employed to prove mean field limits for consensus-based optimization and related interacting particle systems. In the context of ensemble Langevin sampling, it enables proving pathwise propagation of chaos with optimal rate, whereas previous results were optimal only up to a positive epsilon.


title: Hoeffding and Bernstein inequalities for weighted sums of exchangeable random variables

abstract: The aim of this paper is to establish Hoeffding and Bernstein type concentration inequalities for weighted sums of exchangeable random variables. A special case is the i.i.d. setting, where random variables are sampled independently from some distribution (and are therefore exchangeable). In contrast to the existing literature on this problem, our results provide a natural unified view of both the i.i.d. and the exchangeable setting.


title: Critical non-linearity for some evolution equations with Fujita-type critical exponent

abstract: We consider the Cauchy problem for a class of non-linear evolution equations in the form \[L(\partial_t,\partial_x) u=F(\partial_t^\ell u), \quad (t,x)\in [0,\infty)\times \mathbb{R}^n;\] here, $L(\partial_t,\partial_x)$ is a linear partial differential operator with constant coefficients, of order $m\geq 1$ with respect to the time variable $t$, and $\ell$ is a natural number satisfying $0\leq \ell\leq m-1$. For several different choices of $L$, many authors have investigated the existence of global (in time) solutions to this problem when $F(s)=|s|^p$ is a power non-linearity, looking for a \textit{critical exponent} $p_c>1$ such that global small data solutions exist in the supercritical case $p>p_c$, whereas no global weak solutions exist, under suitable sign assumptions on the data, in the subcritical case $1<p<p_c$. In the present paper we consider a more general non-linear term in the form $F(s)=|s|^p\mu(|s|)$; for a large class of models, we provide an integral condition on $\mu$ which allows to distinguish more precisely the region of existence of a global (in time) small data solution from that in which the problem admits no global (in time) weak solutions, refining the existing results about the critical exponents for power type non-linearities.


title: A hybrid discrete-continuum modelling approach for the interactions of the immune system with oncolytic viral infections

abstract: Oncolytic virotherapy, utilizing genetically modified viruses to combat cancer and trigger anti-cancer immune responses, has garnered significant attention in recent years. In our previous work arXiv:2305.12386, we developed a stochastic agent-based model elucidating the spatial dynamics of infected and uninfected cells within solid tumours. Building upon this foundation, we present a novel stochastic agent-based model to describe the intricate interplay between the virus and the immune system; the agents' dynamics are coupled with a balance equation for the concentration of the chemoattractant that guides the movement of immune cells. We formally derive the continuum limit of the model and carry out a systematic quantitative comparison between this system of PDEs and the individual-based model in two spatial dimensions. Furthermore, we describe the traveling waves of the three populations, with the uninfected proliferative cells trying to escape from the infected cells while immune cells infiltrate the tumour. Simulations show a good agreement between agent-based approaches and numerical results for the continuum model. Some parameter ranges give rise to oscillations of cell number in both models, in line with the behaviour of the corresponding nonspatial model, which presents Hopf bifurcations. Nevertheless, in some situations the behaviours of the two models may differ significantly, suggesting that stochasticity plays a key role in the dynamics. Our results highlight that a too rapid immune response, before the infection is well-established, appears to decrease the efficacy of the therapy and thus some care is needed when oncolytic virotherapy is combined with immunotherapy. This further suggests the importance of clinically improving the modulation of the immune response according to the tumour's characteristics and to the immune capabilities of the patients.


title: Learning Locally Interacting Discrete Dynamical Systems: Towards Data-Efficient and Scalable Prediction

abstract: Locally interacting dynamical systems, such as epidemic spread, rumor propagation through crowd, and forest fire, exhibit complex global dynamics originated from local, relatively simple, and often stochastic interactions between dynamic elements. Their temporal evolution is often driven by transitions between a finite number of discrete states. Despite significant advancements in predictive modeling through deep learning, such interactions among many elements have rarely explored as a specific domain for predictive modeling. We present Attentive Recurrent Neural Cellular Automata (AR-NCA), to effectively discover unknown local state transition rules by associating the temporal information between neighboring cells in a permutation-invariant manner. AR-NCA exhibits the superior generalizability across various system configurations (i.e., spatial distribution of states), data efficiency and robustness in extremely data-limited scenarios even in the presence of stochastic interactions, and scalability through spatial dimension-independent prediction.


title: Analysis of Distributed Algorithms for Big-data

abstract: The parallel and distributed processing are becoming de facto industry standard, and a large part of the current research is targeted on how to make computing scalable and distributed, dynamically, without allocating the resources on permanent basis. The present article focuses on the study and performance of distributed and parallel algorithms their file systems, to achieve scalability at local level (OpenMP platform), and at global level where computing and file systems are distributed. Various applications, algorithms,file systems have been used to demonstrate the areas, and their performance studies have been presented. The systems and applications chosen here are of open-source nature, due to their wider applicability.


title: Periodic solutions to integro-differential equations: variational formulation, symmetry, and regularity

abstract: We consider nonconstant periodic constrained minimizers of semilinear elliptic equations for integro-differential operators in $\mathbb{R}$. We prove that, after an appropriate translation, each of them is necessarily an even function which is decreasing in half its period. In particular, it has only two critical points in half its period, the absolute maximum and minimum. If these statements hold for all nonconstant periodic solutions, and not only for constrained minimizers, remains as an open problem. Our results apply to operators with kernels in two different classes: kernels $K$ which are convex and kernels for which $K(\tau^{1/2})$ is a completely monotonic function of $\tau$. This last new class arose in our previous work on nonlocal Delaunay surfaces in $\mathbb{R}^n$. Due to their symmetry of revolution, it gave rise to a 1d problem involving an operator with a nonconvex kernel. Our proofs are based on a not so well-known Riesz rearrangement inequality on the circle $\mathbb{S}^1$ established in 1976. We also put in evidence a new regularity fact which is a truly nonlocal-semilinear effect and also occurs in the nonperiodic setting. Namely, for nonlinearities in $C^\beta$ and when $2s+\beta <1$ ($2s$ being the order of the operator), the solution is not always $C^{2s+\beta-\epsilon}$ for all $\epsilon>0$.


title: Thermal fluctuations of matter composition and quark nucleation in compact stars

abstract: Context. At the extreme densities reached in the core of neutron stars, it is possible that quark deconfined matter is produced. The formation of this new phase of strongly interacting matter is likely to occur via a first-order phase transition for the typical temperatures reached in astrophysical processes. The first seeds of quark matter would then form through a process of nucleation within the metastable hadronic phase. Aims. Here we address the role of the thermal fluctuations in the hadronic composition on the nucleation of two-flavour quark matter. Methods. At finite temperature, thermodynamic quantities in a system fluctuate around average values. Being nucleation a local process, it is possible that it occurs in a subsystem whose composition makes the nucleation easier. We will consider the total probability of the nucleation as the product between the probability that a subsystem has a certain hadronic composition different from the average in the bulk, and the nucleation probability in that subsystem. Results. We will show how those fluctuations of the hadronic composition can increase the efficiency of nucleation already for temperatures $\sim (0.1-1)$ keV. However, for temperatures $\lesssim (1-10)$ MeV, the needed overpressure exceeds the maximum pressure reached in compact stars. Finally, for even larger temperatures the process of nucleation can take place, even taking into account finite size effects.


title: On Hasse norm principle for 3-manifolds in arithmetic topology

abstract: Following the analogies between knots and primes, 3-manifolds and number rings in arithmetic topology, we show a topological analogue of the Hasse norm principle for finite cyclic coverings of 3-manifolds, which was originally stated for finite cyclic extensions of number fields.


title: Phase space contraction of degenerately damped random splittings

abstract: When studying out-of-equilibrium systems, one often excites the dynamics in some degrees of freedom while removing the excitation in others through damping. In order for the system to converge to a statistical steady state, the dynamics must transfer the energy from the excited modes to the dissipative directions. The precise mechanisms underlying this transfer are of particular interest and are the topic of this paper. We explore a class of randomly switched models introduced in [2,3] and provide some of the first results showing that minimal damping is sufficient to stabilize the system in a fluids model.


title: Hyperparameter Selection in Continual Learning

abstract: In continual learning (CL) -- where a learner trains on a stream of data -- standard hyperparameter optimisation (HPO) cannot be applied, as a learner does not have access to all of the data at the same time. This has prompted the development of CL-specific HPO frameworks. The most popular way to tune hyperparameters in CL is to repeatedly train over the whole data stream with different hyperparameter settings. However, this end-of-training HPO is unrealistic as in practice a learner can only see the stream once. Hence, there is an open question: what HPO framework should a practitioner use for a CL problem in reality? This paper answers this question by evaluating several realistic HPO frameworks. We find that all the HPO frameworks considered, including end-of-training HPO, perform similarly. We therefore advocate using the realistic and most computationally efficient method: fitting the hyperparameters on the first task and then fixing them throughout training.


title: Scaling to 32 GPUs on a Novel Composable System Architecture

abstract: The development of composable systems architecture marks a significant shift in resource allocation and utilization within data centers. This paper presents a composable architecture scaling up to 32 GPUs on a single node, addressing the technical challenges encountered and the innovative solutions implemented. This design introduces a flexible and dynamic resource distribution mechanism, particularly for GPUs, enabling tailored allocation to meet varying node demands. The architecture's dynamic nature allows for the flexible assignment and reassignment of hardware resources, such as GPUs, to different nodes as required, offering unprecedented capability and flexibility.


title: Constraining electron number density in the Sun via Earth-based neutrino flavor data

abstract: Neutrino flavor transformation offers a window into the physics of various astrophysical environments, including our Sun and the more exotic environs of core-collapse supernovae and binary neutron-star mergers. Here, we apply an inference framework - specifically: statistical data assimilation (SDA) - to neutrino flavor evolution in the Sun. We take a model for solar neutrino flavor evolution, together with Earth-based neutrino measurements, to infer solar properties. Specifically, we ask what signature of the radially-varying solar electron number density $n_e(r)$ is contained within these Earth-based measurements. Currently, the best estimates of $n_e(r)$ come from the standard solar model. We seek to ascertain, through novel application of the SDA method, whether estimates of the same from neutrino data can serve as independent constraints.


title: Neuromorphic In-Context Learning for Energy-Efficient MIMO Symbol Detection

abstract: In-context learning (ICL), a property demonstrated by transformer-based sequence models, refers to the automatic inference of an input-output mapping based on examples of the mapping provided as context. ICL requires no explicit learning, i.e., no explicit updates of model weights, directly mapping context and new input to the new output. Prior work has proved the usefulness of ICL for detection in MIMO channels. In this setting, the context is given by pilot symbols, and ICL automatically adapts a detector, or equalizer, to apply to newly received signals. However, the implementation tested in prior art was based on conventional artificial neural networks (ANNs), which may prove too energy-demanding to be run on mobile devices. This paper evaluates a neuromorphic implementation of the transformer for ICL-based MIMO detection. This approach replaces ANNs with spiking neural networks (SNNs), and implements the attention mechanism via stochastic computing, requiring no multiplications, but only logical AND operations and counting. When using conventional digital CMOS hardware, the proposed implementation is shown to preserve accuracy, with a reduction in power consumption ranging from $5.4\times$ to $26.8\times$, depending on the model sizes, as compared to ANN-based implementations.


title: Learning State-Invariant Representations of Objects from Image Collections with State, Pose, and Viewpoint Changes

abstract: We add one more invariance - state invariance - to the more commonly used other invariances for learning object representations for recognition and retrieval. By state invariance, we mean robust with respect to changes in the structural form of the object, such as when an umbrella is folded, or when an item of clothing is tossed on the floor. Since humans generally have no difficulty in recognizing objects despite such state changes, we are naturally faced with the question of whether it is possible to devise a neural architecture with similar abilities. To that end, we present a novel dataset, ObjectsWithStateChange, that captures state and pose variations in the object images recorded from arbitrary viewpoints. We believe that this dataset will facilitate research in fine-grained object recognition and retrieval of objects that are capable of state changes. The goal of such research would be to train models capable of generating object embeddings that remain invariant to state changes while also staying invariant to transformations induced by changes in viewpoint, pose, illumination, etc. To demonstrate the usefulness of the ObjectsWithStateChange dataset, we also propose a curriculum learning strategy that uses the similarity relationships in the learned embedding space after each epoch to guide the training process. The model learns discriminative features by comparing visually similar objects within and across different categories, encouraging it to differentiate between objects that may be challenging to distinguish due to changes in their state. We believe that this strategy enhances the model's ability to capture discriminative features for fine-grained tasks that may involve objects with state changes, leading to performance improvements on object-level tasks not only on our new dataset, but also on two other challenging multi-view datasets such as ModelNet40 and ObjectPI.


title: Regression Discontinuity Design with Spillovers

abstract: Researchers who estimate treatment effects using a regression discontinuity design (RDD) typically assume that there are no spillovers between the treated and control units. This may be unrealistic. We characterize the estimand of RDD in a setting where spillovers occur between units that are close in their values of the running variable. Under the assumption that spillovers are linear-in-means, we show that the estimand depends on the ratio of two terms: (1) the radius over which spillovers occur and (2) the choice of bandwidth used for the local linear regression. Specifically, RDD estimates direct treatment effect when radius is of larger order than the bandwidth, and total treatment effect when radius is of smaller order than the bandwidth. In the more realistic regime where radius is of similar order as the bandwidth, the RDD estimand is a mix of the above effects. To recover direct and spillover effects, we propose incorporating estimated spillover terms into local linear regression -- the local analog of peer effects regression. We also clarify the settings under which the donut-hole RD is able to eliminate the effects of spillovers.


title: High-skilled Human Workers in Non-Routine Jobs are Susceptible to AI Automation but Wage Benefits Differ between Occupations

abstract: Artificial Intelligence (AI) will change human work by taking over specific job tasks, but there is a debate which tasks are susceptible to automation, and whether AI will augment or replace workers and affect wages. By combining data on job tasks with a measure of AI susceptibility, we show that more highly skilled workers are more susceptible to AI automation, and that analytical non-routine tasks are at risk to be impacted by AI. Moreover, we observe that wage growth premiums for the lowest and the highest required skill level appear unrelated to AI susceptibility and that workers in occupations with many routine tasks saw higher wage growth if their work was more strongly susceptible to AI. Our findings imply that AI has the potential to affect human workers differently than canonical economic theories about the impact of technology on work these theories predict.


title: Generalized cubic partitions

abstract: A cubic partition consists of partition pairs $(\lambda,\mu)$ such that $\vert\lambda\vert+\vert\mu\vert=n$ where $\mu$ involves only even integers but no restriction is placed on $\lambda$. This paper initiates the notion of generalized cubic partitions and will prove a number of new congruences akin to the classical Ramanujan-type. The tools emphasize three methods of proofs. The paper concludes with a conjecture on the rarity of the aforementioned Ramanujan-type congruences.


title: Autonomous Evaluation and Refinement of Digital Agents

abstract: We show that domain-general automatic evaluators can significantly improve the performance of agents for web navigation and device control. We experiment with multiple evaluation models that trade off between inference cost, modularity of design, and accuracy. We validate the performance of these models in several popular benchmarks for digital agents, finding between 74.4 and 92.9% agreement with oracle evaluation metrics. Finally, we use these evaluators to improve the performance of existing agents via fine-tuning and inference-time guidance. Without any additional supervision, we improve state-of-the-art performance by 29% on the popular benchmark WebArena, and achieve a 75% relative improvement in a challenging domain transfer scenario.


title: Two-dimensional turbulence above topography: condensation transition and selection of minimum enstrophy solutions

abstract: We consider two-dimensional flows above topography, revisiting the selective decay (or minimum-enstrophy) hypothesis of Bretherton and Haidvogel. We derive a 'condensed branch' of solutions to the variational problem where a domain-scale condensate coexists with a flow at the (smaller) scale of the topography. The condensate arises through a supercritical bifurcation as the conserved energy of the initial condition exceeds a threshold value, a prediction that we quantitatively validate using Direct Numerical Simulations (DNS). We then consider the forced-dissipative case, showing how weak forcing and dissipation select a single dissipative state out of the continuum of solutions to the energy-conserving system predicted by selective decay. As the forcing strength increases, the condensate arises through a supercritical bifurcation for topographic-scale forcing and through a subcritical bifurcation for domain-scale forcing, both predictions being quantitatively validated by DNS. This method provides a way of determining the equilibrated state of forced-dissipative flows based on variational approaches to the associated energy-conserving system, such as the statistical mechanics of 2D flows or selective decay.


title: Multiple mixing in ergodic theory

abstract: In 1949 V.A. Rokhlin introduced into ergodic theory the k-fold mixing and puzzled the mathematical community with the problem of the mismatch of these invariants. Here's what Rokhlin wrote: "The proposed work arose from the author's attempts to solve the well-known spectral problem of the theory of dynamical systems: are there any metrically different dynamical systems with the same continuous (in particular, Lebesgue) spectrum? Using new metric invariants introduced for this purpose, the author tried to find among the ergodic automorphisms of compact commutative groups automorphisms of various metric types. It turned out, however, that for all the indicated automorphisms the new invariants are exactly the same." We discuss this long time open problem.


title: Mechanised Hypersafety Proofs about Structured Data: Extended Version

abstract: Arrays are a fundamental abstraction to represent collections of data. It is often possible to exploit structural properties of the data stored in an array (e.g., repetition or sparsity) to develop a specialised representation optimised for space efficiency. Formally reasoning about correctness of manipulations with such structured data is challenging, as they are often composed of multiple loops with non-trivial invariants. In this work, we observe that specifications for structured data manipulations can be phrased as hypersafety properties, i.e., predicates that relate traces of $k$ programs. To turn this observation into an effective verification methodology, we developed the Logic for Graceful Tensor Manipulation (LGTM), a new Hoare-style relational separation logic for specifying and verifying computations over structured data. The key enabling idea of LGTM is that of parametrised hypersafety specifications that allow the number $k$ of the program components to depend on the program variables. We implemented LGTM as a foundational embedding into Coq, mechanising its rules, meta-theory, and the proof of soundness. Furthermore, we developed a library of domain-specific tactics that automate computer-aided hypersafety reasoning, resulting in pleasantly short proof scripts that enjoy a high degree of reuse. We argue for the effectiveness of relational reasoning about structured data in LGTM by specifying and mechanically proving correctness of 13 case studies including computations on compressed arrays and efficient operations over multiple kinds of sparse tensors.


title: Laue Indexing with Optimal Transport

abstract: Laue tomography experiments retrieve the positions and orientations of crystal grains in a polycrystalline samples from diffraction patterns recorded at multiple viewing angles. The use of a broad wavelength spectrum beam can greatly reduce the experimental time, but poses a difficult challenge for the indexing of diffraction peaks in polycrystalline samples; the information about the wavelength of these Bragg peaks is absent and the diffraction patterns from multiple grains are superimposed. To date, no algorithms exist capable of indexing samples with more than about 500 grains efficiently. To address this need we present a novel method: Laue indexing with Optimal Transport (LaueOT). We create a probabilistic description of the multi-grain indexing problem and propose a solution based on Sinkhorn Expectation-Maximization method, which allows to efficiently find the maximum of the likelihood thanks to the assignments being calculated using Optimal Transport. This is a non-convex optimization problem, where the orientations and positions of grains are optimized simultaneously with grain-to-spot assignments, while robustly handling the outliers. The selection of initial prototype grains to consider in the optimization problem are also calculated within the Optimal Transport framework. LaueOT can rapidly and effectively index up to 1000 grains on a single large memory GPU within less than 30 minutes. We demonstrate the performance of LaueOT on simulations with variable numbers of grains, spot position measurement noise levels, and outlier fractions. The algorithm recovers the correct number of grains even for high noise levels and up to 70% outliers in our experiments. We compare the results of indexing with LaueOT to existing algorithms both on synthetic and real neutron diffraction data from well-characterized samples.


title: Text-Based Reasoning About Vector Graphics

abstract: While large multimodal models excel in broad vision-language benchmarks, they often struggle with tasks requiring precise perception of low-level visual details, such as comparing line lengths or solving simple mazes. In particular, this failure mode persists in question-answering tasks about vector graphics -- images composed purely of 2D objects and shapes. To address this challenge, we propose the Visually Descriptive Language Model (VDLM), which performs text-based reasoning about vector graphics. VDLM leverages Scalable Vector Graphics (SVG) for a more precise visual description and first uses an off-the-shelf raster-to-SVG algorithm for encoding. Since existing language models cannot understand raw SVGs in a zero-shot setting, VDLM then bridges SVG with pretrained language models through a newly introduced intermediate symbolic representation, Primal Visual Description (PVD), comprising primitive attributes (e.g., shape, position, measurement) with their corresponding predicted values. PVD is task-agnostic and represents visual primitives that are universal across all vector graphics. It can be learned with procedurally generated (SVG, PVD) pairs and also enables the direct use of LLMs for generalization to complex reasoning tasks. By casting an image to a text-based representation, we can leverage the power of language models to learn alignment from SVG to visual primitives and generalize to unseen question-answering tasks. Empirical results show that VDLM achieves stronger zero-shot performance compared to state-of-the-art LMMs, such as GPT-4V, in various low-level multimodal perception and reasoning tasks on vector graphics. We additionally present extensive analyses on VDLM's performance, demonstrating that our framework offers better interpretability due to its disentangled perception and reasoning processes. Project page: https://mikewangwzhl.github.io/VDLM/


title: Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks

abstract: Recently, the large language model (LLM) community has shown increasing interest in enhancing LLMs' capability to handle extremely long documents. As various long-text techniques and model architectures emerge, the precise and detailed evaluation of models' long-text capabilities has become increasingly important. Existing long-text evaluation benchmarks, such as L-Eval and LongBench, construct long-text test sets based on open-source datasets, focusing mainly on QA and summarization tasks. These datasets include test samples of varying lengths (from 2k to 32k+) entangled together, making it challenging to assess model capabilities across different length ranges. Moreover, they do not cover the ultralong settings (100k+ tokens) that the latest LLMs claim to achieve. In this paper, we introduce Ada-LEval, a length-adaptable benchmark for evaluating the long-context understanding of LLMs. Ada-LEval includes two challenging subsets, TSort and BestAnswer, which enable a more reliable evaluation of LLMs' long context capabilities. These benchmarks support intricate manipulation of the length of test cases, and can easily produce text samples up to 128k tokens. We evaluate 4 state-of-the-art closed-source API models and 6 open-source models with Ada-LEval. The evaluation results demonstrate the limitations of current LLMs, especially in ultra-long-context settings. Our code is available at https://github.com/open-compass/Ada-LEval.


title: GeoDirDock: Guiding Docking Along Geodesic Paths

abstract: This work introduces GeoDirDock (GDD), a novel approach to molecular docking that enhances the accuracy and physical plausibility of ligand docking predictions. GDD guides the denoising process of a diffusion model along geodesic paths within multiple spaces representing translational, rotational, and torsional degrees of freedom. Our method leverages expert knowledge to direct the generative modeling process, specifically targeting desired protein-ligand interaction regions. We demonstrate that GDD significantly outperforms existing blind docking methods in terms of RMSD accuracy and physicochemical pose realism. Our results indicate that incorporating domain expertise into the diffusion process leads to more biologically relevant docking predictions. Additionally, we explore the potential of GDD for lead optimization in drug discovery through angle transfer in maximal common substructure (MCS) docking, showcasing its capability to predict ligand orientations for chemically similar compounds accurately.


title: Exceptional zeros of Rankin-Selberg $L$-functions and joint Sato-Tate distributions

abstract: Let $\chi$ be an idele class character over a number field $F$, and let $\pi,\pi'$ be non-dihedral twist-inequivalent cuspidal automorphic representations of $\mathrm{GL}_2(\mathbb{A}_F)$. We prove the following results. 1. If $m,n\geq 0$ are integers, $m+n\geq 1$, $F$ is totally real, $\chi$ corresponds with a ray class character, and $\pi,\pi'$ correspond with primitive non-CM holomorphic Hilbert cusp forms, then the Rankin-Selberg $L$-function $L(s,\mathrm{Sym}^m(\pi)\times(\mathrm{Sym}^n(\pi')\otimes\chi))$ has a standard zero-free region with no exceptional Landau-Siegel zero. When $m,n\geq 1$ and $m+n\geq 4$, this is new even for $F=\mathbb{Q}$. As an application, we establish the strongest known unconditional effective rates of convergence in the Sato-Tate distribution for $\pi$ and the joint Sato-Tate distribution for $\pi$ and $\pi'$. 2. The Rankin-Selberg $L$-function $L(s,\mathrm{Sym}^2(\pi)\times(\mathrm{Sym}^2 (\pi')\otimes\chi))$ has a standard zero-free region with no exceptional Landau-Siegel zero. Until now, this was only known when $\pi=\pi'$, $\pi$ is self-dual, and $\chi$ is trivial.


title: RhythmMamba: Fast Remote Physiological Measurement with Arbitrary Length Videos

abstract: Remote photoplethysmography (rPPG) is a non-contact method for detecting physiological signals from facial videos, holding great potential in various applications such as healthcare, affective computing, and anti-spoofing. Existing deep learning methods struggle to address two core issues of rPPG simultaneously: extracting weak rPPG signals from video segments with large spatiotemporal redundancy and understanding the periodic patterns of rPPG among long contexts. This represents a trade-off between computational complexity and the ability to capture long-range dependencies, posing a challenge for rPPG that is suitable for deployment on mobile devices. Based on the in-depth exploration of Mamba's comprehension of spatial and temporal information, this paper introduces RhythmMamba, an end-to-end Mamba-based method that employs multi-temporal Mamba to constrain both periodic patterns and short-term trends, coupled with frequency domain feed-forward to enable Mamba to robustly understand the quasi-periodic patterns of rPPG. Extensive experiments show that RhythmMamba achieves state-of-the-art performance with reduced parameters and lower computational complexity. The proposed RhythmMamba can be applied to video segments of any length without performance degradation. The codes are available at https://github.com/zizheng-guo/RhythmMamba.


title: Public-private funding models in open source software development: A case study on scikit-learn

abstract: Governments are increasingly funding open source software (OSS) development to support software security, digital sovereignty, and national competitiveness in science and innovation, amongst others. However, little is known about how OSS developers evaluate the relative benefits and drawbacks of governmental funding for OSS. This study explores this question through a case study on scikit-learn, a Python library for machine learning, funded by public research grants, commercial sponsorship, micro-donations, and a 32 euro million grant announced in France's artificial intelligence strategy. Through 25 interviews with scikit-learn's maintainers and funders, this study makes two key contributions. First, it contributes empirical findings about the benefits and drawbacks of public and private funding in an impactful OSS project, and the governance protocols employed by the maintainers to balance the diverse interests of their community and funders. Second, it offers practical lessons on funding for OSS developers, governments, and companies based on the experience of scikit-learn. The paper concludes with key recommendations for practitioners and future research directions.


title: Server saturation in skewed networks

abstract: We consider a model inspired by compatibility constraints that arise between tasks and servers in data centers, cloud computing systems and content delivery networks. The constraints are represented by a bipartite graph or network that interconnects dispatchers with compatible servers. Each dispatcher receives tasks over time and sends every task to a compatible server with the least number of tasks, or to a server with the least number of tasks among $d$ compatible servers selected uniformly at random. We focus on networks where the neighborhood of at least one server is skewed in a limiting regime. This means that a diverging number of dispatchers are in the neighborhood which are each compatible with a uniformly bounded number of servers; thus, the degree of the central server approaches infinity while the degrees of many neighboring dispatchers remain bounded. We prove that each server with a skewed neighborhood saturates, in the sense that the mean number of tasks queueing in front of it in steady state approaches infinity. Paradoxically, this pathological behavior can even arise in random networks where nearly all the servers have at most one task in the limit.


title: GO4Align: Group Optimization for Multi-Task Alignment

abstract: This paper proposes \textit{GO4Align}, a multi-task optimization approach that tackles task imbalance by explicitly aligning the optimization across tasks. To achieve this, we design an adaptive group risk minimization strategy, compromising two crucial techniques in implementation: (i) dynamical group assignment, which clusters similar tasks based on task interactions; (ii) risk-guided group indicators, which exploit consistent task correlations with risk information from previous iterations. Comprehensive experimental results on diverse typical benchmarks demonstrate our method's performance superiority with even lower computational costs.


title: Uncovering Tidal Treasures: Automated Classification of Faint Tidal Features in DECaLS Data

abstract: Tidal features are a key observable prediction of the hierarchical model of galaxy formation and contain a wealth of information about the properties and history of a galaxy. Modern wide-field surveys such as LSST and Euclid will revolutionise the study of tidal features. However, the volume of data will far surpass the capacity to inspect each galaxy to identify the feature visually, thereby motivating an urgent need to develop automated detection methods. This paper presents a visual classification of $\sim$2,000 galaxies from the DECaLS survey into different tidal feature categories: arms, streams, shells, and diffuse. Using these labels, we trained a Convolutional Neural Network (CNN) to reproduce the assigned visual classifications. Overall our network performed well and retrieved a median $81.1^{+5.8}_{-6.5}$, $65.7^{+5.0}_{-8.4}$, $91.3^{+6.0}_{-5.9}$, and $82.3^{+1.4}_{-7.9}$ per cent of the actual instances of arm, stream, shell, and diffuse features respectively for just 20 per cent contamination. We verified that the network was classifying the images correctly by using a Gradient-weighted Class Activation Mapping analysis to highlight important regions on the images for a given classification. This is the first demonstration of using CNNs to classify tidal features into sub-categories, and it will pave the way for the identification of different categories of tidal features in the vast samples of galaxies that forthcoming wide-field surveys will deliver.


title: Pitfalls of Conversational LLMs on News Debiasing

abstract: This paper addresses debiasing in news editing and evaluates the effectiveness of conversational Large Language Models in this task. We designed an evaluation checklist tailored to news editors' perspectives, obtained generated texts from three popular conversational models using a subset of a publicly available dataset in media bias, and evaluated the texts according to the designed checklist. Furthermore, we examined the models as evaluator for checking the quality of debiased model outputs. Our findings indicate that none of the LLMs are perfect in debiasing. Notably, some models, including ChatGPT, introduced unnecessary changes that may impact the author's style and create misinformation. Lastly, we show that the models do not perform as proficiently as domain experts in evaluating the quality of debiased outputs.


title: Finding Stable Price Zones in European Electricity Markets: Aiming to Square the Circle?

abstract: The European day-ahead electricity market is split into multiple bidding zones with a uniform price. The increase in renewables leads to a growing number of interventions in the generation of energy sources and increasing redispatch costs. To ensure efficient congestion management, the EU Commission mandated a Bidding Zone Review (BZR) to reevaluate the configuration of European bidding zones. An integral part of this process was a locational marginal pricing study. Based on this study, alternative bidding zone configurations were proposed. These bidding zones shall be stable and robust over time. For Germany, four configurations were suggested. We analyzed the proposed configurations considering different clustering algorithms and periods based on the publicly released data set. We found that the configurations do not reduce the price standard deviations within zones much, and the average prices across zones are similar. Other configurations identified based on clustering the prices lead to lower price variance but they are not geographically coherent. Independent of the clustering features and algorithms used, the resulting clusters are not stable over time. While the costs of a bidding zone split in Germany are high, the effect on prices would be low based on an analysis of the new BZR data.


title: Convergence analysis of novel discontinuous Galerkin methods for a convection dominated problem

abstract: In this paper, we propose and analyze a numerically stable and convergent scheme for a convection-diffusion-reaction equation in the convection-dominated regime. Discontinuous Galerkin (DG) methods are considered since standard finite element methods for the convection-dominated equation cause spurious oscillations. We choose to follow a novel DG finite element differential calculus framework introduced in Feng et al. (2016) and approximate the infinite-dimensional operators in the equation with the finite-dimensional DG differential operators. Specifically, we construct the numerical method by using the dual-wind discontinuous Galerkin (DWDG) formulation for the diffusive term and the average discrete gradient operator for the convective term along with standard DG stabilization. We prove that the method converges optimally in the convection-dominated regime. Numerical results are provided to support the theoretical findings.


title: The jet of BP Tau

abstract: A strong global magnetic field of young low-mass stars and a high accretion rate are the necessary conditions for the formation of collimated outflows (jets) from these objects. But it is still unclear whether these conditions are also sufficient. We aim to check whether BP Tau, an actively accreting young star with a strong magnetic field, has a jet. We carried out narrowband SII 672 nm imaging and spectroscopic observations of BP Tau and its vicinity. We find that BP Tau is a source of a Herbig-Haro flow (assigned number HH 1181), which includes two HH objects moving from the star in opposite directions and a micro- (counter-) jet of ~ 1" projected length. The flow is oriented along position angle $59 \pm 1$ degree.


title: Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspective

abstract: Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures, are often challenging due to the rapid growth of the solution space. The trial-and-error paradigm of Reinforcement Learning has recently emerged as a promising alternative to traditional methods, such as exact algorithms and (meta)heuristics, for discovering better decision-making strategies in a variety of disciplines including chemistry, computer science, and statistics. Despite the fact that they arose in markedly different fields, these techniques share significant commonalities. Therefore, we set out to synthesize this work in a unifying perspective that we term Graph Reinforcement Learning, interpreting it as a constructive decision-making method for graph problems. After covering the relevant technical background, we review works along the dividing line of whether the goal is to optimize graph structure given a process of interest, or to optimize the outcome of the process itself under fixed graph structure. Finally, we discuss the common challenges facing the field and open research questions. In contrast with other surveys, the present work focuses on non-canonical graph problems for which performant algorithms are typically not known and Reinforcement Learning is able to provide efficient and effective solutions.


title: Flying with Photons: Rendering Novel Views of Propagating Light

abstract: We present an imaging and neural rendering technique that seeks to synthesize videos of light propagating through a scene from novel, moving camera viewpoints. Our approach relies on a new ultrafast imaging setup to capture a first-of-its kind, multi-viewpoint video dataset with picosecond-level temporal resolution. Combined with this dataset, we introduce an efficient neural volume rendering framework based on the transient field. This field is defined as a mapping from a 3D point and 2D direction to a high-dimensional, discrete-time signal that represents time-varying radiance at ultrafast timescales. Rendering with transient fields naturally accounts for effects due to the finite speed of light, including viewpoint-dependent appearance changes caused by light propagation delays to the camera. We render a range of complex effects, including scattering, specular reflection, refraction, and diffraction. Additionally, we demonstrate removing viewpoint-dependent propagation delays using a time warping procedure, rendering of relativistic effects, and video synthesis of direct and global components of light transport.


title: Existence of Mexican-hat dispersion and symmetry group of a layer

abstract: Increased interest in physics of graphene and other two-dimensional materials boosted investigations of band structure near nodal points and lines. In contrast, group theoretical explanation of simple bands (that do not touch other bands), is sporadically present in the literature. This paper presents electronic dispersions up to forth order in momentum, near Brillouin zone (BZ) high symmetry points of all eighty layer groups. The method applies to non magnetic materials both with or without spin-orbit coupling. Particular attention is devoted to Mexican-hat dispersion, showing that it can appear only at BZ center of hexagonal layer groups. Presented symmetry adapted Taylor expansion of bands can be used to fit ab-initio or experimental band structures, or for analytical calculation of crystal properties. The results presented here might serve also as a guiding tool for design of new two-dimensional materials.


title: Mechanism Design for ZK-Rollup Prover Markets

abstract: In ZK-Rollups, provers spend significant computational resources to generate validity proofs. Their costs should be compensated properly, so a sustainable prover market can form over time. Existing transaction fee mechanisms (TFMs) such as EIP-1559, however, do not work in this setting, as EIP-1559 only generates negligible revenue because of burning, while provers often create or purchase specialized hardware in hopes of creating long-term revenue from proving, somewhat reminiscent of proof-of-work miners in the case of chains like Bitcoin. In this paper, we explore the design of transaction fee mechanisms for prover markets. The desiderata for such mechanisms include efficiency (social welfare is maximized), incentive compatibility (it is rational to bid honestly), collusion resistance (no profitable collusion among provers exists), and off-chain agreement proofness (no profitable collusion between users and provers exists). To demonstrate the difficulties of our new setting, we put forward several simple strawman mechanisms, and show they suffer from notable deficiencies.


title: Lattice determination of the Batalin-Vilkovisky function and the strong running interaction

abstract: The Batalin-Vilkovisky function is a central component in the modern formulation of the background field method and the physical applications derived from it. In the present work we report on novel lattice results for this particular quantity, obtained by capitalizing on its equality with the Kugo-Ojima function in the Landau gauge. The results of the lattice simulation are in very good agreement with the predictions derived from a continuum analysis based on the corresponding Schwinger-Dyson equations. In addition, we show that an important relation connecting this function with the ghost propagator is fulfilled rather accurately. With the aid of these results, we carry out the first completely lattice-based determination of the process-independent strong running interaction, employed in a variety of phenomenological studies.


title: Banach lattices of positively homogeneous functions induced by a Banach space

abstract: Motivated by the construction of the free Banach lattice generated by a Banach space, we introduce and study several vector and Banach lattices of positively homogeneous functions defined on the dual of a Banach space $E$. The relations between these lattices allow us to give multiple characterizations of when the underlying Banach space $E$ is finite-dimensional and when it is reflexive. Furthermore, we show that lattice homomorphisms between free Banach lattices are always composition operators, and study how these operators behave on the scale of lattices of positively homogeneous functions.


title: Simultaneous linear connectivity of neural networks modulo permutation

abstract: Neural networks typically exhibit permutation symmetries which contribute to the non-convexity of the networks' loss landscapes, since linearly interpolating between two permuted versions of a trained network tends to encounter a high loss barrier. Recent work has argued that permutation symmetries are the only sources of non-convexity, meaning there are essentially no such barriers between trained networks if they are permuted appropriately. In this work, we refine these arguments into three distinct claims of increasing strength. We show that existing evidence only supports "weak linear connectivity"-that for each pair of networks belonging to a set of SGD solutions, there exist (multiple) permutations that linearly connect it with the other networks. In contrast, the claim "strong linear connectivity"-that for each network, there exists one permutation that simultaneously connects it with the other networks-is both intuitively and practically more desirable. This stronger claim would imply that the loss landscape is convex after accounting for permutation, and enable linear interpolation between three or more independently trained models without increased loss. In this work, we introduce an intermediate claim-that for certain sequences of networks, there exists one permutation that simultaneously aligns matching pairs of networks from these sequences. Specifically, we discover that a single permutation aligns sequences of iteratively trained as well as iteratively pruned networks, meaning that two networks exhibit low loss barriers at each step of their optimization and sparsification trajectories respectively. Finally, we provide the first evidence that strong linear connectivity may be possible under certain conditions, by showing that barriers decrease with increasing network width when interpolating among three networks.


title: A Machine Learning Framework for the Prediction of Grain Boundary Segregation in Chemically Complex Environments

abstract: The discovery of complex concentrated alloys has unveiled materials with diverse atomic environments, prompting the exploration of solute segregation beyond dilute alloys. Data-driven methods offer promising for modeling segregation in such chemically complex environments, and are employed in this study to understand segregation behavior of a refractory complex concentrated alloy, NbMoTaW. A flexible methodology is developed that uses composable computational modules, with different arrangements of these modules employed to obtain site availabilities at absolute zero and the corresponding density of states beyond the dilute limit, resulting in an extremely large dataset containing 10 million data points. The artificial neural network developed here can rely solely on descriptions of local atomic environments to predict behavior at the dilute limit with very small errors, while the addition of negative segregation instance classification allows any solute concentration from zero up to the equiatomic concentration for ternary or quaternary alloys to be modeled at room temperature. The machine learning model thus achieves a significant speed advantage over traditional atomistic simulations, being four orders of magnitude faster, while only experiencing a minimal reduction in accuracy. This efficiency presents a powerful tool for rapid microstructural and interfacial design in unseen domains. Scientifically, our approach reveals a transition in the segregation behavior of Mo from unfavorable in simple systems to favorable in complex environments. Additionally, increasing solute concentration was observed to cause anti-segregation sites to begin to fill, challenging conventional understanding and highlighting the complexity of segregation dynamics in chemically complex environments.


title: The Rise and Fall of the Initial Era

abstract: Bibliographic data is a rich source of information that goes beyond the use cases of location and citation -- it also encodes both cultural and technological context. For most of its existence, the scholarly record has changed slowly and hence provides an opportunity to gain insight through its reflection of the cultural norms of the research community over the last four centuries. While it is often difficult to distinguish the originating driver of change, it is still valuable to consider the motivating influences that have led to changes in the structure of the scholarly record. An "initial era" is identified during which initials were used in preference to full names by authors on scholarly communications. Causes of the emergence and demise of this era are considered as well as the implications of this era on research culture and practice.


title: Detection of Rydberg lines from the atmosphere of Betelgeuse

abstract: Emission lines from Rydberg transitions are detected for the first time from a region close to the surface of Betelgeuse. The H30${\alpha}$ line is observed at 231.905 GHz, with a FWHM ~42 km/s and extended wings. A second line at 232.025 GHz (FWHM ~21 km/s), is modeled as a combination of Rydberg transitions of abundant low First Ionization Potential metals. Both H30${\alpha}$ and the Rydberg combined line X30${\alpha}$ are fitted by Voigt profiles, and collisional broadening with electrons may be partly responsible for the Lorentzian contribution, indicating electron densities of a few 10$^8$cm$^{-3}$. X30${\alpha}$ is located in a relatively smooth ring at a projected radius of 0.9x the optical photospheric radius R$_*$, whereas H30${\alpha}$ is more clumpy, reaching a peak at ~1.4R$_*$. We use a semi-empirical thermodynamic atmospheric model of Betelgeuse to compute the 232 GHz (1.29mm) continuum and line profiles making simple assumptions. Photoionized abundant metals dominate the electron density and the predicted surface of continuum optical depth unity at 232 GHz occurs at ~1.3R$_*$, in good agreement with observations. Assuming a Saha-Boltzmann distribution for the level populations of Mg, Si, and Fe, the model predicts that the X30${\alpha}$ emission arises in a region of radially-increasing temperature and turbulence. Inclusion of ionized C and non-LTE effects could modify the integrated fluxes and location of emission. These simulations confirm the identity of the Rydberg transition lines observed towards Betelgeuse, and reveal that such diagnostics can improve future atmospheric models.


title: Limit theorem for subdiffusive random walk in Dirichlet random environment in dimension $d \ge 3$

abstract: We consider random walk in Dirichlet random environment in ${\mathbf{Z}^d, d\ge 3}$, which corresponds to the case where the environment is constructed from i.i.d. transition probabilities at each vertex with a Dirichlet distribution with parameters $(\alpha_i)_{1 \le i \le 2d}$. Dirichlet environments are weakly elliptic and the walk can be slowdowned by local traps whose strength are governed by a parameter $\kappa$. In this paper we prove a stable limit theorem when the walk is ballistic but subdiffusive, i.e. when ${\kappa \in (1,2)}$. This completes the result of Poudevigne (arXiv:1909.03866) who proved a sub-ballistic stable limit theorem when $\kappa\in (0,1)$. Contrary to Poudevigne, we have to assume Sznitman's condition $\mathbf{(T)}$ to prove the limit theorem since we work at the level of fluctuations and need a better control on renewal times.


title: Comparing Two Model Designs for Clinical Note Generation; Is an LLM a Useful Evaluator of Consistency?

abstract: Following an interaction with a patient, physicians are responsible for the submission of clinical documentation, often organized as a SOAP note. A clinical note is not simply a summary of the conversation but requires the use of appropriate medical terminology. The relevant information can then be extracted and organized according to the structure of the SOAP note. In this paper we analyze two different approaches to generate the different sections of a SOAP note based on the audio recording of the conversation, and specifically examine them in terms of note consistency. The first approach generates the sections independently, while the second method generates them all together. In this work we make use of PEGASUS-X Transformer models and observe that both methods lead to similar ROUGE values (less than 1% difference) and have no difference in terms of the Factuality metric. We perform a human evaluation to measure aspects of consistency and demonstrate that LLMs like Llama2 can be used to perform the same tasks with roughly the same agreement as the human annotators. Between the Llama2 analysis and the human reviewers we observe a Cohen Kappa inter-rater reliability of 0.79, 1.00, and 0.32 for consistency of age, gender, and body part injury, respectively. With this we demonstrate the usefulness of leveraging an LLM to measure quality indicators that can be identified by humans but are not currently captured by automatic metrics. This allows scaling evaluation to larger data sets, and we find that clinical note consistency improves by generating each new section conditioned on the output of all previously generated sections.


title: Evidence for Primordial Alignment: Insights from Stellar Obliquity Measurements for Compact Sub-Saturn Systems

abstract: Despite decades of effort, the mechanisms by which the spin axis of a star and the orbital axes of its planets become misaligned remain elusive. Particularly, it is of great interest whether the large spin-orbit misalignments observed are driven primarily by high-eccentricity migration -- expected to have occurred for short-period, isolated planets -- or reflect a more universal process that operates across systems with a variety of present-day architectures. Compact multi-planet systems offer a unique opportunity to differentiate between these competing hypotheses, as their tightly-packed configurations preclude violent dynamical histories, including high-eccentricity migration, allowing them to trace the primordial disk plane. In this context, we report measurements of the sky-projected stellar obliquity ($\lambda$) via the Rossiter-McLaughlin effect for two sub-Saturns in multiple-transiting systems: TOI-5126 b ($\lambda=1\pm 48\,^{\circ}$) and TOI-5398 b ($\lambda=-24^{+14}_{-13} \,^{\circ}$). Both are spin-orbit aligned, joining a fast-growing group of just three other compact sub-Saturn systems, all of which exhibit spin-orbit alignment. Our results strongly suggest that sub-Saturn systems are primordially aligned and become misaligned largely in the post-disk phase through violent dynamical interactions inherent to eccentric migration, as appears to be the case increasingly for other exoplanet populations.


title: Characterizing visual cortical magnification with topological smoothing and optimal transportation

abstract: Human vision has different concentration on visual fields. Cortical magnification factor (CMF) is a popular measurement on visual acuity and cortex concentration. In order to achieve thorough measurement of CMF across the whole visual field, we propose a method to measure planar CMF upon retinotopic maps generated by pRF decoding, with help of our proposed methods: optimal transportation and topological smoothing. The optimal transportation re-calculates vertex location in retinotopic mapping, and topological smoothing guarantees topological conditions in retinotopic maps, which allow us to calculate planar CMF with the proposed 1-ring patch method. The pipeline was applied to the HCP 7T dataset, giving new planar results on CMF measurement across all 181 subjects, which illustrate novel concentration behavior on visual fields and their individual difference.


title: Primordial black holes and curvature perturbations from false vacuum islands

abstract: Recently, much attention has been focused on the false vacuum islands that are flooded by an expanding ocean of true-vacuum bubbles slightly later than most of the other parts of the world. These delayed decay regions will accumulate locally larger vacuum energy density by staying in the false vacuum longer than those already transited into the true vacuum. A false vacuum island with thus acquired density contrast of a super-horizon size will evolve locally from radiation dominance to vacuum dominance, creating a local baby Universe that can be regarded effectively as a local closed Universe. If such density contrasts of super-horizon sizes can ever grow large enough to exceed the threshold of gravitational collapse, primordial black holes will form similar to those collapsing curvature perturbations on super-horizon scales induced by small-scale enhancements during inflation. If not, such density contrasts can still induce curvature perturbations potentially observable today. In this paper, we revisit and elaborate on the generations of primordial black holes and curvature perturbations from delayed-decayed false vacuum islands during asynchronous first-order phase transitions with fitting formulas convenient for future model-independent studies.


title: Reconstructing Hand-Held Objects in 3D

abstract: Objects manipulated by the hand (i.e., manipulanda) are particularly challenging to reconstruct from in-the-wild RGB images or videos. Not only does the hand occlude much of the object, but also the object is often only visible in a small number of image pixels. At the same time, two strong anchors emerge in this setting: (1) estimated 3D hands help disambiguate the location and scale of the object, and (2) the set of manipulanda is small relative to all possible objects. With these insights in mind, we present a scalable paradigm for handheld object reconstruction that builds on recent breakthroughs in large language/vision models and 3D object datasets. Our model, MCC-Hand-Object (MCC-HO), jointly reconstructs hand and object geometry given a single RGB image and inferred 3D hand as inputs. Subsequently, we use GPT-4(V) to retrieve a 3D object model that matches the object in the image and rigidly align the model to the network-inferred geometry; we call this alignment Retrieval-Augmented Reconstruction (RAR). Experiments demonstrate that MCC-HO achieves state-of-the-art performance on lab and Internet datasets, and we show how RAR can be used to automatically obtain 3D labels for in-the-wild images of hand-object interactions.


title: On the Effect of (Near) Duplicate Subwords in Language Modelling

abstract: Tokenisation is a core part of language models (LMs). It involves splitting a character sequence into subwords which are assigned arbitrary indices before being served to the LM. While typically lossless, however, this process may lead to less sample efficient LM training: as it removes character-level information, it could make it harder for LMs to generalise across similar subwords, such as now and Now. We refer to such subwords as near duplicates. In this paper, we study the impact of near duplicate subwords on LM training efficiency. First, we design an experiment that gives us an upper bound to how much we should expect a model to improve if we could perfectly generalise across near duplicates. We do this by duplicating each subword in our LM's vocabulary, creating perfectly equivalent classes of subwords. Experimentally, we find that LMs need roughly 17% more data when trained in a fully duplicated setting. Second, we investigate the impact of naturally occurring near duplicates on LMs. Here, we see that merging them considerably hurts LM performance. Therefore, although subword duplication negatively impacts LM training efficiency, naturally occurring near duplicates may not be as similar as anticipated, limiting the potential for performance improvements.


title: Horizon-penetrating form of parametrized metrics for static and stationary black holes

abstract: The Rezzolla-Zhidenko (RZ) and Konoplya-Rezzolla-Zhidenko (KRZ) frameworks provide an efficient approach to characterize agnostically spherically symmetric or stationary black-hole spacetimes in arbitrary metric theories. In their original construction, these metrics were defined only in the spacetime region outside of the event horizon, where they can reproduce any black-hole metric with percent precision and a few parameters only. At the same time, numerical simulations of accreting black holes often require metric functions that are regular across the horizon, so that the inner boundary of the computational domain can be placed in a region that is causally disconnected from the exterior. We present a novel formulation of the RZ/KRZ parametrized metrics in coordinate systems that are regular at the horizon and defined everywhere in the interior. We compare the horizon-penetrating form of the KRZ and RZ metrics with the corresponding forms of the Kerr metric in Kerr-Schild coordinates and of the Schwarzschild metric in Eddington-Finkelstein coordinates, remarking the similarities and differences. We expect the horizon-penetrating formulations of the RZ/KRZ metrics to represent new tools to study via simulations the physical processes that occur near the horizon of an arbitrary black hole.


title: Can Feedback Enhance Semantic Grounding in Large Vision-Language Models?

abstract: Enhancing semantic grounding abilities in Vision-Language Models (VLMs) often involves collecting domain-specific training data, refining the network architectures, or modifying the training recipes. In this work, we venture into an orthogonal direction and explore whether VLMs can improve their semantic grounding by "receiving" feedback, without requiring in-domain data, fine-tuning, or modifications to the network architectures. We systematically analyze this hypothesis using a feedback mechanism composed of a binary signal. We find that if prompted appropriately, VLMs can utilize feedback both in a single step and iteratively, showcasing the potential of feedback as an alternative technique to improve grounding in internet-scale VLMs. Furthermore, VLMs, like LLMs, struggle to self-correct errors out-of-the-box. However, we find that this issue can be mitigated via a binary verification mechanism. Finally, we explore the potential and limitations of amalgamating these findings and applying them iteratively to automatically enhance VLMs' grounding performance, showing grounding accuracy consistently improves using automated feedback across all models in all settings investigated. Overall, our iterative framework improves semantic grounding in VLMs by more than 15 accuracy points under noise-free feedback and up to 5 accuracy points under a simple automated binary verification mechanism. The project website is hosted at https://andrewliao11.github.io/vlms_feedback


title: MoReVQA: Exploring Modular Reasoning Models for Video Question Answering

abstract: This paper addresses the task of video question answering (videoQA) via a decomposed multi-stage, modular reasoning framework. Previous modular methods have shown promise with a single planning stage ungrounded in visual content. However, through a simple and effective baseline, we find that such systems can lead to brittle behavior in practice for challenging videoQA settings. Thus, unlike traditional single-stage planning methods, we propose a multi-stage system consisting of an event parser, a grounding stage, and a final reasoning stage in conjunction with an external memory. All stages are training-free, and performed using few-shot prompting of large models, creating interpretable intermediate outputs at each stage. By decomposing the underlying planning and task complexity, our method, MoReVQA, improves over prior work on standard videoQA benchmarks (NExT-QA, iVQA, EgoSchema, ActivityNet-QA) with state-of-the-art results, and extensions to related tasks (grounded videoQA, paragraph captioning).


title: InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD

abstract: The Large Vision-Language Model (LVLM) field has seen significant advancements, yet its progression has been hindered by challenges in comprehending fine-grained visual content due to limited resolution. Recent efforts have aimed to enhance the high-resolution understanding capabilities of LVLMs, yet they remain capped at approximately 1500 x 1500 pixels and constrained to a relatively narrow resolution range. This paper represents InternLM-XComposer2-4KHD, a groundbreaking exploration into elevating LVLM resolution capabilities up to 4K HD (3840 x 1600) and beyond. Concurrently, considering the ultra-high resolution may not be necessary in all scenarios, it supports a wide range of diverse resolutions from 336 pixels to 4K standard, significantly broadening its scope of applicability. Specifically, this research advances the patch division paradigm by introducing a novel extension: dynamic resolution with automatic patch configuration. It maintains the training image aspect ratios while automatically varying patch counts and configuring layouts based on a pre-trained Vision Transformer (ViT) (336 x 336), leading to dynamic training resolution from 336 pixels to 4K standard. Our research demonstrates that scaling training resolution up to 4K HD leads to consistent performance enhancements without hitting the ceiling of potential improvements. InternLM-XComposer2-4KHD shows superb capability that matches or even surpasses GPT-4V and Gemini Pro in 10 of the 16 benchmarks. The InternLM-XComposer2-4KHD model series with 7B parameters are publicly available at https://github.com/InternLM/InternLM-XComposer.


title: Superpolynomial Lower Bounds for Smooth 3-LCCs and Sharp Bounds for Designs

abstract: We give improved lower bounds for binary $3$-query locally correctable codes (3-LCCs) $C \colon \{0,1\}^k \rightarrow \{0,1\}^n$. Specifically, we prove: (1) If $C$ is a linear design 3-LCC, then $n \geq 2^{(1 - o(1))\sqrt{k} }$. A design 3-LCC has the additional property that the correcting sets for every codeword bit form a perfect matching and every pair of codeword bits is queried an equal number of times across all matchings. Our bound is tight up to a factor $\sqrt{8}$ in the exponent of $2$, as the best construction of binary $3$-LCCs (obtained by taking Reed-Muller codes on $\mathbb{F}_4$ and applying a natural projection map) is a design $3$-LCC with $n \leq 2^{\sqrt{8 k}}$. Up to a $\sqrt{8}$ factor, this resolves the Hamada conjecture on the maximum $\mathbb{F}_2$-codimension of a $4$-design. (2) If $C$ is a smooth, non-linear $3$-LCC with near-perfect completeness, then, $n \geq k^{\Omega(\log k)}$. (3) If $C$ is a smooth, non-linear $3$-LCC with completeness $1 - \varepsilon$, then $n \geq \tilde{\Omega}(k^{\frac{1}{2\varepsilon}})$. In particular, when $\varepsilon$ is a small constant, this implies a lower bound for general non-linear LCCs that beats the prior best $n \geq \tilde{\Omega}(k^3)$ lower bound of [AGKM23] by a polynomial factor. Our design LCC lower bound is obtained via a fine-grained analysis of the Kikuchi matrix method applied to a variant of the matrix used in [KM23]. Our lower bounds for non-linear codes are obtained by designing a from-scratch reduction from nonlinear $3$-LCCs to a system of "chain polynomial equations": polynomial equations with similar structure to the long chain derivations that arise in the lower bounds for linear $3$-LCCs [KM23].


title: Disentangling transitions in topological order induced by boundary decoherence

abstract: We study the entanglement structure of topological orders subject to decoherence on the bipartition boundary. Focusing on the toric codes in $d$ space dimensions for $d=2,3,4$, we explore whether the boundary decoherence may be able to induce a disentangling transition, characterized by the destruction of mixed-state long-range entanglement across the bipartition, measured by topological entanglement negativity. A key insight of our approach is the connection between the negativity spectrum of the decohered mixed states and emergent symmetry-protected topological orders under certain symmetry-preserving perturbation localized on the bipartition boundary. This insight allows us to analytically derive the exact results of entanglement negativity without using a replica trick.


title: Embedding-based comparison of reaction networks of Wnt signaling

abstract: This work introduces a new method for comparing two reaction networks of the same or closely related systems through their embedded networks in terms of the shared set of species. Hence, we call this method the Common Species Embedded Networks (CSEN) analysis. Using this approach, we conduct a comparison of existing reaction networks associated with Wnt signaling models (Lee, Schmitz, MacLean, and Feinberg) that we have identified. The analysis yields three important results for these Wnt models. First, the CSEN analysis of the Lee (mono-stationary) and Feinberg (multi-stationary) shows a strong similarity, justifying the study of the Feinberg model, which was a modified Lee model constructed to study an important network property called "concordance". It also challenge the absoluteness of discrimination of the models into mono-stationarity versus multi-stationarity, which is a main result of Maclean et al. (PNAS USA 2015). Second, the CSEN analysis provides evidence supporting a strong similarity between the Schmitz and MacLean models, as indicated by the "proximate equivalence" that we have identified. Third, the analysis underscores the absence of a comparable relationship between the Feinberg and MacLean models, highlighting distinctive differences between the two. Thus, our approach could be a useful tool to compare mathematical models of the same or closely related systems.


title: Convergence to Nash Equilibrium and No-regret Guarantee in (Markov) Potential Games

abstract: In this work, we study potential games and Markov potential games under stochastic cost and bandit feedback. We propose a variant of the Frank-Wolfe algorithm with sufficient exploration and recursive gradient estimation, which provably converges to the Nash equilibrium while attaining sublinear regret for each individual player. Our algorithm simultaneously achieves a Nash regret and a regret bound of $O(T^{4/5})$ for potential games, which matches the best available result, without using additional projection steps. Through carefully balancing the reuse of past samples and exploration of new samples, we then extend the results to Markov potential games and improve the best available Nash regret from $O(T^{5/6})$ to $O(T^{4/5})$. Moreover, our algorithm requires no knowledge of the game, such as the distribution mismatch coefficient, which provides more flexibility in its practical implementation. Experimental results corroborate our theoretical findings and underscore the practical effectiveness of our method.


title: DiffObs: Generative Diffusion for Global Forecasting of Satellite Observations

abstract: This work presents an autoregressive generative diffusion model (DiffObs) to predict the global evolution of daily precipitation, trained on a satellite observational product, and assessed with domain-specific diagnostics. The model is trained to probabilistically forecast day-ahead precipitation. Nonetheless, it is stable for multi-month rollouts, which reveal a qualitatively realistic superposition of convectively coupled wave modes in the tropics. Cross-spectral analysis confirms successful generation of low frequency variations associated with the Madden--Julian oscillation, which regulates most subseasonal to seasonal predictability in the observed atmosphere, and convectively coupled moist Kelvin waves with approximately correct dispersion relationships. Despite secondary issues and biases, the results affirm the potential for a next generation of global diffusion models trained on increasingly sparse, and increasingly direct and differentiated observations of the world, for practical applications in subseasonal and climate prediction.

categories: physics.comp-ph cs.CV cs.LG physics.ao-ph stat.ML


title: Light-by-light scattering in ultraperipheral collisions of heavy ions with future FoCal and ALICE 3 detectors

abstract: I present possible future studies of light-by-light scattering using FoCal@ALICE and ALICE 3 detectors. Different mechanisms are discussed. The PbPb$\to$PbPb$\gamma \gamma$ cross section is calculated within equivalent photon approximation in the impact parameter space. Several differential distributions are presented and discussed. We predict cross section in the (mb-b) range for typical ALICE 3 cuts, a few orders of magnitude larger than for the current ATLAS or CMS experiments. We also consider the two-$\pi^0$ background which can, in principle, be eliminated at the new kinematical range for the ALICE 3 measurements by imposing dedicated cuts on diphoton transverse momentum and$\slash$or so-called vector asymmetry.