title: Real phase structures on tropical manifolds and patchworks in higher codimension

abstract: This paper generalises the homeomorphism theorem behind Viro's combinatorial patchworking of hypersurfaces in toric varieties to arbitrary codimension using tropical geometry. We first define the patchwork of a polyhedral space equipped with a real phase structure. When the polyhedral subspace is tropically non-singular, we show that the patchwork is a topological manifold. When a non-singular tropical variety appears as a tropical limit of a real analytic family, we show that the real part of a fibre of the family near the tropical limit is homeomorphic to the patchwork. Finally we extend the spectral sequence introduced by the last two authors in the case of hypersurfaces to non-singular tropical varieties with real phase structures. As a corollary, we obtain bounds on the Betti numbers of the patchwork in terms of the dimensions of the tropical homology groups with coefficients modulo two.


title: Information Design for Congestion Games with Unknown Demand

abstract: We study a novel approach to information design in the standard traffic model of network congestion games. It captures the natural condition that the demand is unknown to the users of the network. A principal (e.g., a mobility service) commits to a signaling strategy, observes the realized demand and sends a (public) signal to agents (i.e., users of the network). Based on the induced belief about the demand, the users then form an equilibrium. We consider the algorithmic goal of the principal: Compute a signaling scheme that minimizes the expected total cost of the induced equilibrium. We concentrate on single-commodity networks and affine cost functions, for which we obtain the following results. First, we devise a fully polynomial-time approximation scheme (FPTAS) for the case that the demand can only take two values. It relies on several structural properties of the cost of the induced equilibrium as a function of the updated belief about the distribution of demands. We show that this function is piecewise linear for any number of demands, and monotonic for two demands. Second, we give a complete characterization of the graph structures for which it is optimal to fully reveal the information about the realized demand. This signaling scheme turns out to be optimal for all cost functions and probability distributions over demands if and only if the graph is series-parallel. Third, we propose an algorithm that computes the optimal signaling scheme for any number of demands whose time complexity is polynomial in the number of supports that occur in a Wardrop equilibrium for some demand. Finally, we conduct a computational study that tests this algorithm on real-world instances.


title: Fusion framework and multimodality for the Laplacian approximation of Bayesian neural networks

abstract: This paper considers the problem of sequential fusion of predictions from neural networks (NN) and fusion of predictions from multiple NN. This fusion strategy increases the robustness, i.e., reduces the impact of one incorrect classification and detection of outliers the \nn has not seen during training. This paper uses Laplacian approximation of Bayesian NNs (BNNs) to quantify the uncertainty necessary for fusion. Here, an extension is proposed such that the prediction of the NN can be represented by multimodal distributions. Regarding calibration of the estimated uncertainty in the prediction, the performance is significantly improved by having the flexibility to represent a multimodal distribution. Two class classical image classification tasks, i.e., MNIST and CFAR10, and image sequences from camera traps of carnivores in Swedish forests have been used to demonstrate the fusion strategies and proposed extension to the Laplacian approximation.


title: Extended target tracking utilizing machine-learning software -- with applications to animal classification

abstract: This paper considers the problem of detecting and tracking objects in a sequence of images. The problem is formulated in a filtering framework, using the output of object-detection algorithms as measurements. An extension to the filtering formulation is proposed that incorporates class information from the previous frame to robustify the classification, even if the object-detection algorithm outputs an incorrect prediction. Further, the properties of the object-detection algorithm are exploited to quantify the uncertainty of the bounding box detection in each frame. The complete filtering method is evaluated on camera trap images of the four large Swedish carnivores, bear, lynx, wolf, and wolverine. The experiments show that the class tracking formulation leads to a more robust classification.


title: Observation of the Quantum Zeno Effect on a NISQ Device

abstract: We study the Quantum Zeno Effect (QZE) on a single qubit on IBM Quantum Experience devices under the effect of multiple measurements. We consider two possible cases: the Rabi evolution and the free decay. In both cases we observe the occurrence of the QZE as an increasing of the survival probability with the number of measurements.


title: Band projections in spaces of regular operators

abstract: We introduce inner band projections in the space of regular operators on a Dedekind complete Banach lattice and study some structural properties of this class. In particular, we provide a new characterization of atomic order continuous Banach lattices as those for which all band projections in the corresponding space of regular operators are inner. We also characterize the multiplication operators $L_AR_B$ which are band projections precisely as those with $A,B$ being band projections up to a scalar multiple.


title: Fine-Tuning LLaMA for Multi-Stage Text Retrieval

abstract: The effectiveness of multi-stage text retrieval has been solidly demonstrated since before the era of pre-trained language models. However, most existing studies utilize models that predate recent advances in large language models (LLMs). This study seeks to explore potential improvements that state-of-the-art LLMs can bring. We conduct a comprehensive study, fine-tuning the latest LLaMA model both as a dense retriever (RepLLaMA) and as a pointwise reranker (RankLLaMA) for both passage retrieval and document retrieval using the MS MARCO datasets. Our findings demonstrate that the effectiveness of large language models indeed surpasses that of smaller models. Additionally, since LLMs can inherently handle longer contexts, they can represent entire documents holistically, obviating the need for traditional segmenting and pooling strategies. Furthermore, evaluations on BEIR demonstrate that our RepLLaMA-RankLLaMA pipeline exhibits strong zero-shot effectiveness. Model checkpoints from this study are available on HuggingFace.


title: Defending Our Privacy With Backdoors

abstract: The proliferation of large AI models trained on uncurated, often sensitive web-scraped data has raised significant privacy concerns. One of the concerns is that adversaries can extract information about the training data using privacy attacks. Unfortunately, the task of removing specific information from the models without sacrificing performance is not straightforward and has proven to be challenging. We propose a rather easy yet effective defense based on backdoor attacks to remove private information such as names and faces of individuals from vision-language models by fine-tuning them for only a few minutes instead of re-training them from scratch. Specifically, through strategic insertion of backdoors into text encoders, we align the embeddings of sensitive phrases with those of neutral terms-"a person" instead of the person's actual name. For image encoders, we map embeddings of individuals to be removed from the model to a universal, anonymous embedding. Our empirical results demonstrate the effectiveness of our backdoor-based defense on CLIP by assessing its performance using a specialized privacy attack for zero-shot classifiers. Our approach provides not only a new "dual-use" perspective on backdoor attacks, but also presents a promising avenue to enhance the privacy of individuals within models trained on uncurated web-scraped data.


title: Physical phase field model for phagocytosis

abstract: We propose and study a simple, physical model for phagocytosis, i.e. the active, actin-mediated uptake of micron-sized particles by biological cells. The cell is described by the phase field method and the driving mechanisms of uptake are actin ratcheting, modeled by a dynamic vector field, as well as cell-particle adhesion due to receptor-ligand binding. We first test the modeling framework for the symmetric situation of a spherical cell engulfing a fixed spherical particle. We then exemplify its versatility by studying various asymmetric situations like different particle shapes and orientations, as well as the simultaneous uptake of two particles. In addition, we perform a perturbation theory of a slightly modified model version in the symmetric setting, allowing to derive a reduced model, shedding light on the effective driving forces and being easier to solve. This work is meant as a first step in describing phagocytosis and we discuss several effects that are amenable to future modeling within the same framework.


title: A 3D Kinetic Distribution that Yields Observed Plasma Density in the Inner Van Allen Belt

abstract: A steady-state distribution is obtained that approximately yields the observed plasma density profile of the inner Van Allen radiation belt. The model assumes a collisionless, magnetized plasma with zero electric field present. The inner Van Allen belt consists of a plasma comprising high-energy protons and relativistic electrons. The particle trajectories are obtained from the collisionless Lorentz Force equation for different initial distributions. The resulting steady-state distributions obtained after particles lost to the loss cone are eliminated and are used to generate the density profile. The distribution's dependence on energy and magnetic moment is adjusted to make the density profile agree with observations. For a distribution that is a function of energy times a function of magnetic moment, the calculation leads to the desired type of density profile. The kinetic distribution and the type of density profile obtained are presented.

categories: physics.plasm-ph astro-ph.EP astro-ph.HE physics.comp-ph physics.geo-ph physics.space-ph


title: Robo Sapiens

abstract: This paper proposes a new method of natural language acquisition for robots that does not require the conversion of speech to text. Folks'Talks employs voice2voice technology that enables a robot to understand the meaning of what it is told and to have the ability to learn and understand new languages - inclusive of accent, dialect, and physiological differences. To do this, sound processing and computer vision are incorporated to give the robot a sense of spatiotemporal causality. The "language model" we are proposing equips a robot to imitate a natural speaker's conversational behavior by thinking contextually and articulating its surroundings.


title: Adding a constant and an axiom to a doctrine

abstract: We study the meaning of "adding a constant to a language" for any doctrine, and "adding an axiom to a theory" for a primary doctrine, by showing how these are actually two instances of the same construction. We prove their universal properties, and how these constructions are compatible with additional structure on the doctrine. Existence of Kleisli object for comonads in the 2-category of indexed poset is proved in order to build these constructions.


title: Self-injection-locked optical parametric oscillator based on microcombs

abstract: Narrow-linewidth yet tunable laser oscillators are one of the most important tools for precision metrology, optical atomic clocks, sensing and quantum computing. Commonly used tunable coherent oscillators are based on stimulated emission or stimulated Brillouin scattering; as a result, the operating wavelength band is limited by the gain media. Based on nonlinear optical gain, optical parametric oscillators (OPOs) enable coherent signal generation within the whole transparency window of the medium used. However, the demonstration of OPO-based Hertz-level linewidth and tunable oscillators has remained elusive. Here, we present a tunable coherent oscillator based on a multimode coherent OPO in a high-Q microresonator, i.e., a microcomb. Single-mode coherent oscillation is realized through self-injection locking (SIL) of one selected comb line. We achieve coarse tuning up to 20 nm, and an intrinsic linewidth down to sub-Hertz level, which is three orders of magnitude lower than the pump. Furthermore, we demonstrate that this scheme results into repetition rate stabilization of the microcomb. These results open exciting possibilities for generating tunable coherent radiation where stimulated emission materials are difficult to obtain, and the stabilization of microcomb sources beyond the limits imposed by the thermorefractive noise in the cavity.


title: NSM4D: Neural Scene Model Based Online 4D Point Cloud Sequence Understanding

abstract: Understanding 4D point cloud sequences online is of significant practical value in various scenarios such as VR/AR, robotics, and autonomous driving. The key goal is to continuously analyze the geometry and dynamics of a 3D scene as unstructured and redundant point cloud sequences arrive. And the main challenge is to effectively model the long-term history while keeping computational costs manageable. To tackle these challenges, we introduce a generic online 4D perception paradigm called NSM4D. NSM4D serves as a plug-and-play strategy that can be adapted to existing 4D backbones, significantly enhancing their online perception capabilities for both indoor and outdoor scenarios. To efficiently capture the redundant 4D history, we propose a neural scene model that factorizes geometry and motion information by constructing geometry tokens separately storing geometry and motion features. Exploiting the history becomes as straightforward as querying the neural scene model. As the sequence progresses, the neural scene model dynamically deforms to align with new observations, effectively providing the historical context and updating itself with the new observations. By employing token representation, NSM4D also exhibits robustness to low-level sensor noise and maintains a compact size through a geometric sampling scheme. We integrate NSM4D with state-of-the-art 4D perception backbones, demonstrating significant improvements on various online perception benchmarks in indoor and outdoor settings. Notably, we achieve a 9.6% accuracy improvement for HOI4D online action segmentation and a 3.4% mIoU improvement for SemanticKITTI online semantic segmentation. Furthermore, we show that NSM4D inherently offers excellent scalability to longer sequences beyond the training set, which is crucial for real-world applications.


title: Z3-Noodler: An Automata-based String Solver (Technical Report)

abstract: Z3-Noodler is a fork of Z3 that replaces its string theory solver with a custom solver implementing the recently introduced stabilization-based algorithm for solving word equations with regular constraints. An extensive experimental evaluation shows that Z3-Noodler is a fully-fledged solver that can compete with state-of-the-art solvers, surpassing them by far on many benchmarks. Moreover, it is often complementary to other solvers, making it a suitable choice as a candidate to a solver portfolio.


title: Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Prediction

abstract: As a core technology of Intelligent Transportation System (ITS), traffic flow prediction has a wide range of applications. Traffic flow data are spatial-temporal, which are not only correlated to spatial locations in road networks, but also vary with temporal time indices. Existing methods have solved the challenges in traffic flow prediction partly, focusing on modeling spatial-temporal dependencies effectively, while not all intrinsic properties of traffic flow data are utilized fully. Besides, there are very few attempts at incremental learning of spatial-temporal data mining, and few previous works can be easily transferred to the traffic flow prediction task. Motivated by the challenge of incremental learning methods for traffic flow prediction and the underutilization of intrinsic properties of road networks, we propose a Transport-Hub-aware Spatial-Temporal adaptive graph transFormer (H-STFormer) for traffic flow prediction. Specifically, we first design a novel spatial self-attention module to capture the dynamic spatial dependencies. Three graph masking matrices are integrated into spatial self-attentions to highlight both short- and long-term dependences. Additionally, we employ a temporal self-attention module to detect dynamic temporal patterns in the traffic flow data. Finally, we design an extra spatial-temporal knowledge distillation module for incremental learning of traffic flow prediction tasks. Through extensive experiments, we show the effectiveness of H-STFormer in normal and incremental traffic flow prediction tasks. The code is available at https://github.com/Fantasy-Shaw/H-STFormer.


title: Odometers, Backward continued fractions and counting rationals

abstract: It has been more than twenty years since Moshe Newman, based on work by Neil Calkin and Herbert Wilf, introduced an explicit bijection between the rational and natural numbers. Interestingly, this bijection is dynamic in nature. Indeed, Newman's map has the property that the orbit of zero provides the required bijection. Claudio Bonanno and Stefano Isola, using continued fractions expansions, described the dynamics of its first return time map T. They proved that it is topologically conjugated to the dyadic odometer. In this article, we prove that the correct numerical system needed to analyze this map is the backward continued fractions. Indeed, this approach has the advantage that it provides explicitly the action of T on the expansion. As a by-product, we naturally obtain an explicit formula for Minkowski's question mark function in terms of backward continued fractions. The whole point of Newman was to provide an explicit bijection, our approach shares the same taste for the explicit.


title: Control of ion-photoelectron entanglement and coherence via Rabi oscillations

abstract: We report a theoretical investigation of photoionization by a pair of coherent, ultrashort fundamental and second-harmonic extreme-ultraviolet pulses, where the photon energies are selected to yield the same photoelectron energy for ionization of two different sub-shells. This choice implies that the fundamental energy is equal to the difference in energy of the ionic states, and they are therefore coupled by the fundamental photon. By deriving analytical expressions using the essential-states approach, we show that this Rabi coupling creates coherence between the two photoelectron wave packets, which would otherwise be incoherent. We analyze how the coupling is affected by the parameters such as relative phase, pulse width, delay between the two pulses, the Rabi coupling strength, and photoelectron energy. Our discussion mostly considers Ne 2p and 2s photoionization, but it is generally valid for many other quantum systems where photoionization from two different shells is observed.


title: Dealing with uncertainty: balancing exploration and exploitation in deep recurrent reinforcement learning

abstract: Incomplete knowledge of the environment leads an agent to make decisions under uncertainty. One of the major dilemmas in Reinforcement Learning (RL) where an autonomous agent has to balance two contrasting needs in making its decisions is: exploiting the current knowledge of the environment to maximize the cumulative reward as well as exploring actions that allow improving the knowledge of the environment, hopefully leading to higher reward values (exploration-exploitation trade-off). Concurrently, another relevant issue regards the full observability of the states, which may not be assumed in all applications. For instance, when 2D images are considered as input in an RL approach used for finding the best actions within a 3D simulation environment. In this work, we address these issues by deploying and testing several techniques to balance exploration and exploitation trade-off on partially observable systems for predicting steering wheels in autonomous driving scenarios. More precisely, the final aim is to investigate the effects of using both adaptive and deterministic exploration strategies coupled with a Deep Recurrent Q-Network. Additionally, we adapted and evaluated the impact of a modified quadratic loss function to improve the learning phase of the underlying Convolutional Recurrent Neural Network. We show that adaptive methods better approximate the trade-off between exploration and exploitation and, in general, Softmax and Max-Boltzmann strategies outperform epsilon-greedy techniques.


title: Real-Time Neural BRDF with Spherically Distributed Primitives

abstract: We propose a novel compact and efficient neural BRDF offering highly versatile material representation, yet with very-light memory and neural computation consumption towards achieving real-time rendering. The results in Figure 1, rendered at full HD resolution on a current desktop machine, show that our system achieves real-time rendering with a wide variety of appearances, which is approached by the following two designs. On the one hand, noting that bidirectional reflectance is distributed in a very sparse high-dimensional subspace, we propose to project the BRDF into two low-dimensional components, i.e., two hemisphere feature-grids for incoming and outgoing directions, respectively. On the other hand, learnable neural reflectance primitives are distributed on our highly-tailored spherical surface grid, which offer informative features for each component and alleviate the conventional heavy feature learning network to a much smaller one, leading to very fast evaluation. These primitives are centrally stored in a codebook and can be shared across multiple grids and even across materials, based on the low-cost indices stored in material-specific spherical surface grids. Our neural BRDF, which is agnostic to the material, provides a unified framework that can represent a variety of materials in consistent manner. Comprehensive experimental results on measured BRDF compression, Monte Carlo simulated BRDF acceleration, and extension to spatially varying effect demonstrate the superior quality and generalizability achieved by the proposed scheme.


title: GeNIOS: an (almost) second-order operator-splitting solver for large-scale convex optimization

abstract: We introduce the GEneralized Newton Inexact Operator Splitting solver (GeNIOS) for large-scale convex optimization. GeNIOS speeds up ADMM by approximately solving approximate subproblems: it uses a second-order approximation to the most challenging ADMM subproblem and solves it inexactly with a fast randomized solver. Despite these approximations, GeNIOS retains the convergence rate of classic ADMM and can detect primal and dual infeasibility from the algorithm iterates. At each iteration, the algorithm solves a positive-definite linear system that arises from a second-order approximation of the first subproblem and computes an approximate proximal operator. GeNIOS solves the linear system using an indirect solver with a randomized preconditioner, making it particularly useful for large-scale problems with dense data. Our high-performance open-source implementation in Julia allows users to specify convex optimization problems directly (with or without conic reformulation) and allows extensive customization. We illustrate GeNIOS's performance on a variety of problem types. Notably, GeNIOS is more than ten times faster than existing solvers on large-scale, dense problems.


title: Topological analysis of U.S. city demographics

abstract: We apply persistent homology, the main method in topological data analysis, to the study of demographic data. Persistence diagrams efficiently summarize information about clusters or peaks in a region's demographic data. To illustrate how persistence diagrams can be used for exploratory analysis, we undertake a study of the 100 largest U.S.~cities and their Black and Hispanic populations. We use our method to find clusters in individual cities, determine which cities are outliers and why, measure and describe change in demographic patterns over time, and roughly categorize cities into distinct groups based on the topology of their demographics. Along the way, we highlight the advantages and disadvantages of persistence diagrams as a tool for analyzing geospatial data.


title: 2SFGL: A Simple And Robust Protocol For Graph-Based Fraud Detection

abstract: Financial crime detection using graph learning improves financial safety and efficiency. However, criminals may commit financial crimes across different institutions to avoid detection, which increases the difficulty of detection for financial institutions which use local data for graph learning. As most financial institutions are subject to strict regulations in regards to data privacy protection, the training data is often isolated and conventional learning technology cannot handle the problem. Federated learning (FL) allows multiple institutions to train a model without revealing their datasets to each other, hence ensuring data privacy protection. In this paper, we proposes a novel two-stage approach to federated graph learning (2SFGL): The first stage of 2SFGL involves the virtual fusion of multiparty graphs, and the second involves model training and inference on the virtual graph. We evaluate our framework on a conventional fraud detection task based on the FraudAmazonDataset and FraudYelpDataset. Experimental results show that integrating and applying a GCN (Graph Convolutional Network) with our 2SFGL framework to the same task results in a 17.6\%-30.2\% increase in performance on several typical metrics compared to the case only using FedAvg, while integrating GraphSAGE with 2SFGL results in a 6\%-16.2\% increase in performance compared to the case only using FedAvg. We conclude that our proposed framework is a robust and simple protocol which can be simply integrated to pre-existing graph-based fraud detection methods.


title: Thermodynamics of Growth in Open Chemical Reaction Networks

abstract: We identify the thermodynamic conditions necessary to observe indefinite growth in homogeneous open chemical reaction networks (CRNs) satisfying mass action kinetics. We also characterize the thermodynamic efficiency of growth by considering the fraction of the chemical work supplied from the surroundings that is converted into CRN free energy. We find that indefinite growth cannot arise in CRNs chemostatted by fixing the concentration of some species at constant values, or in continuous-flow stirred tank reactors. Indefinite growth requires a constant net influx from the surroundings of at least one species. In this case, unimolecular CRNs always generate equilibrium linear growth, i.e., a continuous linear accumulation of species with equilibrium concentrations and efficiency one. Multimolecular CRNs are necessary to generate nonequilibrium growth, i.e., the continuous accumulation of species with nonequilibrium concentrations. Pseudo-unimolecular CRNs - a subclass of multimolecular CRNs - always generate asymptotic linear growth with zero efficiency. Our findings demonstrate the importance of the CRN topology and the chemostatting procedure in determining the dynamics and thermodynamics of growth.


title: Neural Diffusion Models

abstract: Diffusion models have shown remarkable performance on many generative tasks. Despite recent success, most diffusion models are restricted in that they only allow linear transformation of the data distribution. In contrast, broader family of transformations can potentially help train generative distributions more efficiently, simplifying the reverse process and closing the gap between the true negative log-likelihood and the variational approximation. In this paper, we present Neural Diffusion Models (NDMs), a generalization of conventional diffusion models that enables defining and learning time-dependent non-linear transformations of data. We show how to optimise NDMs using a variational bound in a simulation-free setting. Moreover, we derive a time-continuous formulation of NDMs, which allows fast and reliable inference using off-the-shelf numerical ODE and SDE solvers. Finally, we demonstrate the utility of NDMs with learnable transformations through experiments on standard image generation benchmarks, including CIFAR-10, downsampled versions of ImageNet and CelebA-HQ. NDMs outperform conventional diffusion models in terms of likelihood and produce high-quality samples.


title: A cry for help: Early detection of brain injury in newborns

abstract: Since the 1960s, neonatal clinicians have known that newborns suffering from certain neurological conditions exhibit altered crying patterns such as the high-pitched cry in birth asphyxia. Despite an annual burden of over 1.5 million infant deaths and disabilities, early detection of neonatal brain injuries due to asphyxia remains a challenge, particularly in developing countries where the majority of births are not attended by a trained physician. Here we report on the first inter-continental clinical study to demonstrate that neonatal brain injury can be reliably determined from recorded infant cries using an AI algorithm we call Roseline. Previous and recent work has been limited by the lack of a large, high-quality clinical database of cry recordings, constraining the application of state-of-the-art machine learning. We develop a new training methodology for audio-based pathology detection models and evaluate this system on a large database of newborn cry sounds acquired from geographically diverse settings -- 5 hospitals across 3 continents. Our system extracts interpretable acoustic biomarkers that support clinical decisions and is able to accurately detect neurological injury from newborns' cries with an AUC of 92.5% (88.7% sensitivity at 80% specificity). Cry-based neurological monitoring opens the door for low-cost, easy-to-use, non-invasive and contact-free screening of at-risk babies, especially when integrated into simple devices like smartphones or neonatal ICU monitors. This would provide a reliable tool where there are no alternatives, but also curtail the need to regularly exert newborns to physically-exhausting or radiation-exposing assessments such as brain CT scans. This work sets the stage for embracing the infant cry as a vital sign and indicates the potential of AI-driven sound monitoring for the future of affordable healthcare.


title: TTK is Getting MPI-Ready

abstract: This system paper documents the technical foundations for the extension of the Topology ToolKit (TTK) to distributed-memory parallelism with the Message Passing Interface (MPI). While several recent papers introduced topology-based approaches for distributed-memory environments, these were reporting experiments obtained with tailored, mono-algorithm implementations. In contrast, we describe in this paper a versatile approach (supporting both triangulated domains and regular grids) for the support of topological analysis pipelines, i.e. a sequence of topological algorithms interacting together. While developing this extension, we faced several algorithmic and software engineering challenges, which we document in this paper. We describe an MPI extension of TTK's data structure for triangulation representation and traversal, a central component to the global performance and generality of TTK's topological implementations. We also introduce an intermediate interface between TTK and MPI, both at the global pipeline level, and at the fine-grain algorithmic level. We provide a taxonomy for the distributed-memory topological algorithms supported by TTK, depending on their communication needs and provide examples of hybrid MPI+thread parallelizations. Performance analyses show that parallel efficiencies range from 20% to 80% (depending on the algorithms), and that the MPI-specific preconditioning introduced by our framework induces a negligible computation time overhead. We illustrate the new distributed-memory capabilities of TTK with an example of advanced analysis pipeline, combining multiple algorithms, run on the largest publicly available dataset we have found (120 billion vertices) on a cluster with 64 nodes (for a total of 1536 cores). Finally, we provide a roadmap for the completion of TTK's MPI extension, along with generic recommendations for each algorithm communication category.


title: Discrete approximation of reflected Brownian motions by Markov chains on partitions of domains

abstract: In this paper, we study discrete approximation of reflected Brownian motions on domains in Euclidean space. Our approximation is given by a sequence of Markov chains on partitions of the domain, where we allow uneven or random partitions. We provide sufficient conditions for the weak convergence of the Markov chains.


title: Light-Induced Nonthermal Phase Transition to the Topological Crystalline Insulator State in SnSe

abstract: Femtosecond pulses have been used to reveal hidden broken symmetry states and induce transitions to metastable states. However, these states are mostly transient and disappear after laser removal. Photoinduced phase transitions towards crystalline metastable states with a change of topological order are rare and difficult to predict and realize experimentally. Here, by using constrained density functional perturbation theory and accounting for light-induced quantum anharmonicity, we show that ultra-fast lasers can permanently transform the topologically-trivial orthorhombic structure of SnSe into the topological crystalline insulating rocksalt phase via a first-order non-thermal phase transition. We describe the reaction path and evaluate the critical fluence and the possible decay channels after photoexcitation. Our simulations of the photoexcited structural and vibrational properties are in excellent agreement with recent pump-probe data in the intermediate fluence regime below the transition with an error on the curvature of the quantum free energy of the photoexcited state that is smaller than 2%.


title: Discontinuous Galerkin approximations of the heterodimer model for protein-protein interaction

abstract: Mathematical models of protein-protein dynamics, such as the heterodimer model, play a crucial role in understanding many physical phenomena. This model is a system of two semilinear parabolic partial differential equations describing the evolution and mutual interaction of biological species. An example is the neurodegenerative disease progression in some significant pathologies, such as Alzheimer's and Parkinson's diseases, characterized by the accumulation and propagation of toxic prionic proteins. This article presents and analyzes a flexible high-order discretization method for the numerical approximation of the heterodimer model. We propose a space discretization based on a Discontinuous Galerkin method on polygonal/polyhedral grids, which provides flexibility in handling complex geometries. Concerning the semi-discrete formulation, we prove stability and a-priori error estimates for the first time. Next, we adopt a $\theta$-method scheme as a time integration scheme. Convergence tests are carried out to demonstrate the theoretical bounds and the ability of the method to approximate traveling wave solutions, considering also complex geometries such as brain sections reconstructed from medical images. Finally, the proposed scheme is tested in a practical test case stemming from neuroscience applications, namely the simulation of the spread of $\alpha$-synuclein in a realistic test case of Parkinson's disease in a two-dimensional sagittal brain section geometry reconstructed from medical images.


title: Bootstrapping Deconfined Quantum Tricriticality

abstract: The paradigmatic example of deconfined quantum criticality is the Neel-VBS phase transition. The continuum description of this transition is the $N=2$ case of the $CP^{N-1}$ model, which is a field theory of $N$ complex scalars in 3d coupled to an Abelian gauge field with $SU(N)\times U(1)$ global symmetry. Lattice studies and duality arguments suggest the global symmetry of the $CP^1$ model is enhanced to $SO(5)$. We perform a conformal bootstrap study of $SO(5)$ invariant fixed points with one relevant $SO(5)$ singlet operator, which would correspond to two relevant $SU(2)\times U(1)$ singlets, i.e. a tricritical point. We find that the bootstrap bounds are saturated by four different predictions from the large $N$ computation of monopole operator scaling dimensions, which were recently shown to be very accurate even for small $N$. This suggests that the Neel-VBS phase transition is described by this bootstrap bound, which predicts that the second relevant singlet has dimension $\approx 2.36$.


title: LeXInt: GPU-accelerated Exponential Integrators package

abstract: We present an open-source CUDA-based package that consists of a compilation of exponential integrators where the action of the matrix exponential or the $\varphi_l$ functions on a vector is approximated using the method of polynomial interpolation at Leja points. Using a couple of test examples on an NVIDIA A100 GPU, we show that one can achieve significant speedups using CUDA over the corresponding CPU code. LeXInt, written in a modular format, facilitates easy integration into any existing software package, and can be used for temporal integration of any differential equation.

categories: math.NA astro-ph.IM cs.NA math-ph math.MP physics.comp-ph


title: Characterizing the Conditions for Indefinite Growth in Open Chemical Reaction Networks

abstract: The thermodynamic and dynamical conditions necessary to observe indefinite growth in homogeneous open chemical reaction networks (CRNs) satisfying mass action kinetics were presented in Srinivas et al. (2023): Unimolecular CRNs can only accumulate equilibrium concentrations of species while multimolecular CRNs are needed to produce indefinite growth with nonequilibrium concentrations. Within multimolecular CRNs, pseudo-unimolecular CRNs produce nonequilibrium concentrations with zero efficiencies. Nonequilibrium growth with finite efficiencies requires dynamically nonlinear CRNs. In this paper, we provide a detailed analysis supporting these results. Mathematical proofs are provided for growth in unimolecular and pseudo-unimolecular CRNs. For multimolecular CRNs, four models displaying very distinctive topological properties are extensively studied, both numerically and partly analytically.


title: Non-piecewise hereditary Nakayama algebras

abstract: Happel and Seidel gave a classification of piecewise hereditary Nakayama algebras, where the relations are given by some power of the radical. Here we explore what happens for general relations. We develop techniques for showing that a given algebra is not piecewise hereditary, illustrating them on numerous mid-sized examples. Then we observe cases where the property of being non-piecewise hereditary can be extended to other (larger) Nakayama algebras. While a complete classification remains elusive, we are able to identify two types of patterns of relations preventing piecewise heredity, indicating that for large quivers many Nakayama algebras are non-piecewise hereditary.


title: Geometrical and maximal u-entropy measure-theoretic structures of maps with c-mostly expanding center and c-mostly contracting

abstract: In this paper, we classified ergodic maximal $u$-entropy measures among the set of partially hyperbolic diffeomorphisms with $(E^{uu},A)$-Markov partition, $c$-mostly contracting center and $c$-mostly expanding center in the $C^1$-topology. More specifically, ergodic maximal $u$-entropy measures can be divided into $c$-$u$-states and $c$-$cu$-states. Due to the existence of $c$-mostly expanding center, ergodic maximal $u$-entropy measures of type $c$-$u$-states are trivial. For ergodic maximal $u$-entropy measures of type $c$-$cu$-states, by noting that its structure is similar to that of physical measures, with the help of the skeleton we obtain their properties of supports and basins, and variation of number in some sense. Consequently, the ergodic measures of maximal $u$-entropy of type $c$-$cu$-states are finite in the sense that the measure supports are consistent. On the certain environment, union of the basins of ergodic measures of maximal $u$-entropy of type $c$-$cu$-states is dense in whole space and number of $c$-$cu$-state is upper semicontinuous in the sense of support. Finally, we provide propositions for qualitative construction examples, which also explains that there are many such examples here.


title: LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision Scenarios

abstract: Building agents based on tree-search planning capabilities with learned models has achieved remarkable success in classic decision-making problems, such as Go and Atari. However, it has been deemed challenging or even infeasible to extend Monte Carlo Tree Search (MCTS) based algorithms to diverse real-world applications, especially when these environments involve complex action spaces and significant simulation costs, or inherent stochasticity. In this work, we introduce LightZero, the first unified benchmark for deploying MCTS/MuZero in general sequential decision scenarios. Specificially, we summarize the most critical challenges in designing a general MCTS-style decision-making solver, then decompose the tightly-coupled algorithm and system design of tree-search RL methods into distinct sub-modules. By incorporating more appropriate exploration and optimization strategies, we can significantly enhance these sub-modules and construct powerful LightZero agents to tackle tasks across a wide range of domains, such as board games, Atari, MuJoCo, MiniGrid and GoBigger. Detailed benchmark results reveal the significant potential of such methods in building scalable and efficient decision intelligence. The code is available as part of OpenDILab at https://github.com/opendilab/LightZero.


title: Performativity and Prospective Fairness

abstract: Deploying an algorithmically informed policy is a significant intervention in the structure of society. As is increasingly acknowledged, predictive algorithms have performative effects: using them can shift the distribution of social outcomes away from the one on which the algorithms were trained. Algorithmic fairness research is usually motivated by the worry that these performative effects will exacerbate the structural inequalities that gave rise to the training data. However, standard retrospective fairness methodologies are ill-suited to predict these effects. They impose static fairness constraints that hold after the predictive algorithm is trained, but before it is deployed and, therefore, before performative effects have had a chance to kick in. However, satisfying static fairness criteria after training is not sufficient to avoid exacerbating inequality after deployment. Addressing the fundamental worry that motivates algorithmic fairness requires explicitly comparing the change in relevant structural inequalities before and after deployment. We propose a prospective methodology for estimating this post-deployment change from pre-deployment data and knowledge about the algorithmic policy. That requires a strategy for distinguishing between, and accounting for, different kinds of performative effects. In this paper, we focus on the algorithmic effect on the causally downstream outcome variable. Throughout, we are guided by an application from public administration: the use of algorithms to (1) predict who among the recently unemployed will stay unemployed for the long term and (2) targeting them with labor market programs. We illustrate our proposal by showing how to predict whether such policies will exacerbate gender inequalities in the labor market.


title: ALPHA: Attention-based Long-horizon Pathfinding in Highly-structured Areas

abstract: The multi-agent pathfinding (MAPF) problem seeks collision-free paths for a team of agents from their current positions to their pre-set goals in a known environment, and is an essential problem found at the core of many logistics, transportation, and general robotics applications. Existing learning-based MAPF approaches typically only let each agent make decisions based on a limited field-of-view (FOV) around its position, as a natural means to fix the input dimensions of its policy network. However, this often makes policies short-sighted, since agents lack the ability to perceive and plan for obstacles/agents beyond their FOV. To address this challenge, we propose ALPHA, a new framework combining the use of ground truth proximal (local) information and fuzzy distal (global) information to let agents sequence local decisions based on the full current state of the system, and avoid such myopicity. We further allow agents to make short-term predictions about each others' paths, as a means to reason about each others' path intentions, thereby enhancing the level of cooperation among agents at the whole system level. Our neural structure relies on a Graph Transformer architecture to allow agents to selectively combine these different sources of information and reason about their inter-dependencies at different spatial scales. Our simulation experiments demonstrate that ALPHA outperforms both globally-guided MAPF solvers and communication-learning based ones, showcasing its potential towards scalability in realistic deployments.


title: Direct observation and control of near-field radiative energy transfer in a natural hyperbolic material

abstract: Heat control is a key issue in nano-electronics, where new efficient energy transfer mechanisms are highly sought after. In this respect, there is indirect evidence that high-mobility hexagonal boron nitride (hBN)-encapsulated graphene exhibits hyperbolic out-of-plane radiative energy transfer when driven out-of-equilibrium. Here we directly observe radiative energy transfer due to the hyperbolic phonon polaritons modes of the hBN encapsulant in intrinsic graphene devices under large bias, using mid-infrared spectroscopy and pyrometry. By using different hBN crystals of varied crystalline quality, we engineer the energy transfer efficiency, a key asset for compact thermal management of electronic circuits.


title: Spectral deferred correction methods for second-order problems

abstract: Spectral deferred corrections (SDC) are a class of iterative methods for the numerical solution of ordinary differential equations. SDC can be interpreted as a Picard iteration to solve a fully implicit collocation problem, preconditioned with a low-order method. It has been widely studied for first-order problems, using explicit, implicit or implicit-explicit Euler and other low-order methods as preconditioner. For first-order problems, SDC achieves arbitrary order of accuracy and possesses good stability properties. While numerical results for SDC applied to the second-order Lorentz equations exist, no theoretical results are available for SDC applied to second-order problems. We present an analysis of the convergence and stability properties of SDC using velocity-Verlet as the base method for general second-order initial value problems. Our analysis proves that the order of convergence depends on whether the force in the system depends on the velocity. We also demonstrate that the SDC iteration is stable under certain conditions. Finally, we show that SDC can be computationally more efficient than a simple Picard iteration or a fourth-order Runge-Kutta-Nystr\"om method.


title: There are different shades of green: heterogeneous environmental innovations and their effects on firm performance

abstract: Using a firm-level dataset from the Spanish Technological Innovation Panel (2003-2016), this study explores the characteristics of environmentally innovative firms and quantifies the effects of pursuing different types of environmental innovation strategies (resource-saving, pollution-reducing, and regulation-driven innovations) on sales, employment, and productivity dynamics.


title: Nonlinear magnetic buoyancy instability and turbulent dynamo

abstract: Stratified disks with strong horizontal magnetic fields are susceptible to magnetic buoyancy instability (MBI). Modifying the magnetic field and gas distributions, this can play an important role in galactic evolution. The MBI and the Parker instability, in which cosmic rays exacerbate MBI, are often studied using an imposed magnetic field. However, in galaxies and accretion discs, the magnetic field is continuously replenished by a large-scale dynamo action. Using non-ideal MHD equations, we model a section of the galactic disc (we neglect rotation and cosmic rays considered elsewhere), in which the large-scale field is generated by an imposed $\alpha$-effect of variable intensity to explore the interplay between dynamo instability and MBI. The system evolves through three distinct phases: the linear (kinematic) dynamo stage, the onset of linear MBI when the magnetic field becomes sufficiently strong and the nonlinear, statistically steady state. Nonlinear effects associated with the MBI introduce oscillations which do not occur when the field is produced by the dynamo alone. The MBI initially accelerates the magnetic field amplification but the growth is quenched by the vertical motions produced by MBI. We construct a 1D model, which replicates all significant features of 3D simulations to confirm that magnetic buoyancy alone can quench the dynamo and is responsible for the magnetic field oscillations. Unlike with an imposed magnetic field (arXiv:2305.03318,arXiv:2212.03215), the nonlinear interactions do not reduce the gas scale height, so the consequences of the magnetic buoyancy depend on how the magnetic field is maintained.


title: Generation and analysis of fractional Hankel-Bessel vortex beams via computational holography

abstract: In this work, the experimental optical generation of the fractional Hankel-Bessel vortex beams were investigated through the holographic technique by means of computer generated holograms (CGHs) and reproduced in a spatial light modulator (SLMs). The intensity and phase profiles were simulated and the experimental results are presented in this work, as well as their propagation along the z-axis is demonstrated. The experimental results are in accordance with the theoretical predictions described in the theory and literature. These results presents excellent perspectives of this optical vortex and potential applications in optical manipulation, optical microscopy and optics communications, optical metrology, among others.


title: A new local and explicit kinetic method for linear and non-linear convection-diffusion problems with finite kinetic speeds: I. One-dimensional case

abstract: We propose a numerical approach, of the BGK kinetic type, that is able to approximate with a given, but arbitrary, order of accuracy the solution of linear and non-linear convection-diffusion type problems: scalar advection-diffusion, non-linear scalar problems of this type and the compressible Navier-Stokes equations. Our kinetic model can use \emph{finite} advection speeds that are independent of the relaxation parameter, and the time step does not suffer from a parabolic constraint. Having finite speeds is in contrast with many of the previous works about this kind of approach, and we explain why this is possible: paraphrasing more or less \cite{golse:hal-00859451}, the convection-diffusion like PDE is not a limit of the BGK equation, but a correction of the same PDE without the parabolic term at the second order in the relaxation parameter that is interpreted as Knudsen number. We then show that introducing a matrix collision instead of the well-known BGK relaxation makes it possible to target a desired convection-diffusion system. Several numerical examples, ranging from a simple pure diffusion model to the compressible Navier-Stokes equations illustrate our approach


title: Difference of Hilbert series of homogeneous monoid algebras and their normalizations

abstract: Let $Q$ be an affine monoid, $\Bbbk[Q]$ the associated monoid $\Bbbk$-algebra, and $\Bbbk[\overline{Q}]$ its normalization, where we let $\Bbbk$ be a field. In this paper, in the case where $\Bbbk[Q]$ is homogeneous (i.e., standard graded), a difference of the Hilbert series of $\Bbbk[Q]$ and $\Bbbk[\overline{Q}]$ is discussed. More precisely, we prove that if $\Bbbk[Q]$ satisfies Serre's condition $(S_2)$, then the degree of the $h$-polynomial of $\Bbbk[Q]$ is always greater than or equal to that of $\Bbbk[\overline{Q}]$. Moreover, we also show counterexamples of this statement if we drop the assumption $(S_2)$.


title: Towards Demystifying the Generalization Behaviors When Neural Collapse Emerges

abstract: Neural Collapse (NC) is a well-known phenomenon of deep neural networks in the terminal phase of training (TPT). It is characterized by the collapse of features and classifier into a symmetrical structure, known as simplex equiangular tight frame (ETF). While there have been extensive studies on optimization characteristics showing the global optimality of neural collapse, little research has been done on the generalization behaviors during the occurrence of NC. Particularly, the important phenomenon of generalization improvement during TPT has been remaining in an empirical observation and lacking rigorous theoretical explanation. In this paper, we establish the connection between the minimization of CE and a multi-class SVM during TPT, and then derive a multi-class margin generalization bound, which provides a theoretical explanation for why continuing training can still lead to accuracy improvement on test set, even after the train accuracy has reached 100%. Additionally, our further theoretical results indicate that different alignment between labels and features in a simplex ETF can result in varying degrees of generalization improvement, despite all models reaching NC and demonstrating similar optimization performance on train set. We refer to this newly discovered property as "non-conservative generalization". In experiments, we also provide empirical observations to verify the indications suggested by our theoretical results.


title: Bounds on the Spreading Radius in Droplet Impact: The Inviscid Case

abstract: We consider the classical problem of droplet impact and droplet spread on a smooth surface in the case of an ideal inviscid fluid. We revisit the rim-lamella model of Roisman et al. [\textit{Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences}, 458(2022), pp.1411-1430.]. This model comprises a system of ordinary differential equations (ODEs); we present a rigorous theoretical analysis of these ODEs, and derive upper and lower bounds for the maximum spreading radius. Both bounds possess a $\mathrm{We}^{1/2}$ scaling behaviour, and by a sandwich result, the spreading radius itself also possesses this scaling. We demonstrate rigorously that the rim-lamella model is self-consistent: once a rim forms, its height will invariably exceed that of the lamella. We introduce a rational procedure to obtain initial conditions for the rim-lamella model. Our approach to solving the rim-lamella model gives predictions for the maximum droplet spread that are in close agreement with existing experimental studies and direct numerical simulations.


title: A planetary collision afterglow and transit of the resultant debris cloud

abstract: Planets grow in rotating disks of dust and gas around forming stars, some of which can subsequently collide in giant impacts after the gas component is removed from the disk. Monitoring programs with the warm Spitzer mission have recorded significant and rapid changes in mid-infrared output for several stars, interpreted as variations in the surface area of warm dusty material ejected by planetary-scale collisions and heated by the central star: e.g., NGC 2354-ID8, HD 166191 and V844 Persei. Here we report combined observations of the young (about 300 Myr), solar-like star ASASSN-21qj: an infrared brightening consistent with a blackbody temperature of 1000 K and a luminosity of 4 percent of that of the star lasting for about 1000 days, partially overlapping in time with a complex and deep wavelength-dependent optical eclipse that lasted for about 500 days. The optical eclipse started 2.5 years after the infrared brightening, implying an orbital period of at least that duration. These observations are consistent with a collision between two exoplanets of several to tens of Earth masses at 2 to 16 au from the central star. Such an impact produces a hot, highly-extended post-impact remnant with sufficient luminosity to explain the infrared observations. Transit of the impact debris, sheared by orbital motion into a long cloud, causes the subsequent complex eclipse of the host star.


title: Would you trust a vehicle merging into your lane? Subjective evaluation of negotiating behaviour in a congested merging scenario

abstract: Aiming for a society where humans and automated vehicles can coexist cooperatively, understanding what constitutes cooperative and trustworthy behaviour is essential to designing automated vehicle controllers that enable the integration of highly automated vehicles into the real world. This study investigates how merging vehicles can gain trust from human-driven vehicles in a congested merging situation that requires explicit and implicit communication. Specifically, this study examines how the different behaviours of merging vehicles in the preparatory phase of the merge affect perceived trust from the perspective of the host vehicle in the mainstream lane. The findings suggest that transparent longitudinal positioning could improve the chance of successful merging, and cooperative deceleration during merging preparation could enhance the trust perceived by the host vehicle. Furthermore, the results reveal that, in time-sensitive situations where the merging vehicle approaches a lane closing point, prompt and decisive action of the merging vehicle encourages establishing trust with the host vehicle; any delay or hesitation can result in a lower level of trust. The results can provide valuable insights towards developing collaborative automated vehicles that improve safety and efficiency in real-world traffic situations that involve humans.


title: Multi-Value Alignment in Normative Multi-Agent System: An Evolutionary Optimisation Approach

abstract: Value-alignment in normative multi-agent systems is used to promote a certain value and to ensure the consistent behaviour of agents in autonomous intelligent systems with human values. However, the current literature is limited to the incorporation of effective norms for single-value alignment with no consideration of agents' heterogeneity and the requirement of simultaneous promotion and alignment of multiple values. This research proposes a multi-value promotion model that uses multi-objective evolutionary algorithms and decentralised reasoning to produce the optimum parametric set of norms that is aligned with multiple simultaneous values of heterogeneous agents and the system. To understand various aspects of this complex problem, several evolutionary algorithms were used to find a set of optimised norm parameters considering two toy tax scenarios with two and five values are considered. The results are analysed from different perspectives to show the impact of a selected evolutionary algorithm on the solution, and the importance of understanding the relation between values when prioritising them.


title: Localization of min-max minimal hypersurfaces

abstract: We show that min-max minimal hypersurfaces can be localized. As a consequence, we obtain the sharp generalization to complete manifolds of the famous Almgren-Pitts min-max theorem in closed manifolds. We use this result to prove the existence of a complete embedded finite area minimal hypersurface of index at most one in every balanced complete manifold.


title: Map2Schedule: An End-to-End Link Scheduling Method for Urban V2V Communications

abstract: Urban vehicle-to-vehicle (V2V) link scheduling with shared spectrum is a challenging problem. Its main goal is to find the scheduling policy that can maximize system performance (usually the sum capacity of each link or their energy efficiency). Given that each link can experience interference from all other active links, the scheduling becomes a combinatorial integer programming problem and generally does not scale well with the number of V2V pairs. Moreover, link scheduling requires accurate channel state information (CSI), which is very difficult to estimate with good accuracy under high vehicle mobility. In this paper, we propose an end-to-end urban V2V link scheduling method called Map2Schedule, which can directly generate V2V scheduling policy from the city map and vehicle locations. Map2Schedule delivers comparable performance to the physical-model-based methods in urban settings while maintaining low computation complexity. This enhanced performance is achieved by machine learning (ML) technologies. Specifically, we first deploy the convolutional neural network (CNN) model to estimate the CSI from street layout and vehicle locations and then apply the graph embedding model for optimal scheduling policy. The results show that the proposed method can achieve high accuracy with much lower overhead and latency.


title: From Large Language Models to Knowledge Graphs for Biomarker Discovery in Cancer

abstract: Domain experts often rely on most recent knowledge for apprehending and disseminating specific biological processes that help them design strategies for developing prevention and therapeutic decision-making in various disease scenarios. A challenging scenarios for artificial intelligence (AI) is using biomedical data (e.g., texts, imaging, omics, and clinical) to provide diagnosis and treatment recommendations for cancerous conditions.~Data and knowledge about biomedical entities like cancer, drugs, genes, proteins, and their mechanism is spread across structured (knowledge bases (KBs)) and unstructured (e.g., scientific articles) sources. A large-scale knowledge graph (KG) can be constructed by integrating and extracting facts about semantically interrelated entities and relations. Such a KG not only allows exploration and question answering (QA) but also enables domain experts to deduce new knowledge. However, exploring and querying large-scale KGs is tedious for non-domain users due to their lack of understanding of the data assets and semantic technologies. In this paper, we develop a domain KG to leverage cancer-specific biomarker discovery and interactive QA. For this, we constructed a domain ontology called OncoNet Ontology (ONO), which enables semantic reasoning for validating gene-disease (different types of cancer) relations. The KG is further enriched by harmonizing the ONO, metadata, controlled vocabularies, and biomedical concepts from scientific articles by employing BioBERT- and SciBERT-based information extractors. Further, since the biomedical domain is evolving, where new findings often replace old ones, without having access to up-to-date scientific findings, there is a high chance an AI system exhibits concept drift while providing diagnosis and treatment. Therefore, we fine-tune the KG using large language models (LLMs) based on more recent articles and KBs.


title: Constraints on the velocity of gravitational waves from NANOGrav 15-year data set

abstract: General relativity predicts that gravitational waves propagate at the speed of light. Although ground-based gravitational-wave detectors have successfully constrained the velocity of gravitational waves in the high-frequency range, extending this constraint to the lower frequency range remains a challenge. In this work, we utilize the deviations in the overlap reduction function for a gravitational-wave background within pulsar timing arrays to investigate the velocity of gravitational waves in the nanohertz frequency band. By analyzing the NANOGrav 15-year data set, we obtain a well-constrained lower bound for the velocity of gravitational waves that $v \gtrsim 0.87\,c$, where $c$ is the speed of light.


title: MCU: A Task-centric Framework for Open-ended Agent Evaluation in Minecraft

abstract: To pursue the goal of creating an open-ended agent in Minecraft, an open-ended game environment with unlimited possibilities, this paper introduces a task-centric framework named MCU for Minecraft agent evaluation. The MCU framework leverages the concept of atom tasks as fundamental building blocks, enabling the generation of diverse or even arbitrary tasks. Within the MCU framework, each task is measured with six distinct difficulty scores (time consumption, operational effort, planning complexity, intricacy, creativity, novelty). These scores offer a multi-dimensional assessment of a task from different angles, and thus can reveal an agent's capability on specific facets. The difficulty scores also serve as the feature of each task, which creates a meaningful task space and unveils the relationship between tasks. For efficient evaluation of Minecraft agents employing the MCU framework, we maintain a unified benchmark, namely SkillForge, which comprises representative tasks with diverse categories and difficulty distribution. We also provide convenient filters for users to select tasks to assess specific capabilities of agents. We show that MCU has the high expressivity to cover all tasks used in recent literature on Minecraft agent, and underscores the need for advancements in areas such as creativity, precise control, and out-of-distribution generalization under the goal of open-ended Minecraft agent development.


title: Mapping Memes to Words for Multimodal Hateful Meme Classification

abstract: Multimodal image-text memes are prevalent on the internet, serving as a unique form of communication that combines visual and textual elements to convey humor, ideas, or emotions. However, some memes take a malicious turn, promoting hateful content and perpetuating discrimination. Detecting hateful memes within this multimodal context is a challenging task that requires understanding the intertwined meaning of text and images. In this work, we address this issue by proposing a novel approach named ISSUES for multimodal hateful meme classification. ISSUES leverages a pre-trained CLIP vision-language model and the textual inversion technique to effectively capture the multimodal semantic content of the memes. The experiments show that our method achieves state-of-the-art results on the Hateful Memes Challenge and HarMeme datasets. The code and the pre-trained models are publicly available at https://github.com/miccunifi/ISSUES.


title: Fast Search Method for Large Polarization Kernels

abstract: A novel search method for large polarization kernels is proposed. The algorithm produces a kernel with given partial distances by employing the depth-first search combined with the computation of coset leaders weight tables and sufficient conditions of code non-equivalence. Using the proposed method, we improved all existing lower bounds on the maximum error exponent for kernels of size from 17 to 29. We also obtained kernels which admit low complexity processing by the recently proposed recursive trellis algorithm. Numerical results demonstrate the advantage of polar codes with the obtained kernels compared with shortened polar codes and polar codes with small kernels.


title: UniPAD: A Universal Pre-training Paradigm for Autonomous Driving

abstract: In the context of autonomous driving, the significance of effective feature learning is widely acknowledged. While conventional 3D self-supervised pre-training methods have shown widespread success, most methods follow the ideas originally designed for 2D images. In this paper, we present UniPAD, a novel self-supervised learning paradigm applying 3D volumetric differentiable rendering. UniPAD implicitly encodes 3D space, facilitating the reconstruction of continuous 3D shape structures and the intricate appearance characteristics of their 2D projections. The flexibility of our method enables seamless integration into both 2D and 3D frameworks, enabling a more holistic comprehension of the scenes. We manifest the feasibility and effectiveness of UniPAD by conducting extensive experiments on various downstream 3D tasks. Our method significantly improves lidar-, camera-, and lidar-camera-based baseline by 9.1, 7.7, and 6.9 NDS, respectively. Notably, our pre-training pipeline achieves 73.2 NDS for 3D object detection and 79.4 mIoU for 3D semantic segmentation on the nuScenes validation set, achieving state-of-the-art results in comparison with previous methods. The code will be available at https://github.com/Nightmare-n/UniPAD.


title: Worst-Case Morphs using Wasserstein ALI and Improved MIPGAN

abstract: A morph is a combination of two separate facial images and contains identity information of two different people. When used in an identity document, both people can be authenticated by a biometric Face Recognition (FR) system. Morphs can be generated using either a landmark-based approach or approaches based on deep learning such as Generative Adversarial Networks (GAN). In a recent paper, we introduced a \emph{worst-case} upper bound on how challenging morphing attacks can be for an FR system. The closer morphs are to this upper bound, the bigger the challenge they pose to FR. We introduced an approach with which it was possible to generate morphs that approximate this upper bound for a known FR system (white box), but not for unknown (black box) FR systems. In this paper, we introduce a morph generation method that can approximate worst-case morphs even when the FR system is not known. A key contribution is that we include the goal of generating difficult morphs \emph{during} training. Our method is based on Adversarially Learned Inference (ALI) and uses concepts from Wasserstein GANs trained with Gradient Penalty, which were introduced to stabilise the training of GANs. We include these concepts to achieve similar improvement in training stability and call the resulting method Wasserstein ALI (WALI). We finetune WALI using loss functions designed specifically to improve the ability to manipulate identity information in facial images and show how it can generate morphs that are more challenging for FR systems than landmark- or GAN-based morphs. We also show how our findings can be used to improve MIPGAN, an existing StyleGAN-based morph generator.


title: Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignment

abstract: Pretrained language models (PLMs) based knowledge-grounded dialogue systems are prone to generate responses that are factually inconsistent with the provided knowledge source. In such inconsistent responses, the dialogue models fail to accurately express the external knowledge they rely upon. Inspired by previous work which identified that feed-forward networks (FFNs) within Transformers are responsible for factual knowledge expressions, we investigate two methods to efficiently improve the factual expression capability {of FFNs} by knowledge enhancement and alignment respectively. We first propose \textsc{K-Dial}, which {explicitly} introduces {extended FFNs in Transformers to enhance factual knowledge expressions} given the specific patterns of knowledge-grounded dialogue inputs. Additionally, we apply the reinforcement learning for factual consistency (RLFC) method to implicitly adjust FFNs' expressions in responses by aligning with gold knowledge for the factual consistency preference. To comprehensively assess the factual consistency and dialogue quality of responses, we employ extensive automatic measures and human evaluations including sophisticated fine-grained NLI-based metrics. Experimental results on WoW and CMU\_DoG datasets demonstrate that our methods efficiently enhance the ability of the FFN module to convey factual knowledge, validating the efficacy of improving factual consistency for knowledge-grounded dialogue systems.


title: Chrono: A Peer-to-Peer Network with Verifiable Causality

abstract: Logical clocks are a fundamental tool to establish causal ordering of events in a distributed system. They have been used as the building block in weakly consistent storage systems, causally ordered broadcast, distributed snapshots, deadlock detection, and distributed system debugging. However, prior logical clock constructs fail to work in a permissionless setting with Byzantine participants. In this work, we introduce Chrono, a novel logical clock system that targets an open and decentralized network. Chrono introduces a new logical clock construct, the Decaying Onion Bloom Clock (DOBC), that scales independently to the size of the network. To tolerate Byzantine behaviors, Chrono leverages non-uniform incrementally verifiable computation (IVC) to efficiently prove and verify the construction of DOBC clocks. We have applied Chrono to build two decentralized applications, a weakly consistent key-value store and an anti-censorship social network, demonstrating the power of scalable, verifiable causality in a decentralized network.


title: Rich doctrines and Henkin's Theorem

abstract: We find a possible interpretation of Henkin's Theorem in the language of existential implicational doctrines. Starting from a consistent doctrine, we construct a new doctrine which is rich-where a theory is rich when for every valid formula of the kind $\exists x \phi (x)$ there exists a witness constant $c$ such that $\phi (c)$ holds. We then show that a rich doctrine admits an appropriate morphism towards the doctrine of subsets. Henkin's Theorem for doctrines follows from these two results, modelling our proof on the main lines of the original theorem. Existence of directed colimits in the category of doctrines, the construction of the Boolean completion, and the quotient of a primary doctrine over a filter are displayed as key steps in some of the proofs of Henkin's Theorem for doctrines.


title: Low-lying baryon resonances from lattice QCD

abstract: Recent results studying the masses and widths of low-lying baryon resonances in lattice QCD are presented. The $S$-wave $N\pi$ scattering lengths for both total isospins $I = 1/2$ and $I = 3/2$ are inferred from the finite-volume spectrum below the inelastic threshold together with the $I = 3/2$ $P$-wave containing the $\Delta(1232)$ resonance. A lattice QCD computation employing a combined basis of three-quark and meson-baryon interpolating operators with definite momentum to determine the coupled channel $\Sigma\pi$-$N\overline{K}$ scattering amplitude in the $\Lambda(1405)$ region is also presented. Our results support the picture of a two-pole structure suggested by theoretical approaches based on $SU(3)$ chiral symmetry and unitarity.


title: Wigner transport in linear electromagnetic fields

abstract: Applying a Weyl-Stratonovich transform to the evolution equation of the Wigner function in an electromagnetic field yields a multidimensional gauge-invariant equation which is numerically very challenging to solve. In this work, we apply simplifying assumptions for linear electromagnetic fields and the evolution of an electron in a plane (two-dimensional transport), which reduces the complexity and enables to gain first experiences with a gauge-invariant Wigner equation. We present an equation analysis and show that a finite difference approach for solving the high-order derivatives allows for reformulation into a Fredholm integral equation. The resolvent expansion of the latter contains consecutive integrals, which is favorable for Monte Carlo solution approaches. To that end, we present two stochastic (Monte Carlo) algorithms that evaluate averages of generic physical quantities or directly the Wigner function. The algorithms give rise to a quantum particle model, which interprets quantum transport in heuristic terms.


title: Do Not Marginalize Mechanisms, Rather Consolidate!

abstract: Structural causal models (SCMs) are a powerful tool for understanding the complex causal relationships that underlie many real-world systems. As these systems grow in size, the number of variables and complexity of interactions between them does, too. Thus, becoming convoluted and difficult to analyze. This is particularly true in the context of machine learning and artificial intelligence, where an ever increasing amount of data demands for new methods to simplify and compress large scale SCM. While methods for marginalizing and abstracting SCM already exist today, they may destroy the causality of the marginalized model. To alleviate this, we introduce the concept of consolidating causal mechanisms to transform large-scale SCM while preserving consistent interventional behaviour. We show consolidation is a powerful method for simplifying SCM, discuss reduction of computational complexity and give a perspective on generalizing abilities of consolidated SCM.


title: When the atoms dance: exploring mechanisms of electron-beam induced modifications of materials with machine-learning assisted high temporal resolution electron microscopy

abstract: Directed atomic fabrication using an aberration-corrected scanning transmission electron microscope (STEM) opens new pathways for atomic engineering of functional materials. In this approach, the electron beam is used to actively alter the atomic structure through electron beam induced irradiation processes. One of the impediments that has limited widespread use thus far has been the ability to understand the fundamental mechanisms of atomic transformation pathways at high spatiotemporal resolution. Here, we develop a workflow for obtaining and analyzing high-speed spiral scan STEM data, up to 100 fps, to track the atomic fabrication process during nanopore milling in monolayer MoS2. An automated feedback-controlled electron beam positioning system combined with deep convolution neural network (DCNN) was used to decipher fast but low signal-to-noise datasets and classify time-resolved atom positions and nature of their evolving atomic defect configurations. Through this automated decoding, the initial atomic disordering and reordering processes leading to nanopore formation was able to be studied across various timescales. Using these experimental workflows a greater degree of speed and information can be extracted from small datasets without compromising spatial resolution. This approach can be adapted to other 2D materials systems to gain further insights into the defect formation necessary to inform future automated fabrication techniques utilizing the STEM electron beam.


title: Last passage percolation in a product-type random environment

abstract: We consider a last passage percolation model in dimension $1+1$ with potential given by the product of a spatial i.i.d. potential with symmetric bounded distribution and an independent i.i.d. in time sequence of signs. We assume that the density of the spatial potential near the edge of its support behaves as a power, with exponent $\kappa>-1$. We investigate the linear growth rate of the actions of optimal point-to-point lazy random walk paths as a function of the path slope and describe the structure of the resulting shape function. It has a corner at $0$ and, although its restriction to positive slopes cannot be linear, we prove that it has a flat edge near $0$ if $\kappa>0$. For optimal point-to-line paths, we study their actions and locations of favorable edges that the paths tends to reach and stay at. Under an additional assumption on the time it takes for the optimal path to reach the favorable location, we prove that appropriately normalized actions converge to a limiting distribution that can be viewed as a counterpart of the Tracy-Widom law. Since the scaling exponent and the limiting distribution depend only on the parameter $\kappa$, our results provide a description of a new universality class.


title: Left adjoint to precomposition in elementary doctrines

abstract: It is well-known in universal algebra that adding structure and equational axioms generates forgetful functors between varieties, and such functors all have left adjoints. The category of elementary doctrines provides a natural framework for studying algebraic theories, since each algebraic theory can be described by some syntactic doctrine and its models are morphism from the syntactic doctrine into the doctrine of subsets. In this context, adding structure and axioms to a theory can be described by a morphism between the two corresponding syntactic doctrines, and the forgetful functor arises as precomposition with this last morphism. In this work, given any morphism of elementary doctrines, we prove the existence of a left adjoint of the functor induced by precomposition in the doctrine of subobjects of a Grothendieck topos.


title: AutoVP: An Automated Visual Prompting Framework and Benchmark

abstract: Visual prompting (VP) is an emerging parameter-efficient fine-tuning approach to adapting pre-trained vision models to solve various downstream image-classification tasks. However, there has hitherto been little systematic study of the design space of VP and no clear benchmark for evaluating its performance. To bridge this gap, we propose AutoVP, an end-to-end expandable framework for automating VP design choices, along with 12 downstream image-classification tasks that can serve as a holistic VP-performance benchmark. Our design space covers 1) the joint optimization of the prompts; 2) the selection of pre-trained models, including image classifiers and text-image encoders; and 3) model output mapping strategies, including nonparametric and trainable label mapping. Our extensive experimental results show that AutoVP outperforms the best-known current VP methods by a substantial margin, having up to 6.7% improvement in accuracy; and attains a maximum performance increase of 27.5% compared to linear-probing (LP) baseline. AutoVP thus makes a two-fold contribution: serving both as an efficient tool for hyperparameter tuning on VP design choices, and as a comprehensive benchmark that can reasonably be expected to accelerate VP's development. The source code is available at https://github.com/IBM/AutoVP.


title: Global existence of solutions in two-species chemotaxis system with two chemicals with sub-logistic sources in 2d

abstract: This paper investigates the global existence and boundedness of solutions in a two-species chemotaxis system with two chemicals and sub-logistic sources. The presence of a sub-logistic source in only one cell density equation effectively prevents the occurrence of blow-up solutions, even in fully parabolic chemotaxis systems.


title: Reconstructing Materials Tetrahedron: Challenges in Materials Information Extraction

abstract: The discovery of new materials has a documented history of propelling human progress for centuries and more. The behaviour of a material is a function of its composition, structure, and properties, which further depend on its processing and testing conditions. Recent developments in deep learning and natural language processing have enabled information extraction at scale from published literature such as peer-reviewed publications, books, and patents. However, this information is spread in multiple formats, such as tables, text, and images, and with little or no uniformity in reporting style giving rise to several machine learning challenges. Here, we discuss, quantify, and document these challenges in automated information extraction (IE) from materials science literature towards the creation of a large materials science knowledge base. Specifically, we focus on IE from text and tables and outline several challenges with examples. We hope the present work inspires researchers to address the challenges in a coherent fashion, providing a fillip to IE towards developing a materials knowledge base.


title: Towards Running Time Analysis of Interactive Multi-objective Evolutionary Algorithms

abstract: Evolutionary algorithms (EAs) are widely used for multi-objective optimization due to their population-based nature. Traditional multi-objective EAs (MOEAs) generate a large set of solutions to approximate the Pareto front, leaving a decision maker (DM) with the task of selecting a preferred solution. However, this process can be inefficient and time-consuming, especially when there are many objectives or the subjective preferences of DM is known. To address this issue, interactive MOEAs (iMOEAs) combine decision making into the optimization process, i.e., update the population with the help of the DM. In contrast to their wide applications, there has existed only two pieces of theoretical works on iMOEAs, which only considered interactive variants of the two simple single-objective algorithms, RLS and (1+1)-EA. This paper provides the first running time analysis (the essential theoretical aspect of EAs) for practical iMOEAs. Specifically, we prove that the expected running time of the well-developed interactive NSGA-II (called R-NSGA-II) for solving the OneMinMax and OneJumpZeroJump problems is $O(n \log n)$ and $O(n^k)$, respectively, which are all asymptotically faster than the traditional NSGA-II. Meanwhile, we present a variant of OneMinMax, and prove that R-NSGA-II can be exponentially slower than NSGA-II. These results provide theoretical justification for the effectiveness of iMOEAs while identifying situations where they may fail. Experiments are also conducted to validate the theoretical results.


title: Explicit universal bounds for squeezing functions of ($\mathbb{C}$-)convex domains

abstract: We prove two separate lower bounds -- one for nondegenerate convex domains and the other for nondegenerate $\mathbb{C}$-convex (but not necessarily convex) domains -- for the squeezing function that hold true for all domains in $\mathbb{C}^n$, for a fixed $n\geq 2$, of the stated class. We provide explicit expressions in terms of $n$ for these estimates.


title: Measuring small-scale magnetic fields of 44 M dwarfs from SPIRou spectra with ZeeTurbo

abstract: We present the results of an analysis aimed at probing the small-scale magnetic fields of M dwarfs observed with SPIRou, the nIR high-resolution spectro-polarimeter installed at the Canada-France-Hawaii Telescope, in the context of the SPIRou Legacy Survey. Our analysis relies on high-resolution median spectra built from several tens of spectra recorded between 2019 and 2022, and on synthetic spectra computed with the ZeeTurbo code for various combination of atmospheric parameters and magnetic field strengths. We pursue the efforts undertaken in a previous study and focus on 44 weakly to moderately active M dwarfs. We derive average magnetic field strengths (<$B$>) ranging from 0.05 to 1.15 kG, in good agreement with activity estimates and rotation periods. We found that including magnetic fields in our models has virtually no impact on our derived atmospheric parameters, and that a priori assumptions on the stellar surface gravity can affect our estimated <$B$>. Our results suggest that small-scale magnetic fields account for more than 70% of the overall average magnetic field for most targets whose large-scale fields were previously measured. We derived low magnetic fluxes for several targets in our sample, and found no clear evidence that <$B$> decreases with increasing Rossby number in the unsaturated dynamo regime. We even identified counterexamples (GJ 1289 and GJ 1286) where the small-scale field is unusually strong despite the long rotation period. Along with similar results on the large-scale fields, our findings further suggest that dynamo processes may operate in a non-conventional mode in these strongly magnetic, slowly-rotating stars.


abstract: Active learning presents a promising avenue for training high-performance models with minimal labeled data, achieved by judiciously selecting the most informative instances to label and incorporating them into the task learner. Despite notable advancements in active learning for image recognition, metrics devised or learned to gauge the information gain of data, crucial for query strategy design, do not consistently align with task model performance metrics, such as Mean Average Precision (MeanAP) in object detection tasks. This paper introduces MeanAP-Guided Reinforced Active Learning for Object Detection (MAGRAL), a novel approach that directly utilizes the MeanAP metric of the task model to devise a sampling strategy employing a reinforcement learning-based sampling agent. Built upon LSTM architecture, the agent efficiently explores and selects subsequent training instances, and optimizes the process through policy gradient with MeanAP serving as reward. Recognizing the time-intensive nature of MeanAP computation at each step, we propose fast look-up tables to expedite agent training. We assess MAGRAL's efficacy across popular benchmarks, PASCAL VOC and MS COCO, utilizing different backbone architectures. Empirical findings substantiate MAGRAL's superiority over recent state-of-the-art methods, showcasing substantial performance gains. MAGRAL establishes a robust baseline for reinforced active object detection, signifying its potential in advancing the field.


title: Is the photon-blockade breakdown a quantum effect? A neoclassical story

abstract: The photon-blockade breakdown bistability can be intuitively explained invoking the energy spectrum of the interacting qubit-mode system. Yet, the neoclassical solution of the driven-dissipative Jaynes-Cummings model has been shown to capture several key aspects of the phenomenon. In this paper, we set out to compare a fully quantum solution with the neo- and semi-classical solutions. Although the neoclassical theory is founded on the assumption of a pure partial state for the qubit, it is not simply the $\gamma \to 0$ limit of the semiclassical theory; the semi- vs. neo-classical duality being a case of non-commutativity of limits. Furthermore, we show that the neoclassical predictions still hold in case of a small qubit decay. Tracing the bistable behavior for different detunings, we show that it is robust over a significant range of $\Delta$ values. We demonstrate that the aptitude of the neoclassical description is founded on the high quantum purity of the bright state of the photon-blockade breakdown bistability, which sharply differentiates this phenomenology from conventional optical bistability. It is thereby demonstrated that driven-dissipative dynamics can produce closely separable pure steady states in an interacting bipartite.


title: Modelling Deuterated Isotopologues of Methanol toward the Pre-Stellar Core L1544

abstract: Aims. We aim to improve a previous model for the prediction of column densities and deuterium fractions of non- and singly deuterated methanol. Thereby, we try to identify crucial chemical and physical parameters, for which the study of deuteration could provide valuable additional constraints. Methods. We employed a gas-grain chemical code to devise a model that is in agreement with the observed column density and deuterium fraction profiles of the innermost region of the pre-stellar core L1544. For that purpose, we developed a new treatment of reactive desorption, deriving an individual reactive desorption efficiency for every product species in a chemical reaction, that depends on the reaction enthalpy and type of underlying surface. Furthermore, we explored several options to promote the diffusion of hydrogen and deuterium atoms over the surface of interstellar dust grains, in order to increase methanol formation. Results. Our fiducial model employs diffusion by quantum tunneling of hydrogen and deuterium atoms, resulting in CH$_3$OH and CH$_2$DOH column densities that are approximately an order of magnitude lower than the observed values, which improves the results compared to the previous model by a factor 10. The $N$(CH$_2$DOH)/$N$(CH$_3$OH) ratio is reproduced within a factor of 1.2 for the centre and 1.8 for the position of the methanol peak. Given the large uncertainties that chemical models typically have, we consider our predictions to be in agreement with the observations. In general, we conclude that a diffusion process with a high diffusion rate needs to be employed to obtain methanol column densities that are in accordance with the observed values. Also, we find that the introduction of abstraction reactions into the methanol formation scheme suppresses deuteration, when used in combination with a high diffusion rate.


title: Hyp-UML: Hyperbolic Image Retrieval with Uncertainty-aware Metric Learning

abstract: Metric learning plays a critical role in training image retrieval and classification. It is also a key algorithm in representation learning, e.g., for feature learning and its alignment in metric space. Hyperbolic embedding has been recently developed. Compared to the conventional Euclidean embedding in most of the previously developed models, Hyperbolic embedding can be more effective in representing the hierarchical data structure. Second, uncertainty estimation/measurement is a long-lasting challenge in artificial intelligence. Successful uncertainty estimation can improve a machine learning model's performance, robustness, and security. In Hyperbolic space, uncertainty measurement is at least with equivalent, if not more, critical importance. In this paper, we develop a Hyperbolic image embedding with uncertainty-aware metric learning for image retrieval. We call our method Hyp-UML: Hyperbolic Uncertainty-aware Metric Learning. Our contribution are threefold: we propose an image embedding algorithm based on Hyperbolic space, with their corresponding uncertainty value; we propose two types of uncertainty-aware metric learning, for the popular Contrastive learning and conventional margin-based metric learning, respectively. We perform extensive experimental validations to prove that the proposed algorithm can achieve state-of-the-art results among related methods. The comprehensive ablation study validates the effectiveness of each component of the proposed algorithm.


title: How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?

abstract: Transformers pretrained on diverse tasks exhibit remarkable in-context learning (ICL) capabilities, enabling them to solve unseen tasks solely based on input contexts without adjusting model parameters. In this paper, we study ICL in one of its simplest setups: pretraining a linearly parameterized single-layer linear attention model for linear regression with a Gaussian prior. We establish a statistical task complexity bound for the attention model pretraining, showing that effective pretraining only requires a small number of independent tasks. Furthermore, we prove that the pretrained model closely matches the Bayes optimal algorithm, i.e., optimally tuned ridge regression, by achieving nearly Bayes optimal risk on unseen tasks under a fixed context length. These theoretical findings complement prior experimental research and shed light on the statistical foundations of ICL.


title: Introducing a Deep Neural Network-based Model Predictive Control Framework for Rapid Controller Implementation

abstract: Model Predictive Control (MPC) provides an optimal control solution based on a cost function while allowing for the implementation of process constraints. As a model-based optimal control technique, the performance of MPC strongly depends on the model used where a trade-off between model computation time and prediction performance exists. One solution is the integration of MPC with a machine learning (ML) based process model which are quick to evaluate online. This work presents the experimental implementation of a deep neural network (DNN) based nonlinear MPC for Homogeneous Charge Compression Ignition (HCCI) combustion control. The DNN model consists of a Long Short-Term Memory (LSTM) network surrounded by fully connected layers which was trained using experimental engine data and showed acceptable prediction performance with under 5% error for all outputs. Using this model, the MPC is designed to track the Indicated Mean Effective Pressure (IMEP) and combustion phasing trajectories, while minimizing several parameters. Using the acados software package to enable the real-time implementation of the MPC on an ARM Cortex A72, the optimization calculations are completed within 1.4 ms. The external A72 processor is integrated with the prototyping engine controller using a UDP connection allowing for rapid experimental deployment of the NMPC. The IMEP trajectory following of the developed controller was excellent, with a root-mean-square error of 0.133 bar, in addition to observing process constraints.


title: Coherent Exciton-Lattice Dynamics in a 2D Metal Organochalcogenolate Semiconductor

abstract: Hybrid organic-inorganic nanomaterials can exhibit transitional behavior that deviates from models developed for all-organic or all-inorganic materials systems. Here, we reveal the complexity of exciton-phonon interactions in a recently discovered 2D layered hybrid organic-inorganic semiconductor, silver phenylselenolate (AgSePh). Using femtosecond resonant impulsive vibrational spectroscopy and non-resonant Raman scattering, we measure multiple hybrid organic-inorganic vibrational modes and identify a subset of these modes that strongly couple to the electronic excited state. Calculations by density functional perturbation theory show that these strongly coupled modes exhibit large out-of-plane silver atomic motions and silver-selenium spacing displacements. Moreover, analysis of photoluminescence fine-structure splitting and temperature-dependent peak-shifting/linewidth-broadening suggests that light emission in AgSePh is most strongly affected by a compound 100 cm-1 mode involving the wagging motion of phenylselenolate ligands and accompanying metal-chalcogen stretching. Finally, red-shifting of vibrational modes with increasing temperature reveals a high degree of anharmonicity arising from non-covalent interactions between phenyl rings. These findings reveal the unique effects of hybrid vibrational modes in organic-inorganic semiconductors and motivate future work aimed at specifically engineering such interactions through chemical and structural modification.