title: A hybrid quantum-classical conditional generative adversarial network algorithm for human-centered paradigm in cloud

abstract: As an emerging field that aims to bridge the gap between human activities and computing systems, human-centered computing (HCC) in cloud, edge, fog has had a huge impact on the artificial intelligence algorithms. The quantum generative adversarial network (QGAN) is considered to be one of the quantum machine learning algorithms with great application prospects, which also should be improved to conform to the human-centered paradigm. The generation process of QGAN is relatively random and the generated model does not conform to the human-centered concept, so it is not quite suitable for real scenarios. In order to solve these problems, a hybrid quantum-classical conditional generative adversarial network (QCGAN) algorithm is proposed, which is a knowledge-driven human-computer interaction computing mode that can be implemented in cloud. The purposes of stabilizing the generation process and realizing the interaction between human and computing process are achieved by inputting artificial conditional information in the generator and discriminator. The generator uses the parameterized quantum circuit with an all-to-all connected topology, which facilitates the tuning of network parameters during the training process. The discriminator uses the classical neural network, which effectively avoids the "input bottleneck" of quantum machine learning. Finally, the BAS training set is selected to conduct experiment on the quantum cloud computing platform. The result shows that the QCGAN algorithm can effectively converge to the Nash equilibrium point after training and perform human-centered classification generation tasks.


title: Bridging the Gap Between Foundation Models and Heterogeneous Federated Learning

abstract: Federated learning (FL) offers privacy-preserving decentralized machine learning, optimizing models at edge clients without sharing private data. Simultaneously, foundation models (FMs) have gained traction in the artificial intelligence (AI) community due to their exceptional performance across various tasks. However, integrating FMs into FL presents challenges, primarily due to their substantial size and intensive resource requirements. This is especially true when considering the resource heterogeneity in edge FL systems. We present an adaptive framework for Resource-aware Federated Foundation Models (RaFFM) to address these challenges. RaFFM introduces specialized model compression algorithms tailored for FL scenarios, such as salient parameter prioritization and high-performance subnetwork extraction. These algorithms enable dynamic scaling of given transformer-based FMs to fit heterogeneous resource constraints at the network edge during both FL's optimization and deployment stages. Experimental results demonstrate that RaFFM shows significant superiority in resource utilization efficiency and uses fewer resources to deploy FMs to FL. Despite the lower resource consumption, target models optimized by RaFFM achieve performance on par with traditional FL methods applied to full-sized FMs. This is evident across tasks in both natural language processing and computer vision domains.


title: Learning State-Augmented Policies for Information Routing in Communication Networks

abstract: This paper examines the problem of information routing in a large-scale communication network, which can be formulated as a constrained statistical learning problem having access to only local information. We delineate a novel State Augmentation (SA) strategy to maximize the aggregate information at source nodes using graph neural network (GNN) architectures, by deploying graph convolutions over the topological links of the communication network. The proposed technique leverages only the local information available at each node and efficiently routes desired information to the destination nodes. We leverage an unsupervised learning procedure to convert the output of the GNN architecture to optimal information routing strategies. In the experiments, we perform the evaluation on real-time network topologies to validate our algorithms. Numerical simulations depict the improved performance of the proposed method in training a GNN parameterization as compared to baseline algorithms.


title: MMPI: a Flexible Radiance Field Representation by Multiple Multi-plane Images Blending

abstract: This paper presents a flexible representation of neural radiance fields based on multi-plane images (MPI), for high-quality view synthesis of complex scenes. MPI with Normalized Device Coordinate (NDC) parameterization is widely used in NeRF learning for its simple definition, easy calculation, and powerful ability to represent unbounded scenes. However, existing NeRF works that adopt MPI representation for novel view synthesis can only handle simple forward-facing unbounded scenes, where the input cameras are all observing in similar directions with small relative translations. Hence, extending these MPI-based methods to more complex scenes like large-range or even 360-degree scenes is very challenging. In this paper, we explore the potential of MPI and show that MPI can synthesize high-quality novel views of complex scenes with diverse camera distributions and view directions, which are not only limited to simple forward-facing scenes. Our key idea is to encode the neural radiance field with multiple MPIs facing different directions and blend them with an adaptive blending operation. For each region of the scene, the blending operation gives larger blending weights to those advantaged MPIs with stronger local representation abilities while giving lower weights to those with weaker representation abilities. Such blending operation automatically modulates the multiple MPIs to appropriately represent the diverse local density and color information. Experiments on the KITTI dataset and ScanNet dataset demonstrate that our proposed MMPI synthesizes high-quality images from diverse camera pose distributions and is fast to train, outperforming the previous fast-training NeRF methods for novel view synthesis. Moreover, we show that MMPI can encode extremely long trajectories and produce novel view renderings, demonstrating its potential in applications like autonomous driving.


title: The oracle property of the generalized outcome adaptive lasso

abstract: The generalized outcome-adaptive lasso (GOAL) is a variable selection for high-dimensional causal inference proposed by Bald\'e et al. [2023, {\em Biometrics} {\bfseries 79(1)}, 514--520]. When the dimension is high, it is now well established that an ideal variable selection method should have the oracle property to ensure the optimal large sample performance. However, the oracle property of GOAL has not been proven. In this paper, we show that the GOAL estimator enjoys the oracle property. Our simulation shows that the GOAL method deals with the collinearity problem better than the oracle-like method, the outcome-adaptive lasso (OAL).


title: Direct sum graph of the subspaces of a finite dimensional vector space over finite fields

abstract: In this paper, we introduce a new graph structure, called the $direct~ sum ~graph$ on a finite dimensional vector space. We investigate the connectivity, diameter and the completeness of $\Gamma_{U\oplus W}(\mathbb{V})$. Further, we find its domination number and independence number. We also determine the degree of each vertex in case the base field is finite and show that the graph $\Gamma_{U\oplus W}(\mathbb{V})$ is not Eulerian. We also show that under some mild conditions the graph $\Gamma_{U\oplus W}(\mathbb{V})$ is triangulated. We determine the clique number of $\Gamma_{U\oplus W}(\mathbb{V})$ for some particular cases. Finally, we find the size, girth, edge-connectivity and the chromatic number of $\Gamma_{U\oplus W}(\mathbb{V})$.


title: Bayesian Approach for Adaptive EMG Pattern Classification Via Semi-Supervised Sequential Learning

abstract: Intuitive human-machine interfaces may be developed using pattern classification to estimate executed human motions from electromyogram (EMG) signals generated during muscle contraction. The continual use of EMG-based interfaces gradually alters signal characteristics owing to electrode shift and muscle fatigue, leading to a gradual decline in classification accuracy. This paper proposes a Bayesian approach for adaptive EMG pattern classification using semi-supervised sequential learning. The proposed method uses a Bayesian classification model based on Gaussian distributions to predict the motion class and estimate its confidence. Pseudo-labels are subsequently assigned to data with high-prediction confidence, and the posterior distributions of the model are sequentially updated within the framework of Bayesian updating, thereby achieving adaptive motion recognition to alterations in signal characteristics over time. Experimental results on six healthy adults demonstrated that the proposed method can suppress the degradation of classification accuracy over time and outperforms conventional methods. These findings demonstrate the validity of the proposed approach and its applicability to practical EMG-based control systems.


title: Scalar fields around a rotating loop quantum gravity black hole: Waveform, quasi-normal modes and superradiance

abstract: The dynamical behavior of a scalar field near a rotating loop quantum gravity black hole is investigated. By analyzing the waveform of scalar fields, we find that the loop quantum correction only affects the decaying oscillation of waveforms, which is mainly described by quasi-normal modes. Moreover, we calculate the quasi-normal modes of scalar field perturbations by using three numerical methods, which are the Prony, WKB, and shooting methods, respectively, and compare the accuracy of results among these methods. Over the entire parameter space of a rotating loop quantum gravity black hole, we analyze the stability of the spacetime and the influence of loop quantum corrections on the quasi-normal modes of scalar field perturbations, and find that the influence varies with the change of black hole angular momenta. Finally, we study the energy amplification effect of black holes on free scalar fields, and analyze the influence of loop quantum corrections on the amplification factor. Our result shows the diverse influences of loop quantum corrections on the dynamics of scalar fields and superradiance effect of a rotating loop quantum gravity black hole.


title: A Distributed Efficient Blockchain Oracle Scheme for Internet of Things

abstract: In recent years, blockchain has been widely applied in the Internet of Things (IoT). Blockchain oracle, as a bridge for data communication between blockchain and off-chain, has also received significant attention. However, the numerous and heterogeneous devices in the IoT pose great challenges to the efficiency and security of data acquisition for oracles. We find that the matching relationship between data sources and oracle nodes greatly affects the efficiency and service quality of the entire oracle system. To address these issues, this paper proposes a distributed and efficient oracle solution tailored for the IoT, enabling fast acquisition of real-time off-chain data. Specifically, we first design a distributed oracle architecture that combines both Trusted Execution Environment (TEE) devices and ordinary devices to improve system scalability, considering the heterogeneity of IoT devices. Secondly, based on the trusted node information provided by TEE, we determine the matching relationship between nodes and data sources, assigning appropriate nodes for tasks to enhance system efficiency. Through simulation experiments, our proposed solution has been shown to effectively improve the efficiency and service quality of the system, reducing the average response time by approximately 9.92\% compared to conventional approaches.


title: Identifying Distribution Network Faults Using Adaptive Transition Probability

abstract: A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is to discover the most appropriate linear mapping between simulated and real data to minimize distribution differences. By aligning the data in the same feature space, the proposed method effectively overcomes the challenge posed by limited sample size when identifying faults and classifying real data in distribution networks. Experimental results utilizing simulated system data and real field data demonstrate that this approach outperforms commonly used classification models such as convolutional neural networks, support vector machines, and k-nearest neighbors, especially under adaptive learning conditions. Consequently, this research provides a fresh perspective on fault detection in distribution networks, particularly when adaptive learning conditions are employed.


title: On Performance Analysis of Graphcore IPUs: Analyzing Squared and Skewed Matrix Multiplication

abstract: In recent decades, High Performance Computing (HPC) has undergone significant enhancements, particularly in the realm of hardware platforms, aimed at delivering increased processing power while keeping power consumption within reasonable limits. The Intelligence Processing Unit (IPU) represents an entirely novel category of massively parallel processors, meticulously designed to expedite parallel computations through a multitude of processing cores and on-chip memory components interconnected via high-speed fabrics. While IPUs are primarily tailored for machine learning applications and come equipped with several libraries for the seamless implementation of neural networks, they also retain the capability to execute traditional parallel programs like matrix multiplication. However, it is essential to acknowledge that there are certain considerations and limitations when utilizing IPUs for such tasks. This paper embarks on an extensive analytical examination of matrix multiplications (MM) executed on an IPU, focusing on aspects such as execution efficiency and memory usage. Additionally, a comparative analysis is conducted, pitting the IPU against a GPU. Our findings indicate that IPUs can outperform modern GPUs, especially in handling the consistently challenging skewed matrix multiplication operations. For a more comprehensive understanding, we scrutinize various aspect ratios of matrices for these operations on an IPU and a Turing-class GPU (RTX 2080TI), revealing that the IPU consistently delivers more robust performance when dealing with skewed matrices compared to a GPU.


title: The Lov\'asz Theta Function for Recovering Planted Clique Covers and Graph Colorings

abstract: The problems of computing graph colorings and clique covers are central challenges in combinatorial optimization. Both of these are known to be NP-hard, and thus computationally intractable in the worst-case instance. A prominent approach for computing approximate solutions to these problems is the celebrated Lov\'asz theta function $\vartheta(G)$, which is specified as the solution of a semidefinite program (SDP), and hence tractable to compute. In this work, we move beyond the worst-case analysis and set out to understand whether the Lov\'asz theta function recovers clique covers for random instances that have a latent clique cover structure, possibly obscured by noise. We answer this question in the affirmative and show that for graphs generated from the planted clique model we introduce in this work, the SDP formulation of $\vartheta(G)$ has a unique solution that reveals the underlying clique-cover structure with high-probability. The main technical step is an intermediate result where we prove a deterministic condition of recovery based on an appropriate notion of sparsity.


title: NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation

abstract: Data-Free Knowledge Distillation (DFKD) has made significant recent strides by transferring knowledge from a teacher neural network to a student neural network without accessing the original data. Nonetheless, existing approaches encounter a significant challenge when attempting to generate samples from random noise inputs, which inherently lack meaningful information. Consequently, these models struggle to effectively map this noise to the ground-truth sample distribution, resulting in prolonging training times and low-quality outputs. In this paper, we propose a novel Noisy Layer Generation method (NAYER) which relocates the random source from the input to a noisy layer and utilizes the meaningful constant label-text embedding (LTE) as the input. LTE is generated by using the language model once, and then it is stored in memory for all subsequent training processes. The significance of LTE lies in its ability to contain substantial meaningful inter-class information, enabling the generation of high-quality samples with only a few training steps. Simultaneously, the noisy layer plays a key role in addressing the issue of diversity in sample generation by preventing the model from overemphasizing the constrained label information. By reinitializing the noisy layer in each iteration, we aim to facilitate the generation of diverse samples while still retaining the method's efficiency, thanks to the ease of learning provided by LTE. Experiments carried out on multiple datasets demonstrate that our NAYER not only outperforms the state-of-the-art methods but also achieves speeds 5 to 15 times faster than previous approaches. The code is available at https://github.com/tmtuan1307/nayer.


title: AutoHall: Automated Hallucination Dataset Generation for Large Language Models

abstract: While Large language models (LLMs) have garnered widespread applications across various domains due to their powerful language understanding and generation capabilities, the detection of non-factual or hallucinatory content generated by LLMs remains scarce. Currently, one significant challenge in hallucination detection is the laborious task of time-consuming and expensive manual annotation of the hallucinatory generation. To address this issue, this paper first introduces a method for automatically constructing model-specific hallucination datasets based on existing fact-checking datasets called AutoHall. Furthermore, we propose a zero-resource and black-box hallucination detection method based on self-contradiction. We conduct experiments towards prevalent open-/closed-source LLMs, achieving superior hallucination detection performance compared to extant baselines. Moreover, our experiments reveal variations in hallucination proportions and types among different models.


title: On Sinkhorn's Algorithm and Choice Modeling

abstract: For a broad class of choice and ranking models based on Luce's choice axiom, including the Bradley--Terry--Luce and Plackett--Luce models, we show that the associated maximum likelihood estimation problems are equivalent to a classic matrix balancing problem with target row and column sums. This perspective opens doors between two seemingly unrelated research areas, and allows us to unify existing algorithms in the choice modeling literature as special instances or analogs of Sinkhorn's celebrated algorithm for matrix balancing. We draw inspirations from these connections and resolve important open problems on the study of Sinkhorn's algorithm. We first prove the global linear convergence of Sinkhorn's algorithm for non-negative matrices whenever finite solutions to the matrix balancing problem exist. We characterize this global rate of convergence in terms of the algebraic connectivity of the bipartite graph constructed from data. Next, we also derive the sharp asymptotic rate of linear convergence, which generalizes a classic result of Knight (2008), but with a more explicit analysis that exploits an intrinsic orthogonality structure. To our knowledge, these are the first quantitative linear convergence results for Sinkhorn's algorithm for general non-negative matrices and positive marginals. The connections we establish in this paper between matrix balancing and choice modeling could help motivate further transmission of ideas and interesting results in both directions.


title: A physics and data co-driven surrogate modeling method for high-dimensional rare event simulation

abstract: This paper presents a physics and data co-driven surrogate modeling method for efficient rare event simulation of civil and mechanical systems with high-dimensional input uncertainties. The method fuses interpretable low-fidelity physical models with data-driven error corrections. The hypothesis is that a well-designed and well-trained simplified physical model can preserve salient features of the original model, while data-fitting techniques can fill the remaining gaps between the surrogate and original model predictions. The coupled physics-data-driven surrogate model is adaptively trained using active learning, aiming to achieve a high correlation and small bias between the surrogate and original model responses in the critical parametric region of a rare event. A final importance sampling step is introduced to correct the surrogate model-based probability estimations. Static and dynamic problems with input uncertainties modeled by random field and stochastic process are studied to demonstrate the proposed method.


title: Robust Integral Consensus Control of Multi-Agent Networks Perturbed by Matched and Unmatched Disturbances: The Case of Directed Graphs

abstract: This work presents a new method to design consensus controllers for perturbed double integrator systems whose interconnection is described by a directed graph containing a rooted spanning tree. We propose new robust controllers to solve the consensus and synchronization problems when the systems are under the effects of matched and unmatched disturbances. In both problems, we present simple continuous controllers, whose integral actions allow us to handle the disturbances. A rigorous stability analysis based on Lyapunov's direct method for unperturbed networked systems is presented. To assess the performance of our result, a representative simulation study is presented.


title: RIS-Aided Cell-Free Massive MIMO Systems for 6G: Fundamentals, System Design, and Applications

abstract: An introduction of intelligent interconnectivity for people and things has posed higher demands and more challenges for sixth-generation (6G) networks, such as high spectral efficiency and energy efficiency, ultra-low latency, and ultra-high reliability. Cell-free (CF) massive multiple-input multiple-output (mMIMO) and reconfigurable intelligent surface (RIS), also called intelligent reflecting surface (IRS), are two promising technologies for coping with these unprecedented demands. Given their distinct capabilities, integrating the two technologies to further enhance wireless network performances has received great research and development attention. In this paper, we provide a comprehensive survey of research on RIS-aided CF mMIMO wireless communication systems. We first introduce system models focusing on system architecture and application scenarios, channel models, and communication protocols. Subsequently, we summarize the relevant studies on system operation and resource allocation, providing in-depth analyses and discussions. Following this, we present practical challenges faced by RIS-aided CF mMIMO systems, particularly those introduced by RIS, such as hardware impairments and electromagnetic interference. We summarize corresponding analyses and solutions to further facilitate the implementation of RIS-aided CF mMIMO systems. Furthermore, we explore an interplay between RIS-aided CF mMIMO and other emerging 6G technologies, such as next-generation multiple-access (NGMA), simultaneous wireless information and power transfer (SWIPT), and millimeter wave (mmWave). Finally, we outline several research directions for future RIS-aided CF mMIMO systems.


title: Epistemic Logic over Similarity Graphs: Common, Distributed and Mutual Knowledge

abstract: In this paper, we delve into the study of epistemic logics, interpreted through similarity models based on weighted graphs. We explore eight languages that extend the traditional epistemic language by incorporating modalities of common, distributed, and mutual knowledge. The concept of individual knowledge is redefined under these similarity models. It is no longer just a matter of personal knowledge, but is now enriched and understood as knowledge under the individual's epistemic ability. Common knowledge is presented as higher-order knowledge that is universally known to any degree, a definition that aligns with existing literature. We reframe distributed knowledge as a form of knowledge acquired by collectively leveraging the abilities of a group of agents. In contrast, mutual knowledge is defined as the knowledge obtained through the shared abilities of a group. We then focus on the resulting logics, examining their relative expressivity, semantic correspondence to the classical epistemic logic, proof systems and the computational complexity associated with the model checking problem and the satisfiability/validity problem. This paper offers significant insights into the logical analysis and understanding of these enriched forms of knowledge, contributing to the broader discourse on epistemic logic.


title: Describing weighted safety with weighted LTL over product $\omega$-valuation monoids

abstract: We define the notion of $k$-safe infinitary series over idempotent ordered totally generalized product $\omega $-valuation monoids that satisfy specific properties. For each element $k$ of the underlying structure (different from the neutral elements of the additive, and the multiplicative operation) we determine two syntactic fragments of the weighted $LTL$ with the property that the semantics of the formulas in these fragments are $k$ -safe infinitary series. For specific idempotent ordered totally generalized product $\omega $-valuation monoids we provide algorithms that given a weighted B\"{u}chi automaton and a weighted $LTL$ formula in these fragments, decide whether the behavior of the automaton coincides with the semantics of the formula.


title: Is controlling a brain-computer interface just a matter of presence of mind? The limits of cognitive-motor dissociation

abstract: Brain-computer interfaces (BCI) are presented as a solution for people with global paralysis, also known as locked-in syndrome (LIS). The targeted population includes the most severe patients, with no residual eye movements, who cannot use any communication device (Complete LIS). However, BCI reliability is low precisely in these cases, technical pitfalls being considered responsible so far. Here, we propose to consider also that global paralysis could have an impact on cognitive functions that are crucial for being able to control a BCI. We review a bundle of arguments about the role of motor structures in cognition. Especially, we uncover that these patients without oculomotor activity often have injuries in more 'cognitive' structures such as the frontal eye field or the midbrain, exposing them to cognitive deficits further than canonical LIS population. We develop a hypothesis about the putative role of the motor system in (covert) attention, a capacity which is a prerequisite for most BCI paradigms and which should therefore be both better assessed in patients and considered.


title: The Physics of Preference: Unravelling Imprecision of Human Preferences through Magnetisation Dynamics

abstract: Paradoxical decision-making behaviours such as preference reversal often arise from imprecise or noisy human preferences. Harnessing the physical principle of magnetisation reversal in ferromagnetic nanostructures, we developed a model that closely reflects human decision-making dynamics. Tested against a spectrum of psychological data, our model adeptly captures the complexities inherent in individual choices. This blend of physics and psychology paves the way for fresh perspectives on understanding the imprecision of human decision-making processes, extending the reach of the current classical and quantum physical models of human behaviour and decision-making.

categories: physics.soc-ph cond-mat.other cs.AI quant-ph


title: Unravel Anomalies: An End-to-end Seasonal-Trend Decomposition Approach for Time Series Anomaly Detection

abstract: Traditional Time-series Anomaly Detection (TAD) methods often struggle with the composite nature of complex time-series data and a diverse array of anomalies. We introduce TADNet, an end-to-end TAD model that leverages Seasonal-Trend Decomposition to link various types of anomalies to specific decomposition components, thereby simplifying the analysis of complex time-series and enhancing detection performance. Our training methodology, which includes pre-training on a synthetic dataset followed by fine-tuning, strikes a balance between effective decomposition and precise anomaly detection. Experimental validation on real-world datasets confirms TADNet's state-of-the-art performance across a diverse range of anomalies.


title: Well-posedness and Long Time Behavior of the Euler Alignment System with Adaptive Communication Strength

abstract: We study a new flocking model which has the versatility to capture the physically realistic qualitative behavior of the Motsch-Tadmor model, while also retaining the entropy law, which lends to a similar 1D global well-posedness analysis to the Cucker-Smale model. This is an improvement to the situation in the Cucker-Smale case, which may display the physically unrealistic behavior that large flocks overpower the dynamics of small, far away flocks; and it is an improvement in the situation in the Motsch-Tadmor case, where 1D global well-posedness is not known. The new model was proposed in arXiv:2211.00117v3 and has a similar structure to the Cucker-Smale and Motsch-Tadmor hydrodynamic systems, but with a new feature: the communication strength is not fixed, but evolves in time according to its own transport equation along the Favre-filtered velocity field. This transport of the communication strength is precisely what preserves the entropy law. A variety of phenomenological behavior can be obtained from various choices of the initial communication strength, including the aforementioned Motsch-Tadmor-like behavior. We develop the general well-posedness theory for the new model and study the long time behavior -- including alignment, strong flocking in 1D, and entropy estimates to estimate the distribution of the limiting flock, all of which extend the classical results of the Cucker-Smale case. In addition, we provide numerical evidence to show the similar qualitative behavior


title: SpatialRank: Urban Event Ranking with NDCG Optimization on Spatiotemporal Data

abstract: The problem of urban event ranking aims at predicting the top-k most risky locations of future events such as traffic accidents and crimes. This problem is of fundamental importance to public safety and urban administration especially when limited resources are available. The problem is, however, challenging due to complex and dynamic spatio-temporal correlations between locations, uneven distribution of urban events in space, and the difficulty to correctly rank nearby locations with similar features. Prior works on event forecasting mostly aim at accurately predicting the actual risk score or counts of events for all the locations. Rankings obtained as such usually have low quality due to prediction errors. Learning-to-rank methods directly optimize measures such as Normalized Discounted Cumulative Gain (NDCG), but cannot handle the spatiotemporal autocorrelation existing among locations. In this paper, we bridge the gap by proposing a novel spatial event ranking approach named SpatialRank. SpatialRank features adaptive graph convolution layers that dynamically learn the spatiotemporal dependencies across locations from data. In addition, the model optimizes through surrogates a hybrid NDCG loss with a spatial component to better rank neighboring spatial locations. We design an importance-sampling with a spatial filtering algorithm to effectively evaluate the loss during training. Comprehensive experiments on three real-world datasets demonstrate that SpatialRank can effectively identify the top riskiest locations of crimes and traffic accidents and outperform state-of-art methods in terms of NDCG by up to 12.7%.


title: Virial Black Hole Mass Estimates of Quasars in the XQ-100 Legacy Survey

abstract: The black hole (BH) mass and luminosity are key factors in determining how a quasar interacts with its environment. In this study, we utilise data from the European Southern Observatory Large Programme XQ-100, a high-quality sample of 100 X-shooter spectra of the most luminous quasars in the redshift range $3.5 < z < 4.5$, and measure the properties of three prominent optical and ultraviolet broad emission-lines present in the wide wavelength coverage of X-shooter: CIV, MgII, and H$\beta$. The line properties of all three broad lines are used for virial estimates of the BH mass and their resulting mass estimates for this sample are tightly correlated. The BH mass range is $\log{(\rm{M_{BH}}/\rm{M_\odot})} = 8.6-10.3$ with bolometric luminosities estimated from the 3000A continuum in the range $\log{(\rm{L_{bol}}/\rm{erg\,s^{-1}})} = 46.7-48.0$. Robustly determined properties of these quasars enable a variety of follow-up research in quasar astrophysics, from chemical abundance and evolution in the broad-line region to radiatively driven quasar outflows.


title: Investigating the Efficacy of Large Language Models in Reflective Assessment Methods through Chain of Thoughts Prompting

abstract: Large Language Models, such as Generative Pre-trained Transformer 3 (aka. GPT-3), have been developed to understand language through the analysis of extensive text data, allowing them to identify patterns and connections between words. While LLMs have demonstrated impressive performance across various text-related tasks, they encounter challenges in tasks associated with reasoning. To address this challenge, Chain of Thought(CoT) prompting method has been proposed as a means to enhance LLMs' proficiency in complex reasoning tasks like solving math word problems and answering questions based on logical argumentative reasoning. The primary aim of this research is to assess how well four language models can grade reflective essays of third-year medical students. The assessment will specifically target the evaluation of critical thinking skills using CoT prompting. The research will provide the following contributions; to introduce and educate on the process of instructing models to evaluate reflective essays from a dataset they have not been previously trained on; to illustrate the use of CoT prompting as an instructional approach for training large models to carry out particular tasks. Our results suggest that among all the models, Llama-7b performs the least effectively, displaying the highest mean squared error. Conversely, ChatGPT emerges as the superior model, boasting a higher Cohen kappa score value of 0.53. Lastly, it's important to note that the selected models do prioritise user privacy by allowing users to delete their own conducted conversations.


title: Safe Stabilizing Control for Polygonal Robots in Dynamic Elliptical Environments

abstract: This paper addresses the challenge of safe navigation for rigid-body mobile robots in dynamic environments. We introduce an analytic approach to compute the distance between a polygon and an ellipse, and employ it to construct a control barrier function (CBF) for safe control synthesis. Existing CBF design methods for mobile robot obstacle avoidance usually assume point or circular robots, preventing their applicability to more realistic robot body geometries. Our work enables CBF designs that capture complex robot and obstacle shapes. We demonstrate the effectiveness of our approach in simulations highlighting real-time obstacle avoidance in constrained and dynamic environments for both mobile robots and multi-joint robot arms.


title: AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASR

abstract: Africa has a very low doctor-to-patient ratio. At very busy clinics, doctors could see 30+ patients per day -- a heavy patient burden compared with developed countries -- but productivity tools such as clinical automatic speech recognition (ASR) are lacking for these overworked clinicians. However, clinical ASR is mature, even ubiquitous, in developed nations, and clinician-reported performance of commercial clinical ASR systems is generally satisfactory. Furthermore, the recent performance of general domain ASR is approaching human accuracy. However, several gaps exist. Several publications have highlighted racial bias with speech-to-text algorithms and performance on minority accents lags significantly. To our knowledge, there is no publicly available research or benchmark on accented African clinical ASR, and speech data is non-existent for the majority of African accents. We release AfriSpeech, 200hrs of Pan-African English speech, 67,577 clips from 2,463 unique speakers across 120 indigenous accents from 13 countries for clinical and general domain ASR, a benchmark test set, with publicly available pre-trained models with SOTA performance on the AfriSpeech benchmark.


title: Chromatic Cardinalities via Redshift

abstract: Using higher descent for chromatically localized algebraic $K$-theory, we show that the higher semiadditive cardinality of a $\pi$-finite $p$-space $A$ at the Lubin-Tate spectrum $E_n$ is equal to the higher semiadditive cardinality of the free loop space $LA$ at $E_{n-1}$. By induction, it is thus equal to the homotopy cardinality of the $n$-fold free loop space $L^n A$. We explain how this allows one to bypass the Ravenel-Wilson computation in the proof of the $\infty$-semiadditivity of the $T(n)$-local categories.


title: Obstacles and Opportunities for Learning from Demonstration in Practical Industrial Assembly: A Systematic Literature Review

abstract: Learning from demonstration is one of the most promising methods to counteract the challenging long-term trends in repetitive industrial assembly. It offers not only a programming technique that is accessible to workers on the shop floor, reducing the need for robot experts and the associated costs but also a possible solution to the observable shift from mass-production to mass-customisation through flexible and generalising systems. Since the emergence of the learning from demonstration idea in the 1980s, its methodologies, capabilities, and achievements have constantly evolved. However, despite reports of continued progress in academic publications, the concept has not yet robustly emerged across the assembly industry. In light of its great potential, this paper presents the findings from a systematic literature review following the updated Preferred Reporting Items for Systematic Reviews (PRISMA) guidelines. It aims to provide an overview of the state-of-the-art learning from demonstration solutions developed for assembly-related tasks and offer a critical discussion of remaining obstacles in order to drive its progression towards meaningful deployments. The analysis includes a total of 61 papers over the period of 2013-2023 sourced from Scopus and Web of Science databases. Findings indicate that learning from demonstration has attained a significant level of maturity within the research environment, as evidenced by thorough experimental achievements, proving its great promise for industrial assembly applications. However, critical obstacles exist in the area of proven practicability, task complexity and diversity, generalisation, performance evaluation and integration concepts that require attention to promote its widespread adoption and create a seamless transition into industrial practices.


title: A Unified Framework for Generative Data Augmentation: A Comprehensive Survey

abstract: Generative data augmentation (GDA) has emerged as a promising technique to alleviate data scarcity in machine learning applications. This thesis presents a comprehensive survey and unified framework of the GDA landscape. We first provide an overview of GDA, discussing its motivation, taxonomy, and key distinctions from synthetic data generation. We then systematically analyze the critical aspects of GDA - selection of generative models, techniques to utilize them, data selection methodologies, validation approaches, and diverse applications. Our proposed unified framework categorizes the extensive GDA literature, revealing gaps such as the lack of universal benchmarks. The thesis summarises promising research directions, including , effective data selection, theoretical development for large-scale models' application in GDA and establishing a benchmark for GDA. By laying a structured foundation, this thesis aims to nurture more cohesive development and accelerate progress in the vital arena of generative data augmentation.


title: A bibliometric Analysis on Spectrum Sensing in Wireless Networks

abstract: Spectrum scarcity is a prevalent problem in wireless networks due to the strict allotment of the spectrum (frequency bands) to licensed users by network regulatory bodies. Such an operation implies that the unlicensed users (secondary wireless spectrum users) have to evacuate the spectrum when the primary wireless spectrum users (licensed users) are utilizing the frequency bands to avoid interference. Cognitive radio alleviates the spectrum shortage by detecting unoccupied frequency bands. This reduces the underutilization of frequency bands in wireless networks. There have been numerous related studies on spectrum sensing, however, few studies have conducted a bibliometric analysis on this subject. The goal of this study was to conduct a bibliometric analysis on the optimization of spectrum sensing. The PRISMA methodology was the basis for the bibliometric analysis to identify the limitations of the existing spectrum sensing techniques. The findings revealed that various machine learning or hybrid models outperformed the traditional techniques such as matched filter and energy detectors at the lowest signal to noise ratio (SNR). SNR is the ratio of the desired signal magnitude to the background noise magnitude. This study, therefore, recommends researchers propose alternative techniques to optimize (improve) spectrum sensing in wireless networks. More work should be done to develop models that optimize spectrum sensing at low SNR.


title: Completion under strong homotopy cokernels

abstract: For A a category with finite colimits, we show that the embedding of A into the category of arrows Arr(A) determined by the initial object is the completion of A under strong homotopy cokernels. The nullhomotopy structure of Arr(A) (needed in order to express the notion of homotopy cokernel) is the usual one induced by the canonical string of adjunctions between A and Arr(A).


title: Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration

abstract: Large Language Models (LLMs) are evolving at an unprecedented pace and have exhibited considerable capability in the realm of natural language processing (NLP) with world knowledge. Benefiting from ultra-large-scale training corpora, a single LLM can manage typical NLP tasks competently. However, its performance in executing reasoning tasks is still confined by the limitations of its internal representations. To push this boundary further, we introduce Corex in this paper, a suite of novel general-purpose strategies that transform LLMs into autonomous agents pioneering multi-model collaborations for complex task-solving. Inspired by human behaviors, Corex is constituted by diverse collaboration paradigms including Debate, Review, and Retrieve modes, which collectively work towards enhancing the factuality, faithfulness, and reliability of the reasoning process. These paradigms foster task-agnostic approaches that enable LLMs to ''think outside the box,'' thereby overcoming hallucinations and providing better solutions. Through extensive experiments across four different types of reasoning tasks, we demonstrate that orchestrating multiple LLMs to work in concert yields substantially better performance compared to existing methods. Further results and in-depth analysis demonstrate the cost-effectiveness of our method, facilitating collaboration among different LLMs and promoting annotation efficiency.


title: On the Constants and Extremal Function and Sequence for Hardy Inequalities in $L_p$ and $l_p$

abstract: We study the behavior of the smallest possible constants $d(a,b)$ and $d_n$ in Hardy inequalities $$ \int_a^b\left(\frac{1}{x}\int_a^xf(t)dt\right)^p\,dx\leq d(a,b)\,\int_a^b [f(x)]^p dx $$ and $$ \sum_{k=1}^{n}\Big(\frac{1}{k}\sum_{j=1}^{k}a_j\Big)^p\leq d_n\,\sum_{k=1}^{n}a_k^p. $$ The exact rate of convergence of $d(a,b)$ and $d_n$ is established and the ``almost extremal'' function and sequence are found.


title: High gas pressure and high-temperature synthesis (HP-HTS) technique and its impact on iron-based superconductors

abstract: The high-pressure growth technique generally plays an important role in the improvement of the sample quality and the enhancement of various physical and magnetic properties of materials. The high gas pressure technique provides a large sample space (10-15 cm) to grow various kinds of materials. In this paper, we introduce the high gas pressure and high-temperature synthesis (HP-HTS) technique that is present at our institute and is applied to the growth process of different kinds of superconducting materials, particularly iron-based superconductors. More details and the working principle of this HP-HTS technique are discussed. We have also demonstrated the current results based on the iron-based superconductors by using this unique HP-HTS technique. These results demonstrate the enhancement of the superconducting properties with the improved sample quality compared to the conventional synthesis process at ambient pressure.


title: Active Learning Based Fine-Tuning Framework for Speech Emotion Recognition

abstract: Speech emotion recognition (SER) has drawn increasing attention for its applications in human-machine interaction. However, existing SER methods ignore the information gap between the pre-training speech recognition task and the downstream SER task, leading to sub-optimal performance. Moreover, they require much time to fine-tune on each specific speech dataset, restricting their effectiveness in real-world scenes with large-scale noisy data. To address these issues, we propose an active learning (AL) based Fine-Tuning framework for SER that leverages task adaptation pre-training (TAPT) and AL methods to enhance performance and efficiency. Specifically, we first use TAPT to minimize the information gap between the pre-training and the downstream task. Then, AL methods are used to iteratively select a subset of the most informative and diverse samples for fine-tuning, reducing time consumption. Experiments demonstrate that using only 20\%pt. samples improves 8.45\%pt. accuracy and reduces 79\%pt. time consumption.


title: Wormhole influence on the false vacuum bubble tunneling

abstract: In this study, we generalize the work of Farhi, Guth and Guven [Nucl. Phys. B 339 (1990) 417] to include a wormhole effect. We study the influence of the wormhole on the tunneling of the false vacuum bubble. The spherically symmetric bubble has two domain walls. The classical dynamics of each domain wall are constrained by two classically forbidden regions. We find that the wormhole has increased the number of instantons and thus can enhance the tunneling rate. We have analytically derived the formula for the bubble tunneling rate, which is consistent with the result obtained by Farhi, Guth and Guven when the wormhole disappears. We show that the tunneling rate increases with the throat radius of the wormhole. Furthermore, we illustrate that the tunneling rate increases with an increases in the mass of the black hole or the surface tension. In the case where a wormhole exists within a bubble and is connected to another universe, we demonstrate that the bubble can enter into another universe through quantum tunneling.


title: Optimal Local Measurements in Many-body Quantum Metrology

abstract: Quantum measurements are key to quantum metrology. Constrained by experimental capabilities, collective measurements on a large number of copies of metrological probes can pose significant challenges. Therefore, the locality in quantum measurements must be considered. In this work, we propose a method dubbed as the "iterative matrix partition" approach to elucidate the underlying structures of optimal local measurements, with and without classical communications, that saturate the quantum Cram\'er-Rao Bound (qCRB). Furthermore, we find that while exact saturation is possible for all two-qubit pure states, it is generically restrictive for multi-qubit pure states. However, we demonstrate that the qCRB can be universally saturated in an approximate manner through adaptive coherent controls, as long as the initial state is separable and the Hamiltonian allows for interaction. Our results bridge the gap between theoretical proposals and experiments in many-body metrology and can find immediate applications in noisy intermediate-scale quantum devices.

categories: quant-ph cond-mat.quant-gas cs.IT math.IT math.OC physics.atom-ph


title: Linear stability of the elliptic relative equilibria for the restricted N-body problem: two special cases

abstract: In this paper, we consider the elliptic relative equilibria of the restricted $N$-body problems, where the $N-1$ primaries form an Euler-Moulton collinear central configuration or a $(1+n)$-gon central configuration. We obtain the symplectic reduction to the general restricted $N$-body problem. For the first case, by analyzing the relationship between this restricted $N$-body problems and the elliptic Lagrangian solutions, we obtain the linear stability of the restricted $N$-body problem by the $\omega$-Maslov index. Via numerical computations, we also obtain conditions of the stability on the mass parameters under $N=4$ and the symmetry of the central configuration. For the second case, there exist three positions $S_1,S_2$ and $S_3$ of the massless body (up to rotations of angle $\frac{2\pi}{n}$). For ${m_0\over m}$ sufficiently large, we show that the elliptic relative equilibria is linearly unstable if the eccentricity $0\le e<e_0$ and the massless body lies at $S_1$ or $S_2$; while the elliptic relative equilibria is linear stability if the massless body lies at $S_3$.


title: InFER: A Multi-Ethnic Indian Facial Expression Recognition Dataset

abstract: The rapid advancement in deep learning over the past decade has transformed Facial Expression Recognition (FER) systems, as newer methods have been proposed that outperform the existing traditional handcrafted techniques. However, such a supervised learning approach requires a sufficiently large training dataset covering all the possible scenarios. And since most people exhibit facial expressions based upon their age group, gender, and ethnicity, a diverse facial expression dataset is needed. This becomes even more crucial while developing a FER system for the Indian subcontinent, which comprises of a diverse multi-ethnic population. In this work, we present InFER, a real-world multi-ethnic Indian Facial Expression Recognition dataset consisting of 10,200 images and 4,200 short videos of seven basic facial expressions. The dataset has posed expressions of 600 human subjects, and spontaneous/acted expressions of 6000 images crowd-sourced from the internet. To the best of our knowledge InFER is the first of its kind consisting of images from 600 subjects from very diverse ethnicity of the Indian Subcontinent. We also present the experimental results of baseline & deep FER methods on our dataset to substantiate its usability in real-world practical applications.


title: Parallel in-memory wireless computing

abstract: Parallel wireless digital communication with ultralow power consumption is critical for emerging edge technologies such as 5G and Internet of Things. However, the physical separation between digital computing units and analogue transmission units in traditional wireless technology leads to high power consumption. Here we report a parallel in-memory wireless computing scheme. The approach combines in-memory computing with wireless communication using memristive crossbar arrays. We show that the system can be used for the radio transmission of a binary stream of 480 bits with a bit error rate of 0. The in-memory wireless computing uses two orders of magnitude less power than conventional technology (based on digital-to-analogue and analogue-to-digital converters). We also show that the approach can be applied to acoustic and optical wireless communications

categories: cs.AR cs.ET cs.SY eess.SY physics.app-ph


title: Pubic Symphysis-Fetal Head Segmentation Using Pure Transformer with Bi-level Routing Attention

abstract: In this paper, we propose a method, named BRAU-Net, to solve the pubic symphysis-fetal head segmentation task. The method adopts a U-Net-like pure Transformer architecture with bi-level routing attention and skip connections, which effectively learns local-global semantic information. The proposed BRAU-Net was evaluated on transperineal Ultrasound images dataset from the pubic symphysis-fetal head segmentation and angle of progression (FH-PS-AOP) challenge. The results demonstrate that the proposed BRAU-Net achieves comparable a final score. The codes will be available at https://github.com/Caipengzhou/BRAU-Net.


title: Universality of almost periodicity in bounded discrete time series

abstract: We consider arbitrary bounded discrete time series. From its statistical feature, without any use of the Fourier transform, we find an almost periodic function which suitably characterizes the corresponding time series.

categories: cs.LG cs.IT math.AP math.DS math.FA math.IT


title: Coexistence of insulating phases in confined fermionic chains with a Wannier-Stark potential

abstract: We study fermions on a finite chain, interacting repulsively when residing on the same and on nearest-neighbor sites, and subjected to a Wannier-Stark linearly-varying potential. Using the density matrix renormalization-group numerical technique to solve this generalized extended Hubbard model, the ground state exhibits a staircase of (quasi) plateaus in the average local site density along the chain, decreasing from being doubly-filled to empty as the potential increases. These `plateaus' represent locked-in commensurate phases of charge density waves together with band and Mott insulators. These phases are separated by incompressible regions with incommensurate fillings. It is suggested that experimental variations of the slope of the potential and of the range of the repulsive interactions will produce such a coexistence of phases which have been individually expected theoretically and observed experimentally for uniform systems.


title: Structure of measures for which Ehrhard symmetrization is perimeter non-increasing

abstract: In this paper, we prove that isotropic Gaussian functions are characterized by a rearrangement inequality for weighted perimeter in dimensions $n \ge 2$ within the class of non-negative weights in $L^1(\mathbb{R}^n) \cap W^{1,1}_{loc}(\mathbb{R}^n)$. More specifically, we prove that within this class generalized Ehrhard symmetrization is perimeter non-increasing for all Borel sets $E$ in all directions $\vec{v}$ if and only if the distribution function is an isotropic Gaussian.


title: Rapid Scan White Light Two-dimensional Electronic Spectroscopy with 100 kHz Shot-to-Shot Detection

abstract: We demonstrate an approach to two-dimensional electronic spectroscopy (2DES) that combines the benefits of shot-to-shot detection at high-repetition rates with the simplicity of a broadband white light continuum input and conventional optical elements to generate phase-locked pump pulse pairs. We demonstrate this through mutual synchronization between the laser repetition rate, acousto-optical deflector (AOD), pump delay stage and the CCD line camera, which allows rapid scanning of pump optical delay synchronously with the laser repetition rate while the delay stage is moved at a constant velocity. The resulting shot-to-shot detection scheme is repetition rate scalable and only limited by the CCD line rate and the maximum stage velocity. Using this approach, we demonstrate measurement of an averaged 2DES absorptive spectrum in as much as 1.2 seconds of continuous sample exposure per 2D spectrum. We achieve a signal-to-noise ratio (SNR) of 6.8 for optical densities down to 0.05 with 11.6 seconds of averaging at 100 kHz laser repetition rate. Combining rapid scanning of mechanical delay lines with shot-to-shot detection as demonstrated here provides a viable alternative to acousto-optic pulse shaping (AOPS) approaches that is repetition-rate scalable, has comparable throughput and sensitivity, and minimizes sample exposure per 2D spectrum with promising micro-spectroscopy applications.


title: RIS-aided Near-Field MIMO Communications: Codebook and Beam Training Design

abstract: Downlink reconfigurable intelligent surface (RIS)-assisted multi-input-multi-output (MIMO) systems are considered with far-field, near-field, and hybrid-far-near-field channels. According to the angular or distance information contained in the received signals, 1) a distance-based codebook is designed for near-field MIMO channels, based on which a hierarchical beam training scheme is proposed to reduce the training overhead; 2) a combined angular-distance codebook is designed for mixed-far-near-field MIMO channels, based on which a two-stage beam training scheme is proposed to achieve alignment in the angular and distance domains separately. For maximizing the achievable rate while reducing the complexity, an alternating optimization algorithm is proposed to carry out the joint optimization iteratively. Specifically, the RIS coefficient matrix is optimized through the beam training process, the optimal combining matrix is obtained from the closed-form solution for the mean square error (MSE) minimization problem, and the active beamforming matrix is optimized by exploiting the relationship between the achievable rate and MSE. Numerical results reveal that: 1) the proposed beam training schemes achieve near-optimal performance with a significantly decreased training overhead; 2) compared to the angular-only far-field channel model, taking the additional distance information into consideration will effectively improve the achievable rate when carrying out beam design for near-field communications.


title: Anomalous emission from Li- and Na-like ions in the Corona heated via Alfv\'{e}n wave

abstract: The solar ultraviolet intensities of spectral lines originating from Li- and Na-like ions have been observed to surpass the expectations derived from plasmas with coronal approximation. The violation of the coronal approximation can be partially attributed to non-equilibrium ionization (NEI) due to dynamic processes occurring in the vicinity of the transition region. To investigate the impact of these dynamics in Alfv\'{e}n-wave-heated coronal loop, a set of equations governing NEI for multiple ion species was solved numerically in conjunction with 1.5-dimensional magnetohydrodynamic equations. Following the injection of Alfv\'{e}n waves from the photosphere, the system undergoes a time evolution characterized by phases of evaporation, condensation, and quasi-steady states. During the evaporation phase, the ionization fractions of Li- and Na-like ions were observed to increase when compared to the fractions in ionization equilibrium, which lead to the intensity enhancement of up to 1.6. This over-fractionation of Li- and Na-like ions was found to be induced by the evaporation process. While collisions between shocks and the transition region temporarily led to deviations from ionization equilibrium, on average over time, these deviations were negligible. Conversely, under-fractions of the ionization fraction led to intensity reduction of down to 0.9 during the condensation phase and the quasi-steady state. Given the dependency of the over/under-fractionation on mass circulations between the chromosphere and the corona, these observations will serve as valuable benchmarks to validate not only Alfv\'{e}n wave models but also other existing mechanisms on coronal heating.


title: QUIZ: An Arbitrary Volumetric Point Matching Method for Medical Image Registration

abstract: Rigid pre-registration involving local-global matching or other large deformation scenarios is crucial. Current popular methods rely on unsupervised learning based on grayscale similarity, but under circumstances where different poses lead to varying tissue structures, or where image quality is poor, these methods tend to exhibit instability and inaccuracies. In this study, we propose a novel method for medical image registration based on arbitrary voxel point of interest matching, called query point quizzer (QUIZ). QUIZ focuses on the correspondence between local-global matching points, specifically employing CNN for feature extraction and utilizing the Transformer architecture for global point matching queries, followed by applying average displacement for local image rigid transformation. We have validated this approach on a large deformation dataset of cervical cancer patients, with results indicating substantially smaller deviations compared to state-of-the-art methods. Remarkably, even for cross-modality subjects, it achieves results surpassing the current state-of-the-art.


title: Understanding In-Context Learning from Repetitions

abstract: This paper explores the elusive mechanism underpinning in-context learning in Large Language Models (LLMs). Our work provides a novel perspective by examining in-context learning via the lens of surface repetitions. We quantitatively investigate the role of surface features in text generation, and empirically establish the existence of \emph{token co-occurrence reinforcement}, a principle that strengthens the relationship between two tokens based on their contextual co-occurrences. By investigating the dual impacts of these features, our research illuminates the internal workings of in-context learning and expounds on the reasons for its failures. This paper provides an essential contribution to the understanding of in-context learning and its potential limitations, providing a fresh perspective on this exciting capability.


title: Compilation Semantics for a Programming Language with Versions

abstract: Programming with versions is a paradigm that allows a program to use multiple versions of a module so that the programmer can selectively use functions from both older and newer versions of a single module. Previous work formalized $\lambda_{\mathrm{VL}}$, a core calculus for programming with versions, but it has not been integrated into practical programming languages. In this paper, we propose VL, a Haskell-subset surface language for $\lambda_{\mathrm{VL}}$ along with its compilation method. We formally describe the core part of the VL compiler, which translates from the surface language to the core language by leveraging Girard's translation, soundly infers the consistent version of expressions along with their types, and generates a multi-version interface by bundling specific-version interfaces. We conduct a case study to show how VL supports practical software evolution scenarios and discuss the method's scalability.


title: RelBERT: Embedding Relations with Language Models

abstract: Many applications need access to background knowledge about how different concepts and entities are related. Although Knowledge Graphs (KG) and Large Language Models (LLM) can address this need to some extent, KGs are inevitably incomplete and their relational schema is often too coarse-grained, while LLMs are inefficient and difficult to control. As an alternative, we propose to extract relation embeddings from relatively small language models. In particular, we show that masked language models such as RoBERTa can be straightforwardly fine-tuned for this purpose, using only a small amount of training data. The resulting model, which we call RelBERT, captures relational similarity in a surprisingly fine-grained way, allowing us to set a new state-of-the-art in analogy benchmarks. Crucially, RelBERT is capable of modelling relations that go well beyond what the model has seen during training. For instance, we obtained strong results on relations between named entities with a model that was only trained on lexical relations between concepts, and we observed that RelBERT can recognise morphological analogies despite not being trained on such examples. Overall, we find that RelBERT significantly outperforms strategies based on prompting language models that are several orders of magnitude larger, including recent GPT-based models and open source models.


title: An Easy Rejection Sampling Baseline via Gradient Refined Proposals

abstract: Rejection sampling is a common tool for low dimensional problems ($d \leq 2$), often touted as an "easy" way to obtain valid samples from a distribution $f(\cdot)$ of interest. In practice it is non-trivial to apply, often requiring considerable mathematical effort to devise a good proposal distribution $g(\cdot)$ and select a supremum $C$. More advanced samplers require additional mathematical derivations, limitations on $f(\cdot)$, or even cross-validation, making them difficult to apply. We devise a new approximate baseline approach to rejection sampling that works with less information, requiring only a differentiable $f(\cdot)$ be specified, making it easier to use. We propose a new approach to rejection sampling by refining a parameterized proposal distribution with a loss derived from the acceptance threshold. In this manner we obtain comparable or better acceptance rates on current benchmarks by up to $7.3\times$, while requiring no extra assumptions or any derivations to use: only a differentiable $f(\cdot)$ is required. While approximate, the results are correct with high probability, and in all tests pass a distributional check. This makes our approach easy to use, reproduce, and efficacious.


title: Enhancing the Hierarchical Environment Design via Generative Trajectory Modeling

abstract: Unsupervised Environment Design (UED) is a paradigm for automatically generating a curriculum of training environments, enabling agents trained in these environments to develop general capabilities, i.e., achieving good zero-shot transfer performance. However, existing UED approaches focus primarily on the random generation of environments for open-ended agent training. This is impractical in scenarios with limited resources, such as the constraints on the number of generated environments. In this paper, we introduce a hierarchical MDP framework for environment design under resource constraints. It consists of an upper-level RL teacher agent that generates suitable training environments for a lower-level student agent. The RL teacher can leverage previously discovered environment structures and generate environments at the frontier of the student's capabilities by observing the student policy's representation. Moreover, to reduce the time-consuming collection of experiences for the upper-level teacher, we utilize recent advances in generative modeling to synthesize a trajectory dataset to train the teacher agent. Our proposed method significantly reduces the resource-intensive interactions between agents and environments and empirical experiments across various domains demonstrate the effectiveness of our approach.


title: Femtosecond electron transfer dynamics across the D$_2$O/Cs$^+$/Cu(111) interface: The impact of hydrogen bonding

abstract: Hydrogen bonding is essential in electron transfer processes at water-electrode interfaces. We study the impact of the H-bonding of water as a solvent molecule on real-time electron transfer dynamics across a Cs+-Cu(111) ion-metal interface using femtosecond time-resolved two-photon photoelectron spectroscopy. We distinguish in the formed water-alkali aggregates two regimes below and above two water molecules per ion. Upon crossing the boundary of these regimes, the lifetime of the excess electron localized transiently at the Cs+ ion increases from 40 to 60 femtoseconds, which indicates a reduced alkali-metal interaction. Furthermore, the energy transferred to a dynamic structural rearrangement due to hydration is reduced from 0.3 to 0.2 eV concomitantly. These effects are a consequence of H-bonding and the beginning formation of a nanoscale water network. This finding is supported by real-space imaging of the solvatomers and vibrational frequency shifts of the OH stretch and bending modes calculated for these specific interfaces.


title: SRG/eROSITA catalogue of X-ray active SDSS dwarf galaxies

abstract: We present a sample of 99 dwarf galaxies ($M_*<10^{9.5} M_\odot$) with X-ray activity in their central regions. The sample was obtained from a match of the SRG/eROSITA X-ray catalogue in the Eastern Galactic hemisphere with the MPA-JHU SDSS catalogue. The obtained matches were cleaned rigorously with the help of external optical catalogues to increase the purity of the sample. This work is the largest study of this kind -- X-ray activity in $\approx 85$ per cent of matched dwarfs was not reported before. The majority of X-ray active dwarfs are identified as star-forming galaxies. However, the X-ray luminosity of 82 objects cannot be explained by the collective emission of X-ray binaries, rendering them strong candidates for dwarf galaxies with an active accreting black hole in their centre. We find that the fraction of AGN among dwarf galaxies drops from $\sim 2\cdot 10^{-2}$ at $L_X\sim 10^{39}$ erg/s to $\sim (2-4)\cdot 10^{-4}$ at $L_X\sim 10^{41}$ erg/s and increases with the stellar mass of the host galaxy. We serendipitously discovered sources with unexpected properties. We report on a tidal disruption event (TDE) candidate in a dwarf galaxy, a massive black hole in a dwarf galaxy with a soft thermal spectrum, a luminous dwarf galaxy with an obscured X-ray spectrum and a few other peculiar sources. We found three Ultra-luminous X-ray source (ULX) candidates and a sample of X-ray bright galaxy pairs, in four of which both members shine in X-rays.


title: Indispensability of orbital angular momentum states in secure quantum communication tasks

abstract: Quantum key distribution protocols have been designed for layered networks employing multidimensional entangled and separable orbital angular momentum states [Phys. Rev. A 97, 032312 (2018), Int. J. Theor. Phys. 62, 104 (2023)]. This paper seeks an answer to the overarching question -- in the context of secure quantum communication tasks, do orbital angular momentum states act merely as an alternative or do they act as an indispensable resource? We start by showing that the task of quantum key distribution in layered networks can also be accomplished with several copies of lower-dimensional states such as polarization qubits. For this reason, orbital angular momentum states do not offer any intrinsic advantage in layered quantum key distribution. The potential of OAM states unveils itself in the enhancement of key generation rates and integrated quantum communication tasks, which we present in this paper. These tasks can be implemented exclusively with high-dimensional OAM entangled states. In fact, we show that the employment of orbital angular momentum states eliminates the need for entangled state measurements, whose implementation is resource-intensive. We believe that this study opens up a possibility for designing several quantum information processing tasks in which multidimensional OAM states act as an indispensable resource.


title: Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Method

abstract: While large pre-trained language models (LLMs) have shown their impressive capabilities in various NLP tasks, they are still under-explored in the misinformation domain. In this paper, we examine LLMs with in-context learning (ICL) for news claim verification, and find that only with 4-shot demonstration examples, the performance of several prompting methods can be comparable with previous supervised models. To further boost performance, we introduce a Hierarchical Step-by-Step (HiSS) prompting method which directs LLMs to separate a claim into several subclaims and then verify each of them via multiple questions-answering steps progressively. Experiment results on two public misinformation datasets show that HiSS prompting outperforms state-of-the-art fully-supervised approach and strong few-shot ICL-enabled baselines.


title: A survey on the Riemann-Lebesgue integrability in non-additive setting

abstract: We present in this survey some results regarding Riemann_Lebesgue integrability with respect to arbitrary non-additive set functions.


title: Dual-Augmented Transformer Network for Weakly Supervised Semantic Segmentation

abstract: Weakly supervised semantic segmentation (WSSS), a fundamental computer vision task, which aims to segment out the object within only class-level labels. The traditional methods adopt the CNN-based network and utilize the class activation map (CAM) strategy to discover the object regions. However, such methods only focus on the most discriminative region of the object, resulting in incomplete segmentation. An alternative is to explore vision transformers (ViT) to encode the image to acquire the global semantic information. Yet, the lack of transductive bias to objects is a flaw of ViT. In this paper, we explore the dual-augmented transformer network with self-regularization constraints for WSSS. Specifically, we propose a dual network with both CNN-based and transformer networks for mutually complementary learning, where both networks augment the final output for enhancement. Massive systemic evaluations on the challenging PASCAL VOC 2012 benchmark demonstrate the effectiveness of our method, outperforming previous state-of-the-art methods.


title: On the finite separability of finitely generated associative rings

abstract: We find necessary and sufficient conditions for the finite separability of monogenic rings. As a corollary, we prove that a finitely generated torsion-free PI-ring is finitely separable if and only if its additive group is finitely generated.


title: An Adaptation of the AAA-Interpolation Algorithm for Model Reduction of MIMO Systems

abstract: We consider the Adaptive Antoulas-Anderson (AAA) rational interpolation algorithm recently developed by Trefethen and co-authors, which can be viewed as a type of moment-matching technique for system realization and approximation. We consider variations on this algorithm that are suitable for model reduction of linear time invariant systems while addressing some of the shortcomings of the block-AAA variant of the algorithm for MIMO systems. In particular, we develop state-space formulas and keep track of the state-space dimension at every step of the adaptive block-AAA algorithm, showing an unfavorable increase of the state dimension. We propose a new low-rank adaptive interpolation algorithm that addresses this shortcoming. Comparative computational results are included for the algorithms above, together with comparisons to balanced reduction.


title: An easy zero-shot learning combination: Texture Sensitive Semantic Segmentation IceHrNet and Advanced Style Transfer Learning Strategy

abstract: We proposed an easy method of Zero-Shot semantic segmentation by using style transfer. In this case, we successfully used a medical imaging dataset (Blood Cell Imagery) to train a model for river ice semantic segmentation. First, we built a river ice semantic segmentation dataset IPC_RI_SEG using a fixed camera and covering the entire ice melting process of the river. Second, a high-resolution texture fusion semantic segmentation network named IceHrNet is proposed. The network used HRNet as the backbone and added ASPP and Decoder segmentation heads to retain low-level texture features for fine semantic segmentation. Finally, a simple and effective advanced style transfer learning strategy was proposed, which can perform zero-shot transfer learning based on cross-domain semantic segmentation datasets, achieving a practical effect of 87% mIoU for semantic segmentation of river ice without target training dataset (25% mIoU for None Stylized, 65% mIoU for Conventional Stylized, our strategy improved by 22%). Experiments showed that the IceHrNet outperformed the state-of-the-art methods on the texture-focused dataset IPC_RI_SEG, and achieved an excellent result on the shape-focused river ice datasets. In zero-shot transfer learning, IceHrNet achieved an increase of 2 percentage points compared to other methods. Our code and model are published on https://github.com/PL23K/IceHrNet.


title: Efficient Planning with Latent Diffusion

abstract: Temporal abstraction and efficient planning pose significant challenges in offline reinforcement learning, mainly when dealing with domains that involve temporally extended tasks and delayed sparse rewards. Existing methods typically plan in the raw action space and can be inefficient and inflexible. Latent action spaces offer a more flexible paradigm, capturing only possible actions within the behavior policy support and decoupling the temporal structure between planning and modeling. However, current latent-action-based methods are limited to discrete spaces and require expensive planning. This paper presents a unified framework for continuous latent action space representation learning and planning by leveraging latent, score-based diffusion models. We establish the theoretical equivalence between planning in the latent action space and energy-guided sampling with a pretrained diffusion model and incorporate a novel sequence-level exact sampling method. Our proposed method, $\texttt{LatentDiffuser}$, demonstrates competitive performance on low-dimensional locomotion control tasks and surpasses existing methods in higher-dimensional tasks.


title: Kerr-Vaidya type radiating black holes in semi-classical gravity with conformal anomaly

abstract: Static black holes in the conformal anomaly-sourced semi-classical General Relativity in four dimensions were extended to rotating, stationary solutions, recently. These quantum-corrected black holes show different features compared to the Kerr black hole and need for further extensions. Here we remove the condition of stationarity and find radiating (Kerr-Vaidya-type) solutions in the same theory augmented with a cosmological constant. As long as the coupling constant $\alpha$ of the $A$-type trace anomaly is non-zero, we show that $i)$ the cosmological constant is bounded from above, i.e $\Lambda \le \frac{3}{4 \alpha}$; $ii)$ static black holes exist but they may not be unique; $iii)$ static black holes do not satisfy the second law of black hole thermodynamics; $iv)$ static black holes may have unstable inner horizons; $v)$ In the nonstationary and axially symmetric case, stability of the event horizon and the second law of thermodynamics black holes are problematic.


title: Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in Large Language Models

abstract: Large language models (LLMs) exhibit remarkable performance improvement through in-context learning (ICL) by leveraging task-specific examples in the input. However, the mechanisms behind this improvement remain elusive. In this work, we investigate how LLM embeddings and attention representations change following in-context-learning, and how these changes mediate improvement in behavior. We employ neuroscience-inspired techniques such as representational similarity analysis (RSA) and propose novel methods for parameterized probing and measuring ratio of attention to relevant vs. irrelevant information in Llama-2 70B and Vicuna 13B. We designed two tasks with a priori relationships among their conditions: linear regression and reading comprehension. We formed hypotheses about expected similarities in task representations and measured hypothesis alignment of LLM representations before and after ICL as well as changes in attention. Our analyses revealed a meaningful correlation between improvements in behavior after ICL and changes in both embeddings and attention weights across LLM layers. This empirical framework empowers a nuanced understanding of how latent representations shape LLM behavior, offering valuable tools and insights for future research and practical applications.


title: Tracking controllability for the heat equation

abstract: We study the tracking or sidewise controllability of the heat equation. More precisely, we seek for controls that, acting on part of the boundary of the domain where the heat process evolves, aim to assure that the normal trace or flux on the complementary set tracks a given trajectory. The dual equivalent observability problem is identified. It consists on estimating the boundary sources, localized on a given subset of the boundary, out of boundary measurements on the complementary subset. Classical unique continuation and smoothing properties of the heat equation allow us proving approximate tracking controllability properties and the smoothness of the class of trackable trajectories. We also develop a new transmutation method which allows to transfer known results on the sidewise controllability of the wave equation to the tracking controllability of the heat one. Using the flatness approach we also give explicit estimates on the cost of approximate tracking control. The analysis is complemented with a discussion of some possible variants of these results and a list of open problems.


title: Report on chaos bound outside Taub-NUT black holes

abstract: Positions of a charged particle's equilibrium orbits and spatial regions where the chaos bound is violated are found through circular motions of the particle around charged Taub-NUT black holes. Lyapunov exponent is gotten by calculating eigenvalues of a Jacobian matrix in a phase space $(r,\pi_r)$. When the particle's charge is fixed, the positions of the equilibrium orbits gradually move away from the event horizons with the increase of the angular momentum.The result shows that the bound is violated in the near-horizon regions and at a certain distance from the horizons when the charge and NUT parameter are fixed. The spatial regions increase with the increase of the NUT parameter's value.


title: Building pretorsion theories from torsion theories

abstract: We propose two ways of obtaining pretorsion theories starting from torsion theories. The first one uses "comparable" torsion theories, while the second one extends a torsion theory with a Serre subcategory. We provide several applications in module categories, internal groupoids, recollements and representation theory.


title: Xsuite: an integrated beam physics simulation framework

abstract: Xsuite is a newly developed modular simulation package combining in a single flexible and modern framework the capabilities of different tools developed at CERN in the past decades, notably Sixtrack, Sixtracklib, COMBI and PyHEADTAIL. The suite consists of a set of Python modules (Xobjects, Xpart, Xtrack, Xcoll, Xfields, Xdeps) that can be flexibly combined together and with other accelerator-specific and general-purpose python tools to study complex simulation scenarios. The code allows for symplectic modeling of the particle dynamics, combined with the effect of synchrotron radiation, impedances, feedbacks, space charge, electron cloud, beam-beam, beamstrahlung, and electron lenses. For collimation studies, beam-matter interaction is simulated using the K2 scattering model or interfacing Xsuite with the BDSIM/Geant4 library. Tools are available to compute the accelerator optics functions from the tracking model and to generate particle distributions matched to the optics. Different computing platforms are supported, including conventional CPUs, as well as GPUs from different vendors.


title: Decoding Realistic Images from Brain Activity with Contrastive Self-supervision and Latent Diffusion

abstract: Reconstructing visual stimuli from human brain activities provides a promising opportunity to advance our understanding of the brain's visual system and its connection with computer vision models. Although deep generative models have been employed for this task, the challenge of generating high-quality images with accurate semantics persists due to the intricate underlying representations of brain signals and the limited availability of parallel data. In this paper, we propose a two-phase framework named Contrast and Diffuse (CnD) to decode realistic images from functional magnetic resonance imaging (fMRI) recordings. In the first phase, we acquire representations of fMRI data through self-supervised contrastive learning. In the second phase, the encoded fMRI representations condition the diffusion model to reconstruct visual stimulus through our proposed concept-aware conditioning method. Experimental results show that CnD reconstructs highly plausible images on challenging benchmarks. We also provide a quantitative interpretation of the connection between the latent diffusion model (LDM) components and the human brain's visual system. In summary, we present an effective approach for reconstructing visual stimuli based on human brain activity and offer a novel framework to understand the relationship between the diffusion model and the human brain visual system.


title: Time-Variant Overlap-Add in Partitions

abstract: Virtual and augmented realities are increasingly popular tools in many domains such as architecture, production, training and education, (psycho)therapy, gaming, and others. For a convincing rendering of sound in virtual and augmented environments, audio signals must be convolved in real-time with impulse responses that change from one moment in time to another. Key requirements for the implementation of such time-variant real-time convolution algorithms are short latencies, moderate computational cost and memory footprint, and no perceptible switching artifacts. In this engineering report, we introduce a partitioned convolution algorithm that is able to quickly switch between impulse responses without introducing perceptible artifacts, while maintaining a constant computational load and low memory usage. Implementations in several popular programming languages are freely available via GitHub.


title: Further remarks on de Sitter space, extremal surfaces and time entanglement

abstract: We develop further the investigations in arXiv:2210.12963 [hep-th] on de Sitter space, extremal surfaces and time entanglement. We discuss the no-boundary de Sitter extremal surface areas as certain analytic continuations from $AdS$ while also amounting to space-time rotations. The structure of the extremal surfaces suggests a geometric picture of the time-entanglement or pseudo-entanglement wedge. We also study some entropy relations for multiple subregions. The analytic continuation suggests a heuristic Lewkowycz-Maldacena formulation of the extremal surface areas. In the bulk, this is now a replica formulation on the Wavefunction which suggests interpretation as pseudo-entropy. Finally we also discuss aspects of future-past entangled states and time evolution.


title: Modeling the yield curve of Burundian bond market by parametric models

abstract: The term structure of interest rates (yield curve) is a critical facet of financial analytics, impacting various investment and risk management decisions. It is used by the central bank to conduct and monitor its monetary policy. That instrument reflects the anticipation of inflation and the risk by investors. The rates reported on yield curve are the cornerstone of valuation of all assets. To provide such tool for Burundi financial market, we collected the auction reports of treasury securities from the website of the Central Bank of Burundi. Then, we computed the zero-coupon rates, and estimated actuarial rates of return by applying the Nelson-Siegel and Svensson models. This paper conducts a rigorous comparative analysis of these two prominent parametric yield curve models and finds that the Nelson-Siegel model is the optimal choice for modeling the Burundian yield curve. The findings contribute to the body of knowledge on yield curve modeling, enhancing its precision and applicability in financial markets. Furthermore, this research holds implications for investment strategies, risk management, second market pricing, financial decision-making, and the forthcoming establishment of the Burundian stock market.


title: Red Teaming Game: A Game-Theoretic Framework for Red Teaming Language Models

abstract: Deployable Large Language Models (LLMs) must conform to the criterion of helpfulness and harmlessness, thereby achieving consistency between LLMs outputs and human values. Red-teaming techniques constitute a critical way towards this criterion. Existing work rely solely on manual red team designs and heuristic adversarial prompts for vulnerability detection and optimization. These approaches lack rigorous mathematical formulation, thus limiting the exploration of diverse attack strategy within quantifiable measure and optimization of LLMs under convergence guarantees. In this paper, we present Red-teaming Game (RTG), a general game-theoretic framework without manual annotation. RTG is designed for analyzing the multi-turn attack and defense interactions between Red-team language Models (RLMs) and Blue-team Language Model (BLM). Within the RTG, we propose Gamified Red-teaming Solver (GRTS) with diversity measure of the semantic space. GRTS is an automated red teaming technique to solve RTG towards Nash equilibrium through meta-game analysis, which corresponds to the theoretically guaranteed optimization direction of both RLMs and BLM. Empirical results in multi-turn attacks with RLMs show that GRTS autonomously discovered diverse attack strategies and effectively improved security of LLMs, outperforming existing heuristic red-team designs. Overall, RTG has established a foundational framework for red teaming tasks and constructed a new scalable oversight technique for alignment.


title: Relative Weyl Character formula, Relative Pieri formulas and Branching rules for Classical groups

abstract: We give alternate proofs of the classical branching rules for highest weight representations of a complex reductive group $G$ restricted to a closed regular reductive subgroup $H$, where $(G,H)$ consist of the pairs $(GL(n+1),GL(n))$, $ (Spin(2n+1), Spin(2n)) $ and $(Sp(2n),Sp(2)\times Sp(2n-2))$. Our proof is essentially a long division. The starting point is a relative Weyl character formula and our method is an inductive application of a relative Pieri formula. We also give a proof of the branching rule for the case of $ (Spin(2n), Spin(2n-1))$, by a reduction to the case of $(GL(n),GL(n-1))$.


title: An Interfacial Profile-Preserving Approach for Phase Field Modeling of Incompressible Two-Phase Flows

abstract: In this paper, we introduce an interfacial profile-preserving approach for phase field modeling for simulating incompressible two-phase flows. While the advective Cahn-Hilliard equation effectively captures the topological evolution of complex interfacial structures, it tends to displace the fluid interface from its equilibrium state, impacting simulation accuracy. To tackle this challenge, we present an interfacial profile-preserving formulation that relies on a phase-field-related signed distance function, rather than the phase field function itself. It is solved iteratively to restore the equilibrium interface profile after each time step. This approach effectively minimizes discretization errors and enhances mass conservation accuracy for each phase. Our formulation is discretized using a second-order Total Variation Diminishing (TVD) Runge-Kutta method within iterations and a finite volume scheme in spatial discretization. We quantitatively compare our present profile-preserving method with the original method in terms of accuracy and convergence rate through simulations of a deforming drop in a single vortex and a rising bubble in quiescent fluid, and further validate the applicability through simulations of a two-dimensional contracting liquid filament, a drop impacting a deep liquid pool, and three-dimensional drop deformation in shear flow. Our results exhibit good agreement with analytical solutions, prior numerical results, and experimental data, demonstrating the effectiveness and accuracy of our proposed approach.


title: Automation and miniaturization of Golden Gate DNA assembly reactions using acoustic dispensers

abstract: Golden Gate cloning has become one of the most popular DNA assembly techniques. Its modular and hierarchical structure allows the construction of complex DNA fragments. Over time, Golden Gate cloning allows for the creation of a repository of reusable parts, reducing the cost of frequent sequence validation. However, as the number of reactions and fragments increases, so does the cost of consumables and the potential for human error. Typically, Golden Gate reactions are performed in volumes of 10 to 25 microlitre. Recent technological advances have led to the development of liquid handling robots that use sound to transfer liquids in the nL range from a source plate to a target plate. These acoustic dispensers have become particularly popular in the field of synthetic biology. The use of this technology allows miniaturization and parallelization of molecular reactions in a tip-free manner, making it sustainable by reducing plastic waste and reagent usage. Here, we provide a step-by-step protocol for performing and parallelizing Golden Gate cloning reactions in 1 microlitre total volume.


title: The Beauty of Roots

abstract: A "Littlewood polynomial" is a polynomial whose coefficients are all 1 or -1. The set of all complex roots of all Littlewood polynomials exhibits many complicated, beautiful and fascinating patterns. Some fractal regions of this set closely resemble "dragon sets" formed by iterated function systems. A heuristic argument for this is known, but no precise theorem along these lines has been proved. We invite the reader to try.


title: Memorization with neural nets: going beyond the worst case

abstract: In practice, deep neural networks are often able to easily interpolate their training data. To understand this phenomenon, many works have aimed to quantify the memorization capacity of a neural network architecture: the largest number of points such that the architecture can interpolate any placement of these points with any assignment of labels. For real-world data, however, one intuitively expects the presence of a benign structure so that interpolation already occurs at a smaller network size than suggested by memorization capacity. In this paper, we investigate interpolation by adopting an instance-specific viewpoint. We introduce a simple randomized algorithm that, given a fixed finite dataset with two classes, with high probability constructs an interpolating three-layer neural network in polynomial time. The required number of parameters is linked to geometric properties of the two classes and their mutual arrangement. As a result, we obtain guarantees that are independent of the number of samples and hence move beyond worst-case memorization capacity bounds. We illustrate the effectiveness of the algorithm in non-pathological situations with extensive numerical experiments and link the insights back to the theoretical results.


title: Deployment Corrections: An incident response framework for frontier AI models

abstract: A comprehensive approach to addressing catastrophic risks from AI models should cover the full model lifecycle. This paper explores contingency plans for cases where pre-deployment risk management falls short: where either very dangerous models are deployed, or deployed models become very dangerous. Informed by incident response practices from industries including cybersecurity, we describe a toolkit of deployment corrections that AI developers can use to respond to dangerous capabilities, behaviors, or use cases of AI models that develop or are detected after deployment. We also provide a framework for AI developers to prepare and implement this toolkit. We conclude by recommending that frontier AI developers should (1) maintain control over model access, (2) establish or grow dedicated teams to design and maintain processes for deployment corrections, including incident response plans, and (3) establish these deployment corrections as allowable actions with downstream users. We also recommend frontier AI developers, standard-setting organizations, and regulators should collaborate to define a standardized industry-wide approach to the use of deployment corrections in incident response. Caveat: This work applies to frontier AI models that are made available through interfaces (e.g., API) that provide the AI developer or another upstream party means of maintaining control over access (e.g., GPT-4 or Claude). It does not apply to management of catastrophic risk from open-source models (e.g., BLOOM or Llama-2), for which the restrictions we discuss are largely unenforceable.