title: Make Safe Decisions in Power System: Safe Reinforcement Learning Based Pre-decision Making for Voltage Stability Emergency Control

abstract: The high penetration of renewable energy and power electronic equipment bring significant challenges to the efficient construction of adaptive emergency control strategies against various presumed contingencies in today's power systems. Traditional model-based emergency control methods have difficulty in adapt well to various complicated operating conditions in practice. Fr emerging artificial intelligence-based approaches, i.e., reinforcement learning-enabled solutions, they are yet to provide solid safety assurances under strict constraints in practical power systems. To address these research gaps, this paper develops a safe reinforcement learning (SRL)-based pre-decision making framework against short-term voltage collapse. Our proposed framework employs neural networks for pre-decision formulation, security margin estimation, and corrective action implementation, without reliance on precise system parameters. Leveraging the gradient projection, we propose a security projecting correction algorithm that offers theoretical security assurances to amend risky actions. The applicability of the algorithm is further enhanced through the incorporation of active learning, which expedites the training process and improves security estimation accuracy. Extensive numerical tests on the New England 39-bus system and the realistic Guangdong Provincal Power Grid demonstrate the effectiveness of the proposed framework.


title: Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation

abstract: Continual Test-Time Adaptation (CTTA), which aims to adapt the pre-trained model to ever-evolving target domains, emerges as an important task for vision models. As current vision models appear to be heavily biased towards texture, continuously adapting the model from one domain distribution to another can result in serious catastrophic forgetting. Drawing inspiration from the human visual system's adeptness at processing both shape and texture according to the famous Trichromatic Theory, we explore the integration of a Mixture-of-Activation-Sparsity-Experts (MoASE) as an adapter for the CTTA task. Given the distinct reaction of neurons with low/high activation to domain-specific/agnostic features, MoASE decomposes the neural activation into high-activation and low-activation components with a non-differentiable Spatial Differentiate Dropout (SDD). Based on the decomposition, we devise a multi-gate structure comprising a Domain-Aware Gate (DAG) that utilizes domain information to adaptive combine experts that process the post-SDD sparse activations of different strengths, and the Activation Sparsity Gate (ASG) that adaptively assigned feature selection threshold of the SDD for different experts for more precise feature decomposition. Finally, we introduce a Homeostatic-Proximal (HP) loss to bypass the error accumulation problem when continuously adapting the model. Extensive experiments on four prominent benchmarks substantiate that our methodology achieves state-of-the-art performance in both classification and segmentation CTTA tasks. Our code is now available at https://github.com/RoyZry98/MoASE-Pytorch.


title: Dynamics Models in the Aggressive Off-Road Driving Regime

abstract: Current developments in autonomous off-road driving are steadily increasing performance through higher speeds and more challenging, unstructured environments. However, this operating regime subjects the vehicle to larger inertial effects, where consideration of higher-order states is necessary to avoid failures such as rollovers or excessive impact forces. Aggressive driving through Model Predictive Control (MPC) in these conditions requires dynamics models that accurately predict safety-critical information. This work aims to empirically quantify this aggressive operating regime and its effects on the performance of current models. We evaluate three dynamics models of varying complexity on two distinct off-road driving datasets: one simulated and the other real-world. By conditioning trajectory data on higher-order states, we show that model accuracy degrades with aggressiveness and simpler models degrade faster. These models are also validated across datasets, where accuracies over safety-critical states are reported and provide benchmarks for future work.


title: Partial train and isolate, mitigate backdoor attack

abstract: Neural networks are widely known to be vulnerable to backdoor attacks, a method that poisons a portion of the training data to make the target model perform well on normal data sets, while outputting attacker-specified or random categories on the poisoned samples. Backdoor attacks are full of threats. Poisoned samples are becoming more and more similar to corresponding normal samples, and even the human eye cannot easily distinguish them. On the other hand, the accuracy of models carrying backdoors on normal samples is no different from that of clean models.In this article, by observing the characteristics of backdoor attacks, We provide a new model training method (PT) that freezes part of the model to train a model that can isolate suspicious samples. Then, on this basis, a clean model is fine-tuned to resist backdoor attacks.


title: Causal-Aware Graph Neural Architecture Search under Distribution Shifts

abstract: Graph NAS has emerged as a promising approach for autonomously designing GNN architectures by leveraging the correlations between graphs and architectures. Existing methods fail to generalize under distribution shifts that are ubiquitous in real-world graph scenarios, mainly because the graph-architecture correlations they exploit might be spurious and varying across distributions. We propose to handle the distribution shifts in the graph architecture search process by discovering and exploiting the causal relationship between graphs and architectures to search for the optimal architectures that can generalize under distribution shifts. The problem remains unexplored with following challenges: how to discover the causal graph-architecture relationship that has stable predictive abilities across distributions, and how to handle distribution shifts with the discovered causal graph-architecture relationship to search the generalized graph architectures. To address these challenges, we propose Causal-aware Graph Neural Architecture Search (CARNAS), which is able to capture the causal graph-architecture relationship during the architecture search process and discover the generalized graph architecture under distribution shifts. Specifically, we propose Disentangled Causal Subgraph Identification to capture the causal subgraphs that have stable prediction abilities across distributions. Then, we propose Graph Embedding Intervention to intervene on causal subgraphs within the latent space, ensuring that these subgraphs encapsulate essential features for prediction while excluding non-causal elements. Additionally, we propose Invariant Architecture Customization to reinforce the causal invariant nature of the causal subgraphs, which are utilized to tailor generalized graph architectures. Extensive experiments demonstrate that CARNAS achieves advanced out-of-distribution generalization ability.


title: Formalising the intentional stance: attributing goals and beliefs to stochastic processes

abstract: We are concerned with the behaviour of stochastic systems with inputs and outputs, and how this might relate to the pursuit of a goal. We model this using what we term transducers, which are a mathematical object that captures only the external behaviour of such a system and not its internal state. We present a framework for reasoning about the optimality of such a process, when it is coupled to a 'teleo-environment' consisting of another transducer that also embodies a success criterion. We find that (globally) optimal transducers have a property closely related to Bellman's theorem: a transducer that is optimal in one time step will again be optimal in the next time step, but with respect to a different environment (obtained from the original one by a modified version of Bayesian filtering). We also consider bounded rationality and its relationship to constrained optimality, which in our framework means optimal within some subset of all transducers. We describe a condition that is sufficient for such a subset to have this Bellman property. Additionally, we show that a policy is deterministic if and only if there exists a teleo-envionment for which it is uniquely optimal among the set of all transducers; this is at least conceptually related to classical representation theorems from decision theory. This need not hold for constrained subsets; we give an example of this related to the so-called absent-minded driver problem. All of the formalism is defined using coinduction, following the style proposed by Czajka [9].


title: Nuclear deformation effects in photoproduction of $\rho$ mesons in ultraperipheral isobaric collisions

abstract: We have investigated the $\rho^{0}$ meson photoproduction in ultraperipheral isobaric collisions between $_{44}^{96}\textrm{Ru}+_{44}^{96}\textrm{Ru}$ and $_{40}^{96}\textrm{Zr}+_{40}^{96}\textrm{Zr}$ at $\sqrt{s_{NN}}=200$ GeV, employing the dipole model with the equivalent photon approximation. By implementing the Woods-Saxon distribution to represent the nuclear mass density, which is derived from density functional theory with an inclusion of nuclear deformation effects, we have calculated the transverse momentum $q_{T}$ spectra in isobaric collisions. We observe the characteristic dip behavior in these spectra, indicative of diffraction phenomena in high-energy physics. We notice that the deformation effects cause a nearly linear increase with $q_{T}^{2}$ for $q_{T}^{2}\lesssim0.015$ $\textrm{GeV}^{2}$, aligning with experimental observations. We offer a simple explanation for the observed behavior in these spectra by introducing the effective width of the nuclei in the thickness function. We also extend our discussion on the $\rho^{0}$ meson photoproduction with the targets $^{63}\textrm{Cu}$,$^{197}\textrm{Au}$, and $^{238}\textrm{U}$.


title: A joint model for (un)bounded longitudinal markers, competing risks, and recurrent events using patient registry data

abstract: Joint models for longitudinal and survival data have become a popular framework for studying the association between repeatedly measured biomarkers and clinical events. Nevertheless, addressing complex survival data structures, especially handling both recurrent and competing event times within a single model, remains a challenge. This causes important information to be disregarded. Moreover, existing frameworks rely on a Gaussian distribution for continuous markers, which may be unsuitable for bounded biomarkers, resulting in biased estimates of associations. To address these limitations, we propose a Bayesian shared-parameter joint model that simultaneously accommodates multiple (possibly bounded) longitudinal markers, a recurrent event process, and competing risks. We use the beta distribution to model responses bounded within any interval (a,b) without sacrificing the interpretability of the association. The model offers various forms of association, discontinuous risk intervals, and both gap and calendar timescales. A simulation study shows that it outperforms simpler joint models. We utilize the US Cystic Fibrosis Foundation Patient Registry to study the associations between changes in lung function and body mass index, and the risk of recurrent pulmonary exacerbations, while accounting for the competing risks of death and lung transplantation. Our efficient implementation allows fast fitting of the model despite its complexity and the large sample size from this patient registry. Our comprehensive approach provides new insights into cystic fibrosis disease progression by quantifying the relationship between the most important clinical markers and events more precisely than has been possible before. The model implementation is available in the R package JMbayes2.


title: Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perception

abstract: Biological motion perception (BMP) refers to humans' ability to perceive and recognize the actions of living beings solely from their motion patterns, sometimes as minimal as those depicted on point-light displays. While humans excel at these tasks without any prior training, current AI models struggle with poor generalization performance. To close this research gap, we propose the Motion Perceiver (MP). MP solely relies on patch-level optical flows from video clips as inputs. During training, it learns prototypical flow snapshots through a competitive binding mechanism and integrates invariant motion representations to predict action labels for the given video. During inference, we evaluate the generalization ability of all AI models and humans on 62,656 video stimuli spanning 24 BMP conditions using point-light displays in neuroscience. Remarkably, MP outperforms all existing AI models with a maximum improvement of 29% in top-1 action recognition accuracy on these conditions. Moreover, we benchmark all AI models in point-light displays of two standard video datasets in computer vision. MP also demonstrates superior performance in these cases. More interestingly, via psychophysics experiments, we found that MP recognizes biological movements in a way that aligns with human behavioural data. All data and code will be made public.


title: A First Look at Kolmogorov-Arnold Networks in Surrogate-assisted Evolutionary Algorithms

abstract: Surrogate-assisted Evolutionary Algorithm (SAEA) is an essential method for solving expensive expensive problems. Utilizing surrogate models to substitute the optimization function can significantly reduce reliance on the function evaluations during the search process, thereby lowering the optimization costs. The construction of surrogate models is a critical component in SAEAs, with numerous machine learning algorithms playing a pivotal role in the model-building phase. This paper introduces Kolmogorov-Arnold Networks (KANs) as surrogate models within SAEAs, examining their application and effectiveness. We employ KANs for regression and classification tasks, focusing on the selection of promising solutions during the search process, which consequently reduces the number of expensive function evaluations. Experimental results indicate that KANs demonstrate commendable performance within SAEAs, effectively decreasing the number of function calls and enhancing the optimization efficiency. The relevant code is publicly accessible and can be found in the GitHub repository.


title: DePIN: A Framework for Token-Incentivized Participatory Sensing

abstract: There is always demand for integrating data into microeconomic decision making. Participatory sensing deals with how real-world data may be extracted with stakeholder participation and resolves a problem of Big Data, which is concerned with monetizing data extracted from individuals without their participation. We present how Decentralized Physical Infrastructure Networks (DePINs) extend participatory sensing. We discuss the threat models of these networks and how DePIN cryptoeconomics can advance participatory sensing.


title: Exploring a Multimodal Fusion-based Deep Learning Network for Detecting Facial Palsy

abstract: Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessment by clinicians. In this paper, we present a multimodal fusion-based deep learning model that utilizes unstructured data (i.e. an image frame with facial line segments) and structured data (i.e. features of facial expressions) to detect facial palsy. We then contribute to a study to analyze the effect of different data modalities and the benefits of a multimodal fusion-based approach using videos of 21 facial palsy patients. Our experimental results show that among various data modalities (i.e. unstructured data - RGB images and images of facial line segments and structured data - coordinates of facial landmarks and features of facial expressions), the feed-forward neural network using features of facial expression achieved the highest precision of 76.22 while the ResNet-based model using images of facial line segments achieved the highest recall of 83.47. When we leveraged both images of facial line segments and features of facial expressions, our multimodal fusion-based deep learning model slightly improved the precision score to 77.05 at the expense of a decrease in the recall score.


title: Doubly $\kappa$-deformed Yang models, Born-selfdual $\kappa$-deformed quantum phase spaces and two generalizations of Yang models

abstract: Recently it was shown that by using two different realizations of $\hat{o}(1,4)$ Lie algebra one can describe one-parameter standard Snyder model and two-parameter $\kappa$-deformed Snyder model. In this paper, by using the generalized Born duality and Jacobi identities we obtain from the $\kappa$-deformed Snyder model the doubly $\kappa$-deformed Yang model which provides the new class of quantum relativistic phase spaces. These phase spaces contain as subalgebras the $\kappa$-deformed Minkowski space-time as well as quantum $\tilde{\kappa}$-deformed fourmomenta and are depending on five independent parameters. Such a large class of quantum phase spaces can be described in $D=4$ by particular realizations of $\hat{o}(1,5)$ algebra, what illustrates the property that in noncommutative geometry different $D=4$ physical models may be described by various realizations of the same algebraic structure. Finally, in the last Section we propose two new ways of generalizing Yang models: by introducing $\hat o(1,3+2N)$ algebras ($N=1,2\ldots$) we provide internal symmetries $O(N)$ symmetries in Kaluza-Klein extended Yang model, and by replacing the classical $\hat{o}(1,5)$ algebras which describe the algebraic structure of Yang models by $\hat o(1,5)$ quantum groups with suitably chosen nonprimitive coproducts.


title: On Sequential Loss Approximation for Continual Learning

abstract: We introduce for continual learning Autodiff Quadratic Consolidation (AQC), which approximates the previous loss function with a quadratic function, and Neural Consolidation (NC), which approximates the previous loss function with a neural network. Although they are not scalable to large neural networks, they can be used with a fixed pre-trained feature extractor. We empirically study these methods in class-incremental learning, for which regularization-based methods produce unsatisfactory results, unless combined with replay. We find that for small datasets, quadratic approximation of the previous loss function leads to poor results, even with full Hessian computation, and NC could significantly improve the predictive performance, while for large datasets, when used with a fixed pre-trained feature extractor, AQC provides superior predictive performance. We also find that using tanh-output features can improve the predictive performance of AQC. In particular, in class-incremental Split MNIST, when a Convolutional Neural Network (CNN) with tanh-output features is pre-trained on EMNIST Letters and used as a fixed pre-trained feature extractor, AQC can achieve predictive performance comparable to joint training.


title: Boosting probes of CP violation in the top Yukawa coupling with Deep Learning

abstract: The precise measurement of the top-Higgs coupling is crucial in particle physics, offering insights into potential new physics Beyond the Standard Model (BSM) carrying CP Violation (CPV) effects. In this paper, we explore the CP properties of a Higgs boson coupling with a top quark pair, focusing on events where the Higgs state decays into a pair of $b$-quarks and the top-antitop system decays leptonically. The novelty of our analysis resides in the exploitation of two conditional Deep Learning (DL) networks: a Multi-Layer Perceptron (MLP) and a Graph Convolution Network (GCN). These models are trained for selected CPV phase values and then used to interpolate all possible values ranging from $0 \text{ to } \pi/2$. This enables a comprehensive assessment of sensitivity across all CP phase values, thereby streamlining the process as the models are trained only once. Notably, the conditional GCN exhibits superior performance over the conditional MLP, owing to the nature of graph-based Neural Network (NN) structures. Our Machine Learning (ML) informed findings indicate that assessment of the CP properties of the Higgs coupling to the $t\bar{t}$ pair can be within reach of the HL-LHC, quantitatively surpassing the sensitivity of more traditional approaches.


title: Optimal Intervention Strategies and Cost-effectiveness Analysis study of Tuberculosis with reference to TPT, Malnutrition and Diabetes Management

abstract: Tuberculosis remains a significant global health challenge, with millions of new cases reported annually. Recent studies suggest that expanding the accessibility of TB intervention programs can lead to a substantial decrease in both TB incidence and prevalence. This paper initiates by examining a deterministic mathematical model for TB transmission, aiming to analyze the underlying dynamics. Subsequently, an optimal control problem is formulated to enhance TB control measures, encompassing Tuberculosis Preventive Treatment (TPT) and other initiatives targeting malnutrition and diabetes. Through simulation studies, the effectiveness of the control program is assessed. The model dynamics allow us to identify the pseudo-prevalence and incidence. To determine the potential long-term trajectory of TB and to acquire future projections a cost-effectiveness analysis is performed using ACER, AIR, ICER, and four quadrants to compare competing interventions. In conclusion, this work provides valuable insights into TB and strategies for its control and cost effectiveness.


title: User-Friendly Customized Generation with Multi-Modal Prompts

abstract: Text-to-image generation models have seen considerable advancement, catering to the increasing interest in personalized image creation. Current customization techniques often necessitate users to provide multiple images (typically 3-5) for each customized object, along with the classification of these objects and descriptive textual prompts for scenes. This paper questions whether the process can be made more user-friendly and the customization more intricate. We propose a method where users need only provide images along with text for each customization topic, and necessitates only a single image per visual concept. We introduce the concept of a ``multi-modal prompt'', a novel integration of text and images tailored to each customization concept, which simplifies user interaction and facilitates precise customization of both objects and scenes. Our proposed paradigm for customized text-to-image generation surpasses existing finetune-based methods in user-friendliness and the ability to customize complex objects with user-friendly inputs. Our code is available at $\href{https://github.com/zhongzero/Multi-Modal-Prompt}{https://github.com/zhongzero/Multi-Modal-Prompt}$.


title: AmBC-NOMA-Aided Short-Packet Communication for High Mobility V2X Transmissions

abstract: In this paper, we investigate the performance of ambient backscatter communication non-orthogonal multiple access (AmBC-NOMA)-assisted short packet communication for high-mobility vehicle-to-everything transmissions. In the proposed system, a roadside unit (RSU) transmits a superimposed signal to a typical NOMA user pair. Simultaneously, the backscatter device (BD) transmits its own signal towards the user pair by reflecting and modulating the RSU's superimposed signals. Due to vehicles' mobility, we consider realistic assumptions of time-selective fading and channel estimation errors. Theoretical expressions for the average block error rates (BLERs) of both users are derived. Furthermore, analysis and insights on transmit signal-to-noise ratio, vehicles' mobility, imperfect channel estimation, the reflection efficiency at the BD, and blocklength are provided. Numerical results validate the theoretical findings and reveal that the AmBC-NOMA system outperforms its orthogonal multiple access counterpart in terms of BLER performance.


title: Integrating GNN and Neural ODEs for Estimating Two-Body Interactions in Mixed-Species Collective Motion

abstract: Analyzing the motion of multiple biological agents, be it cells or individual animals, is pivotal for the understanding of complex collective behaviors. With the advent of advanced microscopy, detailed images of complex tissue formations involving multiple cell types have become more accessible in recent years. However, deciphering the underlying rules that govern cell movements is far from trivial. Here, we present a novel deep learning framework to estimate the underlying equations of motion from observed trajectories, a pivotal step in decoding such complex dynamics. Our framework integrates graph neural networks with neural differential equations, enabling effective prediction of two-body interactions based on the states of the interacting entities. We demonstrate the efficacy of our approach through two numerical experiments. First, we used a simulated data from a toy model to tune the hyperparameters. Based on the obtained hyperparameters, we then applied this approach to a more complex model that describes interacting cells of cellular slime molds. Our results show that the proposed method can accurately estimate the function of two-body interactions, thereby precisely replicating both individual and collective behaviors within these systems.


title: A Unified Implicit Attention Formulation for Gated-Linear Recurrent Sequence Models

abstract: Recent advances in efficient sequence modeling have led to attention-free layers, such as Mamba, RWKV, and various gated RNNs, all featuring sub-quadratic complexity in sequence length and excellent scaling properties, enabling the construction of a new type of foundation models. In this paper, we present a unified view of these models, formulating such layers as implicit causal self-attention layers. The formulation includes most of their sub-components and is not limited to a specific part of the architecture. The framework compares the underlying mechanisms on similar grounds for different layers and provides a direct means for applying explainability methods. Our experiments show that our attention matrices and attribution method outperform an alternative and a more limited formulation that was recently proposed for Mamba. For the other architectures for which our method is the first to provide such a view, our method is effective and competitive in the relevant metrics compared to the results obtained by state-of-the-art transformer explainability methods. Our code is publicly available.


title: He-enriched STAREVOL models for globular cluster multiple populations. Self-consistent isochrones from ZAMS to the TP-AGB phase

abstract: A common property of globular clusters (GC) is to host multiple populations characterized by peculiar chemical abundances. Recent photometric studies suggest that the He content could vary between the populations of a GC by up to $\Delta$He $\sim$ 0.13, in mass fraction. The initial He content impacts the evolution of low-mass stars by ultimately modifying their lifetimes, luminosity, temperatures, and, more generally, the morphology of post-RGB evolutionary tracks in the Hertzsprung-Russell diagram. We present new physically accurate isochrones with different initial He-enrichments and metallicities, with a focus on the methods implemented to deal with the post-RGB phases. The isochrones are based on tracks computed with the stellar evolution code STAREVOL for different metallicities (Z = 0.0002, 0.0009, 0.002, and 0.008) and with different He-enrichment (from 0.25 to 0.6 in mass fraction). We describe the effect of He-enrichment on the morphology of the isochrones and test these by comparing the predicted number counts of HB and AGB stars with those of selected GCs. Comparing the number ratios, we find that our new theoretical ones agree with the observed values within $1\sigma$ in most cases. The work presented here sets the ground for future studies on stellar populations in globular clusters, in which the abundances of light elements in He-enhanced models will rely on different assumptions for the causes of this enrichment. The developed methodology permits the computation of isochrones from new stellar tracks with non-canonical stellar processes. The checked number counts ensure that, at least in this reference set, the contribution of the luminous late stages of stellar evolution to the integrated light of a GC is represented adequately.


title: GRAG: Graph Retrieval-Augmented Generation

abstract: While Retrieval-Augmented Generation (RAG) enhances the accuracy and relevance of responses by generative language models, it falls short in graph-based contexts where both textual and topological information are important. Naive RAG approaches inherently neglect the structural intricacies of textual graphs, resulting in a critical gap in the generation process. To address this challenge, we introduce $\textbf{Graph Retrieval-Augmented Generation (GRAG)}$, which significantly enhances both the retrieval and generation processes by emphasizing the importance of subgraph structures. Unlike RAG approaches that focus solely on text-based entity retrieval, GRAG maintains an acute awareness of graph topology, which is crucial for generating contextually and factually coherent responses. Our GRAG approach consists of four main stages: indexing of $k$-hop ego-graphs, graph retrieval, soft pruning to mitigate the impact of irrelevant entities, and generation with pruned textual subgraphs. GRAG's core workflow-retrieving textual subgraphs followed by soft pruning-efficiently identifies relevant subgraph structures while avoiding the computational infeasibility typical of exhaustive subgraph searches, which are NP-hard. Moreover, we propose a novel prompting strategy that achieves lossless conversion from textual subgraphs to hierarchical text descriptions. Extensive experiments on graph multi-hop reasoning benchmarks demonstrate that in scenarios requiring multi-hop reasoning on textual graphs, our GRAG approach significantly outperforms current state-of-the-art RAG methods while effectively mitigating hallucinations.


title: Causal Concept Embedding Models: Beyond Causal Opacity in Deep Learning

abstract: Causal opacity denotes the difficulty in understanding the "hidden" causal structure underlying a deep neural network's (DNN) reasoning. This leads to the inability to rely on and verify state-of-the-art DNN-based systems especially in high-stakes scenarios. For this reason, causal opacity represents a key open challenge at the intersection of deep learning, interpretability, and causality. This work addresses this gap by introducing Causal Concept Embedding Models (Causal CEMs), a class of interpretable models whose decision-making process is causally transparent by design. The results of our experiments show that Causal CEMs can: (i) match the generalization performance of causally-opaque models, (ii) support the analysis of interventional and counterfactual scenarios, thereby improving the model's causal interpretability and supporting the effective verification of its reliability and fairness, and (iii) enable human-in-the-loop corrections to mispredicted intermediate reasoning steps, boosting not just downstream accuracy after corrections but also accuracy of the explanation provided for a specific instance.


title: AnyCBMs: How to Turn Any Black Box into a Concept Bottleneck Model

abstract: Interpretable deep learning aims at developing neural architectures whose decision-making processes could be understood by their users. Among these techniqes, Concept Bottleneck Models enhance the interpretability of neural networks by integrating a layer of human-understandable concepts. These models, however, necessitate training a new model from the beginning, consuming significant resources and failing to utilize already trained large models. To address this issue, we introduce "AnyCBM", a method that transforms any existing trained model into a Concept Bottleneck Model with minimal impact on computational resources. We provide both theoretical and experimental insights showing the effectiveness of AnyCBMs in terms of classification performances and effectivenss of concept-based interventions on downstream tasks.


title: Thousand foci coherent anti-Stokes Raman scattering microscopy

abstract: We demonstrate coherent anti-Stokes Raman scattering (CARS) microscopy with 1089 foci, enabled by a high repetition rate amplified oscillator and optical parametric amplifier. We employ a camera as multichannel detector to acquire and separate the signals from the foci, rather than using the camera image itself. This allows to retain the insensitivity of the imaging to sample scattering afforded by the non-linear excitation point-spread function, which is the hallmark of point-scanning techniques. We show frame rates of 0.3Hz for a megapixel CARS image, limited by the camera used. The laser source and corresponding CARS signal allows for at least 1000 times higher speed, and using faster cameras would allow acquiring at that speed, opening a perspective to megapixel CARS imaging with more than 100Hz frame rate.


title: Meta-Task Planning for Language Agents

abstract: The rapid advancement of neural language models has sparked a new surge of intelligent agent research. Unlike traditional agents, large language model-based agents (LLM agents) have emerged as a promising paradigm for achieving artificial general intelligence (AGI) due to their superior reasoning and generalization capabilities. Effective planning is crucial for the success of LLM agents in real-world tasks, making it a highly pursued topic in the community. Current planning methods typically translate tasks into executable action sequences. However, determining a feasible or optimal sequence for complex tasks at fine granularity, which often requires compositing long chains of heterogeneous actions, remains challenging. This paper introduces Meta-Task Planning (MTP), a zero-shot methodology for collaborative LLM-based multi-agent systems that simplifies complex task planning by decomposing it into a hierarchy of subordinate tasks, or meta-tasks. Each meta-task is then mapped into executable actions. MTP was assessed on two rigorous benchmarks, TravelPlanner and API-Bank. Notably, MTP achieved an average $\sim40\%$ success rate on TravelPlanner, significantly higher than the state-of-the-art (SOTA) baseline ($2.92\%$), and outperforming $LLM_{api}$-4 with ReAct on API-Bank by $\sim14\%$, showing the immense potential of integrating LLM with multi-agent systems.


title: SE3Set: Harnessing equivariant hypergraph neural networks for molecular representation learning

abstract: In this paper, we develop SE3Set, an SE(3) equivariant hypergraph neural network architecture tailored for advanced molecular representation learning. Hypergraphs are not merely an extension of traditional graphs; they are pivotal for modeling high-order relationships, a capability that conventional equivariant graph-based methods lack due to their inherent limitations in representing intricate many-body interactions. To achieve this, we first construct hypergraphs via proposing a new fragmentation method that considers both chemical and three-dimensional spatial information of molecular system. We then design SE3Set, which incorporates equivariance into the hypergragh neural network. This ensures that the learned molecular representations are invariant to spatial transformations, thereby providing robustness essential for accurate prediction of molecular properties. SE3Set has shown performance on par with state-of-the-art (SOTA) models for small molecule datasets like QM9 and MD17. It excels on the MD22 dataset, achieving a notable improvement of approximately 20% in accuracy across all molecules, which highlights the prevalence of complex many-body interactions in larger molecules. This exceptional performance of SE3Set across diverse molecular structures underscores its transformative potential in computational chemistry, offering a route to more accurate and physically nuanced modeling.


title: Tau physics at Belle and Belle II

abstract: We present here the major results obtained in $\tau$ physics by the Belle and Belle II experiments. For the Belle II experiment, we also discuss prospects for improved measurements of the $\tau$ lepton properties, new results in Michel parameters determination, and searches for $CP$ and lepton flavor violation in $\tau$ decays.


title: A Counterexample to Viterbo's Conjecture

abstract: We provide a counterexample to Viterbo's volume-capacity conjecture based on Minkowski billiard dynamics. This implies in particular that symplectic capacities differ on the class of convex domains in the classical phase space.


title: The stable category of monomorphisms between (Gorenstein) projective modules with applications

abstract: Let (S; n) be a commutative noetherian local ring and let w in n be non-zero divisor. This paper is concerned with the two categories of monomorphisms between finitely generated (Gorenstein) projective S-modules, such that their cokernels are annihilated by w. It is shown that these categories, which will be denoted by Mon(w;P) and Mon(w; G), are both Frobenius categories with the same projective objects. It is also proved that the stable category Mon(w;P) is triangle equivalent to the category of D-branes of type B, DB(w), which has been introduced by Kontsevich and studied by Orlov. Moreover, it will be observed that the stable categories Mon(w;P) and Mon(w; G) are closely related to the singularity category of the factor ring R = S=(w). Precisely, there is a fully faithful triangle functor from the stable category Mon(w; G) to Dsg(R), which is dense if and only if R (and so S) are Gorenstein rings. Particularly, it is proved that the density of the restriction of this functor to Mon(w;P), guarantees the regularity of the ring S.


title: Adaptive estimation of $\mathbb{L}_2$-norm of a probability density and related topics I. Lower bounds

abstract: We deal with the problem of the adaptive estimation of the $\mathbb{L}_2$-norm of a probability density on $\mathbb{R}^d$, $d\geq 1$, from independent observations. The unknown density is assumed to be uniformly bounded and to belong to the union of balls in the isotropic/anisotropic Nikolskii's spaces. We will show that the optimally adaptive estimators over the collection of considered functional classes do no exist. Also, in the framework of an abstract density model we present several generic lower bounds related to the adaptive estimation of an arbitrary functional of a probability density. These results having independent interest have no analogue in the existing literature. In the companion paper Cleanthous et al (2024) we prove that established lower bounds are tight and provide with explicit construction of adaptive estimators of $\mathbb{L}_2$-norm of the density.


title: Memory-efficient High-resolution OCT Volume Synthesis with Cascaded Amortized Latent Diffusion Models

abstract: Optical coherence tomography (OCT) image analysis plays an important role in the field of ophthalmology. Current successful analysis models rely on available large datasets, which can be challenging to be obtained for certain tasks. The use of deep generative models to create realistic data emerges as a promising approach. However, due to limitations in hardware resources, it is still difficulty to synthesize high-resolution OCT volumes. In this paper, we introduce a cascaded amortized latent diffusion model (CA-LDM) that can synthesis high-resolution OCT volumes in a memory-efficient way. First, we propose non-holistic autoencoders to efficiently build a bidirectional mapping between high-resolution volume space and low-resolution latent space. In tandem with autoencoders, we propose cascaded diffusion processes to synthesize high-resolution OCT volumes with a global-to-local refinement process, amortizing the memory and computational demands. Experiments on a public high-resolution OCT dataset show that our synthetic data have realistic high-resolution and global features, surpassing the capabilities of existing methods. Moreover, performance gains on two down-stream fine-grained segmentation tasks demonstrate the benefit of the proposed method in training deep learning models for medical imaging tasks. The code is public available at: https://github.com/nicetomeetu21/CA-LDM.


title: Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priors

abstract: We aim to tackle sparse-view reconstruction of a 360 3D scene using priors from latent diffusion models (LDM). The sparse-view setting is ill-posed and underconstrained, especially for scenes where the camera rotates 360 degrees around a point, as no visual information is available beyond some frontal views focused on the central object(s) of interest. In this work, we show that pretrained 2D diffusion models can strongly improve the reconstruction of a scene with low-cost fine-tuning. Specifically, we present SparseSplat360 (Sp2360), a method that employs a cascade of in-painting and artifact removal models to fill in missing details and clean novel views. Due to superior training and rendering speeds, we use an explicit scene representation in the form of 3D Gaussians over NeRF-based implicit representations. We propose an iterative update strategy to fuse generated pseudo novel views with existing 3D Gaussians fitted to the initial sparse inputs. As a result, we obtain a multi-view consistent scene representation with details coherent with the observed inputs. Our evaluation on the challenging Mip-NeRF360 dataset shows that our proposed 2D to 3D distillation algorithm considerably improves the performance of a regularized version of 3DGS adapted to a sparse-view setting and outperforms existing sparse-view reconstruction methods in 360 scene reconstruction. Qualitatively, our method generates entire 360 scenes from as few as 9 input views, with a high degree of foreground and background detail.


title: Experimental demonstration of 4-state reference-frame-independent quantum key distribution over 200km

abstract: Reference frame independent quantum key distribution (RFI-QKD) has gained widespread attention due to the unique advantage for practical application, as it circumvents the need for active reference frame alignment within the system. However, in comparison to the standard BB84 protocol, the original 6-state RFI protocol requires a greater number of quantum states to be operated by Alice and Bob, which is an aspect that merits optimization. In this work, we propose a 4-state RFI protocol and illustrate that Alice and Bob each require only four quantum states to perform channel estimation that remains independent of reference frame deviation, which can proficiently reduce the system complexity. Furthermore, through numerical simulations taking the finite-size key effect into consideration, we show that 4-state RFI protocol can achieve a secure key rate and transmission distance on par with the original 6-state RFI protocol. Finally, a experiment over 200 km is inplemented to conducted the feasibility of our scheme. We believe that our protocol can streamline the implementation of RFI-QKD and thereby contribute to the practical advancement of RFI-QKD.


title: Injective Sliced-Wasserstein embedding for weighted sets and point clouds

abstract: We present the $\textit{Sliced Wasserstein Embedding}$ $\unicode{x2014}$ a novel method to embed multisets and distributions over $\mathbb{R}^d$ into Euclidean space. Our embedding is injective and approximately preserves the Sliced Wasserstein distance. Moreover, when restricted to multisets, it is bi-Lipschitz. We also prove that it is $\textit{impossible}$ to embed distributions over $\mathbb{R}^d$ into a Euclidean space in a bi-Lipschitz manner, even under the assumption that their support is bounded and finite. We demonstrate empirically that our embedding offers practical advantage in learning tasks over existing methods for handling multisets.


title: Roger Carter

abstract: Roger Carter (1934--2022) was a very well known mathematician working in algebra, representation theory and Lie theory. He spent most of his mathematical career in Warwick. Roger was a great communicator of mathematics: the clarity, precision and enthusiasm of his lectures delivered in his beautiful handwriting were hallmark features recalled by numerous students and colleagues. His books have been described as marvelous pieces of scholarship and service to the general mathematical community. We both met Roger early in our careers, and were encouraged and influenced by him~ -- ~and his lovely sense of humour. This text is our tribute, both to his mathematical achievements, and to his kindness and generosity towards his students, his colleagues, his collaborators, and his family.


title: Space-time non-separable dynamics of ultrashort vortex pulse with power exponential spectrum

abstract: Ultrashort optical pulses with orbital angular momentum (OAM) owing to their various applications in classical as well as quantum domains attract a lot of research attention. The evolution of their spatio-temporal dynamics is of particular interest. In the present work, we numerically explore the spatio-temporal evolution of ultrashort Laguerre Gauss (LG) vortex with power exponential spectrum, also called power exponential (PE) pulse, in dispersive and nonlinear media. We in particular address the evolution of space-time non-separable ultrashort vortex pulse. The study reveals the asymmetric spatio-temporal evolution and splitting in the spatio-temporal plane. We observe compression at the trailing edge of the pulse with increase in the strength of the nonlinearity. The study further reveals that the temporal, spectral and, chirp evolution patterns of the pulse vary uniquely across different spatial regions and this variation depends upon the strength of nonlinearity and propagation distance. In weak nonlinear regime, a redshift in spectrum is noted as we move radially outward from the bright caustic of ultrashort LG vortex while a blue shifted spectrum emerges on approaching towards the phase singularity. Interestingly, as the pulse furthers in the medium, nonlinearity induced trends in spectral shift is witnessed. With stronger nonlinearity, a complex spectral evolution is observed. Furthermore, we study the evolution of frequency chirp with propagation distance both with weak and strong nonlinearities.


title: Multi-State TD Target for Model-Free Reinforcement Learning

abstract: Temporal difference (TD) learning is a fundamental technique in reinforcement learning that updates value estimates for states or state-action pairs using a TD target. This target represents an improved estimate of the true value by incorporating both immediate rewards and the estimated value of subsequent states. Traditionally, TD learning relies on the value of a single subsequent state. We propose an enhanced multi-state TD (MSTD) target that utilizes the estimated values of multiple subsequent states. Building on this new MSTD concept, we develop complete actor-critic algorithms that include management of replay buffers in two modes, and integrate with deep deterministic policy optimization (DDPG) and soft actor-critic (SAC). Experimental results demonstrate that algorithms employing the MSTD target significantly improve learning performance compared to traditional methods.


title: Charge transfer and Spin-Valley locking in 4Hb-TaS$_{2}$

abstract: 4Hb-TaS$_2$ is a superconductor that exhibits unique characteristics such as time-reversal symmetry breaking, hidden magnetic memory, and topological edge modes. It is a naturally occurring heterostructure comprising of alternating layers of 1H-TaS$_2$ and 1T-TaS$_2$. The former is a well-known superconductor, while the latter is a correlated insulator with a possible non-trivial magnetic ground state. In this study, we use angle resolved photoemission spectroscopy to investigate the normal state electronic structure of this unconventional superconductor. Our findings reveal that the band structure of 4H-TaS$_2$ fundamentally differs from that of its constituent materials. Specifically, we observe a significant charge transfer from the 1T layers to the 1H layers that drives the 1T layers away from half-filling. In addition, we find a substantial reduction in inter-layer coupling in 4Hb-TaS$_2$ compared to the coupling in 2H-TaS$_2$ that results in a pronounced spin-valley locking within 4Hb-TaS$_2$


title: Exploration of methods for computing sensitivities in ODE models at dynamic and steady states

abstract: Estimating parameters of dynamic models from experimental data is a challenging, and often computationally-demanding task. It requires a large number of model simulations and objective function gradient computations, if gradient-based optimization is used. The gradient depends on derivatives of the state variables with respect to parameters, also called state sensitivities, which are expensive to compute. In many cases, steady-state computation is a part of model simulation, either due to steady-state data or an assumption that the system is at steady state at the initial time point. Various methods are available for steady-state and gradient computation. Yet, the most efficient pair of methods (one for steady states, one for gradients) for a particular model is often not clear. Moreover, depending on the model and the available data, some methods may not be applicable or sufficiently robust. In order to facilitate the selection of methods, we explore six method pairs for computing the steady state and sensitivities at steady state using six real-world problems. The method pairs involve numerical integration or Newton's method to compute the steady-state, and -- for both forward and adjoint sensitivity analysis -- numerical integration or a tailored method to compute the sensitivities at steady-state. Our evaluation shows that the two method pairs that combine numerical integration for the steady-state with a tailored method for the sensitivities at steady-state were the most robust, and amongst the most computationally-efficient. We also observed that while Newton's method for steady-state computation yields a substantial speedup compared to numerical integration, it may lead to a large number of simulation failures. Overall, our study provides a concise overview across current methods for computing sensitivities at steady state, guiding modelers to choose the right methods.


title: Entanglement and Bell inequality violation in vector diboson systems produced in decays of spin-0 particles

abstract: We discuss entanglement and the violation of the CGLMP inequality in a system of two vector bosons produced in the decay of a spin-0 particle. We assume the most general CPT conserving, Lorentz-invariant coupling of the spin-0 particle with the daughter bosons. We compute the most general two-boson density matrix obtained by averaging over kinematical configurations with an appropriate probability distribution (which can be obtained when both bosons subsequently decay into fermion-antifermion). We show that the two-boson state is entangled and violates the CGLMP inequality for all values of the (anomalous) coupling constants and that in this case the state is entangled iff it can violate the CGLMP inequality. As an exemplary process of this kind we use the decay $H\to ZZ$ with anomalous coupling.


title: Past, Present, and Future of Citation Practices in HCI

abstract: Science is a complex system comprised of many scientists who individually make collective decisions that, due to the size and nature of the academic system, largely do not affect the system as a whole. However, certain decisions at the meso-level of research communities, such as the Human-Computer Interaction (HCI) community, may result in deep and long-lasting behavioral changes in scientists. In this article, we provide evidence on how a change in editorial policies introduced at the ACM CHI Conference in 2016 launched the CHI community on an expansive path, denoted by a year-by-year increase in the mean number of references included in CHI articles. If this near-linear trend continues undisrupted, an article in CHI 2030 will include on average almost 130 references. Our meta-research provides insights into how the nature and meaning of citation practices in HCI have changed, influenced by factors such as digital accessibility of resources and academic pressures. The observed trend towards more citations reflects a citation culture where quantity is prioritized over quality, contributing to both author and peer reviewer fatigue. This article underscores the value of meta-research for research communities and the profound impact that meso-level policy adjustments have on the evolution of scientific fields and disciplines, urging stakeholders to carefully consider the broader implications of such changes.


title: Adaptive estimation of the $\mathbb{L}_2$-norm of a probability density and related topics II. Upper bounds via the oracle approach

abstract: This is the second part of the research project initiated in Cleanthous et al (2024). We deal with the problem of the adaptive estimation of the $\mathbb{L}_2$-norm of a probability density on $\mathbb{R}^d$, $d\geq 1$, from independent observations. The unknown density is assumed to be uniformly bounded by unknown constant and to belong to the union of balls in the isotropic/anisotropic Nikolskii's spaces. In Cleanthous et al (2024) we have proved that the optimally adaptive estimators do no exist in the considered problem and provided with several lower bounds for the adaptive risk. In this part we show that these bounds are tight and present the adaptive estimator which is obtained by a data-driven selection from a family of kernel-based estimators. The proposed estimation procedure as well as the computation of its risk are heavily based on new concentration inequalities for decoupled $U$-statistics of order two established in Section 4. It is also worth noting that all our results are derived from the unique oracle inequality which may be of independent interest.


title: LoQT: Low Rank Adapters for Quantized Training

abstract: Training of large neural networks requires significant computational resources. Despite advances using low-rank adapters and quantization, pretraining of models such as LLMs on consumer hardware has not been possible without model sharding, offloading during training, or per-layer gradient updates. To address these limitations, we propose LoQT, a method for efficiently training quantized models. LoQT uses gradient-based tensor factorization to initialize low-rank trainable weight matrices that are periodically merged into quantized full-rank weight matrices. Our approach is suitable for both pretraining and fine-tuning of models, which we demonstrate experimentally for language modeling and downstream task adaptation. We find that LoQT enables efficient training of models up to 7B parameters on a consumer-grade 24GB GPU. We also demonstrate the feasibility of training a 13B parameter model using per-layer gradient updates on the same hardware.


title: The Yarkovsky effect on the long-term evolution of binary asteroids

abstract: We explore the Yarkovsky effect on small binary asteroids. While significant attention has been given to the binary YORP effect, the Yarkovsky effect is often overlooked. We develop an analytical model for the binary Yarkovsky effect, considering both the Yarkovsky-Schach and planetary Yarkovsky components, and verify it against thermophysical numerical simulations. We find that the Yarkovsky force could change the mutual orbit when the asteroid's spin period is unequal to the orbital period. Our analysis predicts new evolutionary paths for binaries. For a prograde asynchronous secondary, the Yarkovsky force will migrate the satellite towards the location of the synchronous orbit on ~100 kyr timescales, which could be faster than other synchronization processes such as YORP and tides. For retrograde secondaries, the Yarkovsky force always migrates the secondary outwards, which could produce asteroid pairs with opposite spin poles. Satellites spinning faster than the Roche limit orbit period (e.g. from ~4h to ~10h) will migrate inwards until they disrupt, reshape, or form a contact binary. We also predict a short-lived equilibrium state for asynchronous secondaries where the Yarkovsky force is balanced by tides. We provide calculations of the Yarkovsky-induced drift rate for known asynchronous binaries. If the NASA DART impact broke Dimorphos from synchronous rotation, we predict that Dimorphos's orbit will shrink by \dot a ~ 7 cm/yr, which can be measured by the Hera mission. We also speculate that the Yarkovsky force may have synchronized the Dinkinesh-Selam system after a possible merger of Selam's two lobes.


title: Note on the transformation from the Lorenz gauge to the Coulomb gauge

abstract: A simple formula for the gauge function of the transformation from the Lorenz gauge to the Coulomb gauge, valid under a condition that is satisfied by some charge densities employed in the literature, is derived.


title: On the control of a simplified k-e model of turbulence

abstract: This paper deals with the control of a kind of turbulent flows. We consider a simplified k-e model with distributed controls, locally supported in space. We proof that the system is partially locally null-controllable, in the sense that the velocity field can be driven exactly to zero if the initial state is small enough. The proof relies on an argument where we have concatenated several techniques: fixed-point formulation, linearization, energy and Carleman estimates, local inversion, etc. Ths result can be viewed as a nontrivial step towards the control of turbulent fluids.


title: Zhukovsky-Volterra top and quantisation ideals

abstract: In this letter, we revisit the quantisation problem for a fundamental model of classical mechanics - the Zhukovsky-Volterra top. We have discovered a four-parametric pencil of compatible Poisson brackets, comprising two quadratic and two linear Poisson brackets. Using the quantisation ideal method, we have identified two distinct quantisations of the Zhukovsky-Volterra top. The first type corresponds to the universal enveloping algebras of $so(3)$, leading to Lie-Poisson brackets in the classical limit. The second type can be regarded as a quantisation of the four-parametric inhomogeneous quadratic Poisson pencil. We discuss the relationships between the quantisations obtained in our paper, Sklyanin's quantisation of the Euler top, and Levin-Olshanetsky-Zotov's quantisation of the Zhukovsky-Volterra top.


title: Chain of Tools: Large Language Model is an Automatic Multi-tool Learner

abstract: Augmenting large language models (LLMs) with external tools has emerged as a promising approach to extend their utility, empowering them to solve practical tasks. Existing work typically empowers LLMs as tool users with a manually designed workflow, where the LLM plans a series of tools in a step-by-step manner, and sequentially executes each tool to obtain intermediate results until deriving the final answer. However, they suffer from two challenges in realistic scenarios: (1) The handcrafted control flow is often ad-hoc and constraints the LLM to local planning; (2) The LLM is instructed to use only manually demonstrated tools or well-trained Python functions, which limits its generalization to new tools. In this work, we first propose Automatic Tool Chain (ATC), a framework that enables the LLM to act as a multi-tool user, which directly utilizes a chain of tools through programming. To scale up the scope of the tools, we next propose a black-box probing method. This further empowers the LLM as a tool learner that can actively discover and document tool usages, teaching themselves to properly master new tools. For a comprehensive evaluation, we build a challenging benchmark named ToolFlow, which diverges from previous benchmarks by its long-term planning scenarios and complex toolset. Experiments on both existing datasets and ToolFlow illustrate the superiority of our framework. Analysis on different settings also validates the effectiveness and the utility of our black-box probing algorithm.


title: Pruning for Robust Concept Erasing in Diffusion Models

abstract: Despite the impressive capabilities of generating images, text-to-image diffusion models are susceptible to producing undesirable outputs such as NSFW content and copyrighted artworks. To address this issue, recent studies have focused on fine-tuning model parameters to erase problematic concepts. However, existing methods exhibit a major flaw in robustness, as fine-tuned models often reproduce the undesirable outputs when faced with cleverly crafted prompts. This reveals a fundamental limitation in the current approaches and may raise risks for the deployment of diffusion models in the open world. To address this gap, we locate the concept-correlated neurons and find that these neurons show high sensitivity to adversarial prompts, thus could be deactivated when erasing and reactivated again under attacks. To improve the robustness, we introduce a new pruning-based strategy for concept erasing. Our method selectively prunes critical parameters associated with the concepts targeted for removal, thereby reducing the sensitivity of concept-related neurons. Our method can be easily integrated with existing concept-erasing techniques, offering a robust improvement against adversarial inputs. Experimental results show a significant enhancement in our model's ability to resist adversarial inputs, achieving nearly a 40% improvement in erasing the NSFW content and a 30% improvement in erasing artwork style.


title: A Complete Inverse Optimality Study for a Tank-Liquid System

abstract: This paper presents a complete inverse optimality study for a linearized tank-liquid system where the liquid is described by the viscous Saint-Venant model with surface tension and possible wall friction. We define an appropriate weak solution notion for which we establish existence/uniqueness results with inputs that do not necessarily satisfy any compatibility condition as well as stabilization results with feedback laws that are constructed with the help of a Control Lyapunov Functional. We show that the proposed family of stabilizing feedback laws is optimal for a certain meaningful quadratic cost functional. Finally, we show that the optimal feedback law guarantees additional stronger stability estimates which are similar to those obtained in the case of classical solutions.


title: Geometry of non-classical period domains

abstract: In this paper we prove a conjecture of Griffiths about vanishing of the zeroth cohomology groups of locally homogeneous vector bundles on compact quotients of non-classical period domains, and construct a new $G_\R$-invariant complex structure on any non-classical period domain $D=G_\R/V$ with $G_\R$ of Hermitian type. Various geometric and algebraic characterizations of non-classical period domains and several geometric applications on their compact quotients are deduced as consequences of our results.


title: I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models

abstract: The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional challenges in the time dimension, image editing has witnessed the development of more diverse, high-quality approaches and more capable software like Photoshop. In light of this gap, we introduce a novel and generic solution that extends the applicability of image editing tools to videos by propagating edits from a single frame to the entire video using a pre-trained image-to-video model. Our method, dubbed I2VEdit, adaptively preserves the visual and motion integrity of the source video depending on the extent of the edits, effectively handling global edits, local edits, and moderate shape changes, which existing methods cannot fully achieve. At the core of our method are two main processes: Coarse Motion Extraction to align basic motion patterns with the original video, and Appearance Refinement for precise adjustments using fine-grained attention matching. We also incorporate a skip-interval strategy to mitigate quality degradation from auto-regressive generation across multiple video clips. Experimental results demonstrate our framework's superior performance in fine-grained video editing, proving its capability to produce high-quality, temporally consistent outputs.


title: Gamified AI Approch for Early Detection of Dementia

abstract: This paper aims to develop a new deep learning-inspired gaming approach for early detection of dementia. This research integrates a robust convolutional neural network (CNN)-based model for early dementia detection using health metrics data as well as facial image data through a cognitive assessment-based gaming application. We have collected 1000 data samples of health metrics dataset from Apollo Diagnostic Center Kolkata that is labeled as either demented or non-demented for the training of MOD-1D-CNN for the game level 1 and another dataset of facial images containing 1800 facial data that are labeled as either demented or non-demented is collected by our research team for the training of MOD-2D-CNN model in-game level 2. In our work, the loss for the proposed MOD-1D-CNN model is 0.2692 and the highest accuracy is 70.50% for identifying the dementia traits using real-life health metrics data. Similarly, the proposed MOD-2D-CNN model loss is 0.1755 and the highest accuracy is obtained here 95.72% for recognizing the dementia status using real-life face-based image data. Therefore, a rule-based weightage method is applied to combine both the proposed methods to achieve the final decision. The MOD-1D-CNN and MOD-2D-CNN models are more lightweight and computationally efficient alternatives because they have a significantly lower number of parameters when compared to the other state-of-the-art models. We have compared their accuracies and parameters with the other state-of-the-art deep learning models.


title: MinRank Gabidulin encryption scheme on matrix codes

abstract: The McEliece scheme is a generic frame which allows to use any error correcting code of which there exists an efficient decoding algorithm to design an encryption scheme by hiding the generator matrix code. Similarly, the Niederreiter frame is the dual version of the McEliece scheme, and achieves smaller ciphertexts. We propose a generalization of the McEliece frame and the Niederreiter frame to matrix codes and the MinRank problem, that we apply to Gabidulin matrix codes (Gabidulin rank codes considered as matrix codes). The masking we consider consists in starting from a rank code C, to consider a matrix version of C and to concatenate a certain number of rows and columns to the matrix codes version of the rank code C and then apply to an isometry for matric codes. The security of the schemes relies on the MinRank problem to decrypt a ciphertext, and the structural security of the scheme relies on a new problem EGMC-Indistinguishability problem that we introduce and that we study in detail. The main structural attack that we propose consists in trying to recover the masked linearity over the extension field which is lost during the masking process. Overall, starting from Gabidulin codes we obtain a very appealing tradeoff between the size of ciphertext and the size of the public key. For 128b of security we propose parameters ranging from ciphertext of size 65 B (and public keys of size 98 kB) to ciphertext of size 138B (and public key of size 41 kB). Our new approach permits to achieve better trade-off between ciphertexts and public key than the classical McEliece scheme. Our new approach permits to obtain an alternative scheme to the classic McEliece scheme, to obtain very small ciphertexts, with moreover smaller public keys than in the classic McEliece scheme. For 256 bits of security, we can obtain ciphertext as low as 119B, or public key as low as 87kB.


title: Quasi-probabilistic Bit Erasure Causes Bell Non-locality

abstract: We show that a maximal violation of the Bell-CHSH inequality for two entangled qubits, i.e., Bell non-locality, is a direct consequence of a local bit erasure by means of a quasi-stochastic process, i.e., a stochastic process in which some transition probabilities are negative.


title: Variance-Reducing Couplings for Random Features: Perspectives from Optimal Transport

abstract: Random features (RFs) are a popular technique to scale up kernel methods in machine learning, replacing exact kernel evaluations with stochastic Monte Carlo estimates. They underpin models as diverse as efficient transformers (by approximating attention) to sparse spectrum Gaussian processes (by approximating the covariance function). Efficiency can be further improved by speeding up the convergence of these estimates: a variance reduction problem. We tackle this through the unifying framework of optimal transport, using theoretical insights and numerical algorithms to develop novel, high-performing RF couplings for kernels defined on Euclidean and discrete input spaces. They enjoy concrete theoretical performance guarantees and sometimes provide strong empirical downstream gains, including for scalable approximate inference on graphs. We reach surprising conclusions about the benefits and limitations of variance reduction as a paradigm.


title: Mamba4KT:An Efficient and Effective Mamba-based Knowledge Tracing Model

abstract: Knowledge tracing (KT) enhances student learning by leveraging past performance to predict future performance. Current research utilizes models based on attention mechanisms and recurrent neural network structures to capture long-term dependencies and correlations between exercises, aiming to improve model accuracy. Due to the growing amount of data in smart education scenarios, this poses a challenge in terms of time and space consumption for knowledge tracing models. However, existing research often overlooks the efficiency of model training and inference and the constraints of training resources. Recognizing the significance of prioritizing model efficiency and resource usage in knowledge tracing, we introduce Mamba4KT. This novel model is the first to explore enhanced efficiency and resource utilization in knowledge tracing. We also examine the interpretability of the Mamba structure both sequence-level and exercise-level to enhance model interpretability. Experimental findings across three public datasets demonstrate that Mamba4KT achieves comparable prediction accuracy to state-of-the-art models while significantly improving training and inference efficiency and resource utilization. As educational data continues to grow, our work suggests a promising research direction for knowledge tracing that improves model prediction accuracy, model efficiency, resource utilization, and interpretability simultaneously.


title: Periodic Scenario Trees: A Novel Framework for Robust Periodic Invariance and Stabilization of Constrained Uncertain Linear Systems

abstract: This work proposes a new a framework for determining robust periodic invariant sets and their associated control laws for constrained uncertain linear systems. Necessary and sufficient conditions for stabilizability by periodic controllers are stated and proven using finite step Lyapunov functions for the unconstrained case. We then introduce a scenario tree interpretation of finite step Lyapunov functions for uncertain systems and show that this interpretation results in useful criteria for the design of robust stabilizing controllers. In particular, novel convex feasibility criteria for the synthesis of simple static controllers and what we call linear interpolating tree periodic controllers with memory are derived. It is proven that for a sufficiently large length of the period, a stabilizing linear interpolating tree periodic controller can always be found using the proposed criterion provided that the uncertain system is stabilizable by such controllers. In this sense, the presented synthesis method is non-conservative. The results are then extended to constrained uncertain linear systems and conditions for controllers that realize robust periodic invariant sets which are less conservative than those that result from the known methods in the literature are derived.


title: Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussians

abstract: 3D Gaussian Splatting has emerged as a powerful representation of geometry and appearance for RGB-only dense Simultaneous Localization and Mapping (SLAM), as it provides a compact dense map representation while enabling efficient and high-quality map rendering. However, existing methods show significantly worse reconstruction quality than competing methods using other 3D representations, e.g. neural points clouds, since they either do not employ global map and pose optimization or make use of monocular depth. In response, we propose the first RGB-only SLAM system with a dense 3D Gaussian map representation that utilizes all benefits of globally optimized tracking by adapting dynamically to keyframe pose and depth updates by actively deforming the 3D Gaussian map. Moreover, we find that refining the depth updates in inaccurate areas with a monocular depth estimator further improves the accuracy of the 3D reconstruction. Our experiments on the Replica, TUM-RGBD, and ScanNet datasets indicate the effectiveness of globally optimized 3D Gaussians, as the approach achieves superior or on par performance with existing RGB-only SLAM methods methods in tracking, mapping and rendering accuracy while yielding small map sizes and fast runtimes. The source code is available at https://github.com/eriksandstroem/Splat-SLAM.


title: VICtoR: Learning Hierarchical Vision-Instruction Correlation Rewards for Long-horizon Manipulation

abstract: We study reward models for long-horizon manipulation tasks by learning from action-free videos and language instructions, which we term the visual-instruction correlation (VIC) problem. Recent advancements in cross-modality modeling have highlighted the potential of reward modeling through visual and language correlations. However, existing VIC methods face challenges in learning rewards for long-horizon tasks due to their lack of sub-stage awareness, difficulty in modeling task complexities, and inadequate object state estimation. To address these challenges, we introduce VICtoR, a novel hierarchical VIC reward model capable of providing effective reward signals for long-horizon manipulation tasks. VICtoR precisely assesses task progress at various levels through a novel stage detector and motion progress evaluator, offering insightful guidance for agents learning the task effectively. To validate the effectiveness of VICtoR, we conducted extensive experiments in both simulated and real-world environments. The results suggest that VICtoR outperformed the best existing VIC methods, achieving a 43% improvement in success rates for long-horizon tasks.


title: Cocktail: A Comprehensive Information Retrieval Benchmark with LLM-Generated Documents Integration

abstract: The proliferation of Large Language Models (LLMs) has led to an influx of AI-generated content (AIGC) on the internet, transforming the corpus of Information Retrieval (IR) systems from solely human-written to a coexistence with LLM-generated content. The impact of this surge in AIGC on IR systems remains an open question, with the primary challenge being the lack of a dedicated benchmark for researchers. In this paper, we introduce Cocktail, a comprehensive benchmark tailored for evaluating IR models in this mixed-sourced data landscape of the LLM era. Cocktail consists of 16 diverse datasets with mixed human-written and LLM-generated corpora across various text retrieval tasks and domains. Additionally, to avoid the potential bias from previously included dataset information in LLMs, we also introduce an up-to-date dataset, named NQ-UTD, with queries derived from recent events. Through conducting over 1,000 experiments to assess state-of-the-art retrieval models against the benchmarked datasets in Cocktail, we uncover a clear trade-off between ranking performance and source bias in neural retrieval models, highlighting the necessity for a balanced approach in designing future IR systems. We hope Cocktail can serve as a foundational resource for IR research in the LLM era, with all data and code publicly available at \url{https://github.com/KID-22/Cocktail}.


title: Estimating Dyadic Treatment Effects with Unknown Confounders

abstract: This paper proposes a statistical inference method for assessing treatment effects with dyadic data. Under the assumption that the treatments follow an exchangeable distribution, our approach allows for the presence of any unobserved confounding factors that potentially cause endogeneity of treatment choice without requiring additional information other than the treatments and outcomes. Building on the literature of graphon estimation in network data analysis, we propose a neighborhood kernel smoothing method for estimating dyadic average treatment effects. We also develop a permutation inference method for testing the sharp null hypothesis. Under certain regularity conditions, we derive the rate of convergence of the proposed estimator and demonstrate the size control property of our test. We apply our method to international trade data to assess the impact of free trade agreements on bilateral trade flows.


title: Tree-like process tensor contraction for automated compression of environments

abstract: The algorithm ``automated compression of environments'' (ACE) [Nat. Phys. 18, 662 (2022)] provides a versatile way of simulating an extremely broad class of open quantum systems. This is achieved by encapsulating the influence of the environment, which is determined by the interaction Hamiltonian(s) and initial states, into compact process tensor matrix product operator (PT-MPO) representations. The generality of the ACE method comes at high numerical cost. Here, we demonstrate that orders-of-magnitude improvement of ACE is possible by changing the order of PT-MPO contraction from a sequential to a tree-like scheme. The problem of combining two partial PT-MPOs with large inner bonds is solved by a preselection approach. The drawbacks of the preselection approach are that the MPO compression is suboptimal and that it is more prone to error accumulation than sequential combination and compression. We therefore also identify strategies to mitigate these disadvantages by fine-tuning compression parameters. This results in a scheme that is similar in compression efficiency and accuracy to the original ACE algorithm, yet is significantly faster. Our numerical experiments reach similar conclusions for bosonic and fermionic test cases, suggesting that our findings are characteristic of the combination of PT-MPOs more generally.


title: A characterization of contact elements

abstract: We show that for a non-trivial element $c$ in $\widehat{HF}(-Y)$, there exists a tight contact structure $\xi$ on $Y$ whose contact invariant realizes $c$ if and only if there exists a non-trivial fibered knot $K$ such that $-\tau_c(K)=g(K)$. Moreover, when such a fibered knot $K$ does exist, $\xi$ can be chosen to satisfy the extra condition that $K$ admits a Legendrian representative with Thurston-Bennequin number tb$(K)$ equal to $0$ in $(Y,\xi)$.


title: ReCODE: Modeling Repeat Consumption with Neural ODE

abstract: In real-world recommender systems, such as in the music domain, repeat consumption is a common phenomenon where users frequently listen to a small set of preferred songs or artists repeatedly. The key point of modeling repeat consumption is capturing the temporal patterns between a user's repeated consumption of the items. Existing studies often rely on heuristic assumptions, such as assuming an exponential distribution for the temporal gaps. However, due to the high complexity of real-world recommender systems, these pre-defined distributions may fail to capture the intricate dynamic user consumption patterns, leading to sub-optimal performance. Drawing inspiration from the flexibility of neural ordinary differential equations (ODE) in capturing the dynamics of complex systems, we propose ReCODE, a novel model-agnostic framework that utilizes neural ODE to model repeat consumption. ReCODE comprises two essential components: a user's static preference prediction module and the modeling of user dynamic repeat intention. By considering both immediate choices and historical consumption patterns, ReCODE offers comprehensive modeling of user preferences in the target context. Moreover, ReCODE seamlessly integrates with various existing recommendation models, including collaborative-based and sequential-based models, making it easily applicable in different scenarios. Experimental results on two real-world datasets consistently demonstrate that ReCODE significantly improves the performance of base models and outperforms other baseline methods.


title: GPU Based Differential Evolution: New Insights and Comparative Study

abstract: Differential Evolution (DE) is a highly successful population based global optimisation algorithm, commonly used for solving numerical optimisation problems. However, as the complexity of the objective function increases, the wall-clock run-time of the algorithm suffers as many fitness function evaluations must take place to effectively explore the search space. Due to the inherently parallel nature of the DE algorithm, graphics processing units (GPU) have been used to effectively accelerate both the fitness evaluation and DE algorithm. This work reviews the main architectural choices made in the literature for GPU based DE algorithms and introduces a new GPU based numerical optimisation benchmark to evaluate and compare GPU based DE algorithms.


title: SED: Self-Evaluation Decoding Enhances Large Language Models for Better Generation

abstract: Existing Large Language Models (LLMs) generate text through unidirectional autoregressive decoding methods to respond to various user queries. These methods tend to consider token selection in a simple sequential manner, making it easy to fall into suboptimal options when encountering uncertain tokens, referred to as chaotic points in our work. Many chaotic points exist in texts generated by LLMs, and they often significantly affect the quality of subsequently generated tokens, which can interfere with LLMs' generation. This paper proposes Self-Evaluation Decoding, SED, a decoding method for enhancing model generation. Analogous to the human decision-making process, SED integrates speculation and evaluation steps into the decoding process, allowing LLMs to make more careful decisions and thus optimize token selection at chaotic points. Experimental results across various tasks using different LLMs demonstrate SED's effectiveness.


title: Unveiling quantum phases in quasi-one-dimensional dipolar gases using continuous matrix product state

abstract: We investigate the ground-state properties of the quasi-one-dimensional dipolar gases using continuous matrix product states techniques. Making use of the first- and second-order correlation functions, we find that the system supports the superfluid, super-Tonks-Girardeau, and quasicrystal phases according to the Luttinger liquid theory. We also map out the phase diagram on the parameter plane consisting the contact and dipolar interaction strengths. Furthermore, we compute the Luttinger parameter, the structure factor, and the momentum distribution of the system. Finally, we show that the predicted dipolar effect can potentially be observed in quasi-one-dimensional gases of polar molecules.


title: Physics Constrained Deep Learning For Turbulence Model Uncertainty Quantification

abstract: Engineering design and scientific analysis rely upon computer simulations of turbulent fluid flows using turbulence models. These turbulence models are empirical and approximate, leading to large uncertainties in their predictions that hamper scientific and engineering advances. We outline a Physics Constrained Deep Learning framework to estimate turbulence model uncertainties using physics based Eigenspace Perturbations along with Deep Learning based guidance. The Deep Learning based modulation controls the spatial variation in perturbation magnitude to improve the calibration of uncertainty estimates over the state of the art physics based methods.


title: vHeat: Building Vision Models upon Heat Conduction

abstract: A fundamental problem in learning robust and expressive visual representations lies in efficiently estimating the spatial relationships of visual semantics throughout the entire image. In this study, we propose vHeat, a novel vision backbone model that simultaneously achieves both high computational efficiency and global receptive field. The essential idea, inspired by the physical principle of heat conduction, is to conceptualize image patches as heat sources and model the calculation of their correlations as the diffusion of thermal energy. This mechanism is incorporated into deep models through the newly proposed module, the Heat Conduction Operator (HCO), which is physically plausible and can be efficiently implemented using DCT and IDCT operations with a complexity of $\mathcal{O}(N^{1.5})$. Extensive experiments demonstrate that vHeat surpasses Vision Transformers (ViTs) across various vision tasks, while also providing higher inference speeds, reduced FLOPs, and lower GPU memory usage for high-resolution images. The code will be released at https://github.com/MzeroMiko/vHeat.


title: Gibbs states and Brownian models for coexisting haze and cloud droplets

abstract: Clouds microphysics describes the formation and evolution of cloud droplets, rain, and ice particles. It is among the most critical factors in determining the cloud's size, lifetime, precipitation, and radiative effect. Among all cloud types, the small clouds, characterized by weak updrafts, that are close to the haze-to-cloud transition pose challenges in measuring them and understanding their properties. They are superabundant but hard to capture by satellites and often falsely regarded as aerosols. K\"ohler's theory explains droplet activation and their growth by condensation at the earliest stages of cloud development. It fully describes the thermodynamic state of a single drop but falls short when explaining the collective behavior of large populations of particles. This is especially important when the supersaturation pool is limited. We present an analytical framework to extend K\"ohler's theory to coexisting cloud droplets. Our results suggest hysteresis and asymmetry in the process of droplet activation and deactivation. The turbulent nature of clouds is incorporated into our model formulation as Brownian noise to provide explicit droplet size distributions and activation timescales. The theoretical findings are confronted with experimental data stemming from laboratory clouds created in the Pi convection chamber, suggesting a new way of understanding haze-to-cloud transitions and small cloud formation processes.


title: Scalable Numerical Embeddings for Multivariate Time Series: Enhancing Healthcare Data Representation Learning

abstract: Multivariate time series (MTS) data, when sampled irregularly and asynchronously, often present extensive missing values. Conventional methodologies for MTS analysis tend to rely on temporal embeddings based on timestamps that necessitate subsequent imputations, yet these imputed values frequently deviate substantially from their actual counterparts, thereby compromising prediction accuracy. Furthermore, these methods typically fail to provide robust initial embeddings for values infrequently observed or even absent within the training set, posing significant challenges to model generalizability. In response to these challenges, we propose SCAlable Numerical Embedding (SCANE), a novel framework that treats each feature value as an independent token, effectively bypassing the need for imputation. SCANE regularizes the traits of distinct feature embeddings and enhances representational learning through a scalable embedding mechanism. Coupling SCANE with the Transformer Encoder architecture, we develop the Scalable nUMerical eMbeddIng Transformer (SUMMIT), which is engineered to deliver precise predictive outputs for MTS characterized by prevalent missing entries. Our experimental validation, conducted across three disparate electronic health record (EHR) datasets marked by elevated missing value frequencies, confirms the superior performance of SUMMIT over contemporary state-of-the-art approaches addressing similar challenges. These results substantiate the efficacy of SCANE and SUMMIT, underscoring their potential applicability across a broad spectrum of MTS data analytical tasks.


title: Experimental Refrence-Frame-Independent Quantum Key Distribution over 250 km of Optical Fiber

abstract: The reference-frame-independent quantum key distribution (RFI-QKD) protocol enables QKD systems to function effectively despite slowly varying reference frames, offering a distinct advantage in practical scenarios, particularly in mobile platforms. In this study, we successfully distribute secure key bits over a 250 km optical fiber distance by developing an RFI-QKD system with a repetition rate of 150 MHz. Benefiting from high repetition rate, we achieve a finite-key secret key rate of 49.65 bit/s at a distance of 200 km, which is more than three times higher than state-of-the-art systems. Our work dramatically extends the transmission distance and enhances the secret key rate of RFI-QKD, significantly promoting its practical application.


title: Map-based Modular Approach for Zero-shot Embodied Question Answering

abstract: Building robots capable of interacting with humans through natural language in the visual world presents a significant challenge in the field of robotics. To overcome this challenge, Embodied Question Answering (EQA) has been proposed as a benchmark task to measure the ability to identify an object navigating through a previously unseen environment in response to human-posed questions. Although some methods have been proposed, their evaluations have been limited to simulations, without experiments in real-world scenarios. Furthermore, all of these methods are constrained by a limited vocabulary for question-and-answer interactions, making them unsuitable for practical applications. In this work, we propose a map-based modular EQA method that enables real robots to navigate unknown environments through frontier-based map creation and address unknown QA pairs using foundation models that support open vocabulary. Unlike the questions of the previous EQA dataset on Matterport 3D (MP3D), questions in our real-world experiments contain various question formats and vocabularies not included in the training data. We conduct comprehensive experiments on virtual environments (MP3D-EQA) and two real-world house environments and demonstrate that our method can perform EQA even in the real world.


title: Task Groupings Regularization: Data-Free Meta-Learning with Heterogeneous Pre-trained Models

abstract: Data-Free Meta-Learning (DFML) aims to derive knowledge from a collection of pre-trained models without accessing their original data, enabling the rapid adaptation to new unseen tasks. Current methods often overlook the heterogeneity among pre-trained models, which leads to performance degradation due to task conflicts. In this paper, we empirically and theoretically identify and analyze the model heterogeneity in DFML. We find that model heterogeneity introduces a heterogeneity-homogeneity trade-off, where homogeneous models reduce task conflicts but also increase the overfitting risk. Balancing this trade-off is crucial for learning shared representations across tasks. Based on our findings, we propose Task Groupings Regularization, a novel approach that benefits from model heterogeneity by grouping and aligning conflicting tasks. Specifically, we embed pre-trained models into a task space to compute dissimilarity, and group heterogeneous models together based on this measure. Then, we introduce implicit gradient regularization within each group to mitigate potential conflicts. By encouraging a gradient direction suitable for all tasks, the meta-model captures shared representations that generalize across tasks. Comprehensive experiments showcase the superiority of our approach in multiple benchmarks, effectively tackling the model heterogeneity in challenging multi-domain and multi-architecture scenarios.


title: Tur\'an number of complete multipartite graphs in multipartite graphs

abstract: In this paper we study a multi-partite version of the Erd\H{o}s--Stone theorem. Given integers $r<k$ and $t\ge 1$, let $ex_k(n, K_{r+1}(t))$ be the maximum number of edges of $K_{r+1}(t)$-free $k$-partite graphs with $n$ vertices in each part, where $K_{r+1}(t)$ is the $t$-blowup of $K_{r+1}$. An easy consequence of the supersaturaion result gives that $ex_k(n, K_{r+1}(t)) = ex_k(n, K_{r+1})+o(n^2)$. Similar to a result of Erd\H os and Simonovits for the non-partite case, we find that the error term is closely related to the (multi-partite) Zarankiewicz problem. Using such Zarankiewicz numbers, for $t=2,3$, we determine the error term up to an additive linear term; using some natural assumptions on such Zarankiewicz numbers, we determine the error term up to an additive constant depending on $k$, $r$ and $t$. We actually obtain exact results in many cases, for example, when $k\equiv 0, 1 \pmod{r}$. Our proof uses the stability method and starts by proving a stability result for $K_{r+1}$-free multi-partite graphs.


title: Global existence and nonexistence analyses for a magnetic fractional pseudo-parabolic equation

abstract: In this paper, we study the initial-boundary value problem for a pseudo-parabolic equation in magnetic fractional Orlicz-Sobolev spaces. First, by employing the imbedding theorems, the theory of potential wells and the Galerkin method, we prove the existence and uniqueness of global solutions with subcritical initial energy, critical initial energy and supercritical initial energy, respectively. Furthermore, we prove the decay estimate of global solutions with sub-sharp-critical initial energy, sharp-critical initial energy and supercritical initial energy, respectively. Specifically, we need to analyze the properties of $\omega$-limits of solutions for supercritical initial energy. Next, we establish the finite time blowup of solutions with sub-sharp-critical initial energy and sharp-critical initial energy, respectively. Finally, we discuss the convergence relationship between the global solutions of the evolution problem and the ground state solutions of the corresponding stationary problem.


title: Reality Only Happens Once: Single-Path Generalization Bounds for Transformers

abstract: One of the inherent challenges in deploying transformers on time series is that \emph{reality only happens once}; namely, one typically only has access to a single trajectory of the data-generating process comprised of non-i.i.d. observations. We derive non-asymptotic statistical guarantees in this setting through bounds on the \textit{generalization} of a transformer network at a future-time $t$, given that it has been trained using $N\le t$ observations from a single perturbed trajectory of a Markov process. Under the assumption that the Markov process satisfies a log-Sobolev inequality, we obtain a generalization bound which effectively converges at the rate of ${O}(1/\sqrt{N})$. Our bound depends explicitly on the activation function ($\operatorname{Swish}$, $\operatorname{GeLU}$, or $\tanh$ are considered), the number of self-attention heads, depth, width, and norm-bounds defining the transformer architecture. Our bound consists of three components: (I) The first quantifies the gap between the stationary distribution of the data-generating Markov process and its distribution at time $t$, this term converges exponentially to $0$. (II) The next term encodes the complexity of the transformer model and, given enough time, eventually converges to $0$ at the rate ${O}(\log(N)^r/\sqrt{N})$ for any $r>0$. (III) The third term guarantees that the bound holds with probability at least $1$-$\delta$, and converges at a rate of ${O}(\sqrt{\log(1/\delta)}/\sqrt{N})$.

categories: cs.LG cs.NA cs.NE math.NA math.PR stat.ML


title: Contextual Linear Optimization with Bandit Feedback

abstract: Contextual linear optimization (CLO) uses predictive observations to reduce uncertainty in random cost coefficients and thereby improve average-cost performance. An example is a stochastic shortest path with random edge costs (e.g., traffic) and predictive features (e.g., lagged traffic, weather). Existing work on CLO assumes the data has fully observed cost coefficient vectors, but in many applications, we can only see the realized cost of a historical decision, that is, just one projection of the random cost coefficient vector, to which we refer as bandit feedback. We study a class of algorithms for CLO with bandit feedback, which we term induced empirical risk minimization (IERM), where we fit a predictive model to directly optimize the downstream performance of the policy it induces. We show a fast-rate regret bound for IERM that allows for misspecified model classes and flexible choices of the optimization estimate, and we develop computationally tractable surrogate losses. A byproduct of our theory of independent interest is fast-rate regret bound for IERM with full feedback and misspecified policy class. We compare the performance of different modeling choices numerically using a stochastic shortest path example and provide practical insights from the empirical results.