title: When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMs

abstract: Self-correction is an approach to improving responses from large language models (LLMs) by refining the responses using LLMs during inference. Prior work has proposed various self-correction frameworks using different sources of feedback, including self-evaluation and external feedback. However, there is still no consensus on the question of when LLMs can correct their own mistakes, as recent studies also report negative results. In this work, we critically survey broad papers and discuss the conditions required for successful self-correction. We first find that prior studies often do not define their research questions in detail and involve impractical frameworks or unfair evaluations that over-evaluate self-correction. To tackle these issues, we categorize research questions in self-correction research and provide a checklist for designing appropriate experiments. Our critical survey based on the newly categorized research questions shows that (1) no prior work demonstrates successful self-correction with feedback from prompted LLMs in general tasks, (2) self-correction works well in tasks that can use reliable external feedback, and (3) large-scale fine-tuning enables self-correction.


title: Floquet engineering nearly flat bands through quantum-geometric light-matter coupling with surface polaritons

abstract: We investigate Floquet engineering in a sawtooth chain -- a minimal model hosting a nearly flat band endowed with nontrivial quantum geometry -- coupled to driven surface polaritons. In this paradigmatic flat band model, light-matter coupling to a flat band is enabled by quantum geometry despite the vanishing band velocity and band curvature. We show that light polarization and finite momentum transfer in polaritonic settings provide sufficient tunability to flatten or unflatten bands, with sometimes drastic band structure modifications beyond what is attainable with laser pulses in free space. Possible implications for light-driven phenomena in prototypical flat-band moir\'e or kagome materials are discussed.


title: Enhancing Dynamic CT Image Reconstruction with Neural Fields Through Explicit Motion Regularizers

abstract: Image reconstruction for dynamic inverse problems with highly undersampled data poses a major challenge: not accounting for the dynamics of the process leads to a non-realistic motion with no time regularity. Variational approaches that penalize time derivatives or introduce motion model regularizers have been proposed to relate subsequent frames and improve image quality using grid-based discretization. Neural fields offer an alternative parametrization of the desired spatiotemporal quantity with a deep neural network, a lightweight, continuous, and biased towards smoothness representation. The inductive bias has been exploited to enforce time regularity for dynamic inverse problems resulting in neural fields optimized by minimizing a data-fidelity term only. In this paper we investigate and show the benefits of introducing explicit PDE-based motion regularizers, namely, the optical flow equation, in 2D+time computed tomography for the optimization of neural fields. We also compare neural fields against a grid-based solver and show that the former outperforms the latter.


title: pOps: Photo-Inspired Diffusion Operators

abstract: Text-guided image generation enables the creation of visual content from textual descriptions. However, certain visual concepts cannot be effectively conveyed through language alone. This has sparked a renewed interest in utilizing the CLIP image embedding space for more visually-oriented tasks through methods such as IP-Adapter. Interestingly, the CLIP image embedding space has been shown to be semantically meaningful, where linear operations within this space yield semantically meaningful results. Yet, the specific meaning of these operations can vary unpredictably across different images. To harness this potential, we introduce pOps, a framework that trains specific semantic operators directly on CLIP image embeddings. Each pOps operator is built upon a pretrained Diffusion Prior model. While the Diffusion Prior model was originally trained to map between text embeddings and image embeddings, we demonstrate that it can be tuned to accommodate new input conditions, resulting in a diffusion operator. Working directly over image embeddings not only improves our ability to learn semantic operations but also allows us to directly use a textual CLIP loss as an additional supervision when needed. We show that pOps can be used to learn a variety of photo-inspired operators with distinct semantic meanings, highlighting the semantic diversity and potential of our proposed approach.


title: On a reconstruction procedure for special spherically symmetric metrics in the scalar-Einstein-Gauss-Bonnet model: the Schwarzschild metric test

abstract: The 4D gravitational model with a real scalar field $\varphi$, Einstein and Gauss-Bonnet terms is considered. The action contains the potential $U(\varphi)$ and the Gauss-Bonnet coupling function $f(\varphi)$. For a special static spherically symmetric metric $ds^2 = (A(u))^{-1} du^2 - A(u) dt^2 + u^2 d\Omega^2$, with $A(u) > 0$ ($u > 0$ is a radial coordinate), we verify the so-called reconstruction procedure suggested by Nojiri and Nashed. This procedure presents certain implicit relations for $U(\varphi)$ and $f(\varphi)$ which lead to exact solutions to the equations of motion for a given metric governed by $A(u)$. We confirm that all relations in the approach of Nojiri and Nashed for $f(\varphi(u))$ and $\varphi(u)$ are correct, but the relation for $U(\varphi(u))$ contains a typo which is eliminated in this paper. Here we apply the procedure to the (external) Schwarzschild metric with the gravitational radius $2 \mu $ and $u > 2 \mu$. Using the ``no-ghost'' restriction (i.e., reality of $\varphi(u)$), we find two families of $(U(\varphi), f(\varphi))$. The first one gives us the Schwarzschild metric defined for $u > 3 \mu$, while the second one describes the Schwarzschild metric defined for $2 \mu < u < 3 \mu$ ($3 \mu$ is the radius of the photon sphere). In both cases the potential $U(\varphi)$ is negative.


title: Pulmonary Embolism Mortality Prediction Using Multimodal Learning Based on Computed Tomography Angiography and Clinical Data

abstract: Purpose: Pulmonary embolism (PE) is a significant cause of mortality in the United States. The objective of this study is to implement deep learning (DL) models using Computed Tomography Pulmonary Angiography (CTPA), clinical data, and PE Severity Index (PESI) scores to predict PE mortality. Materials and Methods: 918 patients (median age 64 years, range 13-99 years, 52% female) with 3,978 CTPAs were identified via retrospective review across three institutions. To predict survival, an AI model was used to extract disease-related imaging features from CTPAs. Imaging features and/or clinical variables were then incorporated into DL models to predict survival outcomes. Four models were developed as follows: (1) using CTPA imaging features only; (2) using clinical variables only; (3) multimodal, integrating both CTPA and clinical variables; and (4) multimodal fused with calculated PESI score. Performance and contribution from each modality were evaluated using concordance index (c-index) and Net Reclassification Improvement, respectively. Performance was compared to PESI predictions using the Wilcoxon signed-rank test. Kaplan-Meier analysis was performed to stratify patients into high- and low-risk groups. Additional factor-risk analysis was conducted to account for right ventricular (RV) dysfunction. Results: For both data sets, the PESI-fused and multimodal models achieved higher c-indices than PESI alone. Following stratification of patients into high- and low-risk groups by multimodal and PESI-fused models, mortality outcomes differed significantly (both p<0.001). A strong correlation was found between high-risk grouping and RV dysfunction. Conclusions: Multiomic DL models incorporating CTPA features, clinical data, and PESI achieved higher c-indices than PESI alone for PE survival prediction.


title: A behavioural approach to port-controlled systems

abstract: We give insight in the structure of port-Hamiltonian systems as control systems in between two closed Hamiltonian systems. Using the language of category theory, we identify systems with their behavioural representation and view a port-control structure with desired structural properties on a given closed system as an extension of this system which itself may be embedded in a "larger" closed system. The latter system describes the nature of the ports (e.g. Hamiltonian, metriplectic etc.). This point of view allows us to describe meaningful port-control structures for a large family of systems, which is illustrated with Hamiltonian and metriplectic systems.


title: CodeR: Issue Resolving with Multi-Agent and Task Graphs

abstract: GitHub issue resolving recently has attracted significant attention from academia and industry. SWE-bench is proposed to measure the performance in resolving issues. In this paper, we propose CodeR, which adopts a multi-agent framework and pre-defined task graphs to Repair & Resolve reported bugs and add new features within code Repository. On SWE-bench lite, CodeR is able to solve 28.33% of issues, when submitting only once for each issue. We examine the performance impact of each design of CodeR and offer insights to advance this research direction.


title: Forbidden subgraphs of conjugacy class graphs of groups

abstract: Let G be a finite group. The nilpotent/commuting/solvable conjugacy class graph is a simple graph with non-central conjugacy classes of G as its vertex set and two vertices are adjacent if and only if a member of one conjugacy class with a member of another conjugacy class generates a nilpotent/abelian/solvable (sub)group. In this paper have discussed about the forbidden subgraphs of nilpotent, commuting and solvable conjugacy class graphs of groups.


title: Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding

abstract: Within the context of reading comprehension, the task of Distractor Generation (DG) aims to generate several incorrect options to confuse readers. Traditional supervised methods for DG rely heavily on expensive human-annotated distractor labels. In this paper, we propose an unsupervised DG framework, leveraging Large Language Models (LLMs) as cost-effective annotators to enhance the DG capability of smaller student models. Specially, to perform knowledge distilling, we propose a dual task training strategy that integrates pseudo distractors from LLMs and the original answer in-formation as the objective targets with a two-stage training process. Moreover, we devise a counterfactual contrastive decoding mechanism for increasing the distracting capability of the DG model. Experiments show that our unsupervised generation method with Bart-base greatly surpasses GPT-3.5-turbo performance with only 200 times fewer model parameters. Our proposed unsupervised DG method offers a cost-effective framework for practical reading comprehension applications, without the need of laborious distractor annotation and costly large-size models


title: On Efficient Algorithms For Partial Quantifier Elimination

abstract: Earlier, we introduced Partial Quantifier Elimination (PQE). It is a $\mathit{generalization}$ of regular quantifier elimination where one can take a $\mathit{part}$ of the formula out of the scope of quantifiers. We apply PQE to CNF formulas of propositional logic with existential quantifiers. The appeal of PQE is that many problems like equivalence checking and model checking can be solved in terms of PQE and the latter can be very efficient. The main flaw of current PQE solvers is that they do not $\mathit{reuse}$ learned information. The problem here is that these PQE solvers are based on the notion of clause redundancy and the latter is a $\mathit{structural}$ rather than $\mathit{semantic}$ property. In this paper, we provide two important theoretical results that enable reusing the information learned by a PQE solver. Such reusing can dramatically boost the efficiency of PQE like conflict clause learning boosts SAT solving.


title: A new trick for for Santalo's integral geometric proof of the strong Bonnesen inequality

abstract: Given a lamina $K$ whose boundary $\partial K$ is convex we define the Bonnesen functional by integrating over the position and orientation of a disk of radius $r$ its intersections with the lamina and its boundary. \[ B(r) = \frac{1}{2\pi}\int (\frac{n}{2}-\nu)dx\,dy\,d\theta =rL-A-\pi r^2\] where $n$ is the number of intersections of the boundary of $K$ with the boundary of the disk and $\nu$ (with values either 0 or 1) is the number of intersections of the interiors. Analyzing the interval on which $B(r)\ge 0$ leads to a number of isoperimetric inequalities. For example Santalo observed that $B(r)$ is non-negative on $[r_{in},r_{out}]$ where $r_{in}$, the inradius, is the largest disk contained in $K$ and $r_{out}$, the outradius, is the smallest disk containing $K$. For this configuration if the bodies intersect than their boundaries must intersect in 2 or more points (generically) so the integrand is always non-negative and $B(r)\ge 0$. In this paper we show that $B(r)\ge 0$ on the interval$[\rho_{in}, \rho_{out}]$ where these are the inner and outer radii of the annulus of minimal width which surrounds $\partial K$. In this case the integrand is not always positive but we carefully analyze the integral and use an ``averaging trick'' to balance regions where the integrand is negative with regions where the integrand is positive to show that $B(r)\ge 0$ The final isoperimetric inequalities obtained are not new, the same results have been obtained by cleverly cutting $\partial K$ and doubling it to create two centrally symmetric curves and analyzing those, but I believe that the averaging trick is new in this context. The paper also reviews the concept of ``positive centers'' and shows how the isoperimetric inequalities can be used to the show that the final shape of the curve shortening flow in Euclidean and Minkowski geometries are respectively the disk and the isoperimetrix.


title: REvolve: Reward Evolution with Large Language Models for Autonomous Driving

abstract: Designing effective reward functions is crucial to training reinforcement learning (RL) algorithms. However, this design is non-trivial, even for domain experts, due to the subjective nature of certain tasks that are hard to quantify explicitly. In recent works, large language models (LLMs) have been used for reward generation from natural language task descriptions, leveraging their extensive instruction tuning and commonsense understanding of human behavior. In this work, we hypothesize that LLMs, guided by human feedback, can be used to formulate human-aligned reward functions. Specifically, we study this in the challenging setting of autonomous driving (AD), wherein notions of "good" driving are tacit and hard to quantify. To this end, we introduce REvolve, an evolutionary framework that uses LLMs for reward design in AD. REvolve creates and refines reward functions by utilizing human feedback to guide the evolution process, effectively translating implicit human knowledge into explicit reward functions for training (deep) RL agents. We demonstrate that agents trained on REvolve-designed rewards align closely with human driving standards, thereby outperforming other state-of-the-art baselines.


title: Nonclassical optical response of particle plasmons with quantum informed local optics

abstract: As the dimensions of plasmonic structures or the field confinement length approach the mean free path of electrons, mesoscopic optical response effects, including nonlocality, electron density spill-in or spill-out, and Landau damping, are expected to become observable. In this work, we present a quantum-informed local analogue model (QILAM) that maps these nonclassical optical responses onto a local dielectric film. The primary advantage of this model lies in its compatibility with the highly efficient boundary element method (BEM), which includes retardation effects and eliminates the need to incorporate wavevector-dependent permittivity. Furthermore, our approach offers a unified framework that connects two important semiclassical theories: the generalized nonlocal optical response (GNOR) theory and the Feibelman d-parameters formalism. We envision that QILAM could evolve into a multiscale electrodynamic tool for exploring nonclassical optical responses in diverse plasmonic structures in future. This could be achieved by directly translating mesoscopic effects into observable phenomena, such as resonance energy shifts and linewidth broadening in the scattering spectrum.


title: FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs

abstract: Fact-checking is a crucial natural language processing (NLP) task that verifies the truthfulness of claims by considering reliable evidence. Traditional methods are often limited by labour-intensive data curation and rule-based approaches. In this paper, we present FactGenius, a novel method that enhances fact-checking by combining zero-shot prompting of large language models (LLMs) with fuzzy text matching on knowledge graphs (KGs). Leveraging DBpedia, a structured linked data dataset derived from Wikipedia, FactGenius refines LLM-generated connections using similarity measures to ensure accuracy. The evaluation of FactGenius on the FactKG, a benchmark dataset for fact verification, demonstrates that it significantly outperforms existing baselines, particularly when fine-tuning RoBERTa as a classifier. The two-stage approach of filtering and validating connections proves crucial, achieving superior performance across various reasoning types and establishing FactGenius as a promising tool for robust fact-checking. The code and materials are available at https://github.com/SushantGautam/FactGenius.


title: Kinetic Parameters analysis of GdAlO$_3$ based on thermoluminescent phenomenon

abstract: {We herein report on the calculation of thermoluminescence (TL) kinetic parameters determined from the TL emission of synthetic GdAlO3 (GAO) phosphors prepared by the co-precipitation method. The sample, characterized by means of X-ray diffraction with an orthorhombic phase structure (space group Pnma (62), shows complex glow curves consisting of at least four groups of components peaked at 100, 140, 240, and 290 {\deg}C where the two lower overlapped temperature peaks are difficult to identify using the $T_M-T_{stop}$. The coexistence of a continuum in the trap distribution (linked to the lower temperature peaks) and a discrete trap system (associated with the components at temperatures higher than 200 {\deg}C) can be distinguished. The estimation of the TL kinetic parameters is performed using GlowFit, TLAnal, the spreadsheet Origin, Computing Glow Curve Deconvolution (CGCD), and various heating rate (VHR) methods. However, only CGCD appears as the suitable technique for such purpose since it provides information on the TL physical process supported by mathematical models based on a linear combination of functions related to the First Order Kinetic approach.


title: 3D Trajectory Design for Energy-constrained Aerial CRNs Under Probabilistic LoS Channel

abstract: Unmanned aerial vehicles (UAVs) have been attracting significant attention because there is a high probability of line-of-sight links being obtained between them and terrestrial nodes in high-rise urban areas. In this work, we investigate cognitive radio networks (CRNs) by jointly designing three-dimensional (3D) trajectory, the transmit power of the UAV, and user scheduling. Considering the UAV's onboard energy consumption, an optimization problem is formulated in which the average achievable rate of the considered system is maximized by jointly optimizing the UAV's 3D trajectory, transmission power, and user scheduling. Due to the non-convex optimization problem, a lower bound on the average achievable rate is utilized to reduce the complexity of the solution. Subsequently, the original optimization problem is decoupled into four subproblems by using block coordinate descent, and each subproblem is transformed into manageable convex optimization problems by introducing slack variables and successive convex approximation. Numerical results validate the effectiveness of our proposed algorithm and demonstrate that the 3D trajectories of UAVs can enhance the average achievable rate of aerial CRNs.


title: Compute-Efficient Medical Image Classification with Softmax-Free Transformers and Sequence Normalization

abstract: The Transformer model has been pivotal in advancing fields such as natural language processing, speech recognition, and computer vision. However, a critical limitation of this model is its quadratic computational and memory complexity relative to the sequence length, which constrains its application to longer sequences. This is especially crucial in medical imaging where high-resolution images can reach gigapixel scale. Efforts to address this issue have predominantely focused on complex techniques, such as decomposing the softmax operation integral to the Transformer's architecture. This paper addresses this quadratic computational complexity of Transformer models and introduces a remarkably simple and effective method that circumvents this issue by eliminating the softmax function from the attention mechanism and adopting a sequence normalization technique for the key, query, and value tokens. Coupled with a reordering of matrix multiplications this approach reduces the memory- and compute complexity to a linear scale. We evaluate this approach across various medical imaging datasets comprising fundoscopic, dermascopic, radiologic and histologic imaging data. Our findings highlight that these models exhibit a comparable performance to traditional transformer models, while efficiently handling longer sequences.


title: Scale-Free Image Keypoints Using Differentiable Persistent Homology

abstract: In computer vision, keypoint detection is a fundamental task, with applications spanning from robotics to image retrieval; however, existing learning-based methods suffer from scale dependency and lack flexibility. This paper introduces a novel approach that leverages Morse theory and persistent homology, powerful tools rooted in algebraic topology. We propose a novel loss function based on the recent introduction of a notion of subgradient in persistent homology, paving the way toward topological learning. Our detector, MorseDet, is the first topology-based learning model for feature detection, which achieves competitive performance in keypoint repeatability and introduces a principled and theoretically robust approach to the problem.


title: Enhancing Inertial Hand based HAR through Joint Representation of Language, Pose and Synthetic IMUs

abstract: Due to the scarcity of labeled sensor data in HAR, prior research has turned to video data to synthesize Inertial Measurement Units (IMU) data, capitalizing on its rich activity annotations. However, generating IMU data from videos presents challenges for HAR in real-world settings, attributed to the poor quality of synthetic IMU data and its limited efficacy in subtle, fine-grained motions. In this paper, we propose Multi$^3$Net, our novel multi-modal, multitask, and contrastive-based framework approach to address the issue of limited data. Our pretraining procedure uses videos from online repositories, aiming to learn joint representations of text, pose, and IMU simultaneously. By employing video data and contrastive learning, our method seeks to enhance wearable HAR performance, especially in recognizing subtle activities.Our experimental findings validate the effectiveness of our approach in improving HAR performance with IMU data. We demonstrate that models trained with synthetic IMU data generated from videos using our method surpass existing approaches in recognizing fine-grained activities.


title: The Intelligible and Effective Graph Neural Additive Networks

abstract: Graph Neural Networks (GNNs) have emerged as the predominant approach for learning over graph-structured data. However, most GNNs operate as black-box models and require post-hoc explanations, which may not suffice in high-stakes scenarios where transparency is crucial. In this paper, we present a GNN that is interpretable by design. Our model, Graph Neural Additive Network (GNAN), is a novel extension of the interpretable class of Generalized Additive Models, and can be visualized and fully understood by humans. GNAN is designed to be fully interpretable, allowing both global and local explanations at the feature and graph levels through direct visualization of the model. These visualizations describe the exact way the model uses the relationships between the target variable, the features, and the graph. We demonstrate the intelligibility of GNANs in a series of examples on different tasks and datasets. In addition, we show that the accuracy of GNAN is on par with black-box GNNs, making it suitable for critical applications where transparency is essential, alongside high accuracy.


title: Advancements in Glitch Subtraction Systems for Enhancing Gravitational Wave Data Analysis: A Brief Review

abstract: Glitches are transitory noise artifacts that degrade the detection sensitivity and accuracy of interferometric observatories such as LIGO and Virgo in gravitational wave astronomy. Reliable glitch subtraction techniques are essential for separating genuine gravitational wave signals from background noise and improving the accuracy of astrophysical investigations. This review study summarizes the main glitch subtraction methods used in the industry. We talk about the efficacy of classic time-domain techniques in real-time applications, like matched filtering and regression methods. The robustness of frequency-domain approaches, such as wavelet transformations and spectral analysis, in detecting and mitigating non-stationary glitches is assessed. We also investigate sophisticated machine learning methods, demonstrating great potential in automatically identifying and eliminating intricate glitch patterns. We hope to provide a thorough understanding of these approaches' uses, difficulties, and potential for future development in gravitational wave data analysis by contrasting their advantages and disadvantages. Researchers looking to enhance glitch subtraction procedures and raise the accuracy of gravitational wave detections will find great value in this paper.


title: Meson modes of probe $D7$-branes in Klebanov-Strassler background

abstract: We examine the properties of 4-d bosonic and fermionic (mesons and mesinos) modes on $D7$-branes wrapped over Kuperstein 4-cycle of the Klebanov-Strassler background. The wave equations are derived in a convenient parameterization of the warped deformed conifold metric. The mass spectra, wave functions and couplings of bosonic modes are evaluated by means of semi-classical tools. We explore the possible existence of fermionic zero modes.


title: Convergence of the denoising diffusion probabilistic models

abstract: We theoretically analyze the original version of the denoising diffusion probabilistic models (DDPMs) presented in Ho, J., Jain, A., and Abbeel, P., Advances in Neural Information Processing Systems, 33 (2020), pp. 6840-6851. Our main theorem states that the sequence constructed by the original DDPM sampling algorithm weakly converges to a given data distribution as the number of time steps goes to infinity, under some asymptotic conditions on the parameters for the variance schedule, the $L^2$-based score estimation error, and the noise estimating function with respect to the number of time steps. In proving the theorem, we reveal that the sampling sequence can be seen as an exponential integrator type approximation of a reverse time stochastic differential equation (SDE). Moreover, we give a proper definition of the backward It\^o integral for general continuous processes and prove rigorously the reverse time representation of a given SDE with backward It\^o integral, without using the smoothness and uniqueness of the associated forward Kolmogorov equations.


title: Sequence-to-Sequence Multi-Modal Speech In-Painting

abstract: Speech in-painting is the task of regenerating missing audio contents using reliable context information. Despite various recent studies in multi-modal perception of audio in-painting, there is still a need for an effective infusion of visual and auditory information in speech in-painting. In this paper, we introduce a novel sequence-to-sequence model that leverages the visual information to in-paint audio signals via an encoder-decoder architecture. The encoder plays the role of a lip-reader for facial recordings and the decoder takes both encoder outputs as well as the distorted audio spectrograms to restore the original speech. Our model outperforms an audio-only speech in-painting model and has comparable results with a recent multi-modal speech in-painter in terms of speech quality and intelligibility metrics for distortions of 300 ms to 1500 ms duration, which proves the effectiveness of the introduced multi-modality in speech in-painting.


title: A GPU-ready pseudo-spectral method for direct numerical simulations of multiphase turbulence

abstract: In this work, we detail the GPU-porting of an in-house pseudo-spectral solver tailored towards large-scale simulations of interface-resolved simulation of drop- and bubble-laden turbulent flows. The code relies on direct numerical simulation of the Navier-Stokes equations, used to describe the flow field, coupled with a phase-field method, used to describe the shape, deformation, and topological changes of the interface of the drops or bubbles. The governing equations -Navier-Stokes and Cahn-Hilliard equations-are solved using a pseudo-spectral method that relies on transforming the variables in the wavenumber space. The code targets large-scale simulations of drop- and bubble-laden turbulent flows and relies on a multilevel parallelism. The first level of parallelism relies on the message-passing interface (MPI) and is used on multi-core architectures in CPU-based infrastructures. A second level of parallelism relies on OpenACC directives and cuFFT libraries and is used to accelerate the code execution when GPU-based infrastructures are targeted. The resulting multiphase flow solver can be efficiently executed in heterogeneous computing infrastructures and exhibits a remarkable speed-up when GPUs are employed. Thanks to the modular structure of the code and the use of a directive-based strategy to offload code execution on GPUs, only minor code modifications are required when targeting different computing architectures. This improves code maintenance, version control and the implementation of additional modules or governing equations.


title: Structural Interventions and the Dynamics of Inequality

abstract: Recent conversations in the algorithmic fairness literature have raised several concerns with standard conceptions of fairness. First, constraining predictive algorithms to satisfy fairness benchmarks may lead to non-optimal outcomes for disadvantaged groups. Second, technical interventions are often ineffective by themselves, especially when divorced from an understanding of structural processes that generate social inequality. Inspired by both these critiques, we construct a common decision-making model, using mortgage loans as a running example. We show that under some conditions, any choice of decision threshold will inevitably perpetuate existing disparities in financial stability unless one deviates from the Pareto optimal policy. Then, we model the effects of three different types of interventions. We show how different interventions are recommended depending upon the difficulty of enacting structural change upon external parameters and depending upon the policymaker's preferences for equity or efficiency. Counterintuitively, we demonstrate that preferences for efficiency over equity may lead to recommendations for interventions that target the under-resourced group. Finally, we simulate the effects of interventions on a dataset that combines HMDA and Fannie Mae loan data. This research highlights the ways that structural inequality can be perpetuated by seemingly unbiased decision mechanisms, and it shows that in many situations, technical solutions must be paired with external, context-aware interventions to enact social change.


title: Isoperimetric inequalities in high-dimensional convex sets

abstract: These are lecture notes focusing on recent progress towards Bourgain's slicing problem and the isoperimetric conjecture proposed by Kannan, Lovasz and Simonovits (KLS).


title: The system of the vortex-like structures: the viewpoint on a turbulence modelling

abstract: In this study we suggest new approach to turbulence modeling. To develop this approach, we construct the set of the vortex-like dynamical systems evolving in the space $E_3$. These systems are constructed using the AKNS hierarchy so that they generalize thin closed vortex filament described in the local induction approximation. We construct and investigate the Hamiltonian dynamics of these systems in terms of the non - standard variables. We formulate the principles of quantization these systems focusing on the quantum description of the filaments with linearized dynamics. To describe the energy of vortex-like structures, we apply a new method based on the use of the central extended Galilei group. In a special case, we calculate the energy levels of a system of quantized vortices. The proposed approach makes it possible to describe both the interaction of such vortex - like filaments and the processes of their creation and annihilation in a natural way. As a result, we have constructed a quantum turbulent flow model that demonstrates the relationship between stochastic and integrable dynamics.


title: TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergy

abstract: Tables contain factual and quantitative data accompanied by various structures and contents that pose challenges for machine comprehension. Previous methods generally design task-specific architectures and objectives for individual tasks, resulting in modal isolation and intricate workflows. In this paper, we present a novel large vision-language model, TabPedia, equipped with a concept synergy mechanism. In this mechanism, all the involved diverse visual table understanding (VTU) tasks and multi-source visual embeddings are abstracted as concepts. This unified framework allows TabPedia to seamlessly integrate VTU tasks, such as table detection, table structure recognition, table querying, and table question answering, by leveraging the capabilities of large language models (LLMs). Moreover, the concept synergy mechanism enables table perception-related and comprehension-related tasks to work in harmony, as they can effectively leverage the needed clues from the corresponding source perception embeddings. Furthermore, to better evaluate the VTU task in real-world scenarios, we establish a new and comprehensive table VQA benchmark, ComTQA, featuring approximately 9,000 QA pairs. Extensive quantitative and qualitative experiments on both table perception and comprehension tasks, conducted across various public benchmarks, validate the effectiveness of our TabPedia. The superior performance further confirms the feasibility of using LLMs for understanding visual tables when all concepts work in synergy. The benchmark ComTQA has been open-sourced at https://huggingface.co/datasets/ByteDance/ComTQA. The source code and model will be released later.


title: Power output optimization in complex laser systems by means of polarization control

abstract: Recently, the polarimetricmethod for thermally-induced polarization changes driven power losses (TIPCL) mitigation in complex laser systems has been developed. However, the final optimization relied on the four-parameter numerical process. This letter provides a fully analytical direct calculation alternative to this optimization process. The validity of this approach is demonstrated on the previously published data from pulsed laser system Bivoj/DiPOLE100. The new approach provides a deeper insight into the polarimetric method for TIPCL suppression and also brings a more precise, reliable, and faster alternative to the numerical process used earlier.


title: Black Flowers and Real Forms of Higher Spin Symmetries

abstract: Using Chern-Simons formulation, we investigate higher spin (HS) black holes in AdS$_{3}$ with soft Heisenberg hair and establish linkage with the real forms of the underlying complexified gauge symmetries taken here as $SL(N,C)_{L}\times SL(N,C)_{R}.$ We study the various conserved currents characterizing the HS black flowers (HS-BF) and show that they can be formed of layers indexed by the elements of the centre of the gauge symmetry. This feature follows from requiring the holonomy of the asymptotic gauge connection around the thermal cycle to sit in the centre $\mathbb{Z}_{N}$ of the symmetry group. With regard to the compact subgroups of the real forms of the complexified gauge symmetry, we calculate the entropies of the HS-BF and verify that, unless we are considering trivial holonomies, there are no continuous paths joining the HS-BF to the core spin 2 black holes. As explicit illustrations, we give quantum field realisations of the soft Heisenberg hair in terms of bosonic and fermionic primary conformal fields and compute the HS-BF entropy as a function of the number of fermions occupying the ground state of the Heisenberg soft hair.


title: Transferring Domain Knowledge with (X)AI-Based Learning Systems

abstract: In numerous high-stakes domains, training novices via conventional learning systems does not suffice. To impart tacit knowledge, experts' hands-on guidance is imperative. However, training novices by experts is costly and time-consuming, increasing the need for alternatives. Explainable artificial intelligence (XAI) has conventionally been used to make black-box artificial intelligence systems interpretable. In this work, we utilize XAI as an alternative: An (X)AI system is trained on experts' past decisions and is then employed to teach novices by providing examples coupled with explanations. In a study with 249 participants, we measure the effectiveness of such an approach for a classification task. We show that (X)AI-based learning systems are able to induce learning in novices and that their cognitive styles moderate learning. Thus, we take the first steps to reveal the impact of XAI on human learning and point AI developers to future options to tailor the design of (X)AI-based learning systems.


title: Escape Velocity Mass of Abell S1063

abstract: We measure the radius-velocity phase-space edge profile for Abell S1063 using galaxy redshifts from arXiv:1409.3507 and arXiv:2109.03305. Combined with a cosmological model and after accounting for interlopers and sampling effects, we infer the escape velocity profile. Using the Poisson equation, we then directly constrain the gravitational potential profile and find excellent agreement between three different density models. For the NFW profile, we find log$_{10}$(M$_{200},{\rm crit}$)= $15.40^{+0.06}_{-0.12}$M$_{\odot}$, consistent to within $1\sigma$ of six recently published lensing masses. We argue that this consistency is due to the fact that the escape technique shares no common systematics with lensing other than radial binning. These masses are 2-4$\sigma$ lower than estimates using X-ray data, in addition to earlier velocity dispersion estimates. We measure the 1D velocity dispersion within r$_{200}$ to be $\sigma_{v} = 1477^{+87}_{-99}$ km/s, which combined with our escape velocity mass, brings the dispersion for AS1063 in-line with hydrodynamic cosmological simulations for the first time.


title: Performance Trade-off of Integrated Sensing and Communications for Multi-User Backscatter Systems

abstract: This paper studies the performance trade-off in a multi-user backscatter communication (BackCom) system for integrated sensing and communications (ISAC), where the multi-antenna ISAC transmitter sends excitation signals to power multiple single-antenna passive backscatter devices (BD), and the multi-antenna ISAC receiver performs joint sensing (localization) and communication tasks based on the backscattered signals from all BDs. Specifically, the localization performance is measured by the Cram\'{e}r-Rao bound (CRB) on the transmission delay and direction of arrival (DoA) of the backscattered signals, whose closed-form expression is obtained by deriving the corresponding Fisher information matrix (FIM), and the communication performance is characterized by the sum transmission rate of all BDs. Then, to characterize the trade-off between the localization and communication performances, the CRB minimization problem with the communication rate constraint is formulated, and is shown to be non-convex in general. By exploiting the hidden convexity, we propose an approach that combines fractional programming (FP) and Schur complement techniques to transform the original problem into an equivalent convex form. Finally, numerical results reveal the trade-off between the CRB and sum transmission rate achieved by our proposed method.


title: Measurements of the branching fractions of semileptonic $D^{+}_s$ decays via $e^+e^-\to D_s^{*+}D_s^{*-}$

abstract: We measure the absolute branching fractions of semileptonic $D^+_s$ decays via the $e^+e^-\to D_s^{*+}D_s^{*-}$ process using $e^+e^-$ collision data corresponding to an integrated luminosity of $10.64~\mathrm{fb}^{-1}$ collected by the BESIII detector at center-of-mass energies between 4.237 and 4.699 GeV. The branching fractions are ${\mathcal B}(D_s^+\to \eta e^+\nu_e)=(2.35\pm0.11_{\rm stat}\pm 0.10_{\rm syst})\%,$ ${\mathcal B}(D_s^+\to \eta^\prime e^+\nu_e)=(0.82\pm0.09_{\rm stat}\pm 0.04_{\rm syst})\%,$ ${\mathcal B}(D_s^+\to \phi e^+\nu_e)=(2.21\pm0.16_{\rm stat}\pm 0.11_{\rm syst})\%,$ ${\mathcal B}(D_s^+\to f_0(980) e^+\nu_e,f_0(980)\to\pi^+\pi^-)=(0.15\pm0.02_{\rm stat}\pm 0.01_{\rm syst})\%,$ ${\mathcal B}(D_s^+\to K^0 e^+\nu_e)=(0.24\pm0.04_{\rm stat}\pm 0.01_{\rm syst})\%,$ and ${\mathcal B}(D_s^+\to K^{*0} e^+\nu_e)=(0.19\pm0.03_{\rm stat}\pm 0.01_{\rm syst})\%.$ These results are consistent with those measured via the $e^+e^-\to D_s^{*\pm}D_s^{\mp}$ process by BESIII and CLEO. The hadronic transition form factors $D^+_s\to \eta e^+\nu_e$, $D^+_s\to \eta^\prime e^+\nu_e$, and $D^+_s\to K^0 e^+\nu_e$ at four-momentum transfer squared $q^2$ = 0 are determined to be $f^{\eta}_+(0) = 0.482 \pm 0.011_{\rm stat} \pm 0.009_{\rm syst}\pm0.004_{\rm input},$ $f^{\eta^{\prime}}_+(0) = 0.562 \pm 0.031_{\rm stat} \pm 0.014_{\rm syst}\pm0.003_{\rm input},$ and $f^{K^0}_+(0) = 0.624 \pm 0.052_{\rm stat} \pm 0.013_{\rm syst}\pm0.002_{\rm input}.$


title: Probing Language Models for Pre-training Data Detection

abstract: Large Language Models (LLMs) have shown their impressive capabilities, while also raising concerns about the data contamination problems due to privacy issues and leakage of benchmark datasets in the pre-training phase. Therefore, it is vital to detect the contamination by checking whether an LLM has been pre-trained on the target texts. Recent studies focus on the generated texts and compute perplexities, which are superficial features and not reliable. In this study, we propose to utilize the probing technique for pre-training data detection by examining the model's internal activations. Our method is simple and effective and leads to more trustworthy pre-training data detection. Additionally, we propose ArxivMIA, a new challenging benchmark comprising arxiv abstracts from Computer Science and Mathematics categories. Our experiments demonstrate that our method outperforms all baselines, and achieves state-of-the-art performance on both WikiMIA and ArxivMIA, with additional experiments confirming its efficacy (Our code and dataset are available at https://github.com/zhliu0106/probing-lm-data).


title: HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models

abstract: Recent years have witnessed a trend of the deep integration of the generation and reconstruction paradigms. In this paper, we extend the ability of controllable generative models for a more comprehensive hand mesh recovery task: direct hand mesh generation, inpainting, reconstruction, and fitting in a single framework, which we name as Holistic Hand Mesh Recovery (HHMR). Our key observation is that different kinds of hand mesh recovery tasks can be achieved by a single generative model with strong multimodal controllability, and in such a framework, realizing different tasks only requires giving different signals as conditions. To achieve this goal, we propose an all-in-one diffusion framework based on graph convolution and attention mechanisms for holistic hand mesh recovery. In order to achieve strong control generation capability while ensuring the decoupling of multimodal control signals, we map different modalities to a shared feature space and apply cross-scale random masking in both modality and feature levels. In this way, the correlation between different modalities can be fully exploited during the learning of hand priors. Furthermore, we propose Condition-aligned Gradient Guidance to enhance the alignment of the generated model with the control signals, which significantly improves the accuracy of the hand mesh reconstruction and fitting. Experiments show that our novel framework can realize multiple hand mesh recovery tasks simultaneously and outperform the existing methods in different tasks, which provides more possibilities for subsequent downstream applications including gesture recognition, pose generation, mesh editing, and so on.


title: Statistics-Informed Parameterized Quantum Circuit via Maximum Entropy Principle for Data Science and Finance

abstract: Quantum machine learning has demonstrated significant potential in solving practical problems, particularly in statistics-focused areas such as data science and finance. However, challenges remain in preparing and learning statistical models on a quantum processor due to issues with trainability and interpretability. In this letter, we utilize the maximum entropy principle to design a statistics-informed parameterized quantum circuit (SI-PQC) for efficiently preparing and training of quantum computational statistical models, including arbitrary distributions and their weighted mixtures. The SI-PQC features a static structure with trainable parameters, enabling in-depth optimized circuit compilation, exponential reductions in resource and time consumption, and improved trainability and interpretability for learning quantum states and classical model parameters simultaneously. As an efficient subroutine for preparing and learning in various quantum algorithms, the SI-PQC addresses the input bottleneck and facilitates the injection of prior knowledge.


title: A Reverse Mathematical Analysis of Hilbert's Nullstellensatz and Basis Theorem

abstract: This paper presents an expository reverse-mathematical analysis of two fundamental theorems in commutative algebra: Hilbert's Nullstellensatz and Basis Theorem. In addition to its profound significance in commutative algebra and algebraic geometry, the Basis Theorem is also historically notable for its nonconstructive proof. The Nullstellensatz, on the other hand, is noteworthy as it establishes a fundamental connection between the more algebraic notion of ideals and the more geometric notion of varieties. We explore the conscious shift from computational to conceptual approaches in mathematical argumentation, contextualizing Hilbert's contributions. We formalize the relative constructivity of these theorems using the framework of reverse mathematics, although we do not presuppose familiarity with reverse mathematics. Drawing from contemporary mathematical literature, we analyze the Basis Theorem's reliance on nonconstructive methods versus the more constructive nature of the Nullstellensatz. Our study employs the standard tools of reverse mathematics, in particular subsystems of second-order arithmetic, to outline the minimal set-existence axioms required for these theorems. We review results showing that certain formulations of the Nullstellensatz are provable in the weak axiom system of $\mathsf{RCA}_0$, while the Basis Theorem requires stronger axioms, such as $\Sigma^0_2$-Induction. Consequently, we position these theorems separately within the Friedman-Simpson hierarchy. This analysis contributes to a deeper understanding of the foundational requirements for these pivotal results in algebra.


title: ARCH2S: Dataset, Benchmark and Challenges for Learning Exterior Architectural Structures from Point Clouds

abstract: Precise segmentation of architectural structures provides detailed information about various building components, enhancing our understanding and interaction with our built environment. Nevertheless, existing outdoor 3D point cloud datasets have limited and detailed annotations on architectural exteriors due to privacy concerns and the expensive costs of data acquisition and annotation. To overcome this shortfall, this paper introduces a semantically-enriched, photo-realistic 3D architectural models dataset and benchmark for semantic segmentation. It features 4 different building purposes of real-world buildings as well as an open architectural landscape in Hong Kong. Each point cloud is annotated into one of 14 semantic classes.


title: Non-thermal emission from mildly relativistic tidal ejecta of compact objects merger

abstract: Mergers of compact objects (binary neutron stars, BNS, or neutron star-black hole, NSBH) with a substantial mass ratio ($q>1.5$) are expected to produce a mildly relativistic ejecta within $\sim20^\circ$ from the orbital plane. We present a semi-analytic approach to calculate the expected synchrotron emission observed from various viewing angles, along with the corresponding radio maps, that are produced by a collisionless shock driven by such ejecta into the interstellar medium. This method is supported by 2D numerical calculations of the full relativistic hydrodynamics with an agreement in the observed emission of $\sim30\%$. We consider a toroid ejecta with an opening angle of $15^\circ\leq\theta_ \text{open}\leq30^\circ$ and broken power-law mass distribution, $M(>\gamma\beta)\propto(\gamma\beta)^{-s}$ with $s=s_{\rm KN}$ at $\gamma\beta<\gamma_0\beta_0$ and $s=s_{\rm ft}$ at $\gamma\beta>\gamma_0\beta_0$ (where $\gamma$ is the Lorentz factor). While the peak flux is dimmer by a factor of $\sim$2-3, and the peak time remains roughly the same (within $20\%$), for various viewing angles compared to isotropic equivalent ejecta ($\theta_\text{open}=90^\circ$) considered in preceding papers, the radio maps are significantly different from the spherical case. The semi-analytic method can provide information on the ejecta geometry and viewing angle from future radio map observations and, consequently, constrain the ejection mechanism. Due to the larger ejected mass in NSBH merger, this late non-thermal signal can be observed to distances of $\lesssim 200$Mpc for typical parameter values.


title: Recover as It is Designed to Be: Recovering from Compatibility Mobile App Crashes by Reusing User Flows

abstract: Android OS is severely fragmented by API updates and device vendors' OS customization, creating a market condition where vastly different OS versions coexist. This gives rise to compatibility crash problems where Android apps crash on certain Android versions but not on others. Although well-known, this problem is extremely challenging for app developers to overcome due to the sheer number of Android versions in the market that must be tested. We present RecoFlow, a framework for enabling app developers to automatically recover an app from a crash by programming user flows with our API and visual tools. RecoFlow tracks app feature usage with the user flows on user devices and recovers an app from a crash by replaying UI actions of the app feature disrupted by the crash. To prevent recurring compatibility crashes, RecoFlow executes a previously crashed app in compatibility mode that is enabled by our novel Android OS virtualization technique. Our evaluation with professional Android developers shows that our API and tools are easy to use and effective in recovering from compatibility crashes.


title: Quantum machines based on $\mathrm{Cu}_{3}$-like compounds using the Heisenberg antiferromagnetic model in a triangular ring

abstract: In this work, we present a theoretical investigation into an antiferromagnetically coupled spin system, specifically $\text{Cu}_{3}-\text{X}(\text{X=As, Sb})$, which exhibits a configuration of a slightly distorted equilateral triangle, as identified in previous literature. This system is modeled using the Heisenberg model within a triangular structure, incorporating exchange interaction, Dzyaloshinskii-Moriya interaction, g-factors, and an external magnetic field. We explore three quantum machines based on the $\text{Cu}_{3}$-like antiferromagnetically coupled spin system. The magnetocaloric effect (MCE), which is notably more significant at low temperatures, around $T\sim1$K, for a perpendicular magnetic field at approximately $\sim5$T, has been analyzed. We examine the Carnot machine, observing the influence of the external magnetic field on its operation as both a heat engine and refrigerator, and discuss the thermal efficiencies under these conditions. Our findings suggest that enhanced MCE allows for broader operation regions as a heat engine. Additionally, we explore the quantum Otto machine, showing its versatility in functioning as a heat engine, refrigerator, heater, and thermal accelerator. However, it mainly operates as a refrigerator and accelerator. We also explore their corresponding thermal efficiencies. Similarly, we have analyzed the quantum Stirling machine, which is capable of functioning as a heat engine, refrigerator, heater, and thermal accelerator, but it mainly operates as a refrigerator and thermal accelerator. We also examined the corresponding thermal efficiencies. It is worth mentioning that the Otto machine performance as a heat engine is notably influenced by the MCE, while the operational mode of the Stirling machine switches between a heat engine and accelerator around MCE is more prominent.


title: Important node identification for complex networks based on improved Electre Multi-Attribute fusion

abstract: Influence maximization problem involves selecting a subset of seed nodes within a social network to maximize information spread under a given diffusion model, so how to identify the important nodes is the problem to be considered in this paper. Due to the great differences in the reality of the network, a class of multi-attribute decision fusion methods is often used to solve this problem. Electre is mostly used to solve the problems of investment order, benefit, and risk assessment of projects in economics, which supports the decision maker to make choices by comparing the differences between a set of alternatives. In this paper, we propose a multi-attribute decision fusion method named SK-E, which construct local and global metrics for different networks, use the improved Electre to make decision fusion between local and global metrics of nodes, to get the optimal weight between local and global metrics, and then identify the important nodes. The proposed method demonstrates superior accuracy compared to other methods, as evaluated through three experiments: the SIR epidemic model, the independent cascade model, and constraint efficiency. These experiments were conducted across six different real networks selected as the experimental dataset.


title: PolyCLEAN: When H\"ogbom meets Bayes -- Fast Super-Resolution Imaging with Bayesian MAP Estimation

abstract: Aims: We address two issues for the adoption of convex optimization in radio interferometric imaging. First, a method for a fine resolution setup is proposed which scales naturally in terms of memory usage and reconstruction speed. Second, a new tool to localize a region of uncertainty is developed, paving the way for quantitative imaging in radio interferometry. Methods: The classical $\ell_1$ penalty is used to turn the inverse problem into a sparsity-promoting optimization. For efficient implementation, the so-called Frank-Wolfe algorithm is used together with a \textit{polyatomic} refinement. The algorithm naturally produces sparse images at each iteration, leveraged to reduce memory and computational requirements. In that regard, PolyCLEAN reproduces the numerical behavior of CLEAN while guaranteeing that it solves the minimization problem of interest. Additionally, we introduce the dual certificate image, which appears as a numerical byproduct of the Frank-Wolfe algorithm. This image is proposed as a tool for uncertainty quantification on the location of the recovered sources. Results: PolyCLEAN demonstrates good scalability performance, in particular for fine-resolution grids. On simulations, the Python-based implementation is competitive with the fast numerically-optimized CLEAN solver. This acceleration does not affect image reconstruction quality: PolyCLEAN images are consistent with CLEAN-obtained ones for both point sources and diffuse emission recovery. We also highlight PolyCLEAN reconstruction capabilities on observed radio measurements. Conclusions: PolyCLEAN can be considered as an alternative to CLEAN in the radio interferometric imaging pipeline, as it enables the use of Bayesian priors without impacting the scalability and numerical performance of the imaging method.


title: Absolute and Relative Ambiguity Attitudes

abstract: We represent preferences that exhibit absolute or relative attitudes towards ambiguity without assuming convexity of preferences. Our analysis is motivated by the recent experimental evidence by Baillon and Placido (2019) indicating that ambiguity becomes more tolerable as individuals are better off overall. Decreasing absolute ambiguity aversion is characterized by constant superadditive certainty equivalents and admits an act-dependent variational representation (Maccheroni et al., 2006). Decreasing relative ambiguity aversion relates to positive superhomogeneity and admits an act-dependent confidence preference representation (Chateauneuf and Faro, 2009). We apply our characterizations to retrieve a classic risk sharing result on the efficiency of trade and subjective beliefs of the individuals (Rigotti et al., 2008).


title: Unusual low-temperature behavior in the half-filled band of the one-dimensional extended Hubbard model in atomic limit

abstract: Recently, a kind of finite-temperature pseudo-transition was observed in several quasi-one-dimensional models. In this work, we consider a genuine one-dimensional extended Hubbard model in the atomic limit, influenced by an external magnetic field and with the arbitrary number of particles controlled by the chemical potential. The one-dimensional extended Hubbard model in the atomic limit was initially studied in the seventies and has been investigated over the past decades, but it still surprises us today with its fascinating properties. We rigorously analyze its low-temperature behavior using the transfer matrix technique and provide accurate numerical results. Our analysis confirms that there is an anomalous behavior in the half-filled band, specifically occurring between the alternating pair ($AP$) and paramagnetic ($PM$) phases at zero temperature. Previous investigations did not deeply identify this anomalous behavior, maybe due to the numerical simplicity of the model, but from analytical point of view this is not so easy to manipulate algebraically because one needs to solve an algebraic cubic equation. In this study, we explore this behavior and clearly distinguish the pseudo-transition, which could easily be mistaken with a real phase transition. This anomalous behavior mimics features of both first- and second-order phase transitions. However, due to its nature, we cannot expect a finite-temperature phase transition in this model.


title: BMRS: Bayesian Model Reduction for Structured Pruning

abstract: Modern neural networks are often massively overparameterized leading to high compute costs during training and at inference. One effective method to improve both the compute and energy efficiency of neural networks while maintaining good performance is structured pruning, where full network structures (e.g. neurons or convolutional filters) that have limited impact on the model output are removed. In this work, we propose Bayesian Model Reduction for Structured pruning (BMRS), a fully end-to-end Bayesian method of structured pruning. BMRS is based on two recent methods: Bayesian structured pruning with multiplicative noise, and Bayesian model reduction (BMR), a method which allows efficient comparison of Bayesian models under a change in prior. We present two realizations of BMRS derived from different priors which yield different structured pruning characteristics: 1) BMRS_N with the truncated log-normal prior, which offers reliable compression rates and accuracy without the need for tuning any thresholds and 2) BMRS_U with the truncated log-uniform prior that can achieve more aggressive compression based on the boundaries of truncation. Overall, we find that BMRS offers a theoretically grounded approach to structured pruning of neural networks yielding both high compression rates and accuracy. Experiments on multiple datasets and neural networks of varying complexity showed that the two BMRS methods offer a competitive performance-efficiency trade-off compared to other pruning methods.


title: Current fluctuations in symmetric zero-range process below and at critical density

abstract: Characterizing current fluctuations in a stationary state is of fundamental interest and has attracted considerable attention in the recent past. However, bulk of the studies are limited to systems that either do not exhibit a phase transition or are far from criticality. Here we consider a symmetric zero-range process on a ring that is known to show a phase transition in the stationary state. We use a microscopic approach to analytically calculate two density-dependent transport coefficients that characterize the first two cumulants of the time-integrated current. We show that on the hydrodynamic scale, away from the critical point, the variance of the time-integrated current grows with time $t$ as $\sqrt{t}$ and $t$ at short and long times, respectively. Moreover, we find an expression of the full scaling function for the variance of the cumulative current and thereby the amplitude of the temporal growth of the current fluctuations. At the critical point, using a scaling theory, we find that while the above mentioned long-time scaling of the variance of the cumulative current continues to hold, the short time behavior is anomalous in that the growth exponent is larger than one-half and varies continuously with the model parameters.


title: Conforming Spline-Based Parameterisation Techniques for Plane Graphs

abstract: This paper presents a spline-based parameterisation framework for plane graphs. The plane graph is characterised by a collection of curves forming closed loops that fence-off planar faces which have to be parameterised individually. Hereby, we focus on parameterisations that are conforming across the interfaces between the faces. Parameterising each face individually allows for the imposition of locally differing material parameters which has many applications in engineering applications, such as elasticity and heat transfer. For the parameterisation of the individual faces, we employ the concept of harmonic maps. The plane graph's spline-based parameterisation is suitable for numerical simulation based on isogeometric analysis or can be utilised to extract arbitrarily dense classical meshes. Application-specific features can be built into the geometry's mathematical description either on the spline level or in the mesh extraction step.


title: A uniform trigonometric R-matrix for the exceptional series

abstract: We give a uniform trigonometric $R$-matrix for the adjoint representations on the exceptional series. The exceptional series is a finite list of points on a projective line with a simple Lie algebra attached to each point. This list of Lie algebras includes the five exceptional Lie algebras. For $L$ a simple Lie algebra there is a rational $R$-matrix in $\mathrm{End}_L(\otimes^2(L\oplus I))$ which has a quantum deformation to a trigonometric $R$-matrix. We construct a sixteen dimensional algebra, $A^\square(\mathit{2})$, which interpolates the quantum deformations of the algebras $\mathrm{End}_L(\otimes^2(L\oplus I))$ and a 287 dimensional algebra, $A^\square(\mathit{3})$, which interpolates the quantum deformations of the algebras $\mathrm{End}_L(\otimes^3(L\oplus I))$. Then we construct an $R$-matrix in $A^\square(\mathit{2})$ which satisfies the Yang--Baxter equation in $A^\square(\mathit{3})$ and which interpolates the trigonometric $R$-matrices for the points in the exceptional series.


title: Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation

abstract: Using generative models to synthesize new data has become a de-facto standard in autonomous driving to address the data scarcity issue. Though existing approaches are able to boost perception models, we discover that these approaches fail to improve the performance of planning of end-to-end autonomous driving models as the generated videos are usually less than 8 frames and the spatial and temporal inconsistencies are not negligible. To this end, we propose Delphi, a novel diffusion-based long video generation method with a shared noise modeling mechanism across the multi-views to increase spatial consistency, and a feature-aligned module to achieves both precise controllability and temporal consistency. Our method can generate up to 40 frames of video without loss of consistency which is about 5 times longer compared with state-of-the-art methods. Instead of randomly generating new data, we further design a sampling policy to let Delphi generate new data that are similar to those failure cases to improve the sample efficiency. This is achieved by building a failure-case driven framework with the help of pre-trained visual language models. Our extensive experiment demonstrates that our Delphi generates a higher quality of long videos surpassing previous state-of-the-art methods. Consequentially, with only generating 4% of the training dataset size, our framework is able to go beyond perception and prediction tasks, for the first time to the best of our knowledge, boost the planning performance of the end-to-end autonomous driving model by a margin of 25%.


title: Realization of permutation groups by quantum circuit

abstract: In this paper, we exclusively utilize CNOT gates for implementing permutation groups generated by more than two elements. In Lemma 1, we recall that three CNOT gates are both necessary and sufficient to execute a two-qubit swap gate operation. Subsequently, in Lemma 2, we show that the maximum number of CNOT gates needed to carry out an n-qubit substitution operation is 3(n-1). Moving forward, our analysis in Section 3 reveals that utilizing five or fewer CNOT gates is insufficient for implementing a three-qubit swap gate corresponding to the permutation element (123). Hence six CNOT gates are both necessary and sufficient for implementing (123). This is done by employing a graph-theoretic approach to rigorously validate the results in terms of at most five CNOT gates. Using computational tools, we exhaustively explore all valid circuit diagrams containing exactly six CNOT gates to successfully execute the swap gate for (123), by explaining the equivalence classes in Remark 6 and Table 2. We conclude them in Theorem 7.To extend our analysis to the multiqubit scenario, we present the reducible and irreducible permutation elements in Definition 8. We clarify the equivalence between rows in the multi-qubit space and provide an approximate upper bound for multi-qubits to perform the aforementioned operations in Theorem 9. The comprehensive exploration of this paper aims to pave the way for further advancements in understanding quantum circuit optimization via multiple use of a specific two-qubit gate.


title: Boundary vorticity of incompressible 2D flows

abstract: For a homogeneous incompressible 2D fluid confined within a bounded Lipschitz simply connected domain, homogeneous Neumann pressure boundary conditions are equivalent to a constant boundary vorticity. We investigate the rigidity of such conditions.


title: Position Paper: An Inner Interpretability Framework for AI Inspired by Lessons from Cognitive Neuroscience

abstract: Inner Interpretability is a promising emerging field tasked with uncovering the inner mechanisms of AI systems, though how to develop these mechanistic theories is still much debated. Moreover, recent critiques raise issues that question its usefulness to advance the broader goals of AI. However, it has been overlooked that these issues resemble those that have been grappled with in another field: Cognitive Neuroscience. Here we draw the relevant connections and highlight lessons that can be transferred productively between fields. Based on these, we propose a general conceptual framework and give concrete methodological strategies for building mechanistic explanations in AI inner interpretability research. With this conceptual framework, Inner Interpretability can fend off critiques and position itself on a productive path to explain AI systems.


title: Bohr recurrence and density of non-lacunary semigroups of $\mathbb{N}$

abstract: A subset $R$ of integers is a set of Bohr recurrence if every rotation on $\mathbb{T}^d$ returns arbitrarily close to zero under some non-zero multiple of $R$. We show that the set $\{k!\, 2^m3^n\colon k,m,n\in \mathbb{N}\}$ is a set of Bohr recurrence. This is a particular case of a more general statement about images of such sets under any integer polynomial with zero constant term. We also show that if $P$ is a real polynomial with at least one non-constant irrational coefficient, then the set $\{P(2^m3^n)\colon m,n\in \mathbb{N}\}$ is dense in $\mathbb{T}$, thus providing a joint generalization of two well-known results, one of Furstenberg and one of Weyl.


title: (Weakly) $(\alpha,\beta)$-prime hyperideals in commutative multiplicative hypeering

abstract: Let $H$ be a commutative multiplicative hyperring and $\alpha, \beta \in \mathbb{Z}^+$. A proper hyperideal $P$ of $H$ is called (weakly) $(\alpha,\beta)$-prime if $x^\alpha \circ y \subseteq P$ for $x,y \in H$ implies $x^\beta \subseteq P$ or $y \in P$. In this paper, we aim to investigate (weakly) $(\alpha,\beta)$-prime hyperideals and then we present some properties of them.


title: Differentially Private Fine-Tuning of Diffusion Models

abstract: The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential privacy offers a rigorous framework for safeguarding individual data points during model training, with Differential Privacy Stochastic Gradient Descent (DP-SGD) being a prominent implementation. Diffusion method decomposes image generation into iterative steps, theoretically aligning well with DP's incremental noise addition. Despite the natural fit, the unique architecture of DMs necessitates tailored approaches to effectively balance privacy-utility trade-off. Recent developments in this field have highlighted the potential for generating high-quality synthetic data by pre-training on public data (i.e., ImageNet) and fine-tuning on private data, however, there is a pronounced gap in research on optimizing the trade-offs involved in DP settings, particularly concerning parameter efficiency and model scalability. Our work addresses this by proposing a parameter-efficient fine-tuning strategy optimized for private diffusion models, which minimizes the number of trainable parameters to enhance the privacy-utility trade-off. We empirically demonstrate that our method achieves state-of-the-art performance in DP synthesis, significantly surpassing previous benchmarks on widely studied datasets (e.g., with only 0.47M trainable parameters, achieving a more than 35% improvement over the previous state-of-the-art with a small privacy budget on the CelebA-64 dataset). Anonymous codes available at https://anonymous.4open.science/r/DP-LORA-F02F.


title: MP-PolarMask: A Faster and Finer Instance Segmentation for Concave Images

abstract: While there are a lot of models for instance segmentation, PolarMask stands out as a unique one that represents an object by a Polar coordinate system. With an anchor-box-free design and a single-stage framework that conducts detection and segmentation at one time, PolarMask is proved to be able to balance efficiency and accuracy. Hence, it can be easily connected with other downstream real-time applications. In this work, we observe that there are two deficiencies associated with PolarMask: (i) inability of representing concave objects and (ii) inefficiency in using ray regression. We propose MP-PolarMask (Multi-Point PolarMask) by taking advantage of multiple Polar systems. The main idea is to extend from one main Polar system to four auxiliary Polar systems, thus capable of representing more complicated convex-and-concave-mixed shapes. We validate MP-PolarMask on both general objects and food objects of the COCO dataset, and the results demonstrate significant improvement of 13.69% in AP_L and 7.23% in AP over PolarMask with 36 rays.


title: Spinor Bose-Einstein condensates subject to current-density interactions

abstract: Recently achieved chiral condensates open intriguing avenues for the study of the chiral properties induced by current-density interactions. An attempt to include these features in a spinor system is presented, which gives rise to a nonlinear, effective spin-orbit coupling that emerges from the differential orbital currents, along with constraints in the conserved quantities due to the linear coupling between spin components. Chirality pervades the resulting spectrum of stationary states and their dynamical stability, which are explored in plane waves, dark and bright solitons, and Josephson vortices. Our analytical and numerical results reveal the destabilizing role of polarization and Josephson currents, and support the existence of stable nonlinear states built of linear superpositions of plane waves.


title: EMT,Pseudo-EMT and all that Improvement and Superpotentials

abstract: Within Einstein-Hilbert gravity, higher derivatives and a scalar field as representative of matter different versions of tensorlike quantities are discussed.The concepts of improvement and superpotential help to understand the details of their construction and meaning. On this basis it is claimed that the higher derivatives which are necessary for defining higher orders in perturbation theory donot ruin the physical content of the model.


title: R2C2-Coder: Enhancing and Benchmarking Real-world Repository-level Code Completion Abilities of Code Large Language Models

abstract: Code completion models have made significant progress in recent years. Recently, repository-level code completion has drawn more attention in modern software development, and several baseline methods and benchmarks have been proposed. However, existing repository-level code completion methods often fall short of fully using the extensive context of a project repository, such as the intricacies of relevant files and class hierarchies. Besides, the existing benchmarks usually focus on limited code completion scenarios, which cannot reflect the repository-level code completion abilities well of existing methods. To address these limitations, we propose the R2C2-Coder to enhance and benchmark the real-world repository-level code completion abilities of code Large Language Models, where the R2C2-Coder includes a code prompt construction method R2C2-Enhance and a well-designed benchmark R2C2-Bench. Specifically, first, in R2C2-Enhance, we first construct the candidate retrieval pool and then assemble the completion prompt by retrieving from the retrieval pool for each completion cursor position. Second, based on R2C2 -Enhance, we can construct a more challenging and diverse R2C2-Bench with training, validation and test splits, where a context perturbation strategy is proposed to simulate the real-world repository-level code completion well. Extensive results on multiple benchmarks demonstrate the effectiveness of our R2C2-Coder.


title: Modeling crack arrest in snow slab avalanches -- towards estimating avalanche release sizes

abstract: Dry-snow slab avalanches are considered to be the most difficult to predict, yet the deadliest avalanche types. The release of snow slab avalanches starts with a initial failure in a weak layer that may propagate across the slope until the slab fractures and slides. The evaluation of crack propagation area is a primary concern for avalanche forecasters. The purpose of this study is to test the hypothesis that the heterogeneity of snowpack properties is one of the primary factors that may potentially stop dynamic crack propagation. To test this assumption, we use a depth-averaged Material Point Method (DA-MPM) for efficient elasto-plastic modeling of snow slab avalanches. Our analysis includes scenarios involving i) pure-elastic slabs and ii) elasto-plastic slabs. In the first scenario, we report a significant decrease in slab tensile stress with increasing crack speed compared to quasi-static theory. In addition, we quantify the effect of weak layer heterogeneity and softening fracture energy on the crack stopping mechanism. In the second scenario, we analyse the interplay between weak layer heterogeneity and slab tensile fracture and quantify their combined effect on crack arrest. Results are interpreted through a scaling law relating the crack arrest distance to two dimensionless numbers related to weak layer strength variability and slab tensile fracture. Furthermore, the proposed model is applied to field campaigns in which spatial variations of weak layer shear strength were measured. Finally, DA-MPM simulations are performed on three-dimensional terrain with spatial variations revealing interesting release patterns. This research and the proposed methods can not only enhance our comprehension of the factors influencing avalanche release sizes,and possibly, the design of new mitigation measures for avalanche start zones.


title: Learning to Play Atari in a World of Tokens

abstract: Model-based reinforcement learning agents utilizing transformers have shown improved sample efficiency due to their ability to model extended context, resulting in more accurate world models. However, for complex reasoning and planning tasks, these methods primarily rely on continuous representations. This complicates modeling of discrete properties of the real world such as disjoint object classes between which interpolation is not plausible. In this work, we introduce discrete abstract representations for transformer-based learning (DART), a sample-efficient method utilizing discrete representations for modeling both the world and learning behavior. We incorporate a transformer-decoder for auto-regressive world modeling and a transformer-encoder for learning behavior by attending to task-relevant cues in the discrete representation of the world model. For handling partial observability, we aggregate information from past time steps as memory tokens. DART outperforms previous state-of-the-art methods that do not use look-ahead search on the Atari 100k sample efficiency benchmark with a median human-normalized score of 0.790 and beats humans in 9 out of 26 games. We release our code at https://pranaval.github.io/DART/.


title: Low energy alpha-nucleus optical potential studied via (a,n) cross section measurements on Te isotopes

abstract: In several processes of stellar nucleosynthesis, like the astrophysical gamma-process, nuclear reactions involving alpha particles play an important role. The description of these reactions necessitates the knowledge of the alpha-nucleus optical model potential (AOMP) which is highly ambiguous at low, astrophysical energies. This ambiguity introduces a substantial uncertainty in the stellar models for predicting elemental and isotopic abundances. The experimental study of the AOMP is thus necessary which can be implemented by measuring the cross section of alpha-induced nuclear reactions. At low energies, (a,n) reactions are suitable for such a purpose. Therefore, in the present work, the (a,n) cross sections of four Te isotopes have been measured, mostly for the first time, and compared with theoretical predictions. The (a,n) cross sections of 120,122,124,130Te have been measured in the energy range between about 10 and 17 MeV using the activation method. The detection of the gamma radiation following the decay of the radioactive reaction products were used to determine the cross sections. The measured cross sections are compared with statistical model calculations obtained from the widely used TALYS nuclear reaction simulation code. Predictions using various available AOMPs are investigated. It is found that the recently developed Atomki-V2 AOMP provides the best description for all studied reactions and this potential also reproduces well the total reaction cross sections from elastic scattering experiments, when they are available in literature. We recommend therefore to use the astrophysical reaction rates based on this potential for nucleosynthesis models of heavy elements.


title: Privacy in LLM-based Recommendation: Recent Advances and Future Directions

abstract: Nowadays, large language models (LLMs) have been integrated with conventional recommendation models to improve recommendation performance. However, while most of the existing works have focused on improving the model performance, the privacy issue has only received comparatively less attention. In this paper, we review recent advancements in privacy within LLM-based recommendation, categorizing them into privacy attacks and protection mechanisms. Additionally, we highlight several challenges and propose future directions for the community to address these critical problems.


title: BELLS: A Framework Towards Future Proof Benchmarks for the Evaluation of LLM Safeguards

abstract: Input-output safeguards are used to detect anomalies in the traces produced by Large Language Models (LLMs) systems. These detectors are at the core of diverse safety-critical applications such as real-time monitoring, offline evaluation of traces, and content moderation. However, there is no widely recognized methodology to evaluate them. To fill this gap, we introduce the Benchmarks for the Evaluation of LLM Safeguards (BELLS), a structured collection of tests, organized into three categories: (1) established failure tests, based on already-existing benchmarks for well-defined failure modes, aiming to compare the performance of current input-output safeguards; (2) emerging failure tests, to measure generalization to never-seen-before failure modes and encourage the development of more general safeguards; (3) next-gen architecture tests, for more complex scaffolding (such as LLM-agents and multi-agent systems), aiming to foster the development of safeguards that could adapt to future applications for which no safeguard currently exists. Furthermore, we implement and share the first next-gen architecture test, using the MACHIAVELLI environment, along with an interactive visualization of the dataset.


title: From Feature Visualization to Visual Circuits: Effect of Adversarial Model Manipulation

abstract: Understanding the inner working functionality of large-scale deep neural networks is challenging yet crucial in several high-stakes applications. Mechanistic inter- pretability is an emergent field that tackles this challenge, often by identifying human-understandable subgraphs in deep neural networks known as circuits. In vision-pretrained models, these subgraphs are usually interpreted by visualizing their node features through a popular technique called feature visualization. Recent works have analyzed the stability of different feature visualization types under the adversarial model manipulation framework. This paper starts by addressing limitations in existing works by proposing a novel attack called ProxPulse that simultaneously manipulates the two types of feature visualizations. Surprisingly, when analyzing these attacks under the umbrella of visual circuits, we find that visual circuits show some robustness to ProxPulse. We, therefore, introduce a new attack based on ProxPulse that unveils the manipulability of visual circuits, shedding light on their lack of robustness. The effectiveness of these attacks is validated using pre-trained AlexNet and ResNet-50 models on ImageNet.


title: Link Bundles and Intersection Spaces of Complex Toric Varieties

abstract: There exist several homology theories for singular spaces that satisfy generalized Poincar\'e duality, including Goresky-MacPherson's intersection homology, Cheeger's $L^2$ cohomology and the homology of intersection spaces. The intersection homology and $L^2$ cohomology of toric varieties is known. Here, we compute the rational homology of intersection spaces of complex 3-dimensional toric varieties and compare it to intersection homology. To achieve this, we analyze cell structures and topological stratifications of these varieties and determine compatible structures on their singularity links. In particular, we compute the homology of links in 3-dimensional toric varieties. We find it convenient to use the concept of a rational homology stratification. It turns out that the intersection space homology of a toric variety, contrary to its intersection homology, is not combinatorially invariant and thus retains more refined information on the defining fan.


title: Structural prediction of super-diffusion in multiplex networks

abstract: Diffusion dynamics in multiplex networks can model a diverse number of real-world processes. In some specific configurations of these systems, the super-diffusion phenomenon arises, in which the diffusion is faster in the multiplex network than in any of its layers. Many studies attempt to characterize this phenomenon by examining its dependency on structural properties of the network, such as overlap, average degree, network dissimilarity, and others. While certain properties show a correlation with super-diffusion in specific networks, a broader characterization is still missing. Here, we introduce a structural parameter based on the minimum node strength that effectively predicts the occurrence of super-diffusion in multiplex networks. Additionally, we propose a novel framework for deriving analytical bounds for several multiplex networks structures. Finally, we analyze and justify why certain arrangements of the inter-layer connections induce super-diffusion. These findings provide novel insights into the super-diffusion phenomenon and the interplay between network structure and dynamics.


title: New Fixed Points from Melonic Interactions

abstract: Generalizations of vector field theories to tensors allow to similarly apply large-$N$ techniques but find a richer though often still tractable structure. However, the potential of such tensor theories has not been fully exploited since only a symmetry-reduced ``isotropic'' part of their phase space has been studied so far. Here we present for the first time the richness of the tensorial phase space applying the functional renormalization group to tensor fields of rank $r$ in the cyclic-melonic potential approximation including the flow of anomalous dimensions. Due to a decoupling of the flow equations of the $r$ couplings at given order, we find non-Gaussian fixed points in any regime of $0<s\le r$ non-vanishing coupling types. Each of these regimes contains isotropic fixed points of Wilson-Fisher type as well as new anisotropic fixed points. This new classification reveals a rich structure of renormalization group dynamics including candidates for asymptotic safe fixed points even at critical dimension. Considering the tensorial interactions as generating discrete geometries, the various fixed points correspond to continuum limits of distinguished ensembles of triangulations raising hope to find new classes of continuum geometry in this way.


title: Constraints on the Axion-Photon Coupling Using Stellar Modelling

abstract: Asteroseismology has been shown to be, together with stellar modelling, an invaluable tool in constraining properties of novel physics. In this work, we study for the first time the influence of axionic production in the evolution of a late main-sequence star, comparing computational models with observational data in order to constrain the axion-photon $g_{a\gamma}$ coupling parameter. We first perform a high-precision calibration of a stellar model to our target star, in order to obtain a benchmark for our other diagnostics. We then apply a two-stage test, first using global quantities and then resorting to precision seismic ratios. We find that seismology allows us to place an independent upper bound of $g_{a\gamma} \leq 0.98\times 10^{-10} $ GeV$^{-1}$ at a $68\%$ confidence level (CL), in the same order of magnitude as both the most recent constraints from the observation of globular clusters and previous bounds obtained through stellar modelling, but more stringent than most current direct axion detections. We also suggest a more conservative limit of $g_{a\gamma} \leq 1.38\times 10^{-10} $ GeV$^{-1}$ at a $95\%$ CL. Moreover, this new diagnostic method can be applied to stellar data that will be obtained in future asteroseismic projects.


title: Uncovering dynamical equations of stochastic decision models using data-driven SINDy algorithm

abstract: Decision formation in perceptual decision-making involves sensory evidence accumulation instantiated by the temporal integration of an internal decision variable towards some decision criterion or threshold, as described by sequential sampling theoretical models. The decision variable can be represented in the form of experimentally observable neural activities. Hence, elucidating the appropriate theoretical model becomes crucial to understanding the mechanisms underlying perceptual decision formation. Existing computational methods are limited to either fitting of choice behavioural data or linear model estimation from neural activity data. In this work, we made use of sparse identification of nonlinear dynamics (SINDy), a data-driven approach, to elucidate the deterministic linear and nonlinear components of often-used stochastic decision models within reaction time task paradigms. Based on the simulated decision variable activities of the models, SINDy, enhanced with a trial-averaging approach, could readily uncover the dynamical equations of the models while predicting the models' choice accuracy and decision time across a range of signal-to-noise ratio values. In particular, SINDy performed relatively better for decision models which have an accelerating dynamical component during decision formation, as expressed by a metastable linear competing accumulator model and a nonlinear bistable model. Taken together, our work suggests that SINDy can be a useful tool for uncovering the dynamics in perceptual decision-making, and more generally, for first-passage time problems.


title: An Origami-Inspired Endoscopic Capsule with Tactile Perception for Early Tissue Anomaly Detection

abstract: Video Capsule Endoscopy (VCE) is currently one of the most effective methods for detecting intestinal diseases. However, it is challenging to detect early-stage small nodules with this method because they lack obvious color or shape features. In this letter, we present a new origami capsule endoscope to detect early small intestinal nodules using tactile sensing. Four soft tactile sensors made out of piezoresistive material feed four channels of phase-shifted data that are processed using a particle filter. The particle filter uses an importance assignment template designed using experimental data from five known sizes of modules. Moreover, the proposed capsule can use shape changes to passively move forward or backward under peristalsis, enabling it to reach any position in the intestine for detection. Experimental results show that the proposed capsule can detect nodules of more than 3mm diameter with 100% accuracy.


title: Linguistic Analysis, Description, and Typological Exploration with Categorial Grammar (TheBench Guide)

abstract: TheBench is a tool to study monadic structures in natural language. It is for writing monadic grammars to explore analyses, compare diverse languages through their categories, and to train models of grammar from form-meaning pairs where syntax is latent variable. Monadic structures are binary combinations of elements that employ semantics of composition only. TheBench is essentially old-school categorial grammar to syntacticize the idea, with the implication that although syntax is autonomous (recall \emph{colorless green ideas sleep furiously}), the treasure is in the baggage it carries at every step, viz. semantics, more narrowly, predicate-argument structures indicating choice of categorial reference and its consequent placeholders for decision in such structures. There is some new thought in old school. Unlike traditional categorial grammars, application is turned into composition in monadic analysis. Moreover, every correspondence requires specifying two command relations, one on syntactic command and the other on semantic command. A monadic grammar of TheBench contains only synthetic elements (called `objects' in category theory of mathematics) that are shaped by this analytic invariant, viz. composition. Both ingredients (command relations) of any analytic step must therefore be functions (`arrows' in category theory). TheBench is one implementation of the idea for iterative development of such functions along with grammar of synthetic elements.


title: Stability in Random Hedonic Games

abstract: Partitioning a large group of employees into teams can prove difficult because unsatisfied employees may want to transfer to other teams. In this case, the team (coalition) formation is unstable and incentivizes deviation from the proposed structure. Such a coalition formation scenario can be modeled in the framework of hedonic games and a significant amount of research has been devoted to the study of stability in such games. Unfortunately, stable coalition structures are not guaranteed to exist in general and their practicality is further hindered by computational hardness barriers. We offer a new perspective on this matter by studying a random model of hedonic games. For three prominent stability concepts based on single-agent deviations, we provide a high probability analysis of stability in the large agent limit. Our first main result is an efficient algorithm that outputs an individually and contractually Nash-stable partition with high probability. Our second main result is that the probability that a random game admits a Nash-stable partition tends to zero. Our approach resolves the two major downsides associated with individual stability and contractual Nash stability and reveals agents acting single-handedly are usually to blame for instabilities.


title: sAirflow: Adopting Serverless in a Legacy Workflow Scheduler

abstract: Serverless clouds promise efficient scaling, reduced toil and monetary costs. Yet, serverless-ing a complex, legacy application might require major refactoring and thus is risky. As a case study, we use Airflow, an industry-standard workflow system. To reduce migration risk, we propose to limit code modifications by relying on change data capture (CDC) and message queues for internal communication. To achieve serverless efficiency, we rely on Function-as-a-Service (FaaS). Our system, sAirflow, is the first adaptation of the control plane and workers to the serverless cloud - and it maintains the same interface and most of the code. Experimentally, we show that sAirflow delivers the key serverless benefits: scaling and cost reduction. We compare sAirflow to MWAA, a managed (SaaS) Airflow. On Alibaba benchmarks on warm systems, sAirflow performs similarly while halving the monetary cost. On highly parallel workflows on cold systems, sAirflow scales out in seconds to 125 workers, reducing makespan by 2x-7x.


title: D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models

abstract: Continual Pre-Training (CPT) on Large Language Models (LLMs) has been widely used to expand the model's fundamental understanding of specific downstream domains (e.g., math and code). For the CPT on domain-specific LLMs, one important question is how to choose the optimal mixture ratio between the general-corpus (e.g., Dolma, Slim-pajama) and the downstream domain-corpus. Existing methods usually adopt laborious human efforts by grid-searching on a set of mixture ratios, which require high GPU training consumption costs. Besides, we cannot guarantee the selected ratio is optimal for the specific domain. To address the limitations of existing methods, inspired by the Scaling Law for performance prediction, we propose to investigate the Scaling Law of the Domain-specific Continual Pre-Training (D-CPT Law) to decide the optimal mixture ratio with acceptable training costs for LLMs of different sizes. Specifically, by fitting the D-CPT Law, we can easily predict the general and downstream performance of arbitrary mixture ratios, model sizes, and dataset sizes using small-scale training costs on limited experiments. Moreover, we also extend our standard D-CPT Law on cross-domain settings and propose the Cross-Domain D-CPT Law to predict the D-CPT law of target domains, where very small training costs (about 1% of the normal training costs) are needed for the target domains. Comprehensive experimental results on six downstream domains demonstrate the effectiveness and generalizability of our proposed D-CPT Law and Cross-Domain D-CPT Law.