title: Asymptotic properties of a multicolored random reinforced urn model with an application to multi-armed bandits

abstract: The random self-reinforcement mechanism, characterized by the principle of ``the rich get richer'', has demonstrated significant utility across various domains. One prominent model embodying this mechanism is the random reinforcement urn model. This paper investigates a multicolored, multiple-drawing variant of the random reinforced urn model. We establish the limiting behavior of the normalized urn composition and demonstrate strong convergence upon scaling the counts of each color. Additionally, we derive strong convergence estimators for the reinforcement means, i.e., for the expectations of the replacement matrix's diagonal elements, and prove their joint asymptotic normality. It is noteworthy that the estimators of the largest reinforcement mean are asymptotically independent of the estimators of the other smaller reinforcement means. Additionally, if a reinforcement mean is not the largest, the estimators of these smaller reinforcement means will also demonstrate asymptotic independence among themselves. Furthermore, we explore the parallels between the reinforced mechanisms in random reinforced urn models and multi-armed bandits, addressing hypothesis testing for expected payoffs in the latter context.


title: ALPS: An Auto-Labeling and Pre-training Scheme for Remote Sensing Segmentation With Segment Anything Model

abstract: In the fast-growing field of Remote Sensing (RS) image analysis, the gap between massive unlabeled datasets and the ability to fully utilize these datasets for advanced RS analytics presents a significant challenge. To fill the gap, our work introduces an innovative auto-labeling framework named ALPS (Automatic Labeling for Pre-training in Segmentation), leveraging the Segment Anything Model (SAM) to predict precise pseudo-labels for RS images without necessitating prior annotations or additional prompts. The proposed pipeline significantly reduces the labor and resource demands traditionally associated with annotating RS datasets. By constructing two comprehensive pseudo-labeled RS datasets via ALPS for pre-training purposes, our approach enhances the performance of downstream tasks across various benchmarks, including iSAID and ISPRS Potsdam. Experiments demonstrate the effectiveness of our framework, showcasing its ability to generalize well across multiple tasks even under the scarcity of extensively annotated datasets, offering a scalable solution to automatic segmentation and annotation challenges in the field. In addition, the proposed a pipeline is flexible and can be applied to medical image segmentation, remarkably boosting the performance. Note that ALPS utilizes pre-trained SAM to semi-automatically annotate RS images without additional manual annotations. Though every component in the pipeline has bee well explored, integrating clustering algorithms with SAM and novel pseudo-label alignment significantly enhances RS segmentation, as an off-the-shelf tool for pre-training data preparation. Our source code is available at: https://github.com/StriveZs/ALPS.


title: LEO Satellite Networks Assisted Geo-distributed Data Processing

abstract: Nowadays, the increasing deployment of edge clouds globally provides users with low-latency services. However, connecting an edge cloud to a core cloud via optic cables in terrestrial networks poses significant barriers due to the prohibitively expensive building cost of optic cables. Fortunately, emerging Low Earth Orbit (LEO) satellite networks (e.g., Starlink) offer a more cost-effective solution for increasing edge clouds, and hence large volumes of data in edge clouds can be transferred to a core cloud via those networks for time-sensitive big data tasks processing, such as attack detection. However, the state-of-the-art satellite selection algorithms bring poor performance for those processing via our measurements. Therefore, we propose a novel data volume aware satellite selection algorithm, named DVA, to support such big data processing tasks. DVA first takes into account both the data size in edge clouds and satellite capacity to finalize the selection, thereby preventing congestion in the access network and reducing transmitting duration. Extensive simulations validate that DVA has a significantly lower average access network duration than the state-of-the-art satellite selection algorithms in a LEO satellite emulation platform.


title: An LLM-enhanced Multi-objective Evolutionary Search for Autonomous Driving Test Scenario Generation

abstract: The safety of Autonomous Driving Systems (ADSs) is significantly important for the implementation of autonomous vehicles (AVs). Therefore, ADSs must be evaluated thoroughly before their release and deployment to the public. How to generate diverse safety-critical test scenarios is a key task for ADS testing. This paper proposes LEADE, an LLM-enhanced scenario generation approach for ADS testing, which adopts the LLM-enhanced adaptive evolutionary search to generate safety-critical and diverse test scenarios. LEADE leverages LLM's ability in program understanding to better comprehend the scenario generation task, which generates high-quality scenarios of the first generation. LEADE adopts an adaptive multi-objective genetic algorithm to search for diverse safety-critical scenarios. To guide the search away from the local optima, LEADE formulates the evolutionary search into a QA task, which leverages LLM's ability in quantitative reasoning to generate differential seed scenarios to break out of the local optimal solutions. We implement and evaluate LEADE on industrial-grade full-stack ADS platform, Baidu Apollo. Experimental results show that LEADE can effectively and efficiently generate safety-critical scenarios and expose 10 diverse safety violations of Apollo. It outperforms two state-of-the-art search-based ADS testing techniques by identifying 4 new types of safety-critical scenarios on the same roads.


title: Step-level Value Preference Optimization for Mathematical Reasoning

abstract: Direct Preference Optimization (DPO) using an implicit reward model has proven to be an effective alternative to reinforcement learning from human feedback (RLHF) for fine-tuning preference aligned large language models (LLMs). However, the overall preference annotations of responses do not fully capture the fine-grained quality of model outputs in complex multi-step reasoning tasks, such as mathematical reasoning. To address this limitation, we introduce a novel algorithm called Step-level Value Preference Optimization (SVPO). Our approach employs Monte Carlo Tree Search (MCTS) to automatically annotate step-level preferences for multi-step reasoning. Furthermore, from the perspective of learning-to-rank, we train an explicit value model to replicate the behavior of the implicit reward model, complementing standard preference optimization. This value model enables the LLM to generate higher reward responses with minimal cost during inference. Experimental results demonstrate that our method achieves state-of-the-art performance on both in-domain and out-of-domain mathematical reasoning benchmarks.


title: Scaling Properties of Liquid Dynamics Predicted from a Single Configuration: Pseudoisomorphs for Harmonic-Bonded Molecules

abstract: Isomorphs are curves in the thermodynamic phase diagram of invariant excess entropy, structure, and dynamics, while pseudoisomorphs are curves of invariant structure and dynamics, but not of the excess entropy. The latter curves have been shown to exist in molecular models with flexible bonds [Olsen et al., J. Chem. Phys. 145, 241103 (2016)]. We here present three force-based methods to trace out pseudoisomorphs based on a single configuration and test them on the asymmetric dumbbell and 10-bead Lennard-Jones chain models with bonds modeled as harmonic springs. The three methods are based on requiring that particle forces, center-of-mass forces, and torques, respectively, are invariant in reduced units. For each of the two investigated models we identify a method that works well for tracing out pseudoisomorphs.


title: Unrevealing the structure and properties of {$\alpha$}-sheet-based bilayer borophenes

abstract: Recent experimental realizations of bilayer boron materials motivated us to study the structure and properties of $\alpha$-sheet-based bilayer borophenes with interlayer covalent bonds. As shown here, at least three stacking variations are possible: AA, AB, and AB$'$. The on-top AA-stacking has been obtained experimentally. The AB-stacking is the most stable among neutral freestanding structures, whereas the AA and AB$'$ stacking sequences are very close in energy, both for neutral and negatively charged cases. The studied bilayer borophenes exhibit extraordinarily high electric conductivity with values as high as ${\sim} 10^7\mathrm{~S}/\mathrm{m}$ for the experimentally observed AA-stacking. The highly stable AB-stacking bilayer, reported here for the first time, exhibits an anisotropic conductivity with an average value of $6.0 \times 10^6~\mathrm{S/m}$.


title: Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions

abstract: Federated Learning (FL) is a distributed and privacy-preserving machine learning paradigm that coordinates multiple clients to train a model while keeping the raw data localized. However, this traditional FL poses some challenges, including privacy risks, data heterogeneity, communication bottlenecks, and system heterogeneity issues. To tackle these challenges, knowledge distillation (KD) has been widely applied in FL since 2020. KD is a validated and efficacious model compression and enhancement algorithm. The core concept of KD involves facilitating knowledge transfer between models by exchanging logits at intermediate or output layers. These properties make KD an excellent solution for the long-lasting challenges in FL. Up to now, there have been few reviews that summarize and analyze the current trend and methods for how KD can be applied in FL efficiently. This article aims to provide a comprehensive survey of KD-based FL, focusing on addressing the above challenges. First, we provide an overview of KD-based FL, including its motivation, basics, taxonomy, and a comparison with traditional FL and where KD should execute. We also analyze the critical factors in KD-based FL in the appendix, including teachers, knowledge, data, and methods. We discuss how KD can address the challenges in FL, including privacy protection, data heterogeneity, communication efficiency, and personalization. Finally, we discuss the challenges facing KD-based FL algorithms and future research directions. We hope this survey can provide insights and guidance for researchers and practitioners in the FL area.


title: OpenCAEPoro: A Parallel Simulation Framework for Multiphase and Multicomponent Porous Media Flows

abstract: OpenCAEPoro is a parallel numerical simulation software developed in C++ for simulating multiphase and multicomponent flows in porous media. The software utilizes a set of general-purpose compositional model equations, enabling it to handle a diverse range of fluid dynamics, including the black oil model, compositional model, and thermal recovery models. OpenCAEPoro establishes a unified solving framework that integrates many widely used methods, such as IMPEC, FIM, and AIM. This framework allows dynamic collaboration between different methods. Specifically, based on this framework, we have developed an adaptively coupled domain decomposition method, which can provide initial solutions for global methods to accelerate the simulation. The reliability of OpenCAEPoro has been validated through benchmark testing with the SPE comparative solution project. Furthermore, its robust parallel efficiency has been tested in distributed parallel environments, demonstrating its suitability for large-scale simulation problems.


title: Global-Local Graph Neural Networks for Node-Classification

abstract: The task of graph node classification is often approached by utilizing a local Graph Neural Network (GNN), that learns only local information from the node input features and their adjacency. In this paper, we propose to improve the performance of node classification GNNs by utilizing both global and local information, specifically by learning label- and node- features. We therefore call our method Global-Local-GNN (GLGNN). To learn proper label features, for each label, we maximize the similarity between its features and nodes features that belong to the label, while maximizing the distance between nodes that do not belong to the considered label. We then use the learnt label features to predict the node classification map. We demonstrate our GLGNN using three different GNN backbones, and show that our approach improves baseline performance, revealing the importance of global information utilization for node classification.


title: Kinetic theory of dilute granular gases having an inverse power law potential

abstract: The kinetic theory of dilute granular gases having an inverse power law repulsive potential is studied. We derive the time evolution of the temperature and the transport coefficients from the Boltzmann equation. We also investigate the linear stability analysis of the hydrodynamics, and study the softness dependence of the thresholds for the shear and heat modes against the restitution coefficient.


title: On the refined analyticity radius of 3-D generalized Navier-Stokes equations

abstract: We analyze the instantaneous growth of analyticity radius for three dimensional generalized Navier-Stokes equations. For the subcritical $H^{\gamma}(\mathbb R^3)$ case with $\gamma>\frac12,$ we prove that there exists a positive time $t_0$ so that for any $t\in]0, t_0]$, the radius of analyticity of the solution $u$ satisfies the pointwise-in-time lower bound $${\mathrm{rad}}(u)(t)\ge \sqrt{(2\gamma-1)t\bigl(|\ln t|+\ln|\ln t|+K_t\bigr)},$$ where $K_t \to \infty$ as $t\to 0^+$. This in particular gives a nontrivial improvement of the previous result by Herbst and Skibsted in \cite{HS} for the case $\gamma\in ]1/2,3/2[$ and also settles the decade-long open question in \cite{HS}, namely, whether or not $\liminf_{t\to 0^+}\frac {{\mathrm{ rad}}(u)(t)}{\sqrt{t|\ln t|}}\ge \sqrt{2\gamma-1}$ for all $\gamma\ge \frac32$. For the critical case $H^{\frac 12}(\mathbb R^3)$, we prove that there exists $t_1>0$ so that for any $t\in ]0, t_1],$ ${\mathrm {rad}}(u)(t)\ge \lambda(t)\sqrt{t}$ with $\lambda(t)$ satisfying $\lim_{t\to 0^+}\lambda(t)=\infty.$


title: K-contact manifolds with minimal closed Reeb orbits

abstract: We use the Boothby-Wang fibration to construct certain simply connected K-contact manifolds and we give sufficient and necessary conditions on when such K-contact manifolds are homeomorphic to the odd dimensional spheres. For the symplectic base manifold of the fibration which admits a Hamiltonian torus action, we show that the total space of the fibration admits other than the above K-contact structures whose closed Reeb orbits correspond exactly to the fixed points of the Hamiltonian circle action on the base manifold. Then we give a collection of examples of compact simply connected K-contact manifolds with minimal number of closed Reeb orbits which are not homeomorphic to the odd dimensional spheres, while having the real cohomology ring of the spheres. Finally, we give a family of examples of simply connected K-contact manifolds which have one more than the minimal number of closed Reeb orbits and which do not have the real cohomology ring of the spheres.


title: Geometric-informed GFlowNets for Structure-Based Drug Design

abstract: The rise of cost involved with drug discovery and current speed of which they are discover, underscore the need for more efficient structure-based drug design (SBDD) methods. We employ Generative Flow Networks (GFlowNets), to effectively explore the vast combinatorial space of drug-like molecules, which traditional virtual screening methods fail to cover. We introduce a novel modification to the GFlowNet framework by incorporating trigonometrically consistent embeddings, previously utilized in tasks involving protein conformation and protein-ligand interactions, to enhance the model's ability to generate molecules tailored to specific protein pockets. We have modified the existing protein conditioning used by GFlowNets, blending geometric information from both protein and ligand embeddings to achieve more geometrically consistent embeddings. Experiments conducted using CrossDocked2020 demonstrated an improvement in the binding affinity between generated molecules and protein pockets for both single and multi-objective tasks, compared to previous work. Additionally, we propose future work aimed at further increasing the geometric information captured in protein-ligand interactions.


title: Analyzing Key Neurons in Large Language Models

abstract: Large Language Models (LLMs) possess vast amounts of knowledge within their parameters, prompting research into methods for locating and editing this knowledge. Previous investigations have primarily focused on fill-in-the-blank tasks and locating entity-related usually single-token facts) information in relatively small-scale language models. However, several key questions remain unanswered: (1) How can we effectively locate query-relevant neurons in contemporary autoregressive LLMs, such as LLaMA and Mistral? (2) How can we address the challenge of long-form text generation? (3) Are there localized knowledge regions in LLMs? In this study, we introduce Neuron Attribution-Inverse Cluster Attribution (NA-ICA), a novel architecture-agnostic framework capable of identifying key neurons in LLMs. NA-ICA allows for the examination of long-form answers beyond single tokens by employing the proxy task of multi-choice question answering. To evaluate the effectiveness of our detected key neurons, we construct two multi-choice QA datasets spanning diverse domains and languages. Empirical evaluations demonstrate that NA-ICA outperforms baseline methods significantly. Moreover, analysis of neuron distributions reveals the presence of visible localized regions, particularly within different domains. Finally, we demonstrate the potential applications of our detected key neurons in knowledge editing and neuron-based prediction.


title: Geometric Distortion Guided Transformer for Omnidirectional Image Super-Resolution

abstract: As virtual and augmented reality applications gain popularity, omnidirectional image (ODI) super-resolution has become increasingly important. Unlike 2D plain images that are formed on a plane, ODIs are projected onto spherical surfaces. Applying established image super-resolution methods to ODIs, therefore, requires performing equirectangular projection (ERP) to map the ODIs onto a plane. ODI super-resolution needs to take into account geometric distortion resulting from ERP. However, without considering such geometric distortion of ERP images, previous deep-learning-based methods only utilize a limited range of pixels and may easily miss self-similar textures for reconstruction. In this paper, we introduce a novel Geometric Distortion Guided Transformer for Omnidirectional image Super-Resolution (GDGT-OSR). Specifically, a distortion modulated rectangle-window self-attention mechanism, integrated with deformable self-attention, is proposed to better perceive the distortion and thus involve more self-similar textures. Distortion modulation is achieved through a newly devised distortion guidance generator that produces guidance by exploiting the variability of distortion across latitudes. Furthermore, we propose a dynamic feature aggregation scheme to adaptively fuse the features from different self-attention modules. We present extensive experimental results on public datasets and show that the new GDGT-OSR outperforms methods in existing literature.


title: COOL: Comprehensive Knowledge Enhanced Prompt Learning for Domain Adaptive Few-shot Fake News Detection

abstract: Most Fake News Detection (FND) methods often struggle with data scarcity for emerging news domain. Recently, prompt learning based on Pre-trained Language Models (PLM) has emerged as a promising approach in domain adaptive few-shot learning, since it greatly reduces the need for labeled data by bridging the gap between pre-training and downstream task. Furthermore, external knowledge is also helpful in verifying emerging news, as emerging news often involves timely knowledge that may not be contained in the PLM's outdated prior knowledge. To this end, we propose COOL, a Comprehensive knOwledge enhanced prOmpt Learning method for domain adaptive few-shot FND. Specifically, we propose a comprehensive knowledge extraction module to extract both structured and unstructured knowledge that are positively or negatively correlated with news from external sources, and adopt an adversarial contrastive enhanced hybrid prompt learning strategy to model the domain-invariant news-knowledge interaction pattern for FND. Experimental results demonstrate the superiority of COOL over various state-of-the-arts.


title: Graph Neural Reaction Diffusion Models

abstract: The integration of Graph Neural Networks (GNNs) and Neural Ordinary and Partial Differential Equations has been extensively studied in recent years. GNN architectures powered by neural differential equations allow us to reason about their behavior, and develop GNNs with desired properties such as controlled smoothing or energy conservation. In this paper we take inspiration from Turing instabilities in a Reaction Diffusion (RD) system of partial differential equations, and propose a novel family of GNNs based on neural RD systems. We \textcolor{black}{demonstrate} that our RDGNN is powerful for the modeling of various data types, from homophilic, to heterophilic, and spatio-temporal datasets. We discuss the theoretical properties of our RDGNN, its implementation, and show that it improves or offers competitive performance to state-of-the-art methods.


title: On entropy Marton-type inequalities and small symmetric differences with cosets of abelian groups

abstract: We recognise that an entropy inequality akin to the main intermediate goal of recent works (Gowers, Green, Manners, Tao [3],[2]) regarding a conjecture of Marton provides a black box from which we can also through a short deduction recover another description: if a finite subset $A$ of an abelian group $G$ is such that the distribution of the sums $a+b$ with $(a,b) \in A \times A$ is only slightly more spread out than the uniform distribution on $A$, then $A$ has small symmetric difference with some finite coset of $G$. The resulting bounds are necessarily sharp up to a logarithmic factor.

categories: cs.IT math.CO math.GR math.IT math.NT math.PR


title: Optimizing Automatic Speech Assessment: W-RankSim Regularization and Hybrid Feature Fusion Strategies

abstract: Automatic Speech Assessment (ASA) has seen notable advancements with the utilization of self-supervised features (SSL) in recent research. However, a key challenge in ASA lies in the imbalanced distribution of data, particularly evident in English test datasets. To address this challenge, we approach ASA as an ordinal classification task, introducing Weighted Vectors Ranking Similarity (W-RankSim) as a novel regularization technique. W-RankSim encourages closer proximity of weighted vectors in the output layer for similar classes, implying that feature vectors with similar labels would be gradually nudged closer to each other as they converge towards corresponding weighted vectors. Extensive experimental evaluations confirm the effectiveness of our approach in improving ordinal classification performance for ASA. Furthermore, we propose a hybrid model that combines SSL and handcrafted features, showcasing how the inclusion of handcrafted features enhances performance in an ASA system.


title: Nested discontinuous asymptotic profiles for the viscous Burgers equation with infinite mass

abstract: We study the viscous Burgers equation with a family of initial data having infinite mass. After rescaling, the solution converges toward a bounded discontinuous profile in the long-time limit. Moreover, by changing the scale near the discontinuity point again, we find a new profile that is also discontinuous. This process can be repeated an arbitrary number of times.


title: Embedding formalism for AdS superspaces in five dimensions

abstract: The standard geometric description of $d$-dimensional anti-de Sitter (AdS) space is a quadric in ${\mathbb R}^{d-1,2}$ defined by $(X^0)^2 - (X^1)^2 - \dots - (X^{d-1})^2 + (X^d)^2 = \ell^2 = \text{const}$. In this paper we provide a supersymmetric generalisation of this embedding construction in the $d=5$ case. Specifically, a bi-supertwistor realisation is given for the ${\cal N}$-extended AdS superspace $\text{AdS}^{5|8\cal N}$, with ${\cal N}\geq 1$. The proposed formalism offers a simple construction of AdS super-invariants. As an example, we present a model for a massive superparticle in $\text{AdS}^{5|8\cal N}$ which is manifestly invariant under the AdS isometry supergroup $\mathsf{SU}(2,2|{\cal N})$.


title: Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for space-time solutions of semilinear partial differential equations

abstract: It is a challenging topic in applied mathematics to solve high-dimensional nonlinear partial differential equations (PDEs). Standard approximation methods for nonlinear PDEs suffer under the curse of dimensionality (COD) in the sense that the number of computational operations of the approximation method grows at least exponentially in the PDE dimension and with such methods it is essentially impossible to approximately solve high-dimensional PDEs even when the fastest currently available computers are used. However, in the last years great progress has been made in this area of research through suitable deep learning (DL) based methods for PDEs in which deep neural networks (DNNs) are used to approximate solutions of PDEs. Despite the remarkable success of such DL methods in simulations, it remains a fundamental open problem of research to prove (or disprove) that such methods can overcome the COD in the approximation of PDEs. However, there are nowadays several partial error analysis results for DL methods for high-dimensional nonlinear PDEs in the literature which prove that DNNs can overcome the COD in the sense that the number of parameters of the approximating DNN grows at most polynomially in both the reciprocal of the prescribed approximation accuracy $\varepsilon>0$ and the PDE dimension $d\in\mathbb{N}$. In the main result of this article we prove that for all $T,p\in(0,\infty)$ it holds that solutions $u_d\colon[0,T]\times\mathbb{R}^d\to\mathbb{R}$, $d\in\mathbb{N}$, of semilinear heat equations with Lipschitz continuous nonlinearities can be approximated in the $L^p$-sense on space-time regions without the COD by DNNs with the rectified linear unit (ReLU), the leaky ReLU, or the softplus activation function. In previous articles similar results have been established not for space-time regions but for the solutions $u_d(T,\cdot)$, $d\in\mathbb{N}$, at the terminal time $T$.


title: WALLABY Pilot Survey: the Tully-Fisher relation in the NGC 4808, Vela and NGC 5044 fields

abstract: The Tully-Fisher Relation (TFR) is a well-known empirical relationship between the luminosity of a spiral galaxy and its circular velocity, allowing us to estimate redshift independent distances. Here we use high signal-to-noise HI 21-cm integrated spectra from the second pilot data release (PDR2, 180 deg2) of the Widefield ASKAP L-band Legacy All-sky Blind surveY (WALLABY). In order to prepare for the full WALLABY survey, we have investigated the TFR in phase 2 of the pilot survey with a further three fields. The data were obtained with wide-field Phased Array Feeds on the Australian Square Kilometre Array Pathfinder (ASKAP) and have an angular resolution of 30 arcsec and a velocity resolution of ~4 km/s. Galaxy luminosities have been measured from the Wide-field Infrared Survey Explorer (WISE), and optical galaxy inclinations from the Dark Energy Camera Legacy Survey. We present TFRs for wavelengths from 0.8-3.4{\mu}m. We examine sources of galaxy inclination data and investigate magnitudes from the DECam Local Volume Exploration Survey (DELVE) and DENIS catalogues and the 4HS target catalogue based on the VISTA Hemisphere Survey (VHS). We consider the baryonic TFR. These are all of interest for TFR using the full WALLABY survey of 200,000 galaxies. We demonstrate that WALLABY TFR distances can take their place among state of the art studies of the local velocity field.


title: Demonstration Notebook: Finding the Most Suited In-Context Learning Example from Interactions

abstract: Large language models (LLMs) benefit greatly from prompt engineering, with in-context learning standing as a pivital technique. While former approaches have provided various ways to construct the demonstrations used for in-context learning, they often ignore the inherent heterogeneity within datasets, applying the same demonstrations to all reasoning questions. We observed that the effectiveness of demonstrations varies depending on the specific question. This motivates our exploration of using prompt engineering to select appropriate demonstrations. To address the challenge of automatically creating and choosing demonstrations tailored to each question, we propose a novel prompt engineering workflow built around a novel object called the "demonstration notebook." This notebook helps identify the most suitable in-context learning example for a question by gathering and reusing information from the LLM's past interactions. Our experiments show that this approach outperforms all existing methods for automatic demonstration construction and selection (as far as we know), achieving state-of-the-art results on serveral reasoning benchmarks. The method's versatility is further demonstrated by its success in text summarization and prompt compression tasks. Additionally, we contribute a rigorous analysis method to reveal the "demonstrative regime" of a demonstration, providing valuable insights into how demonstrations relate to different question types within a dataset.


title: Stretched Horizon from Conformal Field Theory

abstract: Recently, it has been observed that the Hartle-Hawking correlators, a signature of smooth horizon, can emerge from certain heavy excited state correlators in the (manifestly non-smooth) BTZ stretched horizon background, in the limit when the stretched horizon approaches the real horizon. In this note, we develop a framework of quantizing the CFT modular Hamiltonian, that explains the necessity of introducing a stretched horizon and the emergence of thermal features in the AdS-Rindler and (planar) BTZ backgrounds. In more detail, we quantize vacuum modular Hamiltonian on a spatial segment of $S^{1}$. Unlike radial quantization, (Euclidean) time circles emerge naturally here which can be contracted smoothly to the `fixed points'(end points of the interval) of this quantization thus providing a direct link to thermal physics. To define a Hilbert space with discrete normalizable states and to construct a Virasoro algebra with finite central extension, a natural regulator ($\epsilon$) is needed around the fixed points. Eventually, in the dual description the fixed points correspond to the horizons of AdS-Rindler patch or (planar) BTZ and the cut-off being the stretched horizon. We construct a (Lorentzian) highest weight representation of that Virasoro algebra. We further demonstrate that two point function in a (vacuum) descendant state of the regulated Hilbert space will reproduce thermal answer in $\epsilon \rightarrow 0$ limit which is analogous to the recent observation of emergent thermality in stretched horizon background. We also argue the thermal entropy of this quantization coincides with entanglement entropy of the subregion. Conversely, the microcanonical entropy corresponding to high energy density of states exactly reproduce the BTZ entropy. Quite remarkably, all these dominant high lying microstates are defined only at finite $\epsilon$ in the regulated Hilbert space.


title: Exploring the Potential of Multimodal LLM with Knowledge-Intensive Multimodal ASR

abstract: Recent advancements in multimodal large language models (MLLMs) have made significant progress in integrating information across various modalities, yet real-world applications in educational and scientific domains remain challenging. This paper introduces the Multimodal Scientific ASR (MS-ASR) task, which focuses on transcribing scientific conference videos by leveraging visual information from slides to enhance the accuracy of technical terminologies. Realized that traditional metrics like WER fall short in assessing performance accurately, prompting the proposal of severity-aware WER (SWER) that considers the content type and severity of ASR errors. We propose the Scientific Vision Augmented ASR (SciVASR) framework as a baseline method, enabling MLLMs to improve transcript quality through post-editing. Evaluations of state-of-the-art MLLMs, including GPT-4o, show a 45% improvement over speech-only baselines, highlighting the importance of multimodal information integration.


title: Teaching Large Language Models to Express Knowledge Boundary from Their Own Signals

abstract: Large language models (LLMs) have achieved great success, but their occasional content fabrication, or hallucination, limits their practical application. Hallucination arises because LLMs struggle to admit ignorance due to inadequate training on knowledge boundaries. We call it a limitation of LLMs that they can not accurately express their knowledge boundary, answering questions they know while admitting ignorance to questions they do not know. In this paper, we aim to teach LLMs to recognize and express their knowledge boundary, so they can reduce hallucinations caused by fabricating when they do not know. We propose CoKE, which first probes LLMs' knowledge boundary via internal confidence given a set of questions, and then leverages the probing results to elicit the expression of the knowledge boundary. Extensive experiments show CoKE helps LLMs express knowledge boundaries, answering known questions while declining unknown ones, significantly improving in-domain and out-of-domain performance.


title: SCAR: Efficient Instruction-Tuning for Large Language Models via Style Consistency-Aware Response Ranking

abstract: Recent studies have shown that maintaining a consistent response style by human experts and enhancing data quality in training sets can significantly improve the performance of fine-tuned Large Language Models (LLMs) while reducing the number of training examples needed. However, the precise definition of style and the relationship between style, data quality, and LLM performance remains unclear. This research decomposes response style into presentation and composition styles and finds that, among training data of similar quality, those with higher style consistency lead to better LLM performance. Inspired by this, we introduce Style Consistency-Aware Response Ranking (SCAR), which automatically prioritizes instruction-response pairs in the training set based on their response stylistic consistency. By selecting the most style-consistent examples, ranging from the top 25% to 0.7% of the full dataset, the fine-tuned LLMs can match or even surpass the performance of models trained on the entire dataset in coding and open-ended question-answering benchmarks. Code and data are available at https://github.com/zhuang-li/SCAR .


title: Pro-nilpotently extended dgca-s and SH Lie-Rinehart pairs

abstract: Category of pro-nilpotently extended differential graded commutative algebras is introduced. Chevalley-Eilenberg construction provides an equivalence between its certain full subcategory and the opposite to the full subcategory of strong homotopy Lie Rinehart pairs with strong homotopy morphisms, consisting of pairs $(A,M)$ where $M$ is flat as a graded $A$-module. It is shown that pairs $(A,M)$, where $A$ is a semi-free dgca and $M$ a cell complex in $\op{Mod}(A)$, form a category of fibrant objects by proving that their Chevalley-Eilenberg complexes form a category of cofibrant objects.


title: Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives

abstract: Federated learning is fast becoming a popular paradigm for applications involving mobile devices, banking systems, healthcare, and IoT systems. Hence, over the past five years, researchers have undertaken extensive studies on the privacy leaks, security threats, and fairness associated with these emerging models. For the most part, these three critical concepts have been studied in isolation; however, recent research has revealed that there may be an intricate interplay between them. For instance, some researchers have discovered that pursuing fairness may compromise privacy, or that efforts to enhance security can impact fairness. These emerging insights shed light on the fundamental connections between privacy, security, and fairness within federated learning, and, by delving deeper into these interconnections, we may be able to significantly augment research and development across the field. Consequently, the aim of this survey is to offer comprehensive descriptions of the privacy, security, and fairness issues in federated learning. Moreover, we analyze the complex relationships between these three dimensions of cyber safety and pinpoint the fundamental elements that influence each of them. We contend that there exists a trade-off between privacy and fairness and between security and gradient sharing. On this basis, fairness can function as a bridge between privacy and security to build models that are either more secure or more private. Building upon our observations, we identify the trade-offs between privacy and fairness and between security and fairness within the context of federated learning. The survey then concludes with promising directions for future research in this vanguard field.


title: On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions

abstract: Entity- and event-level conceptualization, as fundamental elements of human cognition, plays a pivotal role in generalizable reasoning. This process involves abstracting specific instances into higher-level concepts and forming abstract knowledge that can be applied in unfamiliar or novel situations, which can enhance models' inferential capabilities and support the effective transfer of knowledge across various domains. Despite its significance, there is currently a lack of a systematic overview that comprehensively examines existing works in the definition, execution, and application of conceptualization to enhance reasoning tasks. In this paper, we address this gap by presenting the first comprehensive survey of 150+ papers, categorizing various definitions, resources, methods, and downstream applications related to conceptualization into a unified taxonomy, with a focus on the entity and event levels. Furthermore, we shed light on potential future directions in this field and hope to garner more attention from the community.


title: Distilling Opinions at Scale: Incremental Opinion Summarization using XL-OPSUMM

abstract: Opinion summarization in e-commerce encapsulates the collective views of numerous users about a product based on their reviews. Typically, a product on an e-commerce platform has thousands of reviews, each review comprising around 10-15 words. While Large Language Models (LLMs) have shown proficiency in summarization tasks, they struggle to handle such a large volume of reviews due to context limitations. To mitigate, we propose a scalable framework called Xl-OpSumm that generates summaries incrementally. However, the existing test set, AMASUM has only 560 reviews per product on average. Due to the lack of a test set with thousands of reviews, we created a new test set called Xl-Flipkart by gathering data from the Flipkart website and generating summaries using GPT-4. Through various automatic evaluations and extensive analysis, we evaluated the framework's efficiency on two datasets, AMASUM and Xl-Flipkart. Experimental results show that our framework, Xl-OpSumm powered by Llama-3-8B-8k, achieves an average ROUGE-1 F1 gain of 4.38% and a ROUGE-L F1 gain of 3.70% over the next best-performing model.


title: Imperceptible Face Forgery Attack via Adversarial Semantic Mask

abstract: With the great development of generative model techniques, face forgery detection draws more and more attention in the related field. Researchers find that existing face forgery models are still vulnerable to adversarial examples with generated pixel perturbations in the global image. These generated adversarial samples still can't achieve satisfactory performance because of the high detectability. To address these problems, we propose an Adversarial Semantic Mask Attack framework (ASMA) which can generate adversarial examples with good transferability and invisibility. Specifically, we propose a novel adversarial semantic mask generative model, which can constrain generated perturbations in local semantic regions for good stealthiness. The designed adaptive semantic mask selection strategy can effectively leverage the class activation values of different semantic regions, and further ensure better attack transferability and stealthiness. Extensive experiments on the public face forgery dataset prove the proposed method achieves superior performance compared with several representative adversarial attack methods. The code is publicly available at https://github.com/clawerO-O/ASMA.


title: Noise reduction in ISAR imaging of UAVs using weighted atomic norm minimization and 2D-ADMM algorithm

abstract: The effect of noise on the Inverse Synthetic Aperture Radar (ISAR) with sparse apertures is a challenging issue for image reconstruction with high resolution at low Signal-to-Noise Ratios (SNRs). It is well-known that the image resolution is affected by the bandwidth of the transmitted signal and the Coherent Processing Interval (CPI) in two dimensions, range and azimuth, respectively. To reduce the noise effect and thus increase the two-dimensional resolution of Unmanned Aerial Vehicles (UAVs) images, we propose the Fast Reweighted Atomic Norm Denoising (FRAND) algorithm by incorporating the weighted atomic norm minimization. To solve the problem, the Two-Dimensional Alternating Direction Method of Multipliers (2D-ADMM) algorithm is developed to speed up the implementation procedure. Assuming sparse apertures for ISAR images of UAVs, we compare the proposed method with the MUltiple SIgnal Classification (MUSIC), Cadzow, and SL0 methods in different SNRs. Simulation results show the superiority of FRAND at low SNRs based on the Mean-Square Error (MSE), Peak Signal-to-Noise ratio (PSNR) and Structural Similarity Index Measure (SSIM) criteria.


title: VELOCITI: Can Video-Language Models Bind Semantic Concepts through Time?

abstract: Compositionality is a fundamental aspect of vision-language understanding and is especially required for videos since they contain multiple entities (e.g. persons, actions, and scenes) interacting dynamically over time. Existing benchmarks focus primarily on perception capabilities. However, they do not study binding, the ability of a model to associate entities through appropriate relationships. To this end, we propose VELOCITI, a new benchmark building on complex movie clips and dense semantic role label annotations to test perception and binding in video language models (contrastive and Video-LLMs). Our perception-based tests require discriminating video-caption pairs that share similar entities, and the binding tests require models to associate the correct entity to a given situation while ignoring the different yet plausible entities that also appear in the same video. While current state-of-the-art models perform moderately well on perception tests, accuracy is near random when both entities are present in the same video, indicating that they fail at binding tests. Even the powerful Gemini 1.5 Flash has a substantial gap (16-28%) with respect to human accuracy in such binding tests.


title: RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models

abstract: Large language models (LLMs) inevitably memorize sensitive, copyrighted, and harmful knowledge from the training corpus; therefore, it is crucial to erase this knowledge from the models. Machine unlearning is a promising solution for efficiently removing specific knowledge by post hoc modifying models. In this paper, we propose a Real-World Knowledge Unlearning benchmark (RWKU) for LLM unlearning. RWKU is designed based on the following three key factors: (1) For the task setting, we consider a more practical and challenging unlearning setting, where neither the forget corpus nor the retain corpus is accessible. (2) For the knowledge source, we choose 200 real-world famous people as the unlearning targets and show that such popular knowledge is widely present in various LLMs. (3) For the evaluation framework, we design the forget set and the retain set to evaluate the model's capabilities across various real-world applications. Regarding the forget set, we provide four four membership inference attack (MIA) methods and nine kinds of adversarial attack probes to rigorously test unlearning efficacy. Regarding the retain set, we assess locality and utility in terms of neighbor perturbation, general ability, reasoning ability, truthfulness, factuality, and fluency. We conduct extensive experiments across two unlearning scenarios, two models and six baseline methods and obtain some meaningful findings. We release our benchmark and code publicly at http://rwku-bench.github.io for future work.


title: Benchmarking Label Noise in Instance Segmentation: Spatial Noise Matters

abstract: Obtaining accurate labels for instance segmentation is particularly challenging due to the complex nature of the task. Each image necessitates multiple annotations, encompassing not only the object's class but also its precise spatial boundaries. These requirements elevate the likelihood of errors and inconsistencies in both manual and automated annotation processes. By simulating different noise conditions, we provide a realistic scenario for assessing the robustness and generalization capabilities of instance segmentation models in different segmentation tasks, introducing COCO-N and Cityscapes-N. We also propose a benchmark for weakly annotation noise, dubbed COCO-WAN, which utilizes foundation models and weak annotations to simulate semi-automated annotation tools and their noisy labels. This study sheds light on the quality of segmentation masks produced by various models and challenges the efficacy of popular methods designed to address learning with label noise.


abstract: Learning control policies to perform complex robotics tasks from human preference data presents significant challenges. On the one hand, the complexity of such tasks typically requires learning policies to perform a variety of subtasks, then combining them to achieve the overall goal. At the same time, comprehensive, well-engineered reward functions are typically unavailable in such problems, while limited human preference data often is; making efficient use of such data to guide learning is therefore essential. Methods for learning to perform complex robotics tasks from human preference data must overcome both these challenges simultaneously. In this work, we introduce DIPPER: Direct Preference Optimization to Accelerate Primitive-Enabled Hierarchical Reinforcement Learning, an efficient hierarchical approach that leverages direct preference optimization to learn a higher-level policy and reinforcement learning to learn a lower-level policy. DIPPER enjoys improved computational efficiency due to its use of direct preference optimization instead of standard preference-based approaches such as reinforcement learning from human feedback, while it also mitigates the well-known hierarchical reinforcement learning issues of non-stationarity and infeasible subgoal generation due to our use of primitive-informed regularization inspired by a novel bi-level optimization formulation of the hierarchical reinforcement learning problem. To validate our approach, we perform extensive experimental analysis on a variety of challenging robotics tasks, demonstrating that DIPPER outperforms hierarchical and non-hierarchical baselines, while ameliorating the non-stationarity and infeasible subgoal generation issues of hierarchical reinforcement learning.


title: Development and Validation of Fully Automatic Deep Learning-Based Algorithms for Immunohistochemistry Reporting of Invasive Breast Ductal Carcinoma

abstract: Immunohistochemistry (IHC) analysis is a well-accepted and widely used method for molecular subtyping, a procedure for prognosis and targeted therapy of breast carcinoma, the most common type of tumor affecting women. There are four molecular biomarkers namely progesterone receptor (PR), estrogen receptor (ER), antigen Ki67, and human epidermal growth factor receptor 2 (HER2) whose assessment is needed under IHC procedure to decide prognosis as well as predictors of response to therapy. However, IHC scoring is based on subjective microscopic examination of tumor morphology and suffers from poor reproducibility, high subjectivity, and often incorrect scoring in low-score cases. In this paper, we present, a deep learning-based semi-supervised trained, fully automatic, decision support system (DSS) for IHC scoring of invasive ductal carcinoma. Our system automatically detects the tumor region removing artifacts and scores based on Allred standard. The system is developed using 3 million pathologist-annotated image patches from 300 slides, fifty thousand in-house cell annotations, and forty thousand pixels marking of HER2 membrane. We have conducted multicentric trials at four centers with three different types of digital scanners in terms of percentage agreement with doctors. And achieved agreements of 95, 92, 88 and 82 percent for Ki67, HER2, ER, and PR stain categories, respectively. In addition to overall accuracy, we found that there is 5 percent of cases where pathologist have changed their score in favor of algorithm score while reviewing with detailed algorithmic analysis. Our approach could improve the accuracy of IHC scoring and subsequent therapy decisions, particularly where specialist expertise is unavailable. Our system is highly modular. The proposed algorithm modules can be used to develop DSS for other cancer types.


title: Selection rules of linear and nonlinear polarization-selective absorption in optically dressed matter

abstract: Dynamical symmetries of laser-dressed matter determine selection rules that determine its absorption spectrum. We explore selection rules for polarization-sensitive absorption in Floquet matter, using Floquet group theory in synthetic dimensions. We present comprehensive tables of selection rules that polarization-structured light impose on Floquet dark states and Floquet dark bands. Notably, our tables encompass nonlinear absorption, to all nonlinear orders, revealing that different nonlinear orders follow distinct polarization selection rules, potentially leading to polarization-tunable optical filters.


title: Fair Computation Offloading for RSMA-Assisted Mobile Edge Computing Networks

abstract: Rate splitting multiple access (RSMA) provides a flexible transmission framework that can be applied in mobile edge computing (MEC) systems. However, the research work on RSMA-assisted MEC systems is still at the infancy and many design issues remain unsolved, such as the MEC server and channel allocation problem in general multi-server and multi-channel scenarios as well as the user fairness issues. In this regard, we study an RSMA-assisted MEC system with multiple MEC servers, channels and devices, and consider the fairness among devices. A max-min fairness computation offloading problem to maximize the minimum computation offloading rate is investigated. Since the problem is difficult to solve optimally, we develop an efficient algorithm to obtain a suboptimal solution. Particularly, the time allocation and the computing frequency allocation are derived as closed-form functions of the transmit power allocation and the successive interference cancellation (SIC) decoding order, while the SIC decoding order is obtained heuristically, and the bisection search and the successive convex approximation methods are employed to optimize the transmit power allocation. For the MEC server and channel allocation problem, we transform it into a hypergraph matching problem and solve it by matching theory. Simulation results demonstrate that the proposed RSMA-assisted MEC system outperforms current MEC systems under various system setups.


title: Oscillation inequalities for Carleson--Dunkl operator

abstract: In this paper, we establish estimates for the oscillation seminorm for the so-called Carleson--Dunkl operator on weighted $L^p(\mathbb{R},w(x)|x|^{2\alpha+1}{\rm d}x)$ spaces with power weights $w(x)=|x|^\beta$. As a result, we obtain oscillation estimates for the standard Carleson operator on $L_{\rm rad}^p(\mathbb{R}^n,|x|^\beta{\rm d}x)$. As a byproduct, we obtain the 'generalization' of the Rubio de Francia transference principle for radial multipliers.


title: When NOMA Meets AIGC: Enhanced Wireless Federated Learning

abstract: Wireless federated learning (WFL) enables devices to collaboratively train a global model via local model training, uploading and aggregating. However, WFL faces the data scarcity/heterogeneity problem (i.e., data are limited and unevenly distributed among devices) that degrades the learning performance. In this regard, artificial intelligence generated content (AIGC) can synthesize various types of data to compensate for the insufficient local data. Nevertheless, downloading synthetic data or uploading local models iteratively takes a lot of time, especially for a large amount of devices. To address this issue, we propose to leverage non-orthogonal multiple access (NOMA) to achieve efficient synthetic data and local model transmission. This paper is the first to combine AIGC and NOMA with WFL to maximally enhance the learning performance. For the proposed NOMA+AIGC-enhanced WFL, the problem of jointly optimizing the synthetic data distribution, two-way communication and computation resource allocation to minimize the global learning error is investigated. The problem belongs to NP-hard mixed integer nonlinear programming, whose optimal solution is intractable to find. We first employ the block coordinate descent method to decouple the complicated-coupled variables, and then resort to our analytical method to derive an efficient low-complexity local optimal solution with partial closed-form results. Extensive simulations validate the superiority of the proposed scheme compared to the existing and benchmark schemes such as the frequency/time division multiple access based AIGC-enhanced schemes.


title: TrafficBots V1.5: Traffic Simulation via Conditional VAEs and Transformers with Relative Pose Encoding

abstract: In this technical report we present TrafficBots V1.5, a baseline method for the closed-loop simulation of traffic agents. TrafficBots V1.5 achieves baseline-level performance and a 3rd place ranking in the Waymo Open Sim Agents Challenge (WOSAC) 2024. It is a simple baseline that combines TrafficBots, a CVAE-based multi-agent policy conditioned on each agent's individual destination and personality, and HPTR, the heterogeneous polyline transformer with relative pose encoding. To improve the performance on the WOSAC leaderboard, we apply scheduled teacher-forcing at the training time and we filter the sampled scenarios at the inference time. The code is available at https://github.com/zhejz/TrafficBotsV1.5.


title: Notes on heating phase dynamics in Floquet CFTs and Modular quantization

abstract: In this article, we explore the connection between the heating phase of periodically driven CFTs and the Modular Hamiltonian of a subregion in the vacuum state. We show that the heating phase Hamiltonian corresponds to the Modular Hamiltonian, with the fixed points mapping to the endpoints of the subregion. In the bulk dual, we find that these fixed points correspond to the Ryu-Takayanagi surface of the AdS-Rindler wedge. Consequently, the entanglement entropy associated to the boundary interval within two fixed points exactly matches with the Bekenstein-Hawking entropy of AdS-Rindler. We observe the emergent Virasoro algebra in the boundary quantization of the Modular Hamiltonian has a striking similarity with the emerging near Horizon Virasoro algebra. This is a consequence of the fact that while obtaining the boundary Virasoro algebra, a cut-off with conformal boundary condition around the fixed point is introduced, which in the bulk is related to a stretched horizon, with an emergent two-dimensional conformal symmetry. We also argue that as one tunes the parameter space of Floquet Hamiltonians to transition from the non-heating to the heating phase the operator algebra type changes from Von Neumann type $I$ to $III_1$ factor, providing a non-equilibrium analogue of the Hawking-Page transition.


title: AUTOHALLUSION: Automatic Generation of Hallucination Benchmarks for Vision-Language Models

abstract: Large vision-language models (LVLMs) hallucinate: certain context cues in an image may trigger the language module's overconfident and incorrect reasoning on abnormal or hypothetical objects. Though a few benchmarks have been developed to investigate LVLM hallucinations, they mainly rely on hand-crafted corner cases whose fail patterns may hardly generalize, and finetuning on them could undermine their validity. These motivate us to develop the first automatic benchmark generation approach, AUTOHALLUSION, that harnesses a few principal strategies to create diverse hallucination examples. It probes the language modules in LVLMs for context cues and uses them to synthesize images by: (1) adding objects abnormal to the context cues; (2) for two co-occurring objects, keeping one and excluding the other; or (3) removing objects closely tied to the context cues. It then generates image-based questions whose ground-truth answers contradict the language module's prior. A model has to overcome contextual biases and distractions to reach correct answers, while incorrect or inconsistent answers indicate hallucinations. AUTOHALLUSION enables us to create new benchmarks at the minimum cost and thus overcomes the fragility of hand-crafted benchmarks. It also reveals common failure patterns and reasons, providing key insights to detect, avoid, or control hallucinations. Comprehensive evaluations of top-tier LVLMs, e.g., GPT-4V(ision), Gemini Pro Vision, Claude 3, and LLaVA-1.5, show a 97.7% and 98.7% success rate of hallucination induction on synthetic and real-world datasets of AUTOHALLUSION, paving the way for a long battle against hallucinations.


title: Magnetohydrodynamical modeling of star-disk formation: from isolated spherical collapse towards incorporation of external dynamics

abstract: The formation of protostars and their disks has been understood as the result of the gravitational collapse phase of an accumulation of dense gas that determines the mass reservoir of the star-disk system. Against this background, the broadly applied scenario of considering the formation of disks has been to model the collapse of a dense core assuming spherical spherical symmetry. Our understanding of the formation of star-disk systems is currently undergoing a reformation though. The picture evolves from interpreting disks as the sole outcome of the collapse of an isolated prestellar core to a more dynamic picture where disks are affected by the molecular cloud environment in which they form. In this review, we provide a status report of the state-of-the-art of spherical collapse models that are highly advanced in terms of the incorporated physics together with constraints from models that account for the possibility of infall onto star-disk systems in simplified test setups, as well as in multi-scale simulations that cover a dynamical range from the Giant Molecular Cloud environment down to the disk. Considering the observational constraints that favor a more dynamical picture of star formation, we finally discuss the challenges and prospects in linking the efforts of tackle the problem of star-disk formation in combined multi-scale, multi-physics simulations.


title: Light Up the Shadows: Enhance Long-Tailed Entity Grounding with Concept-Guided Vision-Language Models

abstract: Multi-Modal Knowledge Graphs (MMKGs) have proven valuable for various downstream tasks. However, scaling them up is challenging because building large-scale MMKGs often introduces mismatched images (i.e., noise). Most entities in KGs belong to the long tail, meaning there are few images of them available online. This scarcity makes it difficult to determine whether a found image matches the entity. To address this, we draw on the Triangle of Reference Theory and suggest enhancing vision-language models with concept guidance. Specifically, we introduce COG, a two-stage framework with COncept-Guided vision-language models. The framework comprises a Concept Integration module, which effectively identifies image-text pairs of long-tailed entities, and an Evidence Fusion module, which offers explainability and enables human verification. To demonstrate the effectiveness of COG, we create a dataset of 25k image-text pairs of long-tailed entities. Our comprehensive experiments show that COG not only improves the accuracy of recognizing long-tailed image-text pairs compared to baselines but also offers flexibility and explainability.


title: New Solutions on LLM Acceleration, Optimization, and Application

abstract: Large Language Models (LLMs) have become extremely potent instruments with exceptional capacities for comprehending and producing human-like text in a wide range of applications. However, the increasing size and complexity of LLMs present significant challenges in both training and deployment, leading to substantial computational and storage costs as well as heightened energy consumption. In this paper, we provide a review of recent advancements and research directions aimed at addressing these challenges and enhancing the efficiency of LLM-based systems. We begin by discussing algorithm-level acceleration techniques focused on optimizing LLM inference speed and resource utilization. We also explore LLM-hardware co-design strategies with a vision to improve system efficiency by tailoring hardware architectures to LLM requirements. Further, we delve into LLM-to-accelerator compilation approaches, which involve customizing hardware accelerators for efficient LLM deployment. Finally, as a case study to leverage LLMs for assisting circuit design, we examine LLM-aided design methodologies for an important task: High-Level Synthesis (HLS) functional verification, by creating a new dataset that contains a large number of buggy and bug-free codes, which can be essential for training LLMs to specialize on HLS verification and debugging. For each aspect mentioned above, we begin with a detailed background study, followed by the presentation of several novel solutions proposed to overcome specific challenges. We then outline future research directions to drive further advancements. Through these efforts, we aim to pave the way for more efficient and scalable deployment of LLMs across a diverse range of applications.


title: Propagation of GRB Relativistic Jets in AGN Disks and Its Implication for GRB Detection

abstract: The accretion disks of supermassive black holes (SMBHs) harboring in active galactic nuclei (AGN) are considered to be an ideal site for producing different types of gamma-ray bursts (GRBs). The detectability of these GRB phenomena hidden in AGN disks is highly dependent on the dynamical evolution of the GRB relativistic jets. By investigating the reverse and forward shock dynamics due to the interaction between the jets and AGN disk material, we find that the relativistic jets can successfully break out from the disks only for a sufficiently high luminosity and a long enough duration. In comparison, relatively normal GRB jets are inclined to be choked in the disks, unless the GRBs occur near an SMBH with relatively low mass (e.g., $\sim 10^6M_{\odot}$). For the choked jets, unlike normal GRB prompt and afterglow emission, we can only expect to detect emission from the forward shock when the shock is very close to the edge of the disks, i.e., the shock breakout emission and subsequent cooling of the shock.


title: Simons Observatory: Observatory Scheduler and Automated Data Processing

abstract: The Simons Observatory (SO) is a next-generation ground-based telescope located in the Atacama Desert in Chile, designed to map the cosmic microwave background (CMB) with unprecedented precision. The observatory consists of three small aperture telescopes (SATs) and one large aperture telescope (LAT), each optimized for distinct but complementary scientific goals. To achieve these goals, optimized scan strategies have been defined for both the SATs and LAT. This paper describes a software system deployed in SO that effectively translates high-level scan strategies into realistic observing scripts executable by the telescope, taking into account realistic observational constraints. The data volume of SO also necessitates a scalable software infrastructure to support its daily data processing needs. This paper also outlines an automated workflow system for managing data packaging and daily data reduction at the site.


title: Breaking the Attention Bottleneck

abstract: Attention-based transformers have become the standard architecture in many deep learning fields, primarily due to their ability to model long-range dependencies and handle variable-length input sequences. However, the attention mechanism with its quadratic complexity is a significant bottleneck in the transformer architecture. This algorithm is only uni-directional in the decoder and converges to a static pattern in over-parametrized decoder-only models. I address this issue by developing a generative function as attention or activation replacement. It still has the auto-regressive character by comparing each token with the previous one. In my test setting with nanoGPT this yields a smaller loss while having a smaller model. The loss further drops by incorporating an average context vector. This concept of attention replacement is distributed under the GNU AGPL v3 license at https://gitlab.com/Bachstelze/causal_generation.


title: SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-based 3D Object Detection

abstract: LiDAR-based sparse 3D object detection plays a crucial role in autonomous driving applications due to its computational efficiency advantages. Existing methods either use the features of a single central voxel as an object proxy, or treat an aggregated cluster of foreground points as an object proxy. However, the former lacks the ability to aggregate contextual information, resulting in insufficient information expression in object proxies. The latter relies on multi-stage pipelines and auxiliary tasks, which reduce the inference speed. To maintain the efficiency of the sparse framework while fully aggregating contextual information, in this work, we propose SparseDet which designs sparse queries as object proxies. It introduces two key modules, the Local Multi-scale Feature Aggregation (LMFA) module and the Global Feature Aggregation (GFA) module, aiming to fully capture the contextual information, thereby enhancing the ability of the proxies to represent objects. Where LMFA sub-module achieves feature fusion across different scales for sparse key voxels %which does this through via coordinate transformations and using nearest neighbor relationships to capture object-level details and local contextual information, GFA sub-module uses self-attention mechanisms to selectively aggregate the features of the key voxels across the entire scene for capturing scene-level contextual information. Experiments on nuScenes and KITTI demonstrate the effectiveness of our method. Specifically, on nuScene, SparseDet surpasses the previous best sparse detector VoxelNeXt by 2.2\% mAP with 13.5 FPS, and on KITTI, it surpasses VoxelNeXt by 1.12\% $\mathbf{AP_{3D}}$ on hard level tasks with 17.9 FPS.


title: MICL: Improving In-Context Learning through Multiple-Label Words in Demonstration

abstract: In-context learning (ICL) enables large language models (LLMs) to perform new tasks by using sample-label pairs as demonstrations. However, variations in demonstrations can lead to significantly different performances. Current research mainly focuses on selecting demonstration samples, preassuming the class name to be the label word when creating sample-label pairs. However, the choice of label words is crucial for ICL performance. In addition, we observe that using a single class name in demonstration may not yield optimal results. In this paper, we propose to use multiple label words in one sample-label pair to enhance ICL performance. Further, we select and order sample-label pairs based on LLM's output distribution, aiming to optimize the demonstration examples from both the samples' and labels' perspectives. Evaluation results on seven classification datasets show that the use of multiple label words, strategically organized by their selection, order and quantity, improves ICL performance through diverse label information.


title: Multispecies BGK models and the Onsager reciprocal relations

abstract: It is shown that most of the existing versions of the Bhatnagar-Gross-Krook model $-$ those whose coefficient are independent of the molecular velocity $-$ do not satisfy the Onsager relations. This casts doubt on their qualitative relevance and definitely rules them out as a quantitative predictive tool.


title: Fast Fractional Programming for Multi-Cell Integrated Sensing and Communications

abstract: This paper concerns the coordinate multi-cell beamforming design for integrated sensing and communications (ISAC). In particular, we assume that each base station (BS) has massive antennas. The optimization objective is to maximize a weighted sum of the data rates (for communications) and the Fisher information (for sensing). We first show that the conventional beamforming method for the multiple-input multiple-output (MIMO) transmission, i.e., the weighted minimum mean square error (WMMSE) algorithm, has a natural extension to the ISAC problem scenario from a fractional programming (FP) perspective. However, the extended WMMSE algorithm requires computing the $N\times N$ matrix inverse extensively, where $N$ is proportional to the antenna array size, so the algorithm becomes quite costly when antennas are massively deployed. To address this issue, we develop a nonhomogeneous bound and use it in conjunction with the FP technique to solve the ISAC beamforming problem without the need to invert any large matrices. It is further shown that the resulting new FP algorithm has an intimate connection with gradient projection, based on which we can accelerate the convergence via Nesterov's gradient extrapolation.


title: SingMOS: An extensive Open-Source Singing Voice Dataset for MOS Prediction

abstract: In speech generation tasks, human subjective ratings, usually referred to as the opinion score, are considered the "gold standard" for speech quality evaluation, with the mean opinion score (MOS) serving as the primary evaluation metric. Due to the high cost of human annotation, several MOS prediction systems have emerged in the speech domain, demonstrating good performance. These MOS prediction models are trained using annotations from previous speech-related challenges. However, compared to the speech domain, the singing domain faces data scarcity and stricter copyright protections, leading to a lack of high-quality MOS-annotated datasets for singing. To address this, we propose SingMOS, a high-quality and diverse MOS dataset for singing, covering a range of Chinese and Japanese datasets. These synthesized vocals are generated using state-of-the-art models in singing synthesis, conversion, or resynthesis tasks and are rated by professional annotators alongside real vocals. Data analysis demonstrates the diversity and reliability of our dataset. Additionally, we conduct further exploration on SingMOS, providing insights for singing MOS prediction and guidance for the continued expansion of SingMOS.


title: A systematic investigation on dark matter-electron scattering in effective field theories

abstract: In this paper, we systematically investigate the general dark matter-electron interactions within the framework of effective field theories (EFT). We consider both the non-relativistic (NR) EFT and the relativistic EFT descriptions of the interactions with the spin of dark matter (DM) up to one, i.e., the scalar ($\phi$), fermion ($\chi$), and vector $(X)$ DM scenarios. We first collect the leading-order NR EFT operators describing the DM-electron interactions, and construct especially the NR operators for the vector DM case. Next, we consider all possible leading-order relativistic EFT operators including those with a photon field and perform the NR reduction to match them onto the NR EFT. Then we rederive the DM-bound-electron scattering rate within the NR EFT framework and find that the matrix element squared, which is the key input that encodes the DM and atomic information, can be compactly decomposed into three terms. Each term is a product of a DM response function $(a_{0,1,2})$, which is essentially a factor of Wilson coefficients squared, and its corresponding generalized atomic response function ($\widetilde W_{0,1,2}$). Lastly, we employ the electron recoil data from the DM direct detection experiments (including XENON10, XENON1T, and PandaX-4T) to constrain all the non-relativistic and relativistic operators in all three DM scenarios. We set strong bounds on the DM-electron interactions in the sub-GeV region. Particularly, we find that the latest PandaX-4T S2-only data provide stringent constraints on dark matter with a mass greater than approximately 20 MeV, surpassing those from the previous XENON10 and XENON1T experiments.


title: Minimal evolution times for fast, pulse-based state preparation in silicon spin qubits

abstract: Standing as one of the most significant barriers to reaching quantum advantage, state-preparation fidelities on noisy intermediate-scale quantum processors suffer from quantum-gate errors, which accumulate over time. A potential remedy is pulse-based state preparation. We numerically investigate the minimal evolution times (METs) attainable by optimizing (microwave and exchange) pulses on silicon hardware. We investigate two state preparation tasks. First, we consider the preparation of molecular ground states and find the METs for H$_2$, HeH$^+$, and LiH to be 2.4 ns, 4.4 ns, and 27.2 ns, respectively. Second, we consider transitions between arbitrary states and find the METs for transitions between arbitrary four-qubit states to be below 50 ns. For comparison, connecting arbitrary two-qubit states via one- and two-qubit gates on the same silicon processor requires approximately 200 ns. This comparison indicates that pulse-based state preparation is likely to utilize the coherence times of silicon hardware more efficiently than gate-based state preparation. Finally, we quantify the effect of silicon device parameters on the MET. We show that increasing the maximal exchange amplitude from 10 MHz to 1 GHz accelerates the METs, e.g., for H$_2$ from 84.3 ns to 2.4 ns. This demonstrates the importance of fast exchange. We also show that increasing the maximal amplitude of the microwave drive from 884 kHz to 56.6 MHz shortens state transitions, e.g., for two-qubit states from 1000 ns to 25 ns. Our results bound both the state-preparation times for general quantum algorithms and the execution times of variational quantum algorithms with silicon spin qubits.


title: First-Order Manifold Data Augmentation for Regression Learning

abstract: Data augmentation (DA) methods tailored to specific domains generate synthetic samples by applying transformations that are appropriate for the characteristics of the underlying data domain, such as rotations on images and time warping on time series data. In contrast, domain-independent approaches, e.g. mixup, are applicable to various data modalities, and as such they are general and versatile. While regularizing classification tasks via DA is a well-explored research topic, the effect of DA on regression problems received less attention. To bridge this gap, we study the problem of domain-independent augmentation for regression, and we introduce FOMA: a new data-driven domain-independent data augmentation method. Essentially, our approach samples new examples from the tangent planes of the train distribution. Augmenting data in this way aligns with the network tendency towards capturing the dominant features of its input signals. We evaluate FOMA on in-distribution generalization and out-of-distribution robustness benchmarks, and we show that it improves the generalization of several neural architectures. We also find that strong baselines based on mixup are less effective in comparison to our approach. Our code is publicly available athttps://github.com/azencot-group/FOMA.


title: Self-consistent Coulomb interactions for machine learning interatomic potentials

abstract: A ubiquitous approach to obtain transferable machine learning-based models of potential energy surfaces for atomistic systems is to decompose the total energy into a sum of local atom-centred contributions. However, in many systems non-negligible long-range electrostatic effects must be taken into account as well. We introduce a general mathematical framework to study how such long-range effects can be included in a way that (i) allows charge equilibration and (ii) retains the locality of the learnable atom-centred contributions to ensure transferability. Our results give partial explanations for the success of existing machine learned potentials that include equilibriation and provide perspectives how to design such schemes in a systematic way. To complement the rigorous theoretical results, we describe a practical scheme for fitting the energy and electron density of water clusters.


title: M-SET: Multi-Drone Swarm Intelligence Experimentation with Collision Avoidance Realism

abstract: Distributed sensing by cooperative drone swarms is crucial for several Smart City applications, such as traffic monitoring and disaster response. Using an indoor lab with inexpensive drones, a testbed supports complex and ambitious studies on these systems while maintaining low cost, rigor, and external validity. This paper introduces the Multi-drone Sensing Experimentation Testbed (M-SET), a novel platform designed to prototype, develop, test, and evaluate distributed sensing with swarm intelligence. M-SET addresses the limitations of existing testbeds that fail to emulate collisions, thus lacking realism in outdoor environments. By integrating a collision avoidance method based on a potential field algorithm, M-SET ensures collision-free navigation and sensing, further optimized via a multi-agent collective learning algorithm. Extensive evaluation demonstrates accurate energy consumption estimation and a low risk of collisions, providing a robust proof-of-concept. New insights show that M-SET has significant potential to support ambitious research with minimal cost, simplicity, and high sensing quality.


title: Bayesian Intervention Optimization for Causal Discovery

abstract: Causal discovery is crucial for understanding complex systems and informing decisions. While observational data can uncover causal relationships under certain assumptions, it often falls short, making active interventions necessary. Current methods, such as Bayesian and graph-theoretical approaches, do not prioritize decision-making and often rely on ideal conditions or information gain, which is not directly related to hypothesis testing. We propose a novel Bayesian optimization-based method inspired by Bayes factors that aims to maximize the probability of obtaining decisive and correct evidence. Our approach uses observational data to estimate causal models under different hypotheses, evaluates potential interventions pre-experimentally, and iteratively updates priors to refine interventions. We demonstrate the effectiveness of our method through various experiments. Our contributions provide a robust framework for efficient causal discovery through active interventions, enhancing the practical application of theoretical advancements.


title: Embodied Question Answering via Multi-LLM Systems

abstract: Embodied Question Answering (EQA) is an important problem, which involves an agent exploring the environment to answer user queries. In the existing literature, EQA has exclusively been studied in single-agent scenarios, where exploration can be time-consuming and costly. In this work, we consider EQA in a multi-agent framework involving multiple large language models (LLM) based agents independently answering queries about a household environment. To generate one answer for each query, we use the individual responses to train a Central Answer Model (CAM) that aggregates responses for a robust answer. Using CAM, we observe a $50\%$ higher EQA accuracy when compared against aggregation methods for ensemble LLM, such as voting schemes and debates. CAM does not require any form of agent communication, alleviating it from the associated costs. We ablate CAM with various nonlinear (neural network, random forest, decision tree, XGBoost) and linear (logistic regression classifier, SVM) algorithms. Finally, we present a feature importance analysis for CAM via permutation feature importance (PFI), quantifying CAMs reliance on each independent agent and query context.


title: A new family of expansions of real numbers

abstract: For $\alpha>1$ we represent a real number in $(0,1]$ in the form \[ \sum_{i=1}^{\infty}(\alpha-1)^{i-1}\alpha^{-(d_{1}+\dots+d_{i})}\] with $d_{i}\in\mathbb{N}$. We discuss ergodic theoretical and dimension theoretical aspects of this expansion. Furthermore we study their base-change-transformation.


title: Hamilton-Jacobi Based Policy-Iteration via Deep Operator Learning

abstract: The framework of deep operator network (DeepONet) has been widely exploited thanks to its capability of solving high dimensional partial differential equations. In this paper, we incorporate DeepONet with a recently developed policy iteration scheme to numerically solve optimal control problems and the corresponding Hamilton--Jacobi--Bellman (HJB) equations. A notable feature of our approach is that once the neural network is trained, the solution to the optimal control problem and HJB equations with different terminal functions can be inferred quickly thanks to the unique feature of operator learning. Furthermore, a quantitative analysis of the accuracy of the algorithm is carried out via comparison principles of viscosity solutions. The effectiveness of the method is verified with various examples, including 10-dimensional linear quadratic regulator problems (LQRs).


title: Improved absolute abundance estimates from spatial count data with simulation and microfossil case studies

abstract: Many fundamental parameters of biological systems -- eg. productivity, population sizes and biomass -- are most effectively expressed in absolute terms. In contrast to proportional data (eg. percentages), absolute values provide standardised metrics on the functioning of biological entities (eg. organisism, species, ecosystems). These are particularly valuable when comparing assemblages across time and space. Since it is almost always impractical to count entire populations, estimates of population abundances require a sampling method that is both accurate and precise. Such absolute abundance estimates typically entail more "sampling effort" (data collection time) than proportional data. Here we refined a method of absolute abundance estimates -- the "exotic marker technique" -- by producing a variant that is more efficient without losing accuracy. This new method, the "field-of-view subsampling method" (FOVS method) is based on area subsampling, from which large samples can be quickly extrapolated. Two case studies of the exotic marker technique were employed: 1, computer simulations; and 2, an observational "real world" data set of terrestrial organic microfossils from the Permian- and Triassic-aged rock strata of southeastern Australia, spiked with marker grains of known quantity and variance. We compared the FOVS method against the traditional "linear method" method using three metrics: 1, concentration (specimens/gram of sediment); 2, precision and 3, data collection effort. In almost all cases, the FOVS method delivers higher precision than the linear method, with equivalent effort, and our computer simulations suggest that the FOVS method more accurately estimates the true error for large target-to-marker ratios. Since we predict that these conditions are typically common, we recommend the new FOVS method in almost every "real world" case.


title: Generating Tables from the Parametric Knowledge of Language Models

abstract: We explore generating factual and accurate tables from the parametric knowledge of large language models (LLMs). While LLMs have demonstrated impressive capabilities in recreating knowledge bases and generating free-form text, we focus on generating structured tabular data, which is crucial in domains like finance and healthcare. We examine the table generation abilities of four state-of-the-art LLMs: GPT-3.5, GPT-4, Llama2-13B, and Llama2-70B, using three prompting methods for table generation: (a) full-table, (b) row-by-row; (c) cell-by-cell. For evaluation, we introduce a novel benchmark, WikiTabGen which contains 100 curated Wikipedia tables. Tables are further processed to ensure their factual correctness and manually annotated with short natural language descriptions. Our findings reveal that table generation remains a challenge, with GPT-4 reaching the highest accuracy at 19.6%. Our detailed analysis sheds light on how various table properties, such as size, table popularity, and numerical content, influence generation performance. This work highlights the unique challenges in LLM-based table generation and provides a solid evaluation framework for future research. Our code, prompts and data are all publicly available: https://github.com/analysis-bots/WikiTabGen


title: Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies

abstract: Large Language Models (LLMs) have demonstrated effectiveness not only in language tasks but also in video reasoning. This paper introduces a novel dataset, Tropes in Movies (TiM), designed as a testbed for exploring two critical yet previously overlooked video reasoning skills: (1) Abstract Perception: understanding and tokenizing abstract concepts in videos, and (2) Long-range Compositional Reasoning: planning and integrating intermediate reasoning steps for understanding long-range videos with numerous frames. Utilizing tropes from movie storytelling, TiM evaluates the reasoning capabilities of state-of-the-art LLM-based approaches. Our experiments show that current methods, including Captioner-Reasoner, Large Multimodal Model Instruction Fine-tuning, and Visual Programming, only marginally outperform a random baseline when tackling the challenges of Abstract Perception and Long-range Compositional Reasoning. To address these deficiencies, we propose Face-Enhanced Viper of Role Interactions (FEVoRI) and Context Query Reduction (ConQueR), which enhance Visual Programming by fostering role interaction awareness and progressively refining movie contexts and trope queries during reasoning processes, significantly improving performance by 15 F1 points. However, this performance still lags behind human levels (40 vs. 65 F1). Additionally, we introduce a new protocol to evaluate the necessity of Abstract Perception and Long-range Compositional Reasoning for task resolution. This is done by analyzing the code generated through Visual Programming using an Abstract Syntax Tree (AST), thereby confirming the increased complexity of TiM. The dataset and code are available at: https://ander1119.github.io/TiM


title: Ajtai's theorem for $T^2_2(R)$ and pebble games with backtracking

abstract: We introduce a pebble game extended by backtracking options for one of the two players (called Prover) and reduce the provability of the pigeonhole principle for a generic predicate $R$ in the bounded arithmetic $T^2_2(R)$ to the existence of a particular kind of winning strategy (called oblivious) for Prover in the game. While the unprovability of the said principle in $T^2_2(R)$ is an immediate consequence of a celebrated theorem of Ajtai (which deals with a stronger theory $T_2(R)$), up-to-date no methods working for $T^2_2(R)$ directly (in particular without switching lemma) are known. Although the full analysis of the introduced pebble game is left open, as a first step towards resolving it, we restrict ourselves to a simplified version of the game. In this case, Prover can use only two pebbles and move in an extremely oblivious way. Besides, a series of backtracks can be made only once during a play. Under these assumptions, we show that no strategy of Prover can be winning.


title: Determination of the Hamiltonian from the Equations of Motion with Illustration from Examples

abstract: In this paper, we study the determination of Hamiltonian from a given equations of motion. It can be cast into a problem of matrix factorization after reinterpretation of the system as first order evolutionary equations in the phase space coordinates. We state the criterion on the evolution matrix for a Hamiltonian to exist. In addition, the proof is constructive and an explicit Hamiltonian with accompanied symplectic structure can be obtained. As an application, we will study a class of PT-symmetric systems for illustration.


title: Real-Time Formulation of Atomistic Electromagnetic Models for Plasmonics

abstract: Investigating nanoplasmonics using time-dependent approaches permits shedding light on the dynamic optical properties of plasmonic structures, which are intrinsically connected with their potential applications in photochemistry and photoreactivity. This work proposes a real-time extension of our recently developed fully atomistic approaches $\omega$FQ and $\omega$FQF$\mu$. These methods successfully reproduce quantum size effects in metal nanoparticles, including plasmon shifts for both simple and $d$-metals, even below the quantum size limit. Also, thanks to their atomistic nature and the phenomenological inclusion of quantum tunneling effects, they can effectively describe the optical response of subnanometer junctions. By incorporating real-time dynamics, the approach provides an efficient framework for studying the time-dependent optical behavior of metal nanostructures, including the decoherence of plasmon excitations.


title: Ungar Games on the Young-Fibonacci and the Shifted Staircase Lattices

abstract: In 2023, Defant and Li introduced the Ungar move, which sends an element $v$ of a finite meet-semilattice $L$ to the meet of some subset of the elements covered by $v$. More recently, Defant, Kravitz, and Williams introduced the Ungar game on $L$, in which two players take turns making Ungar moves starting from an element of $L$ until the player that cannot make a nontrivial Ungar move loses. In this note, we settle two conjectures by Defant, Kravitz, and Williams on the Ungar games on the Young-Fibonacci lattice and the lattices of the order ideals of shifted staircases.


title: Make Your Home Safe: Time-aware Unsupervised User Behavior Anomaly Detection in Smart Homes via Loss-guided Mask

abstract: Smart homes, powered by the Internet of Things, offer great convenience but also pose security concerns due to abnormal behaviors, such as improper operations of users and potential attacks from malicious attackers. Several behavior modeling methods have been proposed to identify abnormal behaviors and mitigate potential risks. However, their performance often falls short because they do not effectively learn less frequent behaviors, consider temporal context, or account for the impact of noise in human behaviors. In this paper, we propose SmartGuard, an autoencoder-based unsupervised user behavior anomaly detection framework. First, we design a Loss-guided Dynamic Mask Strategy (LDMS) to encourage the model to learn less frequent behaviors, which are often overlooked during learning. Second, we propose a Three-level Time-aware Position Embedding (TTPE) to incorporate temporal information into positional embedding to detect temporal context anomaly. Third, we propose a Noise-aware Weighted Reconstruction Loss (NWRL) that assigns different weights for routine behaviors and noise behaviors to mitigate the interference of noise behaviors during inference. Comprehensive experiments on three datasets with ten types of anomaly behaviors demonstrates that SmartGuard consistently outperforms state-of-the-art baselines and also offers highly interpretable results.


title: Modulo Sampling in Shift-Invariant Spaces: Recovery and Stability Enhancement

abstract: Sampling shift-invariant (SI) signals with a high dynamic range poses a notable challenge in the domain of analog-to-digital conversion (ADC). It is essential for the ADC's dynamic range to exceed that of the incoming analog signal to ensure no vital information is lost during the conversion process. Modulo sampling, an approach initially explored with bandlimited (BL) signals, offers a promising solution to overcome the constraints of dynamic range. In this paper, we expand on the recent advancements in modulo sampling to encompass a broader range of SI signals. Our proposed strategy incorporates analog preprocessing, including the use of a mixer and a low-pass filter (LPF), to transform the signal into a bandlimited one. This BL signal can be accurately reconstructed from its modulo samples if sampled at slightly above its Nyquist frequency. The recovery of the original SI signal from this BL representation is then achieved through suitable filtering. We also examine the efficacy of this system across various noise conditions. Careful choice of the mixer plays a pivotal role in enhancing the method's reliability, especially with generators prone to instability. Our approach thus broadens the framework of modulo sampling's utility in efficiently recovering SI signals, pushing its boundaries beyond BL signals while sampling only slightly above the rate needed for a SI signal.


title: Optimizing alphabet reduction pairs of arrays

abstract: In [1], we introduced a family of combinatorial designs, which we call "alphabet reduction pairs of arrays", ARPAs for short. These designs depend on three integer parameters $q, p \leq q, k\leq p$: $q$ is the size of the symbol set $\{0, 1 ,\ldots, q -1\}$ in which the coefficients of the arrays take their values; $p$ is the maximum number of distinct symbols allowed in a row of the second array of the pair; $k$ is the larger integer for which the two arrays of the pair coincide -- up to the order of their rows -- on any $k$-ary subset of their columns. The first array must contain at least one occurrence of the word $0\ 1\ \ldots\ q -1$. Intuitively, the idea is to cover "as many as possible" occurrences of this word of $q$ symbols with "as few as possible" words of at most $p$ different symbols. These designs are related to the approximability of "Constraint Satisfaction Problems with bounded constraint arity", known as $k\,$CSPs. In this context, we are particularly interested in ARPAs in which the frequency of the word $0\ 1\ \ldots\ q -1$ is maximal. We introduce a seemingly simpler family of combinatorial designs as "Cover pairs of arrays" (CPAs). The arrays of a CPA take Boolean coefficients, and must still coincide on any $k$-ary subset of their columns. The purpose is, as it were, to cover "as many as possible" occurrences of the word of $q$ ones using "as few as possible" $q$-length Boolean words of weight at most $p$. We show that, when it comes to maximizing the frequency of the words $0\ 1\ \ldots\ q -1$ in ARPAs and $1\ 1\ \ldots\ 1$ in CPAs, ARPAs and CPAs are equivalent. We prove the optimality of the ARPAs given in [1] for the case $p =k$. In addition, we provide optimal ARPAs for the cases $k =1$ and $k =2$. We emphasize the fact that both families of combinatorial designs are related to the approximability of $k\,$CSPs.


title: A test for the redshift dependence of $\sigma_8$ using $f\sigma_8$ measurements

abstract: We search for a redshift dependence of $\sigma_8^0$ using 23 growth rate measurements from redshift space distortions and peculiar velocity measurements as a consistency check of $\Lambda$CDM. For this purpose we use the dataset from arXiv:1806.10822 consisting of 22 measurements, which has been vetted for internal consistencies. Eighteen of these measurements have been obtained from the Gold-2017 sample, collated from multiple redshift space distortion surveys between 2009 and 2016, whereas the remaining four have been obtained from the eBOSS DR14 quasar survey. We also added one additional data point from the BOSS DR12 CMASS galaxy sample. We find that for this dataset the $\sigma_8^0$ values are consistent between the low redshift and high redshift samples using three different redshift cuts. This implies that the growth rate measurements are consistent with a constant $\sigma_8^0$ in accord with $\Lambda$CDM, assuming there are no uncontrolled systematics in this dataset.