title: Abyssal Slope Currents

abstract: Realistic computational simulations in different oceanic basins reveal prevalent prograde mean flows (i.e. in the direction of topographic Rossby wave propagation along isobaths; a.k.a. topostrophy) on topographic slopes in the deep ocean, consistent with the barotropic theory of eddy-driven mean flows. Attention is focused on the Western Mediterranean Sea with strong currents and steep topography. These prograde mean currents induce an opposing bottom drag stress and thus a turbulent boundary-layer mean flow in the downhill direction, evidenced by a near-bottom negative mean vertical velocity. The slope-normal profile of diapycnal buoyancy mixing results in down-slope mean advection near the bottom (a tendency to locally increase the mean buoyancy) and up-slope buoyancy mixing (a tendency to decrease buoyancy) with associated buoyancy fluxes across the mean isopycnal surfaces (diapycnal downwelling). In the upper part of the boundary layer and nearby interior, the diapycnal turbulent buoyancy flux divergence reverses sign (diapycnal upwelling), with upward Eulerian mean buoyancy advection across isopycnal surfaces. These near-slope tendencies abate with further distance from the boundary. An along-isobath mean momentum balance shows an advective acceleration and a bottom-drag retardation of the prograde flow. The eddy buoyancy advection is significant near the slope, and the associated eddy potential energy conversion is negative, consistent with mean vertical shear flow generation for the eddies. This cross-isobath flow structure differs from previous proposals, and a new one-dimensional model is constructed for a topostrophic, stratified, slope bottom boundary layer. The broader issue of the return pathways of the global thermohaline circulation remains open, but the abyssal slope region is likely to play a dominant role.


title: Beyond Generalization: A Survey of Out-Of-Distribution Adaptation on Graphs

abstract: Distribution shifts on graphs -- the data distribution discrepancies between training and testing a graph machine learning model, are often ubiquitous and unavoidable in real-world scenarios. Such shifts may severely deteriorate the performance of the model, posing significant challenges for reliable graph machine learning. Consequently, there has been a surge in research on graph Out-Of-Distribution (OOD) adaptation methods that aim to mitigate the distribution shifts and adapt the knowledge from one distribution to another. In our survey, we provide an up-to-date and forward-looking review of graph OOD adaptation methods, covering two main problem scenarios including training-time as well as test-time graph OOD adaptation. We start by formally formulating the two problems and then discuss different types of distribution shifts on graphs. Based on our proposed taxonomy for graph OOD adaptation, we systematically categorize the existing methods according to their learning paradigm and investigate the techniques behind them. Finally, we point out promising research directions and the corresponding challenges. We also provide a continuously updated reading list at https://github.com/kaize0409/Awesome-Graph-OOD-Adaptation.git


title: Representation and Characterization of Quasistationary Distributions for Markov Chains

abstract: This work provides complete description of Quasistationary Distributions (QSDs) for Markov chains with a unique absorbing state and an irreducible set of non-absorbing states. As is well-known, every QSD has an associated absorption parameter describing the exponential tail of the absorption time under the law of the process with the QSD as the initial distribution. The analysis associated with the existence and representation of QSDs corresponding to a given parameter is according to whether the moment generating function of the absorption time starting from any non-absorbing state evaluated at the parameter is finite or infinite, the finite or infinite moment generating function regimes, respectively. For parameters in the finite regime, it is shown that when exist, all QSDs are in the convex cone of a Martin entry boundary associated with the parameter. The infinite regime corresponds to at most one parameter value and at most one QSD. In this regime, when a QSD exists, it is unique and can be represented by a renewal-type formula. Multiple applications to the findings are presented, including revisiting some of the main classical results in the area.


title: Automated Optimization of Parameterized Data-Plane Programs with Parasol

abstract: Programmable data planes allow for sophisticated applications that give operators the power to customize the functionality of their networks. Deploying these applications, however, often requires tedious and burdensome optimization of their layout and design, in which programmers must manually write, compile, and test an implementation, adjust the design, and repeat. In this paper we present Parasol, a framework that allows programmers to define general, parameterized network algorithms and automatically optimize their various parameters. The parameters of a Parasol program can represent a wide variety of implementation decisions, and may be optimized for arbitrary, high-level objectives defined by the programmer. Furthermore, optimization may be tailored to particular environments by providing a representative sample of traffic. We show how we implement the Parasol framework, which consists of a sketching language for writing parameterized programs, and a simulation-based optimizer for testing different parameter settings. We evaluate Parasol by implementing a suite of ten data-plane applications, and find that Parasol produces a solution with comparable performance to hand-optimized P4 code within a two-hour time budget.


title: Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Bandits

abstract: We study low-rank matrix trace regression and the related problem of low-rank matrix bandits. Assuming access to the distribution of the covariates, we propose a novel low-rank matrix estimation method called LowPopArt and provide its recovery guarantee that depends on a novel quantity denoted by B(Q) that characterizes the hardness of the problem, where Q is the covariance matrix of the measurement distribution. We show that our method can provide tighter recovery guarantees than classical nuclear norm penalized least squares (Koltchinskii et al., 2011) in several problems. To perform efficient estimation with a limited number of measurements from an arbitrarily given measurement set A, we also propose a novel experimental design criterion that minimizes B(Q) with computational efficiency. We leverage our novel estimator and design of experiments to derive two low-rank linear bandit algorithms for general arm sets that enjoy improved regret upper bounds. This improves over previous works on low-rank bandits, which make somewhat restrictive assumptions that the arm set is the unit ball or that an efficient exploration distribution is given. To our knowledge, our experimental design criterion is the first one tailored to low-rank matrix estimation beyond the naive reduction to linear regression, which can be of independent interest.


title: The Value of Context: Human versus Black Box Evaluators

abstract: Evaluations once solely within the domain of human experts (e.g., medical diagnosis by doctors) can now also be carried out by machine learning algorithms. This raises a new conceptual question: what is the difference between being evaluated by humans and algorithms, and when should an individual prefer one form of evaluation over the other? We propose a theoretical framework that formalizes one key distinction between the two forms of evaluation: Machine learning algorithms are standardized, fixing a common set of covariates by which to assess all individuals, while human evaluators customize which covariates are acquired to each individual. Our framework defines and analyzes the advantage of this customization -- the value of context -- in environments with very high-dimensional data. We show that unless the agent has precise knowledge about the joint distribution of covariates, the value of more covariates exceeds the value of context.


title: Assessing PIP and sGDML Potential Energy Surfaces for H3O2-

abstract: Here we assess two machine-learned potentials, one using the symmetric gradient domain machine learning (sGDML) method and one based on permutationally invariant polynomials (PIPs). These are successors to a PIP potential energy surface (PES) reported in 2004. We describe the details of both fitting methods and then compare the two PESs with respect to precision, properties, and speed of evaluation. While the precision of the potentials is similar, the PIP PES is much faster to evaluate for energies and energies plus gradient than the sGDML one. Diffusion Monte Carlo calculations of the ground vibrational state, using both potentials, produce similar large anharmonic downshift of the zero-point energy compared to the harmonic approximation the PIP and sGDML potentials. The computational time for these calculations using the sGDML PES is roughly 300 times greater than using the PIP one.


title: Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability

abstract: This paper addresses the critical challenge of assessing the representativeness of news thumbnail images, which often serve as the first visual engagement for readers when an article is disseminated on social media. We focus on whether a news image represents the actors discussed in the news text. To serve the challenge, we introduce NewsTT, a manually annotated dataset of 1000 news thumbnail images and text pairs. We found that the pretrained vision and language models, such as BLIP-2, struggle with this task. Since news subjects frequently involve named entities or proper nouns, the pretrained models could have a limited capability to match news actors' visual and textual appearances. We hypothesize that learning to contrast news text with its counterfactual, of which named entities are replaced, can enhance the cross-modal matching ability of vision and language models. We propose CFT-CLIP, a contrastive learning framework that updates vision and language bi-encoders according to the hypothesis. We found that our simple method can boost the performance for assessing news thumbnail representativeness, supporting our assumption. Code and data can be accessed at https://github.com/ssu-humane/news-images-acl24.


title: Wright-Fisher stochastic heat equations with irregular drifts

abstract: Consider the $[0,1]$-valued continuous random field solution $(u_t(x))_{t\geq 0, x\in \mathbb R}$ to the one-dimensional stochastic heat equation \[ \partial_t u_t = \frac{1}{2}\Delta u_t + b(u_t) + \sqrt{u_t(1-u_t)} \dot W, \] where $b(1)\leq 0\leq b(0)$ and $\dot W$ is space-time white noise. In this paper, we establish the weak existence and uniqueness of the above equation for a class of drifts $b(u)$ that may be irregular at the points where the noise coefficient is non-Lipschitz and degenerate, specifically at $u=0$ or $u=1$. This class of drifts includes non-Lipschitz drifts like $b(u) = u^q(1-u)$ for every $q\in (0,1)$, and some discontinuous drifts like $b(u) = \mathbf 1_{(0,1]}(u)-u$. This demonstrates a regularization effect of the multiplicative space-time white noise without the standard assumption that the noise coefficient is Lipschitz and non-degenerate. The method we apply is a further development of a moment duality technique that uses branching-coalescing Brownian motions as the dual particle system. To handle an irregular drift in the above equation, particles in the dual system are allowed to have a number of offspring with infinite expectation, and even an infinite number of offspring with positive probability. We show that, even though the branching mechanism with an infinite number of offspring causes explosions in finite time, immediately after each explosion, the total population comes down from infinity due to the coalescing mechanism. Our results on this dual particle system are of independent interest.


title: PANDA (Pedantic ANswer-correctness Determination and Adjudication):Improving Automatic Evaluation for Question Answering and Text Generation

abstract: Question answering (QA) can only make progress if we know if an answer is correct, but for many of the most challenging and interesting QA examples, current answer correctness (AC) metrics do not align with human judgments, particularly verbose, free form answers from large language models (LLM). There are two challenges: a lack of data and that models are too big. LLM based scorers correlate better with humans, but this expensive task has only been tested on limited QA datasets. We rectify these issues by providing clear guidelines for evaluating machine QA adopted from human QA contests. We also introduce Precise ANswer correctness Determination and Adjudication (PANDA), a small, efficient, deterministic AC classifier (812 KB) that more accurately evaluates answer correctness.


title: Native defects and their complexes in spinel LiGa5O8: the puzzle of p-type doping

abstract: Recently, LiGa$_5$O$_8$ was identified as a cubic spinel type ultra-wide-band-gap semiconductor with a gap of about 5.36 eV and reported to be unintentionally p-type. Here we present first-principles calculations of the native defects and various of their complexes to try to explain the occurrence of p-type doping. Although we find Li-vacancies to be somewhat shallower acceptors than in LiGaO$_2$, and becoming slightly shallower in complexes with donors such as V$_{\rm O}$ and Ga$_{\rm Li}$ antisites, these $V_{\rm Li}$ based defects are not sufficiently shallow to explain p-type doping. The dominant defects are donors and in equilibrium the Fermi level would be determined by compensation between donors and acceptors, and pinned deep in the gap.


title: KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph

abstract: In this paper, we aim to improve the reasoning ability of large language models (LLMs) over knowledge graphs (KGs) to answer complex questions. Inspired by existing methods that design the interaction strategy between LLMs and KG, we propose an autonomous LLM-based agent framework, called KG-Agent, which enables a small LLM to actively make decisions until finishing the reasoning process over KGs. In KG-Agent, we integrate the LLM, multifunctional toolbox, KG-based executor, and knowledge memory, and develop an iteration mechanism that autonomously selects the tool then updates the memory for reasoning over KG. To guarantee the effectiveness, we leverage program language to formulate the multi-hop reasoning process over the KG, and synthesize a code-based instruction dataset to fine-tune the base LLM. Extensive experiments demonstrate that only using 10K samples for tuning LLaMA-7B can outperform state-of-the-art methods using larger LLMs or more data, on both in-domain and out-domain datasets. Our code and data will be publicly released.


title: TinyLIC-High efficiency lossy image compression method

abstract: Image compression has been the subject of extensive research for several decades, resulting in the development of well-known standards such as JPEG, JPEG2000, and H.264/AVC. However, recent advancements in deep learning have led to the emergence of learned image compression methods that offer significant improvements in coding efficiency compared to traditional codecs. These learned compression techniques have shown noticeable gains and even outperformed traditional schemes


title: A Simple Boundary Condition Regularization Strategy for Image Velocimetry Based Pressure Field Reconstruction

abstract: We propose a simple boundary condition regularization strategy to reduce error propagation in pressure field reconstruction from corrupted image velocimetry data. The core idea is to replace the canonical Neumann boundary conditions with Dirichlet ones obtained by integrating the tangential part of the pressure gradient along the boundaries. Rigorous analysis and numerical experiments justify the effectiveness of this regularization.


title: GenDec: A robust generative Question-decomposition method for Multi-hop reasoning

abstract: Multi-hop QA (MHQA) involves step-by-step reasoning to answer complex questions and find multiple relevant supporting facts. However, Existing large language models'(LLMs) reasoning ability in multi-hop question answering remains exploration, which is inadequate in answering multi-hop questions. Moreover, it is unclear whether LLMs follow a desired reasoning chain to reach the right final answer. In this paper, we propose a \textbf{gen}erative question \textbf{dec}omposition method (GenDec) from the perspective of explainable QA by generating independent and complete sub-questions based on incorporating additional extracted evidence for enhancing LLMs' reasoning ability in RAG. To demonstrate the impact, generalization, and robustness of Gendec, we conduct two experiments, the first is combining GenDec with small QA systems on paragraph retrieval and QA tasks. We secondly examine the reasoning capabilities of various state-of-the-art LLMs including GPT-4 and GPT-3.5 combined with GenDec. We experiment on the HotpotQA, 2WikihopMultiHopQA, MuSiQue, and PokeMQA datasets.


title: Token-Ensemble Text Generation: On Attacking the Automatic AI-Generated Text Detection

abstract: The robustness of AI-content detection models against cultivated attacks (e.g., paraphrasing or word switching) remains a significant concern. This study proposes a novel token-ensemble generation strategy to challenge the robustness of current AI-content detection approaches. We explore the ensemble attack strategy by completing the prompt with the next token generated from random candidate LLMs. We find the token-ensemble approach significantly drops the performance of AI-content detection models (The code and test sets will be released). Our findings reveal that token-ensemble generation poses a vital challenge to current detection models and underlines the need for advancing detection technologies to counter sophisticated adversarial strategies.


title: Trust Regions for Explanations via Black-Box Probabilistic Certification

abstract: Given the black box nature of machine learning models, a plethora of explainability methods have been developed to decipher the factors behind individual decisions. In this paper, we introduce a novel problem of black box (probabilistic) explanation certification. We ask the question: Given a black box model with only query access, an explanation for an example and a quality metric (viz. fidelity, stability), can we find the largest hypercube (i.e., $\ell_{\infty}$ ball) centered at the example such that when the explanation is applied to all examples within the hypercube, (with high probability) a quality criterion is met (viz. fidelity greater than some value)? Being able to efficiently find such a \emph{trust region} has multiple benefits: i) insight into model behavior in a \emph{region}, with a \emph{guarantee}; ii) ascertained \emph{stability} of the explanation; iii) \emph{explanation reuse}, which can save time, energy and money by not having to find explanations for every example; and iv) a possible \emph{meta-metric} to compare explanation methods. Our contributions include formalizing this problem, proposing solutions, providing theoretical guarantees for these solutions that are computable, and experimentally showing their efficacy on synthetic and real data.


title: Automated optimization of force field parameters against ensemble-averaged measurements with Bayesian Inference of Conformational Populations

abstract: Accurate force fields are essential for reliable molecular simulations. These models are refined against quantum mechanical calculations and experimental measurements, which are subject to random and systematic errors. Bayesian Inference of Conformational Populations (BICePs) is a reweighting algorithm that reconciles simulated ensembles with sparse or noisy observables by sampling the full posterior distribution of conformational populations and experimental uncertainty. In this method, a metric called the BICePs score is used to perform model selection, by calculating the free energy of "turning on" the conformational populations under experimental restraints. This approach, when used with improved likelihood functions to deal with experimental outliers, can be used for force field validation (Raddi et al. 2023). Here, we extend the BICePs approach to perform automated force field refinement while simultaneously sampling the full distribution of uncertainties, using a variational method to minimize the BICePs score. To demonstrate the utility of this method, we refine multiple interaction parameters for a 12-mer HP lattice model using ensemble-averaged distance measurements as restraints. To illustrate the resilience of BICePs in the presence of unknown random and systematic errors, we assess the performance of our algorithm through repeated optimizations and under various extents of experimental error. Our results suggest that variational optimization of the BICePs score is a promising direction for robust and automatic parameterization of molecular potentials.


title: Analyzing Reward Dynamics and Decentralization in Ethereum 2.0: An Advanced Data Engineering Workflow and Comprehensive Datasets for Proof-of-Stake Incentives

abstract: Ethereum 2.0, as the preeminent smart contract blockchain platform, guarantees the precise execution of applications without third-party intervention. At its core, this system leverages the Proof-of-Stake (PoS) consensus mechanism, which utilizes a stochastic process to select validators for block proposal and validation, consequently rewarding them for their contributions. However, the implementation of blockchain technology often diverges from its central tenet of decentralized consensus, presenting significant analytical challenges. Our study collects consensus reward data from the Ethereum Beacon chain and conducts a comprehensive analysis of reward distribution and evolution, categorizing them into attestation, proposer and sync committee rewards. To evaluate the degree of decentralization in PoS Ethereum, we apply several inequality indices, including the Shannon entropy, the Gini Index, the Nakamoto Coefficient, and the Herfindahl-Hirschman Index (HHI). Our comprehensive dataset is publicly available on Harvard Dataverse, and our analytical methodologies are accessible via GitHub, promoting open-access research. Additionally, we provide insights on utilizing our data for future investigations focused on assessing, augmenting, and refining the decentralization, security, and efficiency of blockchain systems.

categories: econ.GN cs.CR cs.CY cs.DB cs.DC q-fin.EC


title: Local temperature measurement in dynamical systems with rigid constraints

abstract: Temperature measurements in particle simulations must account for the reduction in degrees of freedom (DoF) due to constraints. However, when local temperature is measured, e.g. from a set of particles in a subvolume or from velocities projected onto one Cartesian direction, the result can appear to unphysically violate equipartition if the local DoF are not correctly calculated. Here we provide a self-consistent method for calculating the DoF for an arbitrary local kinetic temperature measurement.

categories: cond-mat.stat-mech cond-mat.soft math-ph math.MP physics.chem-ph physics.class-ph


title: A Model of Solar Magnetic Flux Rope Eruption Initiated Primarily by Magnetic Reconnection

abstract: There is a heated debate regarding the specific roles played by ideal magnetohydrodynamic (MHD) instability and magnetic reconnection in the causes of solar eruptions. In the context with a pre-existing magnetic flux rope (MFR) before an eruption, it is widely believed that an ideal MHD instability, in particular, the torus instability, is responsible for triggering and driving the eruption, while reconnection, as invoked in the wake of the erupting MFR, plays a secondary role. Here we present a new numerical MHD model in which the eruption of a pre-existing MFR is primarily triggered and driven by reconnection. In this model, a stable MFR embedded in a strapping field is set as the initial condition. A surface converging flow is then applied at the lower boundary, pushing magnetic flux towards to the main polarity inversion line. It drives a quasi-static evolution of the system, during which a current layer is built up below the MFR with decreasing thickness. Once reconnection starts in the current sheet, the eruption commences, which indicates that the reconnection plays a determining role in triggers the eruption. By further analyzing the works done by in the magnetic flux of the pre-existing MFR and the newly reconnected flux during the acceleration stage of the eruption, we find that the latter plays a major role in driving the eruption. Such a model may explain observed eruptions in which the pre-eruption MFR has not reached the conditions for ideal instability.


title: How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimization

abstract: We provide a simple and flexible framework for designing differentially private algorithms to find approximate stationary points of non-convex loss functions. Our framework is based on using a private approximate risk minimizer to "warm start" another private algorithm for finding stationary points. We use this framework to obtain improved, and sometimes optimal, rates for several classes of non-convex loss functions. First, we obtain improved rates for finding stationary points of smooth non-convex empirical loss functions. Second, we specialize to quasar-convex functions, which generalize star-convex functions and arise in learning dynamical systems and training some neural nets. We achieve the optimal rate for this class. Third, we give an optimal algorithm for finding stationary points of functions satisfying the Kurdyka-Lojasiewicz (KL) condition. For example, over-parameterized neural networks often satisfy this condition. Fourth, we provide new state-of-the-art rates for stationary points of non-convex population loss functions. Fifth, we obtain improved rates for non-convex generalized linear models. A modification of our algorithm achieves nearly the same rates for second-order stationary points of functions with Lipschitz Hessian, improving over the previous state-of-the-art for each of the above problems.


title: Maz'ya-Shaposhnikova meet Bishop-Gromov

abstract: We find a surprising link between Maz'ya-Shaposhnikova's well-known asymptotic formula concerning fractional Sobolev seminorms and the generalized Bishop-Gromov inequality. In the setting of abstract metric measure spaces we prove the validity of a large family of asymptotic formulas concerning non-local energies. Important examples which are covered by our approach are for instance Carnot groups, Riemannian manifolds with Ricci curvature bounded from below and non-collapsed RCD spaces. We also extend the classical Maz'ya-Shaposhnikova's formula on Euclidean spaces to a wider class of mollifiers.


title: M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detection

abstract: The advent of Large Language Models (LLMs) has brought an unprecedented surge in machine-generated text (MGT) across diverse channels. This raises legitimate concerns about its potential misuse and societal implications. The need to identify and differentiate such content from genuine human-generated text is critical in combating disinformation, preserving the integrity of education and scientific fields, and maintaining trust in communication. In this work, we address this problem by introducing a new benchmark based on a multilingual, multi-domain, and multi-generator corpus of MGTs -- M4GT-Bench. The benchmark is compiled of three tasks: (1) mono-lingual and multi-lingual binary MGT detection; (2) multi-way detection where one need to identify, which particular model generated the text; and (3) mixed human-machine text detection, where a word boundary delimiting MGT from human-written content should be determined. On the developed benchmark, we have tested several MGT detection baselines and also conducted an evaluation of human performance. We see that obtaining good performance in MGT detection usually requires an access to the training data from the same domain and generators. The benchmark is available at https://github.com/mbzuai-nlp/M4GT-Bench.


title: KnowTuning: Knowledge-aware Fine-tuning for Large Language Models

abstract: Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual, or illogical answers. These limitations stem from inadequate knowledge awareness of LLMs during vanilla fine-tuning. To address these problems, we propose a knowledge-aware fine-tuning (KnowTuning) method to improve fine-grained and coarse-grained knowledge awareness of LLMs. We devise a fine-grained knowledge augmentation stage to train LLMs to identify difficult fine-grained knowledge in answers. We also propose a coarse-grained knowledge comparison stage to train LLMs to distinguish between reliable and unreliable knowledge, in three aspects: completeness, factuality, and logicality. Extensive experiments on both generic and medical question answering (QA) datasets confirm the effectiveness of KnowTuning, through automatic and human evaluations, across various sizes of LLMs. We further verify that KnowTuning generates more facts with less factual error rate under fine-grained facts evaluation.


title: A Question Answering Based Pipeline for Comprehensive Chinese EHR Information Extraction

abstract: Electronic health records (EHRs) hold significant value for research and applications. As a new way of information extraction, question answering (QA) can extract more flexible information than conventional methods and is more accessible to clinical researchers, but its progress is impeded by the scarcity of annotated data. In this paper, we propose a novel approach that automatically generates training data for transfer learning of QA models. Our pipeline incorporates a preprocessing module to handle challenges posed by extraction types that are not readily compatible with extractive QA frameworks, including cases with discontinuous answers and many-to-one relationships. The obtained QA model exhibits excellent performance on subtasks of information extraction in EHRs, and it can effectively handle few-shot or zero-shot settings involving yes-no questions. Case studies and ablation studies demonstrate the necessity of each component in our design, and the resulting model is deemed suitable for practical use.


title: RENOVI: A Benchmark Towards Remediating Norm Violations in Socio-Cultural Conversations

abstract: Norm violations occur when individuals fail to conform to culturally accepted behaviors, which may lead to potential conflicts. Remediating norm violations requires social awareness and cultural sensitivity of the nuances at play. To equip interactive AI systems with a remediation ability, we offer ReNoVi - a large-scale corpus of 9,258 multi-turn dialogues annotated with social norms, as well as define a sequence of tasks to help understand and remediate norm violations step by step. ReNoVi consists of two parts: 512 human-authored dialogues (real data), and 8,746 synthetic conversations generated by ChatGPT through prompt learning. While collecting sufficient human-authored data is costly, synthetic conversations provide suitable amounts of data to help mitigate the scarcity of training data, as well as the chance to assess the alignment between LLMs and humans in the awareness of social norms. We thus harness the power of ChatGPT to generate synthetic training data for our task. To ensure the quality of both human-authored and synthetic data, we follow a quality control protocol during data collection. Our experimental results demonstrate the importance of remediating norm violations in socio-cultural conversations, as well as the improvement in performance obtained from synthetic data.


title: Uncertainty Quantification of Graph Convolution Neural Network Models of Evolving Processes

abstract: The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural network models have proved to be adept at modeling processes with spatial-temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial-temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance.Projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.


title: PureNav: A Personalized Navigation Service for Environmental Justice Communities Impacted by Planned Disruptions

abstract: Planned disruptions such as highway constructions are commonplace nowadays and the communities living near these disruptions generally tend to be environmental justice communities -- low socioeconomic status with disproportionately high and adverse human health and environmental effects. A major concern is that such activities negatively impact people's well-being by disrupting their daily commutes via frequent road closures and increased dust and air pollution. This paper addresses this concern by developing a personalized navigation service called PureNav to mitigate the negative impacts of disruptions in daily commutes on people's well-being. PureNav has been designed using active engagement with four environmental justice communities affected by major highway construction. It has been deployed in the real world among the members of the four communities, and a detailed analysis of the data collected from this deployment as well as surveys show that PureNav is potentially useful in improving people's well-being. The paper describes the design, implementation, and evaluation of PureNav, and offers suggestions for further improving its efficacy.


title: Horizontally Polarized Kink Oscillations Supported by Solar Coronal Loops in an Asymmetric Environment

abstract: Kink oscillations are ubiquitously observed in solar coronal loops, their understanding being crucial in the contexts of coronal seismology and atmospheric heating. We study kink modes supported by a straight coronal loop embeded in an asymmetric environment using three-dimensional magnetohydrodynamic (MHD) simulations. We implement the asymmetric effect by setting different exterior densities below and above the loop interior, and initiate the simulation using a kink-like velocity perturbation perpendicular to the loop plane, mimicking the frequently measured horizontally polarized kink modes. We find that the external velocity fields show fan blade structures propagating in the azimuthal direction as a result of the successive excitation of higher azimuthal Fourier modes. Resonant absorption and phase mixing can still occur despite an asymmetric environment, leading to the development of small scales at loop boundaries. These small scales nonetheless develop asymmetrically at the upper and lower boundaries due to the different gradients of the Alfven speed. These findings enrich our understanding of kink modes in coronal loops embedded within an asymmetric environment, providing insights helpful for future high-resolution observations.


title: A uGMRT search for radio emission from planets around evolved stars

abstract: In this work, we present the results from a study using the Giant Meterwave Radio Telescope (GMRT) to search for radio {emission} from planets around three evolved stars namely $\alpha$~Tau, $\beta$~UMi, and $\beta$~Gem. Both $\alpha$~Tau and $\beta$~UMi host massive $\sim$ 6 $M_J$ mass planets at about $\sim$1.4 au from the central star, while $\beta$~Gem is host to a 2.9 $M_J$ mass planet at 1.7 au from the host star. We observe $\alpha$~Tau and $\beta$~ UMi at two u(upgraded)GMRT bands; band~3 (250-500~MHz) and band~4 (550-900~MHz). We also analyzed the archival observations from $\beta$ Gem at 150~MHz from GMRT. We did not detect any radio signals from these systems. At 400~MHz, the 3$\sigma$ upper limit is 87 $\mu$Jy/beam for $\alpha$~Tau~{b} and 77.4 $\mu$Jy/beam for $\beta$~UMi~{b}. From our observations at 650~MHz, we place a 3$\sigma$ upper limit of 28.2 $\mu$Jy/beam for $\alpha$~Tau~b and 33.6 $\mu$Jy/beam for $\beta$~UMi~b. For $\beta$ Gem b, at 150~MHz, we place an upper limit of 2.5 mJy. At 400~MHz and 650~MHz, our observations are the deepest radio images for any exoplanetary system.


title: Materiality and Risk in the Age of Pervasive AI Sensors

abstract: Artificial intelligence systems connected to sensor-laden devices are becoming pervasive, which has significant implications for a range of AI risks, including to privacy, the environment, autonomy, and more. There is therefore a growing need for increased accountability around the responsible development and deployment of these technologies. In this paper, we provide a comprehensive analysis of the evolution of sensors, the risks they pose by virtue of their material existence in the world, and the impacts of ubiquitous sensing and on-device AI. We propose incorporating sensors into risk management frameworks and call for more responsible sensor and system design paradigms that address risks of such systems. To do so, we trace the evolution of sensors from analog devices to intelligent, networked systems capable of real-time data analysis and decision-making at the extreme edge of the network. We show that the proliferation of sensors is driven by calculative models that prioritize data collection and cost reduction and produce risks that emerge around privacy, surveillance, waste, and power dynamics. We then analyze these risks, highlighting issues of validity, safety, security, accountability, interpretability, and bias. We surface sensor-related risks not commonly captured in existing approaches to AI risk management, using a materiality lens that reveals how physical sensor properties shape data and algorithmic models. We conclude by advocating for increased attention to the materiality of algorithmic systems, and of on-device AI sensors in particular, and highlight the need for development of a responsible sensor design paradigm that empowers users and communities and leads to a future of increased fairness, accountability and transparency.


title: A modified version of the PRESB preconditioner for a class of non-Hermitian complex systems of linear equations

abstract: We present a modified version of the PRESB preconditioner for two-by-two block system of linear equations with the coefficient matrix $$\textbf{A}=\left(\begin{array}{cc} F & -G^* G & F \end{array}\right),$$ where $F\in\mathbb{C}^{n\times n}$ is Hermitian positive definite and $G\in\mathbb{C}^{n\times n}$ is positive semidefinite. Spectral analysis of the preconditioned matrix is analyzed. In each iteration of a Krylov subspace method, like GMRES, for solving the preconditioned system in conjunction with proposed preconditioner two subsystems with Hermitian positive definite coefficient matrix should be solved which can be accomplished exactly using the Cholesky factorization or inexactly utilizing the conjugate gradient method. Application of the proposed preconditioner to the systems arising from finite element discretization of PDE-constrained optimization problems is presented. Numerical results are given to demonstrate the efficiency of the preconditioner.


title: Minimally Supervised Topological Projections of Self-Organizing Maps for Phase of Flight Identification

abstract: Identifying phases of flight is important in the field of general aviation, as knowing which phase of flight data is collected from aircraft flight data recorders can aid in the more effective detection of safety or hazardous events. General aviation flight data for phase of flight identification is usually per-second data, comes on a large scale, and is class imbalanced. It is expensive to manually label the data and training classification models usually faces class imbalance problems. This work investigates the use of a novel method for minimally supervised self-organizing maps (MS-SOMs) which utilize nearest neighbor majority votes in the SOM U-matrix for class estimation. Results show that the proposed method can reach or exceed a naive SOM approach which utilized a full data file of labeled data, with only 30 labeled datapoints per class. Additionally, the minimally supervised SOM is significantly more robust to the class imbalance of the phase of flight data. These results highlight how little data is required for effective phase of flight identification.


title: Low-Dose CT Reconstruction Using Dataset-free Learning

abstract: Low-Dose computer tomography (LDCT) is an ideal alternative to reduce radiation risk in clinical applications. Although supervised-deep-learning-based reconstruction methods have demonstrated superior performance compared to conventional model-driven reconstruction algorithms, they require collecting massive pairs of low-dose and norm-dose CT images for neural network training, which limits their practical application in LDCT imaging. In this paper, we propose an unsupervised and training data-free learning reconstruction method for LDCT imaging that avoids the requirement for training data. The proposed method is a post-processing technique that aims to enhance the initial low-quality reconstruction results, and it reconstructs the high-quality images by neural work training that minimizes the $\ell_1$-norm distance between the CT measurements and their corresponding simulated sinogram data, as well as the total variation (TV) value of the reconstructed image. Moreover, the proposed method does not require to set the weights for both the data fidelity term and the plenty term. Experimental results on the AAPM challenge data and LoDoPab-CT data demonstrate that the proposed method is able to effectively suppress the noise and preserve the tiny structures. Also, these results demonstrate the rapid convergence and low computational cost of the proposed method. The source code is available at \url{https://github.com/linfengyu77/IRLDCT}.


title: LaCo: Large Language Model Pruning via Layer Collapse

abstract: Large language models (LLMs) based on transformer are witnessing a notable trend of size expansion, which brings considerable costs to both model training and inference. However, existing methods such as model quantization, knowledge distillation, and model pruning are constrained by various issues, including hardware support limitations, the need for extensive training, and alterations to the internal structure of the model. In this paper, we propose a concise layer-wise pruning method called \textit{Layer Collapse (LaCo)}, in which rear model layers collapse into a prior layer, enabling a rapid reduction in model size while preserving the model structure. Comprehensive experiments show that our method maintains an average task performance of over 80\% at pruning ratios of 25-30\%, significantly outperforming existing state-of-the-art structured pruning methods. We also conduct post-training experiments to confirm that the proposed pruning method effectively inherits the parameters of the original model. Finally, we discuss our motivation from the perspective of layer-wise similarity and evaluate the performance of the pruned LLMs across various pruning ratios.


title: AGN properties of ~1 million member galaxies of galaxy groups and clusters at z < 1.4 based on the Subaru Hyper Suprime-Cam survey

abstract: Herein, we present the statistical properties of active galactic nuclei (AGNs) for approximately 1 million member galaxies of galaxy groups and clusters, with 0.1 $<$ cluster redshift ($z_{\rm cl}$) $<$ 1.4, selected using Subaru Hyper Suprime-Cam, the so-called CAMIRA clusters. In this research, we focused on the AGN power fraction ($f_{\rm AGN}$), which is defined as the proportion of the contribution of AGNs to the total infrared (IR) luminosity, $L_{\rm IR}$ (AGN)/$L_{\rm IR}$, and examined how $f_{\rm AGN}$ depends on (i) $z_{\rm cl}$ and (ii) the distance from the cluster center. We compiled multiwavelength data using the ultraviolet--mid-IR range. Moreover, we performed spectral energy distribution fits to determine $f_{\rm AGN}$ using the CIGALE code with the SKIRTOR AGN model. We found that (i) the value of $f_{\rm AGN}$ in the CAMIRA clusters is positively correlated with $z_{\rm cl}$, with the correlation slope being steeper than that for field galaxies, and (ii) $f_{\rm AGN}$ exhibits a high value at the cluster outskirts. These results indicate that the emergence of AGN population depends on the redshift and environment and that galaxy groups and clusters at high redshifts are important in AGN evolution. Additionally, we demonstrated that cluster--cluster mergers may enhance AGN activity at the outskirts of particularly massive galaxy clusters. Our findings are consistent with a related study on the CAMIRA clusters that was based on the AGN number fraction.


title: Evolution of the Ratio of Mg II Intensities During Solar Flares

abstract: The Mg II k \& h line intensity ratios can be used to probe the characteristics of the plasma in the solar atmosphere. In this study, using the observations recorded by the Interface Region Imaging Spectrometer (IRIS), we study the variation of the Mg II k \& h intensity ratio for three flares belonging to X-class, M-class, and C-class, throughout their evolution. We also study the k-to-h intensity ratio as a function of magnetic flux density obtained from the line-of-sight magnetograms recorded by the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO). Our results reveal that while the intensity ratios are independent of magnetic flux density, they show significant changes during the evolution of the C-class and M-class flares. The intensity ratios start to increase at the start of the flare and peak during the impulsive phase before the flare peak and decrease rapidly thereafter. The values of the ratios fall even below the pre-flare level during the peak and decline phases of the flare. These results are important in light of the heating and cooling of localized plasma and provide further constraints on the understanding of flare physics.


title: Disclosure and Mitigation of Gender Bias in LLMs

abstract: Large Language Models (LLMs) can generate biased responses. Yet previous direct probing techniques contain either gender mentions or predefined gender stereotypes, which are challenging to comprehensively collect. Hence, we propose an indirect probing framework based on conditional generation. This approach aims to induce LLMs to disclose their gender bias even without explicit gender or stereotype mentions. We explore three distinct strategies to disclose explicit and implicit gender bias in LLMs. Our experiments demonstrate that all tested LLMs exhibit explicit and/or implicit gender bias, even when gender stereotypes are not present in the inputs. In addition, an increased model size or model alignment amplifies bias in most cases. Furthermore, we investigate three methods to mitigate bias in LLMs via Hyperparameter Tuning, Instruction Guiding, and Debias Tuning. Remarkably, these methods prove effective even in the absence of explicit genders or stereotypes.


title: Knowledge Graph Assisted Automatic Sports News Writing

abstract: In this paper, we present a novel method for automatically generating sports news, which employs a unique algorithm that extracts pivotal moments from live text broadcasts and uses them to create an initial draft of the news. This draft is further refined by incorporating key details and background information from a specially designed sports knowledge graph. This graph contains 5,893 entities, which are classified into three distinct conceptual categories, interconnected through four relationship types, and characterized by 27 unique attributes. In addition, we create a multi-stage learning model by combining convolutional neural networks and a transformer encoder. This model expresses entity-task interactions using convolutional neural networks and enriches entity representations in the query set with the transformer encoder. It also includes a processor to compute matching scores for incomplete triples, addressing few-shot knowledge graph completion problem. The efficiency of this approach has been confirmed through both subjective and objective evaluations of 50 selected test cases, demonstrating its capability in revolutionizing the creation of sports news.


title: I Learn Better If You Speak My Language: Understanding the Superior Performance of Fine-Tuning Large Language Models with LLM-Generated Responses

abstract: This paper explores an intriguing observation: fine-tuning a large language model (LLM) with responses generated by a LLM often yields better results than using responses generated by humans. We conduct an in-depth investigation to understand why this occurs. Contrary to the common belief that these instances is simply due to the more detailed nature of LLM-generated content, our study identifies another contributing factor: an LLM is inherently more "familiar" with LLM generated responses. This familiarity is evidenced by lower perplexity before fine-tuning. We design a series of experiments to understand the impact of the "familiarity" and our conclusion reveals that this "familiarity" significantly impacts learning performance. Training with LLM-generated responses not only enhances performance but also helps maintain the model's capabilities in other tasks after fine-tuning on a specific task.


title: Privacy Impact Assessments in the Wild: A Scoping Review

abstract: Privacy Impact Assessments (PIAs) offer a systematic process for assessing the privacy impacts of a project or system. As a privacy engineering strategy, PIAs are heralded as one of the main approaches to privacy by design, supporting the early identification of threats and controls. However, there is still a shortage of empirical evidence on their uptake and proven effectiveness in practice. To better understand the current state of literature and research, this paper provides a comprehensive Scoping Review (ScR) on the topic of PIAs "in the wild", following the well-established Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. As a result, this ScR includes 45 studies, providing an extensive synthesis of the existing body of knowledge, classifying types of research and publications, appraising the methodological quality of primary research, and summarising the positive and negative aspects of PIAs in practice, as reported by studies. This ScR also identifies significant research gaps (e.g., evidence gaps from contradictory results and methodological gaps from research design deficiencies), future research pathways, and implications for researchers, practitioners, and policymakers developing and evaluating PIA frameworks. As we conclude, there is still a significant need for more primary research on the topic, both qualitative and quantitative. A critical appraisal of qualitative studies (n=28) revealed deficiencies in the methodological quality, and only four quantitative studies were identified, suggesting that current primary research remains incipient. Nonetheless, PIAs can be regarded as a prominent sub-area in the broader field of Empirical Privacy Engineering, warranting further research toward more evidence-based practices.


title: Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering

abstract: Large Language Models (LLMs), excel in natural language understanding, but their capability for complex mathematical reasoning with an amalgamation of structured tables and unstructured text is uncertain. This study explores LLMs' mathematical reasoning on four financial tabular question-answering datasets: TATQA, FinQA, ConvFinQA, and Multihiertt. Through extensive experiments with various models and prompting techniques, we assess how LLMs adapt to complex tables and mathematical tasks. We focus on sensitivity to table complexity and performance variations with an increasing number of arithmetic reasoning steps. The results provide insights into LLMs' capabilities and limitations in handling complex mathematical scenarios for semi-structured tables. Ultimately, we introduce a novel prompting technique tailored to semi-structured documents, matching or outperforming other baselines in performance while providing a nuanced understanding of LLMs abilities for such a task.


title: Deep learning-enhanced paper-based vertical flow assay for high-sensitivity troponin detection using nanoparticle amplification

abstract: Successful integration of point-of-care testing (POCT) into clinical settings requires improved assay sensitivity and precision to match laboratory standards. Here, we show how innovations in amplified biosensing, imaging, and data processing, coupled with deep learning, can help improve POCT. To demonstrate the performance of our approach, we present a rapid and cost-effective paper-based high-sensitivity vertical flow assay (hs-VFA) for quantitative measurement of cardiac troponin I (cTnI), a biomarker widely used for measuring acute cardiac damage and assessing cardiovascular risk. The hs-VFA includes a colorimetric paper-based sensor, a portable reader with time-lapse imaging, and computational algorithms for digital assay validation and outlier detection. Operating at the level of a rapid at-home test, the hs-VFA enabled the accurate quantification of cTnI using 50 uL of serum within 15 min per test and achieved a detection limit of 0.2 pg/mL, enabled by gold ion amplification chemistry and time-lapse imaging. It also achieved high precision with a coefficient of variation of < 7% and a very large dynamic range, covering cTnI concentrations over six orders of magnitude, up to 100 ng/mL, satisfying clinical requirements. In blinded testing, this computational hs-VFA platform accurately quantified cTnI levels in patient samples and showed a strong correlation with the ground truth values obtained by a benchtop clinical analyzer. This nanoparticle amplification-based computational hs-VFA platform can democratize access to high-sensitivity point-of-care diagnostics and provide a cost-effective alternative to laboratory-based biomarker testing.


title: Maintaining Adversarial Robustness in Continuous Learning

abstract: Adversarial robustness is essential for security and reliability of machine learning systems. However, the adversarial robustness gained by sophisticated defense algorithms is easily erased as the neural network evolves to learn new tasks. This vulnerability can be addressed by fostering a novel capability for neural networks, termed continual robust learning, which focuses on both the (classification) performance and adversarial robustness on previous tasks during continuous learning. To achieve continuous robust learning, we propose an approach called Double Gradient Projection that projects the gradients for weight updates orthogonally onto two crucial subspaces -- one for stabilizing the smoothed sample gradients and another for stabilizing the final outputs of the neural network. The experimental results on four benchmarks demonstrate that the proposed approach effectively maintains continuous robustness against strong adversarial attacks, outperforming the baselines formed by combining the existing defense strategies and continual learning methods.


title: Centroid-Based Efficient Minimum Bayes Risk Decoding

abstract: Minimum Bayes risk (MBR) decoding achieved state-of-the-art translation performance by using COMET, a neural metric that has a high correlation with human evaluation. However, MBR decoding requires quadratic time since it computes the expected score between a translation hypothesis and all reference translations. We propose centroid-based MBR (CBMBR) decoding to improve the speed of MBR decoding. Our method clusters the reference translations in the feature space, and then calculates the score using the centroids of each cluster. The experimental results show that our CBMBR not only improved the decoding speed of the expected score calculation 5.7 times, but also outperformed vanilla MBR decoding in translation quality by up to 0.5 COMET in the WMT'22 En$\leftrightarrow$Ja, En$\leftrightarrow$De, En$\leftrightarrow$Zh, and WMT'23 En$\leftrightarrow$Ja translation tasks.


title: Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients

abstract: Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based algorithms have gained substantial popularity in FL to reduce the communication overhead, where each client conducts multiple localized iterations before communicating with a central server. In this paper, we focus on FL where the clients have diverse computation and/or communication capabilities. Under this circumstance, FedAvg can be less efficient since it requires all clients that participate in the global aggregation in a round to initiate iterations from the latest global model, and thus the synchronization among fast clients and straggler clients can severely slow down the overall training process. To address this issue, we propose an efficient asynchronous federated learning (AFL) framework called Delayed Federated Averaging (DeFedAvg). In DeFedAvg, the clients are allowed to perform local training with different stale global models at their own paces. Theoretical analyses demonstrate that DeFedAvg achieves asymptotic convergence rates that are on par with the results of FedAvg for solving nonconvex problems. More importantly, DeFedAvg is the first AFL algorithm that provably achieves the desirable linear speedup property, which indicates its high scalability. Additionally, we carry out extensive numerical experiments using real datasets to validate the efficiency and scalability of our approach when training deep neural networks.


title: Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge Graphs

abstract: Large language models (LLMs) demonstrate strong reasoning abilities when prompted to generate chain-of-thought (CoT) explanations alongside answers. However, previous research on evaluating LLMs has solely focused on answer accuracy, neglecting the correctness of the generated CoT. In this paper, we delve deeper into the CoT reasoning capabilities of LLMs in multi-hop question answering by utilizing knowledge graphs (KGs). We propose a novel discriminative and generative CoT evaluation paradigm to assess LLMs' knowledge of reasoning and the accuracy of the generated CoT. Through experiments conducted on 5 different families of LLMs across 2 multi-hop question-answering datasets, we find that LLMs possess sufficient knowledge to perform reasoning. However, there exists a significant disparity between answer accuracy and faithfulness of the CoT reasoning generated by LLMs, indicating that they often arrive at correct answers through incorrect reasoning.


title: Contraction of Markovian Operators in Orlicz Spaces and Error Bounds for Markov Chain Monte Carlo

abstract: We introduce a novel concept of convergence for Markovian processes within Orlicz spaces, extending beyond the conventional approach associated with $L_p$ spaces. After showing that Markovian operators are contractive in Orlicz spaces, our key technical contribution is an upper bound on their contraction coefficient, which admits a closed-form expression. The bound is tight in some settings, and it recovers well-known results, such as the connection between contraction and ergodicity, ultra-mixing and Doeblin's minorisation. Specialising our approach to $L_p$ spaces leads to a significant improvement upon classical Riesz-Thorin's interpolation methods. Furthermore, by exploiting the flexibility offered by Orlicz spaces, we can tackle settings where the stationary distribution is heavy-tailed, a severely under-studied setup. As an application of the framework put forward in the paper, we introduce tighter bounds on the mixing time of Markovian processes, better exponential concentration bounds for MCMC methods, and better lower bounds on the burn-in period. To conclude, we show how our results can be used to prove the concentration of measure phenomenon for a sequence of Markovian random variables.


title: A Decoding Scheme with Successive Aggregation of Multi-Level Features for Light-Weight Semantic Segmentation

abstract: Multi-scale architecture, including hierarchical vision transformer, has been commonly applied to high-resolution semantic segmentation to deal with computational complexity with minimum performance loss. In this paper, we propose a novel decoding scheme for semantic segmentation in this regard, which takes multi-level features from the encoder with multi-scale architecture. The decoding scheme based on a multi-level vision transformer aims to achieve not only reduced computational expense but also higher segmentation accuracy, by introducing successive cross-attention in aggregation of the multi-level features. Furthermore, a way to enhance the multi-level features by the aggregated semantics is proposed. The effort is focused on maintaining the contextual consistency from the perspective of attention allocation and brings improved performance with significantly lower computational cost. Set of experiments on popular datasets demonstrates superiority of the proposed scheme to the state-of-the-art semantic segmentation models in terms of computational cost without loss of accuracy, and extensive ablation studies prove the effectiveness of ideas proposed.


title: Towards Scalability and Extensibility of Query Reformulation Modeling in E-commerce Search

abstract: Customer behavioral data significantly impacts e-commerce search systems. However, in the case of less common queries, the associated behavioral data tends to be sparse and noisy, offering inadequate support to the search mechanism. To address this challenge, the concept of query reformulation has been introduced. It suggests that less common queries could utilize the behavior patterns of their popular counterparts with similar meanings. In Amazon product search, query reformulation has displayed its effectiveness in improving search relevance and bolstering overall revenue. Nonetheless, adapting this method for smaller or emerging businesses operating in regions with lower traffic and complex multilingual settings poses the challenge in terms of scalability and extensibility. This study focuses on overcoming this challenge by constructing a query reformulation solution capable of functioning effectively, even when faced with limited training data, in terms of quality and scale, along with relatively complex linguistic characteristics. In this paper we provide an overview of the solution implemented within Amazon product search infrastructure, which encompasses a range of elements, including refining the data mining process, redefining model training objectives, and reshaping training strategies. The effectiveness of the proposed solution is validated through online A/B testing on search ranking and Ads matching. Notably, employing the proposed solution in search ranking resulted in 0.14% and 0.29% increase in overall revenue in Japanese and Hindi cases, respectively, and a 0.08\% incremental gain in the English case compared to the legacy implementation; while in search Ads matching led to a 0.36% increase in Ads revenue in the Japanese case.


title: Exploring ChatGPT for Next-generation Information Retrieval: Opportunities and Challenges

abstract: The rapid advancement of artificial intelligence (AI) has highlighted ChatGPT as a pivotal technology in the field of information retrieval (IR). Distinguished from its predecessors, ChatGPT offers significant benefits that have attracted the attention of both the industry and academic communities. While some view ChatGPT as a groundbreaking innovation, others attribute its success to the effective integration of product development and market strategies. The emergence of ChatGPT, alongside GPT-4, marks a new phase in Generative AI, generating content that is distinct from training examples and exceeding the capabilities of the prior GPT-3 model by OpenAI. Unlike the traditional supervised learning approach in IR tasks, ChatGPT challenges existing paradigms, bringing forth new challenges and opportunities regarding text quality assurance, model bias, and efficiency. This paper seeks to examine the impact of ChatGPT on IR tasks and offer insights into its potential future developments.


title: Predicting Superconducting Transition Temperature through Advanced Machine Learning and Innovative Feature Engineering

abstract: Superconductivity is a remarkable phenomenon in condensed matter physics, which comprises a fascinating array of properties expected to revolutionize energy-related technologies and pertinent fundamental research. However, the field faces the challenge of achieving superconductivity at room temperature. In recent years, Artificial Intelligence (AI) approaches have emerged as a promising tool for predicting such properties as transition temperature (Tc) to enable the rapid screening of large databases to discover new superconducting materials. This study employs the SuperCon dataset as the largest superconducting materials dataset. Then, we perform various data pre-processing steps to derive the clean DataG dataset, containing 13022 compounds. In another stage of the study, we apply the novel CatBoost algorithm to predict the transition temperatures of novel superconducting materials. In addition, we developed a package called Jabir, which generates 322 atomic descriptors. We also designed an innovative hybrid method called Soraya package to select the most critical features from the feature space. These yield R2 and RMSE values (0.952 and 6.45 K, respectively) superior to those previously reported in the literature. Finally, as a novel contribution to the field, a web application was designed for predicting and determining the Tc values of superconducting materials.


title: An Efficient Quantum Circuit for Block Encoding a Pairing Hamiltonian

abstract: We present an efficient quantum circuit for block encoding pairing Hamiltonian often studied in nuclear physics. Our block encoding scheme does not require mapping the creation and annihilation operators to the Pauli operators and representing the Hamiltonian as a linear combination of unitaries. Instead, we show how to encode the Hamiltonian directly using controlled swap operations. We analyze the gate complexity of the block encoding circuit and show that it scales polynomially with respect to the number of qubits required to represent a quantum state associated with the pairing Hamiltonian. We also show how the block encoding circuit can be combined with the quantum singular value transformation to construct an efficient quantum circuit for approximating the density of states of a pairing Hamiltonian. The techniques presented can be extended to encode more general second-quantized Hamiltonians.


title: Hand Biometrics in Digital Forensics

abstract: Digital forensic is now an unavoidable part for securing the digital world from identity theft. Higher order of crimes, dealing with a massive database is really very challenging problem for any intelligent system. Biometric is a better solution to win over the problems encountered by digital forensics. Many biometric characteristics are playing their significant roles in forensics over the decades. The potential benefits and scope of hand based modes in forensics have been investigated with an illustration of hand geometry verifi-cation method. It can be applied when effective biometric evidences are properly unavailable; gloves are damaged, and dirt or any kind of liquid can minimize the accessibility and reliability of the fingerprint or palmprint. Due to the crisis of pure uniqueness of hand features for a very large database, it may be relevant for verification only. Some unimodal and multimodal hand based biometrics (e.g. hand geometry, palmprint and hand vein) with several feature extractions, database and verification methods have been discussed with 2D, 3D and infrared images.


title: Search for the production of deuterons and antideuterons in e^+e^- annihilation at center-of-mass energies between 4.13 and 4.70 GeV

abstract: Using a data sample of $e^+e^-$ collision data corresponding to an integrated luminosity of 19 fb$^{-1}$ collected with the BESIII detector at the BEPCII collider, we search for the production of deuterons and antideuterons via $e^+e^-\to pp\pi^-\bar{d}+c.c.$ for the first time at center-of-mass energies between 4.13 and 4.70 GeV. No significant signal is observed and the upper limit of the $e^+e^-\to pp\pi^-\bar{d}+c.c.$ cross section is determined to be from 9.0 to 145 fb depending on the center-of-mass energy at the $90\%$ confidence level.


title: Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents

abstract: Leveraging the rapid development of Large Language Models LLMs, LLM-based agents have been developed to handle various real-world applications, including finance, healthcare, and shopping, etc. It is crucial to ensure the reliability and security of LLM-based agents during applications. However, the safety issues of LLM-based agents are currently under-explored. In this work, we take the first step to investigate one of the typical safety threats, backdoor attack, to LLM-based agents. We first formulate a general framework of agent backdoor attacks, then we present a thorough analysis on the different forms of agent backdoor attacks. Specifically, from the perspective of the final attacking outcomes, the attacker can either choose to manipulate the final output distribution, or only introduce malicious behavior in the intermediate reasoning process, while keeping the final output correct. Furthermore, the former category can be divided into two subcategories based on trigger locations: the backdoor trigger can be hidden either in the user query or in an intermediate observation returned by the external environment. We propose the corresponding data poisoning mechanisms to implement the above variations of agent backdoor attacks on two typical agent tasks, web shopping and tool utilization. Extensive experiments show that LLM-based agents suffer severely from backdoor attacks, indicating an urgent need for further research on the development of defenses against backdoor attacks on LLM-based agents. Warning: This paper may contain biased content.


title: When Simple is Near-Optimal in Security Games

abstract: Fraudulent or illegal activities are ubiquitous across applications and involve users bypassing the rule of law, often with the strategic aim of obtaining some benefit that would otherwise be unattainable within the bounds of lawful conduct. However, user fraud is detrimental, as it may compromise safety or impose disproportionate negative externalities on particular population groups. To mitigate the potential harms of user fraud, we study the problem of policing such fraud as a security game between an administrator and users. In this game, an administrator deploys $R$ security resources (e.g., police officers) across $L$ locations and levies fines against users engaging in fraud at those locations. For this security game, we study both welfare and revenue maximization administrator objectives. In both settings, we show that computing the optimal administrator strategy is NP-hard and develop natural greedy algorithm variants for the respective settings that achieve at least half the welfare or revenue as the welfare-maximizing or revenue-maximizing solutions, respectively. We also establish a resource augmentation guarantee that our proposed greedy algorithms with one extra resource, i.e., $R+1$ resources, achieve at least the same welfare (revenue) as the welfare-maximizing (revenue-maximizing) outcome with $R$ resources. Finally, since the welfare and revenue-maximizing solutions can differ significantly, we present a framework inspired by contract theory, wherein a revenue-maximizing administrator is compensated through contracts for the welfare it contributes. Beyond extending our theoretical results in the welfare and revenue maximization settings to studying equilibrium strategies in the contract game, we also present numerical experiments highlighting the efficacy of contracts in bridging the gap between the revenue and welfare-maximizing administrator outcomes.


title: Surface mobility gradient and emergent facilitation in glassy films

abstract: Confining glassy polymer into films can substantially modify their local and film-averaged properties. We present a lattice model of film geometry with void-mediated facilitation behaviors but free from any elasticity effect. We analyze the spatially varying viscosity to delineate the transport property of glassy films. The film mobility measurements reported by [Yang et. al., Science, 2010, 328, 1676] are successfully reproduced. The flow exhibits a crossover from simple viscous flow to a surface-dominated regime as temperature decreases. The propagation of a highly mobile front induced by the free surface is visualized in real space. Our approach provides a microscopic treatment of the observed glassy phenomena.


title: Training-free image style alignment for self-adapting domain shift on handheld ultrasound devices

abstract: Handheld ultrasound devices face usage limitations due to user inexperience and cannot benefit from supervised deep learning without extensive expert annotations. Moreover, the models trained on standard ultrasound device data are constrained by training data distribution and perform poorly when directly applied to handheld device data. In this study, we propose the Training-free Image Style Alignment (TISA) framework to align the style of handheld device data to those of standard devices. The proposed TISA can directly infer handheld device images without extra training and is suited for clinical applications. We show that TISA performs better and more stably in medical detection and segmentation tasks for handheld device data. We further validate TISA as the clinical model for automatic measurements of spinal curvature and carotid intima-media thickness. The automatic measurements agree well with manual measurements made by human experts and the measurement errors remain within clinically acceptable ranges. We demonstrate the potential for TISA to facilitate automatic diagnosis on handheld ultrasound devices and expedite their eventual widespread use.


title: Equivariant (co)module nuclearity of $C^*$-crossed products

abstract: We define an equivariant and equicovariant versions of the notion of module nuclearity. More precisely, for a discrete group $\Gamma$ and operator $\mathcal A$-$\Gamma$-(co)module $\mathcal B$, $\mathcal E$ over a $\Gamma$-C$^*$-algebra $\mathcal A$, we define $\mathcal E$-$\Gamma$-nuclearity of $\mathcal B$, as an equivariant version of the notion of $\mathcal E$-nuclearity, in which the identity map on $\mathcal B$ is required to be approximately factored through matrix algebras on $\mathcal E$ with module structures coming both from the original module structure of $\mathcal E$ and the $\Gamma$-action on $\mathcal E$. For trivial actions of $\Gamma$, this is shown to reduce to the notion of module nuclearity, introduced and studied by the first author. As a concrete example, for a discrete group $\Gamma$ acting amenably on a unital C$^*$-algebra $\mathcal A$, we show that the reduced crossed product $\mathcal A\rtimes_{r} \Gamma$ is $\mathcal A$-$\Gamma$-nuclear. Conversely, if $\mathcal A$ is a nuclear C$^*$-algebra with a $\Gamma$-invariant state $\rho$ and $\mathcal A\rtimes_{r} \Gamma$ is $\mathcal A$-$\Gamma$-nuclear, then we deduce that $\Gamma$ is amenable. We show that when $\mathcal A\rtimes_{r} \Gamma$ is $\mathcal A$-$\Gamma$-nuclear and $\mathcal A$ has the completely bounded approximation property (resp., is exact), then so is $\mathcal A\rtimes_{r} \Gamma$. We prove similar results for $\mathcal A\rtimes_{r} \Gamma$, regarded as an $\mathcal A$-$\Gamma$-comodule.


title: On resolvability and tightness in uncountable spaces

abstract: We investigate connections between resolvability and different forms of tightness. This study is adjacent to [1,2]. We construct a non-regular refinement $\tau^*$ of the natural topology of the real line $\mathbb{R}$ with properties such that the space $(\mathbb{R}, \tau^*)$ has a hereditary nowhere dense tightness and it has no $\omega_1$-resolvable subspaces, whereas $\Delta(\mathbb{R}, \tau^*) = \frak{c}$. We also show that the proof of the main result of [1], being slightly modified, leads to the following strengthening: if $L$ is a Hausdorff space of countable character and the space $L^\omega$ is c.c.c., then every submaximal dense subspace of $L^\kappa$ has disjoint tightness. As a corollary, for every $\kappa \geq \omega$ there is a Tychonoff submaximal space $X$ such that $|X|=\Delta(X)=\kappa$ and $X$ has disjoint tightness.


title: On the Fredholm determinant of the confluent hypergeometric kernel with discontinuities

abstract: We consider the determinantal point process with the confluent hypergeometric kernel. This process is a universal point process in random matrix theory and describes the distribution of eigenvalues of large random Hermitian matrices near the Fisher-Hartwig singularity. Applying the Riemann-Hilbert method, we study the generating function of this process on any given number of intervals. It can be expressed as the Fredholm determinant of the confluent hypergeometric kernel with $n$ discontinuities. In this paper, we derive an integral representation for the determinant by using the Hamiltonian of the coupled Painlev\'e V system. By evaluating the total integral of the Hamiltonian, we obtain the asymptotics of the determinant as the $n$ discontinuities tend to infinity up to and including the constant term. Here the constant term is expressed in terms of the Barnes $G$-function.


title: AdAdaGrad: Adaptive Batch Size Schemes for Adaptive Gradient Methods

abstract: The choice of batch sizes in minibatch stochastic gradient optimizers is critical in large-scale model training for both optimization and generalization performance. Although large-batch training is arguably the dominant training paradigm for large-scale deep learning due to hardware advances, the generalization performance of the model deteriorates compared to small-batch training, leading to the so-called "generalization gap" phenomenon. To mitigate this, we investigate adaptive batch size strategies derived from adaptive sampling methods, originally developed only for stochastic gradient descent. Given the significant interplay between learning rates and batch sizes, and considering the prevalence of adaptive gradient methods in deep learning, we emphasize the need for adaptive batch size strategies in these contexts. We introduce AdAdaGrad and its scalar variant AdAdaGradNorm, which progressively increase batch sizes during training, while model updates are performed using AdaGrad and AdaGradNorm. We prove that AdAdaGradNorm converges with high probability at a rate of $\mathscr{O}(1/K)$ to find a first-order stationary point of smooth nonconvex functions within $K$ iterations. AdAdaGrad also demonstrates similar convergence properties when integrated with a novel coordinate-wise variant of our adaptive batch size strategies. We corroborate our theoretical claims by performing image classification experiments, highlighting the merits of the proposed schemes in terms of both training efficiency and model generalization. Our work unveils the potential of adaptive batch size strategies for adaptive gradient optimizers in large-scale model training.


title: Feedback Delay Network Optimization

abstract: A common bane of artificial reverberation algorithms is spectral coloration, typically manifesting as metallic ringing, leading to a degradation in the perceived sound quality. This paper presents an optimization framework where a differentiable feedback delay network is used to learn a set of parameters to reduce coloration iteratively. The parameters under optimization include the feedback matrix, as well as the input and output gains. The optimization objective is twofold: to maximize spectral flatness through a spectral loss while maintaining temporal density by penalizing sparseness in the parameter values. A favorable narrower distribution of modal excitation is achieved while maintaining the desired impulse response density. In a subjective assessment, the new method proves effective in reducing perceptual coloration of late reverberation. The proposed method achieves computational savings compared to the baseline while preserving its performance. The effectiveness of this work is demonstrated through two application scenarios where natural-sounding synthetic impulse responses are obtained via the introduction of attenuation filters and an optimizable scattering feedback matrix.


title: Asclepius: A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Models

abstract: The significant breakthroughs of Medical Multi-Modal Large Language Models (Med-MLLMs) renovate modern healthcare with robust information synthesis and medical decision support. However, these models are often evaluated on benchmarks that are unsuitable for the Med-MLLMs due to the intricate nature of the real-world diagnostic frameworks, which encompass diverse medical specialties and involve complex clinical decisions. Moreover, these benchmarks are susceptible to data leakage, since Med-MLLMs are trained on large assemblies of publicly available data. Thus, an isolated and clinically representative benchmark is highly desirable for credible Med-MLLMs evaluation. To this end, we introduce Asclepius, a novel Med-MLLM benchmark that rigorously and comprehensively assesses model capability in terms of: distinct medical specialties (cardiovascular, gastroenterology, etc.) and different diagnostic capacities (perception, disease analysis, etc.). Grounded in 3 proposed core principles, Asclepius ensures a comprehensive evaluation by encompassing 15 medical specialties, stratifying into 3 main categories and 8 sub-categories of clinical tasks, and exempting from train-validate contamination. We further provide an in-depth analysis of 6 Med-MLLMs and compare them with 5 human specialists, providing insights into their competencies and limitations in various medical contexts. Our work not only advances the understanding of Med-MLLMs' capabilities but also sets a precedent for future evaluations and the safe deployment of these models in clinical environments. We launch and maintain a leaderboard for community assessment of Med-MLLM capabilities (https://asclepius-med.github.io/).


title: Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs

abstract: Controlled Text Generation (CTG) aims to produce texts that exhibit specific desired attributes. In this study, we introduce a pluggable CTG framework for Large Language Models (LLMs) named Dynamic Attribute Graphs-based controlled text generation (DATG). This framework utilizes an attribute scorer to evaluate the attributes of sentences generated by LLMs and constructs dynamic attribute graphs. DATG modulates the occurrence of key attribute words and key anti-attribute words, achieving effective attribute control without compromising the original capabilities of the model. We conduct experiments across four datasets in two tasks: toxicity mitigation and sentiment transformation, employing five LLMs as foundational models. Our findings highlight a remarkable enhancement in control accuracy, achieving a peak improvement of 19.29% over baseline methods in the most favorable task across four datasets. Additionally, we observe a significant decrease in perplexity, markedly improving text fluency.


title: Estimators for multivariate allometric regression model

abstract: In a regression model with multiple response variables and multiple explanatory variables, if the difference of the mean vectors of the response variables for different values of explanatory variables is always in the direction of the first principal eigenvector of the covariance matrix of the response variables, then it is called a multivariate allometric regression model. This paper studies the estimation of the first principal eigenvector in the multivariate allometric regression model. A class of estimators that includes conventional estimators is proposed based on weighted sum-of-squares matrices of regression sum-of-squares matrix and residual sum-of-squares matrix. We establish an upper bound of the mean squared error of the estimators contained in this class, and the weight value minimizing the upper bound is derived. Sufficient conditions for the consistency of the estimators are discussed in weak identifiability regimes under which the difference of the largest and second largest eigenvalues of the covariance matrix decays asymptotically and in ``large $p$, large $n$" regimes, where $p$ is the number of response variables and $n$ is the sample size. Several numerical results are also presented.


title: Peering into cosmic reionization: the Ly$\alpha$ visibility evolution from galaxies at $z$ = 4.5-8.5 with JWST

abstract: The resonant scattering interaction between Ly$\alpha$ photons and neutral hydrogen implies that a partially neutral IGM can significantly impact the detectability of Ly$\alpha$ emission in galaxies. The redshift evolution of the Ly$\alpha$ equivalent width distribution of galaxies thus offers a key probe of the degree of ionization during the Epoch of Reionization (EoR). Previous in-depth investigations at $z$ $\geq$ 7 were limited by ground-based instrument capabilities. We present an extensive study of Ly$\alpha$ emission from galaxies at 4 < $z$ < 8.5, observed from the CEERS and JADES surveys in the JWST NIRSpec/PRISM configuration. The sample consists of 235 galaxies, among which we identify 65 as Ly$\alpha$ emitters. We first measure Ly$\alpha$ escape fractions from Balmer lines, and explore the correlations with the inferred galaxies' physical properties, which are similar to those found at lower redshift. We also investigate the possible connection between the escape of Ly$\alpha$ photons and the inferred escape fractions of LyC photons obtained from indirect indicators. We then analyze the redshift evolution of the Ly$\alpha$ emitter fraction, finding lower average values at $z$ = 5 and 6 compared to ground-based observations. At $z$ = 7 we find a very large difference in Ly$\alpha$ visibility between the EGS and GOODS-South fields, possibly due to the presence of early reionized regions in the EGS. Such large variance is also expected in the Cosmic Dawn II radiation-hydrodynamical simulation. Our findings suggest a scenario in which the ending phase of the EoR is characterized by $\sim$ 1 pMpc ionized bubbles around a high fraction of moderately bright galaxies. Finally, we characterize such two ionized regions found in the EGS at $z$ = 7.18 and $z$ = 7.49 by estimating the radius of the ionized bubble that each of the spectroscopically-confirmed members could have created.


title: MOB-Net: Limb-modularized Uncertainty Torque Learning of Humanoids for Sensorless External Torque Estimation

abstract: Momentum observer (MOB) can estimate external joint torque without requiring additional sensors, such as force/torque or joint torque sensors. However, the estimation performance of MOB deteriorates due to the model uncertainty which encompasses the modeling errors and the joint friction. Moreover, the estimation error is significant when MOB is applied to high-dimensional floating-base humanoids, which prevents the estimated external joint torque from being used for force control or collision detection in the real humanoid robot. In this paper, the pure external joint torque estimation method named MOB-Net, is proposed for humanoids. MOB-Net learns the model uncertainty torque and calibrates the estimated signal of MOB. The external joint torque can be estimated in the generalized coordinate including whole-body and virtual joints of the floating-base robot with only internal sensors (an IMU on the pelvis and encoders in the joints). Our method substantially reduces the estimation errors of MOB, and the robust performance of MOB-Net for the unseen data is validated through extensive simulations, real robot experiments, and ablation studies. Finally, various collision handling scenarios are presented using the estimated external joint torque from MOB-Net: contact wrench feedback control for locomotion, collision detection, and collision reaction for safety.


title: Treewidth versus clique number. IV. Tree-independence number of graphs excluding an induced star

abstract: Many recent works address the question of characterizing induced obstructions to bounded treewidth. In 2022, Lozin and Razgon completely answered this question for graph classes defined by finitely many forbidden induced subgraphs. Their result also implies a characterization of graph classes defined by finitely many forbidden induced subgraphs that are $(tw,\omega)$-bounded, that is, treewidth can only be large due to the presence of a large clique. This condition is known to be satisfied for any graph class with bounded tree-independence number, a graph parameter introduced independently by Yolov in 2018 and by Dallard, Milani\v{c}, and \v{S}torgel in 2024. Dallard et al. conjectured that $(tw,\omega)$-boundedness is actually equivalent to bounded tree-independence number. We address this conjecture in the context of graph classes defined by finitely many forbidden induced subgraphs and prove it for the case of graph classes excluding an induced star. We also prove it for subclasses of the class of line graphs, determine the exact values of the tree-independence numbers of line graphs of complete graphs and line graphs of complete bipartite graphs, and characterize the tree-independence number of $P_4$-free graphs, which implies a linear-time algorithm for its computation. Applying the algorithmic framework provided in a previous paper of the series leads to polynomial-time algorithms for the Maximum Weight Independent Set problem in an infinite family of graph classes.


title: HEAL: Brain-inspired Hyperdimensional Efficient Active Learning

abstract: Drawing inspiration from the outstanding learning capability of our human brains, Hyperdimensional Computing (HDC) emerges as a novel computing paradigm, and it leverages high-dimensional vector presentation and operations for brain-like lightweight Machine Learning (ML). Practical deployments of HDC have significantly enhanced the learning efficiency compared to current deep ML methods on a broad spectrum of applications. However, boosting the data efficiency of HDC classifiers in supervised learning remains an open question. In this paper, we introduce Hyperdimensional Efficient Active Learning (HEAL), a novel Active Learning (AL) framework tailored for HDC classification. HEAL proactively annotates unlabeled data points via uncertainty and diversity-guided acquisition, leading to a more efficient dataset annotation and lowering labor costs. Unlike conventional AL methods that only support classifiers built upon deep neural networks (DNN), HEAL operates without the need for gradient or probabilistic computations. This allows it to be effortlessly integrated with any existing HDC classifier architecture. The key design of HEAL is a novel approach for uncertainty estimation in HDC classifiers through a lightweight HDC ensemble with prior hypervectors. Additionally, by exploiting hypervectors as prototypes (i.e., compact representations), we develop an extra metric for HEAL to select diverse samples within each batch for annotation. Our evaluation shows that HEAL surpasses a diverse set of baselines in AL quality and achieves notably faster acquisition than many BNN-powered or diversity-guided AL methods, recording 11 times to 40,000 times speedup in acquisition runtime per batch.


title: Neural Networks with (Low-Precision) Polynomial Approximations: New Insights and Techniques for Accuracy Improvement

abstract: Replacing non-polynomial functions (e.g., non-linear activation functions such as ReLU) in a neural network with their polynomial approximations is a standard practice in privacy-preserving machine learning. The resulting neural network, called polynomial approximation of neural network (PANN) in this paper, is compatible with advanced cryptosystems to enable privacy-preserving model inference. Using ``highly precise'' approximation, state-of-the-art PANN offers similar inference accuracy as the underlying backbone model. However, little is known about the effect of approximation, and existing literature often determined the required approximation precision empirically. In this paper, we initiate the investigation of PANN as a standalone object. Specifically, our contribution is two-fold. Firstly, we provide an explanation on the effect of approximate error in PANN. In particular, we discovered that (1) PANN is susceptible to some type of perturbations; and (2) weight regularisation significantly reduces PANN's accuracy. We support our explanation with experiments. Secondly, based on the insights from our investigations, we propose solutions to increase inference accuracy for PANN. Experiments showed that combination of our solutions is very effective: at the same precision, our PANN is 10% to 50% more accurate than state-of-the-arts; and at the same accuracy, our PANN only requires a precision of 2^{-9} while state-of-the-art solution requires a precision of 2^{-12} using the ResNet-20 model on CIFAR-10 dataset.


title: Variants of Bernstein's theorem for variational integrals with linear and nearly linear growth

abstract: Using a Caccioppoli-type inequality involving negative exponents for a directional weight we establish variants of Bernstein's theorem for variational integrals with linear and nearly linear growth. We give some mild conditions for entire solutions of the equation \[ {\rm div} \Big[Df(\nabla u)\Big] = 0 \, , \] under which solutions have to be affine functions. Here $f$ is a smooth energy density satisfying $D^2 f>0$ together with a natural growth condition for $D^2 f$.


title: The $n+3$, $n+4$ dimensional homotopy groups of $\mathbf{A}_n^2$-complexes

abstract: In this paper, we calculate the $n+3$, $n+4$ dimensional homotopy groups of indecomposable $\mathbf{A}_n^2$-complexes after localization at 2. This job is seen as a sequel to P.J. Hilton's work on the $n+1,n+2$ dimensional homotopy groups of $\mathbf{A}_n^2$-complexes (1950-1951). The main technique used is analysing the homotopy property of $J(X,A)$, defined by B. Gray for a CW-pair $(X,A)$, which is homotopy equivalent to the homotopy fibre of the pinch map $X\cup CA\rightarrow \Sigma A$. By the way, the results of these homotopy groups have been used to make progress on recent popular topic about the homotopy decomposition of the (multiple) suspension of oriented closed manifolds.


title: On the Role of Similarity in Detecting Masquerading Files

abstract: Similarity has been applied to a wide range of security applications, typically used in machine learning models. We examine the problem posed by masquerading samples; that is samples crafted by bad actors to be similar or near identical to legitimate samples. We find that these samples potentially create significant problems for machine learning solutions. The primary problem being that bad actors can circumvent machine learning solutions by using masquerading samples. We then examine the interplay between digital signatures and machine learning solutions. In particular, we focus on executable files and code signing. We offer a taxonomy for masquerading files. We use a combination of similarity and clustering to find masquerading files. We use the insights gathered in this process to offer improvements to similarity based and machine learning security solutions.