title: Towards Precision Photometric Type Ia Supernova Cosmology with Machine Learning

abstract: The revolutionary discovery of dark energy and accelerating cosmic expansion was made with just 42 type Ia supernovae (SNe Ia) in 1999. Since then, large synoptic surveys, e.g., Dark Energy Survey (DES), have observed thousands more SNe Ia and the upcoming Rubin Legacy Survey of Space and Time (LSST) and Roman Space Telescope promise to deliver millions in the next decade. This unprecedented data volume can be used to test concordance cosmology. However, extracting a pure SN Ia sample with accurate redshifts for such a large dataset will be a challenge. Spectroscopic classification will not be possible for the vast majority of discovered objects, and only 25% will have spectroscopic redshifts. This thesis presents a series of observational and methodological studies designed to address the questions associated with this new era of photometric SN Ia cosmology. First, we present a machine learning (ML) method for SN photometric classification, SCONE. Photometric classification enables SNe with no spectroscopic information to be categorized, a critical step for cosmological analysis. SCONE achieves 99+% accuracy distinguishing simulated SNe Ia from non-Ia SNe, and is a part of DES, LSST, and Roman analysis pipelines. We also show that SCONE can classify 6 SN types with 75% accuracy on the night of initial discovery, comparable to results in the literature for full-phase SNe. Next, we study current methods for estimating SN Ia redshifts and propose an ML alternative that uses SN photometry alone to extract redshift information. Photo-zSNthesis is a host galaxy-independent redshift estimator accurate to within 2% across the redshift range of LSST, a first in the literature. Finally, we focus on ML robustness and demonstrate a general method for improving robustness that achieves new state-of-the-art results on astronomical object classification, wildlife identification, and tumor detection.


title: A general framework for floating point error analysis of simplex derivatives

abstract: Gradient approximations are a class of numerical approximation techniques that are of central importance in numerical optimization. In derivative-free optimization, most of the gradient approximations, including the simplex gradient, centred simplex gradient, and adapted centred simplex gradient, are in the form of simplex derivatives. Owing to machine precision, the approximation accuracy of any numerical approximation technique is subject to the influence of floating point errors. In this paper, we provide a general framework for floating point error analysis of simplex derivatives. Our framework is independent of the choice of the simplex derivative as long as it satisfies a general form. We review the definition and approximation accuracy of the generalized simplex gradient and generalized centred simplex gradient. We define and analyze the accuracy of a generalized version of the adapted centred simplex gradient. As examples, we apply our framework to the generalized simplex gradient, generalized centred simplex gradient, and generalized adapted centred simplex gradient. Based on the results, we give suggestions on the minimal choice of approximate diameter of the sample set.


title: TESTEVAL: Benchmarking Large Language Models for Test Case Generation

abstract: Testing plays a crucial role in the software development cycle, enabling the detection of bugs, vulnerabilities, and other undesirable behaviors. To perform software testing, testers need to write code snippets that execute the program under test. Recently, researchers have recognized the potential of large language models (LLMs) in software testing. However, there remains a lack of fair comparisons between different LLMs in terms of test case generation capabilities. In this paper, we propose TESTEVAL, a novel benchmark for test case generation with LLMs. We collect 210 Python programs from an online programming platform, LeetCode, and design three different tasks: overall coverage, targeted line/branch coverage, and targeted path coverage. We further evaluate sixteen popular LLMs, including both commercial and open-source ones, on TESTEVAL. We find that generating test cases to cover specific program lines/branches/paths is still challenging for current LLMs, indicating a lack of ability to comprehend program logic and execution paths. We have open-sourced our dataset and benchmark pipelines at https://llm4softwaretesting.github.io to contribute and accelerate future research on LLMs for software testing.


title: MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation

abstract: In the field of self-supervised depth estimation, Convolutional Neural Networks (CNNs) and Transformers have traditionally been dominant. However, both architectures struggle with efficiently handling long-range dependencies due to their local focus or computational demands. To overcome this limitation, we present MambaDepth, a versatile network tailored for self-supervised depth estimation. Drawing inspiration from the strengths of the Mamba architecture, renowned for its adept handling of lengthy sequences and its ability to capture global context efficiently through a State Space Model (SSM), we introduce MambaDepth. This innovative architecture combines the U-Net's effectiveness in self-supervised depth estimation with the advanced capabilities of Mamba. MambaDepth is structured around a purely Mamba-based encoder-decoder framework, incorporating skip connections to maintain spatial information at various levels of the network. This configuration promotes an extensive feature learning process, enabling the capture of fine details and broader contexts within depth maps. Furthermore, we have developed a novel integration technique within the Mamba blocks to facilitate uninterrupted connectivity and information flow between the encoder and decoder components, thereby improving depth accuracy. Comprehensive testing across the established KITTI dataset demonstrates MambaDepth's superiority over leading CNN and Transformer-based models in self-supervised depth estimation task, allowing it to achieve state-of-the-art performance. Moreover, MambaDepth proves its superior generalization capacities on other datasets such as Make3D and Cityscapes. MambaDepth's performance heralds a new era in effective long-range dependency modeling for self-supervised depth estimation.


title: Rare Class Prediction Model for Smart Industry in Semiconductor Manufacturing

abstract: The evolution of industry has enabled the integration of physical and digital systems, facilitating the collection of extensive data on manufacturing processes. This integration provides a reliable solution for improving process quality and managing equipment health. However, data collected from real manufacturing processes often exhibit challenging properties, such as severe class imbalance, high rates of missing values, and noisy features, which hinder effective machine learning implementation. In this study, a rare class prediction approach is developed for in situ data collected from a smart semiconductor manufacturing process. The primary objective is to build a model that addresses issues of noise and class imbalance, enhancing class separation. The developed approach demonstrated promising results compared to existing literature, which would allow the prediction of new observations that could give insights into future maintenance plans and production quality. The model was evaluated using various performance metrics, with ROC curves showing an AUC of 0.95, a precision of 0.66, and a recall of 0.96


title: Strategically Conservative Q-Learning

abstract: Offline reinforcement learning (RL) is a compelling paradigm to extend RL's practical utility by leveraging pre-collected, static datasets, thereby avoiding the limitations associated with collecting online interactions. The major difficulty in offline RL is mitigating the impact of approximation errors when encountering out-of-distribution (OOD) actions; doing so ineffectively will lead to policies that prefer OOD actions, which can lead to unexpected and potentially catastrophic results. Despite the variety of works proposed to address this issue, they tend to excessively suppress the value function in and around OOD regions, resulting in overly pessimistic value estimates. In this paper, we propose a novel framework called Strategically Conservative Q-Learning (SCQ) that distinguishes between OOD data that is easy and hard to estimate, ultimately resulting in less conservative value estimates. Our approach exploits the inherent strengths of neural networks to interpolate, while carefully navigating their limitations in extrapolation, to obtain pessimistic yet still property calibrated value estimates. Theoretical analysis also shows that the value function learned by SCQ is still conservative, but potentially much less so than that of Conservative Q-learning (CQL). Finally, extensive evaluation on the D4RL benchmark tasks shows our proposed method outperforms state-of-the-art methods. Our code is available through \url{https://github.com/purewater0901/SCQ}.


title: Tangent differential privacy

abstract: Differential privacy is a framework for protecting the identity of individual data points in the decision-making process. In this note, we propose a new form of differential privacy called tangent differential privacy. Compared with the usual differential privacy that is defined uniformly across data distributions, tangent differential privacy is tailored towards a specific data distribution of interest. It also allows for general distribution distances such as total variation distance and Wasserstein distance. In the case of risk minimization, we show that entropic regularization guarantees tangent differential privacy under rather general conditions on the risk function.


title: Emergence of topological states in relaxation dynamics of interacting bosons

abstract: Topological concepts have been employed to understand the ground states of many strongly correlated systems, but it is still quite unclear if and how topology manifests itself in the relaxation dynamics. Here we uncover emergent topological phenomena in the time evolution of far-from-equilibrium one-dimensional interacting bosons. Beginning with simple product states, the system evolves into long-time stationary states with high energy that are nonthermal for a wide range of parameters, and they exhibit nonlocal string correlation that is characteristic of the symmetry-protected topological ground state of the Hamiltonian. In contrast, no topological feature is found in the stationary state as long as the system thermalizes. This difference is further corroborated by the distinct behaviour of quantum entanglement and edge states of the system. Our theoretical prediction can be examined by current experimental techniques and paves the way for a more comprehensive understanding of topological phases in nonequilibrium settings.


title: HTESP (High-throughput electronic structure package): a Package for the high-throughput $ab$ $initio$ calculations

abstract: High-throughput $ab$ $initio$ calculations are the indispensable parts of data-driven discovery of new materials with desirable properties, as reflected in the establishment of several online material databases. The accumulation of extensive theoretical data through computations enables data-driven discovery by constructing machine learning and artificial intelligence models to predict novel compounds and forecast their properties. Efficient usage and extraction of data from these existing online material databases can accelerate the next stage materials discovery that targets different and more advanced properties, such as electron-phonon coupling for phonon-mediated superconductivity. However, extracting data from these databases, generating tailored input files for different $ab$ $initio$ calculations, performing such calculations, and analyzing new results can be demanding tasks. Here, we introduce a software package named "HTESP" (High-Throughput Electronic Structure Package) written in Python and Bash languages, which automates the entire workflow including data extraction, input file generation, calculation submission, result collection and plotting. Our HTESP will help speed up future computational materials discovery processes.


title: A unified framework for prediction of vortex-induced vibration based on the nonlinear identification of general wake oscillator modeling

abstract: In this paper, we present novel identification strategies to develop a unified framework for vortex-induced vibration (VIV) prediction based on the general semi-empirical wake oscillator. Greybox nonlinear system identification method accompanying high-fidelity computational fluid dynamics (CFD) and/or experimental data could be applied for the identification process. The proposed template of general wake oscillators contains low- to high-order damping terms to be identified for characterizing the possible flow dynamics. Two different strategies, including individual identification of single wake oscillator and overall identification of coupled VIV control equations, are proposed. VIV system consisting of an elastically-mounted circular cylinder submerged in laminar flow at Reynold number of 100 is considered. Both strategies have been tested and have exhibited high accuracy. The second strategy, i.e., overall identification of coupled VIV control equations, would be more suitable for the future framework owing that its training process considers the effect of fluid damping. A detailed mathematical introduction to future works on framework development covering the wide Reynold number range is addressed. The proposed unified framework is a landmark update of past wake oscillators both in terms of prediction accuracy and physical principles and has considerable research significance and practical engineering value.


title: The KLT kernel in twistor space

abstract: The double copy relationship between Yang-Mills theory and general relativity can be stated in terms of a field theory Kawai-Lewellen-Tye (KLT) momentum kernel, which maps two colour-ordered gluon amplitudes to a graviton amplitude at tree-level. These amplitudes can also be written in compact, helicity-graded representations on twistor space which include the famous Parke-Taylor and Hodges formulae in the maximal helicity violating sector. However, a double copy formulation of these helicity-graded formulae has proved elusive. In this paper, we use graph-theoretic methods to obtain an explicit double copy representation of the tree-level, helicity graded S-matrix of general relativity in terms of a KLT-like integral kernel in twistor space. This integral kernel glues together two colour-ordered integrands for tree-level gluon scattering on twistor space to produce tree-level graviton amplitudes, and admits a chiral splitting into positive and negative helicity degrees of freedom. Furthermore, the kernel can be inverted to obtain a new formula for the tree-level S-matrix of biadjoint scalar theory, which we verify using recursion relations. We also derive extensions of this integral kernel to graviton scattering in anti-de Sitter space and self-dual radiative spacetimes, commenting on their potential double copy interpretations.


title: Network Threshold Games

abstract: This paper studies the general class of games where agents: (1) are embedded on a network, (2) have two possible actions, and (3) these actions are strategic complements. We use a measure of network cohesiveness -- the k-core -- to provide a novel characterisation of the equilibria. After transforming the network appropriately, the k-core fully describes both the minimal and maximal equilibria, and also provides a partial characterisation of all others. This framework is also the binary action version of the large class of network games with strategic complements and continuous actions.


title: Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translation

abstract: While the neural transducer is popular for online speech recognition, simultaneous speech translation (SST) requires both streaming and re-ordering capabilities. This paper presents the LS-Transducer-SST, a label-synchronous neural transducer for SST, which naturally possesses these two properties. The LS-Transducer-SST dynamically decides when to emit translation tokens based on an Auto-regressive Integrate-and-Fire (AIF) mechanism. A latency-controllable AIF is also proposed, which can control the quality-latency trade-off either only during decoding, or it can be used in both decoding and training. The LS-Transducer-SST can naturally utilise monolingual text-only data via its prediction network which helps alleviate the key issue of data sparsity for E2E SST. During decoding, a chunk-based incremental joint decoding technique is designed to refine and expand the search space. Experiments on the Fisher-CallHome Spanish (Es-En) and MuST-C En-De data show that the LS-Transducer-SST gives a better quality-latency trade-off than existing popular methods. For example, the LS-Transducer-SST gives a 3.1/2.9 point BLEU increase (Es-En/En-De) relative to CAAT at a similar latency and a 1.4 s reduction in average lagging latency with similar BLEU scores relative to Wait-k.


title: M&M VTO: Multi-Garment Virtual Try-On and Editing

abstract: We present M&M VTO, a mix and match virtual try-on method that takes as input multiple garment images, text description for garment layout and an image of a person. An example input includes: an image of a shirt, an image of a pair of pants, "rolled sleeves, shirt tucked in", and an image of a person. The output is a visualization of how those garments (in the desired layout) would look like on the given person. Key contributions of our method are: 1) a single stage diffusion based model, with no super resolution cascading, that allows to mix and match multiple garments at 1024x512 resolution preserving and warping intricate garment details, 2) architecture design (VTO UNet Diffusion Transformer) to disentangle denoising from person specific features, allowing for a highly effective finetuning strategy for identity preservation (6MB model per individual vs 4GB achieved with, e.g., dreambooth finetuning); solving a common identity loss problem in current virtual try-on methods, 3) layout control for multiple garments via text inputs specifically finetuned over PaLI-3 for virtual try-on task. Experimental results indicate that M&M VTO achieves state-of-the-art performance both qualitatively and quantitatively, as well as opens up new opportunities for virtual try-on via language-guided and multi-garment try-on.


title: Function and form of U.S. cities

abstract: The relationship between urban form and function is a complex challenge that can be examined from multiple perspectives. In this study, we propose a method to characterize the urban function of U.S. metropolitan areas by analyzing trip patterns extracted from the 2017 National Household Travel Survey (NHTS). To characterize urban form, we employ measures that capture road network topology. We cluster cities based on both form and function and subsequently compare these clusters. Our analysis of 52 U.S. metropolitan areas identifies 7 distinct clusters of cities that exhibit similar travel behavior, suggesting that diverse mobility patterns can be effectively grouped into a few universal classes. The observed disparity between the urban-function clustering and the urban-form clustering suggests that travel behavior in the U.S. is not strongly influenced by the physical infrastructure of the city.


title: Continuous Sobolev functions with singularity on arbitrary real-analytic sets

abstract: Near every point of a real-analytic set in $\mathbb R^n$, we make use of Hironaka's resolution of singularity theorem to construct a family of continuous functions in $W^{1, 1}_{loc}$ such that their weak derivatives have (removable) singularity precisely on that set.


title: Continuous Attractor Networks for Laplace Neural Manifolds

abstract: Many cognitive models, including those for predicting the time of future events, can be mapped onto a particular form of neural representation in which activity across a population of neurons is restricted to manifolds that specify the Laplace transform of functions of continuous variables. These populations coding Laplace transform are associated with another population that inverts the transform, approximating the original function. This paper presents a neural circuit that uses continuous attractor dynamics to represent the Laplace transform of a delta function evolving in time. One population places an edge at any location along a 1-D array of neurons; another population places a bump at a location corresponding to the edge. Together these two populations can estimate a Laplace transform of delta functions in time along with an approximate inverse transform. Building the circuit so the edge moves at an appropriate speed enables the network to represent events as a function of log time. Choosing the connections appropriately within the edge network make the network states map onto Laplace transform with exponential change as a function of time. In this paper we model a learned temporal association in which one stimulus predicts another at some fixed delay $T$. Shortly after $t=0$ the first stimulus recedes into the past. The Laplace Neural Manifold representing the past maintains the Laplace transform $\exp(-st)$. Another Laplace Neural Manifold represents the predicted future. At $t=0$, the second stimulus is represented a time $T$ in the future. At each moment between 0 and $T$, firing over the Laplace transform predicting the future changes as $\exp[-s(T-t)]$. Despite exponential growth in firing, the circuit is robust to noise, making it a practical means to implement Laplace Neural Manifolds in populations of neurons for a variety of cognitive models.


title: FOOD: Facial Authentication and Out-of-Distribution Detection with Short-Range FMCW Radar

abstract: This paper proposes a short-range FMCW radar-based facial authentication and out-of-distribution (OOD) detection framework. Our pipeline jointly estimates the correct classes for the in-distribution (ID) samples and detects the OOD samples to prevent their inaccurate prediction. Our reconstruction-based architecture consists of a main convolutional block with one encoder and multi-decoder configuration, and intermediate linear encoder-decoder parts. Together, these elements form an accurate human face classifier and a robust OOD detector. For our dataset, gathered using a 60 GHz short-range FMCW radar, our network achieves an average classification accuracy of 98.07% in identifying in-distribution human faces. As an OOD detector, it achieves an average Area Under the Receiver Operating Characteristic (AUROC) curve of 98.50% and an average False Positive Rate at 95% True Positive Rate (FPR95) of 6.20%. Also, our extensive experiments show that the proposed approach outperforms previous OOD detectors in terms of common OOD detection metrics.


title: Identification and Quenching of Nugget Galaxies in the RESOLVE Survey at z = 0

abstract: We present a complete census of candidate nuggets, i.e., dense galaxies likely formed by compaction with intense gas influx, within the volume-limited $z \sim 0$ REsolved Spectroscopy Of a Local VolumE (RESOLVE) survey. These nuggets span all evolutionary stages and 3 orders of magnitude in stellar mass ($M_{*} \sim 10^{8} M_\odot$ to $10^{11} M_\odot$) from the dwarf to the giant regime. We develop selection criteria for our $z\sim0$ nugget candidates based on structure and introduce the use of environmental criteria to eliminate nugget-like objects with suspected non-compaction origins. The resulting $z\sim0$ nuggets follow expectations with respect to structure (i.e., density, size), population frequency, and likely origins. We show that the properties of our nugget census are consistent with permanent quenching above the gas-richness threshold scale (halo mass $M_{halo} \sim 10^{11.4} M_\odot$), cyclic temporary quenching below the threshold scale, and feedback from active galactic nuclei (AGN) assisting in permanent quenching. As predicted in simulations, most nuggets quench within the halo mass range $M_{halo} \sim 10^{11.45} M_\odot$ to $10^{11.9} M_\odot$. We find $\sim 0.29$ dex scatter around the star-forming main sequence for candidate blue nuggets below the threshold scale, which is consistent with temporary quenching as seen in simulations. A transitional population of green nuggets appears above the threshold scale. AGN also become more common in nuggets above this scale, and we see a likely AGN excess in nuggets vs. comparably selected non-nuggets. Our results provide the first observational confirmation of the mass-dependent, AGN-mediated shift from cyclic quenching to halo quenching in nuggets.


title: GNNAnatomy: Systematic Generation and Evaluation of Multi-Level Explanations for Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have proven highly effective in various machine learning (ML) tasks involving graphs, such as node/graph classification and link prediction. However, explaining the decisions made by GNNs poses challenges because of the aggregated relational information based on graph structure, leading to complex data transformations. Existing methods for explaining GNNs often face limitations in systematically exploring diverse substructures and evaluating results in the absence of ground truths. To address this gap, we introduce GNNAnatomy, a model- and dataset-agnostic visual analytics system designed to facilitate the generation and evaluation of multi-level explanations for GNNs. In GNNAnatomy, we employ graphlets to elucidate GNN behavior in graph-level classification tasks. By analyzing the associations between GNN classifications and graphlet frequencies, we formulate hypothesized factual and counterfactual explanations. To validate a hypothesized graphlet explanation, we introduce two metrics: (1) the correlation between its frequency and the classification confidence, and (2) the change in classification confidence after removing this substructure from the original graph. To demonstrate the effectiveness of GNNAnatomy, we conduct case studies on both real-world and synthetic graph datasets from various domains. Additionally, we qualitatively compare GNNAnatomy with a state-of-the-art GNN explainer, demonstrating the utility and versatility of our design.


title: Concurrent Training and Layer Pruning of Deep Neural Networks

abstract: We propose an algorithm capable of identifying and eliminating irrelevant layers of a neural network during the early stages of training. In contrast to weight or filter-level pruning, layer pruning reduces the harder to parallelize sequential computation of a neural network. We employ a structure using residual connections around nonlinear network sections that allow the flow of information through the network once a nonlinear section is pruned. Our approach is based on variational inference principles using Gaussian scale mixture priors on the neural network weights and allows for substantial cost savings during both training and inference. More specifically, the variational posterior distribution of scalar Bernoulli random variables multiplying a layer weight matrix of its nonlinear sections is learned, similarly to adaptive layer-wise dropout. To overcome challenges of concurrent learning and pruning such as premature pruning and lack of robustness with respect to weight initialization or the size of the starting network, we adopt the "flattening" hyper-prior on the prior parameters. We prove that, as a result of its usage, the solutions of the resulting optimization problem describe deterministic networks with parameters of the posterior distribution at either 0 or 1. We formulate a projected SGD algorithm and prove its convergence to such a solution using stochastic approximation results. In particular, we prove conditions that lead to a layer's weights converging to zero and derive practical pruning conditions from the theoretical results. The proposed algorithm is evaluated on the MNIST, CIFAR-10 and ImageNet datasets and common LeNet, VGG16 and ResNet architectures. The simulations demonstrate that our method achieves state-of the-art performance for layer pruning at reduced computational cost in distinction to competing methods due to the concurrent training and pruning.


title: Entanglement engineering of optomechanical systems by reinforcement learning

abstract: Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement -- so-called entanglement engineering -- for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon-phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based control principle is applicable to entanglement engineering of experimental quantum systems in general.


title: Improving Geo-diversity of Generated Images with Contextualized Vendi Score Guidance

abstract: With the growing popularity of text-to-image generative models, there has been increasing focus on understanding their risks and biases. Recent work has found that state-of-the-art models struggle to depict everyday objects with the true diversity of the real world and have notable gaps between geographic regions. In this work, we aim to increase the diversity of generated images of common objects such that per-region variations are representative of the real world. We introduce an inference time intervention, contextualized Vendi Score Guidance (c-VSG), that guides the backwards steps of latent diffusion models to increase the diversity of a sample as compared to a "memory bank" of previously generated images while constraining the amount of variation within that of an exemplar set of real-world contextualizing images. We evaluate c-VSG with two geographically representative datasets and find that it substantially increases the diversity of generated images, both for the worst performing regions and on average, while simultaneously maintaining or improving image quality and consistency. Additionally, qualitative analyses reveal that diversity of generated images is significantly improved, including along the lines of reductive region portrayals present in the original model. We hope that this work is a step towards text-to-image generative models that reflect the true geographic diversity of the world.


title: Flexible Multichannel Speech Enhancement for Noise-Robust Frontend

abstract: This paper proposes a flexible multichannel speech enhancement system with the main goal of improving robustness of automatic speech recognition (ASR) in noisy conditions. The proposed system combines a flexible neural mask estimator applicable to different channel counts and configurations and a multichannel filter with automatic reference selection. A transform-attend-concatenate layer is proposed to handle cross-channel information in the mask estimator, which is shown to be effective for arbitrary microphone configurations. The presented evaluation demonstrates the effectiveness of the flexible system for several seen and unseen compact array geometries, matching the performance of fixed configuration-specific systems. Furthermore, a significantly improved ASR performance is observed for configurations with randomly-placed microphones.


title: Better Late Than Never: Formulating and Benchmarking Recommendation Editing

abstract: Recommendation systems play a pivotal role in suggesting items to users based on their preferences. However, in online platforms, these systems inevitably offer unsuitable recommendations due to limited model capacity, poor data quality, or evolving user interests. Enhancing user experience necessitates efficiently rectify such unsuitable recommendation behaviors. This paper introduces a novel and significant task termed recommendation editing, which focuses on modifying known and unsuitable recommendation behaviors. Specifically, this task aims to adjust the recommendation model to eliminate known unsuitable items without accessing training data or retraining the model. We formally define the problem of recommendation editing with three primary objectives: strict rectification, collaborative rectification, and concentrated rectification. Three evaluation metrics are developed to quantitatively assess the achievement of each objective. We present a straightforward yet effective benchmark for recommendation editing using novel Editing Bayesian Personalized Ranking Loss. To demonstrate the effectiveness of the proposed method, we establish a comprehensive benchmark that incorporates various methods from related fields. Codebase is available at https://github.com/cycl2018/Recommendation-Editing.


title: Generative AI Needs Adaptive Governance

abstract: Because of the speed of its development, broad scope of application, and its ability to augment human performance, generative AI challenges the very notions of governance, trust, and human agency. The technology's capacity to mimic human knowledge work, feedback loops including significant uptick in users, research, investor, policy, and media attention, data and compute resources, all lead to rapidly increasing capabilities. For those reasons, adaptive governance, where AI governance and AI co-evolve, is essential for governing generative AI. In sharp contrast to traditional governance's regulatory regimes that are based on a mix of rigid one-and-done provisions for disclosure, registration and risk management, which in the case of AI carry the potential for regulatory misalignment, this paper argues that generative AI calls for adaptive governance. We define adaptive governance in the context of AI and outline an adaptive AI governance framework. We outline actors, roles, as well as both shared and actors-specific policy activities. We further provide examples of how the framework could be operationalized in practice. We then explain that the adaptive AI governance stance is not without its risks and limitations, such as insufficient oversight, insufficient depth, regulatory uncertainty, and regulatory capture, and provide potential approaches to fix these shortcomings.


title: Creating an AI Observer: Generative Semantic Workspaces

abstract: An experienced human Observer reading a document -- such as a crime report -- creates a succinct plot-like $\textit{``Working Memory''}$ comprising different actors, their prototypical roles and states at any point, their evolution over time based on their interactions, and even a map of missing Semantic parts anticipating them in the future. $\textit{An equivalent AI Observer currently does not exist}$. We introduce the $\textbf{[G]}$enerative $\textbf{[S]}$emantic $\textbf{[W]}$orkspace (GSW) -- comprising an $\textit{``Operator''}$ and a $\textit{``Reconciler''}$ -- that leverages advancements in LLMs to create a generative-style Semantic framework, as opposed to a traditionally predefined set of lexicon labels. Given a text segment $C_n$ that describes an ongoing situation, the $\textit{Operator}$ instantiates actor-centric Semantic maps (termed ``Workspace instance'' $\mathcal{W}_n$). The $\textit{Reconciler}$ resolves differences between $\mathcal{W}_n$ and a ``Working memory'' $\mathcal{M}_n^*$ to generate the updated $\mathcal{M}_{n+1}^*$. GSW outperforms well-known baselines on several tasks ($\sim 94\%$ vs. FST, GLEN, BertSRL - multi-sentence Semantics extraction, $\sim 15\%$ vs. NLI-BERT, $\sim 35\%$ vs. QA). By mirroring the real Observer, GSW provides the first step towards Spatial Computing assistants capable of understanding individual intentions and predicting future behavior.


title: Photon emission by hot electron injection across a lateral \textit{pn} junction

abstract: We demonstrate a method to generate photons by injecting hot electrons into a {\it pn} junction within a \ce{GaAs/AlGaAs} heterostructure. Hot electrons are generated by biasing across a mesoscopic potential in {\it n}-type region and travel toward {\it p}-type region through quantum Hall edge channel in the presence of magnetic field perpendicular to the substrate. The {\it p}-type region is created several microns away from the hot electron emitter by inducing interfacial charges using a surface gate. The energy relaxation of the hot electrons is suppressed by separating the orbitals before and after longitudinal-optical (LO) phonon emission. This technique enables the hot electrons to reach the {\it p}-type region and to recombine with induced holes followed by photon emissions. Hot electron-induced hole recombination is confirmed by a peak around \qty{810}{nm} in an optical spectrum that corresponds to excitonic recombination in a \ce{GaAs} quantum well. An asymmetric structure observed in the optical spectrum as a function of the magnetic field originates from the chiral transport of the hot electrons in the Hall edge channel. We propose the combination of our technology and on-demand single-electron source would enable the development of an on-demand single photon source that is an essential building block to drive an optical quantum circuit and to transfer quantum information for a long distance.


title: Countrywide natural experiment reveals impact of built environment on physical activity

abstract: While physical activity is critical to human health, most people do not meet recommended guidelines. More walkable built environments have the potential to increase activity across the population. However, previous studies on the built environment and physical activity have led to mixed findings, possibly due to methodological limitations such as small cohorts, few or single locations, over-reliance on self-reported measures, and cross-sectional designs. Here, we address these limitations by leveraging a large U.S. cohort of smartphone users (N=2,112,288) to evaluate within-person longitudinal behavior changes that occurred over 248,266 days of objectively-measured physical activity across 7,447 relocations among 1,609 U.S. cities. By analyzing the results of this natural experiment, which exposed individuals to differing built environments, we find that increases in walkability are associated with significant increases in physical activity after relocation (and vice versa). These changes hold across subpopulations of different genders, age, and body-mass index (BMI), and are sustained over three months after moving.The added activity observed after moving to a more walkable location is predominantly composed of moderate-to-vigorous physical activity (MVPA), which is linked to an array of associated health benefits across the life course. A simulation experiment demonstrates that substantial walkability improvements (i.e., bringing all US locations to the walkability level of Chicago or Philadelphia) may lead to 10.3% or 33 million more Americans meeting aerobic physical activity guidelines. Evidence against residential self-selection confounding is reported. Our findings provide robust evidence supporting the importance of the built environment in directly improving health-enhancing physical activity, in addition to offering potential guidance for public policy activities in this area.


title: On PI Controllers for Updating Lagrange Multipliers in Constrained Optimization

abstract: Constrained optimization offers a powerful framework to prescribe desired behaviors in neural network models. Typically, constrained problems are solved via their min-max Lagrangian formulations, which exhibit unstable oscillatory dynamics when optimized using gradient descent-ascent. The adoption of constrained optimization techniques in the machine learning community is currently limited by the lack of reliable, general-purpose update schemes for the Lagrange multipliers. This paper proposes the $\nu$PI algorithm and contributes an optimization perspective on Lagrange multiplier updates based on PI controllers, extending the work of Stooke, Achiam and Abbeel (2020). We provide theoretical and empirical insights explaining the inability of momentum methods to address the shortcomings of gradient descent-ascent, and contrast this with the empirical success of our proposed $\nu$PI controller. Moreover, we prove that $\nu$PI generalizes popular momentum methods for single-objective minimization. Our experiments demonstrate that $\nu$PI reliably stabilizes the multiplier dynamics and its hyperparameters enjoy robust and predictable behavior.


title: The automorphism groups of small affine rank 3 graphs

abstract: A rank 3 graph is an orbital graph of a rank 3 permutation group of even order. Despite the classification of rank 3 graphs being complete, see, e.g., Chapter 11 of the recent monograph 'Strongly regular graphs' by Brouwer and Van Maldeghem, the full automorphism groups of these graphs (equivalently, the 2-closures of rank 3 groups) have not been explicitly described, though a lot of information on this subject is available. In the present note, we address this problem for the affine rank 3 graphs. We find the automorphism groups for finitely many relatively small graphs and show that modulo known results, this provides the full description of the automorphism groups of the affine rank 3 graphs, thus reducing the general problem to the case when the socle of the automorphism group is nonabelian simple.


title: meSch: Multi-Agent Energy-Aware Scheduling for Task Persistence

abstract: This paper develops a scheduling protocol for a team of autonomous robots that operate in long-term persistent tasks. The proposed framework, called meSch, accounts for the robots' limited battery capacity and the presence of a single charging station, and achieves the following contributions: 1) First, it guarantees exclusive use of the charging station by one robot at a time; the approach is online, applicable to general nonlinear robot models, does not require robots to be deployed at different times, and can handle robots with different discharge rates. 2) Second, we consider the scenario when the charging station is mobile and subject to uncertainty. This approach ensures that the robots can rendezvous with the charging station while considering the uncertainty in its position. Finally, we provide the evaluation of the efficacy of meSch in simulation and experimental case studies.


title: Effective theory for fusion of conformal defects

abstract: We construct an effective field theory for fusion of conformal defects of any codimension in $d\geq 3$ conformal field theories. We fully solve the constraints of Weyl invariance for defects of arbitrary shape on general curved bulk manifolds and discuss the simplifications that arise for spherical defects on the conformal sphere. As applications, we study the structure of cusp anomalous dimensions in the anti-parallel lines limit and derive high-energy spin-dependent asymptotics for the one-point functions of bulk operators. We point out the potential importance of defects that break transverse rotations and initiate a classification of their Weyl anomalies.


title: A Unified View of Group Fairness Tradeoffs Using Partial Information Decomposition

abstract: This paper introduces a novel information-theoretic perspective on the relationship between prominent group fairness notions in machine learning, namely statistical parity, equalized odds, and predictive parity. It is well known that simultaneous satisfiability of these three fairness notions is usually impossible, motivating practitioners to resort to approximate fairness solutions rather than stringent satisfiability of these definitions. However, a comprehensive analysis of their interrelations, particularly when they are not exactly satisfied, remains largely unexplored. Our main contribution lies in elucidating an exact relationship between these three measures of (un)fairness by leveraging a body of work in information theory called partial information decomposition (PID). In this work, we leverage PID to identify the granular regions where these three measures of (un)fairness overlap and where they disagree with each other leading to potential tradeoffs. We also include numerical simulations to complement our results.


title: Bianchi I spacetimes in $f\left(Q\right)$-gravity

abstract: The Kasner spacetimes are exact solutions that are self-similar and of significant interest because they can describe the dynamic evolution of kinematic variables near the singularity of the Mixmaster universe. The chaotic behavior of the Mixmaster universe is related to the Kasner relations. This study investigates Kasner and Kasner-like solutions in symmetric teleparallel $f\left( Q\right) $-gravity. We consider three families of connections for the spatially flat Friedmann-Lema\^{\i}tre-Robertson-Walker. We found that Kasner-like solutions are present in the theory when the nonmetricity scalar $Q$ vanishes. Kasner-like relations are introduced only for the field equations of the connection defined in the coincidence gauge. Finally, we perform a detailed phase-space analysis to understand the dynamics of $f\left( Q\right) $-gravity in the evolution of anisotropies and the effects of different connections on this evolution.


title: Smoothing $L^\infty$ Riemannian metrics with nonnegative scalar curvature outside of a singular set

abstract: We show that any $L^\infty$ Riemannian metric $g$ on $\mathbb{R}^n$ that is smooth with nonnegative scalar curvature away from a singular set of finite $(n-\alpha)$-dimensional Minkowski content, for some $\alpha>2$, admits an approximation by smooth Riemannian metrics with nonnegative scalar curvature, provided that $g$ is sufficiently close in $L^\infty$ to the Euclidean metric. The approximation is given by time slices of the Ricci-DeTurck flow, which converge locally in $C^\infty$ to $g$ away from the singular set.


title: Non-Spherical Pauli Forbidden States in Deformed Halo Nuclei: Impact on the ${}^7\mathrm{Be}+p$ Resonant States in the Particle Rotor Model

abstract: Background: An important aspect of reducing nuclear many-body problems to few-body models is the presence of Pauli forbidden (PF) states, which are excluded in fully antisymmetrized calculations. Insufficient treatments of PF states in deformed halo nuclei underscore the need for model refinement. Purpose: We propose a new method utilizing Nilsson states as PF states in the orthogonality condition model, and investigate the impact of PF states on the properties of resonant states. Method: We investigate the scattering states of ${}^8\mathrm{B}$ within the Particle Rotor Model (PRM) framework based on a deformed ${}^7\mathrm{Be}$ core and $p$ two-body model. We compare several methods for eliminating PF states and test them with the experimental data. Results: Our model successfully reproduces the experimental excitation function for elastic scattering cross section by properly eliminating PF states. The same calculation predicts the presence of a low-energy bump in the inelastic scattering excitation function, although its position is overestimated by about 1 MeV compared to experimental data. Conclusion: This study extends the applicability of the PRM, offering a comprehensive approach for exploring structures and reactions of loosely bound nuclei like ${}^8$B. Future integration with the continuum discretized coupled channels (CDCC) method promises to further advance the research.


title: SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Models

abstract: Spatial reasoning is a crucial component of both biological and artificial intelligence. In this work, we present a comprehensive study of the capability of current state-of-the-art large language models (LLMs) on spatial reasoning. To support our study, we created and contribute a novel Spatial Reasoning Characterization (SpaRC) framework and Spatial Reasoning Paths (SpaRP) datasets, to enable an in-depth understanding of the spatial relations and compositions as well as the usefulness of spatial reasoning chains. We found that all the state-of-the-art LLMs do not perform well on the datasets -- their performances are consistently low across different setups. The spatial reasoning capability improves substantially as model sizes scale up. Finetuning both large language models (e.g., Llama-2-70B) and smaller ones (e.g., Llama-2-13B) can significantly improve their F1-scores by 7--32 absolute points. We also found that the top proprietary LLMs still significantly outperform their open-source counterparts in topological spatial understanding and reasoning.


title: Error Bounds of Supervised Classification from Information-Theoretic Perspective

abstract: There remains a list of unanswered research questions on deep learning (DL), including the remarkable generalization power of overparametrized neural networks, the efficient optimization performance despite the non-convexity, and the mechanisms behind flat minima in generalization. In this paper, we adopt an information-theoretic perspective to explore the theoretical foundations of supervised classification using deep neural networks (DNNs). Our analysis introduces the concepts of fitting error and model risk, which, together with generalization error, constitute an upper bound on the expected risk. We demonstrate that the generalization errors are bounded by the complexity, influenced by both the smoothness of distribution and the sample size. Consequently, task complexity serves as a reliable indicator of the dataset's quality, guiding the setting of regularization hyperparameters. Furthermore, the derived upper bound fitting error links the back-propagated gradient, Neural Tangent Kernel (NTK), and the model's parameter count with the fitting error. Utilizing the triangle inequality, we establish an upper bound on the expected risk. This bound offers valuable insights into the effects of overparameterization, non-convex optimization, and the flat minima in DNNs.Finally, empirical verification confirms a significant positive correlation between the derived theoretical bounds and the practical expected risk, confirming the practical relevance of the theoretical findings.


title: StackSight: Unveiling WebAssembly through Large Language Models and Neurosymbolic Chain-of-Thought Decompilation

abstract: WebAssembly enables near-native execution in web applications and is increasingly adopted for tasks that demand high performance and robust security. However, its assembly-like syntax, implicit stack machine, and low-level data types make it extremely difficult for human developers to understand, spurring the need for effective WebAssembly reverse engineering techniques. In this paper, we propose StackSight, a novel neurosymbolic approach that combines Large Language Models (LLMs) with advanced program analysis to decompile complex WebAssembly code into readable C++ snippets. StackSight visualizes and tracks virtual stack alterations via a static analysis algorithm and then applies chain-of-thought prompting to harness LLM's complex reasoning capabilities. Evaluation results show that StackSight significantly improves WebAssembly decompilation. Our user study also demonstrates that code snippets generated by StackSight have significantly higher win rates and enable a better grasp of code semantics.


title: Camera-Pose Robust Crater Detection from Chang'e 5

abstract: As space missions aim to explore increasingly hazardous terrain, accurate and timely position estimates are required to ensure safe navigation. Vision-based navigation achieves this goal through correlating impact craters visible through onboard imagery with a known database to estimate a craft's pose. However, existing literature has not sufficiently evaluated crater-detection algorithm (CDA) performance from imagery containing off-nadir view angles. In this work, we evaluate the performance of Mask R-CNN for crater detection, comparing models pretrained on simulated data containing off-nadir view angles and to pretraining on real-lunar images. We demonstrate pretraining on real-lunar images is superior despite the lack of images containing off-nadir view angles, achieving detection performance of 63.1 F1-score and ellipse-regression performance of 0.701 intersection over union. This work provides the first quantitative analysis of performance of CDAs on images containing off-nadir view angles. Towards the development of increasingly robust CDAs, we additionally provide the first annotated CDA dataset with off-nadir view angles from the Chang'e 5 Landing Camera.


title: Modulation instability in dispersive parity-broken systems

abstract: This work explores the interplay between dispersive parity breaking and non-linearity in two contrasting continuous dynamical systems that exhibit Modulation Instability (MI). We begin by examining deep water odd surface gravity waves and derive the non-linear Schr\"odinger equation (NLSE) for the modulated envelope dynamics using the method of multiple scales. The parity breaking in the odd gravity waves results in distinct NLSEs for the right and the left mover, leading to chirality-dependent stability properties for the envelope dynamics. Moreover, the resonant interaction of gravity waves and odd viscosity-induced capillary dynamics creates a window of wave numbers in one of the chiral sectors where the envelope propagation remains stable. Following the odd gravity results, we design a one-dimensional non-reciprocal PT-symmetric dielectric model that exhibits parity-breaking effects that are analogous to the odd viscosity term in 2D hydrodynamics. With cubic non-linearity in the polarization dynamics, we derive the corresponding NLSE. Once again, we observe that parity breaking stabilizes the modulated envelope dynamics in the lower polariton bands. We then compare the similarities and differences between this case and that of odd gravity waves.


title: A Mechanism for Entanglement?

abstract: We propose that quantum entanglement is a special sort of selection artefact, explicable as a combination of (i) collider bias and (ii) a boundary constraint on the collider variable. We show that the proposal is valid for a special class of (`W-shaped') Bell experiments involving delayed-choice entanglement swapping, and argue that it can be extended to the ordinary (`V-shaped') case. The proposal requires no direct causal influence outside lightcones, and may hence offer a way to reconcile Bell nonlocality and relativity. The main argument is a detailed version of an approach previously outlined in arXiv:2404.13928 [quant-ph].


title: Stability impacts from the current and pressure profile modifications within finite sized island

abstract: The stability (or instability) of finite sized magnetic island could play a significant role in disruption avoidance or disruption mitigation dynamics. Especially, various current and pressure profile modifications, such as the current drive and heating caused by electron cyclotron wave, or the radiative cooling and current expulsion caused by the Shattered Pellet Injection could be applied within the island to modify its stability, thus change the ensuing dynamics. In this study, we calculate the mode structure modification caused by such profile changes within the island using the perturbed equilibrium approach, thus obtain the change of stability criterion $\gD'$ and assess the corresponding quasi-linear island stability. The positive helical current perturbation is found to always stabilize the island, while the negative one is found to do the opposite, in agreement with previous results. The pressure bump or hole within the island has a more complicated stability impact. In the small island regime, its contribution is monotonic, with pressure bump tends to stabilize the island while pressure hole destabilizes it. This effect is relatively weak, though, due to the cancellation of the pressure term's odd parity contribution in the second derivatives of the mode structure. In the large island regime, such cancellation is broken due to the island asymmetry, and the pressure contribution to stability is manifested, which is non-monotonic. The stability analysis in this paper helps to more accurately clarify the expected island response in the presence of profile modifications caused by disruption avoidance or mitigation systems.


title: Attention Fusion Reverse Distillation for Multi-Lighting Image Anomaly Detection

abstract: This study targets Multi-Lighting Image Anomaly Detection (MLIAD), where multiple lighting conditions are utilized to enhance imaging quality and anomaly detection performance. While numerous image anomaly detection methods have been proposed, they lack the capacity to handle multiple inputs for a single sample, like multi-lighting images in MLIAD. Hence, this study proposes Attention Fusion Reverse Distillation (AFRD) to handle multiple inputs in MLIAD. For this purpose, AFRD utilizes a pre-trained teacher network to extract features from multiple inputs. Then these features are aggregated into fused features through an attention module. Subsequently, a corresponding student net-work is utilized to regress the attention fused features. The regression errors are denoted as anomaly scores during inference. Experiments on Eyecandies demonstrates that AFRD achieves superior MLIAD performance than other MLIAD alternatives, also highlighting the benefit of using multiple lighting conditions for anomaly detection.


title: Distribution of the number of prime factors with a given multiplicity

abstract: Given an integer $k\ge2$, let $\omega_k(n)$ denote the number of primes that divide $n$ with multiplicity exactly $k$. We compute the density $e_{k,m}$ of those integers $n$ for which $\omega_k(n)=m$ for every integer $m\ge0$. We also show that the generating function $\sum_{m=0}^\infty e_{k,m}z^m$ is an entire function that can be written in the form $\prod_{p} \bigl(1+{(p-1)(z-1)}/{p^{k+1}} \bigr)$; from this representation we show how to both numerically calculate the $e_{k,m}$ to high precision and provide an asymptotic upper bound for the $e_{k,m}$. We further show how to generalize these results to all additive functions of the form $\sum_{j=2}^\infty a_j \omega_j(n)$; when $a_j=j-1$ this recovers a classical result of R\'enyi on the distribution of $\Omega(n)-\omega(n)$.


title: Optimization of geological carbon storage operations with multimodal latent dynamic model and deep reinforcement learning

abstract: Maximizing storage performance in geological carbon storage (GCS) is crucial for commercial deployment, but traditional optimization demands resource-intensive simulations, posing computational challenges. This study introduces the multimodal latent dynamic (MLD) model, a deep learning framework for fast flow prediction and well control optimization in GCS. The MLD model includes a representation module for compressed latent representations, a transition module for system state evolution, and a prediction module for flow responses. A novel training strategy combining regression loss and joint-embedding consistency loss enhances temporal consistency and multi-step prediction accuracy. Unlike existing models, the MLD supports diverse input modalities, allowing comprehensive data interactions. The MLD model, resembling a Markov decision process (MDP), can train deep reinforcement learning agents, specifically using the soft actor-critic (SAC) algorithm, to maximize net present value (NPV) through continuous interactions. The approach outperforms traditional methods, achieving the highest NPV while reducing computational resources by over 60%. It also demonstrates strong generalization performance, providing improved decisions for new scenarios based on knowledge from previous ones.


title: Metasurfaces for infrared multi-modal microscopy: phase contrast and bright field

abstract: Different imaging modalities are used to extract the diverse information carried in an optical field. Two prominent modalities include bright field and phase contrast microscopy that can visualize the amplitude and phase features of a sample, respectively. However, capturing both of these images on the same camera typically requires interchanging optical components. Metasurfaces are ultra-thin nanostructures that can merge both of these operations into a single miniaturized device. Here, a silicon-based metasurface that supports a Mie resonance is demonstrated to perform near-infrared phase contrast and bright field multi-modal microscopy that can be tuned by changing the polarization of the illumination. We performed experiments using optical fields with phase variations synthesized by a spatial light modulator and introduced by propagation through semi-transparent samples, including C. elegans, unstained human prostate cancer cells and breast tissue. The results demonstrate the potential of metasurfaces for label-free point-of-care testing.

categories: physics.optics physics.app-ph physics.bio-ph physics.med-ph


title: Next challenges in semi-leptonic B decays

abstract: Lattice calculation of $B\to D^{(*)}\ell\bar\nu$ decay form factors is now available from multiple lattice collaborations for both zero-recoil limit and non-zero recoil kinematics. Yet, there are a number of challenges we face to better control the systematic errors and to extend the application of lattice calculations to related quantities. The subjects are chosen from my own perspective and not meant to be conprehensive.


title: SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style Transfer

abstract: Text style transfer (TST) aims to vary the style polarity of text while preserving the semantic content. Although recent advancements have demonstrated remarkable progress in short TST, it remains a relatively straightforward task with limited practical applications. The more comprehensive long TST task presents two challenges: (1) existing methods encounter difficulties in accurately evaluating content attributes in multiple words, leading to content degradation; (2) the conventional vanilla style classifier loss encounters obstacles in maintaining consistent style across multiple generated sentences. In this paper, we propose a novel method SC2, where a multilayer Joint Style-Content Weighed (JSCW) module and a Style Consistency loss are designed to address the two issues. The JSCW simultaneously assesses the amounts of style and content attributes within a token, aiming to acquire a lossless content representation and thereby enhancing content preservation. The multiple JSCW layers further progressively refine content representations. We design a style consistency loss to ensure the generated multiple sentences consistently reflect the target style polarity. Moreover, we incorporate a denoising non-autoregressive decoder to accelerate the training. We conduct plentiful experiments and the results show significant improvements of SC2 over competitive baselines. Our code: https://github.com/jiezhao6/SC2.


title: Towards understanding of the inclusive vs exclusive puzzle in the $|V_{cb}|$ determinations

abstract: Lattice calculation may play an important role to understand the cause of the long-standing puzzle among the determination of $|V_{cb}|$. The key element is the computation of the inclusive decay rate, for which the formalism is under development. The method has its own problem: the approximation of the phase-space factor and finite volume effect. I discuss the current status of such study and future prospects.


title: A study guide for "On the Hausdorff dimension of Furstenberg sets and orthogonal projections in the plane" after T. Orponen and P. Shmerkin

abstract: This article is a study guide for ``On the Hausdorff dimension of Furstenberg sets and orthogonal projections in the plane" by Orponen and Shmerkin. We begin by introducing Furstenberg set problem and exceptional set of projections and provide a summary of the proof with the core ideas.


title: Detection of 49 Weak Dispersed Radio Pulses in a Parkes Observation of the X-ray Pulsar PSR J0537$-$6910

abstract: I conducted a new search for dispersed radio pulses from the X-ray pulsar PSR J0537$-$6910 in the Large Magellanic Cloud in a long (11.6 hr) archival 1.4 GHz Parkes search observation. I searched dispersion measures (DMs) between 0 and 10000 pc cm$^{-3}$ and detected 49 pulses with a signal-to-noise ratio (S/N) greater than 7 at a wide range of DMs using the HEIMDALL and FETCH pulse detection and classification packages. All of the pulses were weak, with none having a S/N above 8.5. There was a significant excess of pulses observed in the DM range of the known pulsar population in the LMC, suggesting that these pulses may originate from LMC pulsars. Three repeat pulses, each having widths $\lesssim 1$ ms, were detected in a single DM trial of 103.412 pc cm$^{-3}$, which is in the LMC DM range. This is unlikely to occur by chance in a single DM trial in this search at the (marginally significant) 4.3$\sigma$ level. It remains unclear whether any of the detected pulses in the sample are from PSR J0537$-$6910 itself.


title: Neural Codec-based Adversarial Sample Detection for Speaker Verification

abstract: Automatic Speaker Verification (ASV), increasingly used in security-critical applications, faces vulnerabilities from rising adversarial attacks, with few effective defenses available. In this paper, we propose a neural codec-based adversarial sample detection method for ASV. The approach leverages the codec's ability to discard redundant perturbations and retain essential information. Specifically, we distinguish between genuine and adversarial samples by comparing ASV score differences between original and re-synthesized audio (by codec models). This comprehensive study explores all open-source neural codecs and their variant models for experiments. The Descript-audio-codec model stands out by delivering the highest detection rate among 15 neural codecs and surpassing seven prior state-of-the-art (SOTA) detection methods. Note that, our single-model method even outperforms a SOTA ensemble method by a large margin.


title: Extroversion or Introversion? Controlling The Personality of Your Large Language Models

abstract: Large language models (LLMs) exhibit robust capabilities in text generation and comprehension, mimicking human behavior and exhibiting synthetic personalities. However, some LLMs have displayed offensive personality, propagating toxic discourse. Existing literature neglects the origin and evolution of LLM personalities, as well as the effective personality control. To fill these gaps, our study embarked on a comprehensive investigation into LLM personality control. We investigated several typical methods to influence LLMs, including three training methods: Continual Pre-training, Supervised Fine-Tuning (SFT), and Reinforcement Learning from Human Feedback (RLHF), along with inference phase considerations (prompts). Our investigation revealed a hierarchy of effectiveness in control: Prompt > SFT > RLHF > Continual Pre-train. Notably, SFT exhibits a higher control success rate compared to prompt induction. While prompts prove highly effective, we found that prompt-induced personalities are less robust than those trained, making them more prone to showing conflicting personalities under reverse personality prompt induction. Besides, harnessing the strengths of both SFT and prompt, we proposed $\underline{\text{P}}$rompt $\underline{\text{I}}$nduction post $\underline{\text{S}}$upervised $\underline{\text{F}}$ine-tuning (PISF), which emerges as the most effective and robust strategy for controlling LLMs' personality, displaying high efficacy, high success rates, and high robustness. Even under reverse personality prompt induction, LLMs controlled by PISF still exhibit stable and robust personalities.


title: CLoG: Benchmarking Continual Learning of Image Generation Models

abstract: Continual Learning (CL) poses a significant challenge in Artificial Intelligence, aiming to mirror the human ability to incrementally acquire knowledge and skills. While extensive research has focused on CL within the context of classification tasks, the advent of increasingly powerful generative models necessitates the exploration of Continual Learning of Generative models (CLoG). This paper advocates for shifting the research focus from classification-based CL to CLoG. We systematically identify the unique challenges presented by CLoG compared to traditional classification-based CL. We adapt three types of existing CL methodologies, replay-based, regularization-based, and parameter-isolation-based methods to generative tasks and introduce comprehensive benchmarks for CLoG that feature great diversity and broad task coverage. Our benchmarks and results yield intriguing insights that can be valuable for developing future CLoG methods. Additionally, we will release a codebase designed to facilitate easy benchmarking and experimentation in CLoG publicly at https://github.com/linhaowei1/CLoG. We believe that shifting the research focus to CLoG will benefit the continual learning community and illuminate the path for next-generation AI-generated content (AIGC) in a lifelong learning paradigm.


title: A fully plasma based electron injector for a linear collider or XFEL

abstract: We demonstrate through high-fidelity particle-in-cell simulations a simple approach for efficiently generating 20+ GeV electron beams with the necessary charge, energy spread, and emittance for use as the injector for an electron arm of a future linear collider or a next generation XFEL. The self-focusing of an unmatched, relatively low quality, drive beam results in self-injection by elongating the wakefield excited in the nonlinear blowout regime. Over pump depletion distances, the drive beam dynamics and self-loading from the injected beam leads to extremely high quality and high energy output beams. For plasma densities of $10^{18} \ \text{cm}^{-3}$, PIC simulation results indicate that self-injected beams with $0.52 \ \text{nC}$ of charge can be accelerated to $\sim 20$ GeV energies with projected energy spreads, $\lesssim 1\%$ within the beam core, slice normalized emittances as low as $110 \ \text{nm}$, a peak normalized brightness $\gtrsim 10^{19} \ \text{A}/\text{m}^2/\text{rad}^2$, and energy transfer efficiencies $\gtrsim 54\%$.


title: A Simple Channel Independent Beamforming Scheme With Parallel Uniform Circular Array

abstract: In this letter, we consider a uniform circular array (UCA)-based line-of-sight multiple-input-multiple-output system, where the transmit and receive UCAs are parallel but non-coaxial with each other. We propose a simple channel-independent beamforming scheme with fast symbol-wise maximum likelihood detection.


title: Nonsmooth folds are tipping points

abstract: A nonsmooth fold is where an equilibrium or limit cycle of a nonsmooth dynamical system hits a switching manifold and collides and annihilates with another solution of the same type. We show that beyond the bifurcation the leading-order truncation to the system in general has no bounded invariant set. This is proved for boundary equilibrium bifurcations of Filippov systems, hybrid systems, and continuous piecewise-smooth ODEs, and grazing-type events for which the truncated form is a continuous piecewise-linear map. The omitted higher-order terms are expected to be incapable of altering the local dynamics qualitatively, implying the system has no local invariant set on one side of a nonsmooth fold, and we demonstrate this with an example. Thus if the equilibrium or limit cycle is attracting the bifurcation causes the local attractor of the system to tip to a new state. The results also help explain global aspects of the bifurcation structures of the truncated systems.


title: A majorized PAM method with subspace correction for low-rank composite factorization model

abstract: This paper concerns a class of low-rank composite factorization models arising from matrix completion. For this nonconvex and nonsmooth optimization problem, we propose a proximal alternating minimization algorithm (PAMA) with subspace correction, in which a subspace correction step is imposed on every proximal subproblem so as to guarantee that the corrected proximal subproblem has a closed-form solution. For this subspace correction PAMA, we prove the subsequence convergence of the iterate sequence, and establish the convergence of the whole iterate sequence and the column subspace sequences of factor pairs under the KL property of objective function and a restrictive condition that holds automatically for the column $\ell_{2,0}$-norm function. Numerical comparison with the proximal alternating linearized minimization method on one-bit matrix completion problems indicates that PAMA has an advantage in seeking lower relative error within less time.


title: MUSE: Flexible Voiceprint Receptive Fields and Multi-Path Fusion Enhanced Taylor Transformer for U-Net-based Speech Enhancement

abstract: Achieving a balance between lightweight design and high performance remains a challenging task for speech enhancement. In this paper, we introduce Multi-path Enhanced Taylor (MET) Transformer based U-net for Speech Enhancement (MUSE), a lightweight speech enhancement network built upon the Unet architecture. Our approach incorporates a novel Multi-path Enhanced Taylor (MET) Transformer block, which integrates Deformable Embedding (DE) to enable flexible receptive fields for voiceprints. The MET Transformer is uniquely designed to fuse Channel and Spatial Attention (CSA) branches, facilitating channel information exchange and addressing spatial attention deficits within the Taylor-Transformer framework. Through extensive experiments conducted on the VoiceBank+DEMAND dataset, we demonstrate that MUSE achieves competitive performance while significantly reducing both training and deployment costs, boasting a mere 0.51M parameters.


title: Limit behavior of the twisted conical K\"ahler-Ricci flow with change in the cone angle

abstract: In this paper, we study the limit behavior of the conical K\"ahler-Ricci flow as its cone angle tends to zero. More precisely, we prove that as the cone angle tends to zero, the conical K\"ahler-Ricci flow converges to a unique K\"ahler-Ricci flow, which is smooth outside the divisor and admits cusp singularity along the divisor.


title: Stability of the generalized Lagrangian mean curvature flow in cotangent bundle

abstract: In this paper, we consider the stability of the generalized Lagrangian mean curvature flow of graph case in the cotangent bundle, which is first defined by Smoczyk-Tsui-Wang. By new estimates of derivatives along the flow, we weaken the initial condition and remove the positive curvature condition in Smoczyk-Tsui-Wang's work. More precisely, we prove that if the graph induced by a closed $1$-form is a special Lagrangian submanifold in the cotangent bundle of a Riemannian manifold, then the generalized Lagrangian mean curvature flow is stable near it.


title: Convergence Analysis of Adaptive Gradient Methods under Refined Smoothness and Noise Assumptions

abstract: Adaptive gradient methods are arguably the most successful optimization algorithms for neural network training. While it is well-known that adaptive gradient methods can achieve better dimensional dependence than stochastic gradient descent (SGD) under favorable geometry for stochastic convex optimization, the theoretical justification for their success in stochastic non-convex optimization remains elusive. In this paper, we aim to close this gap by analyzing the convergence rates of AdaGrad measured by the $\ell_1$-norm of the gradient. Specifically, when the objective has $L$-Lipschitz gradient and the stochastic gradient variance is bounded by $\sigma^2$, we prove a worst-case convergence rate of $\tilde{\mathcal{O}}(\frac{\sqrt{d}L}{\sqrt{T}} + \frac{\sqrt{d} \sigma}{T^{1/4}})$, where $d$ is the dimension of the problem.We also present a lower bound of ${\Omega}(\frac{\sqrt{d}}{\sqrt{T}})$ for minimizing the gradient $\ell_1$-norm in the deterministic setting, showing the tightness of our upper bound in the noiseless case. Moreover, under more fine-grained assumptions on the smoothness structure of the objective and the gradient noise and under favorable gradient $\ell_1/\ell_2$ geometry, we show that AdaGrad can potentially shave a factor of $\sqrt{d}$ compared to SGD. To the best of our knowledge, this is the first result for adaptive gradient methods that demonstrates a provable gain over SGD in the non-convex setting.


title: SynAsk: Unleashing the Power of Large Language Models in Organic Synthesis

abstract: The field of natural language processing (NLP) has witnessed a transformative shift with the emergence of large language models (LLMs), revolutionizing various language tasks and applications, and the integration of LLM into specialized domains enhances their capabilities for domain-specific applications. Notably, NLP has made significant strides in organic chemistry, particularly in predicting synthetic tasks, paving the way for the development of LLMs tailored to the organic chemistry field. In this work, we introduce SynAsk, a comprehensive organic chemistry domain-specific LLM platform developed by AIChemEco Inc. By finetuning an LLM with domain-specific data and integrating it with a chain of thought approach, SynAsk seamlessly accesses our knowledge base and advanced chemistry tools in a question-and-answer format. This includes functionalities such as a basic chemistry knowledge base, molecular information retrieval, reaction performance prediction, retrosynthesis prediction, chemical literature acquisition, and more. This novel methodology synergizes fine-tuning techniques with external resource integration, resulting in an organic chemistry-specific model poised to facilitate research and discovery in the field. Accessible via http://synask.aichemeco.com, SynAsk represents a significant advancement in leveraging NLP for synthetic applications.


title: Boosting Large-scale Parallel Training Efficiency with C4: A Communication-Driven Approach

abstract: The emergence of Large Language Models (LLMs) has necessitated the adoption of parallel training techniques, involving the deployment of thousands of GPUs to train a single model. Unfortunately, we have found that the efficiency of current parallel training is often suboptimal, largely due to the following two main issues. Firstly, hardware failures are inevitable, leading to interruptions in the training tasks. The inability to quickly identify the faulty components results in a substantial waste of GPU resources. Secondly, since GPUs must wait for parameter synchronization to complete before proceeding to the next round of computation, network congestions can greatly increase the waiting time for GPUs. To address these challenges, this paper introduces a communication-driven solution, namely the C4. The key insights of C4 are two folds. First, in parallel training, collective communication exhibits periodic and homogeneous characteristics, so any anomalies are certainly due to some form of hardware malfunction. By leveraging this feature, C4 can rapidly identify the faulty components, swiftly isolate the anomaly, and restart the task, thereby avoiding resource wastage caused by delays in anomaly detection. Second, the predictable communication model of collective communication, involving few large flows, allows C4 to efficiently execute traffic planning, substantially reducing network congestion. C4 has been extensively implemented across our production systems, cutting error-induced overhead by roughly 30% and enhancing runtime performance by about 15% for certain applications with moderate communication costs.


title: Pitch-Aware RNN-T for Mandarin Chinese Mispronunciation Detection and Diagnosis

abstract: Mispronunciation Detection and Diagnosis (MDD) systems, leveraging Automatic Speech Recognition (ASR), face two main challenges in Mandarin Chinese: 1) The two-stage models create an information gap between the phoneme or tone classification stage and the MDD stage. 2) The scarcity of Mandarin MDD datasets limits model training. In this paper, we introduce a stateless RNN-T model for Mandarin MDD, utilizing HuBERT features with pitch embedding through a Pitch Fusion Block. Our model, trained solely on native speaker data, shows a 3% improvement in Phone Error Rate and a 7% increase in False Acceptance Rate over the state-of-the-art baseline in non-native scenarios


title: Federated Representation Learning in the Under-Parameterized Regime

abstract: Federated representation learning (FRL) is a popular personalized federated learning (FL) framework where clients work together to train a common representation while retaining their personalized heads. Existing studies, however, largely focus on the over-parameterized regime. In this paper, we make the initial efforts to investigate FRL in the under-parameterized regime, where the FL model is insufficient to express the variations in all ground-truth models. We propose a novel FRL algorithm FLUTE, and theoretically characterize its sample complexity and convergence rate for linear models in the under-parameterized regime. To the best of our knowledge, this is the first FRL algorithm with provable performance guarantees in this regime. FLUTE features a data-independent random initialization and a carefully designed objective function that aids the distillation of subspace spanned by the global optimal representation from the misaligned local representations. On the technical side, we bridge low-rank matrix approximation techniques with the FL analysis, which may be of broad interest. We also extend FLUTE beyond linear representations. Experimental results demonstrate that FLUTE outperforms state-of-the-art FRL solutions in both synthetic and real-world tasks.


title: Constraining the selection corrected luminosity function and total pulse count for radio transients

abstract: Studying transient phenomena, such as individual pulses from pulsars, has garnered considerable attention in the era of astronomical big data. Of specific interest to this study are Rotating Radio Transients (RRATs), nulling, and intermittent pulsars. This study introduces a new algorithm named LuNfit, tailored to correct the selection biases originating from the telescope and detection pipelines. Ultimately LuNfit estimates the intrinsic luminosity distribution and nulling fraction of the single pulses emitted by pulsars. LuNfit relies on Bayesian nested sampling so that the parameter space can be fully explored. Bayesian nested sampling also provides the additional benefit of simplifying model comparisons through the Bayes ratio. The robustness of LuNfit is shown through simulations and applying LuNfit onto pulsars with known nulling fractions. LuNfit is then applied to three RRATs, J0012+5431, J1538+1523, and J2355+1523, extracting their intrinsic luminosity distribution and burst rates. We find that their nulling fraction is 0.4(2), 0.749(5) and 0.995(2) respectively. We further find that a log-normal distribution likely describes the single pulse luminosity distribution of J0012+5431 and J1538+1523, while the Bayes ratio for J2355+1523 slightly favors an exponential distribution. We show the conventional method of correcting selection effects by "scaling up" the missed fraction of radio transients can be unreliable when the mean luminosity of the source is faint relative to the telescope sensitivity. Finally, we discuss the limitations of the current implementation of LuNfit while also delving into potential enhancements that would enable LuNfit to be applied to sources with complex pulse morphologies.


title: OCDB: Revisiting Causal Discovery with a Comprehensive Benchmark and Evaluation Framework

abstract: Large language models (LLMs) have excelled in various natural language processing tasks, but challenges in interpretability and trustworthiness persist, limiting their use in high-stakes fields. Causal discovery offers a promising approach to improve transparency and reliability. However, current evaluations are often one-sided and lack assessments focused on interpretability performance. Additionally, these evaluations rely on synthetic data and lack comprehensive assessments of real-world datasets. These lead to promising methods potentially being overlooked. To address these issues, we propose a flexible evaluation framework with metrics for evaluating differences in causal structures and causal effects, which are crucial attributes that help improve the interpretability of LLMs. We introduce the Open Causal Discovery Benchmark (OCDB), based on real data, to promote fair comparisons and drive optimization of algorithms. Additionally, our new metrics account for undirected edges, enabling fair comparisons between Directed Acyclic Graphs (DAGs) and Completed Partially Directed Acyclic Graphs (CPDAGs). Experimental results show significant shortcomings in existing algorithms' generalization capabilities on real data, highlighting the potential for performance improvement and the importance of our framework in advancing causal discovery techniques.


title: Imputation of Nonignorable Missing Data in Surveys Using Auxiliary Margins Via Hot Deck and Sequential Imputation

abstract: Survey data collection often is plagued by unit and item nonresponse. To reduce reliance on strong assumptions about the missingness mechanisms, statisticians can use information about population marginal distributions known, for example, from censuses or administrative databases. One approach that does so is the Missing Data with Auxiliary Margins, or MD-AM, framework, which uses multiple imputation for both unit and item nonresponse so that survey-weighted estimates accord with the known marginal distributions. However, this framework relies on specifying and estimating a joint distribution for the survey data and nonresponse indicators, which can be computationally and practically daunting in data with many variables of mixed types. We propose two adaptations to the MD-AM framework to simplify the imputation task. First, rather than specifying a joint model for unit respondents' data, we use random hot deck imputation while still leveraging the known marginal distributions. Second, instead of sampling from conditional distributions implied by the joint model for the missing data due to item nonresponse, we apply multiple imputation by chained equations for item nonresponse before imputation for unit nonresponse. Using simulation studies with nonignorable missingness mechanisms, we demonstrate that the proposed approach can provide more accurate point and interval estimates than models that do not leverage the auxiliary information. We illustrate the approach using data on voter turnout from the U.S. Current Population Survey.


title: 1st Place Solution for MOSE Track in CVPR 2024 PVUW Workshop: Complex Video Object Segmentation

abstract: Tracking and segmenting multiple objects in complex scenes has always been a challenge in the field of video object segmentation, especially in scenarios where objects are occluded and split into parts. In such cases, the definition of objects becomes very ambiguous. The motivation behind the MOSE dataset is how to clearly recognize and distinguish objects in complex scenes. In this challenge, we propose a semantic embedding video object segmentation model and use the salient features of objects as query representations. The semantic understanding helps the model to recognize parts of the objects and the salient feature captures the more discriminative features of the objects. Trained on a large-scale video object segmentation dataset, our model achieves first place (\textbf{84.45\%}) in the test set of PVUW Challenge 2024: Complex Video Object Segmentation Track.


title: Enhancing Size Generalization in Graph Neural Networks through Disentangled Representation Learning

abstract: Although most graph neural networks (GNNs) can operate on graphs of any size, their classification performance often declines on graphs larger than those encountered during training. Existing methods insufficiently address the removal of size information from graph representations, resulting in sub-optimal performance and reliance on backbone models. In response, we propose DISGEN, a novel and model-agnostic framework designed to disentangle size factors from graph representations. DISGEN employs size- and task-invariant augmentations and introduces a decoupling loss that minimizes shared information in hidden representations, with theoretical guarantees for its effectiveness. Our empirical results show that DISGEN outperforms the state-of-the-art models by up to 6% on real-world datasets, underscoring its effectiveness in enhancing the size generalizability of GNNs. Our codes are available at: https://github.com/GraphmindDartmouth/DISGEN.


title: Dynamical Stability of Minimal Lagrangians in K\"ahler-Einstein Manifolds of Non-Positive Curvature

abstract: It is known that minimal Lagrangians in K\"ahler--Einstein manifolds of non-positive scalar curvature are linearly stable under Hamiltonian deformations. We prove that they are also stable under the Lagrangian mean curvature flow, and therefore establish the equivalence between linear stability and dynamical stability. Specifically, if one starts the mean curvature flow with a Lagrangian which is $C^1$-close and Hamiltonian isotopic to a minimal Lagrangian, the flow exists smoothly for all time, and converges to that minimal Lagrangian. Due to the work of Neves [Ann. of Math. 2013], this cannot be true for $C^0$-closeness.


title: Simplify Implant Depth Prediction as Video Grounding: A Texture Perceive Implant Depth Prediction Network

abstract: Surgical guide plate is an important tool for the dental implant surgery. However, the design process heavily relies on the dentist to manually simulate the implant angle and depth. When deep neural networks have been applied to assist the dentist quickly locates the implant position, most of them are not able to determine the implant depth. Inspired by the video grounding task which localizes the starting and ending time of the target video segment, in this paper, we simplify the implant depth prediction as video grounding and develop a Texture Perceive Implant Depth Prediction Network (TPNet), which enables us to directly output the implant depth without complex measurements of oral bone. TPNet consists of an implant region detector (IRD) and an implant depth prediction network (IDPNet). IRD is an object detector designed to crop the candidate implant volume from the CBCT, which greatly saves the computation resource. IDPNet takes the cropped CBCT data to predict the implant depth. A Texture Perceive Loss (TPL) is devised to enable the encoder of IDPNet to perceive the texture variation among slices. Extensive experiments on a large dental implant dataset demonstrated that the proposed TPNet achieves superior performance than the existing methods.


title: Learning Task Decomposition to Assist Humans in Competitive Programming

abstract: When using language models (LMs) to solve complex problems, humans might struggle to understand the LM-generated solutions and repair the flawed ones. To assist humans in repairing them, we propose to automatically decompose complex solutions into multiple simpler pieces that correspond to specific subtasks. We introduce a novel objective for learning task decomposition, termed assistive value (AssistV), which measures the feasibility and speed for humans to repair the decomposed solution. We collect a dataset of human repair experiences on different decomposed solutions. Utilizing the collected data as in-context examples, we then learn to critique, refine, and rank decomposed solutions to improve AssistV. We validate our method under competitive programming problems: under 177 hours of human study, our method enables non-experts to solve 33.3\% more problems, speeds them up by 3.3x, and empowers them to match unassisted experts.


title: Effect of Accretion on the evolution of Primordial Black Holes in the context of Modified Gravity Theories

abstract: We investigates the effect of accretion of cosmic fluid on the evolution of Primordial Black Holes (PBHs) within the framework of Modified gravity theories. We consider a general form of the Hubble parameter, reflecting a general class of modified gravity theories and bouncing models. We then study the effect of such modified dynamics on PBH in the presence of Hawking radiation and accretion of surrounding materials. We investigate how the evolution of PBHs is influenced by accretion across different cosmological eras, considering the radiation, matter, and dark energy-dominated phases like phantom and quintessence for linear equation of state. We further incorporated Non-linear Equations of State such as Chaplygin Gas, Modified Chaplygin gas, Van der Waals model, Polytropic Fluid model. The study systematically analyzes the mass variation of PBHs in the presence of such different cosmological environments. The results will contribute to the understanding of PBH formation and evolution in modified theory of gravity, and their possibility of being detected with future experiments.


title: Helpful or Harmful Data? Fine-tuning-free Shapley Attribution for Explaining Language Model Predictions

abstract: The increasing complexity of foundational models underscores the necessity for explainability, particularly for fine-tuning, the most widely used training method for adapting models to downstream tasks. Instance attribution, one type of explanation, attributes the model prediction to each training example by an instance score. However, the robustness of instance scores, specifically towards dataset resampling, has been overlooked. To bridge this gap, we propose a notion of robustness on the sign of the instance score. We theoretically and empirically demonstrate that the popular leave-one-out-based methods lack robustness, while the Shapley value behaves significantly better, but at a higher computational cost. Accordingly, we introduce an efficient fine-tuning-free approximation of the Shapley value (FreeShap) for instance attribution based on the neural tangent kernel. We empirically demonstrate that FreeShap outperforms other methods for instance attribution and other data-centric applications such as data removal, data selection, and wrong label detection, and further generalize our scale to large language models (LLMs). Our code is available at https://github.com/JTWang2000/FreeShap.


title: MeGA: Merging Multiple Independently Trained Neural Networks Based on Genetic Algorithm

abstract: In this paper, we introduce a novel method for merging the weights of multiple pre-trained neural networks using a genetic algorithm called MeGA. Traditional techniques, such as weight averaging and ensemble methods, often fail to fully harness the capabilities of pre-trained networks. Our approach leverages a genetic algorithm with tournament selection, crossover, and mutation to optimize weight combinations, creating a more effective fusion. This technique allows the merged model to inherit advantageous features from both parent models, resulting in enhanced accuracy and robustness. Through experiments on the CIFAR-10 dataset, we demonstrate that our genetic algorithm-based weight merging method improves test accuracy compared to individual models and conventional methods. This approach provides a scalable solution for integrating multiple pre-trained networks across various deep learning applications. Github is available at: https://github.com/YUNBLAK/MeGA-Merging-Multiple-Independently-Trained-Neural-Networks-Based-on-Genetic-Algorithm


title: A Recover-then-Discriminate Framework for Robust Anomaly Detection

abstract: Anomaly detection (AD) has been extensively studied and applied in a wide range of scenarios in the recent past. However, there are still gaps between achieved and desirable levels of recognition accuracy for making AD for practical applications. In this paper, we start from an insightful analysis of two types of fundamental yet representative failure cases in the baseline model, and reveal reasons that hinder current AD methods from achieving a higher recognition accuracy. Specifically, by Case-1, we found that the main reasons detrimental to current AD methods is that the inputs to the recovery model contain a large number of detailed features to be recovered, which leads to the normal/abnormal area has-not/has been recovered into its original state. By Case-2, we surprisingly found that the abnormal area that cannot be recognized in image-level representations can be easily recognized in the feature-level representation. Based on the above observations, we propose a novel Recover-then-Discriminate (ReDi) framework for AD. ReDi takes a self-generated feature map and a selected prompted image as explicit input information to solve problems in case-1. Concurrently, a feature-level discriminative network is proposed to enhance abnormal differences between the recovered representation and the input representation. Extensive experimental results on two popular yet challenging AD datasets validate that ReDi achieves the new state-of-the-art accuracy.