title: A modified debiased inverse-variance weighted estimator in two-sample summary-data Mendelian randomization

abstract: Mendelian randomization uses genetic variants as instrumental variables to make causal inferences about the effects of modifiable risk factors on diseases from observational data. One of the major challenges in Mendelian randomization is that many genetic variants are only modestly or even weakly associated with the risk factor of interest, a setting known as many weak instruments. Many existing methods, such as the popular inverse-variance weighted (IVW) method, could be biased when the instrument strength is weak. To address this issue, the debiased IVW (dIVW) estimator, which is shown to be robust to many weak instruments, was recently proposed. However, this estimator still has non-ignorable bias when the effective sample size is small. In this paper, we propose a modified debiased IVW (mdIVW) estimator by multiplying a modification factor to the original dIVW estimator. After this simple correction, we show that the bias of the mdIVW estimator converges to zero at a faster rate than that of the dIVW estimator under some regularity conditions. Moreover, the mdIVW estimator has smaller variance than the dIVW estimator.We further extend the proposed method to account for the presence of instrumental variable selection and balanced horizontal pleiotropy. We demonstrate the improvement of the mdIVW estimator over the dIVW estimator through extensive simulation studies and real data analysis.


title: Practical Software for Triangulating and Simplifying 4-Manifolds

abstract: Dimension 4 is the first dimension in which exotic smooth manifold pairs appear -- manifolds which are topologically the same but for which there is no smooth deformation of one into the other. Whilst smooth and triangulated 4-manifolds do coincide, comparatively little work has been done towards gaining an understanding of smooth 4-manifolds from the discrete and algorithmic perspective. In this paper we introduce new software tools to make this possible, including a software implementation of an algorithm which enables us to build triangulations of 4-manifolds from Kirby diagrams, as well as a new heuristic for simplifying 4-manifold triangulations. Using these tools, we present new triangulations of several bounded exotic pairs, corks and plugs (objects responsible for "exoticity"), as well as the smallest known triangulation of the fundamental K3 surface. The small size of these triangulations benefit us by revealing fine structural features in 4-manifold triangulations.


title: Hyperon semileptonic decays in QCD sum rules

abstract: We investigate the hyperon semileptonic decays within the framework of QCD sum rules. The flavor $ SU(3) $ symmetry breaking effects are analyzed via the relevant form factors and corresponding branching fractions. Employing the $ z $-series parameterization to capture the $ q^2 $ dependence of form factors, we calculate the hyperon semileptonic decay rates and confront them with the recent experimental measurements. Moreover, we calculate as well the non-standard tensor form factors, which involve certain new physics beyond the standard model.


title: AttributionBench: How Hard is Automatic Attribution Evaluation?

abstract: Modern generative search engines enhance the reliability of large language model (LLM) responses by providing cited evidence. However, evaluating the answer's attribution, i.e., whether every claim within the generated responses is fully supported by its cited evidence, remains an open problem. This verification, traditionally dependent on costly human evaluation, underscores the urgent need for automatic attribution evaluation methods. To bridge the gap in the absence of standardized benchmarks for these methods, we present AttributionBench, a comprehensive benchmark compiled from various existing attribution datasets. Our extensive experiments on AttributionBench reveal the challenges of automatic attribution evaluation, even for state-of-the-art LLMs. Specifically, our findings show that even a fine-tuned GPT-3.5 only achieves around 80% macro-F1 under a binary classification formulation. A detailed analysis of more than 300 error cases indicates that a majority of failures stem from the model's inability to process nuanced information, and the discrepancy between the information the model has access to and that human annotators do.


title: Frustration elimination for effective optical spins in coherent Ising machines

abstract: Frustration, that is, the impossibility to satisfy the energetic preferences between all spin pairs simultaneously, underlies the complexity of many fundamental properties in spin systems, including the computational hardness to determine their ground states. Coherent Ising machines (CIM) have been proposed as a promising analog computational approach to efficiently find different degenerate ground states of large and complex Ising models. However, CIMs also face challenges in solving frustrated Ising models: Frustration not only reduces the probability to find good solutions, but it also prohibits to leverage quantum effects in doing so. To circumvent these detrimental effects of frustration, we show how frustrated Ising models can be mapped to frustration-free CIM configurations by including ancillary modes and modifying the coupling protocol used in current CIM designs. In our proposal, degenerate optical parametric oscillator (DOPO) modes encode the ground state candidates of the studied Ising model, while the ancillary modes enable the autonomous transformation to a frustration-free Ising model that preserves the ground states encoded in the DOPO modes. Such frustration elimination may empower current CIMs to improve precision and to benefit from quantum effects in dealing with frustrated Ising models.


title: Mixed strategy approach destabilizes cooperation in finite populations with clustering coefficient

abstract: Evolutionary game theory, encompassing discrete, continuous, and mixed strategies, is pivotal for understanding cooperation dynamics. Discrete strategies involve deterministic actions with a fixed probability of one, whereas continuous strategies employ intermediate probabilities to convey the extent of cooperation and emphasize expected payoffs. Mixed strategies, though akin to continuous ones, calculate immediate payoffs based on the action chosen at a given moment within intermediate probabilities. Although previous research has highlighted the distinct impacts of these strategic approaches on fostering cooperation, the reasons behind the differing levels of cooperation among these approaches have remained somewhat unclear. This study explores how these strategic approaches influence cooperation in the context of the prisoner's dilemma game, particularly in networked populations with varying clustering coefficients. Our research goes beyond existing studies by revealing that the differences in cooperation levels between these strategic approaches are not confined to finite populations; they also depend on the clustering coefficients of these populations. In populations with nonzero clustering coefficients, we observed varying degrees of stable cooperation for each strategic approach across multiple simulations, with mixed strategies showing the most variability, followed by continuous and discrete strategies. However, this variability in cooperation evolution decreased in populations with a clustering coefficient of zero, narrowing the differences in cooperation levels among the strategies. These findings suggest that in more realistic settings, the robustness of cooperation systems may be compromised, as the evolution of cooperation through mixed and continuous strategies introduces a degree of unpredictability.


title: Effect of particle size on the phase transformation behavior and equation of state of Si under hydrostatic loading

abstract: High-pressure synchrotron X-ray diffraction (XRD) studies have been conducted on three types of Si particles (micron, 100 nm, and 30 nm). The pressure for initiation of Si-I->Si-II phase transformation (PT) essentially increases with a reduction in particle size. For 30 nm Si particles, Si-I directly transforms to Si-XI by skipping the intermediate Si-II phase, which appears during the pressure release. The evolution of phase fractions of Si particles under hydrostatic compression is studied. The equation of state (EOS) of Si-I, Si-II, Si-V, and Si-XI for all three particle sizes is determined, and the results are compared with other studies. A simple iterative procedure is suggested to extract the EOS of Si-XI and Si-II from the data for a mixture of two and three phases with different pressures in each phase. Using previous atomistic simulations, EOS for Si-II is extended to ambient pressure, which is important for plastic strain-induced phase transformations. Surprisingly, the EOS of micron and 30 nm Si are identical, but different from 100 nm particles. In particular, the Si-I phase of 100 nm Si is less compressible than that of micron and 30 nm Si. The reverse Si-V->Si-I PT is observed for the first time after complete pressure release to the ambient for 100 nm particles.


title: The Folland-Stein spectrum of some Heisenberg Bieberbach manifolds

abstract: We study the eigenvalues and eigenfunctions of the Folland-Stein operator $\mathscr{L}_\alpha$ on some examples of 3-dimensional Heisenberg Bieberbach manifolds, that is, compact quotients $\Gamma\backslash\mathbb{H}$ of the Heisenberg group $\mathbb{H}$ by a discrete torsion-free subgroup $\Gamma$ of $\mathbb{H}\rtimes U(1)$.


title: A note on Suslin matrices and Clifford algebras

abstract: We give a conceptual explanation for the somewhat mysterious origin of Suslin matrices. This enables us to generalize the construction of Suslin matrices and to give more conceptual proofs of some well-known results.


title: The Umeyama algorithm for matching correlated Gaussian geometric models in the low-dimensional regime

abstract: Motivated by the problem of matching two correlated random geometric graphs, we study the problem of matching two Gaussian geometric models correlated through a latent node permutation. Specifically, given an unknown permutation $\pi^*$ on $\{1,\ldots,n\}$ and given $n$ i.i.d. pairs of correlated Gaussian vectors $\{X_{\pi^*(i)},Y_i\}$ in $\mathbb{R}^d$ with noise parameter $\sigma$, we consider two types of (correlated) weighted complete graphs with edge weights given by $A_{i,j}=\langle X_i,X_j \rangle$, $B_{i,j}=\langle Y_i,Y_j \rangle$. The goal is to recover the hidden vertex correspondence $\pi^*$ based on the observed matrices $A$ and $B$. For the low-dimensional regime where $d=O(\log n)$, Wang, Wu, Xu, and Yolou [WWXY22+] established the information thresholds for exact and almost exact recovery in matching correlated Gaussian geometric models. They also conducted numerical experiments for the classical Umeyama algorithm. In our work, we prove that this algorithm achieves exact recovery of $\pi^*$ when the noise parameter $\sigma=o(d^{-3}n^{-2/d})$, and almost exact recovery when $\sigma=o(d^{-3}n^{-1/d})$. Our results approach the information thresholds up to a $\operatorname{poly}(d)$ factor in the low-dimensional regime.


title: Multimodal Transformer With a Low-Computational-Cost Guarantee

abstract: Transformer-based models have significantly improved performance across a range of multimodal understanding tasks, such as visual question answering and action recognition. However, multimodal Transformers significantly suffer from a quadratic complexity of the multi-head attention with the input sequence length, especially as the number of modalities increases. To address this, we introduce Low-Cost Multimodal Transformer (LoCoMT), a novel multimodal attention mechanism that aims to reduce computational cost during training and inference with minimal performance loss. Specifically, by assigning different multimodal attention patterns to each attention head, LoCoMT can flexibly control multimodal signals and theoretically ensures a reduced computational cost compared to existing multimodal Transformer variants. Experimental results on two multimodal datasets, namely Audioset and MedVidCL demonstrate that LoCoMT not only reduces GFLOPs but also matches or even outperforms established models.


title: Learning solution operators of PDEs defined on varying domains via MIONet

abstract: In this work, we propose a method to learn the solution operators of PDEs defined on varying domains via MIONet, and theoretically justify this method. We first extend the approximation theory of MIONet to further deal with metric spaces, establishing that MIONet can approximate mappings with multiple inputs in metric spaces. Subsequently, we construct a set consisting of some appropriate regions and provide a metric on this set thus make it a metric space, which satisfies the approximation condition of MIONet. Building upon the theoretical foundation, we are able to learn the solution mapping of a PDE with all the parameters varying, including the parameters of the differential operator, the right-hand side term, the boundary condition, as well as the domain. Without loss of generality, we for example perform the experiments for 2-d Poisson equations, where the domains and the right-hand side terms are varying. The results provide insights into the performance of this method across convex polygons, polar regions with smooth boundary, and predictions for different levels of discretization on one task. We also show the additional result of the fully-parameterized case in the appendix for interested readers. Reasonably, we point out that this is a meshless method, hence can be flexibly used as a general solver for a type of PDE.


title: Magnetic Field at the Galactic Centre from Multi-Wavelength Dust Polarization

abstract: We have mapped the magnetic field ($B$-field) for a region of about 30 pc around the centre of our Galaxy, which encompasses the circumnuclear disk (CND), the minispiral, and the 20 km s$^{-1}$ and 50 km s$^{-1}$ molecular clouds, using thermal dust polarization observations obtained from SOFIA/HAWC+ and JCMT/SCUPOL. We decompose the spectra of $^{12}$CO ($J\!=\!3\!\rightarrow\!2$) transition from this region into individual cloud components and find the polarization observed at different wavelengths might be tracing completely different layers of dust along the line of sight. We use modified Davis-Chandrasekhar-Fermi methods to measure the strength of $B$-field projected in the plane of the sky ($B_{{}_{\mathrm{POS}}}$). The mean $B_{{}_{\mathrm{POS}}}$ of the CND and the minispiral, probed at 53 $\mu$m is of the order of $\sim\!2$ mG. $B_{{}_{\mathrm{POS}}}\!\!\!<\!1$ mG close to the Galactic Centre, in the region of the ionized mini-cavity within the CND, and increases outwards. However, the longer wavelength polarization at 216 $\mu$m appears to come from a dust layer that is cooler and behind the CND and has a stronger $B$-field of about 7 mG. The $B$-field strength is lowest along the Eastern Arm of the minispiral, which is also the only region with Alfv\'en Mach number, $\mathcal{M}_{\mathrm{A}}>1$ and mass-to-flux ratio, $\lambda\!\gtrsim\!1$. Such an observed weak $B$-field could be a result of the low resolution of the observation, where the tangled $B$-fields due to the strong turbulence in the high density clumps of the CND are lost within the beam size of the observation.


title: Understanding the radio luminosity function of star-forming galaxies and its cosmological evolution

abstract: We explore the redshift evolution of the radio luminosity function (RLF) of star-forming galaxies using GALFORM, a semi-analytic model of galaxy formation and a dynamo model of the magnetic field evolving in a galaxy. Assuming energy equipartition between the magnetic field and cosmic rays, we derive the synchrotron luminosity of each sample galaxy. In a model where the turbulent speed is correlated with the star formation rate, the RLF is in fair agreement with observations in the redshift range $0 \leq z \leq 2$. At larger redshifts, the structure of galaxies, their interstellar matter and turbulence appear to be rather different from those at $z\lesssim2$, so that the turbulence and magnetic field models applicable at low redshifts become inadequate. The strong redshift evolution of the RLF at $0 \leq z \leq 2$ can be attributed to an increased number, at high redshift, of galaxies with large disc volumes and strong magnetic fields. On the other hand, in models where the turbulent speed is a constant or an explicit function of $z$, the observed redshift evolution of the RLF is poorly captured. The evolution of the interstellar turbulence and outflow parameters appear to be major (but not the only) drivers of the RLF changes. We find that both the small- and large-scale magnetic fields contribute to the RLF but the small-scale field dominates at high redshifts. Polarisation observations will therefore be important to distinguish these two components and understand better the evolution of galaxies and their nonthermal constituents.


title: Studying LLM Performance on Closed- and Open-source Data

abstract: Large Language models (LLMs) are finding wide use in software engineering practice. These models are extremely data-hungry, and are largely trained on open-source (OSS) code distributed with permissive licenses. In terms of actual use however, a great deal of software development still occurs in the for-profit/proprietary sphere, where the code under development is not, and never has been, in the public domain; thus, many developers, do their work, and use LLMs, in settings where the models may not be as familiar with the code under development. In such settings, do LLMs work as well as they do for OSS code? If not, what are the differences? When performance differs, what are the possible causes, and are there work-arounds? In this paper, we examine this issue using proprietary, closed-source software data from Microsoft, where most proprietary code is in C# and C++. We find that performance for C# changes little from OSS --> proprietary code, but does significantly reduce for C++; we find that this difference is attributable to differences in identifiers. We also find that some performance degradation, in some cases, can be ameliorated efficiently by in-context learning.


title: The accretion of a solar mass per day by a 17-billion solar mass black hole

abstract: Around a million quasars have been catalogued in the Universe by probing deeper and using new methods for discovery. However, the hardest ones to find seem to be the rarest and brightest specimen. In this work, we study the properties of the most luminous of all quasars found so far. It has been overlooked until recently, which demonstrates that modern all-sky surveys have much to reveal. The black hole in this quasar accretes around one solar mass per day onto an existing mass of $\sim$17 billion solar masses. In this process its accretion disc alone releases a radiative energy of $2\times 10^{41}$ Watts. If the quasar is not strongly gravitationally lensed, then its broad line region (BLR) is expected to have the largest physical and angular diameter occurring in the Universe, and will allow the Very Large Telescope Interferometer to image its rotation and measure its black hole mass directly. This will be an important test for BLR size-luminosity relations, whose extrapolation has underpinned common black-hole mass estimates at high redshift.


title: Trajectory-wise Iterative Reinforcement Learning Framework for Auto-bidding

abstract: In online advertising, advertisers participate in ad auctions to acquire ad opportunities, often by utilizing auto-bidding tools provided by demand-side platforms (DSPs). The current auto-bidding algorithms typically employ reinforcement learning (RL). However, due to safety concerns, most RL-based auto-bidding policies are trained in simulation, leading to a performance degradation when deployed in online environments. To narrow this gap, we can deploy multiple auto-bidding agents in parallel to collect a large interaction dataset. Offline RL algorithms can then be utilized to train a new policy. The trained policy can subsequently be deployed for further data collection, resulting in an iterative training framework, which we refer to as iterative offline RL. In this work, we identify the performance bottleneck of this iterative offline RL framework, which originates from the ineffective exploration and exploitation caused by the inherent conservatism of offline RL algorithms. To overcome this bottleneck, we propose Trajectory-wise Exploration and Exploitation (TEE), which introduces a novel data collecting and data utilization method for iterative offline RL from a trajectory perspective. Furthermore, to ensure the safety of online exploration while preserving the dataset quality for TEE, we propose Safe Exploration by Adaptive Action Selection (SEAS). Both offline experiments and real-world experiments on Alibaba display advertising platform demonstrate the effectiveness of our proposed method.


title: Ab initio calculation of the nonequilibrium adsorption energy

abstract: While first-principles calculations of electrode-molecule binding play an indispensable role in obtaining atomic-level understanding in surface science and electrochemistry, a significant challenge remains because the adsorption energy is well-defined only in equilibrium. Herein, a theory to calculate the electric enthalpy for electrochemical interfaces is formulated within the multi-space constrained-search density functional theory (MS-DFT), which provides the nonequilibrium total energy of a nanoscale electrode-channel-electrode junction. An additional MS-DFT calculation for the electrode-only counterpart that maintains the same bias voltage allows one to identify the internal energy of the channel as well as the electric field and the channel polarization, which together determine the electric enthalpy and the nonequilibrium adsorption energy. Application of the developed scheme to the water-Au and water-graphene interface models shows that the Au and graphene electrodes induce very different behaviors in terms of the electrode potential-dependent stabilization of water configurations. The theory developed here will be a valuable tool in the ongoing effort to obtain an atomic-scale understanding of bias-dependent molecular reorganizations in electrified interfaces.


title: On vertices of frontals in the Euclidean plane

abstract: We investigate vertices for plane curves with singular points. As plane curves with singular points, we consider Legendre curves (respectively, Legendre immersions) in the unit tangent bundle over the Euclidean plane and frontals (respectively, fronts) in the Euclidean plane. We define a vertex using evolutes of frontals. After that we define a vertex of a frontal in the general case. It is also known that the four vertex theorem does not hold for simple closed fronts. We give conditions under which a frontal has a vertex and the four vertex theorem holds for closed frontals. We also give examples and counter examples of the four vertex theorem.


title: A First Look at GPT Apps: Landscape and Vulnerability

abstract: Following OpenAI's introduction of GPTs, a surge in GPT apps has led to the launch of dedicated LLM app stores. Nevertheless, given its debut, there is a lack of sufficient understanding of this new ecosystem. To fill this gap, this paper presents a first comprehensive longitudinal (5-month) study of the evolution, landscape, and vulnerability of the emerging LLM app ecosystem, focusing on two GPT app stores: \textit{GPTStore.AI} and the official \textit{OpenAI GPT Store}. Specifically, we develop two automated tools and a TriLevel configuration extraction strategy to efficiently gather metadata (\ie names, creators, descriptions, \etc) and user feedback for all GPT apps across these two stores, as well as configurations (\ie system prompts, knowledge files, and APIs) for the top 10,000 popular apps. Our extensive analysis reveals: (1) the user enthusiasm for GPT apps consistently rises, whereas creator interest plateaus within three months of GPTs' launch; (2) nearly 90\% system prompts can be easily accessed due to widespread failure to secure GPT app configurations, leading to considerable plagiarism and duplication among apps. Our findings highlight the necessity of enhancing the LLM app ecosystem by the app stores, creators, and users.


title: Sampling-based Distributed Training with Message Passing Neural Network

abstract: In this study, we introduce a domain-decomposition-based distributed training and inference approach for message-passing neural networks (MPNN). Our objective is to address the challenge of scaling edge-based graph neural networks as the number of nodes increases. Through our distributed training approach, coupled with Nystr\"om-approximation sampling techniques, we present a scalable graph neural network, referred to as DS-MPNN (D and S standing for distributed and sampled, respectively), capable of scaling up to $O(10^5)$ nodes. We validate our sampling and distributed training approach on two cases: (a) a Darcy flow dataset and (b) steady RANS simulations of 2-D airfoils, providing comparisons with both single-GPU implementation and node-based graph convolution networks (GCNs). The DS-MPNN model demonstrates comparable accuracy to single-GPU implementation, can accommodate a significantly larger number of nodes compared to the single-GPU variant (S-MPNN), and significantly outperforms the node-based GCN.


title: On the weak Harder-Narasimhan stratification on $B_{\mathrm{dR}}^+$-affine Grassmannian

abstract: We consider the Harder-Narasimhan formalism on the category of normed isocrystals and show that the Harder-Narasimhan filtration is compatible with tensor products which generalizes a result of Cornut. As an application of this result, we are able to define a (weak) Harder-Narasimhan stratification on the $B_{\mathrm{dR}}^+$-affine Grassmannian for arbitrary $(G, b, \mu)$. When $\mu$ is minuscule, it corresponds to the Harder-Narasimhan stratification on the flag varieties defined by Dat-Orlik-Rapoport. And when $b$ is basic, it's studied by Nguyen-Viehmann and Shen. We study the basic geometric properties of the Harder-Narasimhan stratification, such as non-emptiness, dimension and its relation with other stratifications.


title: A Contextual Inquiry of People with Vision Impairments in Cooking

abstract: Individuals with vision impairments employ a variety of strategies for object identification, such as pans or soy sauce, in the culinary process. In addition, they often rely on contextual details about objects, such as location, orientation, and current status, to autonomously execute cooking activities. To understand how people with vision impairments collect and use the contextual information of objects while cooking, we conducted a contextual inquiry study with 12 participants in their own kitchens. This research aims to analyze object interaction dynamics in culinary practices to enhance assistive vision technologies for visually impaired cooks. We outline eight different types of contextual information and the strategies that blind cooks currently use to access the information while preparing meals. Further, we discuss preferences for communicating contextual information about kitchen objects as well as considerations for the deployment of AI-powered assistive technologies.


title: Machine Unlearning by Suppressing Sample Contribution

abstract: Machine Unlearning (MU) is to forget data from a well-trained model, which is practically important due to the "right to be forgotten". In this paper, we start from the fundamental distinction between training data and unseen data on their contribution to the model: the training data contributes to the final model while the unseen data does not. We theoretically discover that the input sensitivity can approximately measure the contribution and practically design an algorithm, called MU-Mis (machine unlearning via minimizing input sensitivity), to suppress the contribution of the forgetting data. Experimental results demonstrate that MU-Mis outperforms state-of-the-art MU methods significantly. Additionally, MU-Mis aligns more closely with the application of MU as it does not require the use of remaining data.


title: A study of the Inspiral-Merger-Ringdown Consistency Test with gravitational-wave signals from compact binaries in eccentric orbits

abstract: The Inspiral Merger Ringdown Consistency Test (IMRCT) is one among a battery of tests of general relativity (GR) employed by the LIGO-Virgo-KAGRA (LVK) collaboration. It is used to search for deviations from GR in detected gravitational waves (GWs) from compact binary coalescences (CBCs) in a model-agnostic way. The test compares source parameter estimates extracted independently from the inspiral and post-inspiral portions of the CBC signals and, therefore, crucially relies on the accurate modeling of the waveform. Current implementations of the IMRCT routinely use quasicircular waveforms, under the assumption that the residual eccentricity of the binary when the emitted GWs enter the frequency band of the LVK detector network will be negligible. In this work, we perform a detailed study to investigate the typical magnitudes of this residual eccentricity that could potentially lead to spurious violations of the IMRCT. To that end, we conduct injection campaigns for a range of eccentricities and recover with both quasicircular and eccentric waveforms. We find that an eccentric GW signal from a GW150914-like system with $e_{\text{gw}} \gtrsim$ 0.04 at an orbit averaged frequency $\langle f_{\text{ref}} \rangle=$ 25 Hz breaks the IMRCT if recovered with quasicircular waveforms at $\gtrsim 68\%$ confidence. The violation becomes more severe ($\gtrsim 90\%$ confidence) for $e_{\text{gw}} =$ 0.055 at $\langle f_{\text{ref}} \rangle=$ 25 Hz. On the other hand, when eccentric waveforms are used, the IMRCT remains intact for all eccentricities considered. We also briefly investigate the effect of the magnitude and orientation (aligned/antialigned) of the component spins of the binary on the extent of the spurious violations of the IMRCT. Our work, therefore, demonstrates the need for accurate eccentric waveform models in the context of tests of GR.


title: Chu-ko-nu: A Reliable, Efficient, and Anonymously Authentication-Enabled Realization for Multi-Round Secure Aggregation in Federated Learning

abstract: Secure aggregation enables federated learning (FL) to perform collaborative training of clients from local gradient updates without exposing raw data. However, existing secure aggregation schemes inevitably perform an expensive fresh setup per round because each client needs to establish fresh input-independent secrets over different rounds. The latest research, Flamingo (S&P 2023), designed a share-transfer-based reusable secret key to support the server continuously performing multiple rounds of aggregation. Nevertheless, the share transfer mechanism it proposed can only be achieved with P probability, which has limited reliability. To tackle the aforementioned problems, we propose a more reliable and anonymously authenticated scheme called Chu-ko-nu for multi-round secure aggregation. Specifically, in terms of share transfer, Chu-ko-nu breaks the probability P barrier by supplementing a redistribution process of secret key components (the sum of all components is the secret key), thus ensuring the reusability of the secret key. Based on this reusable secret key, Chu-ko-nu can efficiently perform consecutive aggregation in the following rounds. Furthermore, considering the client identity authentication and privacy protection issue most approaches ignore, Chu-ko-nu introduces a zero-knowledge proof-based authentication mechanism. It can support clients anonymously participating in FL training and enables the server to authenticate clients effectively in the presence of various attacks. Rigorous security proofs and extensive experiments demonstrated that Chu-ko-nu can provide reliable and anonymously authenticated aggregation for FL with low aggregation costs, at least a 21.02% reduction compared to the state-of-the-art schemes.


title: Gluonic contributions to semi-inclusive DIS in the target fragmentation region

abstract: We study one-loop contributions to semi-inclusive deep inelastic scattering in the target fragmentation region for a polarized lepton beam and nucleon target. Complete one-loop results at leading twist are derived, with a particular focus on the gluonic channel. It shows that four structure functions are generated uniquely by the gluon fracture functions starting at one-loop. Additionally, we obtain two structure functions associated with the longitudinal polarization of the virtual photon, and they are contributed by both gluon and quark channels. By combining existing twist-3 results, all eighteen structure functions for the studied process are predicted in terms of fracture functions convoluted with perturbative coefficient functions.


title: MSPipe: Efficient Temporal GNN Training via Staleness-aware Pipeline

abstract: Memory-based Temporal Graph Neural Networks (MTGNNs) are a class of temporal graph neural networks that utilize a node memory module to capture and retain long-term temporal dependencies, leading to superior performance compared to memory-less counterparts. However, the iterative reading and updating process of the memory module in MTGNNs to obtain up-to-date information needs to follow the temporal dependencies. This introduces significant overhead and limits training throughput. Existing optimizations for static GNNs are not directly applicable to MTGNNs due to differences in training paradigm, model architecture, and the absence of a memory module. Moreover, they do not effectively address the challenges posed by temporal dependencies, making them ineffective for MTGNN training. In this paper, we propose MSPipe, a general and efficient framework for MTGNNs that maximizes training throughput while maintaining model accuracy. Our design addresses the unique challenges associated with fetching and updating node memory states in MTGNNs by integrating staleness into the memory module. However, simply introducing a predefined staleness bound in the memory module to break temporal dependencies may lead to suboptimal performance and lack of generalizability across different models and datasets. To solve this, we introduce an online pipeline scheduling algorithm in MSPipe that strategically breaks temporal dependencies with minimal staleness and delays memory fetching to obtain fresher memory states. Moreover, we design a staleness mitigation mechanism to enhance training convergence and model accuracy. We provide convergence analysis and prove that MSPipe maintains the same convergence rate as vanilla sample-based GNN training. Experimental results show that MSPipe achieves up to 2.45x speed-up without sacrificing accuracy, making it a promising solution for efficient MTGNN training.


title: Cavity based non-destructive detection of photoassociation in a dark MOT

abstract: The photoassociation (PA) of rubidium dimer (Rb2) in a dark magneto-optic trap (MOT) is studied using atom-cavity collective strong coupling. This allows non-destructive detection of the molecule formation process as well as rapid and repeated interrogation of the atom-molecule system. The vacuum Rabi splitting (VRS) measurements from the bright MOT are carefully calibrated against equivalent measurements with fluorescence. Further loading rates in dark MOT are determined using VRS. This method provides a reliable, fast, and non-destructive detection scheme for ultracold molecules when the atoms are non-fluorescing using the free atoms coupled to a cavity.


title: Physics-constrained polynomial chaos expansion for scientific machine learning and uncertainty quantification

abstract: We present a novel physics-constrained polynomial chaos expansion as a surrogate modeling method capable of performing both scientific machine learning (SciML) and uncertainty quantification (UQ) tasks. The proposed method possesses a unique capability: it seamlessly integrates SciML into UQ and vice versa, which allows it to quantify the uncertainties in SciML tasks effectively and leverage SciML for improved uncertainty assessment during UQ-related tasks. The proposed surrogate model can effectively incorporate a variety of physical constraints, such as governing partial differential equations (PDEs) with associated initial and boundary conditions constraints, inequality-type constraints (e.g., monotonicity, convexity, non-negativity, among others), and additional a priori information in the training process to supplement limited data. This ensures physically realistic predictions and significantly reduces the need for expensive computational model evaluations to train the surrogate model. Furthermore, the proposed method has a built-in uncertainty quantification (UQ) feature to efficiently estimate output uncertainties. To demonstrate the effectiveness of the proposed method, we apply it to a diverse set of problems, including linear/non-linear PDEs with deterministic and stochastic parameters, data-driven surrogate modeling of a complex physical system, and UQ of a stochastic system with parameters modeled as random fields.


title: Large Multimodal Agents: A Survey

abstract: Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on extending these LLM-powered AI agents into the multimodal domain. This extension enables AI agents to interpret and respond to diverse multimodal user queries, thereby handling more intricate and nuanced tasks. In this paper, we conduct a systematic review of LLM-driven multimodal agents, which we refer to as large multimodal agents ( LMAs for short). First, we introduce the essential components involved in developing LMAs and categorize the current body of research into four distinct types. Subsequently, we review the collaborative frameworks integrating multiple LMAs , enhancing collective efficacy. One of the critical challenges in this field is the diverse evaluation methods used across existing studies, hindering effective comparison among different LMAs . Therefore, we compile these evaluation methodologies and establish a comprehensive framework to bridge the gaps. This framework aims to standardize evaluations, facilitating more meaningful comparisons. Concluding our review, we highlight the extensive applications of LMAs and propose possible future research directions. Our discussion aims to provide valuable insights and guidelines for future research in this rapidly evolving field. An up-to-date resource list is available at https://github.com/jun0wanan/awesome-large-multimodal-agents.


title: The KSBA moduli space of stable log Calabi-Yau surfaces

abstract: We prove that every irreducible component of the coarse Koll\'ar-Shepherd-Barron and Alexeev (KSBA) moduli space of stable log Calabi-Yau surfaces is a finite quotient of a projective toric variety. This verifies a conjecture of Hacking-Keel-Yu. The proof combines tools from log smooth deformation theory, the minimal model program, punctured log Gromov-Witten theory and mirror symmetry.


title: Calabi-Yau type theorem for complete manifolds with nonnegative scalar curvature

abstract: In this paper, we are able to prove an analogy of the Calabi-Yau theorem for complete Riemannian manifolds with nonnegative scalar curvature which are aspherical at infinity. The key tool is an existence result for arbitrarily large bounded regions with weakly mean-concave boundary in Riemannian manifolds with sublinear volume growth. As an application, we use the same tool to show that a complete contractible Riemannian $3$-manifold with positive scalar curvature and sublinear volume growth is necessarily homeomorphic to $\mathbb R^3$.


title: A multidisciplinary framework for deconstructing bots' pluripotency in dualistic antagonism

abstract: Anthropomorphic social bots are engineered to emulate human verbal communication and generate toxic or inflammatory content across social networking services (SNSs). Bot-disseminated misinformation could subtly yet profoundly reshape societal processes by complexly interweaving factors like repeated disinformation exposure, amplified political polarization, compromised indicators of democratic health, shifted perceptions of national identity, propagation of false social norms, and manipulation of collective memory over time. However, extrapolating bots' pluripotency across hybridized, multilingual, and heterogeneous media ecologies from isolated SNS analyses remains largely unknown, underscoring the need for a comprehensive framework to characterise bots' emergent risks to civic discourse. Here we propose an interdisciplinary framework to characterise bots' pluripotency, incorporating quantification of influence, network dynamics monitoring, and interlingual feature analysis. When applied to the geopolitical discourse around the Russo-Ukrainian conflict, results from interlanguage toxicity profiling and network analysis elucidated spatiotemporal trajectories of pro-Russian and pro-Ukrainian human and bots across hybrid SNSs. Weaponized bots predominantly inhabited X, while human primarily populated Reddit in the social media warfare. This rigorous framework promises to elucidate interlingual homogeneity and heterogeneity in bots' pluripotent behaviours, revealing synergistic human-bot mechanisms underlying regimes of information manipulation, echo chamber formation, and collective memory manifestation in algorithmically structured societies.


title: Fine-tuning CLIP Text Encoders with Two-step Paraphrasing

abstract: Contrastive language-image pre-training (CLIP) models have demonstrated considerable success across various vision-language tasks, such as text-to-image retrieval, where the model is required to effectively process natural language input to produce an accurate visual output. However, current models still face limitations in dealing with linguistic variations in input queries, such as paraphrases, making it challenging to handle a broad range of user queries in real-world applications. In this study, we introduce a straightforward fine-tuning approach to enhance the representations of CLIP models for paraphrases. Our approach involves a two-step paraphrase generation process, where we automatically create two categories of paraphrases from web-scale image captions by leveraging large language models. Subsequently, we fine-tune the CLIP text encoder using these generated paraphrases while freezing the image encoder. Our resulting model, which we call ParaCLIP, exhibits significant improvements over baseline CLIP models across various tasks, including paraphrased retrieval (with rank similarity scores improved by up to 2.0% and 5.6%), Visual Genome Relation and Attribution, as well as seven semantic textual similarity tasks.


title: Toward High Performance, Programmable Extreme-Edge Intelligence for Neuromorphic Vision Sensors utilizing Magnetic Domain Wall Motion-based MTJ

abstract: The desire to empower resource-limited edge devices with computer vision (CV) must overcome the high energy consumption of collecting and processing vast sensory data. To address the challenge, this work proposes an energy-efficient non-von-Neumann in-pixel processing solution for neuromorphic vision sensors employing emerging (X) magnetic domain wall magnetic tunnel junction (MDWMTJ) for the first time, in conjunction with CMOS-based neuromorphic pixels. Our hybrid CMOS+X approach performs in-situ massively parallel asynchronous analog convolution, exhibiting low power consumption and high accuracy across various CV applications by leveraging the non-volatility and programmability of the MDWMTJ. Moreover, our developed device-circuit-algorithm co-design framework captures device constraints (low tunnel-magnetoresistance, low dynamic range) and circuit constraints (non-linearity, process variation, area consideration) based on monte-carlo simulations and device parameters utilizing GF22nm FD-SOI technology. Our experimental results suggest we can achieve an average of 45.3% reduction in backend-processor energy, maintaining similar front-end energy compared to the state-of-the-art and high accuracy of 79.17% and 95.99% on the DVS-CIFAR10 and IBM DVS128-Gesture datasets, respectively.


title: Measurements of low energy nuclear recoil quenching factors for Na and I recoils in the NaI(Tl) scintillator

abstract: Elastic scattering off nuclei in target detectors, involving interactions with dark matter and coherent elastic neutrino nuclear recoil (CE$\nu$NS), results in the deposition of low energy within the nuclei, dissipating rapidly through a combination of heat and ionization. The primary energy loss mechanism for nuclear recoil is heat, leading to consistently smaller measurable scintillation signals compared to electron recoils of the same energy. The nuclear recoil quenching factor (QF), representing the ratio of scintillation light yield produced by nuclear recoil to that of electron recoil at the same energy, is a critical parameter for understanding dark matter and neutrino interactions with nuclei. The low energy QF of NaI(Tl) crystals, commonly employed in dark matter searches and CE$\nu$NS measurements, is of substantial importance. Previous low energy QF measurements were constrained by contamination from photomultiplier tube (PMT)-induced noise, resulting in an observed light yield of approximately 15 photoelectrons per keVee (kilo-electron-volt electron-equivalent energy) and nuclear recoil energy above 5 keVnr (kilo-electron-volt nuclear recoil energy). Through enhanced crystal encapsulation, an increased light yield of around 26 photoelectrons per keVee is achieved. This improvement enables the measurement of the nuclear recoil QF for sodium nuclei at an energy of 3.8 $\pm$ 0.6 keVnr with a QF of 11.2 $\pm$ 1.7%. Furthermore, a reevaluation of previously reported QF results is conducted, incorporating enhancements in low energy events based on waveform simulation. The outcomes are generally consistent with various recent QF measurements for sodium and iodine.


title: Turbulent Accelerating Combusting Flows with a Methane-Vitiated Air Flamelet Model

abstract: This work presents a numerical study of a diffusion flame in a reacting, two-dimensional, turbulent, viscous, multi-component, compressible mixing layer subject to a large favorable streamwise pressure gradient. The boundary-layer equations, coupled with the SST turbulence model, are solved using a sub-grid, turbulence-aware flamelet model. The flamelet model employs a 13-species, 32-elementary reaction, methane-air reaction mechanism and a flamelet progress variable (FPV) approach. The model is applied to both pure air and vitiated air, the latter being particularly relevant in turbine-burner scenarios. Boundary-layer results, when compared to Navier-Stokes solutions, consistently under-predict mixing layer Navier-Stokes growth in upstream locations due to reduced accuracy locally. Thus, mixing layer and flame locations are shifted towards the fuel-side. A comparison is made with results obtained using a simplified one-step reaction mechanism to provide insights in flow and flame structure differences resulting from the detailed reaction mechanism. The FPV solutions with the more detailed reaction mechanism show faster chemistry compared to the one-step reaction approach and report shorter ignition delays. Furthermore, the FPV solutions show considerable carbon monoxide production in the reaction zone and significantly reduced peak temperatures. Ignition delay causes oxygen to be entrained from the air-side to the fuel-side. Effects of vitiated air on the flow and combustion process are observed with a weak flame characterized by lower peak temperature and impeded development.


title: Gauge coupling unification and proton decay via 45 Higgs boson in SU(5) GUT

abstract: We study the gauge coupling unification (GCU) and proton decay in a non-supersymmetric SU(5) grand unified theory (GUT) incorporating a 45 representation Higgs field. Our analysis is based on the assumption that Georgi-Jarlskog-type mass matrices for fermions are responsible for explaining the mass ratio of the strange quark and the muon. We examine the conditions of GCU, taking into account the possibility that certain components of the 45 Higgs field have masses much smaller than the GUT scale. We have found that to satisfy the GCU conditions, at least two components of the 45 Higgs field should have such small masses. We search the parameter space to identify regions where the GCU conditions are satisfied, in the scenarios where two or three components of the 45 Higgs boson are hierarchically light. If the colored Higgs component of the 45 Higgs boson has a mass much smaller than the GUT scale, proton decay via colored Higgs boson exchange can occur with an observably large rate. We estimate the mass bounds for the colored Higgs component from the proton decay search at Super- Kamiokande and thereby further restrict the parameter space.


title: Accelerating Convergence of Stein Variational Gradient Descent via Deep Unfolding

abstract: Stein variational gradient descent (SVGD) is a prominent particle-based variational inference method used for sampling a target distribution. SVGD has attracted interest for application in machine-learning techniques such as Bayesian inference. In this paper, we propose novel trainable algorithms that incorporate a deep-learning technique called deep unfolding,into SVGD. This approach facilitates the learning of the internal parameters of SVGD, thereby accelerating its convergence speed. To evaluate the proposed trainable SVGD algorithms, we conducted numerical simulations of three tasks: sampling a one-dimensional Gaussian mixture, performing Bayesian logistic regression, and learning Bayesian neural networks. The results show that our proposed algorithms exhibit faster convergence than the conventional variants of SVGD.


title: Friction and Memory Effects in Homogeneous Gas-Liquid Nucleation: Quest for Quantitative Rate Calculation

abstract: The task of a first principles theoretical calculation of the rate of gas to liquid nucleation has remained largely incomplete despite the existence of reliable results from unbiased simulation studies at large supersaturation. Although the classical nucleation theory, formulated by Becker-Doring-Zeldovich (BDZ) about a century ago, provides an elegant, widely-used picture of nucleation in a first-order phase transition, the theory finds difficulties in predicting the rate accurately, especially in the case of gas-to-liquid nucleation. Here, we use a multiple-order parameter description to construct the nucleation free energy surface needed to calculate the nucleation rate. A multidimensional non-Markovian rate theory formulation that generalizes Langer's well-known nucleation theory by using Grote-Hynes multidimensional non-Markovian treatment is used to obtain the rate of barrier crossing. We find good agreement of the theory with the rate obtained by direct unbiased molecular dynamics simulations, the latter is feasible at large supersaturation, S. The theory gives the experimentally strong dependence of the rate of nucleation on supersaturation, S. Interestingly, we find a strong influence of frequency-dependent friction at the barrier top. This arises from multiple recrossing of the barrier surface. We find that a Markovian theory, such as Langer's formulation, fails to capture the rate quantitatively. In addition, the multidimensional transition state theory expression performs poorly, revealing the underlying role of friction.


title: Multi-Armed Bandits with Abstention

abstract: We introduce a novel extension of the canonical multi-armed bandit problem that incorporates an additional strategic element: abstention. In this enhanced framework, the agent is not only tasked with selecting an arm at each time step, but also has the option to abstain from accepting the stochastic instantaneous reward before observing it. When opting for abstention, the agent either suffers a fixed regret or gains a guaranteed reward. Given this added layer of complexity, we ask whether we can develop efficient algorithms that are both asymptotically and minimax optimal. We answer this question affirmatively by designing and analyzing algorithms whose regrets meet their corresponding information-theoretic lower bounds. Our results offer valuable quantitative insights into the benefits of the abstention option, laying the groundwork for further exploration in other online decision-making problems with such an option. Numerical results further corroborate our theoretical findings.


title: Ill-posedness and global solution for the $b$-equation

abstract: In this paper, we consider the Cauchy problem for the $b$-equation. Firstly, for $s>\frac32,$ if $u_{0}(x)\in H^{s}(\mathbb{R})$ and $m_{0}(x)=u_{0}(x)-u_{0xx}(x)\in L^{1}(\mathbb{R}),$ the global solutions of the $b$-equation is established when $b\geq1$ or $b\leq1.$ It's worth noting that our global result is a new result which doesn't need the condition that $m_{0}(x)$ keeps its sign. For $s<\frac32,$ it is shown (see [13]) that the Cauchy problem of the $b$-equation is ill-posed in Sobolev space $H^{s}(\mathbb{R})$ when $b>1$ or $b<1.$ In the present paper, for $s=\frac32,$ we prove that the Cauchy problem of the $b$-equation is also ill-posed in $H^{\frac32}(\mathbb{R})$ in the sense of norm inflation by constructing a class of special initial data when $b\neq1.$


title: Shadowing and the basins of terminal chain components

abstract: We provide an alternative view of some results in [1, 3, 11]. In particular, we prove that (1) if a continuous self-map of a compact metric space has the shadowing, then the union of the basins of terminal chain components is a dense $G_\delta$-subset of the space; and (2) if a continuous self-map of a locally connected compact metric space has the shadowing, and if the chain recurrent set is totally disconnected, then the map is almost chain continuous.


title: Diffusion Processes on $p$-Wasserstein Space over Banach Space

abstract: To study diffusion processes on the $p$-Wasserstein space $\scr P_p $ for $p\in [1,\infty)$ over a separable, reflexive Banach space $X$, we present a criterion on the quasi-regularity of Dirichlet forms in $L^2(\scr P_p,\Lambda)$ for a reference probability $\Lambda$ on $\scr P_p$. It is formulated in terms of an upper bound condition with the uniform norm of the intrinsic derivative. The condition is easy to check in relevant applications and allows to construct a type of Ornstein-Uhlenbeck process on $\scr P_p$. We find a versatile class of quasi-regular local Dirichlet forms on $\scr P_p$ by using images of Dirichlet forms on the tangent space $L^p(X\to X,\mu_0)$ at a reference point $\mu_0\in \scr P_p$. The Ornstein-Uhlenbeck type Dirichlet form is an important example in this class. An $L^2$-estimate for the corresponding heat kernel is derived, based on the eigenvalues of the covariance operator of the underlying Gaussian measure.


title: Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models

abstract: This study explores the realm of knowledge-base question answering (KBQA). KBQA is considered a challenging task, particularly in parsing intricate questions into executable logical forms. Traditional semantic parsing (SP)-based methods require extensive data annotations, which result in significant costs. Recently, the advent of few-shot in-context learning, powered by large language models (LLMs), has showcased promising capabilities. Yet, fully leveraging LLMs to parse questions into logical forms in low-resource scenarios poses a substantial challenge. To tackle these hurdles, we introduce Interactive-KBQA, a framework designed to generate logical forms through direct interaction with knowledge bases (KBs). Within this framework, we have developed three generic APIs for KB interaction. For each category of complex question, we devised exemplars to guide LLMs through the reasoning processes. Our method achieves competitive results on the WebQuestionsSP, ComplexWebQuestions, KQA Pro, and MetaQA datasets with a minimal number of examples (shots). Importantly, our approach supports manual intervention, allowing for the iterative refinement of LLM outputs. By annotating a dataset with step-wise reasoning processes, we showcase our model's adaptability and highlight its potential for contributing significant enhancements to the field.


title: Improving Sentence Embeddings with an Automatically Generated NLI Dataset

abstract: Decoder-based large language models (LLMs) have shown high performance on many tasks in natural language processing. This is also true for sentence embedding learning, where a decoder-based model, PromptEOL, has achieved the best performance on semantic textual similarity (STS) tasks. However, PromptEOL makes great use of fine-tuning with a manually annotated natural language inference (NLI) dataset. We aim to improve sentence embeddings learned in an unsupervised setting by automatically generating an NLI dataset with an LLM and using it to fine-tune PromptEOL. In experiments on STS tasks, the proposed method achieved an average Spearman's rank correlation coefficient of 82.21 with respect to human evaluation, thus outperforming existing methods without using large, manually annotated datasets.


title: On the concentration-compactness principle for anisotropic variable exponent Sobolev spaces and its applications

abstract: We obtain critical embeddings and the concentration-compactness principle for the anisotropic variable exponent Sobolev spaces. As an application of these results,we confirm the existence of and find infinitely many nontrivial solutions for a class of nonlinear critical anisotropic elliptic equations involving variable exponents and two real parameters. With the groundwork laid in this work, there is potential for future extensions, particularly in extending the concentration-compactness principle to anisotropic fractional order Sobolev spaces with variable exponents in bounded domains. This extension could find applications in solving the generalized fractional Brezis-Nirenberg problem.


title: Deep Coupling Network For Multivariate Time Series Forecasting

abstract: Multivariate time series (MTS) forecasting is crucial in many real-world applications. To achieve accurate MTS forecasting, it is essential to simultaneously consider both intra- and inter-series relationships among time series data. However, previous work has typically modeled intra- and inter-series relationships separately and has disregarded multi-order interactions present within and between time series data, which can seriously degrade forecasting accuracy. In this paper, we reexamine intra- and inter-series relationships from the perspective of mutual information and accordingly construct a comprehensive relationship learning mechanism tailored to simultaneously capture the intricate multi-order intra- and inter-series couplings. Based on the mechanism, we propose a novel deep coupling network for MTS forecasting, named DeepCN, which consists of a coupling mechanism dedicated to explicitly exploring the multi-order intra- and inter-series relationships among time series data concurrently, a coupled variable representation module aimed at encoding diverse variable patterns, and an inference module facilitating predictions through one forward step. Extensive experiments conducted on seven real-world datasets demonstrate that our proposed DeepCN achieves superior performance compared with the state-of-the-art baselines.


title: Modified CycleGAN for the synthesization of samples for wheat head segmentation

abstract: Deep learning models have been used for a variety of image processing tasks. However, most of these models are developed through supervised learning approaches, which rely heavily on the availability of large-scale annotated datasets. Developing such datasets is tedious and expensive. In the absence of an annotated dataset, synthetic data can be used for model development; however, due to the substantial differences between simulated and real data, a phenomenon referred to as domain gap, the resulting models often underperform when applied to real data. In this research, we aim to address this challenge by first computationally simulating a large-scale annotated dataset and then using a generative adversarial network (GAN) to fill the gap between simulated and real images. This approach results in a synthetic dataset that can be effectively utilized to train a deep-learning model. Using this approach, we developed a realistic annotated synthetic dataset for wheat head segmentation. This dataset was then used to develop a deep-learning model for semantic segmentation. The resulting model achieved a Dice score of 83.4\% on an internal dataset and Dice scores of 79.6% and 83.6% on two external Global Wheat Head Detection datasets. While we proposed this approach in the context of wheat head segmentation, it can be generalized to other crop types or, more broadly, to images with dense, repeated patterns such as those found in cellular imagery.


title: A motivic spectrum representing hermitian K-theory

abstract: We establish fundamental motivic results about hermitian K-theory without assuming that 2 is invertible on the base scheme. In particular, we prove that both quadratic and symmetric Grothendieck-Witt theory satisfy Nisnevich descent, and that symmetric Grothendieck-Witt theory further satisfies d\'evissage and A^1-invariance over a regular Noetherian base of finite Krull dimension, as well as a projective bundle formula. We use this to show that over a regular Noetherian base, symmetric Grothendieck-Witt theory is represented by a motivic E-infinity-ring spectrum, which we then show is an absolutely pure spectrum, answering a question of D\'eglise. As with algebraic K-theory, we show that over a general base, one can also construct a hermitian K-theory motivic spectrum, representing this time a suitable homotopy invariant and Karoubi-localising version of Grothendieck-Witt theory.


title: Benchmarking Observational Studies with Experimental Data under Right-Censoring

abstract: Drawing causal inferences from observational studies (OS) requires unverifiable validity assumptions; however, one can falsify those assumptions by benchmarking the OS with experimental data from a randomized controlled trial (RCT). A major limitation of existing procedures is not accounting for censoring, despite the abundance of RCTs and OSes that report right-censored time-to-event outcomes. We consider two cases where censoring time (1) is independent of time-to-event and (2) depends on time-to-event the same way in OS and RCT. For the former, we adopt a censoring-doubly-robust signal for the conditional average treatment effect (CATE) to facilitate an equivalence test of CATEs in OS and RCT, which serves as a proxy for testing if the validity assumptions hold. For the latter, we show that the same test can still be used even though unbiased CATE estimation may not be possible. We verify the effectiveness of our censoring-aware tests via semi-synthetic experiments and analyze RCT and OS data from the Women's Health Initiative study.


title: Anomaly cancellation and modularity: E8*E8*E8 case

abstract: In [5] and [19], the authors gave anomaly cancellation formulas for the gauge groups E8,E8*E8. In this paper, we mainly deal with the case of gauge group E8*E8*E8. Using the E8*E8*E8 bundle, we construct some modular forms over SL2(Z). By these modular forms, we get some new anomaly cancellation formulas of characteristic forms.


title: Generalized noncooperative Schr\"{o}dinger-Kirchhoff-type systems in $\mathbb{R}^N$

abstract: We consider a class of noncooperative Schr\"{o}dinger-Kirchhoff type system which involves a general variable exponent elliptic operator with critical growth. Under certain suitable conditions on the nonlinearities, we establish the existence of infinitely many solutions for the problem by using the limit index theory, a version of concentration-compactness principle for weighted-variable exponents Sobolev spaces and the principle of symmetric criticality of Krawcewicz and Marzantowicz.


title: A Relation-Interactive Approach for Message Passing in Hyper-relational Knowledge Graphs

abstract: Hyper-relational knowledge graphs (KGs) contain additional key-value pairs, providing more information about the relations. In many scenarios, the same relation can have distinct key-value pairs, making the original triple fact more recognizable and specific. Prior studies on hyper-relational KGs have established a solid standard method for hyper-relational graph encoding. In this work, we propose a message-passing-based graph encoder with global relation structure awareness ability, which we call ReSaE. Compared to the prior state-of-the-art approach, ReSaE emphasizes the interaction of relations during message passing process and optimizes the readout structure for link prediction tasks. Overall, ReSaE gives a encoding solution for hyper-relational KGs and ensures stronger performance on downstream link prediction tasks. Our experiments demonstrate that ReSaE achieves state-of-the-art performance on multiple link prediction benchmarks. Furthermore, we also analyze the influence of different model structures on model performance.


title: A note on the adjoint method for neural ordinary differential equation network

abstract: Perturbation and operator adjoint method are used to give the right adjoint form rigourously. From the derivation, we can have following results: 1) The loss gradient is not an ODE, it is an integral and we shows the reason; 2) The traditional adjoint form is not equivalent with the back propagation results. 3) The adjoint operator analysis shows that if and only if the discrete adjoint has the same scheme with the discrete neural ODE, the adjoint form would give the same results as BP does.


title: Higher-Order Energy-Decreasing Exponential Time Differencing Runge-Kutta methods for Gradient Flows

abstract: In this paper, we develop a general framework for constructing higher-order, unconditionally energy-stable exponential time differencing Runge-Kutta methods applicable to a range of gradient flows. Specifically, we identify conditions sufficient for ETDRK schemes to maintain the original energy dissipation. Our analysis reveals that commonly used third-order and fourth-order ETDRK schemes fail to meet these conditions. To address this, we introduce new third-order ETDRK schemes, designed with appropriate stabilization, which satisfy these conditions and thus guarantee the unconditional energy decaying property. We conduct extensive numerical experiments with these new schemes to verify their accuracy, stability, behavior under large time steps, long-term evolution, and adaptive time stepping strategy across various gradient flows. This study is the first to examine the unconditional energy stability of high-order ETDRK methods, and we are optimistic that our framework will enable the development of ETDRK schemes beyond the third order that are unconditionally energy stable.


title: PUAD: Frustratingly Simple Method for Robust Anomaly Detection

abstract: Developing an accurate and fast anomaly detection model is an important task in real-time computer vision applications. There has been much research to develop a single model that detects either structural or logical anomalies, which are inherently distinct. The majority of the existing approaches implicitly assume that the anomaly can be represented by identifying the anomalous location. However, we argue that logical anomalies, such as the wrong number of objects, can not be well-represented by the spatial feature maps and require an alternative approach. In addition, we focused on the possibility of detecting logical anomalies by using an out-of-distribution detection approach on the feature space, which aggregates the spatial information of the feature map. As a demonstration, we propose a method that incorporates a simple out-of-distribution detection method on the feature space against state-of-the-art reconstruction-based approaches. Despite the simplicity of our proposal, our method PUAD (Picturable and Unpicturable Anomaly Detection) achieves state-of-the-art performance on the MVTec LOCO AD dataset.


title: Polarization Signals from Axion-Photon Resonant Conversion in Neutron Star Magnetosphere

abstract: Neutron stars provide ideal astrophysical laboratories for probing new physics beyond the Standard Model. If axions exist, photons can develop linear polarization during photon-axion conversion in the magnetic field of a neutron star. We find that the plasma in the neutron star magnetosphere could dramatically enhance the polarization through the resonant conversion effect. With the polarization measurements from PSR B0531+21, PSR B0656+14, and 4U 0142+61, we derive new strong constraints on the axion-photon coupling in a broad axion mass range $10^{-11}\lesssim m_a \lesssim 10^{-3}$ eV.


title: The Cost of Parallelizing Boosting

abstract: We study the cost of parallelizing weak-to-strong boosting algorithms for learning, following the recent work of Karbasi and Larsen. Our main results are two-fold: - First, we prove a tight lower bound, showing that even "slight" parallelization of boosting requires an exponential blow-up in the complexity of training. Specifically, let $\gamma$ be the weak learner's advantage over random guessing. The famous \textsc{AdaBoost} algorithm produces an accurate hypothesis by interacting with the weak learner for $\tilde{O}(1 / \gamma^2)$ rounds where each round runs in polynomial time. Karbasi and Larsen showed that "significant" parallelization must incur exponential blow-up: Any boosting algorithm either interacts with the weak learner for $\Omega(1 / \gamma)$ rounds or incurs an $\exp(d / \gamma)$ blow-up in the complexity of training, where $d$ is the VC dimension of the hypothesis class. We close the gap by showing that any boosting algorithm either has $\Omega(1 / \gamma^2)$ rounds of interaction or incurs a smaller exponential blow-up of $\exp(d)$. -Complementing our lower bound, we show that there exists a boosting algorithm using $\tilde{O}(1/(t \gamma^2))$ rounds, and only suffer a blow-up of $\exp(d \cdot t^2)$. Plugging in $t = \omega(1)$, this shows that the smaller blow-up in our lower bound is tight. More interestingly, this provides the first trade-off between the parallelism and the total work required for boosting.


title: Convergence Analysis of Blurring Mean Shift

abstract: Blurring mean shift (BMS) algorithm, a variant of the mean shift algorithm, is a kernel-based iterative method for data clustering, where data points are clustered according to their convergent points via iterative blurring. In this paper, we analyze convergence properties of the BMS algorithm by leveraging its interpretation as an optimization procedure, which is known but has been underutilized in existing convergence studies. Whereas existing results on convergence properties applicable to multi-dimensional data only cover the case where all the blurred data point sequences converge to a single point, this study provides a convergence guarantee even when those sequences can converge to multiple points, yielding multiple clusters. This study also shows that the convergence of the BMS algorithm is fast by further leveraging geometrical characterization of the convergent points.


title: TREC: APT Tactic / Technique Recognition via Few-Shot Provenance Subgraph Learning

abstract: APT (Advanced Persistent Threat) with the characteristics of persistence, stealth, and diversity is one of the greatest threats against cyber-infrastructure. As a countermeasure, existing studies leverage provenance graphs to capture the complex relations between system entities in a host for effective APT detection. In addition to detecting single attack events as most existing work does, understanding the tactics / techniques (e.g., Kill-Chain, ATT&CK) applied to organize and accomplish the APT attack campaign is more important for security operations. Existing studies try to manually design a set of rules to map low-level system events to high-level APT tactics / techniques. However, the rule based methods are coarse-grained and lack generalization ability, thus they can only recognize APT tactics and cannot identify fine-grained APT techniques and mutant APT attacks. In this paper, we propose TREC, the first attempt to recognize APT tactics / techniques from provenance graphs by exploiting deep learning techniques. To address the "needle in a haystack" problem, TREC segments small and compact subgraphs covering individual APT technique instances from a large provenance graph based on a malicious node detection model and a subgraph sampling algorithm. To address the "training sample scarcity" problem, TREC trains the APT tactic / technique recognition model in a few-shot learning manner by adopting a Siamese neural network. We evaluate TREC based on a customized dataset collected and made public by our team. The experiment results show that TREC significantly outperforms state-of-the-art systems in APT tactic recognition and TREC can also effectively identify APT techniques.


title: Stability of a dispersion of elongated particles embedded in a viscous membrane

abstract: We develop a mean-field model to examine the stability of a `quasi-2D suspension' of elongated particles embedded within a viscous membrane. This geometry represents several biological and synthetic settings, and we reveal mechanisms by which the anisotropic mobility of particles interacts with long-ranged viscous membrane hydrodynamics. We first show that a system of slender rod-like particles driven by a constant force is unstable to perturbations in concentration -- much like sedimentation in analogous 3D suspensions -- so long as membrane viscous stresses dominate. However, increasing the contribution of viscous stresses from the surrounding 3D fluid(s) suppresses such an instability. We then tie this result to the hydrodynamic disturbances generated by each particle in the plane of the membrane and show that enhancing subphase viscous contributions generates extensional fields that orient neighboring particles in a manner that draws them apart. The balance of flux of particles aggregating versus separating then leads to a wave number selection in the mean-field model.


title: Possible spectral irregularities in the AMS-02 positron spectrum

abstract: The excesses in the electron and positron spectra observed by many experiments, such as PAMELA and AMS-02, have sparked significant theoretical investigation. It is not easy to distinguish the two primary hypotheses dark matter annihilation/decay and pulsars from the spectral features. Should pulsars be the source of this excess, the expected variability in their distribution may introduce distinct irregularities in the positron energy spectrum. In this study, we use an irregularity estimator to detect these potential features in the positron energy spectrum of AMS-02. Our analysis of the current AMS-02 data reveals these spectral irregularities with a statistical significance of $1.75\sigma$. However, our projection indicates that, with AMS-02 data collected over a period of 20 years, such irregularities could be identified with a confidence level of $3\sigma$ level in 71\% of our simulations.


title: The Runge--Kutta discontinuous Galerkin method with stage-dependent polynomial spaces for hyperbolic conservation laws

abstract: In this paper, we present a novel class of high-order Runge--Kutta (RK) discontinuous Galerkin (DG) schemes for hyperbolic conservation laws. The new method extends beyond the traditional method of lines framework and utilizes stage-dependent polynomial spaces for the spatial discretization operators. To be more specific, two different DG operators, associated with $\mathcal{P}^k$ and $\mathcal{P}^{k-1}$ piecewise polynomial spaces, are used at different RK stages. The resulting method is referred to as the sdRKDG method. It features fewer floating-point operations and may achieve larger time step sizes. For problems without sonic points, we observe optimal convergence for all the sdRKDG schemes; and for problems with sonic points, we observe that a subset of the sdRKDG schemes remains optimal. We have also conducted von Neumann analysis for the stability and error of the sdRKDG schemes for the linear advection equation in one dimension. Numerical tests, for problems including two-dimensional Euler equations for gas dynamics, are provided to demonstrate the performance of the new method.


title: Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing

abstract: In visual speech processing, context modeling capability is one of the most important requirements due to the ambiguous nature of lip movements. For example, homophenes, words that share identical lip movements but produce different sounds, can be distinguished by considering the context. In this paper, we propose a novel framework, namely Visual Speech Processing incorporated with LLMs (VSP-LLM), to maximize the context modeling ability by bringing the overwhelming power of LLMs. Specifically, VSP-LLM is designed to perform multi-tasks of visual speech recognition and translation, where the given instructions control the type of task. The input video is mapped to the input latent space of an LLM by employing a self-supervised visual speech model. Focused on the fact that there is redundant information in input frames, we propose a novel deduplication method that reduces the embedded visual features by employing visual speech units. Through the proposed deduplication and Low Rank Adaptation (LoRA), VSP-LLM can be trained in a computationally efficient manner. In the translation dataset, the MuAViC benchmark, we demonstrate that VSP-LLM trained on just 30 hours of labeled data can more effectively translate lip movements compared to the recent model trained with 433 hours of data.


title: On the Duality Between Sharpness-Aware Minimization and Adversarial Training

abstract: Adversarial Training (AT), which adversarially perturb the input samples during training, has been acknowledged as one of the most effective defenses against adversarial attacks, yet suffers from inevitably decreased clean accuracy. Instead of perturbing the samples, Sharpness-Aware Minimization (SAM) perturbs the model weights during training to find a more flat loss landscape and improve generalization. However, as SAM is designed for better clean accuracy, its effectiveness in enhancing adversarial robustness remains unexplored. In this work, considering the duality between SAM and AT, we investigate the adversarial robustness derived from SAM. Intriguingly, we find that using SAM alone can improve adversarial robustness. To understand this unexpected property of SAM, we first provide empirical and theoretical insights into how SAM can implicitly learn more robust features, and conduct comprehensive experiments to show that SAM can improve adversarial robustness notably without sacrificing any clean accuracy, shedding light on the potential of SAM to be a substitute for AT when accuracy comes at a higher priority. Code is available at https://github.com/weizeming/SAM_AT.


title: Self-Adaptive Reconstruction with Contrastive Learning for Unsupervised Sentence Embeddings

abstract: Unsupervised sentence embeddings task aims to convert sentences to semantic vector representations. Most previous works directly use the sentence representations derived from pretrained language models. However, due to the token bias in pretrained language models, the models can not capture the fine-grained semantics in sentences, which leads to poor predictions. To address this issue, we propose a novel Self-Adaptive Reconstruction Contrastive Sentence Embeddings (SARCSE) framework, which reconstructs all tokens in sentences with an AutoEncoder to help the model to preserve more fine-grained semantics during tokens aggregating. In addition, we proposed a self-adaptive reconstruction loss to alleviate the token bias towards frequency. Experimental results show that SARCSE gains significant improvements compared with the strong baseline SimCSE on the 7 STS tasks.


title: Logarithmic A$_{\rm inf}$-cohomology

abstract: We extend the construction of A$_{\rm inf}$-cohomology by Bhatt-Morrow-Scholze to the context of log $p$-adic formal schemes over a log perfectoid base. In particular, using coordinates, we prove comparison theorems between log A$_{\rm inf}$-cohomology with other $p$-adic cohomology theories, including log de Rham, log (q-)crystalline, log prismatic, and Kummer \'etale cohomology, as well as the derived A$_{\rm inf}$-cohomology of certain infinite root stacks. Along the way, we define and give a combinatorial characterization of a new class of maps between saturated log schemes, called pseudo-saturated maps, which is of independent interest. They are related to (and slightly weaker than) the notion of quasi-saturated maps and maps of Cartier type studied by Tsuji.


title: Algorithmically Fair Maximization of Multiple Submodular Objective Functions

abstract: Constrained maximization of submodular functions poses a central problem in combinatorial optimization. In many realistic scenarios, a number of agents need to maximize multiple submodular objectives over the same ground set. We study such a setting, where the different solutions must be disjoint, and thus, questions of fairness arise. Inspired from the fair division literature, we suggest a simple round-robin protocol, where agents are allowed to build their solutions one item at a time by taking turns. Unlike what is typical in fair division, however, the prime goal here is to provide a fair algorithmic environment; each agent is allowed to use any algorithm for constructing their respective solutions. We show that just by following simple greedy policies, agents have solid guarantees for both monotone and non-monotone objectives, and for combinatorial constraints as general as $p$-systems (which capture cardinality and matroid intersection constraints). In the monotone case, our results include approximate EF1-type guarantees and their implications in fair division may be of independent interest. Further, although following a greedy policy may not be optimal in general, we show that consistently performing better than that is computationally hard.


title: Spacetime singularities and caustic of outgoing null hypersurfaces

abstract: In this paper, we investigate the caustic point developed by outgoing null hypersurfaces and the behavior of null curves. We analyze three cases: Future, past, and zero caustic point terminology for outgoing null hypersurfaces in the marginally bound Lemaitre-Tolman-Bondi (LTB) metric for homogenous and inhomogeneous cases defined in the present work. We show the criteria to form local and globally visible singularity in terms of the tangent on the apparent horizon curve.


title: On a precessing jet-nozzle scenario with a common helical trajectory-pattern for blazar 3C345

abstract: The kinematics and flux evolution of the superluminal knots in blazar 3C345 were interpreted in the framework of the precessing jet-nozzle scenario with a precessing common helical trajectory-pattern. We show that the jet in 3C345 precesses with a period of 7.3yr and the superluminal knots move consistently along a precessing common helical trajectory-pattern in their inner jet regions, which can extend to core distances of about 1.2mas or traveled distances of about 300pc (for knots C4 and C9). Through model-fitting of the observed kinematic behavior of the superluminal knots, their bulk Lorentz factor and Doppler factor were derived as continuous functions of time, which were used to investigate their flux evolution. We found that the light curves measured at 15, 22 and 43GHz can be well model-fitted in terms of their Doppler boosting profiles associated with their superluminal motion. Flux fluctuations on shorter time scales also exist due to knots' intrinsic variations in flux density and spectral index. The close association of the flux evolution with the Doppler boosting effect is important, firmly vadidating the precessing jet-nozzle scenario being fully appropriate to explain both the kinematics and emission properties of the superluminal knots in 3C345. We have proposed both the precessing jet-nozzle scenarios with a single jet and double jets (this paper and Qian[2022b]) to understand the VLBI phenomena in 3C345. VLBI-observations with higher resolutions deep into the core regions (core distances less than 0.1mas) are required to test them.


title: General infinitesimal variations of Hodge structure of ample curves in surfaces

abstract: Given a smooth projective complex curve inside a smooth projective surface, one can ask how its Hodge structure varies when the curve moves inside the surface. In this paper we develop a general theory to study the infinitesimal version of this question in the case of ample curves. We can then apply the machinery to show that the infinitesimal variation of Hodge structure of a general deformation of an ample curve in $\mathbb{P}^1\times\mathbb{P}^1$ is an isomorphism.


title: Machine Unlearning of Pre-trained Large Language Models

abstract: This study investigates the concept of the `right to be forgotten' within the context of large language models (LLMs). We explore machine unlearning as a pivotal solution, with a focus on pre-trained models--a notably under-researched area. Our research delineates a comprehensive framework for machine unlearning in pre-trained LLMs, encompassing a critical analysis of seven diverse unlearning methods. Through rigorous evaluation using curated datasets from arXiv, books, and GitHub, we establish a robust benchmark for unlearning performance, demonstrating that these methods are over $10^5$ times more computationally efficient than retraining. Our results show that integrating gradient ascent with gradient descent on in-distribution data improves hyperparameter robustness. We also provide detailed guidelines for efficient hyperparameter tuning in the unlearning process. Our findings advance the discourse on ethical AI practices, offering substantive insights into the mechanics of machine unlearning for pre-trained LLMs and underscoring the potential for responsible AI development.


title: Spatially-Aware Transformer for Embodied Agents

abstract: Episodic memory plays a crucial role in various cognitive processes, such as the ability to mentally recall past events. While cognitive science emphasizes the significance of spatial context in the formation and retrieval of episodic memory, the current primary approach to implementing episodic memory in AI systems is through transformers that store temporally ordered experiences, which overlooks the spatial dimension. As a result, it is unclear how the underlying structure could be extended to incorporate the spatial axis beyond temporal order alone and thereby what benefits can be obtained. To address this, this paper explores the use of Spatially-Aware Transformer models that incorporate spatial information. These models enable the creation of place-centric episodic memory that considers both temporal and spatial dimensions. Adopting this approach, we demonstrate that memory utilization efficiency can be improved, leading to enhanced accuracy in various place-centric downstream tasks. Additionally, we propose the Adaptive Memory Allocator, a memory management method based on reinforcement learning that aims to optimize efficiency of memory utilization. Our experiments demonstrate the advantages of our proposed model in various environments and across multiple downstream tasks, including prediction, generation, reasoning, and reinforcement learning. The source code for our models and experiments will be available at https://github.com/junmokane/spatially-aware-transformer.


title: A unified constraint formulation of immersed body techniques for coupled fluid-solid motion: continuous equations and numerical algorithms

abstract: Numerical simulation of moving immersed solid bodies in fluids is now practiced routinely following pioneering work of Peskin and co-workers on immersed boundary method (IBM), Glowinski and co-workers on fictitious domain method (FDM), and others on related methods. A variety of variants of IBM and FDM approaches have been published, most of which rely on using a background mesh for the fluid equations and tracking the solid body using Lagrangian points. The key idea that is common to these methods is to assume that the entire fluid-solid domain is a fluid and then to constrain the fluid within the solid domain to move in accordance with the solid governing equations. The immersed solid body can be rigid or deforming. Thus, in all these methods the fluid domain is extended into the solid domain. In this review, we provide a mathemarical perspective of various immersed methods by recasting the governing equations in an extended domain form for the fluid. The solid equations are used to impose appropriate constraints on the fluid that is extended into the solid domain. This leads to extended domain constrained fluid-solid governing equations that provide a unified framework for various immersed body techniques. The unified constrained governing equations in the strong form are independent of the temporal or spatial discretization schemes. We show that particular choices of time stepping and spatial discretization lead to different techniques reported in literature ranging from freely moving rigid to elastic self-propelling bodies. These techniques have wide ranging applications including aquatic locomotion, underwater vehicles, car aerodynamics, and organ physiology (e.g. cardiac flow, esophageal transport, respiratory flows), wave energy convertors, among others. We conclude with comments on outstanding challenges and future directions.


title: Entity-level Factual Adaptiveness of Fine-tuning based Abstractive Summarization Models

abstract: Abstractive summarization models often generate factually inconsistent content particularly when the parametric knowledge of the model conflicts with the knowledge in the input document. In this paper, we analyze the robustness of fine-tuning based summarization models to the knowledge conflict, which we call factual adaptiveness. We utilize pre-trained language models to construct evaluation sets and find that factual adaptiveness is not strongly correlated with factual consistency on original datasets. Furthermore, we introduce a controllable counterfactual data augmentation method where the degree of knowledge conflict within the augmented data can be adjustable. Our experimental results on two pre-trained language models (PEGASUS and BART) and two fine-tuning datasets (XSum and CNN/DailyMail) demonstrate that our method enhances factual adaptiveness while achieving factual consistency on original datasets on par with the contrastive learning baseline.


title: Has the Deep Neural Network learned the Stochastic Process? A Wildfire Perspective

abstract: This paper presents the first systematic study of evalution of Deep Neural Network (DNN) designed and trained to predict the evolution of a stochastic dynamical system, using wildfire prediction as a case study. We show that traditional evaluation methods based on threshold based classification metrics and error-based scoring rules assess a DNN's ability to replicate the observed ground truth (GT), but do not measure the fidelity of the DNN's learning of the underlying stochastic process. To address this gap, we propose a new system property: Statistic-GT, representing the GT of the stochastic process, and an evaluation metric that exclusively assesses fidelity to Statistic-GT. Utilizing a synthetic dataset, we introduce a stochastic framework to characterize this property and establish criteria for a metric to be a valid measure of the proposed property. We formally show that Expected Calibration Error (ECE) tests the necessary condition for fidelity to Statistic-GT. We perform empirical experiments, differentiating ECE's behavior from conventional metrics and demonstrate that ECE exclusively measures fidelity to the stochastic process. Extending our analysis to real-world wildfire data, we highlight the limitations of traditional evaluation methods and discuss the utility of evaluating fidelity to the stochastic process alongside existing metrics.


title: EasyRL4Rec: An Easy-to-use Library for Reinforcement Learning Based Recommender Systems

abstract: Reinforcement Learning (RL)-Based Recommender Systems (RSs) have gained rising attention for their potential to enhance long-term user engagement. However, research in this field faces challenges, including the lack of user-friendly frameworks, inconsistent evaluation metrics, and difficulties in reproducing existing studies. To tackle these issues, we introduce EasyRL4Rec, an easy-to-use code library designed specifically for RL-based RSs. This library provides lightweight and diverse RL environments based on five public datasets and includes core modules with rich options, simplifying model development. It provides unified evaluation standards focusing on long-term outcomes and offers tailored designs for state modeling and action representation for recommendation scenarios. Furthermore, we share our findings from insightful experiments with current methods. EasyRL4Rec seeks to facilitate the model development and experimental process in the domain of RL-based RSs. The library is available for public use.


title: Spontaneous superradiant photon current

abstract: This work reports the spontaneous emergence of a photon current in a class of spin-cavity systems, where an assemble of quantum emitters interact with distinct photon modes confined in tunneling-coupled cavities. Specifically, with necessary symmetry breaking, photons in a superradiant phase afforded by coherent photon-emitter interaction spontaneously flow from a cavity with a lower resonance frequency to a different cavity with a higher resonance frequency. Theoretical analysis reveals that cavity dissipation is the key to alter spin-cavity coherence, which then makes it possible to extract photons from, and later return photons to the vaccum through the cavities. The interplay between photon loss and emitter coherence hence sustains a counter-intuitive steady current of photons between cavities without an external pumping field.


title: Convergence Analysis of Split Federated Learning on Heterogeneous Data

abstract: Split federated learning (SFL) is a recent distributed approach for collaborative model training among multiple clients. In SFL, a global model is typically split into two parts, where clients train one part in a parallel federated manner, and a main server trains the other. Despite the recent research on SFL algorithm development, the convergence analysis of SFL is missing in the literature, and this paper aims to fill this gap. The analysis of SFL can be more challenging than that of federated learning (FL), due to the potential dual-paced updates at the clients and the main server. We provide convergence analysis of SFL for strongly convex and general convex objectives on heterogeneous data. The convergence rates are $O(1/T)$ and $O(1/\sqrt[3]{T})$, respectively, where $T$ denotes the total number of rounds for SFL training. We further extend the analysis to non-convex objectives and where some clients may be unavailable during training. Numerical experiments validate our theoretical results and show that SFL outperforms FL and split learning (SL) when data is highly heterogeneous across a large number of clients.


title: $\widetilde{O}(N^2)$ Representation of General Continuous Anti-symmetric Function

abstract: In quantum mechanics, the wave function of fermion systems such as many-body electron systems are anti-symmetric (AS) and continuous, and it is crucial yet challenging to find an ansatz to represent them. This paper addresses this challenge by presenting an ${\widetilde O}(N^2)$ ansatz based on permutation-equivariant functions. We prove that our ansatz can represent any AS continuous functions, and can accommodate the determinant-based structure proposed by Hutter [14], solving the proposed open problems that ${O}(N)$ Slater determinants are sufficient to provide universal representation of AS continuous functions. Together, we offer a generalizable and efficient approach to representing AS continuous functions, shedding light on designing neural networks to learn wave functions.


title: Trojan Exoplanets

abstract: Co-orbital exoplanets are a by-product of the models of formation of planetary systems. However, none have been detected in nature thus far. Although challenging, the observation of co-orbital exoplanets would provide valuable information on the formation of planetary systems as well as on the interactions between planets and their host star. After a brief review of the stability and formation issues of co-orbital systems, some observational methods dedicated to their detection are presented.