title: An ab-initio derivation to discuss the heterodyne versus direct detection decision problem for astronomical infrared interferometry

abstract: A consistent and explicit spectral comparison between heterodyne (HD) and direct detection (DD) derived from first principles including the atmospheric transmission and low beam-filling factors could not be found yet in literature but is needed for decisions in technology planification for future infrared interferometry facilities which are e.g. focused on planet formation. This task requires both, high sensitivity continuum and Doppler-resolved emission and absorption line detection in the mid-IR range (N- and Q-bands) at lower source temperatures (300-1000 K). The signal-to-noise ratios (SNRs) are derived for both schemes within the same semi-classical theory, which consists of classical mode theory for coupling to an antenna and occupation of these modes by quanta of three radiation fields, the thermal signal, the thermal background, and for HD also the coherent local oscillator (LO). The effects of very small beam filling factors (interferometry) and atmospheric absorption/emission could be consistently incorporated this way, as well as quantum-noise propagation which allows in HD the consideration of balanced mixers with cross-correlation (CC). Especially, the transition from pre- to post-detection SNRs was considered meticulously. We do this all because the usually cited SNR-expressions were derived for a too simple and unrealistic case, and moreover contain some wrong assumptions. We introduce a novel HD scheme for astronomical interferometry gaining an order of magnitude in sensitivity against conventional HD and calculate that it should trespass the sensitivity of DD interferometry in the N- and Q-bands for a spectral resolution of R=10000, and should do also for R=300 with doable technical improvements. This result encourages to develop broad-band heterodyne technologies for future mid-infrared interferometry facilities and for new instruments at existing facilities.


title: Sum of two squares in cyclic quartic fields

abstract: This paper gives an algorithm to determine whether a number in a cyclic quartic field is a sum of two squares, mainly based on local-global principle of isotropy of quadratic forms.


title: A force-based beam element model based on the modified higher-order shear deformation theory for accurate analysis of FG beams

abstract: In this paper, a force-based beam finite element model based on a modified higher-order shear deformation theory is proposed for the accurate analysis of functionally graded beams. In the modified higher-order shear deformation theory, the distribution of transverse shear stress across the beam's thickness is obtained from the differential equilibrium equation, and a modified shear stiffness is derived to take the effect of transverse shear stress distribution into consideration. In the proposed beam element model, unlike traditional beam finite elements that regard generalized displacements as unknown fields, the internal forces are considered as the unknown fields, and they are predefined by using the closed-form solutions of the differential equilibrium equations of higher-order shear beam. Then, the generalized displacements are expressed by the internal forces with the introduction of geometric relations and constitutive equations, and the equation system of the beam element is constructed based on the equilibrium conditions at the boundaries and the compatibility condition within the element. Numerical examples underscore the accuracy and efficacy of the proposed higher-order beam element model in the static analysis of functionally graded sandwich beams, particularly in terms of true transverse shear stress distribution.


title: Asymmetry of MHD equilibria for generic adapted metrics

abstract: Ideal magnetohydrodynamic (MHD) equilibria on a Riemannian 3-manifold satisfy the stationary Euler equations for ideal fluids. A stationary solution $X$ admits a large set of ``adapted" metrics in $M$ for which $X$ solves the corresponding MHD equilibrium equations with the same pressure function. We prove different versions of the following statement: an MHD equilibrium with non-constant pressure on a compact three-manifold with or without boundary admits no continuous Killing symmetries for an open and dense set of adapted metrics. This contrasts with the classical conjecture of Grad which loosely states that an MHD equilibrium on a toroidal Euclidean domain in $\mathbb{R}^3$ with pressure function foliating the domain with nested toroidal surfaces must admit Euclidean symmetries.

categories: math.DG math-ph math.MP physics.plasm-ph


title: Quality-Diversity Generative Sampling for Learning with Synthetic Data

abstract: Generative models can serve as surrogates for some real data sources by creating synthetic training datasets, but in doing so they may transfer biases to downstream tasks. We focus on protecting quality and diversity when generating synthetic training datasets. We propose quality-diversity generative sampling (QDGS), a framework for sampling data uniformly across a user-defined measure space, despite the data coming from a biased generator. QDGS is a model-agnostic framework that uses prompt guidance to optimize a quality objective across measures of diversity for synthetically generated data, without fine-tuning the generative model. Using balanced synthetic datasets generated by QDGS, we first debias classifiers trained on color-biased shape datasets as a proof-of-concept. By applying QDGS to facial data synthesis, we prompt for desired semantic concepts, such as skin tone and age, to create an intersectional dataset with a combined blend of visual features. Leveraging this balanced data for training classifiers improves fairness while maintaining accuracy on facial recognition benchmarks. Code available at: https://github.com/Cylumn/qd-generative-sampling.


title: Partitioned neural network approximation for partial differential equations enhanced with Lagrange multipliers and localized loss functions

abstract: Partitioned neural network functions are used to approximate the solution of partial differential equations. The problem domain is partitioned into non-overlapping subdomains and the partitioned neural network functions are defined on the given non-overlapping subdomains. Each neural network function then approximates the solution in each subdomain. To obtain the convergent neural network solution, certain continuity conditions on the partitioned neural network functions across the subdomain interface need to be included in the loss function, that is used to train the parameters in the neural network functions. In our work, by introducing suitable interface values, the loss function is reformulated into a sum of localized loss functions and each localized loss function is used to train the corresponding local neural network parameters. In addition, to accelerate the neural network solution convergence, the localized loss function is enriched with an augmented Lagrangian term, where the interface condition and the boundary condition are enforced as constraints on the local solutions by using Lagrange multipliers. The local neural network parameters and Lagrange multipliers are then found by optimizing the localized loss function. To take the advantage of the localized loss function for the parallel computation, an iterative algorithm is also proposed. For the proposed algorithms, their training performance and convergence are numerically studied for various test examples.


title: Necknasium: A Virtual Reality Rehabilitation Game for Managing Faulty Neck Posture

abstract: This study is concerned with the application of virtual reality (VR) in rehabilitation programs for faulty neck posture which is a primary source of neck pain (NP). The latter is a highly prevalent musculoskeletal disorder that is associated with serious societal and economic burden. VR has been shown to be effective in the physical rehabilitation of various diseases. Specifically, it has been shown to improve the adherence of patients and engagement to carry out physical exercises on a regular basis. Many games have been used to manage NP with different immersion levels. Towards this goal, we present a VR-based system that targets a specific neck problem, the so called forward head posture (FHP), which is a faulty head position that abnormally stresses neck structures. The system can also generalize well to other neck-related disorders and rehabilitation goals. We show the steps for designing and developing the system, and we highlight the aspects of interaction between usability and various game elements. Using a three-point scale for user experience, we also present preliminary insights on the evaluation of the system prototype, and we discuss future enhancement directions based on the feedback from users.


title: Generative Models for Simulation of KamLAND-Zen

abstract: The next generation of searches for neutrinoless double beta decay (0{\nu}\b{eta}\b{eta}) are poised to answer deep questions on the nature of neutrinos and the source of the Universe's matter-antimatter asymmetry. They will be looking for event rates of less than one event per ton of instrumented isotope per year. To claim discovery, accurate and efficient simulations of detector events that mimic 0{\nu}\b{eta}\b{eta} is critical. Traditional Monte Carlo (MC) simulations can be supplemented by machine-learning-based generative models. In this work, we describe the performance of generative models designed for monolithic liquid scintillator detectors like KamLAND to produce highly accurate simulation data without a predefined physics model. We demonstrate its ability to recover low-level features and perform interpolation. In the future, the results of these generative models can be used to improve event classification and background rejection by providing high-quality abundant generated data.


title: Learning Socio-Temporal Graphs for Multi-Agent Trajectory Prediction

abstract: In order to predict a pedestrian's trajectory in a crowd accurately, one has to take into account her/his underlying socio-temporal interactions with other pedestrians consistently. Unlike existing work that represents the relevant information separately, partially, or implicitly, we propose a complete representation for it to be fully and explicitly captured and analyzed. In particular, we introduce a Directed Acyclic Graph-based structure, which we term Socio-Temporal Graph (STG), to explicitly capture pair-wise socio-temporal interactions among a group of people across both space and time. Our model is built on a time-varying generative process, whose latent variables determine the structure of the STGs. We design an attention-based model named STGformer that affords an end-to-end pipeline to learn the structure of the STGs for trajectory prediction. Our solution achieves overall state-of-the-art prediction accuracy in two large-scale benchmark datasets. Our analysis shows that a person's past trajectory is critical for predicting another person's future path. Our model learns this relationship with a strong notion of socio-temporal localities. Statistics show that utilizing this information explicitly for prediction yields a noticeable performance gain with respect to the trajectory-only approaches.


title: A Modular Approach to Metatheoretic Reasoning for Extensible Languages

abstract: This paper concerns the development of metatheory for extensible languages. It uses as its starting point a view that programming languages tailored to specific application domains are to be constructed by composing components from an open library of independently-developed extensions to a host language. In the elaboration of this perspective, static analyses (such as typing) and dynamic semantics (such as evaluation) are described via relations whose specifications are distributed across the host language and extensions and are given in a rule-based fashion. Metatheoretic properties, which ensure that static analyses accurately gauge runtime behavior, are represented in this context by formulas over such relations. These properties may be fundamental to the language, introduced by the host language, or they may pertain to analyses introduced by individual extensions. We expose the problem of modular metatheory, i.e., the notion that proofs of relevant properties can be constructed by reasoning independently within each component in the library. To solve this problem, we propose the twin ideas of decomposing proofs around language fragments and of reasoning generically about extensions based on broad, a priori constraints imposed on their behavior. We establish the soundness of these styles of reasoning by showing how complete proofs of the properties can be automatically constructed for any language obtained by composing the independent parts. Mathematical precision is given to our discussions by framing them within a logic that encodes inductive rule-based specifications via least fixed-point definitions. We also sketch the structure of a practical system for metatheoretic reasoning for extensible languages based on the ideas developed.


title: R-Pool and Settlement Markets for Recoverable ERC-20R Tokens

abstract: ERC-20R is a wrapper around ERC-20 that supports asset recovery within a limited time window after an asset is transferred. It is designed to reduce theft and losses on the blockchain by allowing a victim to recover their stolen or lost assets during the recovery window. When an honest recipient receives an ERC-20R asset, they must wait until the recovery windows elapses (say, 24 hours), before they can unwrap the asset back to its base ERC-20 form. We argue that many DeFi services will likely refuse to accept unsettled recoverable assets because they can interfere with their normal operations. Consequently, when Alice receives an ERC-20R token, she must wait 24 hours before she can use it with a DeFi service. But what if Alice is willing to pay a fee to exchange the wrapped token for an unwrapped ERC-20 token that can be used right away? In this paper we explore how to design a pool to exchange an unsettled ERC-20R asset for a base ERC-20 of the same asset. Designing such a pool raises several challenging questions and we present our solutions.


title: Vanishing viscosity limit of the Navier-Stokes equations in a horizontally periodic strip

abstract: In this paper, we establish vanishing viscosity limit of the 2D Navier-Stokes equations in a horizontally periodic strip. On the vertical direction, the horizontal component of the velocity is subjected to two different types of boundary conditions: at the lower boundary, we give the degenerate zero boundary condition, while at the upper boundary, a small smooth perturbation of non-zero constant is prescribed. Due to this different boundary condition setting, the boundary layer effects are different near the lower and upper boundaries, which result in different thickness of boundary layer and different leading order boundary layer equations. We will construct an approximate solution to this 2D Navier-Stokes equations by using higher order asymptotic approximation and show the validity of the boundary layer expansion. The leading order of the Euler solution is the Couette flow $(Ay,0)$ for some suitable constant $A$, which is determined by using the principle of the Prandtl-Batchelor theory.


title: Hyperbolic Spin Waves in Magnetic Polar Metals

abstract: We demonstrate the emergence of collective spin modes with hyperbolic dispersion in three-dimensional spin-orbit coupled polar metals magnetized by intrinsic ordering or applied fields. These particle-hole bound states exist for arbitrarily weak repulsive interactions; they are optically accessible and can be used to generate pure spin current when magnetization is tilted away from the polar axis. We suggest material hosts for these excitations and discuss their potential relevance to nanoscale spintronic and polaritonic applications.


title: Multimodal Attention Merging for Improved Speech Recognition and Audio Event Classification

abstract: Training large foundation models using self-supervised objectives on unlabeled data, followed by fine-tuning on downstream tasks, has emerged as a standard procedure. Unfortunately, the efficacy of this approach is often constrained by both limited fine-tuning compute and scarcity in labeled downstream data. We introduce Multimodal Attention Merging (MAM), an attempt that facilitates direct knowledge transfer from attention matrices of models rooted in high resource modalities, text and images, to those in resource-constrained domains, speech and audio, employing a zero-shot paradigm. MAM reduces the relative Word Error Rate (WER) of an Automatic Speech Recognition (ASR) model by up to 6.70%, and relative classification error of an Audio Event Classification (AEC) model by 10.63%. In cases where some data/compute is available, we present Learnable-MAM, a data-driven approach to merging attention matrices, resulting in a further 2.90% relative reduction in WER for ASR and 18.42% relative reduction in AEC compared to fine-tuning.


title: Goto rings

abstract: As part of stratification of Cohen-Macaulay rings, we introduce and develop the theory of Goto rings, generalizing the notion of almost Gorenstein rings originally defined by V. Barucci and R. Fr\"oberg in 1997. What has dominated the series of researches on almost Gorenstein rings is the fact that the reduction numbers of extended canonical ideals are at most $2$; we define Goto rings as Cohen-Macaulay rings admitting such extended canonical ideals. We provide a characterization of Goto rings in terms of the structure of Sally modules and determine the Hilbert functions of them. Various examples of Goto rings that come from numerical semigroups, idealizations, fiber products, and equimultiple Ulrich ideals are explored as well.


title: Federated Learning with Projected Trajectory Regularization

abstract: Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which leads to deteriorated model training performances. Prior works in this line of research mainly focus on utilizing last-step global model parameters/gradients or the linear combinations of the past model parameters/gradients, which do not fully exploit the potential of global information from the model training trajectory. In this paper, we propose a novel federated learning framework with projected trajectory regularization (FedPTR) for tackling the data heterogeneity issue, which proposes a unique way to better extract the essential global information from the model training trajectory. Specifically, FedPTR allows local clients or the server to optimize an auxiliary (synthetic) dataset that mimics the learning dynamics of the recent model update and utilizes it to project the next-step model trajectory for local training regularization. We conduct rigorous theoretical analysis for our proposed framework under nonconvex stochastic settings to verify its fast convergence under heterogeneous data distributions. Experiments on various benchmark datasets and non-i.i.d. settings validate the effectiveness of our proposed framework.


title: On the cuprates' universal waterfall feature: evidence of a momentum-driven crossover

abstract: We study two related universal anomalies of the spectral function of cuprates, so called waterfall and high-energy kink features, by a combined cellular dynamical mean-field theory and angle-resolved photoemission study for the oxychloride Na$_x$Ca$_{2-x}$CuO$_2$Cl$_2$ (Na-CCOC). Tracing their origin back to an interplay of spin-polaron and local correlation effects both in undoped and hole-doped (Na-)CCOC, we establish them as a universal crossover between regions differing in the momentum-dependence of the coupling and not necessarily in the related quasiparticles' energies. The proposed scenario extends to doping levels coinciding with the cuprate's superconducting dome and motivates further investigations of the fate of spin-polarons in the superconducting phase.


title: Experimental Upper Bounds for Resonance-Enhanced Entangled Two-Photon Absorption Cross Section of Indocyanine Green

abstract: Resonant intermediate states have been proposed to increase the efficiency of entangled two-photon absorption (ETPA). Although resonance-enhanced ETPA (r-ETPA) has been demonstrated in atomic systems using bright squeezed vacuum, it has not been studied in organic molecules. We investigate for the first time r-ETPA in an organic molecular dye, indocyanine green (ICG), when excited by broadband entangled photons in near-IR. Similar to many reported virtual state mediated ETPA (v-ETPA) measurements, no r-ETPA signals are measured, with an experimental upper bound for the cross section placed at $6 \times 10^{-23}$ cm$^2$/molecule. In addition, the classical resonance-enhanced two-photon absorption (r-TPA) cross section of ICG at 800 nm is measured for the first time to be $20(\pm13)$ GM, suggesting that having a resonant intermediate state does not significantly enhance two-photon processes in ICG. The spectrotemporally resolved emission signatures of ICG excited by entangled photons are also presented to support this conclusion.


title: Removing Interference and Recovering Content Imaginatively for Visible Watermark Removal

abstract: Visible watermarks, while instrumental in protecting image copyrights, frequently distort the underlying content, complicating tasks like scene interpretation and image editing. Visible watermark removal aims to eliminate the interference of watermarks and restore the background content. However, existing methods often implement watermark component removal and background restoration tasks within a singular branch, leading to residual watermarks in the predictions and ignoring cases where watermarks heavily obscure the background. To address these limitations, this study introduces the Removing Interference and Recovering Content Imaginatively (RIRCI) framework. RIRCI embodies a two-stage approach: the initial phase centers on discerning and segregating the watermark component, while the subsequent phase focuses on background content restoration. To achieve meticulous background restoration, our proposed model employs a dual-path network capable of fully exploring the intrinsic background information beneath semi-transparent watermarks and peripheral contextual information from unaffected regions. Moreover, a Global and Local Context Interaction module is built upon multi-layer perceptrons and bidirectional feature transformation for comprehensive representation modeling in the background restoration phase. The efficacy of our approach is empirically validated across two large-scale datasets, and our findings reveal a marked enhancement over existing watermark removal techniques.


title: Broken inversion symmetry in van der Waals topological ferromagnetic metal iron germanium telluride

abstract: Inversion symmetry breaking is critical for many quantum effects and fundamental for spin-orbit torque, which is crucial for next-generation spintronics. Recently, a novel type of gigantic intrinsic spin-orbit torque has been established in the topological van-der-Waals (vdW) magnet iron germanium telluride. However, it remains a puzzle because no clear evidence exists for interlayer inversion symmetry breaking. Here, we report the definitive evidence of broken inversion symmetry in iron germanium telluride directly measured by the second harmonic generation (SHG) technique. Our data show that the crystal symmetry reduces from centrosymmetric P63/mmc to noncentrosymmetric polar P3m1 space group, giving the three-fold SHG pattern with dominant out-of-plane polarization. Additionally, the SHG response evolves from an isotropic pattern to a sharp three-fold symmetry upon increasing Fe deficiency, mainly due to the transition from random defects to ordered Fe vacancies. Such SHG response is robust against temperature, ensuring unaltered crystalline symmetries above and below the ferromagnetic transition temperature. These findings add crucial new information to our understanding of this interesting vdW metal, iron germanium telluride: band topology, intrinsic spin-orbit torque and topological vdW polar metal states.

categories: cond-mat.mtrl-sci physics.app-ph physics.optics quant-ph


title: Generative AI Beyond LLMs: System Implications of Multi-Modal Generation

abstract: As the development of large-scale Generative AI models evolve beyond text (1D) generation to include image (2D) and video (3D) generation, processing spatial and temporal information presents unique challenges to quality, performance, and efficiency. We present the first work towards understanding this new system design space for multi-modal text-to-image (TTI) and text-to-video (TTV) generation models. Current model architecture designs are bifurcated into 2 categories: Diffusion- and Transformer-based models. Our systematic performance characterization on a suite of eight representative TTI/TTV models shows that after state-of-the-art optimization techniques such as Flash Attention are applied, Convolution accounts for up to 44% of execution time for Diffusion-based TTI models, while Linear layers consume up to 49% of execution time for Transformer-based models. We additionally observe that Diffusion-based TTI models resemble the Prefill stage of LLM inference, and benefit from 1.1-2.5x greater speedup from Flash Attention than Transformer-based TTI models that resemble the Decode phase. Since optimizations designed for LLMs do not map directly onto TTI/TTV models, we must conduct a thorough characterization of these workloads to gain insights for new optimization opportunities. In doing so, we define sequence length in the context of TTI/TTV models and observe sequence length can vary up to 4x in Diffusion model inference. We additionally observe temporal aspects of TTV workloads pose unique system bottlenecks, with Temporal Attention accounting for over 60% of total Attention time. Overall, our in-depth system performance characterization is a critical first step towards designing efficient and deployable systems for emerging TTI/TTV workloads.


title: Systematic study of the rotational bands in the $A\sim 250$ mass region

abstract: For the first time, we conducted a comprehensive analysis of the rotational bands in the \( A\sim250 \) mass region. Utilizing a variety of rotational energy models and formulas, we have extracted free parameters for 36 rotational bands within this mass region, encompassing neutron numbers from N = 148 to 152. A significant enhancement has been made to the vibrational distortion model, leading to an exceptional match with the experimental data on dynamic moment of inertia across most of the rotational bands studied. Through the application of this revised model, we have categorized the dynamic moment of inertia into three distinct groups. The implications of the modified vibrational distortion term and how it evolves with changes in rotational frequency is also investigated. Our systematic investigation brings to light the peculiar behavior of Pu isotopes, especially in ground state bands of \( ^{242,244}\text{Pu}\), within this mass region. We provide a thorough discussion on various aspects such as the role of shape-fluctuation energy, the softness parameter, band-head and average moment of inertia, the prominence of the anti-pairing effect, and the transition from pairing to anti-pairing effects in Pu isotopes. Moreover, these findings are compared with other isotones, offering a comprehensive understanding of their unique characteristics.


title: Variance-insensitive and Target-preserving Mask Refinement for Interactive Image Segmentation

abstract: Point-based interactive image segmentation can ease the burden of mask annotation in applications such as semantic segmentation and image editing. However, fully extracting the target mask with limited user inputs remains challenging. We introduce a novel method, Variance-Insensitive and Target-Preserving Mask Refinement to enhance segmentation quality with fewer user inputs. Regarding the last segmentation result as the initial mask, an iterative refinement process is commonly employed to continually enhance the initial mask. Nevertheless, conventional techniques suffer from sensitivity to the variance in the initial mask. To circumvent this problem, our proposed method incorporates a mask matching algorithm for ensuring consistent inferences from different types of initial masks. We also introduce a target-aware zooming algorithm to preserve object information during downsampling, balancing efficiency and accuracy. Experiments on GrabCut, Berkeley, SBD, and DAVIS datasets demonstrate our method's state-of-the-art performance in interactive image segmentation.


title: A Generalized Shuffle Framework for Privacy Amplification: Strengthening Privacy Guarantees and Enhancing Utility

abstract: The shuffle model of local differential privacy is an advanced method of privacy amplification designed to enhance privacy protection with high utility. It achieves this by randomly shuffling sensitive data, making linking individual data points to specific individuals more challenging. However, most existing studies have focused on the shuffle model based on $(\epsilon_0,0)$-Locally Differentially Private (LDP) randomizers, with limited consideration for complex scenarios such as $(\epsilon_0,\delta_0)$-LDP or personalized LDP (PLDP). This hinders a comprehensive understanding of the shuffle model's potential and limits its application in various settings. To bridge this research gap, we propose a generalized shuffle framework that can be applied to any $(\epsilon_i,\delta_i)$-PLDP setting with personalized privacy parameters. This generalization allows for a broader exploration of the privacy-utility trade-off and facilitates the design of privacy-preserving analyses in diverse contexts. We prove that shuffled $(\epsilon_i,\delta_i)$-PLDP process approximately preserves $\mu$-Gaussian Differential Privacy with \mu = \sqrt{\frac{2}{\sum_{i=1}^{n} \frac{1-\delta_i}{1+e^{\epsilon_i}}-\max_{i}{\frac{1-\delta_{i}}{1+e^{\epsilon_{i}}}}}}. $ This approach allows us to avoid the limitations and potential inaccuracies associated with inequality estimations. To strengthen the privacy guarantee, we improve the lower bound by utilizing hypothesis testing} instead of relying on rough estimations like the Chernoff bound or Hoeffding's inequality. Furthermore, extensive comparative evaluations clearly show that our approach outperforms existing methods in achieving strong central privacy guarantees while preserving the utility of the global model. We have also carefully designed corresponding algorithms for average function, frequency estimation, and stochastic gradient descent.


title: StyleRetoucher: Generalized Portrait Image Retouching with GAN Priors

abstract: Creating fine-retouched portrait images is tedious and time-consuming even for professional artists. There exist automatic retouching methods, but they either suffer from over-smoothing artifacts or lack generalization ability. To address such issues, we present StyleRetoucher, a novel automatic portrait image retouching framework, leveraging StyleGAN's generation and generalization ability to improve an input portrait image's skin condition while preserving its facial details. Harnessing the priors of pretrained StyleGAN, our method shows superior robustness: a). performing stably with fewer training samples and b). generalizing well on the out-domain data. Moreover, by blending the spatial features of the input image and intermediate features of the StyleGAN layers, our method preserves the input characteristics to the largest extent. We further propose a novel blemish-aware feature selection mechanism to effectively identify and remove the skin blemishes, improving the image skin condition. Qualitative and quantitative evaluations validate the great generalization capability of our method. Further experiments show StyleRetoucher's superior performance to the alternative solutions in the image retouching task. We also conduct a user perceptive study to confirm the superior retouching performance of our method over the existing state-of-the-art alternatives.


title: Concatenating Binomial Codes with the Planar Code

abstract: Rotation symmetric bosonic codes are an attractive encoding for qubits into oscillator degrees of freedom, particularly in superconducting qubit experiments. While these codes can tolerate considerable loss and dephasing, they will need to be combined with higher level codes to achieve large-scale devices. We investigate concatenating these codes with the planar code in a measurement-based scheme for fault-tolerant quantum computation. We focus on binomial codes as the base level encoding, and estimate break-even points for such encodings under loss for various types of measurement protocol. These codes are more resistant to photon loss errors, but require both higher mean photon numbers and higher phase resolution for gate operations and measurements. We find that it is necessary to implement adaptive phase measurements, maximum likelihood quantum state inference, and weighted minimum weight decoding to obtain good performance for a planar code using binomial code qubits.


title: The motion of twisted particles in a stellar gravitational field

abstract: A twisted particle possesses intrinsic orbital angular momentum (OAM), and the dynamics of such a particle may challenge the Einstein Equivalence Principle. In this study, we disregard the spin characteristic of the twisted particle, modeling it as a massless complex twisted scalar wave packet to simplify its interaction with gravitational fields. Building on this simplification, we investigate the gravitational birefringence of the twisted particle by analyzing the center of its energy density. We demonstrate that the gravitational birefringence induced by OAM can potentially exceed that induced by spin by several orders of magnitude, significantly enhancing its detectability. Furthermore, we examine the influence of the nonminimal coupling term $\lambda R|\phi|^2$ on the propagation of the twisted particle through the internal gravitational field of a star. Contrary to the predictions of the Mathisson-Papapetrou-Dixon equations, our findings show that the trajectory of the twisted particle under nonminimal coupling differs from that in the minimal coupling scenario. Specifically, we find that for a positive nonminimal coupling constant, the trajectory of the twisted particle is expected to deviate away from the stellar center, compared to the minimal coupling scenario, and this deviation is independent of the particle's OAM. These findings could provide new avenues for testing the Einstein Equivalence Principle.


title: Wideband Sample Rate Converter Using Cascaded Parallel-serial Structure for Synthetic Instrumentation

abstract: A sample rate converter(SRC) is designed to adjust the sampling rate of digital signals flexibly for different application requirements in the broadband signal processing system. In this paper, a novel parallel-serial structure is proposed to improve the bandwidth and flexibility of SRC. The core of this structure is a parallel decimation filter followed by a serial counterpart, the parallel part is designed to process high sampling rate data streams, and the serial part provides high flexibility in decimation factor configuration. A typical combination of cascaded integral comb filter(CIC) and halfband filter is utilized in this structure, the serial recursive loop which limits the processing ability of the CIC filter is transformed into a parallel-pipeline recursive structure. In addition, the symmetry property and zero coefficient of the halfband filter are exploited with the polyphase filter structure to reduce resource utilization and design complexity. In the meantime, the decimation factor of the CIC filter can be adjusted flexibly in a wide range, which is used to improve the system configuration flexibility. This parallel-serial SRC structure was implemented on Xilinx KU115 series field programmable gate array(FPGA), and then applied in a synthetic instrument system. The experiment results demonstrate that the proposed scheme significantly improves the performance of SRC in bandwidth and flexibility.


title: 3D Anderson localization of light in disordered systems of dielectric particles

abstract: We present the results of full wave numerical simulations of light transmission by layers of irregular dielectric particles that demonstrate 3D Anderson localization of light in disordered uncorrelated discrete media. Our simulations show that a high degree of disorder in a dense layer prevents transverse spreading of a propagating beam and allows anomalous conservation of its initial polarization state. A transition from the purely diffusive regime to a non-exponential time dependence when reaching the Ioffe-Regel criterion is observed in short pulse transmission measurements. The effect depends on the turbidity of the layer: increasing the volume fraction and the refractive index leads to the enhancement of the non-exponential behaviour caused by the disorder in the medium which is a clear signature of Anderson localization.


title: AdapTraj: A Multi-Source Domain Generalization Framework for Multi-Agent Trajectory Prediction

abstract: Multi-agent trajectory prediction, as a critical task in modeling complex interactions of objects in dynamic systems, has attracted significant research attention in recent years. Despite the promising advances, existing studies all follow the assumption that data distribution observed during model learning matches that encountered in real-world deployments. However, this assumption often does not hold in practice, as inherent distribution shifts might exist in the mobility patterns for deployment environments, thus leading to poor domain generalization and performance degradation. Consequently, it is appealing to leverage trajectories from multiple source domains to mitigate such discrepancies for multi-agent trajectory prediction task. However, the development of multi-source domain generalization in this task presents two notable issues: (1) negative transfer; (2) inadequate modeling for external factors. To address these issues, we propose a new causal formulation to explicitly model four types of features: domain-invariant and domain-specific features for both the focal agent and neighboring agents. Building upon the new formulation, we propose AdapTraj, a multi-source domain generalization framework specifically tailored for multi-agent trajectory prediction. AdapTraj serves as a plug-and-play module that is adaptable to a variety of models. Extensive experiments on four datasets with different domains demonstrate that AdapTraj consistently outperforms other baselines by a substantial margin.


title: Unsupervised Deep Learning Image Verification Method

abstract: Although deep learning are commonly employed for image recognition, usually huge amount of labeled training data is required, which may not always be readily available. This leads to a noticeable performance disparity when compared to state-of-the-art unsupervised face verification techniques. In this work, we propose a method to narrow this gap by leveraging an autoencoder to convert the face image vector into a novel representation. Notably, the autoencoder is trained to reconstruct neighboring face image vectors rather than the original input image vectors. These neighbor face image vectors are chosen through an unsupervised process based on the highest cosine scores with the training face image vectors. The proposed method achieves a relative improvement of 56\% in terms of EER over the baseline system on Labeled Faces in the Wild (LFW) dataset. This has successfully narrowed down the performance gap between cosine and PLDA scoring systems.


title: SoCo: Graph Storage and Software Prefetch Co-Design for Dynamic Graph Processing

abstract: There has been growing demands in the dynamic graph, in which a continuous stream of graph updates is mixed with graph computation. For the above scenarios, the compact physically continuous structures and the dispersed but logically continuous structures become the two ends of the scale. In principle, the Pointers become the weights. The number of them determines which side of the scale the data structure leans towards. The Pointers make it easier to update the graph but they will result in poor cache locality. This paper presents SoCo, a graph storage and software prefetch co-design for dynamic graph processing that significantly improves on both graph updating and graph computation. We utilize C++20 coroutines and software prefetching techniques to optimize cache miss overhead during computation, and design a data structure that not only meets the requirements of dynamic graph processing but is also more suitable for prefetching. We also conduct extensive experiments on different datasets and show that SoCo could outperform state-of-the-arts by 10.48x on average and at the same time guarantee a pioneer insertion performance (1st place in 5 cases and 2nd place in 2 cases).


title: Deciding Foot-sortability and Minimal 2-bounded Non-foot-sortable Sock Orderings

abstract: A sock ordering is a sequence of socks with different colors. A sock ordering is foot-sortable if the sequence of socks can be sorted by a stack so that socks with the same color form a contiguous block. The problem of deciding whether a given sock ordering is foot-sortable was first considered by Defant and Kravitz, who resolved the case for alignment-free 2-uniform sock orderings. In this paper, we resolve the problem in a more general setting, where each color appears in the sock ordering at most twice. A key component of the argument is a fast algorithm that determines the foot-sortability of a sock ordering of length $N$ in time $O(N\log N)$, which is also an interesting result on its own.


title: ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations

abstract: Neural text-to-speech (TTS) has achieved human-like synthetic speech for single-speaker, single-language synthesis. Multilingual TTS systems are limited to resource-rich languages due to the lack of large paired text and studio-quality audio data. In most cases, TTS systems are built using a single speaker's voice. However, there is growing interest in developing systems that can synthesize voices for new speakers using only a few seconds of their speech. This paper presents ZMM-TTS, a multilingual and multispeaker framework utilizing quantized latent speech representations from a large-scale, pre-trained, self-supervised model. Our paper is the first to incorporate the representations from text-based and speech-based self-supervised learning models into multilingual speech synthesis tasks. We conducted comprehensive subjective and objective evaluations through a series of experiments. Our model has been proven effective in terms of speech naturalness and similarity for both seen and unseen speakers in six high-resource languages. We also tested the efficiency of our method on two hypothetical low-resource languages. The results are promising, indicating that our proposed approach can synthesize audio that is intelligible and has a high degree of similarity to the target speaker's voice, even without any training data for the new, unseen language.


title: Quantum multigraph states and multihypergraph states

abstract: We proposed two classes of multiparticle entangled states, the multigraph states and multihypergraph states, defined by unique operations on the edges and hyperedges. A key discovery is the one-to-one correspondence between the proposed multihypergraph states and the generalized real equally weighted states when d is prime. While for composite d, multihypergraph states form a subset of the generalized real equally weighted states. Meanwhile, we detailed a method for constructing real equally weighted states from hypergraph states and revealed the generalized real equally weighted states which cannot be generated from d-dimensional hypergraph states.


title: Unveiling Backbone Effects in CLIP: Exploring Representational Synergies and Variances

abstract: Contrastive Language-Image Pretraining (CLIP) stands out as a prominent method for image representation learning. Various neural architectures, spanning Transformer-based models like Vision Transformers (ViTs) to Convolutional Networks (ConvNets) like ResNets, are trained with CLIP and serve as universal backbones across diverse vision tasks. Despite utilizing the same data and training objectives, the effectiveness of representations learned by these architectures raises a critical question. Our investigation explores the differences in CLIP performance among these backbone architectures, revealing significant disparities in their classifications. Notably, normalizing these representations results in substantial performance variations. Our findings showcase a remarkable possible synergy between backbone predictions that could reach an improvement of over 20% through informed selection of the appropriate backbone. Moreover, we propose a simple, yet effective approach to combine predictions from multiple backbones, leading to a notable performance boost of up to 6.34\%. We will release the code for reproducing the results.


title: Towards an Exploratory Visual Analytics System for Griefer Identification in MOBA Games

abstract: Multiplayer Online Battle Arenas (MOBAs) have gained a significant player base worldwide, generating over two billion US dollars in annual game revenue. However, the presence of griefers, who deliberately irritate and harass other players within the game, can have a detrimental impact on players' experience, compromising game fairness and potentially leading to the emergence of gray industries. Unfortunately, the absence of a standardized criterion, and the lack of high-quality labeled and annotated data has made it challenging to detect the presence of griefers. Given the complexity of the multivariant spatiotemporal data for MOBA games, game developers heavily rely on manual review of entire game video recordings to label and annotate griefers, which is a time-consuming process. To alleviate this issue, we have collaborated with a team of game specialists to develop an interactive visual analysis interface, called GrieferLens. It overviews players' behavior analysis and synthesizes their key match events. By presenting multiple views of information, GrieferLens can help the game design team efficiently recognize and label griefers in MOBA games and build up a foundation for creating a more enjoyable and fair gameplay environment.


title: The Fairness Fair: Bringing Human Perception into Collective Decision-Making

abstract: Fairness is one of the most desirable societal principles in collective decision-making. It has been extensively studied in the past decades for its axiomatic properties and has received substantial attention from the multiagent systems community in recent years for its theoretical and computational aspects in algorithmic decision-making. However, these studies are often not sufficiently rich to capture the intricacies of human perception of fairness in the ambivalent nature of the real-world problems. We argue that not only fair solutions should be deemed desirable by social planners (designers), but they should be governed by human and societal cognition, consider perceived outcomes based on human judgement, and be verifiable. We discuss how achieving this goal requires a broad transdisciplinary approach ranging from computing and AI to behavioral economics and human-AI interaction. In doing so, we identify shortcomings and long-term challenges of the current literature of fair division, describe recent efforts in addressing them, and more importantly, highlight a series of open research directions.


title: Dynamically generated axial-vector meson resonance in the chiral symmetry restored vacuum

abstract: We study the modification of the properties of the axial-vector meson, dynamically generated through the unitarization procedure, in the vacuum where the chiral symmetry is restored. This is accomplished by scaling the pion decay constant as the chiral order parameter while keeping the other input parameters fixed. We find that the mass and width of the axial-vector meson reduce to those of the vector meson, as anticipated by the Weinberg sum rules. The findings are consistent with the results of a recent QCD sum rule calculation, wherein the chiral order parameter is expressed through chiral symmetry-breaking four-quark operators, leading to the mass-squared difference scaling in proportion to variations in the chiral order parameter. We calculate the scaling behavior for the mass differences obtained from the unitarization method using both the physical and massless pion masses.


title: Cross-Covariate Gait Recognition: A Benchmark

abstract: Gait datasets are essential for gait research. However, this paper observes that present benchmarks, whether conventional constrained or emerging real-world datasets, fall short regarding covariate diversity. To bridge this gap, we undertake an arduous 20-month effort to collect a cross-covariate gait recognition (CCGR) dataset. The CCGR dataset has 970 subjects and about 1.6 million sequences; almost every subject has 33 views and 53 different covariates. Compared to existing datasets, CCGR has both population and individual-level diversity. In addition, the views and covariates are well labeled, enabling the analysis of the effects of different factors. CCGR provides multiple types of gait data, including RGB, parsing, silhouette, and pose, offering researchers a comprehensive resource for exploration. In order to delve deeper into addressing cross-covariate gait recognition, we propose parsing-based gait recognition (ParsingGait) by utilizing the newly proposed parsing data. We have conducted extensive experiments. Our main results show: 1) Cross-covariate emerges as a pivotal challenge for practical applications of gait recognition. 2) ParsingGait demonstrates remarkable potential for further advancement. 3) Alarmingly, existing SOTA methods achieve less than 43% accuracy on the CCGR, highlighting the urgency of exploring cross-covariate gait recognition. Link: https://github.com/ShinanZou/CCGR.


title: Graph Attention-Based Symmetry Constraint Extraction for Analog Circuits

abstract: In recent years, analog circuits have received extensive attention and are widely used in many emerging applications. The high demand for analog circuits necessitates shorter circuit design cycles. To achieve the desired performance and specifications, various geometrical symmetry constraints must be carefully considered during the analog layout process. However, the manual labeling of these constraints by experienced analog engineers is a laborious and time-consuming process. To handle the costly runtime issue, we propose a graph-based learning framework to automatically extract symmetric constraints in analog circuit layout. The proposed framework leverages the connection characteristics of circuits and the devices' information to learn the general rules of symmetric constraints, which effectively facilitates the extraction of device-level constraints on circuit netlists. The experimental results demonstrate that compared to state-of-the-art symmetric constraint detection approaches, our framework achieves higher accuracy and F1-score.


title: Generative Pretraining at Scale: Transformer-Based Encoding of Transactional Behavior for Fraud Detection

abstract: In this work, we introduce an innovative autoregressive model leveraging Generative Pretrained Transformer (GPT) architectures, tailored for fraud detection in payment systems. Our approach innovatively confronts token explosion and reconstructs behavioral sequences, providing a nuanced understanding of transactional behavior through temporal and contextual analysis. Utilizing unsupervised pretraining, our model excels in feature representation without the need for labeled data. Additionally, we integrate a differential convolutional approach to enhance anomaly detection, bolstering the security and efficacy of one of the largest online payment merchants in China. The scalability and adaptability of our model promise broad applicability in various transactional contexts.


title: AdvCloak: Customized Adversarial Cloak for Privacy Protection

abstract: With extensive face images being shared on social media, there has been a notable escalation in privacy concerns. In this paper, we propose AdvCloak, an innovative framework for privacy protection using generative models. AdvCloak is designed to automatically customize class-wise adversarial masks that can maintain superior image-level naturalness while providing enhanced feature-level generalization ability. Specifically, AdvCloak sequentially optimizes the generative adversarial networks by employing a two-stage training strategy. This strategy initially focuses on adapting the masks to the unique individual faces via image-specific training and then enhances their feature-level generalization ability to diverse facial variations of individuals via person-specific training. To fully utilize the limited training data, we combine AdvCloak with several general geometric modeling methods, to better describe the feature subspace of source identities. Extensive quantitative and qualitative evaluations on both common and celebrity datasets demonstrate that AdvCloak outperforms existing state-of-the-art methods in terms of efficiency and effectiveness.


title: Extended p-median problems for balancing service efficiency and equality

abstract: This article deals with the location problem for balancing the service efficiency and equality. In public service systems, some people may feel envy in case that they need longer travel distance to access services than others. The strength of the envy can be measured by comparing one's travel distance to service facility with a threshold distance. Using the total envy function, four extended p-median problems are proposed for trade-off between service efficiency and equality. Five analytical properties of the new problems are mathematically proven. The new problems were tested on three sets of well-designed instances. The experimentation shows that the equality measures, such as the standard deviation, the mean absolute deviation, and the Gini coefficient between travel distances, can be substantially improved by minimizing the travel cost and the spatial envy. The experimentation also shows that, when the service supply is given in terms of the number of facilities, the service equality can be considerably improved by slightly increasing the travel distance. When the service supply is increased in terms of the number of facilities, both the service efficiency and spatial equality can be significantly improved.


title: Probing scalar induced gravitational waves with PTA and LISA: The Importance of third order correction

abstract: We revisit the calculation of third order \acp{SIGW} and extend it from a monochromatic primordial power spectrum to a more general log-normal one. We investigate the impact of third order SIGWs on \ac{SNR} of \ac{LISA} and \ac{PTA} observations, and find that third order SIGWs significantly contribute to the total energy density spectrum of \acp{GW} in high-frequency region. For a primordial power spectrum amplitude of $A_{\zeta}=10^{-2}\sim 10^{-1}$, the effects of third order SIGWs lead to a $40\%$ to $400\%$ increase in the SNR for LISA. Additionally, our PTA data analysis reveals that third order SIGWs diminish both the amplitude $A_{\zeta}$ and the peak frequency $f_*$ of the primordial power spectrum.


title: A Multi-Stage Adaptive Feature Fusion Neural Network for Multimodal Gait Recognition

abstract: Gait recognition is a biometric technology that has received extensive attention. Most existing gait recognition algorithms are unimodal, and a few multimodal gait recognition algorithms perform multimodal fusion only once. None of these algorithms may fully exploit the complementary advantages of the multiple modalities. In this paper, by considering the temporal and spatial characteristics of gait data, we propose a multi-stage feature fusion strategy (MSFFS), which performs multimodal fusions at different stages in the feature extraction process. Also, we propose an adaptive feature fusion module (AFFM) that considers the semantic association between silhouettes and skeletons. The fusion process fuses different silhouette areas with their more related skeleton joints. Since visual appearance changes and time passage co-occur in a gait period, we propose a multiscale spatial-temporal feature extractor (MSSTFE) to learn the spatial-temporal linkage features thoroughly. Specifically, MSSTFE extracts and aggregates spatial-temporal linkages information at different spatial scales. Combining the strategy and modules mentioned above, we propose a multi-stage adaptive feature fusion (MSAFF) neural network, which shows state-of-the-art performance in many experiments on three datasets. Besides, MSAFF is equipped with feature dimensional pooling (FD Pooling), which can significantly reduce the dimension of the gait representations without hindering the accuracy. https://github.com/ShinanZou/MSAFF


title: Ergodic Control of Resource Sharing Networks: Lower Bound on Asymptotic Costs

abstract: Dynamic capacity allocation control for resource sharing networks (RSN) is studied when the networks are in heavy traffic. The goal is to minimize an ergodic cost with a linear holding cost function. Our main result shows that the optimal cost associated with an associated Brownian control problem provides a lower bound for the asymptotic ergodic cost in the RSN for any sequence of control policies. A similar result for an infinite horizon discounted cost has been previously shown for general resource sharing networks and for general "unitary networks." The study of an ergodic cost criterion requires different ideas as bounds on ergodic costs only yield an estimate on the controls in a time-averaged sense which makes the time-rescaling ideas used in the infinite horizon discounted cost cases hard to implement. Proofs rely on working with a weaker topology on the space of controlled processes that is more amenable to an analysis for the ergodic cost. As a corollary of the main result, we show that control policies which achieve hierarchical greedy ideal performance for general RSN are asymptotically optimal for the ergodic cost when the underlying cost per unit time has certain monotonicity properties.


abstract: The main purpose of this article is to provide access to a previously unpublished and nearly lost paper: P. Ho\v{r}ava, "Covariant Hamilton-Jacobi Equation for Pure Gravity", which appeared originally in July 1990 as a Prague Preprint PRA-HEP-90/4, at the Institute of Physics, Czechoslovak Academy of Sciences, but appears otherwise unavailable online. The author has recently acquired an original copy of this preprint; the present article contains a verbatim transcript of the original 1990 paper, framed by a small number of comments. The contents of the 1990 paper was based on the results contained in the author's BSc Thesis, written in Czech, and presented at Charles University, Prague, in 1986. The original 1990 Abstract: We present an alternative framework for treating Einstein gravity in any dimension greater than two, and at any signature. It is based on a covariant Hamilton-Jacobi-De~Donder equation, which is proved to be equivalent to the Lagrange theory, on space-times of arbitrary topology. It in particular means that Einstein gravity can be thought of as a (covariantly) regular system. Finally, the Hamilton-Jacobi theory is studied, and it is shown that any solution of Einstein equations can be obtained from the action form equal identically to zero.


title: Dynamical structures associated with high-order and secondary resonances in the spin-orbit problem

abstract: In our Solar system, spin-orbit resonances are common under Sun--planet, planet--satellite and binary asteroid configurations. In this work, high-order and secondary spin-orbit resonances are investigated by taking numerical and analytical approaches. Poincar\'e sections as well as two types of dynamical maps are produced, showing that there are complicated structures in the phase space. To understand numerical structures, we adopt the theory of perturbative treatments to formulate resonant Hamiltonian for describing spin-orbit resonances. Results show that there is an excellent agreement between analytical and numerical structures. It is concluded that the main V-shape structure arising in the parameter space $(\dot\theta,\alpha)$ is sculpted by the synchronous primary resonance, those minute structures inside the V-shape region are dominated by secondary resonances and those structures outside the V-shape region are governed by high-order resonances. At last, the analytical approach is applied to binary asteroid systems (65803) Didymos and (4383) Suruga to reveal their phase-space structures.


title: Critical quantum geometric tensors of parametrically-driven nonlinear resonators

abstract: Parametrically driven nonlinear resonators represent a building block for realizing fault-tolerant quantum computation and are useful for critical quantum sensing. From a fundamental viewpoint, the most intriguing feature of such a system is perhaps the critical phenomena, which can occur without interaction with any other quantum system. The non-analytic behaviors of its eigenspectrum have been substantially investigated, but those associated with the ground state wavefunction have largely remained unexplored. Using the quantum ground state geometric tensor as an indicator, we comprehensively establish a phase diagram involving the driving parameter $\varepsilon$ and phase $\phi$. The results reveal that with the increase in $\varepsilon$, the system undergoes a quantum phase transition from the normal to the superradiant phase, with the critical point unaffected by $\phi$. Furthermore, the critical exponent and scaling dimension are obtained by an exact numerical method, which is consistent with previous works. Our numerical results show that the phase transition falls within the universality class of the quantum Rabi model. This work reveals that the quantum metric and Berry curvature display diverging behaviors across the quantum phase transition.


title: Electronic structure, magnetic and transport properties of antiferromagnetic Weyl semimetal GdAlSi

abstract: We report the topological electronic structure, magnetic, and magnetotransport properties of a noncentrosymmetric compound GdAlSi. Magnetic susceptibility shows an antiferromagnetic transition at $T_\mathrm{N}$ = 32 K. In-plane isothermal magnetization exhibits an unusual hysteresis behavior at higher magnetic field, rather than near zero field. Moreover, the hysteresis behavior is asymmetric under positive and negative magnetic fields. First-principles calculations were performed on various magnetic configurations, revealing that the antiferromagnetic state is the ground state, and the spiral antiferromagnetic state is a close competing state. The calculations also reveal that GdAlSi hosts multiple Weyl points near the Fermi energy. The band structure measured by angle-resolved photoemission spectroscopy (ARPES) shows relatively good agreement with the theory, with the possibility of Weyl nodes slightly above the Fermi energy. Within the magnetic ordered state, we observe an exceptionally large anomalous Hall conductivity (AHC) of ~ 1310 $\Omega^{-1}$cm$^{-1}$ at 2 K. Interestingly, the anomalous Hall effect persists up to room temperature with a significant value of AHC (~ 155 $\Omega^{-1}$cm$^{-1}$). Our analysis indicates that the large AHC originates from the Berry curvature associated with the multiple pairs of Weyl points near Fermi energy.


title: Joint Semi-Symmetric Tensor PCA for Integrating Multi-modal Populations of Networks

abstract: Multi-modal populations of networks arise in many scenarios including in large-scale multi-modal neuroimaging studies that capture both functional and structural neuroimaging data for thousands of subjects. A major research question in such studies is how functional and structural brain connectivity are related and how they vary across the population. we develop a novel PCA-type framework for integrating multi-modal undirected networks measured on many subjects. Specifically, we arrange these networks as semi-symmetric tensors, where each tensor slice is a symmetric matrix representing a network from an individual subject. We then propose a novel Joint, Integrative Semi-Symmetric Tensor PCA (JisstPCA) model, associated with an efficient iterative algorithm, for jointly finding low-rank representations of two or more networks across the same population of subjects. We establish one-step statistical convergence of our separate low-rank network factors as well as the shared population factors to the true factors, with finite sample statistical error bounds. Through simulation studies and a real data example for integrating multi-subject functional and structural brain connectivity, we illustrate the advantages of our method for finding joint low-rank structures in multi-modal populations of networks.


title: Solar Cycle as a Distinct Line of Evidence Constraining Earth's Transient Climate Response

abstract: Severity of warming predicted by climate models depends on their Transient Climate Response (TCR). Inter-model spread of TCR has persisted at ~100% of its mean for decades. Existing observational constraints of TCR are based on observed historical warming to historical forcing and their uncertainty spread is just as wide, mainly due to forcing uncertainty, and especially that of aerosols. Contrary, no aerosols are involved in solar-cycle forcing, providing an independent, tighter, constraint. Here, we define a climate sensitivity metric: time-dependent response regressed against time-dependent forcing, allowing phenomena with dissimilar time variations, such as the solar cycle with 11-year cyclic forcing, to be used to constrain TCR, which has a linear time-dependent forcing. We find a theoretical linear relationship between the two. The latest coupled atmosphere-ocean climate models obey the same linear relationship statistically. The proposed observational constraint on TCR is about 1/3 as narrow as existing constraints. The central estimate, 2.2$^\circ$C, is at the midpoint of the spread of the latest generation of climate models, which are more sensitive than those of the previous generations.


title: Sharp error estimates for target measure diffusion maps with applications to the committor problem

abstract: We obtain asymptotically sharp error estimates for the consistency error of the Target Measure Diffusion map (TMDmap) (Banisch et al. 2020), a variant of diffusion maps featuring importance sampling and hence allowing input data drawn from an arbitrary density. The derived error estimates include the bias error and the variance error. The resulting convergence rates are consistent with the approximation theory of graph Laplacians. The key novelty of our results lies in the explicit quantification of all the prefactors on leading-order terms. We also prove an error estimate for solutions of Dirichlet BVPs obtained using TMDmap, showing that the solution error is controlled by consistency error. We use these results to study an important application of TMDmap in the analysis of rare events in systems governed by overdamped Langevin dynamics using the framework of transition path theory (TPT). The cornerstone ingredient of TPT is the solution of the committor problem, a boundary value problem for the backward Kolmogorov PDE. Remarkably, we find that the TMDmap algorithm is particularly suited as a meshless solver to the committor problem due to the cancellation of several error terms in the prefactor formula. Furthermore, significant improvements in bias and variance errors occur when using a quasi-uniform sampling density. Our numerical experiments show that these improvements in accuracy are realizable in practice when using $\delta$-nets as spatially uniform inputs to the TMDmap algorithm.


title: An F5 Algorithm for Tropical Gr\"obner Bases in the Weyl Algebras

abstract: A Gr\"obner basis computation for the Weyl algebra with respect to a tropical term order and by using a homogenization-dehomogenization technique is sufficiently sluggish. A significant number of reductions to zero occur. To improve the computation, a tropical F5 algorithm is developed for this context. As a member of the family of signature-based algorithms, this algorithm keeps track of where Weyl algebra elements come from to anticipate reductions to zero. The total order for ordering module monomials or signatures in this paper is designed as close as possible to the definition of the tropical term order. As in Vaccon et al. (2021), this total order is not compatible with the tropical term order.


title: On eigenvalues of sample covariance matrices based on high dimensional compositional data

abstract: This paper studies the asymptotic spectral properties of the sample covariance matrix for high dimensional compositional data, including the limiting spectral distribution, the limit of extreme eigenvalues, and the central limit theorem for linear spectral statistics. All asymptotic results are derived under the high-dimensional regime where the data dimension increases to infinity proportionally with the sample size. The findings reveal that the limiting spectral distribution is the well-known Marchenko-Pastur law. The largest (or smallest non-zero) eigenvalue converges almost surely to the left (or right) endpoint of the limiting spectral distribution, respectively. Moreover, the linear spectral statistics demonstrate a Gaussian limit. Simulation experiments demonstrate the accuracy of theoretical results.


title: Enhancing Actionable Formal Concept Identification with Base-Equivalent Conceptual-Relevance

abstract: In knowledge discovery applications, the pattern set generated from data can be tremendously large and hard to explore by analysts. In the Formal Concept Analysis (FCA) framework, there have been studies to identify important formal concepts through the stability index and other quality measures. In this paper, we introduce the Base-Equivalent Conceptual Relevance (BECR) score, a novel conceptual relevance interestingness measure for improving the identification of actionable concepts. From a conceptual perspective, the base and equivalent attributes are considered meaningful information and are highly essential to maintain the conceptual structure of concepts. Thus, the basic idea of BECR is that the more base and equivalent attributes and minimal generators a concept intent has, the more relevant it is. As such, BECR quantifies these attributes and minimal generators per concept intent. Our preliminary experiments on synthetic and real-world datasets show the efficiency of BECR compared to the well-known stability index.


title: Survey and Monitoring of ASKAP's RFI Environment and Trends I: Flagging Statistics

abstract: We present an initial analysis of Radio Frequency Interference (RFI) flagging statistics from archived Australian SKA Pathfinder (ASKAP) observations for the 'Survey and Monitoring of ASKAP's RFI environment and Trends' (SMART) project. The survey component covers ASKAP's full 700 MHz to 1800 MHz frequency range, including bands not typically used due to severe RFI. In addition to this dedicated survey, we routinely archive and analyse flagging statistics for all scientific observations to monitor the observatory's RFI environment in near real-time. We use the telescope itself as a very sensitive RFI monitor and directly assess the fraction of scientific observations impacted by RFI. To this end, flag tables are now automatically ingested and aggregated as part of routine ASKAP operations for all science observations, as a function of frequency and time. The data presented in this paper come from processing all archived data for several ASKAP Survey Science Projects (SSPs). We found that the average amount of flagging due to RFI across the routinely-used 'clean' continuum science bands is 3%. The 'clean' mid band from 1293 MHz to 1437 MHz (excluding the 144 MHz below 1293 MHz impacted by radionavigation-satellites which is discarded before processing) is the least affected by RFI, followed by the 'clean' low band from 742 MHz to 1085 MHz. ASKAP SSPs lose most of their data to the mobile service in the low band, aeronautical service in the mid band and satellite navigation service in the 1510 MHz to 1797 MHz high band. We also show that for some of these services, the percentage of discarded data has been increasing year-on-year. SMART provides a unique opportunity to study ASKAP's changing RFI environment and informing the implementation of a suite of RFI mitigation techniques.


title: Efficacy of Machine-Generated Instructions

abstract: Large "instruction-tuned" language models (i.e., finetuned to respond to instructions) have demonstrated a remarkable ability to generalize zero-shot to new tasks. Nevertheless, they depend heavily on human-written instruction data that is often limited in quantity, diversity, and creativity, therefore hindering the generality of the tuned model. We conducted a quantitative study to figure out the efficacy of machine-generated annotations, where we compare the results of a fine-tuned BERT model with human v/s machine-generated annotations. Applying our methods to the vanilla GPT-3 model, we saw that machine generated annotations were 78.54% correct and the fine-tuned model achieved a 96.01% model performance compared to the performance with human-labelled annotations. This result shows that machine-generated annotations are a resource and cost effective way to fine-tune down-stream models.


title: Lost in the Logistical Funhouse: Speculative Design as Synthetic Media Enterprise

abstract: From the deployment of chatbots as procurement negotiators by corporations such as Walmart to autonomous agents providing 'differentiated chat' for managing overbooked flights, synthetic media are making the world of logistics their 'natural' habitat. Here the coordination of commodities, parts and labour design the problems and produce the training sets from which 'solutions' can be synthesised. But to what extent might synthetic media, surfacing via proto-platforms such as MidJourney and OpenAI and apps such as Eleven Labs and D:ID, be understood as logistical media? This paper details synthetic media experiments with 'ChatFOS', a GPT-based bot tasked with developing a logistics design business. Using its prompt-generated media outputs, we assemble a simulation and parody of AI's emerging functionalities within logistical worlds. In the process, and with clunky 'human-in-the-loop' stitching, we illustrate how large language models become media routers or switches, governing production of image prompts, website code, promotional copy, and investor pitch scenarios. Together these elements become links chained together in media ensembles such as the corporate website or the promotional video, fuelling the fictive logistics visualisation company we have 'founded'. The processes and methods of producing speculative scenarios via ChatFOS lead us to consider how synthetic media might be re-positioned as logistical media. Our experiments probe the ways in which the media of logistics and the logistics of media are increasingly enfolded. We ask: what can a (practice-based) articulation of this double-becoming of logistics and synthetic mediality tell us about the politics and aesthetics of contemporary computation and capital?


title: Coriolis Factorizations and their Connections to Riemannian Geometry

abstract: Many energy-based control strategies for mechanical systems require the choice of a Coriolis factorization satisfying a skew-symmetry property. This paper explores (a) if and when a control designer has flexibility in this choice, (b) what choice should be made, and (c) how to efficiently perform control computations with it. We link the choice of a Coriolis factorization to the notion of an affine connection on the configuration manifold and show how properties of the connection relate with ones of the associated factorization. Out of the choices available, the factorization based on the Christoffel symbols is linked with a torsion-free property that limits the twisting of system trajectories during passivity-based control. The machinery of Riemannian geometry also offers a natural way to induce Coriolis factorizations for constrained mechanisms from unconstrained ones, and this result provides a pathway to use the theory for efficient control computations with high-dimensional systems such as humanoids and quadruped robots.


title: Room Occupancy Prediction: Exploring the Power of Machine Learning and Temporal Insights

abstract: Energy conservation in buildings is a paramount concern to combat greenhouse gas emissions and combat climate change. The efficient management of room occupancy, involving actions like lighting control and climate adjustment, is a pivotal strategy to curtail energy consumption. In contexts where surveillance technology isn't viable, non-intrusive sensors are employed to estimate room occupancy. In this study, we present a predictive framework for room occupancy that leverages a diverse set of machine learning models, with Random Forest consistently achieving the highest predictive accuracy. Notably, this dataset encompasses both temporal and spatial dimensions, revealing a wealth of information. Intriguingly, our framework demonstrates robust performance even in the absence of explicit temporal modeling. These findings underscore the remarkable predictive power of traditional machine learning models. The success can be attributed to the presence of feature redundancy, the simplicity of linear spatial and temporal patterns, and the advantages of high-frequency data sampling. While these results are compelling, it's essential to remain open to the possibility that explicitly modeling the temporal dimension could unlock deeper insights or further enhance predictive capabilities in specific scenarios. In summary, our research not only validates the effectiveness of our prediction framework for continuous and classification tasks but also underscores the potential for improvements through the inclusion of temporal aspects. The study highlights the promise of machine learning in shaping energy-efficient practices and room occupancy management.


title: GROOD: GRadient-aware Out-Of-Distribution detection in interpolated manifolds

abstract: Deep neural networks (DNNs) often fail silently with over-confident predictions on out-of-distribution (OOD) samples, posing risks in real-world deployments. Existing techniques predominantly emphasize either the feature representation space or the gradient norms computed with respect to DNN parameters, yet they overlook the intricate gradient distribution and the topology of classification regions. To address this gap, we introduce GRadient-aware Out-Of-Distribution detection in interpolated manifolds (GROOD), a novel framework that relies on the discriminative power of gradient space to distinguish between in-distribution (ID) and OOD samples. To build this space, GROOD relies on class prototypes together with a prototype that specifically captures OOD characteristics. Uniquely, our approach incorporates a targeted mix-up operation at an early intermediate layer of the DNN to refine the separation of gradient spaces between ID and OOD samples. We quantify OOD detection efficacy using the distance to the nearest neighbor gradients derived from the training set, yielding a robust OOD score. Experimental evaluations substantiate that the introduction of targeted input mix-upamplifies the separation between ID and OOD in the gradient space, yielding impressive results across diverse datasets. Notably, when benchmarked against ImageNet-1k, GROOD surpasses the established robustness of state-of-the-art baselines. Through this work, we establish the utility of leveraging gradient spaces and class prototypes for enhanced OOD detection for DNN in image classification.


title: A Unified Industrial Large Knowledge Model Framework in Smart Manufacturing

abstract: The recent emergence of large language models (LLMs) shows the potential for artificial general intelligence, revealing new opportunities in industry 4.0 and smart manufacturing. However, a notable gap exists in applying these LLMs in industry, primarily due to their training on general knowledge rather than domain-specific knowledge. Such specialized domain knowledge is vital for effectively addressing the complex needs of industrial applications. To bridge this gap, this paper proposes an Industrial Large Knowledge Model (ILKM) framework emphasizing their potential to revolutionize the industry in smart manufacturing. In addition, ILKMs and LLMs are compared from eight perspectives. Finally, the "6S Principle" is proposed as the guideline for ILKM development, and several potential opportunities are highlighted for ILKM deployment in smart manufacturing.


title: Lagrangian Cobordism and Shadow Distance in Tamarkin Category

abstract: We study exact Lagrangian cobordisms between exact Lagrangians in a cotangent bundle in the sense of Arnol'd, using microlocal theory of sheaves. We construct a sheaf quantization for an exact Lagrangian cobordism between Lagrangians with conical ends, prove an iterated cone decomposition of the sheaf quantization for cobordisms with multiple ends, and show that the interleaving distance of sheaves is bounded by the shadow distance of the cobordism. Using the result, we prove a rigidity result on Lagrangian intersection by estimating the energy cost of splitting and connecting Lagrangians through cobordisms.


title: Proceedings of the Dialogue Robot Competition 2023

abstract: The Dialogic Robot Competition 2023 (DRC2023) is a competition for humanoid robots (android robots that closely resemble humans) to compete in interactive capabilities. This is the third year of the competition. The top four teams from the preliminary competition held in November 2023 will compete in the final competition on Saturday, December 23. The task for the interactive robots is to recommend a tourism plan for a specific region. The robots can employ multimodal behaviors, such as language and gestures, to engage the user in the sightseeing plan they recommend. In the preliminary round, the interactive robots were stationed in a travel agency office, where visitors conversed with them and rated their performance via a questionnaire. In the final round, dialogue researchers and tourism industry professionals interacted with the robots and evaluated their performance. This event allows visitors to gain insights into the types of dialogue services that future dialogue robots should offer. The proceedings include papers on dialogue systems developed by the 12 teams participating in DRC2023, as well as an overview of the papers provided by all the teams.


title: Disc Novae: Thermodynamics of Gas Assisted Binary Black Hole Formation in AGN Discs

abstract: We investigate the thermodynamics of close encounters between stellar mass black holes (BHs) in the gaseous discs of active galactic nuclei (AGN), during which binary black holes (BBHs) may form. We consider a suite of 2D viscous hydrodynamical simulations within a shearing box prescription using the Eulerian grid code Athena++. We study formation scenarios where the fluid is either an isothermal gas or an adiabatic mixture of gas and radiation in local thermal equilibrium. We include the effects of viscous and shock heating, as well as optically thick cooling. We co-evolve the embedded BHs with the gas, keeping track of the energetic dissipation and torquing of the BBH by gas and inertial forces. We find that compared to the isothermal case, the minidiscs formed around each BH are significantly hotter and more diffuse, though BBH formation is still efficient. We observe massive blast waves arising from collisions between the radiative minidiscs during both the initial close encounter, and subsequent periapsis periods for successfully bound BBHs. These "disc novae" have a profound effect, depleting the BBH Hill sphere of gas and injecting energy into the surrounding medium. In analysing the thermal emission from these events, we observe periodic peaks in local luminosity associated with close encounters/periapses, with emission peaking in the optical/near-IR. In the AGN outskirts, these outbursts can reach 4% of the AGN luminosity in the IR band, with flares rising over 0.5-1year. Collisions in different disc regions, or when treated in 3D with magnetism, may produce more prominent flares.


title: Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learning

abstract: X-ray free-electron lasers (XFELs) offer unique capabilities for measuring the structure and dynamics of biomolecules, helping us understand the basic building blocks of life. Notably, high-repetition-rate XFELs enable single particle imaging (X-ray SPI) where individual, weakly scattering biomolecules are imaged under near-physiological conditions with the opportunity to access fleeting states that cannot be captured in cryogenic or crystallized conditions. Existing X-ray SPI reconstruction algorithms, which estimate the unknown orientation of a particle in each captured image as well as its shared 3D structure, are inadequate in handling the massive datasets generated by these emerging XFELs. Here, we introduce X-RAI, an online reconstruction framework that estimates the structure of a 3D macromolecule from large X-ray SPI datasets. X-RAI consists of a convolutional encoder, which amortizes pose estimation over large datasets, as well as a physics-based decoder, which employs an implicit neural representation to enable high-quality 3D reconstruction in an end-to-end, self-supervised manner. We demonstrate that X-RAI achieves state-of-the-art performance for small-scale datasets in simulation and challenging experimental settings and demonstrate its unprecedented ability to process large datasets containing millions of diffraction images in an online fashion. These abilities signify a paradigm shift in X-ray SPI towards real-time capture and reconstruction.


title: Attribute-driven Disentangled Representation Learning for Multimodal Recommendation

abstract: Recommendation algorithms forecast user preferences by correlating user and item representations derived from historical interaction patterns. In pursuit of enhanced performance, many methods focus on learning robust and independent representations by disentangling the intricate factors within interaction data across various modalities in an unsupervised manner. However, such an approach obfuscates the discernment of how specific factors (e.g., category or brand) influence the outcomes, making it challenging to regulate their effects. In response to this challenge, we introduce a novel method called Attribute-Driven Disentangled Representation Learning (short for AD-DRL), which explicitly incorporates attributes from different modalities into the disentangled representation learning process. By assigning a specific attribute to each factor in multimodal features, AD-DRL can disentangle the factors at both attribute and attribute-value levels. To obtain robust and independent representations for each factor associated with a specific attribute, we first disentangle the representations of features both within and across different modalities. Moreover, we further enhance the robustness of the representations by fusing the multimodal features of the same factor. Empirical evaluations conducted on three public real-world datasets substantiate the effectiveness of AD-DRL, as well as its interpretability and controllability.


title: A Review on Searchable Encryption Functionality and the Evaluation of Homomorphic Encryption

abstract: Cloud Service Providers, such as Google Cloud Platform, Microsoft Azure, or Amazon Web Services, offer continuously evolving cloud services. It is a growing industry. Businesses, such as Netflix and PayPal, rely on the Cloud for data storage, computing power, and other services. For businesses, the cloud reduces costs, provides flexibility, and allows for growth. However, there are security and privacy concerns regarding the Cloud. Because Cloud services are accessed through the internet, hackers and attackers could possibly access the servers from anywhere. To protect data in the Cloud, it should be encrypted before it is uploaded, it should be protected in storage and also in transit. On the other hand, data owners may need to access their encrypted data. It may also need to be altered, updated, deleted, read, searched, or shared with others. If data is decrypted in the Cloud, sensitive data is exposed and could be exposed and misused. One solution is to leave the data in its encrypted form and use Searchable Encryption (SE) which operates on encrypted data. The functionality of SE has improved since its inception and research continues to explore ways to improve SE. This paper reviews the functionality of Searchable Encryption, mostly related to Cloud services, in the years 2019 to 2023, and evaluates one of its schemes, Fully Homomorphic Encryption. Overall, it seems that research is at the point where SE efficiency is increased as multiple functionalities are aggregated and tested.


title: Thermodynamic and Stoichiometric Laws Ruling the Fates of Growing Systems

abstract: We delve into growing open chemical reaction systems (CRSs) characterized by autocatalytic reactions within a variable volume, which changes in response to these reactions. Understanding the thermodynamics of such systems is crucial for comprehending biological cells and constructing protocells, as it sheds light on the physical conditions necessary for their self-replication. Building on our recent work, where we developed a thermodynamic theory for growing CRSs featuring basic autocatalytic motifs with regular stoichiometric matrices, we now expand this theory to include scenarios where the stoichiometric matrix has a nontrivial left kernel space. This extension introduces conservation laws, which limit the variations in chemical species due to reactions, thereby confining the system's possible states to those compatible with its initial conditions. By considering both thermodynamic and stoichiometric constraints, we clarify the environmental and initial conditions that dictate the CRSs' fate-whether they grow, shrink, or reach equilibrium. We also find that the conserved quantities significantly influence the equilibrium state achieved by a growing CRS. These results are derived independently of specific thermodynamic potentials or reaction kinetics, therefore underscoring the fundamental impact of conservation laws on the growth of the system.


title: REBEL: A Regularization-Based Solution for Reward Overoptimization in Robotic Reinforcement Learning from Human Feedback

abstract: The effectiveness of reinforcement learning (RL) agents in continuous control robotics tasks is heavily dependent on the design of the underlying reward function. However, a misalignment between the reward function and user intentions, values, or social norms can be catastrophic in the real world. Current methods to mitigate this misalignment work by learning reward functions from human preferences; however, they inadvertently introduce a risk of reward overoptimization. In this work, we address this challenge by advocating for the adoption of regularized reward functions that more accurately mirror the intended behaviors. We propose a novel concept of reward regularization within the robotic RLHF (RL from Human Feedback) framework, which we refer to as \emph{agent preferences}. Our approach uniquely incorporates not just human feedback in the form of preferences but also considers the preferences of the RL agent itself during the reward function learning process. This dual consideration significantly mitigates the issue of reward function overoptimization in RL. We provide a theoretical justification for the proposed approach by formulating the robotic RLHF problem as a bilevel optimization problem. We demonstrate the efficiency of our algorithm {\ours} in several continuous control benchmarks including DeepMind Control Suite \cite{tassa2018deepmind} and MetaWorld \cite{yu2021metaworld} and high dimensional visual environments, with an improvement of more than 70\% in sample efficiency in comparison to current SOTA baselines. This showcases our approach's effectiveness in aligning reward functions with true behavioral intentions, setting a new benchmark in the field.


title: Time-inconsistent mean field and n-agent games under relative performance criteria

abstract: In this paper we study a time-inconsistent portfolio optimization problem for competitive agents with CARA utilities and non-exponential discounting. The utility of each agent depends on her own wealth and consumption as well as the relative wealth and consumption to her competitors. Due to the presence of a non-exponential discount factor, each agent's optimal strategy becomes time-inconsistent. In order to resolve time-inconsistency, each agent makes a decision in a sophisticated way, choosing open-loop equilibrium strategy in response to the strategies of all the other agents. We construct explicit solutions for the $n$-agent games and the corresponding mean field games (MFGs) where the limit of former yields the latter. This solution is unique in a special class of equilibria.


title: PC-Conv: Unifying Homophily and Heterophily with Two-fold Filtering

abstract: Recently, many carefully crafted graph representation learning methods have achieved impressive performance on either strong heterophilic or homophilic graphs, but not both. Therefore, they are incapable of generalizing well across real-world graphs with different levels of homophily. This is attributed to their neglect of homophily in heterophilic graphs, and vice versa. In this paper, we propose a two-fold filtering mechanism to extract homophily in heterophilic graphs and vice versa. In particular, we extend the graph heat equation to perform heterophilic aggregation of global information from a long distance. The resultant filter can be exactly approximated by the Possion-Charlier (PC) polynomials. To further exploit information at multiple orders, we introduce a powerful graph convolution PC-Conv and its instantiation PCNet for the node classification task. Compared with state-of-the-art GNNs, PCNet shows competitive performance on well-known homophilic and heterophilic graphs. Our implementation is available at https://github.com/uestclbh/PC-Conv.


title: PUMA: Efficient Continual Graph Learning with Graph Condensation

abstract: When handling streaming graphs, existing graph representation learning models encounter a catastrophic forgetting problem, where previously learned knowledge of these models is easily overwritten when learning with newly incoming graphs. In response, Continual Graph Learning emerges as a novel paradigm enabling graph representation learning from static to streaming graphs. Our prior work, CaT is a replay-based framework with a balanced continual learning procedure, which designs a small yet effective memory bank for replaying data by condensing incoming graphs. Although the CaT alleviates the catastrophic forgetting problem, there exist three issues: (1) The graph condensation algorithm derived in CaT only focuses on labelled nodes while neglecting abundant information carried by unlabelled nodes; (2) The continual training scheme of the CaT overemphasises on the previously learned knowledge, limiting the model capacity to learn from newly added memories; (3) Both the condensation process and replaying process of the CaT are time-consuming. In this paper, we propose a psudo-label guided memory bank (PUMA) CGL framework, extending from the CaT to enhance its efficiency and effectiveness by overcoming the above-mentioned weaknesses and limits. To fully exploit the information in a graph, PUMA expands the coverage of nodes during graph condensation with both labelled and unlabelled nodes. Furthermore, a training-from-scratch strategy is proposed to upgrade the previous continual learning scheme for a balanced training between the historical and the new graphs. Besides, PUMA uses a one-time prorogation and wide graph encoders to accelerate the graph condensation and the graph encoding process in the training stage to improve the efficiency of the whole framework. Extensive experiments on four datasets demonstrate the state-of-the-art performance and efficiency over existing methods.


title: Asymmetric Bias in Text-to-Image Generation with Adversarial Attacks

abstract: The widespread use of Text-to-Image (T2I) models in content generation requires careful examination of their safety, including their robustness to adversarial attacks. Despite extensive research on adversarial attacks, the reasons for their effectiveness remain underexplored. This paper presents an empirical study on adversarial attacks against T2I models, focusing on analyzing factors associated with attack success rates (ASR). We introduce a new attack objective - entity swapping using adversarial suffixes and two gradient-based attack algorithms. Human and automatic evaluations reveal the asymmetric nature of ASRs on entity swap: for example, it is easier to replace "human" with "robot" in the prompt "a human dancing in the rain." with an adversarial suffix, but the reverse replacement is significantly harder. We further propose probing metrics to establish indicative signals from the model's beliefs to the adversarial ASR. We identify conditions that result in a success probability of 60% for adversarial attacks and others where this likelihood drops below 5%.