title: THz transition radiation of electron bunch laser-accelerated in long-scale near-critical density plasmas

abstract: Direct laser electron acceleration in near-critical density plasma produces collimated electron beams with high charge $Q$ (up to $\mu$C). This regime could be of interest for high energy THz radiation generation, as many of the mechanisms have a scaling $\propto Q^2$. In this work we focused specifically on challenges that arise during numerical investigation of transition radiation in such interaction. Detailed analytical calculations that include both diffraction and decoherence effects of characteristics of transition radiation in the THz range were conducted with the input parameters obtained from 3D PIC and hydrodynamic simulations. The calculated characteristics of THz radiation are in good agreement with the experimentally measured ones. Therefore, this approach can be used both to optimize properties of THz radiation and distinguish the transition radiation contribution if several mechanisms of THz radiation generation are considered.


title: rTsfNet: a DNN model with Multi-head 3D Rotation and Time Series Feature Extraction for IMU-based Human Activity Recognition

abstract: Although many deep learning (DL) algorithms have been proposed for the IMU-based HAR domain, traditional machine learning that utilizes handcrafted time series features (TSFs) still often performs well. It is not rare that combinations among DL and TSFs show better accuracy than DL-only approaches. However, there is a problem with time series features in IMU-based HAR. The amount of derived features can vary greatly depending on the method used to select the 3D basis. Fortunately, DL's strengths include capturing the features of input data and adaptively deriving parameters. Thus, as a new DNN model for IMU-based human activity recognition (HAR), this paper proposes rTsfNet, a DNN model with Multi-head 3D Rotation and Time Series Feature Extraction. rTsfNet automatically selects 3D bases from which features should be derived by extracting 3D rotation parameters within the DNN. Then, time series features (TSFs), based on many researchers' wisdom, are derived to achieve HAR using MLP. Although rTsfNet is a model that does not use CNN, it achieved higher accuracy than existing models under well-managed benchmark conditions and multiple datasets: UCI HAR, PAMAP2, Daphnet, and OPPORTUNITY, all of which target different activities.


title: Cosmological LTB Black Hole in a Quintom Universe

abstract: We study cosmological Lemaitre-Tolman-Bondi (LTB) black hole thermodynamics immersed in a quintom universe. We investigate some thermodynamic aspects of such a black hole in detail. We apply two methods of treating particles' tunneling from the apparent horizons and calculate the black hole's temperature in each method; the results of which are the same. In addition, by considering specific time slices in cosmic history, we study the thermodynamic features of this black hole in these specific cosmic epochs. Also, we discuss the information loss problem and the remnant content of the cosmological black hole in different cosmic epochs in this context. We show that approximately in all cosmic history, the temperature of the black hole's apparent horizon is more than the temperature of the cosmological apparent horizon.


title: Facilitating Graph Neural Networks with Random Walk on Simplicial Complexes

abstract: Node-level random walk has been widely used to improve Graph Neural Networks. However, there is limited attention to random walk on edge and, more generally, on $k$-simplices. This paper systematically analyzes how random walk on different orders of simplicial complexes (SC) facilitates GNNs in their theoretical expressivity. First, on $0$-simplices or node level, we establish a connection between existing positional encoding (PE) and structure encoding (SE) methods through the bridge of random walk. Second, on $1$-simplices or edge level, we bridge edge-level random walk and Hodge $1$-Laplacians and design corresponding edge PE respectively. In the spatial domain, we directly make use of edge level random walk to construct EdgeRWSE. Based on the spectral analysis of Hodge $1$-Laplcians, we propose Hodge1Lap, a permutation equivariant and expressive edge-level positional encoding. Third, we generalize our theory to random walk on higher-order simplices and propose the general principle to design PE on simplices based on random walk and Hodge Laplacians. Inter-level random walk is also introduced to unify a wide range of simplicial networks. Extensive experiments verify the effectiveness of our random walk-based methods.


title: Local convergence of a sequential quadratic programming method for a class of nonsmooth nonconvex objectives

abstract: A sequential quadratic programming (SQP) algorithm is designed for nonsmooth optimization problems with upper-C^2 objective functions. Upper-C^2 functions are locally equivalent to difference-of-convex (DC) functions with smooth convex parts. They arise naturally in many applications such as certain classes of solutions to parametric optimization problems, e.g., recourse of stochastic programming, and projection onto closed sets. The proposed algorithm conducts line search and adopts an exact penalty merit function. The potential inconsistency due to the linearization of constraints are addressed through relaxation, similar to that of Sl_1QP. We show that the algorithm is globally convergent under reasonable assumptions. Moreover, we study the local convergence behavior of the algorithm under additional assumptions of Kurdyka-{\L}ojasiewicz (KL) properties, which have been applied to many nonsmooth optimization problems. Due to the nonconvex nature of the problems, a special potential function is used to analyze local convergence. We show that under acceptable assumptions, upper bounds on local convergence can be proven. Additionally, we show that for a large number of optimization problems with upper-C^2 objectives, their corresponding potential functions are indeed KL functions. Numerical experiment is performed with a power grid optimization problem that is consistent with the assumptions and analysis in this paper.


title: Enhancing Scalability and Reliability in Semi-Decentralized Federated Learning With Blockchain: Trust Penalization and Asynchronous Functionality

abstract: The paper presents an innovative approach to address the challenges of scalability and reliability in Distributed Federated Learning by leveraging the integration of blockchain technology. The paper focuses on enhancing the trustworthiness of participating nodes through a trust penalization mechanism while also enabling asynchronous functionality for efficient and robust model updates. By combining Semi-Decentralized Federated Learning with Blockchain (SDFL-B), the proposed system aims to create a fair, secure and transparent environment for collaborative machine learning without compromising data privacy. The research presents a comprehensive system architecture, methodologies, experimental results, and discussions that demonstrate the advantages of this novel approach in fostering scalable and reliable SDFL-B systems.


title: EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution

abstract: Recently, convolutional networks have achieved remarkable development in remote sensing image Super-Resoltuion (SR) by minimizing the regression objectives, e.g., MSE loss. However, despite achieving impressive performance, these methods often suffer from poor visual quality with over-smooth issues. Generative adversarial networks have the potential to infer intricate details, but they are easy to collapse, resulting in undesirable artifacts. To mitigate these issues, in this paper, we first introduce Diffusion Probabilistic Model (DPM) for efficient remote sensing image SR, dubbed EDiffSR. EDiffSR is easy to train and maintains the merits of DPM in generating perceptual-pleasant images. Specifically, different from previous works using heavy UNet for noise prediction, we develop an Efficient Activation Network (EANet) to achieve favorable noise prediction performance by simplified channel attention and simple gate operation, which dramatically reduces the computational budget. Moreover, to introduce more valuable prior knowledge into the proposed EDiffSR, a practical Conditional Prior Enhancement Module (CPEM) is developed to help extract an enriched condition. Unlike most DPM-based SR models that directly generate conditions by amplifying LR images, the proposed CPEM helps to retain more informative cues for accurate SR. Extensive experiments on four remote sensing datasets demonstrate that EDiffSR can restore visual-pleasant images on simulated and real-world remote sensing images, both quantitatively and qualitatively. The code of EDiffSR will be available at https://github.com/XY-boy/EDiffSR


title: AMLNet: Adversarial Mutual Learning Neural Network for Non-AutoRegressive Multi-Horizon Time Series Forecasting

abstract: Multi-horizon time series forecasting, crucial across diverse domains, demands high accuracy and speed. While AutoRegressive (AR) models excel in short-term predictions, they suffer speed and error issues as the horizon extends. Non-AutoRegressive (NAR) models suit long-term predictions but struggle with interdependence, yielding unrealistic results. We introduce AMLNet, an innovative NAR model that achieves realistic forecasts through an online Knowledge Distillation (KD) approach. AMLNet harnesses the strengths of both AR and NAR models by training a deep AR decoder and a deep NAR decoder in a collaborative manner, serving as ensemble teachers that impart knowledge to a shallower NAR decoder. This knowledge transfer is facilitated through two key mechanisms: 1) outcome-driven KD, which dynamically weights the contribution of KD losses from the teacher models, enabling the shallow NAR decoder to incorporate the ensemble's diversity; and 2) hint-driven KD, which employs adversarial training to extract valuable insights from the model's hidden states for distillation. Extensive experimentation showcases AMLNet's superiority over conventional AR and NAR models, thereby presenting a promising avenue for multi-horizon time series forecasting that enhances accuracy and expedites computation.


title: Analyzing eyebrow region for morphed image detection

abstract: Facial images in passports are designated as primary identifiers for the verification of travelers according to the International Civil Aviation Organization (ICAO). Hence, it is important to ascertain the sanctity of the facial images stored in the electronic Machine-Readable Travel Document (eMRTD). With the introduction of automated border control (ABC) systems that rely on face recognition for the verification of travelers, it is even more crucial to have a system to ensure that the image stored in the eMRTD is free from any alteration that can hinder or abuse the normal working of a facial recognition system. One such attack against these systems is the face-morphing attack. Even though many techniques exist to detect morphed images, morphing algorithms are also improving to evade these detections. In this work, we analyze the eyebrow region for morphed image detection. The proposed method is based on analyzing the frequency content of the eyebrow region. The method was evaluated on two datasets that each consisted of morphed images created using two algorithms. The findings suggest that the proposed method can serve as a valuable tool in morphed image detection, and can be used in various applications where image authenticity is critical.


title: A3SA: Advanced Data Augmentation via Adjoint Sensitivity Analysis

abstract: Innovative machine learning techniques have facilitated the inverse design of photonic structures for numerous practical applications. Nevertheless, within these approaches, the quantity of data and the initial data distribution are paramount for the discovery of highly efficient photonic devices. These devices often require simulated data ranging from thousands to several hundred thousand data points. This issue has consistently posed a major hurdle in machine learning-based photonic design problems. Therefore, we propose a novel data augmentation algorithm grounded in the adjoint method, capable of generating more than 300 times the amount of original data while enhancing device efficiency. The adjoint method forecasts changes in the figure of merit (FoM) resulting from structural perturbations, requiring only two full-wave Maxwell simulations for this prediction. By leveraging the adjoint gradient values, we can augment and label several thousand new data points without any additional computations. Furthermore, the augmented data generated by the proposed algorithm displays significantly improved FoMs owing to the precise FoM change predictions enabled by the adjoint gradients. We apply this algorithm to a multi-layered metalens design problem and demonstrate that it consequently exhibits a 343-fold increase in data generation efficiency. After incorporating the proposed algorithm into a generative adversarial network (GAN), the optimized metalens exhibits a maximum focusing efficiency of 92.93%, comparable to the theoretical upper bound (93.80%).


title: Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answering

abstract: Answering time-sensitive questions from long documents requires temporal reasoning over the times in questions and documents. An important open question is whether large language models can perform such reasoning solely using a provided text document, or whether they can benefit from additional temporal information extracted using other systems. We address this research question by applying existing temporal information extraction systems to construct temporal graphs of events, times, and temporal relations in questions and documents. We then investigate different approaches for fusing these graphs into Transformer models. Experimental results show that our proposed approach for fusing temporal graphs into input text substantially enhances the temporal reasoning capabilities of Transformer models with or without fine-tuning. Additionally, our proposed method outperforms various graph convolution-based approaches and establishes a new state-of-the-art performance on SituatedQA and three splits of TimeQA.


title: FetusMapV2: Enhanced Fetal Pose Estimation in 3D Ultrasound

abstract: Fetal pose estimation in 3D ultrasound (US) involves identifying a set of associated fetal anatomical landmarks. Its primary objective is to provide comprehensive information about the fetus through landmark connections, thus benefiting various critical applications, such as biometric measurements, plane localization, and fetal movement monitoring. However, accurately estimating the 3D fetal pose in US volume has several challenges, including poor image quality, limited GPU memory for tackling high dimensional data, symmetrical or ambiguous anatomical structures, and considerable variations in fetal poses. In this study, we propose a novel 3D fetal pose estimation framework (called FetusMapV2) to overcome the above challenges. Our contribution is three-fold. First, we propose a heuristic scheme that explores the complementary network structure-unconstrained and activation-unreserved GPU memory management approaches, which can enlarge the input image resolution for better results under limited GPU memory. Second, we design a novel Pair Loss to mitigate confusion caused by symmetrical and similar anatomical structures. It separates the hidden classification task from the landmark localization task and thus progressively eases model learning. Last, we propose a shape priors-based self-supervised learning by selecting the relatively stable landmarks to refine the pose online. Extensive experiments and diverse applications on a large-scale fetal US dataset including 1000 volumes with 22 landmarks per volume demonstrate that our method outperforms other strong competitors.


title: Dual-comb spectroscopy over 100km open-air path

abstract: Satellite-based greenhouse gases (GHG) sensing technologies play a critical role in the study of global carbon emissions and climate change. However, none of the existing satellite-based GHG sensing technologies can achieve the measurement of broad bandwidth, high temporal-spatial resolution, and high sensitivity at the same time. Recently, dual-comb spectroscopy (DCS) has been proposed as a superior candidate technology for GHG sensing because it can measure broadband spectra with high temporal-spatial resolution and high sensitivity. The main barrier to DCS's display on satellites is its short measurement distance in open air achieved thus far. Prior research has not been able to implement DCS over 20 km of open-air path. Here, by developing a bistatic setup using time-frequency dissemination and high-power optical frequency combs, we have implemented DCS over a 113 km turbulent horizontal open-air path. Our experiment successfully measured GHG with 7 nm spectral bandwidth and a 10 kHz frequency and achieved a CO2 sensing precision of <2 ppm in 5 minutes and <0.6 ppm in 36 minutes. Our results represent a significant step towards advancing the implementation of DCS as a satellite-based technology and improving technologies for GHG monitoring


title: ROAM: memory-efficient large DNN training via optimized operator ordering and memory layout

abstract: As deep learning models continue to increase in size, the memory requirements for training have surged. While high-level techniques like offloading, recomputation, and compression can alleviate memory pressure, they also introduce overheads. However, a memory-efficient execution plan that includes a reasonable operator execution order and tensor memory layout can significantly increase the models' memory efficiency and reduce overheads from high-level techniques. In this paper, we propose ROAM which operates on computation graph level to derive memory-efficient execution plan with optimized operator order and tensor memory layout for models. We first propose sophisticated theories that carefully consider model structure and training memory load to support optimization for large complex graphs that have not been well supported in the past. An efficient tree-based algorithm is further proposed to search task divisions automatically, along with delivering high performance and effectiveness to solve the problem. Experiments show that ROAM achieves a substantial memory reduction of 35.7%, 13.3%, and 27.2% compared to Pytorch and two state-of-the-art methods and offers a remarkable 53.7x speedup. The evaluation conducted on the expansive GPT2-XL further validates ROAM's scalability.


title: Complex-valued Wigner entropy of a quantum state

abstract: It is common knowledge that the Wigner function of a quantum state may admit negative values, so that it cannot be viewed as a genuine probability density. Here, we examine the difficulty in finding an entropy-like functional in phase space that extends to negative Wigner functions and then advocate the merits of defining a complex-valued entropy associated with any Wigner function. This quantity, which we call the complex Wigner entropy, is defined via the analytic continuation of Shannon's differential entropy of the Wigner function in the complex plane. We show that the complex Wigner entropy enjoys interesting properties, especially its real and imaginary parts are both invariant under Gaussian unitaries (displacements, rotations, and squeezing in phase space). Its real part is physically relevant when considering the evolution of the Wigner function under a Gaussian convolution, while its imaginary part is simply proportional to the negative volume of the Wigner function. Finally, we define the complex-valued Fisher information of any Wigner function, which is linked (via an extended de Bruijn's identity) to the time derivative of the complex Wigner entropy when the state undergoes Gaussian additive noise. Overall, it is anticipated that the complex plane yields a proper framework for analyzing the entropic properties of quasiprobability distributions in phase space.


title: On Measuring Fairness in Generative Models

abstract: Recently, there has been increased interest in fair generative models. In this work, we conduct, for the first time, an in-depth study on fairness measurement, a critical component in gauging progress on fair generative models. We make three contributions. First, we conduct a study that reveals that the existing fairness measurement framework has considerable measurement errors, even when highly accurate sensitive attribute (SA) classifiers are used. These findings cast doubts on previously reported fairness improvements. Second, to address this issue, we propose CLassifier Error-Aware Measurement (CLEAM), a new framework which uses a statistical model to account for inaccuracies in SA classifiers. Our proposed CLEAM reduces measurement errors significantly, e.g., 4.98% $\rightarrow$ 0.62% for StyleGAN2 w.r.t. Gender. Additionally, CLEAM achieves this with minimal additional overhead. Third, we utilize CLEAM to measure fairness in important text-to-image generator and GANs, revealing considerable biases in these models that raise concerns about their applications. Code and more resources: https://sutd-visual-computing-group.github.io/CLEAM/.


title: Interfacial Tension Hysteresis of Eutectic Gallium-Indium

abstract: When in a pristine state, gallium and its alloys have the largest interfacial tensions of any liquid at room temperature. Nonetheless, applying as little as 0.8 V of electric potential across eutectic gallium indium (EGaIn) placed within aqueous NaOH (or other electrolyte) solution will cause the metal to behave as if its interfacial tension is near zero. The mechanism behind this phenomenon has remained poorly understood because NaOH dissolves the oxide species, making it difficult to directly measure the concentration, thickness, or chemical composition of the film that forms at the interface. In addition, the oxide layers formed are atomically-thin. Here, we present a suite of techniques which allow us to simultaneously measure both electrical and interfacial properties as a function of applied electric potential, allowing for new insights into the mechanisms which cause the dramatic decrease in interfacial tension. A key discovery from this work is that the interfacial tension displays hysteresis while lowering the applied potential. We combine these observations with electrochemical impedance spectroscopy to evaluate how these changes in interfacial tension arise from chemical, electrical, and mechanical changes on the interface, and close with ideas for how to build a free energy model to predict these changes from first principles.


title: Soft factors with AdS radius corrections

abstract: We review recent developments concerning the soft factorization of scattering amplitudes that arise in the large radius limit of four dimensional Anti-de Sitter (AdS$_4$) spacetimes. This includes the presence of AdS radius dependent corrections of known flat spacetime soft factors and their implication on the relationship between soft theorems and Ward identities of the boundary conformal field theory.


title: Stage-Aware Learning for Dynamic Treatments

abstract: Recent advances in dynamic treatment regimes (DTRs) provide powerful optimal treatment searching algorithms, which are tailored to individuals' specific needs and able to maximize their expected clinical benefits. However, existing algorithms could suffer from insufficient sample size under optimal treatments, especially for chronic diseases involving long stages of decision-making. To address these challenges, we propose a novel individualized learning method which estimates the DTR with a focus on prioritizing alignment between the observed treatment trajectory and the one obtained by the optimal regime across decision stages. By relaxing the restriction that the observed trajectory must be fully aligned with the optimal treatments, our approach substantially improves the sample efficiency and stability of inverse probability weighted based methods. In particular, the proposed learning scheme builds a more general framework which includes the popular outcome weighted learning framework as a special case of ours. Moreover, we introduce the notion of stage importance scores along with an attention mechanism to explicitly account for heterogeneity among decision stages. We establish the theoretical properties of the proposed approach, including the Fisher consistency and finite-sample performance bound. Empirically, we evaluate the proposed method in extensive simulated environments and a real case study for COVID-19 pandemic.


title: ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense

abstract: Humans possess a strong capability for reasoning beyond common sense. For example, given an unconventional image of a goldfish laying on the table next to an empty fishbowl, a human would effortlessly determine that the fish is not inside the fishbowl. The case, however, may be different for a vision-language model, whose reasoning could gravitate towards the common scenario that the fish is inside the bowl, despite the visual input. In this paper, we introduce a novel probing dataset named ROME (reasoning beyond commonsense knowledge) to evaluate whether the state-of-the-art pre-trained vision-language models have the reasoning capability to correctly interpret counter-intuitive content. ROME contains images that defy commonsense knowledge with regards to color, shape, material, size and positional relation. Experiments on the state-of-the-art pre-trained vision-language models reveal that most of these models are still largely incapable of interpreting counter-intuitive scenarios. We hope that ROME will spur further investigations on reasoning beyond commonsense knowledge in vision-language research.


title: Empirical approximation to invariant measures of non-degenerate McKean-Vlasov dynamics

abstract: This paper studies the approximation of invariant measures of McKean-Vlasov dynamics with non-degenerate additive noise. While prior findings necessitated a strong monotonicity condition on the McKean-Vlasov process, we expand these results to encompass dissipative and weak interaction scenarios. Utilizing a reflection coupling technique, we prove that the empirical measures of the McKean-Vlasov process and its path-dependent counterpart can converge to the invariant measure in the Wasserstein metric. The Curie-Weiss mean-field lattice model serves as a numerical example to illustrate empirical approximation.


title: Extracting user needs with Chat-GPT for dialogue recommendation

abstract: Large-scale language models (LLMs), such as ChatGPT, are becoming increasingly sophisticated and exhibit human-like capabilities, playing an essential role in assisting humans in a variety of everyday tasks. An important application of AI is interactive recommendation systems that respond to human inquiries and make recommendations tailored to the user. In most conventional interactive recommendation systems, the language model is used only as a dialogue model, and there is a separate recommendation system. This is due to the fact that the language model used as a dialogue system does not have the capability to serve as a recommendation system. Therefore, we will realize the construction of a dialogue system with recommendation capability by using OpenAI's Chat-GPT, which has a very high inference capability as a dialogue system and the ability to generate high-quality sentences, and verify the effectiveness of the system.


title: Privacy-Preserving Federated Learning over Vertically and Horizontally Partitioned Data for Financial Anomaly Detection

abstract: The effective detection of evidence of financial anomalies requires collaboration among multiple entities who own a diverse set of data, such as a payment network system (PNS) and its partner banks. Trust among these financial institutions is limited by regulation and competition. Federated learning (FL) enables entities to collaboratively train a model when data is either vertically or horizontally partitioned across the entities. However, in real-world financial anomaly detection scenarios, the data is partitioned both vertically and horizontally and hence it is not possible to use existing FL approaches in a plug-and-play manner. Our novel solution, PV4FAD, combines fully homomorphic encryption (HE), secure multi-party computation (SMPC), differential privacy (DP), and randomization techniques to balance privacy and accuracy during training and to prevent inference threats at model deployment time. Our solution provides input privacy through HE and SMPC, and output privacy against inference time attacks through DP. Specifically, we show that, in the honest-but-curious threat model, banks do not learn any sensitive features about PNS transactions, and the PNS does not learn any information about the banks' dataset but only learns prediction labels. We also develop and analyze a DP mechanism to protect output privacy during inference. Our solution generates high-utility models by significantly reducing the per-bank noise level while satisfying distributed DP. To ensure high accuracy, our approach produces an ensemble model, in particular, a random forest. This enables us to take advantage of the well-known properties of ensembles to reduce variance and increase accuracy. Our solution won second prize in the first phase of the U.S. Privacy Enhancing Technologies (PETs) Prize Challenge.


title: On Validity of Gyrokinetic Theory

abstract: We study the validity of gyrokinetic theory by examining the destruction of magnetic moment adiabatic invariant in the presence of fluctuations. Contrary to common assertions, it is shown for the first time that the gyrokinetic theory rests not only on the magnetic moment conservation, but also on the fact that the particle dynamics constitutes a boundary layer problem. For low frequency fluctuations, there exists a quantitative, frequency independent threshold below which the adiabaticity is preserved, allowing thereby the general validity of gyrokinetic theory. The adiabaticity threshold in the high frequency regime, however, depends sensitively on frequency, which questions the generalization of gyrokinetic equation to arbitrary frequencies. Further analyses suggest that it is not feasible to construct a reduced kinetic equation based on superadiabaticity.


title: A Planning-and-Exploring Approach to Extreme-Mechanics Force Fields

abstract: Extreme mechanical processes such as strong lattice distortion and bond breakage during fracture are ubiquitous in nature and engineering, which often lead to catastrophic failure of structures. However, understanding the nucleation and growth of cracks is challenged by their multiscale characteristics spanning from atomic-level structures at the crack tip to the structural features where the load is applied. Molecular simulations offer an important tool to resolve the progressive microstructural changes at crack fronts and are widely used to explore processes therein, such as mechanical energy dissipation, crack path selection, and dynamic instabilities (e.g., kinking, branching). Empirical force fields developed based on local descriptors based on atomic positions and the bond orders do not yield satisfying predictions of fracture, even for the nonlinear, anisotropic stress-strain relations and the energy densities of edges. High-fidelity force fields thus should include the tensorial nature of strain and the energetics of rare events during fracture, which, unfortunately, have not been taken into account in both the state-of-the-art empirical and machine-learning force fields. Based on data generated by first-principles calculations, we develop a neural network-based force field for fracture, NN-F$^3$, by combining pre-sampling of the space of strain states and active-learning techniques to explore the transition states at critical bonding distances. The capability of NN-F$^3$ is demonstrated by studying the rupture of h-BN and twisted bilayer graphene as model problems. The simulation results confirm recent experimental findings and highlight the necessity to include the knowledge of electronic structures from first-principles calculations in predicting extreme mechanical processes.


title: Discovery of four new EL CVn-type binaries in the Gaia eclipsing binaries

abstract: In this paper, we performed a search for EL CVn-type binaries based on the Gaia and TESS data. Through the combination of the Gaia DR3 eclipsing binary catalogue and the Gaia DR3 spectroscopic binary catalogue, we have identified 13 stars exhibiting EL CVn-like characteristics. Among these stars, nine have already been identified as EL CVn binaries, while the remaining four are newly discovered candidates. The photometric solutions and absolute parameters of the four binary systems were obtained by utilizing TESS photometry and orbital elements from Gaia DR3 spectroscopic binary catalogue. Light-curve modeling has revealed that all four binary systems with a detached configuration exhibit very low mass ratios, approximately $q\simeq$0.1. The derived physical parameters indicate that the four binary systems are highly probable candidates for being newly discovered EL CVn-type binaries. A preliminary frequency analysis was conducted on the residuals of the light curves, after the removal of binarity effects. The results suggest that the primary component star of TIC 100011519, TIC 219485855 and TIC 464641792 might be a $\delta$ Sct pulsator. However, TIC 399725538 does not exhibit any intrinsic pulsations.


title: Free from Bellman Completeness: Trajectory Stitching via Model-based Return-conditioned Supervised Learning

abstract: Off-policy dynamic programming (DP) techniques such as $Q$-learning have proven to be important in sequential decision-making problems. In the presence of function approximation, however, these techniques often diverge due to the absence of Bellman completeness in the function classes considered, a crucial condition for the success of DP-based methods. In this paper, we show how off-policy learning techniques based on return-conditioned supervised learning (RCSL) are able to circumvent these challenges of Bellman completeness, converging under significantly more relaxed assumptions inherited from supervised learning. We prove there exists a natural environment in which if one uses two-layer multilayer perceptron as the function approximator, the layer width needs to grow linearly with the state space size to satisfy Bellman completeness while a constant layer width is enough for RCSL. These findings take a step towards explaining the superior empirical performance of RCSL methods compared to DP-based methods in environments with near-optimal datasets. Furthermore, in order to learn from sub-optimal datasets, we propose a simple framework called MBRCSL, granting RCSL methods the ability of dynamic programming to stitch together segments from distinct trajectories. MBRCSL leverages learned dynamics models and forward sampling to accomplish trajectory stitching while avoiding the need for Bellman completeness that plagues all dynamic programming algorithms. We propose both theoretical analysis and experimental evaluation to back these claims, outperforming state-of-the-art model-free and model-based offline RL algorithms across several simulated robotics problems.


title: A simple quantum algorithm to efficiently prepare sparse states

abstract: State preparation is a fundamental routine in quantum computation, for which many algorithms have been proposed. Among them, perhaps the simplest one is the Grover-Rudolph algorithm. In this paper, we analyse the performance of this algorithm when the state to prepare is sparse. We show that the gate complexity is linear in the number of non-zero amplitudes in the state and quadratic in the number of qubits. We then introduce a simple modification of the algorithm, which makes the dependence on the number of qubits also linear. This is competitive with the best known algorithms for sparse state preparation


title: Work statistics and generalized Loschmidt echo for the Hatano-Nelson model

abstract: We focus on the biorthogonal work statistics of the interacting many-body Hatano-Nelson model after switching on the imaginary vector potential. We introduce a generalized Loschmidt echo $G(t)$ utilizing the biorthogonal metric operator. It is well suited for numerical analysis and its Fourier transform yields the probability distribution of work done. The statistics of work displays several universal features, including an exponential decay with the square of both the system size and imaginary vector potential for the probability to stay in the ground state. Additionally, its high energy tail follows a universal power law with exponent $-3$. This originates from the peculiar temporal power law decay of $G(t)$ with a time dependent exponent. The mean and the variance of work scale linearly and logarithmically with system size while all higher cumulants are non-extensive. Our results are relevant for non-unitary field theories as well.


title: Relation-driven Query of Multiple Time Series

abstract: Querying time series based on their relations is a crucial part of multiple time series analysis. By retrieving and understanding time series relations, analysts can easily detect anomalies and validate hypotheses in complex time series datasets. However, current relation extraction approaches, including knowledge- and data-driven ones, tend to be laborious and do not support heterogeneous relations. By conducting a formative study with 11 experts, we concluded 6 time series relations, including correlation, causality, similarity, lag, arithmetic, and meta, and summarized three pain points in querying time series involving these relations. We proposed RelaQ, an interactive system that supports the time series query via relation specifications. RelaQ allows users to intuitively specify heterogeneous relations when querying multiple time series, understand the query results based on a scalable, multi-level visualization, and explore possible relations beyond the existing queries. RelaQ is evaluated with two use cases and a user study with 12 participants, showing promising effectiveness and usability.


title: Students' confusions about the electric field of a uniformly moving charge

abstract: In light of a recent direct experimental confirmation of a Lorentz contraction of Coulomb field (an electric field of a point charge in a uniform motion), we revisit some common confusions related to it, to be mindful of in teaching the subject. These include the questions about a radial nature of the field, a role of the retardation effect due to a finite speed of information transfer and some issues related to a depiction of Coulomb field by means of the Lorentz contracted field lines.


title: L2T-DLN: Learning to Teach with Dynamic Loss Network

abstract: With the concept of teaching being introduced to the machine learning community, a teacher model start using dynamic loss functions to teach the training of a student model. The dynamic intends to set adaptive loss functions to different phases of student model learning. In existing works, the teacher model 1) merely determines the loss function based on the present states of the student model, i.e., disregards the experience of the teacher; 2) only utilizes the states of the student model, e.g., training iteration number and loss/accuracy from training/validation sets, while ignoring the states of the loss function. In this paper, we first formulate the loss adjustment as a temporal task by designing a teacher model with memory units, and, therefore, enables the student learning to be guided by the experience of the teacher model. Then, with a dynamic loss network, we can additionally use the states of the loss to assist the teacher learning in enhancing the interactions between the teacher and the student model. Extensive experiments demonstrate our approach can enhance student learning and improve the performance of various deep models on real-world tasks, including classification, objective detection, and semantic segmentation scenarios.


title: The minimax property in infinite two-person win-lose games

abstract: We explore a version of the minimax theorem for two-person win-lose games with infinitely many pure strategies. In the countable case, we give a combinatorial condition on the game which implies the minimax property. In the general case, we prove that a game satisfies the minimax property along with all its subgames if and only if none of its subgames is isomorphic to the "larger number game." This generalizes a recent theorem of Hanneke, Livni and Moran. We also propose several applications of our results outside of game theory.


title: Positivity of exterior products of tangent bundles and their subsheaves

abstract: S. Kov\'acs proposed a conjecture on rigidity results induced by ample subsheaves of some exterior power of tangent bundles for projective manifolds. We verify the conjecture in the case of second exterior products under a rank condition. Besides, we prove a structure theorem satisfied by projective manifolds whose third exterior power of tangent bundle is nef. Additionally, we prove a weaker version of log Campana-Peternell conjecture for fourfolds. Finally, we give the structure of manifolds with a regular foliation whose exterior powers are strictly nef.


title: A Possible Mechanism for "Late Phase" in Stellar White-Light Flares

abstract: M-dwarf flares observed by the \textit{Transiting Exoplanet Survey Satellite} (\textit{TESS}) sometimes exhibit a "peak-bump" light-curve morphology, characterized by a secondary, gradual peak well after the main, impulsive peak. A similar "late phase" is frequently detected in solar flares observed in the extreme-ultraviolet from longer hot coronal loops distinct from the impulsive flare structures. White-light emission has also been observed in off-limb solar flare loops. Here, we perform a suite of one-dimensional hydrodynamic loop simulations for M-dwarf flares inspired by these solar examples. Our results suggest that coronal plasma condensation following impulsive flare heating can yield high electron number density in the loop, allowing it to contribute significantly to the optical light curves via free-bound and free-free emission mechanisms. Our simulation results qualitatively agree with \textit{TESS} observations: the longer evolutionary time scale of coronal loops produces a distinct, secondary emission peak; its intensity increases with the injected flare energy. We argue that coronal plasma condensation is a possible mechanism for the \textit{TESS} late-phase flares.


title: Turbulence on open string worldsheets under non-integrable boundary conditions

abstract: We demonstrate the turbulent dynamics of the Nambu-Goto open string in the AdS3 spacetime. While the motion of a classical closed string in AdS is known to be integrable, the integrability of an open string motion depends on the boundary conditions at the string endpoints. We numerically solve the equations of motion of the open string under the boundary conditions where the endpoints are i) fixed to a finite radial coordinate in AdS, and ii) free. For i), we find turbulence on the string, that shows a cascade in the energy and angular momentum spectra. This result indicates the non-integrability of the open string with this type of boundary conditions. For ii), we find no turbulence. This is consistent with the integrability of the open string with the free boundary conditions.


title: Searching for Associations Between Short Gamma-ray Bursts and Fast Radio Burst

abstract: The physical origin of fast radio bursts (FRBs) is still unclear. However, young magnetars associated with short-duration gamma-ray bursts (SGRBs) have been thought to be possible central engines for some FRBs. In this paper, we perform a systematic search for SGRBs that are associated with FRBs in a sample including 623 FRBs (601 one-off bursts and 22 repeaters) and 168 SGRBs with precise localizations. We find that FRB 190309A is spatially associated with GRB 060502B, with a chance probability of 0.05 when temporal and redshift information is taken into account. Considering the high chance probability (the statistical significance is < 3{\sigma}), we examine other observational properties such as the host galaxy, the dispersion measure, and the energy budget of the central engine to check the possibility of their association. Although the available observational information is insufficient to determine whether they are physically associated, it does not rule out such a possibility. As the only pair of FRB and GRB that are spatially associated, it remains an interesting case worthy of further attention


title: Dual-Directed Algorithm Design for Efficient Pure Exploration

abstract: We consider pure-exploration problems in the context of stochastic sequential adaptive experiments with a finite set of alternative options. The goal of the decision-maker is to accurately answer a query question regarding the alternatives with high confidence with minimal measurement efforts. A typical query question is to identify the alternative with the best performance, leading to ranking and selection problems, or best-arm identification in the machine learning literature. We focus on the fixed-precision setting and derive a sufficient condition for optimality in terms of a notion of strong convergence to the optimal allocation of samples. Using dual variables, we characterize the necessary and sufficient conditions for an allocation to be optimal. The use of dual variables allow us to bypass the combinatorial structure of the optimality conditions that relies solely on primal variables. Remarkably, these optimality conditions enable an extension of top-two algorithm design principle, initially proposed for best-arm identification. Furthermore, our optimality conditions give rise to a straightforward yet efficient selection rule, termed information-directed selection, which adaptively picks from a candidate set based on information gain of the candidates. We outline the broad contexts where our algorithmic approach can be implemented. We establish that, paired with information-directed selection, top-two Thompson sampling is (asymptotically) optimal for Gaussian best-arm identification, solving a glaring open problem in the pure exploration literature. Our algorithm is optimal for $\epsilon$-best-arm identification and thresholding bandit problems. Our analysis also leads to a general principle to guide adaptations of Thompson sampling for pure-exploration problems. Numerical experiments highlight the exceptional efficiency of our proposed algorithms relative to existing ones.


title: A Near-Field Treatment of Aperture Synthesis Techniques using the Murchison Widefield Array

abstract: Typical radio interferometer observations are performed assuming the source of radiation to be in the far-field of the instrument, resulting in a two-dimensional Fourier relationship between the observed visibilities in the aperture plane and the sky brightness distribution (over a small field of view). When near-field objects are present in an observation, the standard approach applies far-field delays during correlation, resulting in loss of signal coherence for the signal from the near-field object. In this paper, we demonstrate near-field aperture synthesis techniques using a Murchison Widefield Array observation of the International Space Station (ISS), as it appears as a bright near-field object. We perform visibility phase corrections to restore coherence across the array for the near-field object (however not restoring coherence losses due to time and frequency averaging at the correlator). We illustrate the impact of the near-field corrections in the aperture plane and the sky plane. The aperture plane curves to match the curvature of the near-field wavefront, and in the sky plane near-field corrections manifest as fringe rotations at different rates as we bring the focal point of the array from infinity to the desired near-field distance. We also demonstrate the inverse scenario of inferring the line-of-sight range of the ISS by inverting the apparent curvature of the wavefront seen by the aperture. We conclude the paper by briefly discussing the limitations of the methods developed and the near-field science cases where our approach can be exploited.


title: D4Explainer: In-Distribution GNN Explanations via Discrete Denoising Diffusion

abstract: The widespread deployment of Graph Neural Networks (GNNs) sparks significant interest in their explainability, which plays a vital role in model auditing and ensuring trustworthy graph learning. The objective of GNN explainability is to discern the underlying graph structures that have the most significant impact on model predictions. Ensuring that explanations generated are reliable necessitates consideration of the in-distribution property, particularly due to the vulnerability of GNNs to out-of-distribution data. Unfortunately, prevailing explainability methods tend to constrain the generated explanations to the structure of the original graph, thereby downplaying the significance of the in-distribution property and resulting in explanations that lack reliability. To address these challenges, we propose D4Explainer, a novel approach that provides in-distribution GNN explanations for both counterfactual and model-level explanation scenarios. The proposed D4Explainer incorporates generative graph distribution learning into the optimization objective, which accomplishes two goals: 1) generate a collection of diverse counterfactual graphs that conform to the in-distribution property for a given instance, and 2) identify the most discriminative graph patterns that contribute to a specific class prediction, thus serving as model-level explanations. It is worth mentioning that D4Explainer is the first unified framework that combines both counterfactual and model-level explanations. Empirical evaluations conducted on synthetic and real-world datasets provide compelling evidence of the state-of-the-art performance achieved by D4Explainer in terms of explanation accuracy, faithfulness, diversity, and robustness.


title: ProNet: Progressive Neural Network for Multi-Horizon Time Series Forecasting

abstract: In this paper, we introduce ProNet, an novel deep learning approach designed for multi-horizon time series forecasting, adaptively blending autoregressive (AR) and non-autoregressive (NAR) strategies. Our method involves dividing the forecasting horizon into segments, predicting the most crucial steps in each segment non-autoregressively, and the remaining steps autoregressively. The segmentation process relies on latent variables, which effectively capture the significance of individual time steps through variational inference. In comparison to AR models, ProNet showcases remarkable advantages, requiring fewer AR iterations, resulting in faster prediction speed, and mitigating error accumulation. On the other hand, when compared to NAR models, ProNet takes into account the interdependency of predictions in the output space, leading to improved forecasting accuracy. Our comprehensive evaluation, encompassing four large datasets, and an ablation study, demonstrate the effectiveness of ProNet, highlighting its superior performance in terms of accuracy and prediction speed, outperforming state-of-the-art AR and NAR forecasting models.


title: A Low-Complexity Machine Learning Design for mmWave Beam Prediction

abstract: The 3rd Generation Partnership Project (3GPP) is currently studying machine learning (ML) for the fifth generation (5G)-Advanced New Radio (NR) air interface, where spatial and temporal-domain beam prediction are important use cases. With this background, this letter presents a low-complexity ML design that expedites the spatial-domain beam prediction to reduce the power consumption and the reference signaling overhead, which are currently imperative for frequent beam measurements. Complexity analysis and evaluation results showcase that the proposed model achieves state-of-the-art accuracy with lower computational complexity, resulting in reduced power consumption and faster beam prediction. Furthermore, important observations on the generalization of the proposed model are presented in this letter.


title: TempME: Towards the Explainability of Temporal Graph Neural Networks via Motif Discovery

abstract: Temporal graphs are widely used to model dynamic systems with time-varying interactions. In real-world scenarios, the underlying mechanisms of generating future interactions in dynamic systems are typically governed by a set of recurring substructures within the graph, known as temporal motifs. Despite the success and prevalence of current temporal graph neural networks (TGNN), it remains uncertain which temporal motifs are recognized as the significant indications that trigger a certain prediction from the model, which is a critical challenge for advancing the explainability and trustworthiness of current TGNNs. To address this challenge, we propose a novel approach, called Temporal Motifs Explainer (TempME), which uncovers the most pivotal temporal motifs guiding the prediction of TGNNs. Derived from the information bottleneck principle, TempME extracts the most interaction-related motifs while minimizing the amount of contained information to preserve the sparsity and succinctness of the explanation. Events in the explanations generated by TempME are verified to be more spatiotemporally correlated than those of existing approaches, providing more understandable insights. Extensive experiments validate the superiority of TempME, with up to 8.21% increase in terms of explanation accuracy across six real-world datasets and up to 22.96% increase in boosting the prediction Average Precision of current TGNNs.


title: A Geometric Algorithm for the Factorization of Spinor Polynomials

abstract: We present a new algorithm to decompose generic spinor polynomials into linear factors. Spinor polynomials are certain polynomials with coefficients in the geometric algebra of dimension three that parametrize rational conformal motions. The factorization algorithm is based on the "kinematics at infinity" of the underlying rational motion. Factorizations exist generically but not generally and are typically not unique. We prove that generic multiples of non-factorizable spinor polynomials admit factorizations and we demonstrate at hand of an example how our ideas can be used to tackle the hitherto unsolved problem of "factorizing" algebraic motions.


title: Correlations Between Subduction of Linear Oceanic Features and Arc Volcanism Volume Around the Pacific Basin

abstract: Arc volcanoes, created by magma generated from the dehydration of subducting slabs, show great variability in their sizes and along-arc spatial distributions. In this study, we address a fundamental question, namely, how do subduction zones and volcanic arcs respond to the subduction of ``atypical'' oceanic lithosphere. We investigate the correlation between the geographical location and volume of arc volcanoes and the subduction of linear oceanic features, including hotspot tracks, oceanic plateaus, volcanic ridges, mid-oceanic ridges, arc volcano chains, and fracture zones, around the Pacific basin. We use multidisciplinary and complementary data sets (topography and bathymetry, seismology and volcano morphometry), and design new analytical and data processing methods. We analyze 35 oceanic linear features. The subduction of three oceanic plateaus and five hotspot chains are clearly associated with volcanism increase, whereas four hotspot chains are related to volcanic gaps. We propose that the patterns of volcanism increase or decrease related to these oceanic features depend on the interplay between chemical (potentially enhancing melting) and thermo-mechanical (inhibiting melting) effects, and/or by the variations of the chemical signatures along hotspot chains. The subduction of volcanic ridges is generally associated with small increases in arc volcanism, which may be accounted for by the fact that these features are highly hydrated and therefore promote melt. The subduction of active mid-oceanic ridges is generally associated with slab windows and arc volcano gaps. No clear inference is found for the subduction of inactive arc ridges.


title: Semiquantum proxy blind signature based on quantum teleportation

abstract: In this paper, we propose a novel semiquantum proxy blind signature scheme with quantum teleportation based on X states, where the original message owner, the proxy signer and the third party are quantum participants with complete quantum capabilities, while the original signer and the signature verifier are semiquantum participants with limited quantum capabilities. It turns out that our protocol not only has complete blindness, unforgeability, non-repudiation and but also can resist the attack behavior from an eavesdropper. Compared with many previous quantum proxy blind signature protocols, our protocol may need less quantum resources and be easier to implement in reality, since both the original signer and the signature verifier are semiquantum participants with limited quantum capabilities.


title: Towards higher-order calculations of quarkonia production with $k_T$-factorization: $P$-wave charmonia

abstract: Inclusive $P$-wave charmonia production in hadronic collisions at high energies is discussed in the framework of non-relativistic QCD and $k_T$-factorization formalism. We present two consistent approches to merge the usual leading order $k_T$-factorization calculations with tree-level next-to-leading order off-shell amplitudes. Using these prescriptions, we extracted long-distance matrix elements for $\chi_c$ mesons from a combined fit to available Tevatron and LHC data. In contrast to previous (leading order) calculations, our fits do not contradict equal color singlet wave functions of $\chi_{c1}$ and $\chi_{c2}$ states. The extracted values of long-distance matrix elements are employed to analyse the $\chi_c$ polarization data reported recently by the CMS Collaboration. Our predictions are in a reasonably good agreement with the Tevatron and LHC measurements within the theoretical and experimental uncertainties.


title: On some stable representations of hyperbolic groups

abstract: Let $\Gamma$ be a hyperbolic group and G be the isometry group of a Gromov-hyperbolic, properand geodesic metric space. We study the action of the outer automorphism group Out($\Gamma$) onthe set X($\Gamma$,G) of conjugacy classes of representations of $\Gamma$ into G. We construct a familyof Out($\Gamma$)-invariant subsets of X($\Gamma$,G) which contains (stricly or not) the set of conjugacyclasses of quasi-convex representations and give a sufficient condition for the induced actionto be properly discontinuous. Finally, we give a criterion for a representation to have discreteimage and finite kernel and use it when G = Isom+(H3) to find new characterizations ofquasi-convex (i.e. convex cocompact) subgroups of PSL2(C).


title: On representation of solutions to the heat equation

abstract: We propose a simple method to obtain semigroup representation of solutions to the heat equation using a local $L^2$ condition with prescribed growth and a boundedness condition within tempered distributions. This applies to many functional settings and, as an example, we consider the Koch and Tataru space related to $BMO^{-1}$ initial data.


title: AdapINT: A Flexible and Adaptive In-Band Network Telemetry System Based on Deep Reinforcement Learning

abstract: In-band Network Telemetry (INT) has emerged as a promising network measurement technology. However, existing network telemetry systems lack the flexibility to meet diverse telemetry requirements and are also difficult to adapt to dynamic network environments. In this paper, we propose AdapINT, a versatile and adaptive in-band network telemetry framework assisted by dual-timescale probes, including long-period auxiliary probes (APs) and short-period dynamic probes (DPs). Technically, the APs collect basic network status information, which is used for the path planning of DPs. To achieve full network coverage, we propose an auxiliary probes path deployment (APPD) algorithm based on the Depth-First-Search (DFS). The DPs collect specific network information for telemetry tasks. To ensure that the DPs can meet diverse telemetry requirements and adapt to dynamic network environments, we apply the deep reinforcement learning (DRL) technique and transfer learning method to design the dynamic probes path deployment (DPPD) algorithm. The evaluation results show that AdapINT can redesign the telemetry system according to telemetry requirements and network environments. AdapINT can reduce telemetry latency by 75\% in online games and video conferencing scenarios. For overhead-aware networks, AdapINT can reduce control overheads by 34\% in cloud computing services.


title: Solar Flare Prediction and Feature Selection using Light Gradient Boosting Machine Algorithm

abstract: Solar flares are among the most severe space weather phenomena, and they have the capacity to generate radiation storms and radio disruptions on Earth. The accurate prediction of solar flare events remains a significant challenge, requiring continuous monitoring and identification of specific features that can aid in forecasting this phenomenon, particularly for different classes of solar flares. In this study, we aim to forecast C and M class solar flares utilising a machine-learning algorithm, namely the Light Gradient Boosting Machine. We have utilised a dataset spanning 9 years, obtained from the Space-weather Helioseismic and Magnetic Imager Active Region Patches (SHARP), with a temporal resolution of 1 hour. A total of 37 flare features were considered in our analysis, comprising of 25 active region parameters and 12 flare history features. To address the issue of class imbalance in solar flare data, we employed the Synthetic Minority Oversampling Technique (SMOTE). We used two labeling approaches in our study: a fixed 24-hour window label and a varying window that considers the changing nature of solar activity. Then, the developed machine learning algorithm was trained and tested using forecast verification metrics, with an emphasis on evaluating the true skill statistic (TSS). Furthermore, we implemented a feature selection algorithm to determine the most significant features from the pool of 37 features that could distinguish between flaring and non-flaring active regions. We found that utilising a limited set of useful features resulted in improved prediction performance. For the 24-hour prediction window, we achieved a TSS of 0.63 (0.69) and accuracy of 0.90 (0.97) for $\geq$C ($\geq$M) class solar flares.


title: Eigenstate Thermalization and its breakdown in Quantum Spin Chains with Inhomogeneous Interactions

abstract: The eigenstate thermalization hypothesis (ETH) is a successful theory that establishes the criteria for ergodicity and thermalization in isolated quantum many-body systems. In this work, we investigate the thermalization properties of spin-$ 1/2 $ XXZ chain with linearly-inhomogeneous interactions. We demonstrate that introduction of the inhomogeneous interactions leads to an onset of quantum chaos and thermalization, which, however, becomes inhibited for sufficiently strong inhomogeneity. To exhibit ETH, and to display its breakdown upon varying the strength of interactions, we probe statistics of energy levels and properties of matrix elements of local observables in eigenstates of the inhomogeneous XXZ spin chain. Moreover, we investigate the dynamics of the entanglement entropy and the survival probability which further evidence the thermalization and its breakdown in the considered model. We outline a way to experimentally realize the XXZ chain with linearly-inhomogeneous interactions in systems of ultracold atoms. Our results highlight a mechanism of emergence of ETH due to insertion of inhomogeneities in an otherwise integrable system and illustrate the arrest of quantum dynamics in presence of strong interactions.


title: Scalable Two-Minute Feedback: Digital, Lecture-Accompanying Survey as a Continuous Feedback Instrument

abstract: Detailed feedback on courses and lecture content is essential for their improvement and also serves as a tool for reflection. However, feedback methods are often only used sporadically, especially in mass courses, because collecting and analyzing feedback in a timely manner is often a challenge for teachers. Moreover, the current situation of the students or the changing workload during the semester are usually not taken into account either. For a holistic investigation, the article used a digital survey format as formative feedback which attempts to measure student stress in a quantitative part and to address the participants' reflection in a qualitative part, as well as to collect general suggestions for improvement (based on the so-called One-Minute Paper) at two educational institutions. The feedback during the semester is evaluated qualitatively and discussed on a meta-level and special features (e.g. reflections on student work ethic or other courses) are addressed. The results show a low, but constant rate of feedback. Responses mostly cover topics of the lecture content or organizational aspects and were intensively used to report issues within the lecture. In addition, artificial intelligence (AI) support in the form of a large language model was tested and showed promising results in summarizing the open-ended responses for the teacher. Finally, the experiences from the lecturers are reflected upon and the results as well as possibilities for improvement are discussed.


title: USSR is in P/poly

abstract: The Sum of Square Roots (SSR) problem is the following computational problem: Given positive integers $a_1, \dots, a_k$, and signs $\delta_1, \dots, \delta_k \in \{-1, 1\}$, check if $\sum_{i=1}^k \delta_i \sqrt{a_i} > 0$. The problem is known to have a polynomial time algorithm on the real RAM model of computation, however no sub-exponential time algorithm is known in the bit or Turing model of computation. The precise computational complexity of SSR has been a notorious open problem \cite{ggj} over the last four decades. The problem is known to admit an upper bound in the third level of the \emph{Counting Hierarchy}, i.e., $\CHtwo$ and no non-trivial lower bounds are known. Even when the input numbers are \emph{small}, i.e., given in \emph{unary}, no better complexity bound was known prior to our work. In this paper, we show that the unary variant (USSR) of the sum of square roots problem is considerably easier by giving a $P/poly$ upper bound.


title: Considerations for the Control Design of Augmentative Robots

abstract: Robotic systems that are intended to augment human capabilities commonly require the use of semi-autonomous control and artificial sensing, while at the same time aiming to empower the user to make decisions and take actions. This work identifies principles and techniques from the literature that can help to resolve this apparent contradiction. It is postulated that augmentative robots must function as tools that have partial agency, as collaborative agents that provide conditional transparency, and ideally, serve as extensions of the human body.


title: Characterization and Exploitation of the Rotational Memory Effect in Multimode Fibers

abstract: In an ideal perfectly straight multimode fiber with a circular-core, the symmetry ensures that rotating the input wavefront leads to a corresponding rotation of the output wavefront. This invariant property, known as the rotational memory effect (RME), remains independent of the typically unknown output profile. The RME thus offers significant potential for imaging and telecommunication applications. However, in real-life fibers, this effect is degraded by intrinsic imperfections and external perturbations, and is challenging to observe because of its acute sensitivity to misalignments and aberrations in the optical setup. Thanks to processing involving a spatial light modulator, we efficiently overcome these measurement biases, allowing for precise quantification of the RME. We establish an experimental and theoretical framework for studying and manipulating the RME in multimode fibers. Theoretical predictions are consistent with experimental data and simulations, connecting the shape of the angular-dependent correlation of the RME to the geometrical properties of the core deformation. This work opens the road for accurate characterization of the distributed disorder originating from the fabrication process and calibration-less imaging in multimode fibers.


title: Lifts of line bundles on curves on K3 surfaces

abstract: Let $X$ be a K3 surface, let $C$ be a smooth curve of genus $g$ on $X$, and let $A$ be a line bundle of degree $d$ on $C$. Then a line bundle $M$ on $X$ with $M\otimes\mathcal{O}_C=A$ is called a lift of $A$ . In this paper, we prove that if the dimension of the linear system $|A|$ is $r\geq2$, $g>2d-4+r(r-1)$, $d\geq 2r+4$, and $A$ computes the Clifford index of $C$, then there exists a base point free lift $M$ of $A$ such that the general member of $|M|$ is a smooth curve of genus $r$. In particular, if $|A|$ is a base point free net which defines a double covering $\pi:C\longrightarrow C_0$ of a smooth curve $C_0\subset\mathbb{P}^2$ of degree $k\geq 4$ branched at distinct $6k$ points on $C_0$, then, by using the aforementioned result, we can also show that there exists a 2:1 morphism $\tilde{\pi}:X\longrightarrow \mathbb{P}^2$ such that $\tilde{\pi}|_C=\pi$.


title: Linear Realisability and Cobordisms

abstract: Cobordism categories are known to be compact closed. They can therefore be used to define non-degenerate models of multiplicative linear logic by combining the Int construction with double glueing. In this work we detail such construction in the case of low-dimensional cobordisms, and exhibit a connexion between those models and the model of Interaction graphs introduced by Seiller. In particular, we exhibit how the so-called trefoil property is a consequence of the associativity of composition of higher structures, providing a first step toward establishing models as obtained from a double glueing construction. We discuss possible extensions to higher-dimensional cobordisms categories


title: Splines 'n Lines: Rest-frame galaxy spectral energy distributions via Bayesian functional data analysis

abstract: Survey-based measurements of the spectral energy distributions (SEDs) of galaxies have flux density estimates on badly misaligned grids in rest-frame wavelength. The shift to rest frame wavelength also causes estimated SEDs to have differing support. For many galaxies, there are sizeable wavelength regions with missing data. Finally, dim galaxies dominate typical samples and have noisy SED measurements, many near the limiting signal-to-noise level of the survey. These limitations of SED measurements shifted to the rest frame complicate downstream analysis tasks, particularly tasks requiring computation of functionals (e.g., weighted integrals) of the SEDs, such as synthetic photometry, quantifying SED similarity, and using SED measurements for photometric redshift estimation. We describe a hierarchical Bayesian framework, drawing on tools from functional data analysis, that models SEDs as a random superposition of smooth continuum basis functions (B-splines) and line features, comprising a finite-rank, nonstationary Gaussian process, measured with additive Gaussian noise. We apply this *Splines 'n Lines* (SnL) model to a collection of 678,239 galaxy SED measurements comprising the Main Galaxy Sample from the Sloan Digital Sky Survey, Data Release 17, demonstrating capability to provide continuous estimated SEDs that reliably denoise, interpolate, and extrapolate, with quantified uncertainty, including the ability to predict line features where there is missing data by leveraging correlations between line features and the entire continuum.


title: Skywork: A More Open Bilingual Foundation Model

abstract: In this technical report, we present Skywork-13B, a family of large language models (LLMs) trained on a corpus of over 3.2 trillion tokens drawn from both English and Chinese texts. This bilingual foundation model is the most extensively trained and openly published LLMs of comparable size to date. We introduce a two-stage training methodology using a segmented corpus, targeting general purpose training and then domain-specific enhancement training, respectively. We show that our model not only excels on popular benchmarks, but also achieves \emph{state of the art} performance in Chinese language modeling on diverse domains. Furthermore, we propose a novel leakage detection method, demonstrating that test data contamination is a pressing issue warranting further investigation by the LLM community. To spur future research, we release Skywork-13B along with checkpoints obtained during intermediate stages of the training process. We are also releasing part of our SkyPile corpus, a collection of over 150 billion tokens of web text, which is the largest high quality open Chinese pre-training corpus to date. We hope Skywork-13B and our open corpus will serve as a valuable open-source resource to democratize access to high-quality LLMs.


title: Label-Only Model Inversion Attacks via Knowledge Transfer

abstract: In a model inversion (MI) attack, an adversary abuses access to a machine learning (ML) model to infer and reconstruct private training data. Remarkable progress has been made in the white-box and black-box setups, where the adversary has access to the complete model or the model's soft output respectively. However, there is very limited study in the most challenging but practically important setup: Label-only MI attacks, where the adversary only has access to the model's predicted label (hard label) without confidence scores nor any other model information. In this work, we propose LOKT, a novel approach for label-only MI attacks. Our idea is based on transfer of knowledge from the opaque target model to surrogate models. Subsequently, using these surrogate models, our approach can harness advanced white-box attacks. We propose knowledge transfer based on generative modelling, and introduce a new model, Target model-assisted ACGAN (T-ACGAN), for effective knowledge transfer. Our method casts the challenging label-only MI into the more tractable white-box setup. We provide analysis to support that surrogate models based on our approach serve as effective proxies for the target model for MI. Our experiments show that our method significantly outperforms existing SOTA Label-only MI attack by more than 15% across all MI benchmarks. Furthermore, our method compares favorably in terms of query budget. Our study highlights rising privacy threats for ML models even when minimal information (i.e., hard labels) is exposed. Our study highlights rising privacy threats for ML models even when minimal information (i.e., hard labels) is exposed. Our code, demo, models and reconstructed data are available at our project page: https://ngoc-nguyen-0.github.io/lokt/


title: Quantile Super Learning for independent and online settings with application to solar power forecasting

abstract: Estimating quantiles of an outcome conditional on covariates is of fundamental interest in statistics with broad application in probabilistic prediction and forecasting. We propose an ensemble method for conditional quantile estimation, Quantile Super Learning, that combines predictions from multiple candidate algorithms based on their empirical performance measured with respect to a cross-validated empirical risk of the quantile loss function. We present theoretical guarantees for both iid and online data scenarios. The performance of our approach for quantile estimation and in forming prediction intervals is tested in simulation studies. Two case studies related to solar energy are used to illustrate Quantile Super Learning: in an iid setting, we predict the physical properties of perovskite materials for photovoltaic cells, and in an online setting we forecast ground solar irradiance based on output from dynamic weather ensemble models.


title: Trend to equilibrium and diffusion limit for the inertial Kuramoto-Sakaguchi equation

abstract: In this paper, we study the inertial Kuramoto-Sakaguchi equation for interacting oscillatory systems. On the one hand, we prove the convergence toward corresponding phasehomogeneous stationary states in weighted Lebesgue norm sense when the coupling strength is small enough. In [10], it is proved that when the noise intensity is sufficiently large, equilibrium of the inertial Kuramoto-Sakaguchi equation is asymptotically stable. For generic initial data, every solutions converges to equilibrium in weighted Sobolev norm sense. We improve this previous result by showing the convergence for a larger class of functions and by providing a simpler proof. On the other hand, we investigate the diffusion limit when all oscillators are identical. In [19], authors studied the same problem using an energy estimate, renormlized solutions and a compactness method, through which error estimates could not be discussed. Here we provide error estimates for the diffusion limit with respect to the mass m $\ll$ 1 using a simple proof by imposing slightly more regularity on the solution.


title: Test Suites Task: Evaluation of Gender Fairness in MT with MuST-SHE and INES

abstract: As part of the WMT-2023 "Test suites" shared task, in this paper we summarize the results of two test suites evaluations: MuST-SHE-WMT23 and INES. By focusing on the en-de and de-en language pairs, we rely on these newly created test suites to investigate systems' ability to translate feminine and masculine gender and produce gender-inclusive translations. Furthermore we discuss metrics associated with our test suites and validate them by means of human evaluations. Our results indicate that systems achieve reasonable and comparable performance in correctly translating both feminine and masculine gender forms for naturalistic gender phenomena. Instead, the generation of inclusive language forms in translation emerges as a challenging task for all the evaluated MT models, indicating room for future improvements and research on the topic.


title: On a methodology to determine Navier's slip-parameter in Navier-Stokes fluid flows at a solid boundary

abstract: While the assumption of the ``no-slip" condition at a solid boundary is unquestioningly applied to study the flow characteristics of the Navier-Stokes fluid, there was considerable debate amongst the early pioneers of fluid mechanics, Du Buat, Girard, Navier, Coulomb, Poisson, Prony, Stokes and others, as to the proper condition that pertains at a solid boundary due to a fluid, such as water flowing adjacent to the same. Contemporary usage of the ``no-slip" boundary condition notwithstanding, M\'alek and Rajagopal outlined a methodology to test the validity of the assumption. In this study, we continue the investigation further by providing a scheme for determining the slip-parameter that determines the extent of slip, if one presumes that Navier-slip obtains at the boundary. We find that depending on whether the volumetric flow rate is greater or less than the volumetric flow rate corresponding to the no-slip case, different scenarios present themselves regarding what transpires at the boundary.


title: Improving Factual Consistency of Text Summarization by Adversarially Decoupling Comprehension and Embellishment Abilities of LLMs

abstract: Despite the recent progress in text summarization made by large language models (LLMs), they often generate summaries that are factually inconsistent with original articles, known as "hallucinations" in text generation. Unlike previous small models (e.g., BART, T5), current LLMs make fewer silly mistakes but more sophisticated ones, such as imposing cause and effect, adding false details, overgeneralizing, etc. These hallucinations are challenging to detect through traditional methods, which poses great challenges for improving the factual consistency of text summarization. In this paper, we propose an adversarially DEcoupling method to disentangle the Comprehension and EmbellishmeNT abilities of LLMs (DECENT). Furthermore, we adopt a probing-based efficient training to cover the shortage of sensitivity for true and false in the training process of LLMs. In this way, LLMs are less confused about embellishing and understanding; thus, they can execute the instructions more accurately and have enhanced abilities to distinguish hallucinations. Experimental results show that DECENT significantly improves the reliability of text summarization based on LLMs.


title: Rapid suppression of quantum many-body magnetic exciton in doped van der Waals antiferromagnet (Ni,Cd)PS3

abstract: The unique discovery of magnetic exciton in van der Waals antiferromagnet NiPS3 arises between two quantum many-body states of a Zhang-Rice singlet excited state and a Zhang-Rice triplet ground state. Simultaneously, the spectral width of photoluminescence originating from this exciton is exceedingly narrow as 0.4 meV. These extraordinary properties, including the extreme coherence of the magnetic exciton in NiPS3, beg many questions. We studied doping effects using Ni1-xCdxPS3 using two experimental techniques and theoretical studies. Our experimental results show that the magnetic exciton is drastically suppressed upon a few % Cd doping. All these happen while the width of the exciton only gradually increases, and the antiferromagnetic ground state is robust. These results highlight the lattice uniformity's hidden importance as a prerequisite for coherent magnetic exciton. Finally, an exciting scenario emerges: the broken charge transfer forbids the otherwise uniform formation of the coherent magnetic exciton in (Ni,Cd)PS3.

categories: cond-mat.str-el cond-mat.mtrl-sci physics.optics quant-ph


title: Japanese SimCSE Technical Report

abstract: We report the development of Japanese SimCSE, Japanese sentence embedding models fine-tuned with SimCSE. Since there is a lack of sentence embedding models for Japanese that can be used as a baseline in sentence embedding research, we conducted extensive experiments on Japanese sentence embeddings involving 24 pre-trained Japanese or multilingual language models, five supervised datasets, and four unsupervised datasets. In this report, we provide the detailed training setup for Japanese SimCSE and their evaluation results.


title: Disorder-dependent Li diffusion in $\mathrm{Li_6PS_5Cl}$ investigated by machine learning potential

abstract: Solid-state electrolytes with argyrodite structures, such as $\mathrm{Li_6PS_5Cl}$, have attracted considerable attention due to their superior safety compared to liquid electrolytes and higher ionic conductivity than other solid electrolytes. Although experimental efforts have been made to enhance conductivity by controlling the degree of disorder, the underlying diffusion mechanism is not yet fully understood. Moreover, existing theoretical analyses based on ab initio MD simulations have limitations in addressing various types of disorder at room temperature. In this study, we directly investigate Li-ion diffusion in $\mathrm{Li_6PS_5Cl}$ at 300 K using large-scale, long-term MD simulations empowered by machine learning potentials (MLPs). To ensure the convergence of conductivity values within an error range of 10%, we employ a 25 ns simulation using a $5\times5\times5$ supercell containing 6500 atoms. The computed Li-ion conductivity, activation energies, and equilibrium site occupancies align well with experimental observations. Notably, Li-ion conductivity peaks when Cl ions occupy 25% of the 4c sites, rather than at 50% where the disorder is maximized. This phenomenon is explained by the interplay between inter-cage and intra-cage jumps. By elucidating the key factors affecting Li-ion diffusion in $\mathrm{Li_6PS_5Cl}$, this work paves the way for optimizing ionic conductivity in the argyrodite family.


title: Seeking Flat Minima with Mean Teacher on Semi- and Weakly-Supervised Domain Generalization for Object Detection

abstract: Object detectors do not work well when domains largely differ between training and testing data. To overcome this domain gap in object detection without requiring expensive annotations, we consider two problem settings: semi-supervised domain generalizable object detection (SS-DGOD) and weakly-supervised DGOD (WS-DGOD). In contrast to the conventional domain generalization for object detection that requires labeled data from multiple domains, SS-DGOD and WS-DGOD require labeled data only from one domain and unlabeled or weakly-labeled data from multiple domains for training. In this paper, we show that object detectors can be effectively trained on the two settings with the same Mean Teacher learning framework, where a student network is trained with pseudo-labels output from a teacher on the unlabeled or weakly-labeled data. We provide novel interpretations of why the Mean Teacher learning framework works well on the two settings in terms of the relationships between the generalization gap and flat minima in parameter space. On the basis of the interpretations, we also propose incorporating a simple regularization method into the Mean Teacher learning framework to find flatter minima. The experimental results demonstrate that the regularization leads to flatter minima and boosts the performance of the detectors trained with the Mean Teacher learning framework on the two settings. They also indicate that those detectors significantly outperform the state-of-the-art methods.


title: Semi-implicit Eulerian method for the fluid structure interaction of elastic membranes

abstract: In this paper we propose a novel and general approach to design semi-implicit methods for the simulation of fluid-structure interaction problems in a fully Eulerian framework. In order to properly present the new method, we focus on the two-dimensional version of the general model developed to describe full membrane elasticity. The approach consists in treating the elastic source term by writing an evolution equation on the structure stress tensor, even if it is nonlinear. Then, it is possible to show that its semi-implicit discretization allows us to add to the linear system of the Navier-Stokes equations some consistent dissipation terms that depend on the local deformation and stiffness of the membrane. Due to the linearly implicit discretization, the approach does not need iterative solvers and can be easily applied to any Eulerian framework for fluid-structure interaction. Its stability properties are studied by performing a Von Neumann analysis on a simplified one-dimensional model and proving that, thanks to the additional dissipation, the discretized coupled system is unconditionally stable. Several numerical experiments are shown for two-dimensional problems by comparing the new method to the original explicit scheme and studying the effect of structure stiffness and mesh refinement on the membrane dynamics. The newly designed scheme is able to relax the time step restrictions that affect the explicit method and reduce crucially the computational costs, especially when very stiff membranes are under consideration.


title: Dual Newton Proximal Point Algorithm for Solution Paths of the L1-Regularized Logistic Regression

abstract: The l1-regularized logistic regression is a widely used statistical model in data classification. This paper proposes a dual Newton method based proximal point algorithm (PPDNA) to solve the l1-regularized logistic regression problem with bias term. The global and local convergence of PPDNA hold under mild conditions. The computational cost of a semismooth Newton (Ssn) algoithm for solving subproblems in the PPDNA can be effectively reduced by fully exploiting the second-order sparsity of the problem. We also design an adaptive sieving (AS) strategy to generate solution paths for the l1-regularized logistic regression problem, where each subproblem in the AS strategy is solved by the PPDNA. This strategy exploits active set constraints to reduce the number of variables in the problem, thereby speeding up the PPDNA for solving a series of problems. Numerical experiments demonstrate the superior performance of the PPDNA in comparison with some state-of-the-art second-order algorithms and the efficiency of the AS strategy combined with the PPDNA for generating solution paths.


title: Martingale problem for a Walsh spider process with spinning measure selected from its own local time

abstract: The objective of this article is to prove existence and weak uniqueness of a Walsh spider diffusion process, whose spinning measure and coefficients are allowed to depend on the local time spent at the junction vertex. The methodology is to show carefully that an effectively designed martingale problem is well-posed. Exploiting fully the results coming from the pioneering work of [16], the construction of the solution is performed using a concatenation procedure, as introduced in the seminal reference [26]. Uniqueness is shown by making use of the recent results obtained in [25] for the solution of the corresponding parabolic PDE that involves a new class of transmission condition called local time Kirchhoff 's transmission condition. As a byproduct of our main result, we manage to compute the explicit law of the diffusion when it behaves as a standard Brownian motion on each branch. The case I = 2 permits us to derive also that there is existence and uniqueness for solutions of generalized SDE on the real line that involve the local time of the unknown process in all its coefficients.


title: Local random quantum circuits form approximate designs on arbitrary architectures

abstract: We consider random quantum circuits (RQC) on arbitrary connected graphs whose edges determine the allowed $2$-qudit interactions. Prior work has established that such $n$-qudit circuits with local dimension $q$ on 1D, complete, and $D$-dimensional graphs form approximate unitary designs, that is, they generate unitaries from distributions close to the Haar measure on the unitary group $U(q^n)$ after polynomially many gates. Here, we extend those results by proving that RQCs comprised of $O(\mathrm{poly}(n,k))$ gates on a wide class of graphs form approximate unitary $k$-designs. We prove that RQCs on graphs with spanning trees of bounded degree and height form $k$-designs after $O(|E|n\,\mathrm{poly}(k))$ gates, where $|E|$ is the number of edges in the graph. Furthermore, we identify larger classes of graphs for which RQCs generate approximate designs in polynomial circuit size. For $k \leq 4$, we show that RQCs on graphs of certain maximum degrees form designs after $O(|E|n)$ gates, providing explicit constants. We determine our circuit size bounds from the spectral gaps of local Hamiltonians. To that end, we extend the finite-size (or Knabe) method for bounding gaps of frustration-free Hamiltonians on regular graphs to arbitrary connected graphs. We further introduce a new method based on the Detectability Lemma for determining the spectral gaps of Hamiltonians on arbitrary graphs. Our methods have wider applicability as the first method provides a succinct alternative proof of [Commun. Math. Phys. 291, 257 (2009)] and the second method proves that RQCs on any connected architecture form approximate designs in quasi-polynomial circuit size.

categories: quant-ph cond-mat.stat-mech hep-th math-ph math.MP


title: Nonlinear interaction of head$-$on solitary waves in integrable and nonintegrable systems

abstract: This study numerically investigates the nonlinear interaction of head-on solitary waves in a granular chain (a nonintegrable system) and compares the simulation results with the theoretical results in fluid (an integrable system). Three stages (i.e., pre-in-phase traveling stage, central-collision stage, and post-in-phase traveling stage) are identified to describe the nonlinear interaction processes in the granular chain. The nonlinear scattering effect occurs in the central-collision stage, which decreases the amplitude of incident solitary waves. Compared with the leading-time phase in the incident and separation collision processes, the lagging-time phase in the separation collision process is smaller. This asymmetrical nonlinear collision results in an occurrence of leading phase shifts of time and space in the post-in-phase traveling stage. We next find that solitary wave amplitude does not influence the immediate space-phase shift in the granular chain. The space$-$phase shift of the post-in-phase traveling stage is only determined by measurement position rather than wave amplitude. The results are reversed in the fluid. An increase in solitary wave amplitude leads to decreased attachment, detachment and residence times for granular chain and fluid. For the immediate time-phase shift, leading and lagging phenomena appear in the granular chain and the fluid, respectively. These results offer new knowledge for designing mechanical metamaterials and energy-mitigating systems.


title: Improved bounds for the two-point logarithmic Chowla conjecture

abstract: Let $\lambda$ be the Liouville function, defined as $\lambda(n) := (-1)^{\Omega(n)}$ where $\Omega(n)$ is the number of prime factors of $n$ with multiplicity. In 2021, Helfgott and Radziwi{\l}{\l} proved that $$\sum_{n\leq x} \frac{1}{n} \lambda(n) \lambda(n+1) \ll \frac{\log x}{(\log \log x)^{1/2}},$$improving earlier results by Tao and Ter\"av\"ainen. We prove that $$\sum_{n\leq x} \frac{1}{n} \lambda(n) \lambda(n+1) \ll (\log x)^{1-c}$$for some absolute constant $c>0$. This appears to be best possible with current methods.


title: Extraction of information on transversity GPDs from $\pi^0$ and $\eta$ production on EIC of China

abstract: The General Parton Distributions (GPDs) are applied to study the hard Pseudoscalar Meson Production (PMP) at high energies. The PMP amplitudes are be obtained within the GPDs factorization. They are expressed in terms of GPDs convolution functions, which are most essential in PMP reactions. We show that these convolution functions can be extracted from the PMP data in future EIC of China (EicC). Predictions of $\pi^0$ and $\eta$ production at typical EicC energies are performed.


title: Introducing instance label correlation in multiple instance learning. Application to cancer detection on histopathological images

abstract: In the last years, the weakly supervised paradigm of multiple instance learning (MIL) has become very popular in many different areas. A paradigmatic example is computational pathology, where the lack of patch-level labels for whole-slide images prevents the application of supervised models. Probabilistic MIL methods based on Gaussian Processes (GPs) have obtained promising results due to their excellent uncertainty estimation capabilities. However, these are general-purpose MIL methods that do not take into account one important fact: in (histopathological) images, the labels of neighboring patches are expected to be correlated. In this work, we extend a state-of-the-art GP-based MIL method, which is called VGPMIL-PR, to exploit such correlation. To do so, we develop a novel coupling term inspired by the statistical physics Ising model. We use variational inference to estimate all the model parameters. Interestingly, the VGPMIL-PR formulation is recovered when the weight that regulates the strength of the Ising term vanishes. The performance of the proposed method is assessed in two real-world problems of prostate cancer detection. We show that our model achieves better results than other state-of-the-art probabilistic MIL methods. We also provide different visualizations and analysis to gain insights into the influence of the novel Ising term. These insights are expected to facilitate the application of the proposed model to other research areas.


title: Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspective

abstract: Adversarial Training (AT) has become arguably the state-of-the-art algorithm for extracting robust features. However, researchers recently notice that AT suffers from severe robust overfitting problems, particularly after learning rate (LR) decay. In this paper, we explain this phenomenon by viewing adversarial training as a dynamic minimax game between the model trainer and the attacker. Specifically, we analyze how LR decay breaks the balance between the minimax game by empowering the trainer with a stronger memorization ability, and show such imbalance induces robust overfitting as a result of memorizing non-robust features. We validate this understanding with extensive experiments, and provide a holistic view of robust overfitting from the dynamics of both the two game players. This understanding further inspires us to alleviate robust overfitting by rebalancing the two players by either regularizing the trainer's capacity or improving the attack strength. Experiments show that the proposed ReBalanced Adversarial Training (ReBAT) can attain good robustness and does not suffer from robust overfitting even after very long training. Code is available at https://github.com/PKU-ML/ReBAT.


title: Interlayer Conductance in the Armchair Nanotube -- Zigzag Graphene Ribbon Parallel Contact: Theoretical Proposal of Detection of Wavefunction Growing from the Edge to the Center in the Graphene Ribbon

abstract: Sublattices A and B are opposite in the decay direction of the edge state of the zigzag graphene ribbon (ZGR). Detecting exponential growth from the zigzag edges to the ZGR center remains challenging. The tight-binding model calculations in this letter reveal that interlayer conductance manifests this growth in parallel contact with the armchair nanotube. The transfer integrals of oblique interlayer bonds are comparable to those of vertical interlayer bonds. However, the phase of the ZGR wave function strongly suppresses the contribution of oblique bonds, allowing the selective detection of the growing component.