title: Differential Calculus over Graded Commutative Algebras and Vector Bundles with Inner Structures

abstract: In this note we highlight a common origin for many ubiquitous geometric structures, as well as several new ones by using only the functors of differential calculus in A.M Vinogradov's original sense, adapted to special classes of (graded) commutative algebras. Special attention is given to the particularly simple cases of diole and triole algebras and we show the latter environment is the appropriate one to describe calculus in vector bundles in the presence of a vector-valued fiber metric.


title: FREDSum: A Dialogue Summarization Corpus for French Political Debates

abstract: Recent advances in deep learning, and especially the invention of encoder-decoder architectures, has significantly improved the performance of abstractive summarization systems. The majority of research has focused on written documents, however, neglecting the problem of multi-party dialogue summarization. In this paper, we present a dataset of French political debates for the purpose of enhancing resources for multi-lingual dialogue summarization. Our dataset consists of manually transcribed and annotated political debates, covering a range of topics and perspectives. We highlight the importance of high quality transcription and annotations for training accurate and effective dialogue summarization models, and emphasize the need for multilingual resources to support dialogue summarization in non-English languages. We also provide baseline experiments using state-of-the-art methods, and encourage further research in this area to advance the field of dialogue summarization. Our dataset will be made publicly available for use by the research community.


title: Tied--boxed algebras

abstract: We introduce two new algebras that we call \emph{tied--boxed Hecke algebra} and \emph{tied--boxed Temperley--Lieb algebra}. The first one is a subalgebra of the algebra of braids and ties introduced by Aicardi and Juyumaya, and the second one is a tied--version of the well known Temperley--Lieb algebra. We study their representation theory and give cellular bases for them. Furthermore, we explore a strong connection between the tied--boxed Temperley--Lieb algebra and the so--called partition Temperley--Lieb algebra given by Juyumaya. Also, we show that both structures inherit diagrammatic interpretations from a new class of monoids that we call \emph{boxed ramified monoids}. Additionally, we give presentations for the singular part of the ramified symmetric monoid and for the boxed ramified monoid associated to the Brauer monoid.


title: Data-Driven Identification of Attack-free Sensors in Networked Control Systems

abstract: This paper proposes a data-driven framework to identify the attack-free sensors in a networked control system when some of the sensors are corrupted by an adversary. An operator with access to offline input-output attack-free trajectories of the plant is considered. Then, a data-driven algorithm is proposed to identify the attack-free sensors when the plant is controlled online. We also provide necessary conditions, based on the properties of the plant, under which the algorithm is feasible. An extension of the algorithm is presented to identify the sensors completely online against certain classes of attacks. The efficacy of our algorithm is depicted through numerical examples.


title: Sound Source Localization for a Source inside a Structure using Ac-CycleGAN

abstract: We propose a method for sound source localization (SSL) for a source inside a structure using Ac-CycleGAN under unpaired data conditions. The proposed method utilizes a large amount of simulated data and a small amount of actual experimental data to locate a sound source inside a structure in a real environment. An Ac-CycleGAN generator contributes to the transformation of simulated data into real data, or vice versa, using unpaired data from both domains. The discriminator of an Ac-CycleGAN model is designed to differentiate between the transformed data generated by the generator and real data, while also predicting the location of the sound source. Vectors representing the frequency spectrum of the accelerometers (FSAs) measured at three points outside the structure are used as input data and the source areas inside the structure are used as labels. The input data vectors are concatenated vertically to form an image. Labels are defined by dividing the interior of the structure into eight areas with one-hot encoding for each area. Thus, the SSL problem is redefined as an image-classification problem to stochastically estimate the location of the sound source. We show that it is possible to estimate the sound source location using the Ac-CycleGAN discriminator for unpaired data across domains. Furthermore, we analyze the discriminative factors for distinguishing the data. The proposed model exhibited an accuracy exceeding 90\% when trained on 80\% of actual data (12.5\% of simulated data). Despite potential imperfections in the domain transformation process carried out by the Ac-CycleGAN generator, the discriminator can effectively distinguish between transferred and real data by selectively utilizing only those features that generate a relatively small transformation error.


title: Over-abundance of orphan galaxies in the UniverseMachine

abstract: Orphan galaxies that have lost a large fraction of the dark matter subhaloes have often been invoked in semi-analytical as well as empirical models of galaxy formation. We run a mock cluster finder that mimics the optical cluster finding technique of the redMaPPer algorithm on a catalogue of galaxies with quenched star formation from one such empirical model, the UniverseMachine, and obtain the prevalence of orphan galaxies in these clusters as a function of their cluster-centric distance. We compare the fraction of orphan galaxies with the upper limits derived based on our prior observations of the weak lensing signals around satellite galaxies from SDSS redMaPPer clusters. Although the orphan fraction from the UniverseMachine is marginally consistent with the upper limits in the innermost regions of galaxy clusters spanning [0.1, 0.3] $h^{-1}$ Mpc, we observe that the orphan fractions substantially violate the upper limits in the outer regions of galaxy clusters beyond 0.3 $h^{-1}$ Mpc. We discuss the reasons, plausible improvements to the model and how observations can be used to constrain such models further.


title: Transient Reviving Dynamics with an Exact Solution for Delay Differential Equations

abstract: We present a new approach to examine transient dynamics in a class of non-autonomous delay differential equations. Exact solutions for these equations are obtained using the Lambert $W$ function alongside an appropriately chosen initial function. These solutions provide a reliable approximation for transient dynamics when the initial functions are not markedly distinct. We explore a non-autonomous equation that exhibits a distinctive phenomenon of reviving dynamics as an illustrative example. The derived exact solutions effectively encapsulate the qualitative characteristics of this reviving dynamics over various delay values.


title: Low Resistance Ohmic Contact to P-type Monolayer WSe2

abstract: Advanced microelectronics in the future may require semiconducting channel materials beyond silicon. Two-dimensional (2D) semiconductors, characterized by their atomically thin thickness, hold immense promise for high-performance electronic devices at the nanometer scale with lower heat dissipation. One challenge for achieving high-performance 2D semiconductor field effect transistors (FET), especially for p-type materials, is the high electrical contact resistance present at the metal-semiconductor interface. In conventional bulk semiconductors, low resistance ohmic contact is realized through heavy substitutional doping with acceptor or donor impurities at the contact region. The strategy of substitutional doping, however, does not work for p-type 2D semiconductors such as monolayer tungsten diselenide (WSe$_2$).In this study, we developed highly efficient charge-transfer doping with WSe$_2$/$\alpha$-RuCl$_3$ heterostructures to achieve low-resistance ohmic contact for p-type WSe$_2$ transistors. We show that a hole doping as high as 3$\times$10$^{13}$ cm$^{-2}$ can be achieved in the WSe$_2/\alpha$-RuCl$_3$ heterostructure due to its type-III band alignment. It results in an Ohmic contact with resistance lower than 4 k Ohm $\mu$m at the p-type monolayer WSe$_2$/metal junction. at room temperature. Using this low-resistance contact, we demonstrate high-performance p-type WSe$_2$ transistors with a saturation current of 35 $\mu$A$\cdot$ $\mu$m$^{-1}$ and an I$_{ON}$/I$_{OFF}$ ratio exceeding 10$^9$ It could enable future microelectronic devices based on 2D semiconductors and contribute to the extension of Moore's law.


title: Impact of the Fizeau drag effect on Goos-H\"{a}nchen shifts in graphene

abstract: We investigate the Goos-H\"{a}nchen shifts in reflection for a light beam within a graphene structure, utilizing the Fizeau drag effect induced by its massless Dirac electrons in incident light. The magnitudes of spatial and angular shifts for a light beam propagating against the direction of drifting electrons are significantly enhanced, while shifts for a beam co-propagating with the drifting electrons are suppressed. The Goos-H\"{a}nchen shifts exhibit augmentation with increasing drift velocities of electrons in graphene. The impact of incident wavelength on the angular and spatial shifts in reflection is discussed. Furthermore, the study highlights the crucial roles of the density of charged particles in graphene, the particle relaxation time, and the thickness of the graphene in manipulating the drag-affected Goos-H\"{a}nchen shifts. This investigation offers valuable insights for efficiently guiding light in graphene structures under the influence of the Fizeau drag effect.


title: Two-weight, two-parameter fractional integration with one side condition

abstract: We study a family of strong fractional integral operators whose kernels have singularity on every coordinate subspace. We prove a two-weight $L^p$-$L^q$-norm inequality by allowing only one of the weights to satisfy $A_p\times A_p$-condition.


title: Uniform bundles on generalised Grassmannians

abstract: Let $E$ be a uniform bundle on an arbitrary generalised Grassmannian $X$ defined over $\mathbb{C}$. We show that if the rank of $E$ is at most $e.d.(\mathrm{VMRT})$, then $E$ necessarily splits. For some generalised Grassmannians, we prove that the upper bounds $e.d.(\mathrm{VMRT})$ are optimal and classify all unsplit uniform bundles of minimal ranks.


title: DiffCMR: Fast Cardiac MRI Reconstruction with Diffusion Probabilistic Models

abstract: Performing magnetic resonance imaging (MRI) reconstruction from under-sampled k-space data can accelerate the procedure to acquire MRI scans and reduce patients' discomfort. The reconstruction problem is usually formulated as a denoising task that removes the noise in under-sampled MRI image slices. Although previous GAN-based methods have achieved good performance in image denoising, they are difficult to train and require careful tuning of hyperparameters. In this paper, we propose a novel MRI denoising framework DiffCMR by leveraging conditional denoising diffusion probabilistic models. Specifically, DiffCMR perceives conditioning signals from the under-sampled MRI image slice and generates its corresponding fully-sampled MRI image slice. During inference, we adopt a multi-round ensembling strategy to stabilize the performance. We validate DiffCMR with cine reconstruction and T1/T2 mapping tasks on MICCAI 2023 Cardiac MRI Reconstruction Challenge (CMRxRecon) dataset. Results show that our method achieves state-of-the-art performance, exceeding previous methods by a significant margin. Code is available at https://github.com/xmed-lab/DiffCMR.


title: Apollo's Oracle: Retrieval-Augmented Reasoning in Multi-Agent Debates

abstract: Multi-agent debate systems are designed to derive accurate and consistent conclusions through adversarial interactions among agents. However, these systems often encounter challenges due to cognitive constraints, manifesting as (1) agents' obstinate adherence to incorrect viewpoints and (2) their propensity to abandon correct viewpoints. These issues are primarily responsible for the ineffectiveness of such debates. Addressing the challenge of cognitive constraints, we introduce a novel framework, the Multi-Agent Debate with Retrieval Augmented (MADRA). MADRA incorporates retrieval of prior knowledge into the debate process, effectively breaking cognitive constraints and enhancing the agents' reasoning capabilities. Furthermore, we have developed a self-selection module within this framework, enabling agents to autonomously select pertinent evidence, thereby minimizing the impact of irrelevant or noisy data. We have comprehensively tested and analyzed MADRA across six diverse datasets. The experimental results demonstrate that our approach significantly enhances performance across various tasks, proving the effectiveness of our proposed method.


title: Comparative study of 1D and 2D convolutional neural network models with attribution analysis for gravitational wave detection from compact binary coalescences

abstract: Recent advancements in gravitational wave astronomy have seen the application of convolutional neural networks (CNNs) in signal detection from compact binary coalescences. This study presents a comparative analysis of two CNN architectures: one-dimensional (1D) and two-dimensional (2D) along with an ensemble model combining both. We trained these models to detect gravitational wave signals from binary black hole (BBH) mergers, neutron star-black hole (NSBH) mergers, and binary neutron star (BNS) mergers within real detector noise. Our investigation entailed a comprehensive evaluation of the detection performance of each model type across different signal classes. To understand the models' decision-making processes, we employed feature map visualization and attribution analysis. The findings revealed that while the 1D model showed superior performance in detecting BBH signals, the 2D model excelled in identifying NSBH and BNS signals. Notably, the ensemble model outperformed both individual models across all signal types, demonstrating enhanced detection capabilities. Additionally, input feature visualization indicated distinct areas of focus in the data for the 1D and 2D models, emphasizing the effectiveness of their combination.


title: SCALER: Versatile Multi-Limbed Robot for Free-Climbing in Extreme Terrains

abstract: This paper presents SCALER, a versatile free-climbing multi-limbed robot that is designed to achieve tightly coupled simultaneous locomotion and dexterous grasping. Although existing quadruped-limbed robots have shown impressive dexterous skills such as object manipulation, it is essential to balance power-intensive locomotion and dexterous grasping capabilities. We design a torso linkage and a parallel-serial limb to meet such conflicting skills that pose unique challenges in the hardware designs. SCALER employs underactuated two-fingered GOAT grippers that can mechanically adapt and offer 7 modes of grasping, enabling SCALER to traverse extreme terrains with multi-modal grasping strategies. We study the whole-body approach, where SCALER uses its body and limbs to generate additional forces for stable grasping with environments, further enhancing versatility. Furthermore, we improve the GOAT gripper actuation speed to realize more dynamic climbing in a closed-loop control fashion. With these proposed technologies, SCALER can traverse vertical, overhang, upside-down, slippery terrains, and bouldering walls with non-convex-shaped climbing holds under the Earth's gravity.


title: Application-Defined Receive Side Dispatching on the NIC

abstract: Recently, some application (L7) processing has been moved to the network stack (including proxies) as a way to provide a common and application-agnostic interface for security policies, simplify service management, etc. This paper looks at whether L7 network functionality can be offloaded to SmartNICs to improve performance and reduce overheads. We investigate this question by examining how to offload to FPGA NICs the task of L7 dispatch: determining which application process must handle a particular application request. We find that existing protocols, e.g., gRPC on TCP or QUIC, are a hindrance for offloading because the data required to make L7 dispatch decisions can be spread out over many packets, requiring the NIC to buffer and parse a large number of packets to reconstruct L7 data. This paper presents QingNiao-an approach that co-designs application libraries, network protocols, and hardware-to make L7 dispatch feasible under NIC memory constraints. We prototype QingNiao on a 100Gbps FPGA NIC. Experiments with real-world applications show that QingNiao supports a variety of dispatch rules and achieves 7.5x to 8x throughput compared to state-of-the-art software L7 dispatcher. We have open-sourced QingNiao at [1].


title: A short tutorial on Wirtinger Calculus with applications in quantum information

abstract: The optimization of system parameters is a ubiquitous problem in science and engineering. The traditional approach involves setting to zero the partial derivatives of the objective function with respect to each parameter, in order to extract the optimal solution. However, the system parameters often take the form of complex matrices. In such situations, conventional methods become unwieldy. The `Wirtinger Calculus' provides a relatively simple methodology for such optimization problems. In this tutorial, we provide a pedagogical introduction to Wirtinger Calculus. To illustrate the utility of this framework in quantum information theory, we also discuss a few example applications.


title: Generalized cluster structures on $\mathrm{SL}_n^\dagger$

abstract: We study Poisson varieties $(\mathrm{SL}_n^{\dagger},\pi_{\mathbf{\Gamma}}^{\dagger})$ parameterized by Belavin-Drinfeld triples $\mathbf{\Gamma}$ of type $A_{n-1}$ along with generalized cluster structures $\mathcal{GC}^{\dagger}(\mathbf{\Gamma})$ on $\mathrm{SL}_n^{\dagger}$ compatible with $\pi_{\mathbf{\Gamma}}^{\dagger}$. As a variety, $\mathrm{SL}_n^{\dagger}$ is a Zariski open subset of $\mathrm{SL}_n$ obtained as the image of the dual Poisson-Lie group $(\mathrm{SL}_n^{*},\pi_{\mathbf{\Gamma}}^*)$ of $(\mathrm{SL}_n,\pi_{\mathbf{\Gamma}})$ under a certain rational map. We prove that the generalized upper cluster structure of $\mathcal{GC}^{\dagger}(\mathbf{\Gamma})$ on $\mathrm{SL}_n$ is naturally isomorphic to $\mathcal{O}(\mathrm{SL}_n)$. Moreover, for any connected reductive complex group $G$ and a BD triple $\mathbf{\Gamma}$, we produce a rational map $\mathcal{Q}:(G,\pi_{\text{std}}^{\dagger})\dashrightarrow(G,\pi_{\mathbf{\Gamma}}^{\dagger})$ that is a Poisson isomorphism if the $r_0$ parts of $\pi_{\text{std}}^{\dagger}$ and $\pi_{\mathbf{\Gamma}}^{\dagger}$ coincide; furthermore, in the case when $G \in \{\mathrm{SL}_n,\mathrm{GL}_n\}$, we show that $\mathcal{Q}$ is a birational quasi-isomorphism between $\mathcal{GC}^\dagger(\mathbf{\Gamma}_{\text{std}})$ and $\mathcal{GC}^\dagger(\mathbf{\Gamma})$. Lastly, for any pair of BD triples $\tilde{\mathbf{\Gamma}} \prec \mathbf{\Gamma}$ of type $A_{n-1}$ comparable in the natural order, we use the map $\mathcal{Q}$ to construct a birational quasi-isomorphism between $\mathcal{GC}^{\dagger}(\tilde{\mathbf{\Gamma}})$ and $\mathcal{GC}^{\dagger}(\mathbf{\Gamma})$.


title: Are We Testing or Being Tested? Exploring the Practical Applications of Large Language Models in Software Testing

abstract: A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates coherent content, including grammatically precise sentences, human-like paragraphs, and syntactically accurate code snippets. LLMs can play a pivotal role in software development, including software testing. LLMs go beyond traditional roles such as requirement analysis and documentation and can support test case generation, making them valuable tools that significantly enhance testing practices within the field. Hence, we explore the practical application of LLMs in software testing within an industrial setting, focusing on their current use by professional testers. In this context, rather than relying on existing data, we conducted a cross-sectional survey and collected data within real working contexts, specifically, engaging with practitioners in industrial settings. We applied quantitative and qualitative techniques to analyze and synthesize our collected data. Our findings demonstrate that LLMs effectively enhance testing documents and significantly assist testing professionals in programming tasks like debugging and test case automation. LLMs can support individuals engaged in manual testing who need to code. However, it is crucial to emphasize that, at this early stage, software testing professionals should use LLMs with caution while well-defined methods and guidelines are being built for the secure adoption of these tools.


title: Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review

abstract: With the rapid advancements of sensor technology and deep learning, autonomous driving systems are providing safe and efficient access to intelligent vehicles as well as intelligent transportation. Among these equipped sensors, the radar sensor plays a crucial role in providing robust perception information in diverse environmental conditions. This review focuses on exploring different radar data representations utilized in autonomous driving systems. Firstly, we introduce the capabilities and limitations of the radar sensor by examining the working principles of radar perception and signal processing of radar measurements. Then, we delve into the generation process of five radar representations, including the ADC signal, radar tensor, point cloud, grid map, and micro-Doppler signature. For each radar representation, we examine the related datasets, methods, advantages and limitations. Furthermore, we discuss the challenges faced in these data representations and propose potential research directions. Above all, this comprehensive review offers an in-depth insight into how these representations enhance autonomous system capabilities, providing guidance for radar perception researchers. To facilitate retrieval and comparison of different data representations, datasets and methods, we provide an interactive website at https://radar-camera-fusion.github.io/radar.


title: Damage GAN: A Generative Model for Imbalanced Data

abstract: This study delves into the application of Generative Adversarial Networks (GANs) within the context of imbalanced datasets. Our primary aim is to enhance the performance and stability of GANs in such datasets. In pursuit of this objective, we introduce a novel network architecture known as Damage GAN, building upon the ContraD GAN framework which seamlessly integrates GANs and contrastive learning. Through the utilization of contrastive learning, the discriminator is trained to develop an unsupervised representation capable of distinguishing all provided samples. Our approach draws inspiration from the straightforward framework for contrastive learning of visual representations (SimCLR), leading to the formulation of a distinctive loss function. We also explore the implementation of self-damaging contrastive learning (SDCLR) to further enhance the optimization of the ContraD GAN model. Comparative evaluations against baseline models including the deep convolutional GAN (DCGAN) and ContraD GAN demonstrate the evident superiority of our proposed model, Damage GAN, in terms of generated image distribution, model stability, and image quality when applied to imbalanced datasets.


title: Information divergences of Markov chains and their applications

abstract: In this paper, we first introduce and define several new information divergences in the space of transition matrices of finite Markov chains which measure the discrepancy between two Markov chains. These divergences offer natural generalizations of classical information-theoretic divergences, such as the $f$-divergences and the R\'enyi divergence between probability measures, to the context of finite Markov chains. We begin by detailing and deriving fundamental properties of these divergences and notably gives a Markov chain version of the Pinsker's inequality and Chernoff information. We then utilize these notions in a few applications. First, we investigate the binary hypothesis testing problem of Markov chains, where the newly defined R\'enyi divergence between Markov chains and its geometric interpretation play an important role in the analysis. Second, we propose and analyze information-theoretic (Ces\`aro) mixing times and ergodicity coefficients, along with spectral bounds of these notions in the reversible setting. Examples of the random walk on the hypercube, as well as the connections between the critical height of the low-temperature Metropolis-Hastings chain and these proposed ergodicity coefficients, are highlighted.


title: Critical Analysis of 5G Networks Traffic Intrusion using PCA, t-SNE and UMAP Visualization and Classifying Attacks

abstract: Networks, threat models, and malicious actors are advancing quickly. With the increased deployment of the 5G networks, the security issues of the attached 5G physical devices have also increased. Therefore, artificial intelligence based autonomous end-to-end security design is needed that can deal with incoming threats by detecting network traffic anomalies. To address this requirement, in this research, we used a recently published 5G traffic dataset, 5G-NIDD, to detect network traffic anomalies using machine and deep learning approaches. First, we analyzed the dataset using three visualization techniques: t-Distributed Stochastic Neighbor Embedding (t-SNE), Uniform Manifold Approximation and Projection (UMAP), and Principal Component Analysis (PCA). Second, we reduced the data dimensionality using mutual information and PCA techniques. Third, we solve the class imbalance issue by inserting synthetic records of minority classes. Last, we performed classification using six different classifiers and presented the evaluation metrics. We received the best results when K-Nearest Neighbors classifier was used: accuracy (97.2%), detection rate (96.7%), and false positive rate (2.2%).


title: StructComp: Substituting Propagation with Structural Compression in Training Graph Contrastive Learning

abstract: Graph contrastive learning (GCL) has become a powerful tool for learning graph data, but its scalability remains a significant challenge. In this work, we propose a simple yet effective training framework called Structural Compression (StructComp) to address this issue. Inspired by a sparse low-rank approximation on the diffusion matrix, StructComp trains the encoder with the compressed nodes. This allows the encoder not to perform any message passing during the training stage, and significantly reduces the number of sample pairs in the contrastive loss. We theoretically prove that the original GCL loss can be approximated with the contrastive loss computed by StructComp. Moreover, StructComp can be regarded as an additional regularization term for GCL models, resulting in a more robust encoder. Empirical studies on various datasets show that StructComp greatly reduces the time and memory consumption while improving model performance compared to the vanilla GCL models and scalable training methods.


title: Understanding oscillating features of the timelike nucleon electromagnetic form factors within the extending vector meson dominance model

abstract: We investigate the nonmonotonic behavior observed in the time-like nucleon electromagnetic form factors. Using a phenomenological extending vector meson dominance model, where the ground states $\rho$ and $\omega$ and their excited states $\rho(2D)$, $\omega(3D)$, and $\omega(5S)$ are taken into account, we have successfully reproduced the cross sections of $e^+ e^- \to p \bar{p}$ and $e^+ e^- \to n \bar{n}$ reactions. Furthermore, we have derived the nucleon electromagnetic form factors in the time-like region, and it is found that the so-called periodic behaviour of the nucleon effective form factors is not confirmed. However, there are indeed nonmonotonic structures in the line shape of nucleon effective form factors, which can be naturally reproduced by considering the contributions from the low-lying excited vector states.


title: HandDiffuse: Generative Controllers for Two-Hand Interactions via Diffusion Models

abstract: Existing hands datasets are largely short-range and the interaction is weak due to the self-occlusion and self-similarity of hands, which can not yet fit the need for interacting hands motion generation. To rescue the data scarcity, we propose HandDiffuse12.5M, a novel dataset that consists of temporal sequences with strong two-hand interactions. HandDiffuse12.5M has the largest scale and richest interactions among the existing two-hand datasets. We further present a strong baseline method HandDiffuse for the controllable motion generation of interacting hands using various controllers. Specifically, we apply the diffusion model as the backbone and design two motion representations for different controllers. To reduce artifacts, we also propose Interaction Loss which explicitly quantifies the dynamic interaction process. Our HandDiffuse enables various applications with vivid two-hand interactions, i.e., motion in-betweening and trajectory control. Experiments show that our method outperforms the state-of-the-art techniques in motion generation and can also contribute to data augmentation for other datasets. Our dataset, corresponding codes, and pre-trained models will be disseminated to the community for future research towards two-hand interaction modeling.


title: Manipulator control of the Robotized TMS System with Incurved TMS Coil Case

abstract: Objective: This study shows the force/torque control strategy for the robotized TMS system whose TMS coil's floor is incurved. The strategy considered the adhesion and friction between the coil and the subject's head. Methods: Hybrid position/force control and proportional torque were used for the strategy. The force magnitude applied for the force control was scheduled by the error between the coil's current position and the target point. Results: The larger desired force for the force controller makes the error quickly. By scheduling the force magnitude applied for the force control, the low error between the coil's current and target positions is maintained with the relatively small force after the larger force is applied for around 10 seconds. The proportional torque made the adhesion better by locating the contact area between the coil and the head close to the coil. I was shown by checking the ${\tau}_c/F_c$ value from the experimental results. While the head slowly moved away from the coil during the TMS treatment, the coil still interacted with the head. Using that characteristic, the coil could locate the new target point using the force/torque strategy without any trajectory planning. Conclusion: The proposed force/torque controller enhanced the adhesion between the incurved TMS coil and the subject's head. It also reduced the error quickly by scheduling the magnitude of the force applied. Significance: This study proposes the robotized TMS system's force/torque control strategy considering the physical characteristics from the contact between the incurved TMS coil case and the subject's head.


title: Adapting Vision Transformer for Efficient Change Detection

abstract: Most change detection models based on vision transformers currently follow a "pretraining then fine-tuning" strategy. This involves initializing the model weights using large scale classification datasets, which can be either natural images or remote sensing images. However, fully tuning such a model requires significant time and resources. In this paper, we propose an efficient tuning approach that involves freezing the parameters of the pretrained image encoder and introducing additional training parameters. Through this approach, we have achieved competitive or even better results while maintaining extremely low resource consumption across six change detection benchmarks. For example, training time on LEVIR-CD, a change detection benchmark, is only half an hour with 9 GB memory usage, which could be very convenient for most researchers. Additionally, the decoupled tuning framework can be extended to any pretrained model for semantic change detection and multi temporal change detection as well. We hope that our proposed approach will serve as a part of foundational model to inspire more unified training approaches on change detection in the future.


title: Manifestation of heavy 3/2-spin lepton in large-angle $e^+e^-\rightarrow \gamma\gamma $ reaction at high energies

abstract: Manifestation of the heavy 3/2-spin lepton $(h^\pm)$, as possible virtual intermediate state in Feynmann diagrams, have been searched in the $e^+\,e^-\to \gamma\,\gamma$ reaction at high energies and large photon angles. The spin-vector field $\Psi_\alpha$ of the 3/2-lepton is described by the Rarita-Schwinger one and phenomenological Lagrangian of $h^\pm\, e^\pm \, \gamma$-interaction is chosen similarly to interaction of $\Delta$ isobar with nucleon and $\gamma$ quant. It is described by two constants with dimension $[M^{-1}]$ and $[M^{-2}].$ The differential cross section and polarization asymmetries have been calculated for the case when both beams are polarized longitudinally along their directions, as well transversally, in the reaction plane, and normally, perpendicularly to it. Numerical estimations are performed in wide diapason of the collision energy and parameters entering phenomenological Lagrangian.


title: SYSFLOW: Efficient Execution Platform for IoT Devices

abstract: Traditional executable delivery models pose challenges for IoT devices with limited storage, necessitating the download of complete executables and dependencies. Network solutions like NFS, designed for data files, encounter high IO overhead for irregular access patterns. This paper introduces SYSFLOW, a lightweight network-based executable delivery system for IoT. SYSFLOW delivers on-demand, redirecting local disk IO to the server through optimized network IO. To optimize cache hit rates, SYSFLOW employs server-side action-based prefetching, reducing latency by 45.1% to 75.8% compared to native Linux filesystems on SD cards. In wired environments, SYSFLOW's latency is up to 67.7% lower than NFS. In wireless scenarios, SYSFLOW performs 22.9% worse than Linux, comparable with Linux and outperforming NFS by up to 60.7%. While SYSFLOW's power consumption may be 6.7% higher than NFS, it offers energy savings due to lower processing time.


title: Formal Green's function theory in non-Hermitian lattice systems

abstract: In this paper, we employ the generalized Bloch theory to rediscover the generalized Brillouin zone theory and follow this way to obtain the Green's function of the non-Hermitian system. We focus on a classical chiral model and give the exact expression of the Green's function for a finite-size system and the formal expression of the Green's function suitable for infinite size. Based on these results, we further derive the correlation matrix and validate it numerically against direct calculations for a system of size 40. The numerical results show the accuracy of our exact expression and the high fidelity of our formal expression.


title: Distinguishing exoplanet companions from field stars in direct imaging using Gaia astrometry

abstract: Direct imaging searches for exoplanets around stars detect many spurious candidates that are in fact background field stars. To help distinguish these from genuine companions, multi-epoch astrometry can be used to identify a common proper motion with the host star. Although this is frequently done, many approaches lack an appropriate model for the motions of the background population, or do not use a statistical framework to properly quantify the results. Here we use Gaia astrometry combined with 2MASS photometry to model the parallax and proper motion distributions of field stars around exoplanet host stars as a function of candidate magnitude. We develop a likelihood-based method that compares the positions of a candidate at multiple epochs with the positions expected under both this field star model and a co-moving companion model. Our method propagates the covariances in the Gaia astrometry and the candidate positions. True companions are assumed to have long periods compared to the observational baseline, so we currently neglect orbital motion. We apply our method to a sample of 23 host stars with 263 candidates identified in the B-Star Exoplanet Abundance Study (BEAST) survey on VLT/SPHERE. We identify seven candidates in which the odds ratio favours the co-moving companion model by a factor of 100 or more. Most of these detections are based on only two or three epochs separated by less than three years, so further epochs should be obtained to reassess the companion probabilities. Our method is publicly available as an open-source python package from https://github.com/herzphi/compass to use with any data.


title: Interpretable Underwater Diver Gesture Recognition

abstract: In recent years, usage and applications of Autonomous Underwater Vehicles has grown rapidly. Interaction of divers with the AUVs remains an integral part of the usage of AUVs for various applications and makes building robust and efficient underwater gesture recognition systems extremely important. In this paper, we propose an Underwater Gesture Recognition system trained on the Cognitive Autonomous Diving Buddy Underwater gesture dataset using deep learning that achieves 98.01\% accuracy on the dataset, which to the best of our knowledge is the best performance achieved on this dataset at the time of writing this paper. We also improve the Gesture Recognition System Interpretability by using XAI techniques to visualize the model's predictions.


title: MVDD: Multi-View Depth Diffusion Models

abstract: Denoising diffusion models have demonstrated outstanding results in 2D image generation, yet it remains a challenge to replicate its success in 3D shape generation. In this paper, we propose leveraging multi-view depth, which represents complex 3D shapes in a 2D data format that is easy to denoise. We pair this representation with a diffusion model, MVDD, that is capable of generating high-quality dense point clouds with 20K+ points with fine-grained details. To enforce 3D consistency in multi-view depth, we introduce an epipolar line segment attention that conditions the denoising step for a view on its neighboring views. Additionally, a depth fusion module is incorporated into diffusion steps to further ensure the alignment of depth maps. When augmented with surface reconstruction, MVDD can also produce high-quality 3D meshes. Furthermore, MVDD stands out in other tasks such as depth completion, and can serve as a 3D prior, significantly boosting many downstream tasks, such as GAN inversion. State-of-the-art results from extensive experiments demonstrate MVDD's excellent ability in 3D shape generation, depth completion, and its potential as a 3D prior for downstream tasks.


title: GVE-Louvain: Fast Louvain Algorithm for Community Detection in Shared Memory Setting

abstract: Community detection is the problem of identifying natural divisions in networks. Efficient parallel algorithms for identifying such divisions is critical in a number of applications, where the size of datasets have reached significant scales. This technical report presents one of the most efficient multicore implementations of the Louvain algorithm, a high quality community detection method. On a server equipped with dual 16-core Intel Xeon Gold 6226R processors, our Louvain, which we term as GVE-Louvain, outperforms Vite, Grappolo, NetworKit Louvain, and cuGraph Louvain (running on NVIDIA A100 GPU) by 50x, 22x, 20x, and 5.8x faster respectively - achieving a processing rate of 560M edges/s on a 3.8B edge graph. In addition, GVE-Louvain improves performance at an average rate of 1.6x for every doubling of threads.


title: Generating Explanations to Understand and Repair Embedding-based Entity Alignment

abstract: Entity alignment (EA) seeks identical entities in different knowledge graphs, which is a long-standing task in the database research. Recent work leverages deep learning to embed entities in vector space and align them via nearest neighbor search. Although embedding-based EA has gained marked success in recent years, it lacks explanations for alignment decisions. In this paper, we present the first framework that can generate explanations for understanding and repairing embedding-based EA results. Given an EA pair produced by an embedding model, we first compare its neighbor entities and relations to build a matching subgraph as a local explanation. We then construct an alignment dependency graph to understand the pair from an abstract perspective. Finally, we repair the pair by resolving three types of alignment conflicts based on dependency graphs. Experiments on a variety of EA datasets demonstrate the effectiveness, generalization, and robustness of our framework in explaining and repairing embedding-based EA results.


title: Response of Non-premixed Jet Flames to Blast Waves

abstract: The work investigates the response dynamics of non-premixed jet flame to blast waves that are incident along the jet axis. In the present study, blast waves, generated using the wire-explosion technique, are forced to sweep across a non-premixed jet flame that is stabilised over a nozzle rim positioned at a distance of 264 mm from the source of blast generation. The work spans a wide range of fuel jet Reynolds numbers ($Re$) and incident blast wave Mach numbers ($M_{s,r}$). The interaction imposes a characteristic flow field over the jet flame, marked by a sharp discontinuity followed by a decaying profile and a delayed second spike. The second spike in the flow field profile corresponds to the induced flow that follows the blast front. While the response of the flame to the blast front was minimal, it was found to detach from the nozzle rim and lift off following the interaction with the induced flow. Subsequently, the lifted flame was found to re-attach back at the nozzle or extinguish, contingent on the operating $Re$ and $M_{s,r}$. Alongside flame lift-off, flame tip flickering was aggravated under the influence of the induced flow. A simplified theoretical model extending the vorticity transport equation was developed to estimate the change in flickering timescales and length scales owing to the interaction with the induced flow. The observed experimental trends were further compared against theoretical predictions from the model.


title: HC-Ref: Hierarchical Constrained Refinement for Robust Adversarial Training of GNNs

abstract: Recent studies have shown that attackers can catastrophically reduce the performance of GNNs by maliciously modifying the graph structure or node features on the graph. Adversarial training, which has been shown to be one of the most effective defense mechanisms against adversarial attacks in computer vision, holds great promise for enhancing the robustness of GNNs. There is limited research on defending against attacks by performing adversarial training on graphs, and it is crucial to delve deeper into this approach to optimize its effectiveness. Therefore, based on robust adversarial training on graphs, we propose a hierarchical constraint refinement framework (HC-Ref) that enhances the anti-perturbation capabilities of GNNs and downstream classifiers separately, ultimately leading to improved robustness. We propose corresponding adversarial regularization terms that are conducive to adaptively narrowing the domain gap between the normal part and the perturbation part according to the characteristics of different layers, promoting the smoothness of the predicted distribution of both parts. Moreover, existing research on graph robust adversarial training primarily concentrates on training from the standpoint of node feature perturbations and seldom takes into account alterations in the graph structure. This limitation makes it challenging to prevent attacks based on topological changes in the graph. This paper generates adversarial examples by utilizing graph structure perturbations, offering an effective approach to defend against attack methods that are based on topological changes. Extensive experiments on two real-world graph benchmarks show that HC-Ref successfully resists various attacks and has better node classification performance compared to several baseline methods.


title: Surveys of clumps, cores, and condensations in Cygnus-X: SMA observations of SiO (5$-$4)

abstract: The SiO emissions are usually used to trace high-velocity outflow shocks in star-forming regions. However, several studies have found low-velocity and widespread SiO emissions not associated with outflows in molecular clouds. We aim to detect and characterize the SiO emissions in massive dense cores (MDCs), and explore the properties of the central sources of SiO emission. We present high-angular-resolution ($\sim$1.5$^{\prime\prime}$) observations of the SiO (5$-$4) line made with the Submillimeter Array towards a sample of 48 MDCs in the Cygnus-X star-forming complex. We studied the SiO emission structures, including their morphologies, kinematics, and energetics, and investigated their relationship with the evolution of the central sources. The SiO (5$-$4) emission is detected in 16 out of 48 MDCs. We identify 14 bipolar and 18 unipolar SiO (5$-$4) outflows associated with 29 dust condensations. Most outflows (24 out of 32) are associated with excess Spitzer 4.5 $\mu$m emissions. We also find diffuse low-velocity ($\Delta{v}$ $\le$ 1.2 km s$^{-1}$) SiO (5$-$4) emission closely surrounding the dust condensations in two MDCs, and suggest that it may originate from decelerated outflow shocks or large-scale shocks from global cloud collapse. We find that the SMA SiO (5$-$4) emission in MDCs is mostly associated with outflows. Probably due to the relatively high excitation of SiO (5$-$4) compared to SiO (2$-$1) and due to the spatial filtering effect, we do not detect large-scale low-velocity SiO (5$-$4) emission, but detect more compact low-velocity emission in close proximity to the dust condensations. We group the sources into different evolutionary stages based on the infrared emission, radio continuum emission, and gas temperature properties of the outflow central sources, and find that the 24 $\mu$m luminosity tends to increase with evolution.


title: Predictive Chemistry Augmented with Text Retrieval

abstract: This paper focuses on using natural language descriptions to enhance predictive models in the chemistry field. Conventionally, chemoinformatics models are trained with extensive structured data manually extracted from the literature. In this paper, we introduce TextReact, a novel method that directly augments predictive chemistry with texts retrieved from the literature. TextReact retrieves text descriptions relevant for a given chemical reaction, and then aligns them with the molecular representation of the reaction. This alignment is enhanced via an auxiliary masked LM objective incorporated in the predictor training. We empirically validate the framework on two chemistry tasks: reaction condition recommendation and one-step retrosynthesis. By leveraging text retrieval, TextReact significantly outperforms state-of-the-art chemoinformatics models trained solely on molecular data.


title: Classification of Human- and AI-Generated Texts for English, French, German, and Spanish

abstract: In this paper we analyze features to classify human- and AI-generated text for English, French, German and Spanish and compare them across languages. We investigate two scenarios: (1) The detection of text generated by AI from scratch, and (2) the detection of text rephrased by AI. For training and testing the classifiers in this multilingual setting, we created a new text corpus covering 10 topics for each language. For the detection of AI-generated text, the combination of all proposed features performs best, indicating that our features are portable to other related languages: The F1-scores are close with 99% for Spanish, 98% for English, 97% for German and 95% for French. For the detection of AI-rephrased text, the systems with all features outperform systems with other features in many cases, but using only document features performs best for German (72%) and Spanish (86%) and only text vector features leads to best results for English (78%).


title: Understanding Community Bias Amplification in Graph Representation Learning

abstract: In this work, we discover a phenomenon of community bias amplification in graph representation learning, which refers to the exacerbation of performance bias between different classes by graph representation learning. We conduct an in-depth theoretical study of this phenomenon from a novel spectral perspective. Our analysis suggests that structural bias between communities results in varying local convergence speeds for node embeddings. This phenomenon leads to bias amplification in the classification results of downstream tasks. Based on the theoretical insights, we propose random graph coarsening, which is proved to be effective in dealing with the above issue. Finally, we propose a novel graph contrastive learning model called Random Graph Coarsening Contrastive Learning (RGCCL), which utilizes random coarsening as data augmentation and mitigates community bias by contrasting the coarsened graph with the original graph. Extensive experiments on various datasets demonstrate the advantage of our method when dealing with community bias amplification.


title: UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models

abstract: Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors when rendering text within the generated images. Such errors manifest as missing, incorrect or extraneous characters, thereby severely constraining the performance of text image generation based on diffusion models. To address the aforementioned issue, this paper proposes a novel approach for text image generation, utilizing a pre-trained diffusion model (i.e., Stable Diffusion [27]). Our approach involves the design and training of a light-weight character-level text encoder, which replaces the original CLIP encoder and provides more robust text embeddings as conditional guidance. Then, we fine-tune the diffusion model using a large-scale dataset, incorporating local attention control under the supervision of character-level segmentation maps. Finally, by employing an inference stage refinement process, we achieve a notably high sequence accuracy when synthesizing text in arbitrarily given images. Both qualitative and quantitative results demonstrate the superiority of our method to the state of the art. Furthermore, we showcase several potential applications of the proposed UDiffText, including text-centric image synthesis, scene text editing, etc. Code and model will be available at https://github.com/ZYM-PKU/UDiffText .


title: VISAGE: Video Instance Segmentation with Appearance-Guided Enhancement

abstract: In recent years, online Video Instance Segmentation (VIS) methods have shown remarkable advancement with their powerful query-based detectors. Utilizing the output queries of the detector at the frame-level, these methods achieve high accuracy on challenging benchmarks. However, our observations demonstrate that these methods heavily rely on location information, which often causes incorrect associations between objects. This paper presents that a key axis of object matching in trackers is appearance information, which becomes greatly instructive under conditions where positional cues are insufficient for distinguishing their identities. Therefore, we suggest a simple yet powerful extension to object decoders that explicitly extract embeddings from backbone features and drive queries to capture the appearances of objects, which greatly enhances instance association accuracy. Furthermore, recognizing the limitations of existing benchmarks in fully evaluating appearance awareness, we have constructed a synthetic dataset to rigorously validate our method. By effectively resolving the over-reliance on location information, we achieve state-of-the-art results on YouTube-VIS 2019/2021 and Occluded VIS (OVIS). Code is available at https://github.com/KimHanjung/VISAGE.


title: Early $\rm TeV$ photons of GRB 221009A were absorbed by the prompt MeV photons

abstract: Gamma-ray burst (GRB) 221009A produced the highest flux of gigaelectronvolt-teraelectronvolt ($\rm GeV-TeV$) photons ever observed, allowing the construction of a detailed $\rm TeV$ light curve. We focus on explaining the noticeable dip in the light curve around $2$-$5\ \rm s$ after the onset of $\rm TeV$ emission. We propose that Megaelectronvolt (MeV) photons from the prompt emission annihilate with $\rm TeV$ photons from the afterglow, producing an optical depth that obscures the $\rm TeV$ emission during this period. We develop a two-zone model accounting for the angles of MeV photons that can successfully reproduce the time delay between MeV and $\rm TeV$ photons, the peak optical depth over 3, and the rapid decline in optical depth. Our model supports $\rm MeV-TeV$ annihilation as the cause of the dip and provides reasonable constraints on the emission region parameters.


title: Response of premixed Jet Flames to Blast Waves

abstract: The study investigates the response dynamics of premixed jet flames when incident with blast waves along the jet axis. In the present work, blast waves are generated using the wire-explosion technique. The generated blast wave interacts with premixed jet flames that are stabilised over a thin fuel-air jet nozzle. The study is performed over a wide range of parametric space, varying the Reynolds number ($Re$) and normalised equivalence ratio ($\Phi$) of the premixed jet and the strength of the generated blast fronts ($M_{s,r}$). The blast wave imposes a decaying flow field profile characterised by a sharp discontinuity at the blast front. This is accompanied by a subsequent induced flow arising due to entertainment from the surroundings as the blast-imposed flow fields decay to sub-ambient levels. While the jet flame is observed to respond to the blast front with a jittery motion, it is found to lift off following the interaction with the induced flow. Depending on the operating conditions ($Re$, $\Phi$, and $M_{s,r}$), the flame lift-off is followed by an extinction or a re-attachment event. The flame response is further classified into two re-attachment and three extinction sub-regimes based on the response dynamics of the flame base and flame tip following the interaction process. The flame response entails flame base lift-off and flame tip distortion, potentially leading to a flame pinch-off event contingent on the operating conditions. A mathematical model was developed to explain the flame base response dynamics, yielding a scaling law for flame base lift-off height. Flame tip response trends were elucidated by extending the vorticity transport equation to estimate the vortex roll-up rate in the shear boundary surrounding the flame. Flame pinch-off was observed when shear layer vortices reached critical circulation limits and shed at length scales lower than the flame height.


title: Low Noise Near-Concentric Optical Cavity Design

abstract: Near-concentric cavities are excellent tools for enhancing atom--light interaction as they combine a small mode volume with a large optical access for atom manipulation. However, they are sensitive to longitudinal and transverse misalignment. To address this sensitivity, we present a compact near-concentric optical cavity system with a residual cavity length variation $\delta L_{C, rms}$=36(9) pm. A key part of this system is a cage-like tensegrity mirror support structure that allows to correct for longitudinal and transverse misalignment. The system is stable enough to allow the use of mirrors with higher cavity finesse to enhance the atom--light coupling strength in cavity-QED applications.


title: KwaiAgents: Generalized Information-seeking Agent System with Large Language Models

abstract: Driven by curiosity, humans have continually sought to explore and understand the world around them, leading to the invention of various tools to satiate this inquisitiveness. Despite not having the capacity to process and memorize vast amounts of information in their brains, humans excel in critical thinking, planning, reflection, and harnessing available tools to interact with and interpret the world, enabling them to find answers efficiently. The recent advancements in large language models (LLMs) suggest that machines might also possess the aforementioned human-like capabilities, allowing them to exhibit powerful abilities even with a constrained parameter count. In this paper, we introduce KwaiAgents, a generalized information-seeking agent system based on LLMs. Within KwaiAgents, we propose an agent system that employs LLMs as its cognitive core, which is capable of understanding a user's query, behavior guidelines, and referencing external documents. The agent can also update and retrieve information from its internal memory, plan and execute actions using a time-aware search-browse toolkit, and ultimately provide a comprehensive response. We further investigate the system's performance when powered by LLMs less advanced than GPT-4, and introduce the Meta-Agent Tuning (MAT) framework, designed to ensure even an open-sourced 7B or 13B model performs well among many agent systems. We exploit both benchmark and human evaluations to systematically validate these capabilities. Extensive experiments show the superiority of our agent system compared to other autonomous agents and highlight the enhanced generalized agent-abilities of our fine-tuned LLMs.


title: Distributionally robust optimization through the lens of submodularity

abstract: Distributionally robust optimization is used to solve decision making problems under adversarial uncertainty where the distribution of the uncertainty is itself ambiguous. In this paper, we identify a class of these instances that is solvable in polynomial time by viewing it through the lens of submodularity. We show that the sharpest upper bound on the expectation of the maximum of affine functions of a random vector is computable in polynomial time if each random variable is discrete with finite support and upper bounds (respectively lower bounds) on the expected values of a finite set of submodular (respectively supermodular) functions of the random vector are specified. This adds to known polynomial time solvable instances of the multimarginal optimal transport problem and the generalized moment problem by bridging ideas from convexity in continuous optimization to submodularity in discrete optimization. In turn, we show that a class of distributionally robust optimization problems with discrete random variables is solvable in polynomial time using the ellipsoid method. When the submodular (respectively supermodular) functions are structured, the sharp bound is computable by solving a compact linear program. We illustrate this in two cases. The first is a multimarginal optimal transport problem with given univariate marginal distributions and bivariate marginals satisfying specific positive dependence orders along with an extension to incorporate higher order marginal information. The second is a discrete moment problem where a set of marginal moments of the random variables are given along with lower bounds on the cross moments of pairs of random variables. Numerical experiments show that the bounds improve by 2 to 8 percent over bounds that use only univariate information in the first case, and by 8 to 15 percent over bounds that use the first moment in the second case.


title: Cross-BERT for Point Cloud Pretraining

abstract: Introducing BERT into cross-modal settings raises difficulties in its optimization for handling multiple modalities. Both the BERT architecture and training objective need to be adapted to incorporate and model information from different modalities. In this paper, we address these challenges by exploring the implicit semantic and geometric correlations between 2D and 3D data of the same objects/scenes. We propose a new cross-modal BERT-style self-supervised learning paradigm, called Cross-BERT. To facilitate pretraining for irregular and sparse point clouds, we design two self-supervised tasks to boost cross-modal interaction. The first task, referred to as Point-Image Alignment, aims to align features between unimodal and cross-modal representations to capture the correspondences between the 2D and 3D modalities. The second task, termed Masked Cross-modal Modeling, further improves mask modeling of BERT by incorporating high-dimensional semantic information obtained by cross-modal interaction. By performing cross-modal interaction, Cross-BERT can smoothly reconstruct the masked tokens during pretraining, leading to notable performance enhancements for downstream tasks. Through empirical evaluation, we demonstrate that Cross-BERT outperforms existing state-of-the-art methods in 3D downstream applications. Our work highlights the effectiveness of leveraging cross-modal 2D knowledge to strengthen 3D point cloud representation and the transferable capability of BERT across modalities.


title: Floquet engineering of many-body states by the Ponderomotive potential

abstract: The Ponderomotive force is a static second order force that a particle feels in an oscillating field, whose static potential may be called the Ponderomotive potential. We generalize this notion to that for generic degrees of freedom in periodically driven quantum many-body systems, and propose it as a convenient tool to engineer the non-equilibrium steady states beyond the single particle level. Applied to materials driven by light, the Ponderomotive potential is intimately related to the optical conductivity, which is enhanced close to resonances. We show that the Ponderomotive potential from the incident light may be used to induce exciton condensates in semiconductors, to generate attractive interactions leading to superconductivity in certain electron-phonon systems, and to create additional free energy minima in systems with charge/spin/excitonic orders. These effects are shown for realistic parameters such that they can be readily verified in ultrafast experiments.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.other cond-mat.supr-con quant-ph


title: Annotation-Free Group Robustness via Loss-Based Resampling

abstract: It is well-known that training neural networks for image classification with empirical risk minimization (ERM) makes them vulnerable to relying on spurious attributes instead of causal ones for prediction. Previously, deep feature re-weighting (DFR) has proposed retraining the last layer of a pre-trained network on balanced data concerning spurious attributes, making it robust to spurious correlation. However, spurious attribute annotations are not always available. In order to provide group robustness without such annotations, we propose a new method, called loss-based feature re-weighting (LFR), in which we infer a grouping of the data by evaluating an ERM-pre-trained model on a small left-out split of the training data. Then, a balanced number of samples is chosen by selecting high-loss samples from misclassified data points and low-loss samples from correctly-classified ones. Finally, we retrain the last layer on the selected balanced groups to make the model robust to spurious correlation. For a complete assessment, we evaluate LFR on various versions of Waterbirds and CelebA datasets with different spurious correlations, which is a novel technique for observing the model's performance in a wide range of spuriosity rates. While LFR is extremely fast and straightforward, it outperforms the previous methods that do not assume group label availability, as well as the DFR with group annotations provided, in cases of high spurious correlation in the training data.


title: Coordination Engineering in Zirconium-Nitrogen-Functionalized Materials for N2 Reduction: A First-Principles Simulation

abstract: Coordination engineering was employed to optimize the coordination environment of the Zr atom anchored on the porphyrins (PP). Five promising ZrPP-A candidates as electrocatalysts for nitrogen reduction reaction (NRR) were identified through a four-step screening strategy. First-principles calculations were utilized to evaluate the performance of the candidate electrocatalysts for NRR. A comprehensive search for reaction pathways revealed that NRR reactions with these selected catalysts tend to follow a hybrid pathway. It is found that orbital hybridization and charge transfer between Zr and its coordination atoms, as well as between ZrPP-A and the adsorbed N2 ensured the stability and high catalytic activity of these selected ZrPP-A. Zr plays a crucial role in coordinating charge transfer during the NRR process. Simultaneously, the coordinating atoms and the PP moiety jointly provide additional charge transfers to or from the adsorbate. An asymmetric coordination environment results in an asymmetric charge distribution of the substrate, causing the adsorbed polarized N2 molecule oriented toward the asymmetric charge aggregation region. Our work underscores the importance of considering not only the single-atom catalyst itself but also its coordination environment for the rational design of efficient catalysts.


title: Complex symmetry in the Fock space of several variables

abstract: In this paper we study the complex symmetry in the several variable Fock space by using the techniques of weighted composition operators and semigroups. We characterize unbounded weighted composition operators that are (real) complex symmetric with respect to a concrete conjugation. Using this characterization, we study complex symmetric semigroups and their generators. We realize such generators as first-order differential operators.


title: Driving Viscous Hydrodynamics in Bulk Electron Flow in Graphene Using Micromagnets

abstract: We consider the hydrodynamic flow of an electron fluid in a channel formed in a two-dimensional electron gas (2DEG) with no-slip boundary conditions. To generate vorticity in the fluid the flow is influenced by an array of micromagnets on the top of 2DEG. We analyse the viscous boundary layer and demonstrate anti-Poiseuille behaviour in this region. Furthermore we predict a longitudinal voltage modulation, where a periodic magnetic field generates a voltage term periodic in the direction of transport.From the experimental point of view we propose a method for a boundary-independent measurement of the viscosity of different electron fluids. The results are applicable to graphene away from the charge neutrality point and to semiconductors.


title: Bounding the amount of entanglement from witness operators

abstract: We present an approach to estimate the operational distinguishability between an entangled state and any separable state directly from measuring an entanglement witness. We show that this estimation also implies bounds on a variety of other well-known entanglement quantifiers. This approach for entanglement estimation is then extended to to both the measurement-device-independent scenario and the fully device-independent scenario, where we obtain non-trivial but sub-optimal bounds. The procedure requires no numerical optimization and is easy to compute. It offers ways for experimenters to not only detect, but also quantify, entanglement from the standard entanglement witness procedure.


title: Quantifying the effectiveness of linear preconditioning in Markov chain Monte Carlo

abstract: Linear transformation of the state variable (linear preconditioning) is a common technique that often drastically improves the practical performance of a Markov chain Monte Carlo algorithm. Despite this, however, the benefits of linear preconditioning are not well-studied theoretically, and rigorous guidelines for choosing preconditioners are not always readily available. Mixing time bounds for various samplers have been produced in recent works for the class of strongly log-concave and Lipschitz target distributions and depend strongly on a quantity known as the condition number. We study linear preconditioning for this class of distributions, and under appropriate assumptions we provide bounds on the condition number after using a given linear preconditioner. We provide bounds on the spectral gap of RWM that are tight in their dependence on the condition number under the same assumptions. Finally we offer a review and analysis of popular preconditioners. Of particular note, we identify a surprising case in which preconditioning with the diagonal of the target covariance can actually make the condition number \emph{increase} relative to doing no preconditioning at all.


title: Morphology of Galaxies in JWST Fields: Initial Distribution and Evolution of Galaxy Morphology

abstract: A recent study from the Horizon Run (HR5) cosmological simulation has predicted that galaxies with ${\rm log}~M_{\ast}/M_{\odot}\lesssim 10$ in the cosmic morning ($10\gtrsim z\gtrsim 4$) dominantly have disk-like morphology in the $\Lambda$CDM universe, which is driven by the tidal torque in the initial matter fluctuations. For a direct comparison with observation, we identify a total of about $19,000$ James Webb Space Telescope (JWST) galaxies with ${\rm log}~M_{\ast}/M_{\odot}>9$ at $z=0.6-8.0$ utilizing deep JWST/NIRCam images of publicly released fields, including NEP-TDF, NGDEEP, CEERS, COSMOS, UDS, and SMACS J0723$-$7327. We estimate their stellar masses and photometric redshifts with the redshift dispersion of $\sigma_{\rm NMAD}=0.009$ and outlier fraction of only about $6\%$. We classify galaxies into three morphological types, `disks', `spheroids', and `irregulars', applying the same criteria used in the HR5 study. The morphological distribution of the JWST galaxies shows that disk galaxies account for $60-70\%$ at all redshift ranges. However, in the high-mass regime (${\rm log}~M_{\ast}/M_{\odot}\gtrsim11$), spheroidal morphology becomes the dominant type. This implies that mass growth of galaxies is accompanied with morphological transition from disks to spheroids. The fraction of irregulars is about 20\% or less at all mass and redshifts. All the trends in the morphology distribution are consistently found in the six JWST fields. These results are in close agreement with the results from the HR5 simulation, particularly confirming the prevalence of disk galaxies at small masses in the cosmic morning and noon.


title: Graph for Science: From API based Programming to Graph Engine based Programming for HPC

abstract: Modern scientific applications predominantly run on large-scale computing platforms, necessitating collaboration between scientific domain experts and high-performance computing (HPC) experts. While domain experts are often skilled in customizing domain-specific scientific computing routines, which often involves various matrix computations, HPC experts are essential for achieving efficient execution of these computations on large-scale platforms. This process often involves utilizing complex parallel computing libraries tailored to specific matrix computation scenarios. However, the intricate programming procedure and the need for deep understanding in both application domains and HPC poses significant challenges to the widespread adoption of scientific computing. In this research, we observe that matrix computations can be transformed into equivalent graph representations, and that by utilizing graph processing engines, HPC experts can be freed from the burden of implementing efficient scientific computations. Based on this observation, we introduce a graph engine-based scientific computing (Graph for Science) paradigm, which provides a unified graph programming interface, enabling domain experts to promptly implement various types of matrix computations. The proposed paradigm leverages the underlying graph processing engine to achieve efficient execution, eliminating the needs for HPC expertise in programming large-scale scientific applications. Our results show that the graph engine-based scientific computing paradigm achieves performance comparable to the best-performing implementations based on existing parallel computing libraries and bespoke implementations. Importantly, the paradigm greatly simplifies the development of scientific computations on large-scale platforms, reducing the programming difficulty for scientists and facilitating broader adoption of scientific computing.


title: Modeling binary collision of evaporating drops

abstract: We investigate the interactions between two drops in a heated environment and analyze the effect of evaporation on bouncing, coalescence and reflexive separation phenomena. A reliable mass transfer model is incorporated in a coupled level-set and volume-of-fluid framework to accurately model the evaporation process and the evolution of drop interfaces during the interactions. The numerical technique is extensively validated against the benchmark problems involving the evaporation of a single drop. We analyze the contour plots of temperature and vapor mass fraction fields for each collision outcome. Our numerical simulations reveal that vapor entrapment during the separation process, with high-velocity vapor manages to escape. Increasing evaporation rates result in slower post-collision drop separation. Furthermore, the differences in kinetic energy and surface energy are analyzed for different Stefan numbers. The coalescence of drops exhibits energy oscillations until dissipation, while the bouncing and reflexive separations lack such oscillations. In the reflexive separation regime, the kinetic energy of the drops becomes zero after detachment.


title: BELT: Old-School Backdoor Attacks can Evade the State-of-the-Art Defense with Backdoor Exclusivity Lifting

abstract: Deep neural networks (DNNs) are susceptible to backdoor attacks, where malicious functionality is embedded to allow attackers to trigger incorrect classifications. Old-school backdoor attacks use strong trigger features that can easily be learned by victim models. Despite robustness against input variation, the robustness however increases the likelihood of unintentional trigger activations. This leaves traces to existing defenses, which find approximate replacements for the original triggers that can activate the backdoor without being identical to the original trigger via, e.g., reverse engineering and sample overlay. In this paper, we propose and investigate a new characteristic of backdoor attacks, namely, backdoor exclusivity, which measures the ability of backdoor triggers to remain effective in the presence of input variation. Building upon the concept of backdoor exclusivity, we propose Backdoor Exclusivity LifTing (BELT), a novel technique which suppresses the association between the backdoor and fuzzy triggers to enhance backdoor exclusivity for defense evasion. Extensive evaluation on three popular backdoor benchmarks validate, our approach substantially enhances the stealthiness of four old-school backdoor attacks, which, after backdoor exclusivity lifting, is able to evade seven state-of-the-art backdoor countermeasures, at almost no cost of the attack success rate and normal utility. For example, one of the earliest backdoor attacks BadNet, enhanced by BELT, evades most of the state-of-the-art defenses including ABS and MOTH which would otherwise recognize the backdoored model.


title: Differential privacy statistical inference for a directed graph network model with covariates

abstract: The real network has two characteristics: heterogeneity and homogeneity. A directed network model with covariates is proposed to analyze these two features, and the asymptotic theory of parameter Maximum likelihood estimators(MLEs) is established. However, in many practical cases, network data often carries a lot of sensitive information. How to achieve the trade-off between privacy and utility has become an important issue in network data analysis. In this paper, we study a directed $\beta$-model with covariates under differential privacy mechanism. It includes $2n$-dimensional node degree parameters $\boldsymbol{\theta}$ and a $p$-dimensional homogeneity parameter $\boldsymbol{\gamma}$ that describes the covariate effect. We use the discrete Laplace mechanism to release noise for the bi-degree sequences. Based on moment equations, we estimate the parameters of both degree heterogeneity and homogeneity in the model, and derive the consistency and asymptotic normality of the differentially private estimators as the number of nodes tends to infinity. Numerical simulations and case studies are provided to demonstrate the validity of our theoretical results.


title: Inhomogeneous condensation in the Gross-Neveu model in noninteger spatial dimensions $1 \leq d < 3$. II. Nonzero temperature and chemical potential

abstract: We continue previous investigations of the (inhomogeneous) phase structure of the Gross-Neveu model in a noninteger number of spatial dimensions ($1 \leq d < 3$) in the limit of an infinite number of fermion species ($N \to \infty$) at (non)zero chemical potential $\mu$. In this work, we extend the analysis from zero to nonzero temperature $T$. The phase diagram of the Gross-Neveu model in $1 \leq d < 3$ spatial dimensions is well known under the assumption of spatially homogeneous condensation with both a symmetry broken and a symmetric phase present for all spatial dimensions. In $d = 1$ one additionally finds an inhomogeneous phase, where the order parameter, the condensate, is varying in space. Similarly, phases of spatially varying condensates are also found in the Gross-Neveu model in $d = 2$ and $d = 3$, as long as the theory is not fully renormalized, i.e., in the presence of a regulator. For $d = 2$, one observes that the inhomogeneous phase vanishes, when the regulator is properly removed (which is not possible for $d = 3$ without introducing additional parameters). In the present work, we use the stability analysis of the symmetric phase to study the presence (for $1 \leq d < 2$) and absence (for $2 \leq d < 3$) of these inhomogeneous phases and the related moat regimes in the fully renormalized Gross-Neveu model in the $\mu, T$-plane. We also discuss the relation between "the number of spatial dimensions" and "studying the model with a finite regulator" as well as the possible consequences for the limit $d \to 3$.


title: Two-Timescale Q-Learning with Function Approximation in Zero-Sum Stochastic Games

abstract: We consider two-player zero-sum stochastic games and propose a two-timescale $Q$-learning algorithm with function approximation that is payoff-based, convergent, rational, and symmetric between the two players. In two-timescale $Q$-learning, the fast-timescale iterates are updated in spirit to the stochastic gradient descent and the slow-timescale iterates (which we use to compute the policies) are updated by taking a convex combination between its previous iterate and the latest fast-timescale iterate. Introducing the slow timescale as well as its update equation marks as our main algorithmic novelty. In the special case of linear function approximation, we establish, to the best of our knowledge, the first last-iterate finite-sample bound for payoff-based independent learning dynamics of these types. The result implies a polynomial sample complexity to find a Nash equilibrium in such stochastic games. To establish the results, we model our proposed algorithm as a two-timescale stochastic approximation and derive the finite-sample bound through a Lyapunov-based approach. The key novelty lies in constructing a valid Lyapunov function to capture the evolution of the slow-timescale iterates. Specifically, through a change of variable, we show that the update equation of the slow-timescale iterates resembles the classical smoothed best-response dynamics, where the regularized Nash gap serves as a valid Lyapunov function. This insight enables us to construct a valid Lyapunov function via a generalized variant of the Moreau envelope of the regularized Nash gap. The construction of our Lyapunov function might be of broad independent interest in studying the behavior of stochastic approximation algorithms.


title: Ophtha-LLaMA2: A Large Language Model for Ophthalmology

abstract: In recent years, pre-trained large language models (LLMs) have achieved tremendous success in the field of Natural Language Processing (NLP). Prior studies have primarily focused on general and generic domains, with relatively less research on specialized LLMs in the medical field. The specialization and high accuracy requirements for diagnosis in the medical field, as well as the challenges in collecting large-scale data, have constrained the application and development of LLMs in medical scenarios. In the field of ophthalmology, clinical diagnosis mainly relies on doctors' interpretation of reports and making diagnostic decisions. In order to take advantage of LLMs to provide decision support for doctors, we collected three modalities of ophthalmic report data and fine-tuned the LLaMA2 model, successfully constructing an LLM termed the "Ophtha-LLaMA2" specifically tailored for ophthalmic disease diagnosis. Inference test results show that even with a smaller fine-tuning dataset, Ophtha-LLaMA2 performs significantly better in ophthalmic diagnosis compared to other LLMs. It demonstrates that the Ophtha-LLaMA2 exhibits satisfying accuracy and efficiency in ophthalmic disease diagnosis, making it a valuable tool for ophthalmologists to provide improved diagnostic support for patients. This research provides a useful reference for the application of LLMs in the field of ophthalmology, while showcasing the immense potential and prospects in this domain.


title: New 511 keV line data provides strongest sub-GeV dark matter constraints

abstract: We explore the $511$~keV emission associated to sub-GeV dark matter (DM) particles that can produce electron-positron pairs and form positronium after thermalizing. We use $\sim16$~yr of SPI data from INTEGRAL to constrain DM properties, considering the full positron propagation and losses, and the free electron density drop away from the Galactic plane. We show that the predicted longitude and latitude profiles vary significantly for different DM masses, unlike previous assumptions, and obtain the strongest limits on sub-GeV DM (from the MeV to a few GeV) so far, excluding cross-sections down to $\langle \sigma v \rangle \lesssim10^{-32}$ cm$^3$ s$^{-1}$ for $m_{\chi}\sim1\,\text{MeV}$ and $\langle \sigma v \rangle \lesssim10^{-26}$ cm$^3$ s$^{-1} $ for $m_{\chi}\sim5\,\text{GeV}$ and lifetimes up to $\tau \gtrsim 10^{29}\, \textrm{s} \, (m_{\chi}\sim1\,\text{MeV}) $ and $\tau \gtrsim 10^{27}\,\textrm{s}$ ($m_{\chi}\sim5$~GeV) for the typical Navarro-Frenk-White DM profile. Our derived limits are robust within a factor of a few due to systematic uncertainties.


title: Pilot tone-guided focused navigation for free-breathing whole-liver fat-water and T2* quantification

abstract: Purpose To achieve whole-liver motion-corrected fat fraction (FF) and R2* quantification with a 3-minute free-breathing (FB) 3D radial isotropic acquisition, for increased organ coverage, ease-of-use, and patient comfort. Methods A FB 3D radial multiecho gradient-echo liver acquisition with integrated Pilot Tone (PT) navigation and NTE=8 echoes was reconstructed with a motion-correction algorithm based on focused navigation and guided by PT signals (PT-fNAV), with and without a denoising step. Fat fraction (FF) and R2* quantification using a graph cut algorithm was performed on the motion-corrected whole-liver multiecho volumes. Volunteer experiments (n=10) at 1.5T included reference 3D and 2D Cartesian breath-hold (BH) acquisitions. Image sharpness was assessed to evaluate the quality of motion correction with PT-fNAV, compared to a motion-resolved reconstruction. Fat-water images and parametric maps were compared to BH reference acquisitions following Cartesian trajectories, and to a routinely used clinical software (MRQuantiF). Results The image sharpness provided by PT-fNAV (with and without denoising) was similar in end-expiratory motion-resolved reconstructions. The 3D radial FB FF maps compared well with reference BH 3D Cartesian maps (bias +0.7%, limits of agreement (LOA) [-2.5; 4.0]%) and with 2D quantification with MRQuantiF (-0.2%, LOA [-1.1; 0.6]%). While expected visual deviations between proposed FB and reference BH R2* maps were observed, no significant differences were found in quantitative analyses. Conclusion A 3D radial technique with retrospective motion correction by PT-fNAV enabled FF and R2* quantification of the whole-liver at 1.5T. The FB whole-liver acquisition at isotropic spatial resolution compared in accuracy with BH techniques, enabling 3D assessment of steatosis in individuals with limited respiratory capabilities.


title: Dynamics of electronic phase separation at the laser-induced insulator-metal transition in (La$_{0.6}$Pr$_{0.4}$)$_{0.7}$Ca$_{0.3}$MnO$_3$

abstract: Ultrafast optical excitations allow creating new metastable and hidden states in quantum materials. However, the fundamental material properties required to support new emergent order are largely unknown. Here we show for two colossal magnetoresistive (CMR) manganites that electronic phase separation (EPS) strongly favors non-thermal behavior and exploit this to stabilize an optically-induced conducting state. Our results shed light on the role of EPS in optical control of CMR manganites and provide guidance for the design of materials that can exhibit non-equilibrium states of matter.


title: Field tests on a full-scale steel chimney subjected to vortex-induced vibrations

abstract: Industrial chimneys, launch vehicles and stacks are examples of large diameter circular cross section structures which can be prone to cross-wind vortex-induced vibrations. VIV has been extensively studied for both fundamental and applied issues, but few documented studies concern high Reynolds number regime (over 500 000) in atmospheric turbulent wind. This paper introduces a field test on a slender light and low damped chimney designed to experience supercritical VIV at moderate wind velocity. The chimney was recently erected in a wind monitored field, near the Atlantic coast of France. The purpose of this paper is to present the first vibration results obtained during a sequential 13 days period in September 2020. A statistical analysis has been performed on the amplitude and dominant frequency responses and results are reported in term of probability distribution as a function of wind speed and direction. VIV events of low (under 15 % of diameter) to moderate amplitude (over 30 % of diameter) have been highlighted in a range of wind velocity 25 % lower than expected, along with significant influence of the wind direction. Low turbulent easterly wind giving vortex induced vibrations with the highest amplitude.


title: Collinear datasets augmentation using Procrustes validation sets

abstract: In this paper, we propose a new method for the augmentation of numeric and mixed datasets. The method generates additional data points by utilizing cross-validation resampling and latent variable modeling. It is particularly efficient for datasets with moderate to high degrees of collinearity, as it directly utilizes this property for generation. The method is simple, fast, and has very few parameters, which, as shown in the paper, do not require specific tuning. It has been tested on several real datasets; here, we report detailed results for two cases, prediction of protein in minced meat based on near infrared spectra (fully numeric data with high degree of collinearity) and discrimination of patients referred for coronary angiography (mixed data, with both numeric and categorical variables, and moderate collinearity). In both cases, artificial neural networks were employed for developing the regression and the discrimination models. The results show a clear improvement in the performance of the models; thus for the prediction of meat protein, fitting the model to the augmented data resulted in a reduction in the root mean squared error computed for the independent test set by 1.5 to 3 times.


title: Improved description of nuclear charge radii: Global trends beyond $N=28$ shell closure

abstract: Charge radii measured with high accuracy provide a stringent benchmark for characterizing nuclear structure phenomena. In this work, the systematic evolution of charge radii for nuclei with $Z=19$-$29$ is investigated through relativistic mean field theory with effective forces NL3, PK1, and NL3$^{*}$. The neutron-proton ($np$) correlation around Fermi surface originated from the unpaired neutron and proton has been taken into account tentatively in order to reduce the overestimated odd-even staggering of charge radii. This improved method can give an available description of charge radii across $N=28$ shell closure. A remarkable observation is that the charge radii beyond $N=28$ shell closure follow the similarly steep increasing trend, namely irrespective of the number of protons in the nucleus. Especially, the latest results of charge radii for nickel and copper isotopes can be reproduced remarkably well. Along $N=28$ isotonic chain, the sudden increase of charge radii is weakened across $Z=20$, but presented evidently across $Z=28$ closed shell. The abrupt changes of charge radii across $Z=22$ are also shown along $N=32$ and $34$ isotones, but the latter with a less slope. This seems to provide a sensitive indicator to identify the new magicity of a nucleus with universal trend of charge radii.


title: SA-Attack: Improving Adversarial Transferability of Vision-Language Pre-training Models via Self-Augmentation

abstract: Current Visual-Language Pre-training (VLP) models are vulnerable to adversarial examples. These adversarial examples present substantial security risks to VLP models, as they can leverage inherent weaknesses in the models, resulting in incorrect predictions. In contrast to white-box adversarial attacks, transfer attacks (where the adversary crafts adversarial examples on a white-box model to fool another black-box model) are more reflective of real-world scenarios, thus making them more meaningful for research. By summarizing and analyzing existing research, we identified two factors that can influence the efficacy of transfer attacks on VLP models: inter-modal interaction and data diversity. Based on these insights, we propose a self-augment-based transfer attack method, termed SA-Attack. Specifically, during the generation of adversarial images and adversarial texts, we apply different data augmentation methods to the image modality and text modality, respectively, with the aim of improving the adversarial transferability of the generated adversarial images and texts. Experiments conducted on the FLickr30K and COCO datasets have validated the effectiveness of our method. Our code will be available after this paper is accepted.


title: JWST detection of extremely excited outflowing CO and H2O in VV 114 E SW: a possible rapidly accreting IMBH

abstract: Mid-infrared (mid-IR) gas-phase molecular bands are powerful diagnostics of the warm interstellar medium. We report the James Webb Space Telescope detection of the CO v=1-0 (4.4-5.0 um) and H2O nu2=1-0 (5.0-7.8um) ro-vibrational bands, both in absorption, toward the ``s2'' core in the southwest nucleus of the merging galaxy VV 114 E. All ro-vibrational CO lines up to J_low=33 (E_low~3000 K) are detected, as well as a forest of H2O lines up to 13_{0,13} (E_low~2600 K). The highest-excitation lines are blueshifted by ~180 km s^{-1} relative to the extended molecular cloud, which is traced by the rotational CO J=3-2 346 GHz line observed with the Atacama Large Millimeter/submillimeter Array. The bands also show absorption in a low-velocity component (blueshifted by ~30 km s^{-1}) with lower excitation. The analysis shows that the bands are observed against a continuum with effective temperature of T_bck~550 K extinguished with tau_6um^ext~ 2.5-3 (A_k~6.9-8.3 mag). The high-excitation CO and H2O lines are consistent with v=0 thermalization with T_rot~450 K and column densities of N_CO~(1.7-3.5)x10^{19} cm^{-2} and N_H2O~(1.5-3.0)x10^{19} cm$^{-2}$. Thermalization of the v=0 levels of H2O requires either an extreme density of n_H2>~10^9 cm^{-3}, or radiative excitation by the mid-IR field in a very compact (<1 pc) optically thick source emitting ~10^{10} L_sun. The latter alternative is favored, implying that the observed absorption probes the very early stages of a fully enshrouded active black hole (BH). On the basis of a simple model for BH growth and applying a lifetime constraint to the s2 core, an intermediate-mass BH (IMBH, M_BH~4.5x10^4 M_sun) accreting at super-Eddington rates is suggested, where the observed feedback has not yet been able to break through the natal cocoon.


title: Engineering synthetic gauge fields through the coupling phases in cavity magnonics

abstract: Cavity magnonics, which studies the interaction of light with magnetic systems in a cavity, is a promising platform for quantum transducers and quantum memories. At microwave frequencies, the coupling between a cavity photon and a magnon, the quasi-particle of a spin wave excitation, is a consequence of the Zeeman interaction between the cavity's magnetic field and the magnet's macroscopic spin. For each photon/magnon interaction, a coupling phase factor exists, but is often neglected in simple systems. However, in "loop-coupled" systems, where there are at least as many couplings as modes, the coupling phases become relevant for the physics and lead to synthetic gauge fields. We present experimental evidence of the existence of such coupling phases by considering two spheres made of Yttrium-Iron-Garnet and two different re-entrant cavities. We predict numerically the values of the coupling phases, and we find good agreement between theory and the experimental data. These results show that in cavity magnonics, one can engineer synthetic gauge fields, which can be useful for cavity-mediated coupling and engineering dark mode physics.


title: EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism

abstract: We present EE-LLM, a framework for large-scale training and inference of early-exit large language models (LLMs). While recent works have shown preliminary evidence for the efficacy of early exiting in accelerating LLM inference, EE-LLM makes a foundational step towards scaling up early-exit LLMs by supporting their training and inference with massive 3D parallelism. Built upon Megatron-LM, EE-LLM implements a variety of algorithmic innovations and performance optimizations tailored to early exiting, including a lightweight method that facilitates backpropagation for the early-exit training objective with pipeline parallelism, techniques of leveraging idle resources in the original pipeline schedule for computation related to early-exit layers, and two approaches of early-exit inference that are compatible with KV caching for autoregressive generation. Our analytical and empirical study shows that EE-LLM achieves great training efficiency with negligible computational overhead compared to standard LLM training, as well as outstanding inference speedup without compromising output quality. To facilitate further research and adoption, we release EE-LLM at https://github.com/pan-x-c/EE-LLM.


title: Operationalizing Assurance Cases for Data Scientists: A Showcase of Concepts and Tooling in the Context of Test Data Quality for Machine Learning

abstract: Assurance Cases (ACs) are an established approach in safety engineering to argue quality claims in a structured way. In the context of quality assurance for Machine Learning (ML)-based software components, ACs are also being discussed and appear promising. Tools for operationalizing ACs do exist, yet mainly focus on supporting safety engineers on the system level. However, assuring the quality of an ML component within the system is commonly the responsibility of data scientists, who are usually less familiar with these tools. To address this gap, we propose a framework to support the operationalization of ACs for ML components based on technologies that data scientists use on a daily basis: Python and Jupyter Notebook. Our aim is to make the process of creating ML-related evidence in ACs more effective. Results from the application of the framework, documented through notebooks, can be integrated into existing AC tools. We illustrate the application of the framework on an example excerpt concerned with the quality of the test data.


title: Pruning Convolutional Filters via Reinforcement Learning with Entropy Minimization

abstract: Structural pruning has become an integral part of neural network optimization, used to achieve architectural configurations which can be deployed and run more efficiently on embedded devices. Previous results showed that pruning is possible with minimum performance loss by utilizing a reinforcement learning agent which makes decisions about the sparsity level of each neural layer by maximizing as a reward the accuracy of the network. We introduce a novel information-theoretic reward function which minimizes the spatial entropy of convolutional activations. This minimization ultimately acts as a proxy for maintaining accuracy, although these two criteria are not related in any way. Our method shows that there is another possibility to preserve accuracy without the need to directly optimize it in the agent's reward function. In our experiments, we were able to reduce the total number of FLOPS of multiple popular neural network architectures by 5-10x, incurring minimal or no performance drop and being on par with the solution found by maximizing the accuracy.