title: Presolar stardust in asteroid Ryugu

abstract: We have conducted a NanoSIMS-based search for presolar material in samples recently returned from C-type asteroid Ryugu as part of JAXA's Hayabusa2 mission. We report the detection of all major presolar grain types with O- and C-anomalous isotopic compositions typically identified in carbonaceous chondrite meteorites: 1 silicate, 1 oxide, 1 O-anomalous supernova grain of ambiguous phase, 38 SiC, and 16 carbonaceous grains. At least two of the carbonaceous grains are presolar graphites, whereas several grains with moderate C isotopic anomalies are probably organics. The presolar silicate was located in a clast with a less altered lithology than the typical extensively aqueously altered Ryugu matrix. The matrix-normalized presolar grain abundances in Ryugu are 4.8$^{+4.7}_{-2.6}$ ppm for O-anomalous grains, 25$^{+6}_{-5}$ ppm for SiC grains and 11$^{+5}_{-3}$ ppm for carbonaceous grains. Ryugu is isotopically and petrologically similar to carbonaceous Ivuna-type (CI) chondrites. To compare the in situ presolar grain abundances of Ryugu with CI chondrites, we also mapped Ivuna and Orgueil samples and found a total of SiC grains and 6 carbonaceous grains. No O-anomalous grains were detected. The matrix-normalized presolar grain abundances in the CI chondrites are similar to those in Ryugu: 23 $^{+7}_{-6}$ ppm SiC and 9.0$^{+5.3}_{-4.6}$ ppm carbonaceous grains. Thus, our results provide further evidence in support of the Ryugu-CI connection. They also reveal intriguing hints of small-scale heterogeneities in the Ryugu samples, such as locally distinct degrees of alteration that allowed the preservation of delicate presolar material.


title: Towards the simulation of transition-metal oxides of the cathode battery materials using VQE methods

abstract: Variational quantum eigensolver (VQE) is a hybrid quantum-classical technique that leverages noisy intermediate scale quantum (NISQ) hardware to obtain the minimum eigenvalue of a model Hamiltonian. VQE has so far been used to simulate condensed matter systems as well as quantum chemistry of small molecules. In this work, we employ VQE methods to obtain the ground-state energy of LiCoO$_2$, a candidate transition metal oxide used for battery cathodes. We simulate Li$_2$Co$_2$O$_4$ and Co$_2$O$_4$ gas-phase models, which represent the lithiated and delithiated states during the discharge and the charge of the Li-ion battery, respectively. Computations are performed using a statevector simulator with a single reference state for three different trial wavefunctions: unitary coupled-cluster singles and doubles (UCCSD), unitary coupled-cluster generalized singles and doubles (UCCGSD) and k-unitary pair coupled-cluster generalized singles and doubles (k-UpCCGSD). The resources in terms of circuit depth, two-qubit entangling gates and wavefunction parameters are analyzed. We find that the k-UpCCGSD with k=5 produces results similar to UCCSD but at a lower cost. Finally, the performance of VQE methods is benchmarked against the classical wavefunction-based methods, such as coupled-cluster singles and doubles (CCSD) and complete active space configuration interaction (CASCI). Our results show that VQE methods quantitatively agree with the results obtained from CCSD. However, the comparison against the CASCI results clearly suggests that advanced trial wavefunctions are likely necessary to capture the multi-reference characteristics as well as the correlations emerging from high-level electronic excitations.

categories: quant-ph physics.atm-clus physics.chem-ph physics.comp-ph


title: Enhancing Heterogeneous Federated Learning with Knowledge Extraction and Multi-Model Fusion

abstract: Concerned with user data privacy, this paper presents a new federated learning (FL) method that trains machine learning models on edge devices without accessing sensitive data. Traditional FL methods, although privacy-protective, fail to manage model heterogeneity and incur high communication costs due to their reliance on aggregation methods. To address this limitation, we propose a resource-aware FL method that aggregates local knowledge from edge models and distills it into robust global knowledge through knowledge distillation. This method allows efficient multi-model knowledge fusion and the deployment of resource-aware models while preserving model heterogeneity. Our method improves communication cost and performance in heterogeneous data and models compared to existing FL algorithms. Notably, it reduces the communication cost of ResNet-32 by up to 50\% and VGG-11 by up to 10$\times$ while delivering superior performance.


title: Transceiver designs to attain the entanglement assisted communications capacity

abstract: Pre-shared entanglement can significantly boost communication rates in the high thermal noise and low-brightness transmitter regime. In this regime, for a lossy-bosonic channel with additive thermal noise, the ratio between the entanglement-assisted capacity and the Holevo capacity - the maximum reliable-communications rate permitted by quantum mechanics without any pre-shared entanglement - scales as $\log(1/{\bar N}_{\rm S})$, where the mean transmitted photon number per mode, ${\bar N}_{\rm S} \ll 1$. Thus, pre-shared entanglement, e.g., distributed by the quantum internet or a satellite-assisted quantum link, promises to significantly improve low-power radio-frequency communications. In this paper, we propose a pair of structured quantum transceiver designs that leverage continuous-variable pre-shared entanglement generated, e.g., from a down-conversion source, binary phase modulation, and non-Gaussian joint detection over a code word block, to achieve this scaling law of capacity enhancement. Further, we describe a modification to the aforesaid receiver using a front-end that uses sum-frequency generation sandwiched with dynamically-programmable in-line two-mode squeezers, and a receiver back-end that takes full advantage of the output of the receiver's front-end by employing a non-destructive multimode vacuum-or-not measurement to achieve the entanglement-assisted classical communications capacity.


title: Black hole spectroscopy: prospects for testing the nature of black holes with gravitational wave observations

abstract: Gravitational waves provide direct information about the nature of spacetime and the existence of black holes. The remnant of a binary black hole merger emits gravitational waves in the form of quasinormal modes, whose spectrum is known as the "fingerprints" of a black hole, as it depends only on the properties of the remnant. The quasinormal modes can be used to test how closely an astrophysical black hole matches the Kerr geometry. Each mode is parameterized by three indices: the harmonic numbers $(\ell, m)$ and the overtone index $n$, that labels the fundamental mode ($n = 0$) and the overtones ($n = 1,2,3,\ldots$). Black hole spectroscopy is the proposal to use the detection of multiple quasinormal modes to test the no-hair theorem. In this work, we investigate the prospects for performing black hole spectroscopy. The $(2,2,0)$ is the dominant mode, and we analyze the contribution of the most relevant subdominant modes in numerical relativity simulations. We show that the overtone mode $(2,2,1)$ has an amplitude higher or comparable to the amplitude of the most relevant higher harmonic modes. For current and future gravitational wave detectors, we compute the black hole spectroscopy horizon, which is the maximum distance of an event up to which two or more quasinormal modes can be detected. For low mass ratio binaries, the secondary and tertiary modes are the $(2,2,1)$ and $(3,3,0)$, respectively, and, for the large mass ratio case, the $(3,3,0)$ and $(4,4,0)$ are the most relevant subdominant modes for detection. Our work indicates promising prospects for the detection of subdominant modes with future gravitational wave detectors. The event rate for LIGO is much smaller, but not prohibitively so.


title: Tiny-HR: Towards an interpretable machine learning pipeline for heart rate estimation on edge devices

abstract: The focus of this paper is a proof of concept, machine learning (ML) pipeline that extracts heart rate from pressure sensor data acquired on low-power edge devices. The ML pipeline consists an upsampler neural network, a signal quality classifier, and a 1D-convolutional neural network optimized for efficient and accurate heart rate estimation. The models were designed so the pipeline was less than 40 kB. Further, a hybrid pipeline consisting of the upsampler and classifier, followed by a peak detection algorithm was developed. The pipelines were deployed on ESP32 edge device and benchmarked against signal processing to determine the energy usage, and inference times. The results indicate that the proposed ML and hybrid pipeline reduces energy and time per inference by 82% and 28% compared to traditional algorithms. The main trade-off for ML pipeline was accuracy, with a mean absolute error (MAE) of 3.28, compared to 2.39 and 1.17 for the hybrid and signal processing pipelines. The ML models thus show promise for deployment in energy and computationally constrained devices. Further, the lower sampling rate and computational requirements for the ML pipeline could enable custom hardware solutions to reduce the cost and energy needs of wearable devices.


title: MosaicSets: Embedding Set Systems into Grid Graphs

abstract: Visualizing sets of elements and their relations is an important research area in information visualization. In this paper, we present MosaicSets: a novel approach to create Euler-like diagrams from non-spatial set systems such that each element occupies one cell of a regular hexagonal or square grid. The main challenge is to find an assignment of the elements to the grid cells such that each set constitutes a contiguous region. As use case, we consider the research groups of a university faculty as elements, and the departments and joint research projects as sets. We aim at finding a suitable mapping between the research groups and the grid cells such that the department structure forms a base map layout. Our objectives are to optimize both the compactness of the entirety of all cells and of each set by itself. We show that computing the mapping is NP-hard. However, using integer linear programming we can solve real-world instances optimally within a few seconds. Moreover, we propose a relaxation of the contiguity requirement to visualize otherwise non-embeddable set systems. We present and discuss different rendering styles for the set overlays. Based on a case study with real-world data, our evaluation comprises quantitative measures as well as expert interviews.


title: Necessary and sufficient conditions for exact closures of epidemic equations on configuration model networks

abstract: We prove that the exact closure of SIR pairwise epidemic equations on a configuration model network is possible if and only if the degree distribution is Poisson, Binomial, or Negative Binomial. The proof relies on establishing, for these specific degree distributions, the equivalence of the closed pairwise model and the so-called dynamical survival analysis (DSA) edge-based model which was previously shown to be exact. Indeed, as we show here, the DSA model is equivalent to the well-known edge-based Volz model. We use this result to provide reductions of the closed pairwise and Volz models to the same single equation involving only susceptibles, which has a useful statistical interpretation in terms of the times to infection. We illustrate our findings with some numerical examples.


title: Private Estimation with Public Data

abstract: We initiate the study of differentially private (DP) estimation with access to a small amount of public data. For private estimation of d-dimensional Gaussians, we assume that the public data comes from a Gaussian that may have vanishing similarity in total variation distance with the underlying Gaussian of the private data. We show that under the constraints of pure or concentrated DP, d+1 public data samples are sufficient to remove any dependence on the range parameters of the private data distribution from the private sample complexity, which is known to be otherwise necessary without public data. For separated Gaussian mixtures, we assume that the underlying public and private distributions are the same, and we consider two settings: (1) when given a dimension-independent amount of public data, the private sample complexity can be improved polynomially in terms of the number of mixture components, and any dependence on the range parameters of the distribution can be removed in the approximate DP case; (2) when given an amount of public data linear in the dimension, the private sample complexity can be made independent of range parameters even under concentrated DP, and additional improvements can be made to the overall sample complexity.


title: Federated Multi-Discriminator BiWGAN-GP based Collaborative Anomaly Detection for Virtualized Network Slicing

abstract: Virtualized network slicing allows a multitude of logical networks to be created on a common substrate infrastructure to support diverse services. A virtualized network slice is a logical combination of multiple virtual network functions, which run on virtual machines (VMs) as software applications by virtualization techniques. As the performance of network slices hinges on the normal running of VMs, detecting and analyzing anomalies in VMs are critical. Based on the three-tier management framework of virtualized network slicing, we first develop a federated learning (FL) based three-tier distributed VM anomaly detection framework, which enables distributed network slice managers to collaboratively train a global VM anomaly detection model while keeping metrics data locally. The high-dimensional, imbalanced, and distributed data features in virtualized network slicing scenarios invalidate the existing anomaly detection models. Considering the powerful ability of generative adversarial network (GAN) in capturing the distribution from complex data, we design a new multi-discriminator Bidirectional Wasserstein GAN with Gradient Penalty (BiWGAN-GP) model to learn the normal data distribution from high-dimensional resource metrics datasets that are spread on multiple VM monitors. The multi-discriminator BiWGAN-GP model can be trained over distributed data sources, which avoids high communication and computation overhead caused by the centralized collection and processing of local data. We define an anomaly score as the discriminant criterion to quantify the deviation of new metrics data from the learned normal distribution to detect abnormal behaviors arising in VMs. The efficiency and effectiveness of the proposed collaborative anomaly detection algorithm are validated through extensive experimental evaluation on a real-world dataset.


title: Vehicle Electrification Solutions: review and open challenges

abstract: An Electric Vehicle usually refers to any vehicle that is partially or fully powered by a battery that can be directly plugged into the mains. Therefore, the new vehicles provide various benefits, including convenience, efficiency, sustainability, and economy. The present study concerns a comprehensive review of vehicle electrification solutions. Indeed, the major electric vehicle technologies are presented. Moreover, based on several research works from the literature, the main electrification solutions are illustrated, including degree of electrification, battery system management, onboard chargers, and power converters. In addition, these solutions, as well as the open challenges, are discussed and evaluated.


title: Why Ortho- and Para-Hydroxy Metabolites Can Scavenge Free Radicals that the Parent Atorvastatin Cannot? Important Pharmacologic Insight from Quantum Chemistry

abstract: The pharmaceutical success of atorvastatin (ATV), a widely employed drug against the "bad" cholesterol (LDL) and cardiovascular diseases, traces back to its ability to scavenge free radicals. Unfortunately, information on its antioxidant properties is missing or unreliable. Here, we report detailed quantum chemical results for ATV and its ortho- and para-hydroxy metabolites (o-ATV, p-ATV) in the methanolic phase. They comprise global reactivity indices, bond order indices, and spin densities as well as all relevant enthalpies of reaction (bond dissociation BDE, ionization IP and electron attachment EA, proton detachment PDE and proton affinity PA, and electron transfer ETE). With these properties in hand, we can provide the first theoretical explanation of the experimental finding that, due to their free radical scavenging activity, ATV hydroxy metabolites rather than the parent ATV, have substantial inhibitory effect on LDL and the like. Surprisingly (because it is contrary to the most cases currently known), we unambiguously found that HAT (direct hydrogen atom transfer) rather than SPLET (sequential proton loss electron transfer) or SET-PT (stepwise electron transfer proton transfer) is the thermodynamically preferred pathway by which o-ATV and p-ATV in methanolic phase can scavenge DPPH$^\bullet$ (1,1-diphenyl-2-picrylhydrazyl) radicals. From a quantum chemical perspective, the ATV's species investigated are surprising because of the nontrivial correlations between bond dissociation energies, bond lengths, bond order indices and pertaining stretching frequencies, which do not fit the framework of naive chemical intuition.

categories: physics.chem-ph physics.bio-ph physics.med-ph q-bio.BM q-bio.QM


title: A proof of the Kudla-Rapoport conjecture for Kr\"amer models

abstract: We prove the Kudla--Rapoport conjecture for Kr\"amer models of unitary Rapoport--Zink spaces at ramified places. It is a precise identity between arithmetic intersection numbers of special cycles on Kr\"amer models and modified derived local densities of hermitian forms. As an application, we relax the local assumptions at ramified places in the arithmetic Siegel--Weil formula for unitary Shimura varieties, which is in particular applicable to unitary Shimura vartieties associated to unimodular hermitian lattices over imaginary quadratic fields.


title: DICE: Data-Efficient Clinical Event Extraction with Generative Models

abstract: Event extraction for the clinical domain is an under-explored research area. The lack of training data along with the high volume of domain-specific terminologies with vague entity boundaries makes the task especially challenging. In this paper, we introduce DICE, a robust and data-efficient generative model for clinical event extraction. DICE frames event extraction as a conditional generation problem and introduces a contrastive learning objective to accurately decide the boundaries of biomedical mentions. DICE also trains an auxiliary mention identification task jointly with event extraction tasks to better identify entity mention boundaries, and further introduces special markers to incorporate identified entity mentions as trigger and argument candidates for their respective tasks. To benchmark clinical event extraction, we compose MACCROBAT-EE, the first clinical event extraction dataset with argument annotation, based on an existing clinical information extraction dataset MACCROBAT. Our experiments demonstrate state-of-the-art performances of DICE for clinical and news domain event extraction, especially under low data settings.


title: Insights into the nature of the $X(3872)$ through B meson decays

abstract: We study the decays $B_{c,u,d}\to X(3872)P$ in the perturbative QCD (PQCD) approach, where the puzzling resonance $X(3872)$ is involved and $P$ represents a light pseudoscalar meson $K$ and $\pi$. Assuming the $X(3872)$ as a $1^{++}$ charmonium state, we find the following results: (a) The branching ratios for the decays $B^+_c\to X(3872)\pi^+$ and $B^+_c\to X(3872) K^+$ agree with the results predicted by the covariant light-front approach within errors, but are larger than those given by the generalized factorization approach; (b) The branching ratio for the decay $B^+\to X(3872)K^+$ is predicted as $(3.8^{+1.1}_{-1.0})\times10^{-4}$, which is smaller than the previous PQCD calculation result, but still slightly larger than the upper limits set by Belle and BaBar. So we suggest that the decays $B^{0,+}\to X(3872)K^{0,+}$ should be precisely measured by the running LHCb and Belle II experiments, which is very helpful to probe the inner structure of the $X(3872)$; (c) Compared with the decays $B_{u,d}\to X(3872)K$, the decays $B_{u,d}\to X(3872)\pi$ have much smaller branching ratios, which drop to as low as $10^{-6}$; (d) The direct CP violations for these considered decays are very small, only $10^{-3}\sim 10^{-2}$, because the penguin contributions are loop suppressed compared with the tree contributions. Testing the results for the branching ratios and the CP violations including the implicit $SU(3)$ and isospin symmetries in these decays by experiments is helpful to probe the nature of the $X(3872)$.


title: High-Dimensional Directional Brain Network Analysis for Focal Epileptic Seizures

abstract: The brain is a high-dimensional directional network system consisting of many regions as network nodes that influence each other. The directional influence from one region to another is referred to as directional connectivity. Epilepsy is a directional network disorder, as epileptic activity spreads from a seizure onset zone (SOZ) to many other regions after seizure onset. However, directional network studies of epilepsy have been mostly limited to low-dimensional directional networks between the SOZ and contiguous regions due to the lack of efficient methods for analyzing high-dimensional directional brain networks. To address this gap, we study high-dimensional directional networks in epileptic brains by using a clustering-enabled multivariate autoregressive state-space model (MARSS) to analyze multi-channel intracranial EEG recordings of focal seizures. This new MARSS characterizes the SOZ, nearby regions, and many other non-SOZ regions as one integrated high-dimensional directional network system with a clustering feature. Using the new MARSS, we reveal changes in high-dimensional directional brain networks throughout seizure development. We simultaneously identify directional connections and the SOZ cluster, regions most affected by SOZ activity, in different seizure periods. We found that, after seizure onset, the numbers of directional connections of the SOZ and regions in the SOZ cluster increase significantly. We also reveal that many regions outside the SOZ cluster have no changes in directional connections, although these regions' EEG data signal ictal activity. Lastly, we use these high-dimensional network results to localize the SOZ and achieve 100% true positive rates and less than 3% false positive rates for different SOZ locations.


title: Kudla-Rapoport conjecture for Kr\"amer models

abstract: In this paper, we propose a modified Kudla-Rapoport conjecture for the Kr\"amer model of unitary Rapoport-Zink space at a ramified prime, which is a precise identity relating intersection numbers of special cycles to derivatives of Hermitian local density polynomials. We also introduce the notion of special difference cycles, which has surprisingly simple description. Combining this with induction formulas of Hermitian local density polynomials, we prove the modified Kudla-Rapoport conjecture when $n=3$. Our conjecture, combining with known results at inert and infinite primes, implies arithmetic Siegel-Weil formula for all non-singular coefficients when the level structure of the corresponding unitary Shimura variety is defined by a self-dual lattice.


title: Recent Advances of Blockchain and its Applications

abstract: Blockchain is an emerging decentralized data collection, sharing and storage technology, which have provided abundant transparent, secure, tamper-proof, secure and robust ledger services for various real-world use cases. Recent years have witnessed notable developments of blockchain technology itself as well as blockchain-adopting applications. Most existing surveys limit the scopes on several particular issues of blockchain or applications, which are hard to depict the general picture of current giant blockchain ecosystem. In this paper, we investigate recent advances of both blockchain technology and its most active research topics in real-world applications. We first review the recent developments of consensus mechanisms and storage mechanisms in general blockchain systems. Then extensive literature is conducted on blockchain enabled IoT, edge computing, federated learning and several emerging applications including healthcare, COVID-19 pandemic, social network and supply chain, where detailed specific research topics are discussed in each. Finally, we discuss the future directions, challenges and opportunities in both academia and industry.


title: Enhancing Audio Perception of Music By AI Picked Room Acoustics

abstract: Every sound that we hear is the result of successive convolutional operations (e.g. room acoustics, microphone characteristics, resonant properties of the instrument itself, not to mention characteristics and limitations of the sound reproduction system). In this work we seek to determine the best room in which to perform a particular piece using AI. Additionally, we use room acoustics as a way to enhance the perceptual qualities of a given sound. Historically, rooms (particularly Churches and concert halls) were designed to host and serve specific musical functions. In some cases the architectural acoustical qualities enhanced the music performed there. We try to mimic this, as a first step, by designating room impulse responses that would correlate to producing enhanced sound quality for particular music. A convolutional architecture is first trained to take in an audio sample and mimic the ratings of experts with about 78 % accuracy for various instrument families and notes for perceptual qualities. This gives us a scoring function for any audio sample which can rate the perceptual pleasantness of a note automatically. Now, via a library of about 60,000 synthetic impulse responses mimicking all kinds of room, materials, etc, we use a simple convolution operation, to transform the sound as if it was played in a particular room. The perceptual evaluator is used to rank the musical sounds, and yield the "best room or the concert hall" to play a sound. As a byproduct it can also use room acoustics to turn a poor quality sound into a "good" sound.


title: Existence and Stability of $\alpha-$ harmonic Maps

abstract: In this paper, we first study the $\alpha-$energy functional, Euler-Lagrange operator and $\alpha$-stress energy tensor. Second, it is shown that the critical points of $\alpha-$ energy functional are explicitly related to harmonic maps through conformal deformation. In addition, an $\alpha-$harmonic map is constructed from any smooth map between Riemannian manifolds under certain assumptions. Next, we determine the conditions under which the fibers of horizontally conformal $\alpha-$ harmonic maps are minimal submanifolds. Then, the stability of any $\alpha-$harmonic map from a Riemannian manifold to a Riemannian manifold with non-positive Riemannian curvature is demonstrated. Finally, the instability of $\alpha-$harmonic maps from a compact manifold to a standard unit sphere is investigated.


title: Correcting Convexity Bias in Function and Functional Estimate

abstract: A general framework with a series of different methods is proposed to improve the estimate of convex function (or functional) values when only noisy observations of the true input are available. Technically, our methods catch the bias introduced by the convexity and remove this bias from a baseline estimate. Theoretical analysis are conducted to show that the proposed methods can strictly reduce the expected estimate error under mild conditions. When applied, the methods require no specific knowledge about the problem except the convexity and the evaluation of the function. Therefore, they can serve as off-the-shelf tools to obtain good estimate for a wide range of problems, including optimization problems with random objective functions or constraints, and functionals of probability distributions such as the entropy and the Wasserstein distance. Numerical experiments on a wide variety of problems show that our methods can significantly improve the quality of the estimate compared with the baseline method.


title: Deep Learning Enabled Time-Lapse 3D Cell Analysis

abstract: This paper presents a method for time-lapse 3D cell analysis. Specifically, we consider the problem of accurately localizing and quantitatively analyzing sub-cellular features, and for tracking individual cells from time-lapse 3D confocal cell image stacks. The heterogeneity of cells and the volume of multi-dimensional images presents a major challenge for fully automated analysis of morphogenesis and development of cells. This paper is motivated by the pavement cell growth process, and building a quantitative morphogenesis model. We propose a deep feature based segmentation method to accurately detect and label each cell region. An adjacency graph based method is used to extract sub-cellular features of the segmented cells. Finally, the robust graph based tracking algorithm using multiple cell features is proposed for associating cells at different time instances. Extensive experiment results are provided and demonstrate the robustness of the proposed method. The code is available on Github and the method is available as a service through the BisQue portal.


title: What Artificial Neural Networks Can Tell Us About Human Language Acquisition

abstract: Rapid progress in machine learning for natural language processing has the potential to transform debates about how humans learn language. However, the learning environments and biases of current artificial learners and humans diverge in ways that weaken the impact of the evidence obtained from learning simulations. For example, today's most effective neural language models are trained on roughly one thousand times the amount of linguistic data available to a typical child. To increase the relevance of learnability results from computational models, we need to train model learners without significant advantages over humans. If an appropriate model successfully acquires some target linguistic knowledge, it can provide a proof of concept that the target is learnable in a hypothesized human learning scenario. Plausible model learners will enable us to carry out experimental manipulations to make causal inferences about variables in the learning environment, and to rigorously test poverty-of-the-stimulus-style claims arguing for innate linguistic knowledge in humans on the basis of speculations about learnability. Comparable experiments will never be possible with human subjects due to practical and ethical considerations, making model learners an indispensable resource. So far, attempts to deprive current models of unfair advantages obtain sub-human results for key grammatical behaviors such as acceptability judgments. But before we can justifiably conclude that language learning requires more prior domain-specific knowledge than current models possess, we must first explore non-linguistic inputs in the form of multimodal stimuli and multi-agent interaction as ways to make our learners more efficient at learning from limited linguistic input.


title: Evaluating the Feasibility of a Provably Secure Privacy-Preserving Entity Resolution Adaptation of PPJoin using Homomorphic Encryption

abstract: Entity resolution is the task of disambiguating records that refer to the same entity in the real world. In this work, we explore adapting one of the most efficient and accurate Jaccard-based entity resolution algorithms - PPJoin, to the private domain via homomorphic encryption. Towards this, we present our precise adaptation of PPJoin (HE-PPJoin) that details certain subtle data structure modifications and algorithmic additions needed for correctness and privacy. We implement HE-PPJoin by extending the PALISADE homomorphic encryption library and evaluate over it for accuracy and incurred overhead. Furthermore, we directly compare HE-PPJoin against P4Join, an existing privacy-preserving variant of PPJoin which uses fingerprinting for raw content obfuscation, by demonstrating a rigorous analysis of the efficiency, accuracy, and privacy properties achieved by our adaptation as well as a characterization of those same attributes in P4Join.


title: DeeperDive: The Unreasonable Effectiveness of Weak Supervision in Document Understanding A Case Study in Collaboration with UiPath Inc

abstract: Weak supervision has been applied to various Natural Language Understanding tasks in recent years. Due to technical challenges with scaling weak supervision to work on long-form documents, spanning up to hundreds of pages, applications in the document understanding space have been limited. At Lexion, we built a weak supervision-based system tailored for long-form (10-200 pages long) PDF documents. We use this platform for building dozens of language understanding models and have applied it successfully to various domains, from commercial agreements to corporate formation documents. In this paper, we demonstrate the effectiveness of supervised learning with weak supervision in a situation with limited time, workforce, and training data. We built 8 high quality machine learning models in the span of one week, with the help of a small team of just 3 annotators working with a dataset of under 300 documents. We share some details about our overall architecture, how we utilize weak supervision, and what results we are able to achieve. We also include the dataset for researchers who would like to experiment with alternate approaches or refine ours. Furthermore, we shed some light on the additional complexities that arise when working with poorly scanned long-form documents in PDF format, and some of the techniques that help us achieve state-of-the-art performance on such data.


title: On strong extension groups of Cuntz--Krieger algebras

abstract: In this paper, we study the strong extension groups of Cuntz--Krieger algebras, and present a formula to compute the groups. We also detect the position of the Toeplitz extension of a Cuntz--Krieger algebra in the strong extension group and in the weak extension group to see that the weak extension group with the position of the Toeplitz extension is a complete invariant of the isomorphism class of the Cuntz--Krieger algebra associated with its transposed matrix.


title: A Study on Learning and Simulating Personalized Car-Following Driving Style

abstract: Automated vehicles are gradually entering people's daily life to provide a comfortable driving experience for the users. The generic and user-agnostic automated vehicles have limited ability to accommodate the different driving styles of different users. This limitation not only impacts users' satisfaction but also causes safety concerns. Learning from user demonstrations can provide direct insights regarding users' driving preferences. However, it is difficult to understand a driver's preference with limited data. In this study, we use a model-free inverse reinforcement learning method to study drivers' characteristics in the car-following scenario from a naturalistic driving dataset, and show this method is capable of representing users' preferences with reward functions. In order to predict the driving styles for drivers with limited data, we apply Gaussian Mixture Models and compute the similarity of a specific driver to the clusters of drivers. We design a personalized adaptive cruise control (P-ACC) system through a partially observable Markov decision process (POMDP) model. The reward function with the model to mimic drivers' driving style is integrated, with a constraint on the relative distance to ensure driving safety. Prediction of the driving styles achieves 85.7% accuracy with the data of less than 10 car-following events. The model-based experimental driving trajectories demonstrate that the P-ACC system can provide a personalized driving experience.


title: Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise

abstract: Increasing the size of overparameterized neural networks has been a key in achieving state-of-the-art performance. This is captured by the double descent phenomenon, where the test loss follows a decreasing-increasing-decreasing pattern (or sometimes monotonically decreasing) as model width increases. However, the effect of label noise on the test loss curve has not been fully explored. In this work, we uncover an intriguing phenomenon where label noise leads to a \textit{final ascent} in the originally observed double descent curve. Specifically, under a sufficiently large noise-to-sample-size ratio, optimal generalization is achieved at intermediate widths. Through theoretical analysis, we attribute this phenomenon to the shape transition of test loss variance induced by label noise. Furthermore, we extend the final ascent phenomenon to model density and provide the first theoretical characterization showing that reducing density by randomly dropping trainable parameters improves generalization under label noise. We also thoroughly examine the roles of regularization and sample size. Surprisingly, we find that larger $\ell_2$ regularization and robust learning methods against label noise exacerbate the final ascent. We confirm the validity of our findings through extensive experiments on ReLu networks trained on MNIST, ResNets/ViTs trained on CIFAR-10/100, and InceptionResNet-v2 trained on Stanford Cars with real-world noisy labels.


title: Field-wise Embedding Size Search via Structural Hard Auxiliary Mask Pruning for Click-Through Rate Prediction

abstract: Feature embeddings are one of the most essential steps when training deep learning based Click-Through Rate prediction models, which map high-dimensional sparse features to dense embedding vectors. Classic human-crafted embedding size selection methods are shown to be "sub-optimal" in terms of the trade-off between memory usage and model capacity. The trending methods in Neural Architecture Search (NAS) have demonstrated their efficiency to search for embedding sizes. However, most existing NAS-based works suffer from expensive computational costs, the curse of dimensionality of the search space, and the discrepancy between continuous search space and discrete candidate space. Other works that prune embeddings in an unstructured manner fail to reduce the computational costs explicitly. In this paper, to address those limitations, we propose a novel strategy that searches for the optimal mixed-dimension embedding scheme by structurally pruning a super-net via Hard Auxiliary Mask. Our method aims to directly search candidate models in the discrete space using a simple and efficient gradient-based method. Furthermore, we introduce orthogonal regularity on embedding tables to reduce correlations within embedding columns and enhance representation capacity. Extensive experiments demonstrate it can effectively remove redundant embedding dimensions without great performance loss.


title: Transformer Encoder for Social Science

abstract: High-quality text data has become an important data source for social scientists. We have witnessed the success of pretrained deep neural network models, such as BERT and RoBERTa, in recent social science research. In this paper, we propose a compact pretrained deep neural network, Transformer Encoder for Social Science (TESS), explicitly designed to tackle text processing tasks in social science research. Using two validation tests, we demonstrate that TESS outperforms BERT and RoBERTa by 16.7% on average when the number of training samples is limited (<1,000 training instances). The results display the superiority of TESS over BERT and RoBERTa on social science text processing tasks. Lastly, we discuss the limitation of our model and present advice for future researchers.


title: Sum of independent random variable for Shanker, Akash, Ishita, Pranav, Rani and Ram Awadh distributions

abstract: In statistics and probability theory, one the most important statistics is the sums of random variables. After introducing a probability distribution, determining the sum of n independent and identically distributed random variables is one of the interesting topics for authors. This paper presented the probability density function for the sum of n independent and identically distributed random variables such as Shanker, Akash, Ishita, Rani, Pranav and Ram Awadh. In order to determine all aforementioned distributions, the problem-solving methods are applied which is based on the change-of-variables technique. The mth moments for them were also accurately calculated. Besides, the reliability and the mean time to failure of a 1 out of n cold standby spare system has also been evaluated under the Lindley components failure time.


title: Atom Interferometric Imaging of Differential Potentials Using an Atom Laser

abstract: Interferometry is a prime technique for modern precision measurements. Atoms, unlike light, have significant interactions with electric, magnetic, and gravitational fields, making their use in interferometric applications particularly versatile. Here, we demonstrate atom interferometry to image optical and magnetic potential landscapes over an area exceeding $240 \mu m \times 600 \mu m$. The differential potentials employed in our experiments generate phase imprints in an atom laser that are made visible through a Ramsey pulse sequence. We further demonstrate how advanced pulse sequences can enhance desired imaging features, e.g. to image steep potential gradients. A theoretical discussion is presented that provides a semiclassical analysis and matching numerics.


title: Nucleon Transversity Distribution in the Continuum and Physical Mass Limit from Lattice QCD

abstract: We report a state-of-the-art lattice QCD calculation of the isovector quark transversity distribution of the proton in the continuum and physical mass limit using large-momentum effective theory. The calculation is done at four lattice spacings $a=\{0.098,0.085,0.064,0.049\}$~fm and various pion masses ranging between $220$ and $350$ MeV, with proton momenta up to $2.8$ GeV. The result is non-perturbatively renormalized in the hybrid scheme with self renormalization which treats the infrared physics at large correlation distance properly, and extrapolated to the continuum, physical mass and infinite momentum limit. We also compare with recent global analyses for the nucleon isovector quark transversity distribution.


title: Resource Allocation in Quantum Key Distribution (QKD) for Space-Air-Ground Integrated Networks

abstract: Space-air-ground integrated networks (SAGIN) are one of the most promising advanced paradigms in the sixth generation (6G) communication. SAGIN can support high data rates, low latency, and seamless network coverage for interconnected applications and services. However, communications in SAGIN are facing tremendous security threats from the ever-increasing capacity of quantum computers. Fortunately, quantum key distribution (QKD) for establishing secure communications in SAGIN, i.e., QKD over SAGIN, can provide information-theoretic security. To minimize the QKD deployment cost in SAGIN with heterogeneous nodes, in this paper, we propose a resource allocation scheme for QKD over SAGIN using stochastic programming. The proposed scheme is formulated via two-stage stochastic programming (SP), while considering uncertainties such as security requirements and weather conditions. Under extensive experiments, the results clearly show that the proposed scheme can achieve the optimal deployment cost under various security requirements and unpredictable weather conditions.


title: ShortcutLens: A Visual Analytics Approach for Exploring Shortcuts in Natural Language Understanding Dataset

abstract: Benchmark datasets play an important role in evaluating Natural Language Understanding (NLU) models. However, shortcuts -- unwanted biases in the benchmark datasets -- can damage the effectiveness of benchmark datasets in revealing models' real capabilities. Since shortcuts vary in coverage, productivity, and semantic meaning, it is challenging for NLU experts to systematically understand and avoid them when creating benchmark datasets. In this paper, we develop a visual analytics system, ShortcutLens, to help NLU experts explore shortcuts in NLU benchmark datasets. The system allows users to conduct multi-level exploration of shortcuts. Specifically, Statistics View helps users grasp the statistics such as coverage and productivity of shortcuts in the benchmark dataset. Template View employs hierarchical and interpretable templates to summarize different types of shortcuts. Instance View allows users to check the corresponding instances covered by the shortcuts. We conduct case studies and expert interviews to evaluate the effectiveness and usability of the system. The results demonstrate that ShortcutLens supports users in gaining a better understanding of benchmark dataset issues through shortcuts, inspiring them to create challenging and pertinent benchmark datasets.


title: Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation

abstract: Effectively representing users lie at the core of modern recommender systems. Since users' interests naturally exhibit multiple aspects, it is of increasing interest to develop multi-interest frameworks for recommendation, rather than represent each user with an overall embedding. Despite their effectiveness, existing methods solely exploit the encoder (the forward flow) to represent multiple aspects of interests. However, without explicit regularization, the interest embeddings may not be distinct from each other nor semantically reflect representative historical items. Towards this end, we propose the Re4 framework, which leverages the backward flow to reexamine each interest embedding. Specifically, Re4 encapsulates three backward flows, i.e., 1) Re-contrast, which drives each interest embedding to be distinct from other interests using contrastive learning; 2) Re-attend, which ensures the interest-item correlation estimation in the forward flow to be consistent with the criterion used in final recommendation; and 3) Re-construct, which ensures that each interest embedding can semantically reflect the information of representative items that relate to the corresponding interest. We demonstrate the novel forward-backward multi-interest paradigm on ComiRec, and perform extensive experiments on three real-world datasets. Empirical studies validate that Re4 helps to learn learning distinct and effective multi-interest representations.


title: Disentangled Speaker Representation Learning via Mutual Information Minimization

abstract: Domain mismatch problem caused by speaker-unrelated feature has been a major topic in speaker recognition. In this paper, we propose an explicit disentanglement framework to unravel speaker-relevant features from speaker-unrelated features via mutual information (MI) minimization. To achieve our goal of minimizing MI between speaker-related and speaker-unrelated features, we adopt a contrastive log-ratio upper bound (CLUB), which exploits the upper bound of MI. Our framework is constructed in a 3-stage structure. First, in the front-end encoder, input speech is encoded into shared initial embedding. Next, in the decoupling block, shared initial embedding is split into separate speaker-related and speaker-unrelated embeddings. Finally, disentanglement is conducted by MI minimization in the last stage. Experiments on Far-Field Speaker Verification Challenge 2022 (FFSVC2022) demonstrate that our proposed framework is effective for disentanglement. Also, to utilize domain-unknown datasets containing numerous speakers, we pre-trained the front-end encoder with VoxCeleb datasets. We then fine-tuned the speaker embedding model in the disentanglement framework with FFSVC 2022 dataset. The experimental results show that fine-tuning with a disentanglement framework on a existing pre-trained model is valid and can further improve performance.


title: Cooling neutral atoms into maximal entanglement in the Rydberg blockade regime

abstract: We propose a cooling scheme to prepare stationary entanglement of neutral atoms in the Rydberg blockade regime by combination of periodically collective laser pumping and dissipation. In each cycle, the controlled unitary dynamics process can selectively pump atoms away from the non-target state while maintaining the target state unchanged. The subsequent dissipative process redistributes the populations of ground states through the engineered spontaneous emission. After a number of cycles, the system will be eventually stabilized into the desired steady state independent of the initial state. This protocol does not rely on coherent addressing of individual neutral atoms or fine control of Rydberg interaction intensity, which can in principle greatly improve the feasibility of experiments in related fields.


title: AUGER: Automatically Generating Review Comments with Pre-training Models

abstract: Code review is one of the best practices as a powerful safeguard for software quality. In practice, senior or highly skilled reviewers inspect source code and provide constructive comments, considering what authors may ignore, for example, some special cases. The collaborative validation between contributors results in code being highly qualified and less chance of bugs. However, since personal knowledge is limited and varies, the efficiency and effectiveness of code review practice are worthy of further improvement. In fact, it still takes a colossal and time-consuming effort to deliver useful review comments. This paper explores a synergy of multiple practical review comments to enhance code review and proposes AUGER (AUtomatically GEnerating Review comments): a review comments generator with pre-training models. We first collect empirical review data from 11 notable Java projects and construct a dataset of 10,882 code changes. By leveraging Text-to-Text Transfer Transformer (T5) models, the framework synthesizes valuable knowledge in the training stage and effectively outperforms baselines by 37.38% in ROUGE-L. 29% of our automatic review comments are considered useful according to prior studies. The inference generates just in 20 seconds and is also open to training further. Moreover, the performance also gets improved when thoroughly analyzed in case study.


title: Cross-Domain Few-Shot Classification via Inter-Source Stylization

abstract: The goal of Cross-Domain Few-Shot Classification (CDFSC) is to accurately classify a target dataset with limited labelled data by exploiting the knowledge of a richly labelled auxiliary dataset, despite the differences between the domains of the two datasets. Some existing approaches require labelled samples from multiple domains for model training. However, these methods fail when the sample labels are scarce. To overcome this challenge, this paper proposes a solution that makes use of multiple source domains without the need for additional labeling costs. Specifically, one of the source domains is completely tagged, while the others are untagged. An Inter-Source Stylization Network (ISSNet) is then introduced to enhance stylisation across multiple source domains, enriching data distribution and model's generalization capabilities. Experiments on 8 target datasets show that ISSNet leverages unlabelled data from multiple source data and significantly reduces the negative impact of domain gaps on classification performance compared to several baseline methods.


title: Quasi-F-splittings in birational geometry

abstract: We develop the theory of quasi-$F$-splittings in the context of birational geometry. Amongst other things, we obtain results on liftability of sections and establish a criterion for whether a scheme is quasi-$F$-split employing the higher Cartier operator. As one of the applications of our theory, we prove that three-dimensional klt singularities in large characteristic are quasi-$F$-split, and so, in particular, they lift modulo $p^2$.


title: Towards Generating Robust, Fair, and Emotion-Aware Explanations for Recommender Systems

abstract: As recommender systems become increasingly sophisticated and complex, they often suffer from lack of fairness and transparency. Providing robust and unbiased explanations for recommendations has been drawing more and more attention as it can help address these issues and improve trustworthiness and informativeness of recommender systems. However, despite the fact that such explanations are generated for humans who respond more strongly to messages with appropriate emotions, there is a lack of consideration for emotions when generating explanations for recommendations. Current explanation generation models are found to exaggerate certain emotions without accurately capturing the underlying tone or the meaning. In this paper, we propose a novel method based on a multi-head transformer, called Emotion-aware Transformer for Explainable Recommendation (EmoTER), to generate more robust, fair, and emotion-enhanced explanations. To measure the linguistic quality and emotion fairness of the generated explanations, we adopt both automatic text metrics and human perceptions for evaluation. Experiments on three widely-used benchmark datasets with multiple evaluation metrics demonstrate that EmoTER consistently outperforms the existing state-of-the-art explanation generation models in terms of text quality, explainability, and consideration for fairness to emotion distribution. Implementation of EmoTER will be released as an open-source toolkit to support further research.


title: On Wronskians and $qq$-systems

abstract: We discuss the $qq$-systems, the functional form of the Bethe ansatz equations for the twisted Gaudin model from a new geometric point of view. We use a concept of $G$-Wronskians, which are certain meromorphic sections of principal $G$-bundles on the projective line. In this context, the $qq$-system, similar to its difference analog, is realized as the relation between generalized minors of the $G$-Wronskian. We explain the link between $G$-Wronskians and twisted $G$-oper connections, which are the traditional source for the $qq$-systems.

categories: math.AG hep-th math-ph math.MP math.QA math.RT


title: Interference Cancellation GAN Framework for Dynamic Channels

abstract: Symbol detection is a fundamental and challenging problem in modern communication systems, e.g., multiuser multiple-input multiple-output (MIMO) setting. Iterative Soft Interference Cancellation (SIC) is a state-of-the-art method for this task and recently motivated data-driven neural network models, e.g. DeepSIC, that can deal with unknown non-linear channels. However, these neural network models require thorough timeconsuming training of the networks before applying, and is thus not readily suitable for highly dynamic channels in practice. We introduce an online training framework that can swiftly adapt to any changes in the channel. Our proposed framework unifies the recent deep unfolding approaches with the emerging generative adversarial networks (GANs) to capture any changes in the channel and quickly adjust the networks to maintain the top performance of the model. We demonstrate that our framework significantly outperforms recent neural network models on highly dynamic channels and even surpasses those on the static channel in our experiments.


title: Low-Mass dark matter (in)direct detection with inelastic scattering

abstract: We revisit the detection of luminous dark matter in direct detection experiments. In this scenario, dark matter scatters endothermically to produce an excited state, which decays to produce a photon. We explore ways in which the electron recoil signal from the decay photon can be differentiated from other potential electron recoil signals with a narrow spectral shape. We find that larger volume/exposure xenon detectors will be unable to differentiate the signal origin without significant improvements in detector energy resolution of around an order of magnitude. We also explore what can be learned about a generic luminous dark matter signal with a higher resolution detector. Motivated by the advancements in energy resolution by solid-state detectors, we find that sub-eV resolution enables the discovery of LDM in the presence of background levels that would otherwise make observation impossible. We also find that sub-eV resolution can be used to determine the shape of the luminous dark matter decay spectrum and thus constrain the dark matter mass and velocity distribution.


title: Streaming Adaptive Submodular Maximization

abstract: Many sequential decision making problems can be formulated as an adaptive submodular maximization problem. However, most of existing studies in this field focus on pool-based setting, where one can pick items in any order, and there have been few studies for the stream-based setting where items arrive in an arbitrary order and one must immediately decide whether to select an item or not upon its arrival. In this paper, we introduce a new class of utility functions, semi-policywise submodular functions. We develop a series of effective algorithms to maximize a semi-policywise submodular function under the stream-based setting.


title: Rough diamond anvils: Steady microstructure, yield surface, and transformation kinetics in Zr

abstract: Study of the plastic flow and strain-induced phase transformations (PTs) under high pressure with diamond anvils is important for material and geophysics. We introduce rough diamond anvils and apply them to Zr, which drastically change the plastic flow, microstructure, and PTs. Multiple steady microstructures independent of pressure, plastic strain, and strain path are reached. Maximum friction equal to the yield strength in shear is achieved. This allows determination of the pressure-dependence of the yield strength and proves that omega-Zr behaves like perfectly plastic, isotropic, and strain path-independent immediately after PT. Record minimum pressure for alpha-omega PT was identified. Kinetics of strain-induced PT depends on plastic strain and time. Crystallite size and dislocation density in omega-Zr during PT depend solely on the volume fraction of omega-Zr.


title: Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes

abstract: Few-shot named entity recognition (NER) enables us to build a NER system for a new domain using very few labeled examples. However, existing prototypical networks for this task suffer from roughly estimated label dependency and closely distributed prototypes, thus often causing misclassifications. To address the above issues, we propose EP-Net, an Entity-level Prototypical Network enhanced by dispersedly distributed prototypes. EP-Net builds entity-level prototypes and considers text spans to be candidate entities, so it no longer requires the label dependency. In addition, EP-Net trains the prototypes from scratch to distribute them dispersedly and aligns spans to prototypes in the embedding space using a space projection. Experimental results on two evaluation tasks and the Few-NERD settings demonstrate that EP-Net consistently outperforms the previous strong models in terms of overall performance. Extensive analyses further validate the effectiveness of EP-Net.


title: CCL4Rec: Contrast over Contrastive Learning for Micro-video Recommendation

abstract: Micro-video recommender systems suffer from the ubiquitous noises in users' behaviors, which might render the learned user representation indiscriminating, and lead to trivial recommendations (e.g., popular items) or even weird ones that are far beyond users' interests. Contrastive learning is an emergent technique for learning discriminating representations with random data augmentations. However, due to neglecting the noises in user behaviors and treating all augmented samples equally, the existing contrastive learning framework is insufficient for learning discriminating user representations in recommendation. To bridge this research gap, we propose the Contrast over Contrastive Learning framework for training recommender models, named CCL4Rec, which models the nuances of different augmented views by further contrasting augmented positives/negatives with adaptive pulling/pushing strengths, i.e., the contrast over (vanilla) contrastive learning. To accommodate these contrasts, we devise the hardness-aware augmentations that track the importance of behaviors being replaced in the query user and the relatedness of substitutes, and thus determining the quality of augmented positives/negatives. The hardness-aware augmentation also permits controllable contrastive learning, leading to performance gains and robust training. In this way, CCL4Rec captures the nuances of historical behaviors for a given user, which explicitly shields off the learned user representation from the effects of noisy behaviors. We conduct extensive experiments on two micro-video recommendation benchmarks, which demonstrate that CCL4Rec with far less model parameters could achieve comparable performance to existing state-of-the-art method, and improve the training/inference speed by several orders of magnitude.


title: AutoCAT: Reinforcement Learning for Automated Exploration of Cache-Timing Attacks

abstract: The aggressive performance optimizations in modern microprocessors can result in security vulnerabilities. For example, timing-based attacks in processor caches can steal secret keys or break randomization. So far, finding cache-timing vulnerabilities is mostly performed by human experts, which is inefficient and laborious. There is a need for automatic tools that can explore vulnerabilities given that unreported vulnerabilities leave the systems at risk. In this paper, we propose AutoCAT, an automated exploration framework that finds cache timing-channel attack sequences using reinforcement learning (RL). Specifically, AutoCAT formulates the cache timing-channel attack as a guessing game between an attack program and a victim program holding a secret. This guessing game can thus be solved via modern deep RL techniques. AutoCAT can explore attacks in various cache configurations without knowing design details and under different attack and victim program configurations. AutoCAT can also find attacks to bypass certain detection and defense mechanisms. In particular, AutoCAT discovered StealthyStreamline, a new attack that is able to bypass performance counter-based detection and has up to a 71% higher information leakage rate than the state-of-the-art LRU-based attacks on real processors. AutoCAT is the first of its kind in using RL for crafting microarchitectural timing-channel attack sequences and can accelerate cache timing-channel exploration for secure microprocessor designs.


title: Conservation laws and variational structure of damped nonlinear wave equations

abstract: All low-order conservation laws are found for a general class of nonlinear wave equations in one dimension with linear damping which is allowed to be time-dependent. Such equations arise in numerous physical applications and have attracted much attention in analysis. The conservation laws describe generalized momentum and boost momentum, conformal momentum, generalized energy, dilational energy, and light-cone energies. Both the conformal momentum and dilational energy have no counterparts for nonlinear undamped wave equations in one dimension. All of the conservation laws are obtainable through Noether's theorem, which is applicable because the damping term can be transformed into a time-dependent self-interaction term by a change of dependent variable. For several of the conservation laws, the corresponding variational symmetries have a novel form which is different than any of the well known variation symmetries admitted by nonlinear undamped wave equations in one dimension.


title: Effective permeability of an immiscible fluid in porous media determined from its geometric state

abstract: Based on the phenomenological extension of Darcy's law, two-fluid flow is dependent on a relative permeability function of saturation only that is process/path dependent with an underlying dependency on pore structure. For applications, fuel cells to underground $CO_2$ storage, it is imperative to determine the effective phase permeability relationships where the traditional approach is based on the inverse modelling of time-consuming experiments. The underlying reason is that the fundamental upscaling step from pore to Darcy scale, which links the pore structure of the porous medium to the continuum hydraulic conductivities, is not solved. Herein, we develop an Artificial Neural Network (ANN) that relies on fundamental geometrical relationships to determine the mechanical energy dissipation during creeping immiscible two-fluid flow. The developed ANN is based on a prescribed set of state variables based on physical insights that predicts the effective permeability of 4,500 unseen pore-scale geometrical states with $R^2 = 0.98$.


title: Deep Learning based Security-Constrained Unit Commitment Considering Locational Frequency Stability in Low-Inertia Power Systems

abstract: With the goal of electricity system decarbonization, conventional synchronous generators are gradually replaced by converter-interfaced renewable generations. Such transition is causing concerns over system frequency and rate-of-change-of-frequency (RoCoF) security due to significant reduction in system inertia. Existing efforts are mostly derived from uniform system frequency response model which may fail to capture all characteristics of the systems. To ensure the locational frequency security, this paper presents a deep neural network (DNN) based RoCoF-constrained unit commitment (DNN-RCUC) model. RoCoF predictor is trained to predict the highest locational RoCoF based on a high-fidelity simulation dataset. Training samples are generated from models over various scenarios, which can avoid simulation divergence and system instability. The trained network is then reformulated into a set of mixed-integer linear constraints representing the locational RoCoF-limiting constraints in unit commitment. The proposed DNN-RCUC model is studied on the IEEE 24-bus system. Time domain simulation results on PSS/E demonstrate the effectiveness of the proposed algorithm.


title: A Context-Aware Approach for Textual Adversarial Attack through Probability Difference Guided Beam Search

abstract: Textual adversarial attacks expose the vulnerabilities of text classifiers and can be used to improve their robustness. Existing context-aware methods solely consider the gold label probability and use the greedy search when searching an attack path, often limiting the attack efficiency. To tackle these issues, we propose PDBS, a context-aware textual adversarial attack model using Probability Difference guided Beam Search. The probability difference is an overall consideration of all class label probabilities, and PDBS uses it to guide the selection of attack paths. In addition, PDBS uses the beam search to find a successful attack path, thus avoiding suffering from limited search space. Extensive experiments and human evaluation demonstrate that PDBS outperforms previous best models in a series of evaluation metrics, especially bringing up to a +19.5% attack success rate. Ablation studies and qualitative analyses further confirm the efficiency of PDBS.


title: The Cauchy problem of the Camassa-Holm equation in a weighted Sobolev space: Long-time and Painlev\'e asymptotics

abstract: Based on the $\overline\partial$-generalization of the Deift-Zhou steepest descent method, we extend the long-time and Painlev\'e asymptotics for the Camassa-Holm (CH) equation to the solutions with initial data in a weighted Sobolev space $ H^{4,2}(\mathbb{R})$. With a new scale $(y,t)$ and a RH problem associated with the initial value problem,we derive different long time asymptotic expansions for the solutions of the CH equation in different space-time solitonic regions. The half-plane $\{ (y,t): -\infty <y<\infty, \ t> 0\}$ is divided into four asymptotic regions: 1. Fast decay region, $ y/t \in(-\infty,-1/4)$ with an error $\mathcal{O}(t^{-1/2})$; 2. Modulation-solitons region, $y/t \in(2,+\infty)$, the result can be characterized with an modulation-solitons with residual error $\mathcal{O}(t^{-1/2 })$; 3. Zakhrov-Manakov region,$y/t \in(0,2)$ and $y/t \in(-1/4,0)$. The asymptotic approximations is characterized by the dispersion term with residual error $\mathcal{O}(t^{-3/4})$; 4. Two transition regions, $|y/t|\approx 2$ and $|y/t| \approx -1/4$, the results are describe by the solution of Painlev\'e II equation with error order $\mathcal{O}(t^{-1/2})$.


title: The Zoo of Opers and Dualities

abstract: We investigate various spaces of $SL(r+1)$-opers and their deformations. For each type of such opers, we study the quantum/classical duality, which relates quantum integrable spin chains with classical solvable many body systems. In this context, quantum/classical dualities serve as an interplay between two different coordinate systems on the space of opers. We also establish correspondences between the underlying oper spaces, which recently had multiple incarnations in symplectic duality and bispectral duality.


title: Screening and collective effects in randomly pinned fluids: A new theoretical framework

abstract: We propose a theoretical framework for the dynamics of bulk isotropic hard-sphere systems in the presence of randomly pinned particles and apply this theory to supercooled water to validate it. Structural relaxation is mainly governed by local and non-local activated process. As the pinned fraction grows, a local caging constraint becomes stronger and the long range collective aspect of relaxation is screened by immobile obstacles. Different responses of the local and cooperative motions results in subtle predictions for how the alpha relaxation time varies with pinning and density. Our theoretical analysis for the relaxation time of water with pinned molecules quantitatively well describe previous simulations. In addition, the thermal dependence of relaxation for unpinned bulk water is also consistent with prior computational and experimental data.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.chem-ph physics.comp-ph


title: Flat $GL(1|1)$-connections and fatgraphs

abstract: We study the moduli space of flat $GL(1|1)$-connections on a punctured surface from the point of view of graph connections. To each fatgraph, a system of coordinates is assigned, which involves two bosonic and two fermionic variables per edge, subject to certain relations. In the case of trivalent graphs, we provide a closed explicit formula for the Whitehead moves. In addition, we discuss the invariant Poisson bracket.

categories: math.GT hep-th math-ph math.MP math.QA math.RT


title: Deep Reinforcement Learning based Robot Navigation in Dynamic Environments using Occupancy Values of Motion Primitives

abstract: This paper presents a Deep Reinforcement Learning based navigation approach in which we define the occupancy observations as heuristic evaluations of motion primitives, rather than using raw sensor data. Our method enables fast mapping of the occupancy data, generated by multi-sensor fusion, into trajectory values in 3D workspace. The computationally efficient trajectory evaluation allows dense sampling of the action space. We utilize our occupancy observations in different data structures to analyze their effects on both training process and navigation performance. We train and test our methodology on two different robots within challenging physics-based simulation environments including static and dynamic obstacles. We benchmark our occupancy representations with other conventional data structures from state-of-the-art methods. The trained navigation policies are also validated successfully with physical robots in dynamic environments. The results show that our method not only decreases the required training time but also improves the navigation performance as compared to other occupancy representations. The open-source implementation of our work and all related info are available at \url{https://github.com/RIVeR-Lab/tentabot}.


title: EGCR: Explanation Generation for Conversational Recommendation

abstract: Growing attention has been paid in Conversational Recommendation System (CRS), which works as a conversation-based and recommendation task-oriented tool to provide items of interest and explore user preference. However, existing work in CRS fails to explicitly show the reasoning logic to users and the whole CRS still remains a black box. Therefore we propose a novel end-to-end framework named Explanation Generation for Conversational Recommendation (EGCR) based on generating explanations for conversational agents to explain why they make the action. EGCR incorporates user reviews to enhance the item representation and increase the informativeness of the whole conversation. To the best of our knowledge, this is the first framework for explainable conversational recommendation on real-world datasets. Moreover, we evaluate EGCR on one benchmark conversational recommendation datasets and achieve better performance on both recommendation accuracy and conversation quality than other state-of-the art models. Finally, extensive experiments demonstrate that generated explanations are not only having high quality and explainability, but also making CRS more trustworthy. We will make our code available to contribute to the CRS community


title: Time-reversal symmetry breaking in charge density wave of CsV$_3$Sb$_5$ detected by polar Kerr effect

abstract: The Kagome lattice exhibits rich quantum phenomena owing to its unique geometric properties. Appealing realizations are the Kagome metals AV$_3$Sb$_5$ (A = K, Rb, Cs), where unconventional charge density wave (CDW) is intertwined with superconductivity and non-trivial band topology. Several experiments suggest that this CDW is a rare occurrence of chiral CDW characterized by orbital loop current. However, key evidences of loop current, spontaneous time-reversal symmetry-breaking (TRSB) and the coupling of its order parameter with the magnetic field remain elusive. Here, we investigate the CDW in CsV3Sb5 by magneto-optic polar Kerr effect with sub-microradian resolution. Under magnetic field, we observed a jump of the Kerr angle at the CDW transition. This jump is magnetic-field switchable and scales with field, indicating magneto--chirality coupling related to non-trivial band topology. At zero field, we found non-zero and field-trainable Kerr angle below CDW transition temperature, signaling spontaneous TRSB. Our results provide a crucial step to unveil quantum phenomena in correlated Kagome materials.


title: LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restriction

abstract: Conditional graphic layout generation, which generates realistic layouts according to user constraints, is a challenging task that has not been well-studied yet. First, there is limited discussion about how to handle diverse user constraints flexibly and uniformly. Second, to make the layouts conform to user constraints, existing work often sacrifices generation quality significantly. In this work, we propose LayoutFormer++ to tackle the above problems. First, to flexibly handle diverse constraints, we propose a constraint serialization scheme, which represents different user constraints as sequences of tokens with a predefined format. Then, we formulate conditional layout generation as a sequence-to-sequence transformation, and leverage encoder-decoder framework with Transformer as the basic architecture. Furthermore, to make the layout better meet user requirements without harming quality, we propose a decoding space restriction strategy. Specifically, we prune the predicted distribution by ignoring the options that definitely violate user constraints and likely result in low-quality layouts, and make the model samples from the restricted distribution. Experiments demonstrate that LayoutFormer++ outperforms existing approaches on all the tasks in terms of both better generation quality and less constraint violation.


title: Modeling of bound electron effects in particle-in-cell simulation

abstract: To include the bound electron effects in particle-in-cell (PIC) simulation, we propose a model in which the response of the dipole components of partially ionized ions to external electromagnetic fields can be included. Instead of treating the macro-ion particle as a single particle without an internal structure, the ions are considered to have a structure composed of a central nucleus and a bounded electron cloud in our model. The two parts experience the interactions of both the external electromagnetic fields and the internal Coulomb fields. In this way, the laser scattering effects by a partially ionized medium can be modeled properly in the PIC simulation. The laser propagation in a neutral medium and the Bragg scattering of the laser in crystal structure have been simulated with a PIC code modified based on our model as the benchmark. Our model may find applications to study some interesting problems, such as the x-ray laser-driven wakefield acceleration in crystals, the x-ray laser-driven high energy density physics, and intense laser propagation in partially ionized nonlinear optical materials, etc.


title: Artificial Intelligence Empowered Multiple Access for Ultra Reliable and Low Latency THz Wireless Networks

abstract: Terahertz (THz) wireless networks are expected to catalyze the beyond fifth generation (B5G) era. However, due to the directional nature and the line-of-sight demand of THz links, as well as the ultra-dense deployment of THz networks, a number of challenges that the medium access control (MAC) layer needs to face are created. In more detail, the need of rethinking user association and resource allocation strategies by incorporating artificial intelligence (AI) capable of providing "real-time" solutions in complex and frequently changing environments becomes evident. Moreover, to satisfy the ultra-reliability and low-latency demands of several B5G applications, novel mobility management approaches are required. Motivated by this, this article presents a holistic MAC layer approach that enables intelligent user association and resource allocation, as well as flexible and adaptive mobility management, while maximizing systems' reliability through blockage minimization. In more detail, a fast and centralized joint user association, radio resource allocation, and blockage avoidance by means of a novel metaheuristic-machine learning framework is documented, that maximizes the THz networks performance, while minimizing the association latency by approximately three orders of magnitude. To support, within the access point (AP) coverage area, mobility management and blockage avoidance, a deep reinforcement learning (DRL) approach for beam-selection is discussed. Finally, to support user mobility between coverage areas of neighbor APs, a proactive hand-over mechanism based on AI-assisted fast channel prediction is~reported.


title: A Survey on Incomplete Multi-view Clustering

abstract: Conventional multi-view clustering seeks to partition data into respective groups based on the assumption that all views are fully observed. However, in practical applications, such as disease diagnosis, multimedia analysis, and recommendation system, it is common to observe that not all views of samples are available in many cases, which leads to the failure of the conventional multi-view clustering methods. Clustering on such incomplete multi-view data is referred to as incomplete multi-view clustering. In view of the promising application prospects, the research of incomplete multi-view clustering has noticeable advances in recent years. However, there is no survey to summarize the current progresses and point out the future research directions. To this end, we review the recent studies of incomplete multi-view clustering. Importantly, we provide some frameworks to unify the corresponding incomplete multi-view clustering methods, and make an in-depth comparative analysis for some representative methods from theoretical and experimental perspectives. Finally, some open problems in the incomplete multi-view clustering field are offered for researchers.


title: InterTrack: Interaction Transformer for 3D Multi-Object Tracking

abstract: 3D multi-object tracking (MOT) is a key problem for autonomous vehicles, required to perform well-informed motion planning in dynamic environments. Particularly for densely occupied scenes, associating existing tracks to new detections remains challenging as existing systems tend to omit critical contextual information. Our proposed solution, InterTrack, introduces the Interaction Transformer for 3D MOT to generate discriminative object representations for data association. We extract state and shape features for each track and detection, and efficiently aggregate global information via attention. We then perform a learned regression on each track/detection feature pair to estimate affinities, and use a robust two-stage data association and track management approach to produce the final tracks. We validate our approach on the nuScenes 3D MOT benchmark, where we observe significant improvements, particularly on classes with small physical sizes and clustered objects. As of submission, InterTrack ranks 1st in overall AMOTA among methods using CenterPoint detections.


title: The Conversational Short-phrase Speaker Diarization (CSSD) Task: Dataset, Evaluation Metric and Baselines

abstract: The conversation scenario is one of the most important and most challenging scenarios for speech processing technologies because people in conversation respond to each other in a casual style. Detecting the speech activities of each person in a conversation is vital to downstream tasks, like natural language processing, machine translation, etc. People refer to the detection technology of "who speak when" as speaker diarization (SD). Traditionally, diarization error rate (DER) has been used as the standard evaluation metric of SD systems for a long time. However, DER fails to give enough importance to short conversational phrases, which are short but important on the semantic level. Also, a carefully and accurately manually-annotated testing dataset suitable for evaluating the conversational SD technologies is still unavailable in the speech community. In this paper, we design and describe the Conversational Short-phrases Speaker Diarization (CSSD) task, which consists of training and testing datasets, evaluation metric and baselines. In the dataset aspect, despite the previously open-sourced 180-hour conversational MagicData-RAMC dataset, we prepare an individual 20-hour conversational speech test dataset with carefully and artificially verified speakers timestamps annotations for the CSSD task. In the metric aspect, we design the new conversational DER (CDER) evaluation metric, which calculates the SD accuracy at the utterance level. In the baseline aspect, we adopt a commonly used method: Variational Bayes HMM x-vector system, as the baseline of the CSSD task. Our evaluation metric is publicly available at https://github.com/SpeechClub/CDER_Metric.


title: The computational simulation of the reflection spectra of copper red glaze

abstract: Owing to the limitation of traditional analytical methods, the coloration mechanism of copper red glaze has been disputed in the academic field for a long time, which mainly focuses on whether the color agent is metallic copper nanoparticles or cuprous oxide (Cu2O) nanoparticles. Based on Mie scattering theory, this work calculated the reflection spectra of nanoparticles uniformly dispersed in transparent glaze with different types, diameters and volume fractions, then discussed the differences between the reflection spectra of metallic copper and cuprous oxide as scatters, calculated the corresponding L*a*b* values, and compared them with the experimental results. This work provides a feasible and convenient method to distinguish these two coloration mechanisms.


title: Wide Effective Work-Function Tuning of Al/SiO$_2$/Si Junction Achieved with Graphene Interlayer at Al/SiO$_2$ Interface

abstract: The effective work-function of metal electrode is one of the major factors to determine the threshold voltage of metal/oxide/semiconductor junction. In this work, we demonstrate experimentally that the effective work-function of Aluminum (Al) electrode in Al/SiO$_2$/n-Si junction increases significantly by $\sim$1.04 eV with the graphene interlayer inserted at Al/SiO$_2$ interface. We also provide the device-physical analysis of solving Poisson equation when the flat-band voltage is applied to the junction, supporting that the wide tuning of Al effective work-function originates from the electrical dipole layer formed by the overlap of electron orbitals between Al and graphene layer. Our work suggests the feasibility of constructing the dual-metal gate CMOS circuitry just by using Al electrodes with area-specific underlying graphene interlayer.


title: Soft MIMO Detection Using Marginal Posterior Probability Statistics

abstract: Soft demodulation of received symbols into bit log-likelihood ratios (LLRs) is at the very heart of multiple-input-multiple-output (MIMO) detection. However, the optimal maximum a posteriori (MAP) detector is complicated and infeasible to be used in a practical system. In this paper, we propose a soft MIMO detection algorithm based on marginal posterior probability statistics (MPPS). With the help of optimal transport theory and order statistics theory, we transform the posteriori probability distribution of each layer into a Gaussian distribution. Then the full sampling paths can be implicitly restored from the first- and second-order moment statistics of the transformed distribution. A lightweight network is designed to learn to recovery the log-MAP LLRs from the moment statistics with low complexity. Simulation results show that the proposed algorithm can improve the performance significantly with reduced samples under fading and correlated channels.


title: High-speed tunable microwave-rate soliton microcomb

abstract: Microwave signal generation with fast frequency tuning underlies many applications including sensing, imaging, ranging, time keeping, wireless communication, and high-speed electronics. Soliton microcombs are a promising new approach for photonic-based microwave signal synthesis. To date, however, tuning rate has been limited in microcombs (and in frequency combs generally). Here, we demonstrate the first microwave-rate soliton microcomb whose repetition rate can be tuned at a high speed. By integrating an electro-optic tuning/modulation element into a lithium niobate comb microresonator, a modulation bandwidth up to 75 MHz and a continuous frequency modulation rate up to 5.0 * 10^14 Hz/s are achieved, several orders-of-magnitude faster than existing microcomb technology. These features are especially useful for disciplining an optical VCO to a long-term reference such as an optical clock or for tight phase lock in dual-microcomb clocks or synthesizers. Moreover, the microwave signal rate can be set to any X - W band rate. Besides its positive impact on microwave photonics, fast repetition rate control is generally important in all applications of frequency combs.


title: Urban feature analysis from aerial remote sensing imagery using self-supervised and semi-supervised computer vision

abstract: Analysis of overhead imagery using computer vision is a problem that has received considerable attention in academic literature. Most techniques that operate in this space are both highly specialised and require expensive manual annotation of large datasets. These problems are addressed here through the development of a more generic framework, incorporating advances in representation learning which allows for more flexibility in analysing new categories of imagery with limited labeled data. First, a robust representation of an unlabeled aerial imagery dataset was created based on the momentum contrast mechanism. This was subsequently specialised for different tasks by building accurate classifiers with as few as 200 labeled images. The successful low-level detection of urban infrastructure evolution over a 10-year period from 60 million unlabeled images, exemplifies the substantial potential of our approach to advance quantitative urban research.


title: REGAS: REspiratory-GAted Synthesis of Views for Multi-Phase CBCT Reconstruction from a single 3D CBCT Acquisition

abstract: It is a long-standing challenge to reconstruct Cone Beam Computed Tomography (CBCT) of the lung under respiratory motion. This work takes a step further to address a challenging setting in reconstructing a multi-phase}4D lung image from just a single}3D CBCT acquisition. To this end, we introduce REpiratory-GAted Synthesis of views, or REGAS. REGAS proposes a self-supervised method to synthesize the undersampled tomographic views and mitigate aliasing artifacts in reconstructed images. This method allows a much better estimation of between-phase Deformation Vector Fields (DVFs), which are used to enhance reconstruction quality from direct observations without synthesis. To address the large memory cost of deep neural networks on high resolution 4D data, REGAS introduces a novel Ray Path Transformation (RPT) that allows for distributed, differentiable forward projections. REGAS require no additional measurements like prior scans, air-flow volume, or breathing velocity. Our extensive experiments show that REGAS significantly outperforms comparable methods in quantitative metrics and visual quality.


title: PDRF: Progressively Deblurring Radiance Field for Fast and Robust Scene Reconstruction from Blurry Images

abstract: We present Progressively Deblurring Radiance Field (PDRF), a novel approach to efficiently reconstruct high quality radiance fields from blurry images. While current State-of-The-Art (SoTA) scene reconstruction methods achieve photo-realistic rendering results from clean source views, their performances suffer when the source views are affected by blur, which is commonly observed for images in the wild. Previous deblurring methods either do not account for 3D geometry, or are computationally intense. To addresses these issues, PDRF, a progressively deblurring scheme in radiance field modeling, accurately models blur by incorporating 3D scene context. PDRF further uses an efficient importance sampling scheme, which results in fast scene optimization. Specifically, PDRF proposes a Coarse Ray Renderer to quickly estimate voxel density and feature; a Fine Voxel Renderer is then used to achieve high quality ray tracing. We perform extensive experiments and show that PDRF is 15X faster than previous SoTA while achieving better performance on both synthetic and real scenes.


title: Neutrinos in Stellar Astrophysics

abstract: The physics of the mysterious and stealthy neutrino is at the heart of many phenomena in the cosmos. These particles interact with matter and with each other through the aptly named weak interaction. At typical astrophysical energies the weak interaction is some twenty orders of magnitude weaker than the electromagnetic interaction. However, in the early universe and in collapsing stars neutrinos can more than make up for their feeble interaction strength with huge numbers. Neutrinos can dominate the dynamics in these sites and set the conditions that govern the synthesis of the elements. Here we journey through the history of the discovery of these particles and describe their role in stellar evolution and collapse, the big bang, and multi-messenger astrophysics. Neutrino physics is at the frontier of elementary particle physics, nuclear physics, astrophysics and cosmology. All of these fields overlap in the neutrino story.


title: Deep-Learning-Aided Voltage-Stability-Enhancing Stochastic Distribution Network Reconfiguration

abstract: Power distribution networks are approaching their voltage stability boundaries due to the severe voltage violations and the inadequate reactive power reserves caused by the increasing renewable generations and dynamic loads. In the broad endeavor to resolve this concern, we focus on enhancing voltage stability through stochastic distribution network reconfiguration (SDNR), which optimizes the (radial) topology of a distribution network under uncertain generations and loads. We propose a deep learning method to solve this computationally challenging problem. Specifically, we build a convolutional neural network model to predict the relevant voltage stability index from the SDNR decisions. Then we integrate this prediction model into successive branch reduction algorithms to reconfigure a radial network with optimized performance in terms of power loss reduction and voltage stability enhancement. Numerical results on two IEEE network models verify the significance of enhancing voltage stability through SDNR and the computational efficiency of the proposed method.


title: Imperceptible and Robust Backdoor Attack in 3D Point Cloud

abstract: With the thriving of deep learning in processing point cloud data, recent works show that backdoor attacks pose a severe security threat to 3D vision applications. The attacker injects the backdoor into the 3D model by poisoning a few training samples with trigger, such that the backdoored model performs well on clean samples but behaves maliciously when the trigger pattern appears. Existing attacks often insert some additional points into the point cloud as the trigger, or utilize a linear transformation (e.g., rotation) to construct the poisoned point cloud. However, the effects of these poisoned samples are likely to be weakened or even eliminated by some commonly used pre-processing techniques for 3D point cloud, e.g., outlier removal or rotation augmentation. In this paper, we propose a novel imperceptible and robust backdoor attack (IRBA) to tackle this challenge. We utilize a nonlinear and local transformation, called weighted local transformation (WLT), to construct poisoned samples with unique transformations. As there are several hyper-parameters and randomness in WLT, it is difficult to produce two similar transformations. Consequently, poisoned samples with unique transformations are likely to be resistant to aforementioned pre-processing techniques. Besides, as the controllability and smoothness of the distortion caused by a fixed WLT, the generated poisoned samples are also imperceptible to human inspection. Extensive experiments on three benchmark datasets and four models show that IRBA achieves 80%+ ASR in most cases even with pre-processing techniques, which is significantly higher than previous state-of-the-art attacks.


title: A Sequence Tagging based Framework for Few-Shot Relation Extraction

abstract: Relation Extraction (RE) refers to extracting the relation triples in the input text. Existing neural work based systems for RE rely heavily on manually labeled training data, but there are still a lot of domains where sufficient labeled data does not exist. Inspired by the distance-based few-shot named entity recognition methods, we put forward the definition of the few-shot RE task based on the sequence tagging joint extraction approaches, and propose a few-shot RE framework for the task. Besides, we apply two actual sequence tagging models to our framework (called Few-shot TPLinker and Few-shot BiTT), and achieves solid results on two few-shot RE tasks constructed from a public dataset.


title: Hierarchical Motion Planning Framework for Cooperative Transportation of Multiple Mobile Manipulators

abstract: Multiple mobile manipulators show superiority in the tasks requiring mobility and dexterity compared with a single robot, especially when manipulating/transporting bulky objects. When the object and the manipulators are rigidly connected, closed-chain will form and the motion of the whole system will be restricted onto a lower-dimensional manifold. However, current research on multi-robot motion planning did not fully consider the formation of the whole system, the redundancy of the mobile manipulator and obstacles in the environment, which make the tasks challenging. Therefore, this paper proposes a hierarchical framework to efficiently solve the above challenges, where the centralized layer plans the object's motion offline and the decentralized layer independently explores the redundancy of each robot in real-time. In addition, closed-chain, obstacle-avoidance and the lower bound of the formation constraints are guaranteed in the centralized layer, which cannot be achieved simultaneously by other planners. Moreover, capability map, which represents the distribution of the formation constraint, is applied to speed up the two layers. Both simulation and experimental results show that the proposed framework outperforms the benchmark planners significantly. The system could bypass or cross obstacles in cluttered environments, and the framework can be applied to different numbers of heterogeneous mobile manipulators.