title: Con-CDVAE: A method for the conditional generation of crystal structures

abstract: In recent years, progress has been made in generating new crystalline materials using generative machine learning models, though gaps remain in efficiently generating crystals based on target properties. This paper proposes the Con-CDVAE model, an extension of the Crystal Diffusion Variational Autoencoder (CDVAE), for conditional crystal generation. We introduce innovative components, design a two-step training method, and develop three unique generation strategies to enhance model performance. The effectiveness of Con-CDVAE is demonstrated through extensive testing under various conditions, including both single and combined property targets. Ablation studies further underscore the critical role of the new components in achieving our model's performance. Additionally, we validate the physical credibility of the generated crystals through Density Functional Theory (DFT) calculations, confirming Con-CDVAE's potential in material science research.


title: Contact structures of type $G_2$ associated to solutions of Noth's equation

abstract: We establish a correspondence between solutions of Noth's equation, a non-linear ordinary differential equation that shows up in the theory of $(2,3,5)$-distributions, and diffeomorphisms of any contact structure of type $G_{2}$ to the standard one.


title: Topological Boundary Modes in Nonlinear Dynamics with Chiral Symmetry

abstract: Particle-hole symmetry and chiral symmetry play a pivotal role in multiple areas of physics, yet they remain unstudied in systems with nonlinear interactions whose nonlinear normal modes do not exhibit $\textbf{U}(1)$-gauge symmetry. In this work, we establish particle-hole symmetry and chiral symmetry in such systems. Chiral symmetry ensures the quantization of the Berry phase of nonlinear normal modes and categorizes the topological phases of nonlinear dynamics. We show topologically protected static boundary modes in chiral-symmetric nonlinear systems. Our theoretical framework extends particle-hole and chiral symmetries to nonlinear dynamics, whose nonlinear modes do not necessarily yield $\textbf{U}(1)$-gauge symmetry.


title: TT-BLIP: Enhancing Fake News Detection Using BLIP and Tri-Transformer

abstract: Detecting fake news has received a lot of attention. Many previous methods concatenate independently encoded unimodal data, ignoring the benefits of integrated multimodal information. Also, the absence of specialized feature extraction for text and images further limits these methods. This paper introduces an end-to-end model called TT-BLIP that applies the bootstrapping language-image pretraining for unified vision-language understanding and generation (BLIP) for three types of information: BERT and BLIP\textsubscript{Txt} for text, ResNet and BLIP\textsubscript{Img} for images, and bidirectional BLIP encoders for multimodal information. The Multimodal Tri-Transformer fuses tri-modal features using three types of multi-head attention mechanisms, ensuring integrated modalities for enhanced representations and improved multimodal data analysis. The experiments are performed using two fake news datasets, Weibo and Gossipcop. The results indicate TT-BLIP outperforms the state-of-the-art models.


title: Embodied LLM Agents Learn to Cooperate in Organized Teams

abstract: Large Language Models (LLMs) have emerged as integral tools for reasoning, planning, and decision-making, drawing upon their extensive world knowledge and proficiency in language-related tasks. LLMs thus hold tremendous potential for natural language interaction within multi-agent systems to foster cooperation. However, LLM agents tend to over-report and comply with any instruction, which may result in information redundancy and confusion in multi-agent cooperation. Inspired by human organizations, this paper introduces a framework that imposes prompt-based organization structures on LLM agents to mitigate these problems. Through a series of experiments with embodied LLM agents and human-agent collaboration, our results highlight the impact of designated leadership on team efficiency, shedding light on the leadership qualities displayed by LLM agents and their spontaneous cooperative behaviors. Further, we harness the potential of LLMs to propose enhanced organizational prompts, via a Criticize-Reflect process, resulting in novel organization structures that reduce communication costs and enhance team efficiency.


title: A Hybrid Transformer-Sequencer approach for Age and Gender classification from in-wild facial images

abstract: The advancements in computer vision and image processing techniques have led to emergence of new application in the domain of visual surveillance, targeted advertisement, content-based searching, and human-computer interaction etc. Out of the various techniques in computer vision, face analysis, in particular, has gained much attention. Several previous studies have tried to explore different applications of facial feature processing for a variety of tasks, including age and gender classification. However, despite several previous studies having explored the problem, the age and gender classification of in-wild human faces is still far from the achieving the desired levels of accuracy required for real-world applications. This paper, therefore, attempts to bridge this gap by proposing a hybrid model that combines self-attention and BiLSTM approaches for age and gender classification problems. The proposed models performance is compared with several state-of-the-art model proposed so far. An improvement of approximately 10percent and 6percent over the state-of-the-art implementations for age and gender classification, respectively, are noted for the proposed model. The proposed model is thus found to achieve superior performance and is found to provide a more generalized learning. The model can, therefore, be applied as a core classification component in various image processing and computer vision problems.


title: Thermoelectric properties of marcasite-type compounds MSb$_2$ (M = Ta, Nb): A combined experimental and computational study

abstract: Here, we investigate the thermoelectric properties of the marcasite-type compounds MSb$_2$ (M = Ta, Nb) in the temperature range of 310-730 K. These compounds were synthesized by a solid-state reaction followed by the spark plasma sintering process. The Rietveld refinement method confirms the monoclinic phase with space group C2/m for both compounds. The observed values of Seebeck coefficients exhibit non-monotonic behaviour in the studied temperature range, with the maximum magnitude of -14.4 and -22.7 $\mu$V K$^{-1}$ for TaSb$_2$ and NbSb$_2$, respectively at ~444 K. The negative sign of S in the full temperature window signifies the n-type behaviour of these compounds. Both electrical and thermal conductivities show an increasing trend with temperature. The experimentally observed thermoelectric properties are understood through the first-principles DFT and Boltzmann transport equation. A pseudogap in the density of states around the Fermi level characterizes the semimetallic behaviour of these compounds. The multi-band electron and hole pockets were found to be mainly responsible for the temperature dependence of transport properties. The experimental power factors are found to be ~0.09 and ~0.42 mW m$^{-1}$ K$^{-2}$ at 310 K for TaSb2 and NbSb2, respectively. From the DFT-based calculations, the maximum possible power factors for p-type conduction are predicted as ~1.14 and ~1.74 mW m$^{-1}$ K$^{-2}$, while these values are found to be ~1.16 and ~1.80 mW m$^{-1}$ K$^{-2}$ for n-type TaSb$_2$ and NbSb$_2$, respectively at 300 K with the corresponding doping concentrations. The present study suggests that the combined DFT and Boltzmann transport theory are found to be reasonably good at explaining the experimental transport properties, and moderate power factors are predicted.


title: Scalar dark matter explanation of the excess in the Belle II $B^+\to K^+ + \mbox{invisible}$ measurement

abstract: Recently Belle II reported the first measurement of $B^+\to K^++\mbox{invisible (inv)}$, which is $2.7\sigma$ above the standard model (SM) prediction. If confirmed, this calls for new physics beyond SM. In the SM, the invisible particles are neutrino-anti-neutrino pairs. There are more possibilities when going beyond the SM. In this work, we focus on decays to dark matter (DM) and show that the $B\to K +\mathrm{inv}$ excess from Belle II and DM relic density can be simultaneously explained in a simple extension of the SM. The model introduces a real scalar singlet $\phi$ acting as a DM candidate, and two heavy vector-like quarks $Q,D$ with the same quantum numbers as the SM left-handed quark doublet and right-handed down-type quark singlet, respectively. All these new particles are odd under a $\mathbb{Z}_2$ symmetry while the SM particles are even. The model can successfully explain the Belle II anomaly and DM relic density for TeV-scale heavy quarks with hierarchical Yukawa couplings involving $b$ and $s$ quarks. At the same time, it can easily satisfy other flavour physics and DM detection constraints.


title: NTK-Guided Few-Shot Class Incremental Learning

abstract: While anti-amnesia FSCIL learners often excel in incremental sessions, they tend to prioritize mitigating knowledge attrition over harnessing the model's potential for knowledge acquisition. In this paper, we delve into the foundations of model generalization in FSCIL through the lens of the Neural Tangent Kernel (NTK). Our primary design focus revolves around ensuring optimal NTK convergence and NTK-related generalization error, serving as the theoretical bedrock for exceptional generalization. To attain globally optimal NTK convergence, we employ a meta-learning mechanism grounded in mathematical principles to guide the optimization process within an expanded network. Furthermore, to reduce the NTK-related generalization error, we commence from the foundational level, optimizing the relevant factors constituting its generalization loss. Specifically, we initiate self-supervised pre-training on the base session to shape the initial network weights. Then they are carefully refined through curricular alignment, followed by the application of dual NTK regularization tailored specifically for both convolutional and linear layers. Through the combined effects of these measures, our network acquires robust NTK properties, significantly enhancing its foundational generalization. On popular FSCIL benchmark datasets, our NTK-FSCIL surpasses contemporary state-of-the-art approaches, elevating end-session accuracy by 2.9% to 8.7%.


title: Unveiling Four Key Factors for Tire Force Control Allocation in 4WID-4WIS Electric Vehicles at Handling Limits

abstract: The four-wheel independent drive and four-wheel independent steering (4WID-4WIS) configurations enhance control flexibility and dynamic performance potential for more integrated electric vehicles. This paper comprehensively analyzes the impacts of four key factors on tire force control allocation: vertical load estimation, actuator dynamic characteristics, tire force constraints, and wheel steering precision at handling limits. The study demonstrates that precise vertical load estimation enhances lateral force allocation accuracy. Additionally, the self-compensating effect of lateral tire forces minimizes the impact of small deviations in vertical load estimation on tire force control allocation. A novel control allocation method considering actuator dynamics is introduced, effectively improving yaw rate response and reducing tracking errors. Considering tire-road adhesion and actuator rate constraints, an innovative method to calculate the real-time attainable tire force volume is proposed based on the tire slip ratio and slip angle. Feedforward control with bump steer compensation is implemented to improve wheel steering precision and lateral tire force control accuracy. Matlab/Simulink and Carsim co-simulation results emphasize the importance of these key factors' individual impacts and combined effects. This analysis offers valuable insights for developing advanced tire force control allocation strategies in 4WID-4WIS electric vehicles.


title: DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLM

abstract: We present DetToolChain, a novel prompting paradigm, to unleash the zero-shot object detection ability of multimodal large language models (MLLMs), such as GPT-4V and Gemini. Our approach consists of a detection prompting toolkit inspired by high-precision detection priors and a new Chain-of-Thought to implement these prompts. Specifically, the prompts in the toolkit are designed to guide the MLLM to focus on regional information (e.g., zooming in), read coordinates according to measure standards (e.g., overlaying rulers and compasses), and infer from the contextual information (e.g., overlaying scene graphs). Building upon these tools, the new detection chain-of-thought can automatically decompose the task into simple subtasks, diagnose the predictions, and plan for progressive box refinements. The effectiveness of our framework is demonstrated across a spectrum of detection tasks, especially hard cases. Compared to existing state-of-the-art methods, GPT-4V with our DetToolChain improves state-of-the-art object detectors by +21.5% AP50 on MS COCO Novel class set for open-vocabulary detection, +24.23% Acc on RefCOCO val set for zero-shot referring expression comprehension, +14.5% AP on D-cube describe object detection FULL setting.


title: Automorphism groups of affine varieties and their Lie algebras

abstract: This is a brief overview of a few selected chapters on automorphism groups of affine varieties. It includes some open questions.


title: Genetically programmable optical random neural networks

abstract: Today, machine learning tools, particularly artificial neural networks, have become crucial for diverse applications. However, current digital computing tools to train and deploy artificial neural networks often struggle with massive data sizes and high power consumptions. Optical computing provides inherent parallelism and perform fundamental operations with passive optical components. However, most of the optical computing platforms suffer from relatively low accuracies for machine learning tasks due to fixed connections while avoiding complex and sensitive techniques. Here, we demonstrate a genetically programmable yet simple optical neural network to achieve high performances with optical random projection. By genetically programming the orientation of the scattering medium which acts as a random projection kernel and only using 1% of the search space, our novel technique finds an optimum kernel and improves its initial test accuracies 7-22% for various machine learning tasks. Our optical computing method presents a promising approach to achieve high performance in optical neural networks with a simple and scalable design.


title: A consistent test of spherical symmetry for multivariate and high-dimensional data via data augmentation

abstract: We develop a test for spherical symmetry of a multivariate distribution $P$ that works even when the dimension of the data $d$ is larger than the sample size $n$. We propose a non-negative measure $\zeta(P)$ such that $\zeta(P)=0$ if and only if $P$ is spherically symmetric. We construct a consistent estimator of $\zeta(P)$ using the data augmentation method and investigate its large sample properties. The proposed test based on this estimator is calibrated using a novel resampling algorithm. Our test controls the Type-I error, and it is consistent against general alternatives. We also study its behaviour for a sequence of alternatives $(1-\delta_n) F+\delta_n G$, where $\zeta(G)=0$ but $\zeta(F)>0$, and $\delta_n \in [0,1]$. When $\lim\sup\delta_n<1$, for any $G$, the power of our test converges to unity as $n$ increases. However, if $\lim\sup\delta_n=1$, the asymptotic power of our test depends on $\lim n(1-\delta_n)^2$. We establish this by proving the minimax rate optimality of our test over a suitable class of alternatives and showing that it is Pitman efficient when $\lim n(1-\delta_n)^2>0$. Moreover, our test is provably consistent for high-dimensional data even when $d$ is larger than $n$. Our numerical results amply demonstrate the superiority of the proposed test over some state-of-the-art methods.


title: A prime decomposition theorem for string links in a thickened surface

abstract: We prove a prime decomposition theorem for string links in a thickened surface. Namely, we prove that any non-braid string link $\ell \subset \Sigma \times I$, where $\Sigma$ is a compact orientable (not necessarily closed) surface other than $S^2$, can be written in the form $\ell =\ell_1 \# \ldots \# \ell_m$, where $\ell_j,j=1,\ldots,m,$ is prime string link defined up to braid-equivalence, and the decomposition is unique up to permuting the order of factors in its right-hand side.


title: A Trainable Feature Extractor Module for Deep Neural Networks and Scanpath Classification

abstract: Scanpath classification is an area in eye tracking research with possible applications in medicine, manufacturing as well as training systems for students in various domains. In this paper we propose a trainable feature extraction module for deep neural networks. The purpose of this module is to transform a scanpath into a feature vector which is directly useable for the deep neural network architecture. Based on the backpropagated error of the deep neural network, the feature extraction module adapts its parameters to improve the classification performance. Therefore, our feature extraction module is jointly trainable with the deep neural network. The motivation to this feature extraction module is based on classical histogram-based approaches which usually compute distributions over a scanpath. We evaluated our module on three public datasets and compared it to the state of the art approaches.


title: Task-Customized Mixture of Adapters for General Image Fusion

abstract: General image fusion aims at integrating important information from multi-source images. However, due to the significant cross-task gap, the respective fusion mechanism varies considerably in practice, resulting in limited performance across subtasks. To handle this problem, we propose a novel task-customized mixture of adapters (TC-MoA) for general image fusion, adaptively prompting various fusion tasks in a unified model. We borrow the insight from the mixture of experts (MoE), taking the experts as efficient tuning adapters to prompt a pre-trained foundation model. These adapters are shared across different tasks and constrained by mutual information regularization, ensuring compatibility with different tasks while complementarity for multi-source images. The task-specific routing networks customize these adapters to extract task-specific information from different sources with dynamic dominant intensity, performing adaptive visual feature prompt fusion. Notably, our TC-MoA controls the dominant intensity bias for different fusion tasks, successfully unifying multiple fusion tasks in a single model. Extensive experiments show that TC-MoA outperforms the competing approaches in learning commonalities while retaining compatibility for general image fusion (multi-modal, multi-exposure, and multi-focus), and also demonstrating striking controllability on more generalization experiments. The code is available at https://github.com/YangSun22/TC-MoA .


title: NSGAN: A Non-Dominant Sorting Optimisation-Based Generative Adversarial Design Framework for Alloy Discovery

abstract: The design and discovery of new materials is fundamental to advancing scientific and technological innovation. The recent emergence of the materials genome concept holds great promise in revolutionising materials science by enabling the systematic utilisation of data for efficient prediction and optimisation of superior materials. However, the materials genome approach can be stymied by the vast complexity of design spaces, which often demand substantial computational resources and sophisticated data processing capabilities. To address these challenges, this work introduces a novel generative design framework called the non-dominant sorting optimisation-based generative adversarial networks (NSGAN). Capitalising on the synergies of genetic algorithms (GA) and generative adversarial networks (GANs), NSGAN provides a robust and efficient approach for tackling high-dimensional multi-objective optimisation design problems. To validate the efficacy of the proposed framework, we applied the model to a comprehensive dataset of aluminium alloys. Additionally, an online tool was created as a supplementary resource, offering a brief introduction to this innovative method for the wider scientific community. This study explores the potential of a predictive and data-driven approach in material design, indicating a promising pathway for widespread applications in the field of materials science.


title: Impact of the Russia-Ukraine conflict on the international staple agrifood trade networks

abstract: The Russia-Ukraine conflict is a growing concern worldwide and poses serious threats to regional and global food security. Using monthly trade data for maize, rice, and wheat from 2016/1 to 2022/12, this paper constructs three international crop trade networks (iCTNs) and an aggregate international food trade network (iFTN). We aim to examine the structural changes following the occurrence of the Russia-Ukraine conflict. We find significant shifts in the number of edges, average degree, density, efficiency, and natural connectivity in the third quarter of 2022, particularly in the international wheat trade network. Additionally, we have shown that political reasons have caused more pronounced changes in the trade connections between the economies of the North Atlantic Treaty Organization and Russia than with Ukraine. This paper could provide insights into the negative impact of geopolitical conflicts on the global food system and encourage a series of effective strategies to mitigate the negative impact of the conflict on global food trade.


title: Formation of Polar Crown Filaments Magnetic Fields by Supergranular Helicity Injection

abstract: To understand the magnetic fields of the polar crown filaments (PCFs) at high latitudes near polar regions of the Sun, we perform magnetofrictional numerical simulations on the long-term magnetic evolution of bipolar fields with roughly east-west polarity inversion lines (PILs) in a three-dimensional (3D) spherical wedge domain near polar regions. The Coriolis effect induced vortical motions at the boundaries of several supergranular cells inject magnetic helicity from the photospheric boundary into the solar atmosphere. Supergranular-scale helicity injection, transfer, and condensation produce strongly sheared magnetic fields. Magnetic reconnections at footpoints of the sheared fields produce magnetic flux ropes (MFRs) with helicity signs consistent with the observed Hemispheric Helicity Rule (HHR). The cross-sectional area of MFRs exhibits an uneven distribution, resembling a "foot-node-foot" periodic configuration. Experiments with different tilt directions of PILs indicate that the PCFs preferably form along PILs with the western end close to the polar region. The bending of PILs caused by supergranular flows, forming S-shape (Z-shape) PIL segments, promotes the formation of dextral (sinistral) MFRs. The realistic magnetic models we got can serve as starting points for the study of the plasma formation and eruption of PCFs.


title: WMMSE-Based Rate Maximization for RIS-Assisted MU-MIMO Systems

abstract: Reconfigurable intelligent surface (RIS) technology, given its ability to favorably modify wireless communication environments, will play a pivotal role in the evolution of future communication systems. This paper proposes rate maximization techniques for both single-user and multiuser MIMO systems, based on the well-known weighted minimum mean square error (WMMSE) criterion. Using a suitable weight matrix, the WMMSE algorithm tackles an equivalent weighted mean square error (WMSE) minimization problem to achieve the sum-rate maximization. By considering a more practical RIS system model that employs a tensor-based representation enforced by the electromagnetic behavior exhibited by the RIS panel, we detail both the sum-rate maximizing and WMSE minimizing strategies for RIS phase shift optimization by deriving the closed-form gradient of the WMSE and the sum-rate with respect to the RIS phase shift vector. Our simulations reveal that the proposed rate maximization technique, rooted in the WMMSE algorithm, exhibits superior performance when compared to other benchmarks.


title: Listwise Generative Retrieval Models via a Sequential Learning Process

abstract: Recently, a novel generative retrieval (GR) paradigm has been proposed, where a single sequence-to-sequence model is learned to directly generate a list of relevant document identifiers (docids) given a query. Existing GR models commonly employ maximum likelihood estimation (MLE) for optimization: this involves maximizing the likelihood of a single relevant docid given an input query, with the assumption that the likelihood for each docid is independent of the other docids in the list. We refer to these models as the pointwise approach in this paper. While the pointwise approach has been shown to be effective in the context of GR, it is considered sub-optimal due to its disregard for the fundamental principle that ranking involves making predictions about lists. In this paper, we address this limitation by introducing an alternative listwise approach, which empowers the GR model to optimize the relevance at the docid list level. Specifically, we view the generation of a ranked docid list as a sequence learning process: at each step we learn a subset of parameters that maximizes the corresponding generation likelihood of the $i$-th docid given the (preceding) top $i-1$ docids. To formalize the sequence learning process, we design a positional conditional probability for GR. To alleviate the potential impact of beam search on the generation quality during inference, we perform relevance calibration on the generation likelihood of model-generated docids according to relevance grades. We conduct extensive experiments on representative binary and multi-graded relevance datasets. Our empirical results demonstrate that our method outperforms state-of-the-art GR baselines in terms of retrieval performance.


title: A Large Collection of Model-generated Contradictory Responses for Consistency-aware Dialogue Systems

abstract: Mitigating the generation of contradictory responses poses a substantial challenge in dialogue response generation. The quality and quantity of available contradictory response data play a vital role in suppressing these contradictions, offering two significant benefits. First, having access to large contradiction data enables a comprehensive examination of their characteristics. Second, data-driven methods to mitigate contradictions may be enhanced with large-scale contradiction data for training. Nevertheless, no attempt has been made to build an extensive collection of model-generated contradictory responses. In this paper, we build a large dataset of response generation models' contradictions for the first time. Then, we acquire valuable insights into the characteristics of model-generated contradictions through an extensive analysis of the collected responses. Lastly, we also demonstrate how this dataset substantially enhances the performance of data-driven contradiction suppression methods.


title: Multilevel Markov Chain Monte Carlo for Bayesian inverse problems for Navier Stokes equation with Lagrangian Observations

abstract: In this paper, we extend our work to the Bayesian inverse problems for inferring unknown forcing and initial condition of the forward Navier-Stokes equation coupled with tracer equation with noisy Lagrangian observation on the positions of the tracers. We consider the Navier-Stokes equations in the two dimensional periodic torus with a tracer equation which is a simple ordinary differential equation. We developed rigorously the theory for the case of the uniform prior where the forcing and the initial condition depend linearly on a countable set of random variables which are uniformly distributed in a compact interval. Numerical experiment using the MLMCMC method produces approximations for posterior expectation of quantities of interest which are in agreement with the theoretical optimal convergence rate established.


title: Under-actuated Robotic Gripper with Multiple Grasping Modes Inspired by Human Finger

abstract: Under-actuated robot grippers as a pervasive tool of robots have become a considerable research focus. Despite their simplicity of mechanical design and control strategy, they suffer from poor versatility and weak adaptability, making widespread applications limited. To better relieve relevant research gaps, we present a novel 3-finger linkage-based gripper that realizes retractable and reconfigurable multi-mode grasps driven by a single motor. Firstly, inspired by the changes that occurred in the contact surface with a human finger moving, we artfully design a slider-slide rail mechanism as the phalanx to achieve retraction of each finger, allowing for better performance in the enveloping grasping mode. Secondly, a reconfigurable structure is constructed to broaden the grasping range of objects' dimensions for the proposed gripper. By adjusting the configuration and gesture of each finger, the gripper can achieve five grasping modes. Thirdly, the proposed gripper is just actuated by a single motor, yet it can be capable of grasping and reconfiguring simultaneously. Finally, various experiments on grasps of slender, thin, and large-volume objects are implemented to evaluate the performance of the proposed gripper in practical scenarios, which demonstrates the excellent grasping capabilities of the gripper.


title: Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices

abstract: Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations. Nevertheless, alongside their remarkable utility, LLMs introduce critical security and risk considerations. These challenges warrant careful examination to ensure responsible deployment and safeguard against potential vulnerabilities. This research paper thoroughly investigates security and privacy concerns related to LLMs from five thematic perspectives: security and privacy concerns, vulnerabilities against adversarial attacks, potential harms caused by misuses of LLMs, mitigation strategies to address these challenges while identifying limitations of current strategies. Lastly, the paper recommends promising avenues for future research to enhance the security and risk management of LLMs.


title: TON-VIO: Online Time Offset Modeling Networks for Robust Temporal Alignment in High Dynamic Motion VIO

abstract: Temporal misalignment (time offset) between sensors is common in low cost visual-inertial odometry (VIO) systems. Such temporal misalignment introduces inconsistent constraints for state estimation, leading to a significant positioning drift especially in high dynamic motion scenarios. In this article, we focus on online temporal calibration to reduce the positioning drift caused by the time offset for high dynamic motion VIO. For the time offset observation model, most existing methods rely on accurate state estimation or stable visual tracking. For the prediction model, current methods oversimplify the time offset as a constant value with white Gaussian noise. However, these ideal conditions are seldom satisfied in real high dynamic scenarios, resulting in the poor performance. In this paper, we introduce online time offset modeling networks (TON) to enhance real-time temporal calibration. TON improves the accuracy of time offset observation and prediction modeling. Specifically, for observation modeling, we propose feature velocity observation networks to enhance velocity computation for features in unstable visual tracking conditions. For prediction modeling, we present time offset prediction networks to learn its evolution pattern. To highlight the effectiveness of our method, we integrate the proposed TON into both optimization-based and filter-based VIO systems. Simulation and real-world experiments are conducted to demonstrate the enhanced performance of our approach. Additionally, to contribute to the VIO community, we will open-source the code of our method on: https://github.com/Franky-X/FVON-TPN.


title: Semantics, Distortion, and Style Matter: Towards Source-free UDA for Panoramic Segmentation

abstract: This paper addresses an interesting yet challenging problem -- source-free unsupervised domain adaptation (SFUDA) for pinhole-to-panoramic semantic segmentation -- given only a pinhole image-trained model (i.e., source) and unlabeled panoramic images (i.e., target). Tackling this problem is nontrivial due to the semantic mismatches, style discrepancies, and inevitable distortion of panoramic images. To this end, we propose a novel method that utilizes Tangent Projection (TP) as it has less distortion and meanwhile slits the equirectangular projection (ERP) with a fixed FoV to mimic the pinhole images. Both projections are shown effective in extracting knowledge from the source model. However, the distinct projection discrepancies between source and target domains impede the direct knowledge transfer; thus, we propose a panoramic prototype adaptation module (PPAM) to integrate panoramic prototypes from the extracted knowledge for adaptation. We then impose the loss constraints on both predictions and prototypes and propose a cross-dual attention module (CDAM) at the feature level to better align the spatial and channel characteristics across the domains and projections. Both knowledge extraction and transfer processes are synchronously updated to reach the best performance. Extensive experiments on the synthetic and real-world benchmarks, including outdoor and indoor scenarios, demonstrate that our method achieves significantly better performance than prior SFUDA methods for pinhole-to-panoramic adaptation.


title: Sparse Estimation for XL-MIMO with Unified LoS/NLoS Representation

abstract: Extremely large-scale antenna array (ELAA) is promising as one of the key ingredients for the sixth generation (6G) of wireless communications. The electromagnetic propagation of spherical wavefronts introduces an additional distance-dependent dimension beyond conventional beamspace. In this paper, we first present one concise closed-form channel formulation for extremely large-scale multiple-input multiple-output (XL-MIMO). All line-of-sight (LoS) and non-line-of-sight (NLoS) paths, far-field and near-field scenarios, and XL-MIMO and XL-MISO channels are unified under the framework, where additional Vandermonde windowing matrix is exclusively considered for LoS path. Under this framework, we further propose one low-complexity unified LoS/NLoS orthogonal matching pursuit (XL-UOMP) algorithm for XL-MIMO channel estimation. The simulation results demonstrate the superiority of the proposed algorithm on both estimation accuracy and pilot consumption.


title: Nanoscale brittle-to-ductile transition of the C15 CaAl$_2$ Laves phase

abstract: The influence of temperature on the deformation behaviour of the C15 CaAl$_2$ Laves phase, a key constituent for enhancing the mechanical properties of Mg alloys up to service temperatures of 200 {\deg}C, remains largely unexplored. This study presents, for the first time, the nanoscale brittle-to-ductile transition (BDT) of this intermetallic phase through in situ testing including nanoindentation, scratch testing, and micropillar splitting conducted at elevated temperatures. By correlating observations from these techniques, changes in deformation of CaAl$_2$ were identified in relation to temperature. High-temperature nanoindentation quantitatively determined the temperature range for the BDT, and revealed that CaAl$_2$ undergoes a BDT at ~0.55T$_m$, exhibiting an intermediate region of microplasticity. A noticeable decrease in nanoindentation hardness was observed at ~450-500 {\deg}C, accompanied by an increase in residual indent size, while indentation cracking was not observed above 300 {\deg}C. Results from high-temperature micropillar splitting revealed cracking and brittle pillar splitting up to 300 {\deg}C, with an increase in apparent fracture toughness from 0.9 $\pm$ 0.1 MPa$\cdot\sqrt m$ to 2.8 $\pm$ 0.3 MPa$\cdot\sqrt m$, and subsequent crack-free plastic deformation from 400 {\deg}C. Transmission electron microscopy analysis of the deformed material from nanoindentation revealed that the BDT of CaAl$_2$ may be attributed to enhanced dislocation plasticity with increasing temperature.


title: Photocurrent generation in solids via linearly polarized laser

abstract: To add to the rapidly progressing field of ultrafast photocurrent, we propose a universal method to generate photocurrent in normal and topological materials using a pair of multicycle linearly polarized laser pulses. The interplay of the fundamental and its second harmonic pulses is studied for the generation of photocurrent in Weyl semimetals by varying the angle between the polarization direction, relative intensity, and relative phase delay. It has been found that the presence of a comparatively weaker second harmonic pulse is sufficient to generate substantial photocurrent. Moreover, significant photocurrent is generated even when polarization directions are orthogonal for certain ratios of the lasers' intensities. In addition, the photocurrent is found to be susceptible to the delay between the two pulses. We have illustrated that all our findings are extendable to non-topological and two-dimensional materials, such as graphene and molybdenum disulfide.


title: Fractional regularity, global persistence, and asymptotic properties of the Boussinesq equations on bounded domains

abstract: We address the long-time behavior of the 2D Boussinesq system, which consists of the incompressible Navier-Stokes equations driven by a non-diffusive density. We construct globally persistent solutions on a smooth bounded domain, when the initial data belongs to $(H^k\cap V)\times H^k$ for $k\in\mathbb{N}$ and $H^s\times H^s$ for $0<s<2$. The proofs use parabolic maximal regularity and specific compatibility conditions at the initial time. Additionally, we also deduce various asymptotic properties of the velocity and density in the long-time limit and present a necessary and sufficient condition for the convergence to a steady state.


title: Generalized Consistency Trajectory Models for Image Manipulation

abstract: Diffusion-based generative models excel in unconditional generation, as well as on applied tasks such as image editing and restoration. The success of diffusion models lies in the iterative nature of diffusion: diffusion breaks down the complex process of mapping noise to data into a sequence of simple denoising tasks. Moreover, we are able to exert fine-grained control over the generation process by injecting guidance terms into each denoising step. However, the iterative process is also computationally intensive, often taking from tens up to thousands of function evaluations. Although consistency trajectory models (CTMs) enable traversal between any time points along the probability flow ODE (PFODE) and score inference with a single function evaluation, CTMs only allow translation from Gaussian noise to data. Thus, this work aims to unlock the full potential of CTMs by proposing generalized CTMs (GCTMs), which translate between arbitrary distributions via ODEs. We discuss the design space of GCTMs and demonstrate their efficacy in various image manipulation tasks such as image-to-image translation, restoration, and editing. Code: \url{https://github.com/1202kbs/GCTM}


title: Forward Gradient-Based Frank-Wolfe Optimization for Memory Efficient Deep Neural Network Training

abstract: Training a deep neural network using gradient-based methods necessitates the calculation of gradients at each level. However, using backpropagation or reverse mode differentiation, to calculate the gradients necessities significant memory consumption, rendering backpropagation an inefficient method for computing gradients. This paper focuses on analyzing the performance of the well-known Frank-Wolfe algorithm, a.k.a. conditional gradient algorithm by having access to the forward mode of automatic differentiation to compute gradients. We provide in-depth technical details that show the proposed Algorithm does converge to the optimal solution with a sub-linear rate of convergence by having access to the noisy estimate of the true gradient obtained in the forward mode of automated differentiation, referred to as the Projected Forward Gradient. In contrast, the standard Frank-Wolfe algorithm, when provided with access to the Projected Forward Gradient, fails to converge to the optimal solution. We demonstrate the convergence attributes of our proposed algorithms using a numerical example.


title: Uranus and Neptune as methane planets: producing icy giants from refractory planetesimals

abstract: Uranus and Neptune are commonly considered ice giants, and it is often assumed that, in addition to a solar mix of hydrogen and helium, they contain roughly twice as much water as rock. This classical picture has led to successful models of their internal structure and has been understood to be compatible with the composition of the solar nebula during their formation (Reynolds and Summers 1965; Podolak and Cameron 1974; Podolak and Reynolds 1984; Podolak et al. 1995; Nettelmann et al. 2013). However, the dominance of water has been recently questioned (Teanby et al. 2020; Helled and Fortney 2020; Podolak et al. 2022). Planetesimals in the outer solar system are composed mainly of refractory materials, leading to an inconsistency between the icy composition of Uranus and Neptune and the ice-poor planetesimals they accreted during formation (Podolak et al. 2022). Here we elaborate on this problem, and propose a new potential solution. We show that chemical reactions between planetesimals dominated by organic-rich refractory materials and the hydrogen in gaseous atmospheres of protoplanets can form large amounts of methane 'ice'. Uranus and Neptune could thus be compatible with having accreted refractory-dominated planetesimals, while still remaining icy. Using random statistical computer models for a wide parameter space, we show that the resulting methane-rich internal composition could be a natural solution, giving a good match to the size, mass and moment of inertia of Uranus and Neptune, whereas rock-rich models appear to only work if a rocky interior is heavily mixed with hydrogen. Our model predicts a lower than solar hydrogen to helium ratio, which can be tested. We conclude that Uranus, Neptune and similar exoplanets could be methane-rich, and discuss why Jupiter and Saturn cannot.


title: Classifying Triebel-Lizorkin capacities in metric spaces

abstract: We study non-local or fractional capacities in metric measure spaces. Our main goal is to clarify the relations between relative Hajlasz-Triebel-Lizorkin capacities, potentional Triebel-Lizorkin capacities, and metric space variants of Riesz capacities. As an application of our results, we obtain a characterization of a Hajlasz-Triebel-Lizorkin capacity density condition, which is based on an earlier characterization of a Riesz capacity density condition in terms of Hausdorff contents.


title: One family of dark-bright solitons with striking width differences

abstract: Most of previously reported dark-bright solitons admit identical width for the two components in both theoretical and experimental studies. We report dark-bright solitons can admit strikingly different widths, and derive a family of analytical solutions for them by Lagrangian variational method. The existence regimes for these solitons become much more widespread in the space of nonlinear parameters, than the ones for the previously known dark-bright solitons with identical width. Our analysis indicates that the effective quantum wells are quite different in the two components, in sharp contrast to the ones for all previously known vector solitons. Especially, the particle number of bright soliton can be used to control the generation of dark-bright solitons with varied ratios of solitons' widths. Based on the current experimental technologies, we propose an experimental scheme for observing these novel dark-bright solitons. The results suggest that abundant vector solitons with difference widths exist in multi-components coupled systems, and would inspire experiments to observe them in nonlinear optical fibers, Bose-Einstein condensates, and other nonlinear coupled systems.


title: Recent advances in the theory of the BCS-BEC crossover for fermionic superfluidity

abstract: The BCS-BEC crossover realized experimentally with ultra-cold Fermi gases may be considered as one of the important scientific achievements occurred during the last several years. The flexibility for operating on these systems on the experimental side and the full control of the relevant system degrees of freedom on the theoretical side make quite stringent at a fundamental level the comparison between the experimental data and the corresponding theoretical calculations. Here, we briefly survey recent theoretical advances resting on a diagrammatic approach at equilibrium that improves in a systematic way on the widely used t-matrix approach, yielding a quite good comparison between theory and experiments for several physical quantities of interest. It is proposed that the physical phenomena underlying this theoretical approach may also be relevant to the superconducting phase of condensed-matter materials which cannot be described by the standard BCS theory.


title: Relations between Chebyshev, Fibonacci and Lucas polynomials via trigonometric sums

abstract: In this paper we derive some new identities involving the Fibonacci and Lucas polynomials and the Chebyshev polynomials of the first and the second kind. Our starting point is a finite trigonometric sum which equals the resolvent kernel on the discrete circle with $m$ vertices and which can be evaluated in two different ways. An expression for this sum in terms of the Chebyshev polynomials was deduced in \cite{JKS} and the expression in terms of the Fibonacci and Lucas polynomials is deduced in this paper. As a consequence, we establish some further identities involving trigonometric sums and Fibonacci, Lucas, Pell and Pell-Lucas polynomials and numbers, thus providing a "physical" interpretation for those identities. Moreover, the finite trigonometric sum of the type considered in this paper can be related to the effective resistance between any two vertices of the $N$-cycle graph with four nearest neighbors $C_{N}(1,2)$. This yields further identities involving Fibonacci numbers.


title: On decompositions for Fano schemes of intersections of two quadrics

abstract: We propose conjectural semiorthogonal decompositions for Fano schemes of linear subspaces on intersections of two quadrics, in terms of symmetric powers of the associated hyperelliptic (resp. stacky) curve. When the intersection is odd-dimensional, we moreover conjecture an identity in the Grothendieck ring of varieties and other motivic contexts. The evidence for these conjectures is given by upgrading recent results of Chen-Vilonen-Xue, to obtain formulae for the Hodge numbers of these Fano schemes. This allows us to numerically verify the conjecture in the hyperelliptic case, and establish a combinatorial identity as evidence for the stacky case.


title: Neural canonical transformations for vibrational spectra of molecules

abstract: The behavior of polyatomic molecules around their equilibrium positions can be regarded as quantum coupled anharmonic oscillators. Solving the corresponding Schr\"odinger equations can interpret or predict experimental spectra of molecules. In this study, we develop a novel approach to solve excited states of anharmonic vibrational systems. The normal coordinates of molecules are transformed into new coordinates through a normalizing flow parameterized by a neural network, facilitating the construction of a set of orthogonal many-body variational wavefunctions. Our methodology has been validated on an exactly solvable $64$-dimensional coupled harmonic oscillator, yielding numerical results with a relative error on the order of $10^{-6}$. Furthermore, the neural canonical transformations are also applied to calculate the energy levels of two specific molecules, acetonitrile ($\text{C}\text{H}_3\text{CN}$) and ethylene oxide ($\text{C}_2\text{H}_4\text{O}$) involving $12$ and $15$ vibrational modes respectively, which are in agreement with experimental findings. One of the key advantages of our approach is its flexibility concerning the potential energy surface, requiring no specific form for its application. Moreover, this method can be easily implemented on large-scale distributed computing platforms, making it particularly suitable for investigating more complex vibrational structures.


title: Dynamic Spatial-Temporal Aggregation for Skeleton-Aware Sign Language Recognition

abstract: Skeleton-aware sign language recognition (SLR) has gained popularity due to its ability to remain unaffected by background information and its lower computational requirements. Current methods utilize spatial graph modules and temporal modules to capture spatial and temporal features, respectively. However, their spatial graph modules are typically built on fixed graph structures such as graph convolutional networks or a single learnable graph, which only partially explore joint relationships. Additionally, a simple temporal convolution kernel is used to capture temporal information, which may not fully capture the complex movement patterns of different signers. To overcome these limitations, we propose a new spatial architecture consisting of two concurrent branches, which build input-sensitive joint relationships and incorporates specific domain knowledge for recognition, respectively. These two branches are followed by an aggregation process to distinguishe important joint connections. We then propose a new temporal module to model multi-scale temporal information to capture complex human dynamics. Our method achieves state-of-the-art accuracy compared to previous skeleton-aware methods on four large-scale SLR benchmarks. Moreover, our method demonstrates superior accuracy compared to RGB-based methods in most cases while requiring much fewer computational resources, bringing better accuracy-computation trade-off. Code is available at https://github.com/hulianyuyy/DSTA-SLR.


title: First Measurement of the $\nu_e$ and $\nu_\mu$ Interaction Cross Sections at the LHC with FASER's Emulsion Detector

abstract: This paper presents the first results of the study of high-energy electron and muon neutrino charged-current interactions in the FASER$\nu$ emulsion/tungsten detector of the FASER experiment at the LHC. A subset of the FASER$\nu$ volume, which corresponds to a target mass of 128.6~kg, was exposed to neutrinos from the LHC $pp$ collisions with a centre-of-mass energy of 13.6~TeV and an integrated luminosity of 9.5 fb$^{-1}$. Applying stringent selections requiring electrons with reconstructed energy above 200~GeV, four electron neutrino interaction candidate events are observed with an expected background of $0.025^{+0.015}_{-0.010}$, leading to a statistical significance of 5.2$\sigma$. This is the first direct observation of electron neutrino interactions at a particle collider. Eight muon neutrino interaction candidate events are also detected, with an expected background of $0.22^{+0.09}_{-0.07}$, leading to a statistical significance of 5.7$\sigma$. The signal events include neutrinos with energies in the TeV range, the highest-energy electron and muon neutrinos ever detected from an artificial source. The energy-independent part of the interaction cross section per nucleon is measured over an energy range of 560--1740 GeV (520--1760 GeV) for $\nu_e$ ($\nu_{\mu}$) to be $(1.2_{-0.7}^{+0.8}) \times 10^{-38}~\mathrm{cm}^{2}\,\mathrm{GeV}^{-1}$ ($(0.5\pm0.2) \times 10^{-38}~\mathrm{cm}^{2}\,\mathrm{GeV}^{-1}$), consistent with Standard Model predictions. These are the first measurements of neutrino interaction cross sections in those energy ranges.


title: Multi-mode Fault Diagnosis Datasets of Gearbox Under Variable Working Conditions

abstract: The gearbox is a critical component of electromechanical systems. The occurrence of multiple faults can significantly impact system accuracy and service life. The vibration signal of the gearbox is an effective indicator of its operational status and fault information. However, gearboxes in real industrial settings often operate under variable working conditions, such as varying speeds and loads. It is a significant and challenging research area to complete the gearbox fault diagnosis procedure under varying operating conditions using vibration signals. This data article presents vibration datasets collected from a gearbox exhibiting various fault degrees of severity and fault types, operating under diverse speed and load conditions. These faults are manually implanted into the gears or bearings through precise machining processes, which include health, missing teeth, wear, pitting, root cracks, and broken teeth. Several kinds of actual compound faults are also encompassed. The development of these datasets facilitates testing the effectiveness and reliability of newly developed fault diagnosis methods.


title: Hybrid star within $f(\mathcal{G})$ gravity

abstract: The purpose of this work is to investigate some interesting features of a static anisotropic relativistic stellar object composed of two different types of fluid distributions typically termed as quark matter (QM) and ordinary baryonic matter (OBM) together with Krori-Barua type (KB) {\em ansatz} in the regime of modified $f(\mathcal{G})$ gravity, where $\mathcal{G}$ being the Gauss-Bonnet invariant term. In order to explain the correlation between pressure and matter density for the quark matter distribution within the compact object, we have taken into consideration the well-known MIT bag equation of state (EoS) whereas there is a simple linear correlation between pressure and matter density for ordinary baryonic matter. Furthermore, using graphical representations for varying parameters, the physical credibility of our obtained solutions has been intensively examined by regularity checking of the metric coefficients and matter variables, energy conditions, mass function, and causality conditions. For these analyses, we consider a particular compact stellar candidate 4U 1538-52. Finally, we found that the resulting outcome depicts the viability of the considered hybrid stellar model.


title: GraphERE: Jointly Multiple Event-Event Relation Extraction via Graph-Enhanced Event Embeddings

abstract: Events describe the state changes of entities. In a document, multiple events are connected by various relations (e.g., Coreference, Temporal, Causal, and Subevent). Therefore, obtaining the connections between events through Event-Event Relation Extraction (ERE) is critical to understand natural language. There are two main problems in the current ERE works: a. Only embeddings of the event triggers are used for event feature representation, ignoring event arguments (e.g., time, place, person, etc.) and their structure within the event. b. The interconnection between relations (e.g., temporal and causal relations usually interact with each other ) is ignored. To solve the above problems, this paper proposes a jointly multiple ERE framework called GraphERE based on Graph-enhanced Event Embeddings. First, we enrich the event embeddings with event argument and structure features by using static AMR graphs and IE graphs; Then, to jointly extract multiple event relations, we use Node Transformer and construct Task-specific Dynamic Event Graphs for each type of relation. Finally, we used a multi-task learning strategy to train the whole framework. Experimental results on the latest MAVEN-ERE dataset validate that GraphERE significantly outperforms existing methods. Further analyses indicate the effectiveness of the graph-enhanced event embeddings and the joint extraction strategy.


title: Search for GeV gamma-ray emission from the possible TeV-bright red dwarfs with Fermi-LAT

abstract: Red dwarfs have been suggested to be among the possible astrophysical species accelerating particles and emitting TeV $\gamma$-rays. As an effort to search for the GeV $\gamma$-ray counterparts of the suggested TeV emission from eight red dwarfs, we analyse the 0.2--500 GeV $\gamma$-ray emission of the regions covering them exploiting the $\sim$13.6 yr Pass 8 data of the Fermi Large Area Telescope. A GeV $\gamma$-ray emission excess with significance of 3.8$\sigma$ is detected in the direction of the red dwarf V962 Tau. This emission contains V962 Tau in 1$\sigma$ error radius and is independent of the catalog source. However, the stellar flare scenario can hardly explain the total energy and lightcurve derived from the $\gamma$-ray emission in view of the spectral analysis. We also analyse the lightcurves in the positions of the eight red dwarfs and no time bin with significance $>$5$\sigma$ is found. Therefore, no significant emission from the red dwarfs could be concluded to be detected by Fermi-LAT.


title: Freezing and BPS jumping

abstract: We report a novel BPS jumping phenomenon of 5d $\mathcal{N}=1$ supersymmetric gauge theories whose brane configuration is equipped with an O$7$-plane. The study of the relation between O$7{}^+$-plane and O$7{}^-$-plane reveals that such BPS jumps take place when the Higgsing is triggered near the O7-plane upon a particular parameter tuning of the theories. We propose two types of gauge theories whose BPS spectra jump. One is the SU($2N+8$) gauge theory with a symmetric hypermultiplet converted to the SU($2N$) gauge theory with an antisymmetric hypermultiplet. The other is pure SO($2N+8$) gauge theory jumping to pure Sp($N$) gauge theory. We explicitly confirm our proposal through the (un)refined instanton partition functions. Furthermore, we discuss feasible generalizations involving an O$p$-plane for supersymmetric gauge theories of eight supercharges in four and three dimensions ($p=6, 5$ respectively).


title: Prompt-based Graph Model for Joint Liberal Event Extraction and Event Schema Induction

abstract: Events are essential components of speech and texts, describing the changes in the state of entities. The event extraction task aims to identify and classify events and find their participants according to event schemas. Manually predefined event schemas have limited coverage and are hard to migrate across domains. Therefore, the researchers propose Liberal Event Extraction (LEE), which aims to extract events and discover event schemas simultaneously. However, existing LEE models rely heavily on external language knowledge bases and require the manual development of numerous rules for noise removal and knowledge alignment, which is complex and laborious. To this end, we propose a Prompt-based Graph Model for Liberal Event Extraction (PGLEE). Specifically, we use a prompt-based model to obtain candidate triggers and arguments, and then build heterogeneous event graphs to encode the structures within and between events. Experimental results prove that our approach achieves excellent performance with or without predefined event schemas, while the automatically detected event schemas are proven high quality.


title: Irreducible modules over N=2 superconformal algebras from algebraic D-modules

abstract: In this paper, we introduce a family of functors denoted $\mathscr{F}_b$ that act on algebraic D-modules and generate modules over N=2 superconformal algebras. We prove these functors preserve irreducibility for all values of $b$, with a few clear exceptions described. We also establish necessary and sufficient conditions to determine when two such functors are naturally isomorphic. Applying $\mathscr{F}_b$ to N=1 super-Virasoro algebras recovers the functors previously introduced in \cite{CDLP}. Our new functors also facilitate the recovery of specific irreducible modules over N=2 superconformal algebras, including intermediate series and $U(\mathfrak{h})$-free modules. Additionally, our constructed functors produce several new irreducible modules for N=2 superconformal algebras.


title: Characteristic subgroups and the R$_\infty$-property for virtual braid groups

abstract: Let $n\geq 2$. Let $VB_n$ (resp. $VP_n$) denote the virtual braid group (resp. virtual pure braid group), let $WB_n$ (resp. $WP_n$) denote the welded braid group (resp. welded pure braid group) and let $UVB_n$ (resp. $UVP_n$) denote the unrestricted virtual braid group (resp. unrestricted virtual pure braid group). In the first part of this paper we prove that, for $n\geq 4$, the group $VP_n$ and for $n\geq 3$ the groups $WP_n$ and $UVP_n$ are characteristic subgroups of $VB_n$, $WB_n$ and $UVB_n$, respectively. In the second part of the paper we show that, for $n\geq 2$, the virtual braid group $VB_n$, the unrestricted virtual pure braid group $UVP_n$, and the unrestricted virtual braid group $UVB_n$ have the R$_\infty$-property. As a consequence of the technique used for few strings we also prove that, for $n=2,3,4$, the welded braid group $WB_n$ has the R$_\infty$-property and that for $n=2$ the corresponding pure braid groups have the R$_\infty$-property. On the other hand for $n\geq 3$ it is unknown if the R$_\infty$-property holds or not for the virtual pure braid group $VP_n$ and the welded pure braid group $WP_n$.


title: Contextualized Messages Boost Graph Representations

abstract: Graph neural networks (GNNs) have gained significant attention in recent years for their ability to process data that may be represented as graphs. This success has prompted several studies to explore the representational capability of GNNs based on the graph isomorphism task. These works inherently assume a countable node feature representation, potentially limiting their applicability. Interestingly, only a few theoretical works study GNNs with uncountable node feature representation. This paper presents a novel perspective on the representational capability of GNNs across all levels - node-level, neighborhood-level, and graph-level - when the space of node feature representation is uncountable. Specifically, it relaxes the injective requirement in previous works by employing an implicit pseudometric distance on the space of input to create a soft-injective function. This allows distinct inputs to produce similar outputs only if the pseudometric deems the inputs to be sufficiently similar on some representation, which is often useful in practice. As a consequence, a novel soft-isomorphic relational graph convolution network (SIR-GCN) that emphasizes non-linear and contextualized transformation of neighborhood feature representations is proposed. A mathematical discussion on the relationship between SIR-GCN and widely used GNNs is then laid out to put the contribution in context, establishing SIR-GCN as a generalization of classical GNN methodologies. Experiments on synthetic and benchmark datasets demonstrate the relative superiority of SIR-GCN, outperforming comparable models in node and graph property prediction tasks.


title: PCT: Perspective Cue Training Framework for Multi-Camera BEV Segmentation

abstract: Generating annotations for bird's-eye-view (BEV) segmentation presents significant challenges due to the scenes' complexity and the high manual annotation cost. In this work, we address these challenges by leveraging the abundance of unlabeled data available. We propose the Perspective Cue Training (PCT) framework, a novel training framework that utilizes pseudo-labels generated from unlabeled perspective images using publicly available semantic segmentation models trained on large street-view datasets. PCT applies a perspective view task head to the image encoder shared with the BEV segmentation head, effectively utilizing the unlabeled data to be trained with the generated pseudo-labels. Since image encoders are present in nearly all camera-based BEV segmentation architectures, PCT is flexible and applicable to various existing BEV architectures. PCT can be applied to various settings where unlabeled data is available. In this paper, we applied PCT for semi-supervised learning (SSL) and unsupervised domain adaptation (UDA). Additionally, we introduce strong input perturbation through Camera Dropout (CamDrop) and feature perturbation via BEV Feature Dropout (BFD), which are crucial for enhancing SSL capabilities using our teacher-student framework. Our comprehensive approach is simple and flexible but yields significant improvements over various baselines for SSL and UDA, achieving competitive performances even against the current state-of-the-art.


title: Asymptotic Error Rates for Point Process Classification

abstract: Point processes are finding growing applications in numerous fields, such as neuroscience, high frequency finance and social media. So classic problems of classification and clustering are of increasing interest. However, analytic study of misclassification error probability in multi-class classification has barely begun. In this paper, we tackle the multi-class likelihood classification problem for point processes and develop, for the first time, both asymptotic upper and lower bounds on the error rate in terms of computable pair-wise affinities. We apply these general results to classifying renewal processes. Under some technical conditions, we show that the bounds have exponential decay and give explicit associated constants. The results are illustrated with a non-trivial simulation.


title: UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them All

abstract: We present UniBind, a flexible and efficient approach that learns a unified representation space for seven diverse modalities -- images, text, audio, point cloud, thermal, video, and event data. Existing works, eg., ImageBind, treat the image as the central modality and build an image-centered representation space; however, the space may be sub-optimal as it leads to an unbalanced representation space among all modalities. Moreover, the category names are directly used to extract text embeddings for the downstream tasks, making it hardly possible to represent the semantics of multi-modal data. The 'out-of-the-box' insight of our UniBind is to make the alignment center modality-agnostic and further learn a unified and balanced representation space, empowered by the large language models (LLMs). UniBind is superior in its flexible application to all CLIP-style models and delivers remarkable performance boosts. To make this possible, we 1) construct a knowledge base of text embeddings with the help of LLMs and multi-modal LLMs; 2) adaptively build LLM-augmented class-wise embedding center on top of the knowledge base and encoded visual embeddings; 3) align all the embeddings to the LLM-augmented embedding center via contrastive learning to achieve a unified and balanced representation space. UniBind shows strong zero-shot recognition performance gains over prior arts by an average of 6.36%. Finally, we achieve new state-of-the-art performance, eg., a 6.75% gain on ImageNet, on the multi-modal fine-tuning setting while reducing 90% of the learnable parameters.


title: To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions

abstract: How can a robot provide unobtrusive physical support within a group of humans? We present Attentive Support, a novel interaction concept for robots to support a group of humans. It combines scene perception, dialogue acquisition, situation understanding, and behavior generation with the common-sense reasoning capabilities of Large Language Models (LLMs). In addition to following user instructions, Attentive Support is capable of deciding when and how to support the humans, and when to remain silent to not disturb the group. With a diverse set of scenarios, we show and evaluate the robot's attentive behavior, which supports and helps the humans when required, while not disturbing if no help is needed.


title: ExACT: Language-guided Conceptual Reasoning and Uncertainty Estimation for Event-based Action Recognition and More

abstract: Event cameras have recently been shown beneficial for practical vision tasks, such as action recognition, thanks to their high temporal resolution, power efficiency, and reduced privacy concerns. However, current research is hindered by 1) the difficulty in processing events because of their prolonged duration and dynamic actions with complex and ambiguous semantics and 2) the redundant action depiction of the event frame representation with fixed stacks. We find language naturally conveys abundant semantic information, rendering it stunningly superior in reducing semantic uncertainty. In light of this, we propose ExACT, a novel approach that, for the first time, tackles event-based action recognition from a cross-modal conceptualizing perspective. Our ExACT brings two technical contributions. Firstly, we propose an adaptive fine-grained event (AFE) representation to adaptively filter out the repeated events for the stationary objects while preserving dynamic ones. This subtly enhances the performance of ExACT without extra computational cost. Then, we propose a conceptual reasoning-based uncertainty estimation module, which simulates the recognition process to enrich the semantic representation. In particular, conceptual reasoning builds the temporal relation based on the action semantics, and uncertainty estimation tackles the semantic uncertainty of actions based on the distributional representation. Experiments show that our ExACT achieves superior recognition accuracy of 94.83%(+2.23%), 90.10%(+37.47%) and 67.24% on PAF, HARDVS and our SeAct datasets respectively.


title: High-Fidelity SLAM Using Gaussian Splatting with Rendering-Guided Densification and Regularized Optimization

abstract: We propose a dense RGBD SLAM system based on 3D Gaussian Splatting that provides metrically accurate pose tracking and visually realistic reconstruction. To this end, we first propose a Gaussian densification strategy based on the rendering loss to map unobserved areas and refine reobserved areas. Second, we introduce extra regularization parameters to alleviate the forgetting problem in the continuous mapping problem, where parameters tend to overfit the latest frame and result in decreasing rendering quality for previous frames. Both mapping and tracking are performed with Gaussian parameters by minimizing re-rendering loss in a differentiable way. Compared to recent neural and concurrently developed gaussian splatting RGBD SLAM baselines, our method achieves state-of-the-art results on the synthetic dataset Replica and competitive results on the real-world dataset TUM.


title: Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-maps

abstract: In this paper, we introduce Vox-Fusion++, a multi-maps-based robust dense tracking and mapping system that seamlessly fuses neural implicit representations with traditional volumetric fusion techniques. Building upon the concept of implicit mapping and positioning systems, our approach extends its applicability to real-world scenarios. Our system employs a voxel-based neural implicit surface representation, enabling efficient encoding and optimization of the scene within each voxel. To handle diverse environments without prior knowledge, we incorporate an octree-based structure for scene division and dynamic expansion. To achieve real-time performance, we propose a high-performance multi-process framework. This ensures the system's suitability for applications with stringent time constraints. Additionally, we adopt the idea of multi-maps to handle large-scale scenes, and leverage loop detection and hierarchical pose optimization strategies to reduce long-term pose drift and remove duplicate geometry. Through comprehensive evaluations, we demonstrate that our method outperforms previous methods in terms of reconstruction quality and accuracy across various scenarios. We also show that our Vox-Fusion++ can be used in augmented reality and collaborative mapping applications. Our source code will be publicly available at \url{https://github.com/zju3dv/Vox-Fusion_Plus_Plus}


title: Prompt-Guided Adaptive Model Transformation for Whole Slide Image Classification

abstract: Multiple instance learning (MIL) has emerged as a popular method for classifying histopathology whole slide images (WSIs). Existing approaches typically rely on frozen pre-trained models to extract instance features, neglecting the substantial domain shift between pre-training natural and histopathological images. To address this issue, we propose PAMT, a novel Prompt-guided Adaptive Model Transformation framework that enhances MIL classification performance by seamlessly adapting pre-trained models to the specific characteristics of histopathology data. To capture the intricate histopathology distribution, we introduce Representative Patch Sampling (RPS) and Prototypical Visual Prompt (PVP) to reform the input data, building a compact while informative representation. Furthermore, to narrow the domain gap, we introduce Adaptive Model Transformation (AMT) that integrates adapter blocks within the feature extraction pipeline, enabling the pre-trained models to learn domain-specific features. We rigorously evaluate our approach on two publicly available datasets, Camelyon16 and TCGA-NSCLC, showcasing substantial improvements across various MIL models. Our findings affirm the potential of PAMT to set a new benchmark in WSI classification, underscoring the value of a targeted reprogramming approach.


title: Multi-View Active Sensing for Human-Robot Interaction via Hierarchically Connected Tree

abstract: Comprehensive perception of human beings is the prerequisite to ensure the safety of human-robot interaction. Currently, prevailing visual sensing approach typically involves a single static camera, resulting in a restricted and occluded field of view. In our work, we develop an active vision system using multiple cameras to dynamically capture multi-source RGB-D data. An integrated human sensing strategy based on a hierarchically connected tree structure is proposed to fuse localized visual information. Constituting the tree model are the nodes representing keypoints and the edges representing keyparts, which are consistently interconnected to preserve the structural constraints during multi-source fusion. Utilizing RGB-D data and HRNet, the 3D positions of keypoints are analytically estimated, and their presence is inferred through a sliding widow of confidence scores. Subsequently, the point clouds of reliable keyparts are extracted by drawing occlusion-resistant masks, enabling fine registration between data clouds and cylindrical model following the hierarchical order. Experimental results demonstrate that our method enhances keypart recognition recall from 69.20% to 90.10%, compared to employing a single static camera. Furthermore, in overcoming challenges related to localized and occluded perception, the robotic arm's obstacle avoidance capabilities are effectively improved.


title: A program for 3D nuclear static and time-dependent density-functional theory with full Skyrme energy density functional: HIT3D

abstract: This work presents a computer program that performs symmetry-unrestricted 3D nuclear time-dependent density function theory (DFT) calculations. The program features the augmented Lagrangian constraint in the static calculation. This allows for the calculation of the potential energy surface. In addition, the code includes the full energy density functionals derived from the Skyrme interaction, meaning that the time-even and time-odd tensor parts are included for the time-dependent calculations. The results of the hit3d code are carefully compared with the Sky3D and Ev8 programs. The testing cases include unconstrained DFT calculations for doubly magic nuclei, the constrained DFT + BCS calculations for medium-heavy nucleus 110Mo, and the dynamic applications for harmonic vibration and nuclear reactions.


title: Community detection by spectral methods in multi-layer networks

abstract: Community detection in multi-layer networks is a crucial problem in network analysis. In this paper, we analyze the performance of two spectral clustering algorithms for community detection within the multi-layer degree-corrected stochastic block model (MLDCSBM) framework. One algorithm is based on the sum of adjacency matrices, while the other utilizes the debiased sum of squared adjacency matrices. We establish consistency results for community detection using these methods under MLDCSBM as the size of the network and/or the number of layers increases. Our theorems demonstrate the advantages of utilizing multiple layers for community detection. Moreover, our analysis indicates that spectral clustering with the debiased sum of squared adjacency matrices is generally superior to spectral clustering with the sum of adjacency matrices. Numerical simulations confirm that our algorithm, employing the debiased sum of squared adjacency matrices, surpasses existing methods for community detection in multi-layer networks. Finally, the analysis of several real-world multi-layer networks yields meaningful insights.


title: TAGS: Real-time Intrusion Detection with Tag-Propagation-based Provenance Graph Alignment on Streaming Events

abstract: The evolution and advancement of cyberattacks pose challenges to existing security products. Recent concentrated research on provenance graph-based detection has proved its effectiveness in attack detection and investigation. However, implementing these approaches in practice encounters challenges such as high overhead, slow responsiveness, and low interpretability and extensibility. Towards practical attack detection and investigation with provenance graphs, we propose TAGS, a tag-propagation-based streaming provenance graph alignment system. Utilizing the tag-based intermediate result caching mechanism alongside carefully crafted propagation rules, we eliminate the need to store and duplicate raw data processing. This approach effectively mitigates in-memory storage requirements and minimizes data processing overhead, facilitating rapid on-stream graph alignment while significantly conserving CPU and memory resources. As a result, TAGS can detect and investigate various cyber-attacks in real-time. Moreover, TAGS allows analysts to customize attack query graphs flexibly to identify extended attacks in data streams. We conduct experimental evaluations on two large-scale public datasets containing 257.42 GB of audit logs with 12 relevant query graphs of varying sizes, covering multiple attack techniques and scenarios. The results demonstrate that TAGS is sufficiently efficient to process 176K events per second while sufficiently accurately identifying all 29 alignments in massive data. Moreover, it can effectively handle the dependency explosion problem with steady, low-level memory consumption (less than 300MB), producing only 3 false positives. Overall, the performance of TAGS significantly outperforms the state-of-the-art methods.


title: Attitude Tracking of Uncertain Flexible Spacecraft Systems Subject to Unknown External Disturbances

abstract: In this paper, we investigate the attitude tracking problem of uncertain flexible spacecraft systems subject to external disturbances. In sharp contrast to existing results, the dynamics of flexible spacecraft systems and external disturbances are allowed to be unknown. To deal with the challenges by these unknown factors, we develop a class of nonlinear internal models which converts the attitude tracking problem of uncertain flexible spacecraft systems into a regulation problem of an augmented system. Furthermore, to overcome the difficulties caused by the unmeasurable modal variable, the uncertainty introduced by the internal model, and the cross-coupling of the uncertainties with the system state, we design an auxiliary dynamic system for auxiliary stabilization, a dynamic compensator for dynamic compensation, and a linearly parameterized transformation for adaptive regulation in sequence. By introducing a series of coordinate and input transformations, we propose an adaptive dynamic control law to achieve regulation of the augmented system and thus leading to the solution to the attitude tracking problem. In addition, we analyze the convergence issue of the estimated parameter to its true value by the persistently exciting condition. Finally, the effec tiveness of the developed approach is verified by its application to the attitude manoeuvre of a flexible spacecraft system in the presence of external disturbances.


title: HCPM: Hierarchical Candidates Pruning for Efficient Detector-Free Matching

abstract: Deep learning-based image matching methods play a crucial role in computer vision, yet they often suffer from substantial computational demands. To tackle this challenge, we present HCPM, an efficient and detector-free local feature-matching method that employs hierarchical pruning to optimize the matching pipeline. In contrast to recent detector-free methods that depend on an exhaustive set of coarse-level candidates for matching, HCPM selectively concentrates on a concise subset of informative candidates, resulting in fewer computational candidates and enhanced matching efficiency. The method comprises a self-pruning stage for selecting reliable candidates and an interactive-pruning stage that identifies correlated patches at the coarse level. Our results reveal that HCPM significantly surpasses existing methods in terms of speed while maintaining high accuracy. The source code will be made available upon publication.


title: AffineQuant: Affine Transformation Quantization for Large Language Models

abstract: The significant resource requirements associated with Large-scale Language Models (LLMs) have generated considerable interest in the development of techniques aimed at compressing and accelerating neural networks. Among these techniques, Post-Training Quantization (PTQ) has emerged as a subject of considerable interest due to its noteworthy compression efficiency and cost-effectiveness in the context of training. Existing PTQ methods for LLMs limit the optimization scope to scaling transformations between pre- and post-quantization weights. In this paper, we advocate for the direct optimization using equivalent Affine transformations in PTQ (AffineQuant). This approach extends the optimization scope and thus significantly minimizing quantization errors. Additionally, by employing the corresponding inverse matrix, we can ensure equivalence between the pre- and post-quantization outputs of PTQ, thereby maintaining its efficiency and generalization capabilities. To ensure the invertibility of the transformation during optimization, we further introduce a gradual mask optimization method. This method initially focuses on optimizing the diagonal elements and gradually extends to the other elements. Such an approach aligns with the Levy-Desplanques theorem, theoretically ensuring invertibility of the transformation. As a result, significant performance improvements are evident across different LLMs on diverse datasets. To illustrate, we attain a C4 perplexity of 15.76 (2.26 lower vs 18.02 in OmniQuant) on the LLaMA2-7B model of W4A4 quantization without overhead. On zero-shot tasks, AffineQuant achieves an average of 58.61 accuracy (1.98 lower vs 56.63 in OmniQuant) when using 4/4-bit quantization for LLaMA-30B, which setting a new state-of-the-art benchmark for PTQ in LLMs.


title: Motivic Hilbert zeta functions for curve singularities and related invariants

abstract: In the present paper, we show that the motivic Hilbert zeta function for a curve singularity yields the generating functions for Euler numbers of punctual Hilbert schemes when any punctual Hilbert scheme admits an affine cell decomposition. This fact allows us to derive the relations among the motivic Hilbert zeta function and other invariants such as the generating function for semi-modules of the semi-group of the singularity, the HOMFLY polynomial and the degrees of Severi strata of the miniversal deformation of the singularity. As an application of the fact above, we also generalize Kawai's result regarding the generating function for the Euler numbers of a singular curve.


title: A two-scale effective model for defect-induced localization transitions in non-Hermitian systems

abstract: We illuminate the fundamental mechanism responsible for the transition between the non-Hermitian skin effect and defect-induced localization in the bulk. We study a Hamiltonian with non-reciprocal couplings that exhibits the skin effect (the localization of all eigenvectors at one edge) and add an on-site defect in the center. Using a two-scale asymptotic method, we characterize the long-scale growth and decay of the eigenvectors and derive a simple and intuitive effective model for the transition that occurs when the defect is sufficiently large that one of the modes is localized at the defect site, rather than at the edge of the system.


title: Non-negative matrix underapproximation as optimal frequency band selector

abstract: Time-frequency representation (TFR) is often used for non-stationary signal analysis. The most intuitive and interpretable TFR is the spectrogram. Recently, a concept of non-negative matrix factorization (NMF) has been successfully applied to local damage detection in rolling elements of bearings via spectrogram factorization. NMF applied to the spectrogram allows one to find an informative frequency band, which could be further used as a filter characteristic. However, the obtained filter characteristics mostly detect the informative frequency band, which also encompasses a lot of noise. In the case where noise is more problematic, as is the case for acoustic signals from industrial machines, the NMF hardly detects the damage. To solve this problem and obtain more selective filters, which are more robust to noise, we propose the non-negative matrix under-approximation (NMU) as an informative frequency band selector. Due to the more sparse parts-based representation of the NMU compared to NMF, NMU provides more selective filter characteristics, which neglect the non-informative frequency bands related to the noise. In practice, it means that NMU gives a better signal-to-noise ratio for the filtered signal. The efficiency of the proposed approach has been validated on the vibration signal from the test rig and the acoustic signal from an idler.


title: Kinetically constrained models constructed from dissipative quantum dynamics

abstract: We propose a construction of kinetically constrained models using the Markovian quantum dynamics under strong dissipation. Using the Gorini-Kossakowski-Sudarshan-Lindblad (GKSL) formalism, we show that strong dissipation leads to the emergent decoherence-free subspaces, within which constrained quantum many-body unitary dynamics can take place. We argue that the unitary dynamics constructed by the GKSL dynamics is more tightly constrained than that constructed by the strongly interacting Hamiltonian, where the interactions have the same form with the GKSL jump operators. As an example, we demonstrate that a one-dimensional spin system with two-site dissipation leads to the kinetically constrained ``PXQ" model, which exhibits the free domain-wall motion with an additional frozen-block structure. Under the uniform magnetic field, the PXQ model shows the domain-wall localization, similar to the Wannier-Stark localization. We then couple two PXQ chains with the magnetic field and inter-chain interaction. We discover that, while localization of the domain walls persists despite the interactions for typical parameter regimes, a non-trivial partial delocalization appears for a certain parameter line.


title: Treewidth of generalized Hamming graph, bipartite Kneser graph and generalized Petersen graph

abstract: Let $t,q$ and $n$ be positive integers. Write $[q] = \{1,2,\ldots,q\}$. The generalized Hamming graph $H(t,q,n)$ is the graph whose vertex set is the cartesian product of $n$ copies of $[q]$$(q\ge 2)$, where two vertices are adjacent if their Hamming distance is at most $t$. In particular, $H(1,q,n)$ is the well-known Hamming graph and $H(1,2,n)$ is the hypercube. In 2006, Chandran and Kavitha described the asymptotic value of $tw(H(1,q,n))$, where $tw(G)$ denotes the treewidth of $G$. In this paper, we give the exact pathwidth of $H(t,2,n)$ and show that $tw(H(t,q,n)) = \Theta(tq^n/\sqrt{n})$ when $n$ goes to infinity. Based on those results, we show that the treewidth of bipartite Kneser graph $BK(n,k)$ is $\binom{n}{k} - 1$ when $n$ is sufficient large relative to $k$ and the bounds of $tw(BK(2k+1,k))$ are given. Moreover, we present the bounds of the treewidth of generalized Petersen graph.


title: RGBD GS-ICP SLAM

abstract: Simultaneous Localization and Mapping (SLAM) with dense representation plays a key role in robotics, Virtual Reality (VR), and Augmented Reality (AR) applications. Recent advancements in dense representation SLAM have highlighted the potential of leveraging neural scene representation and 3D Gaussian representation for high-fidelity spatial representation. In this paper, we propose a novel dense representation SLAM approach with a fusion of Generalized Iterative Closest Point (G-ICP) and 3D Gaussian Splatting (3DGS). In contrast to existing methods, we utilize a single Gaussian map for both tracking and mapping, resulting in mutual benefits. Through the exchange of covariances between tracking and mapping processes with scale alignment techniques, we minimize redundant computations and achieve an efficient system. Additionally, we enhance tracking accuracy and mapping quality through our keyframe selection methods. Experimental results demonstrate the effectiveness of our approach, showing an incredibly fast speed up to 107 FPS (for the entire system) and superior quality of the reconstructed map.


title: Non-coercive Neumann boundary control problems

abstract: The article examines a linear-quadratic Neumann control problem that is governed by a non-coercive elliptic equation. Due to the non-self-adjoint nature of the linear control-to-state operator, it is necessary to independently study both the state and adjoint state equations. The article establishes the existence and uniqueness of solutions for both equations, with minimal assumptions made about the problem's data. Next, the regularity of these solutions is studied in three frameworks: Hilbert-Sobolev spaces, Sobolev-Slobodecki\u\i{} spaces, and weighted Sobolev spaces. These regularity results enable a numerical analysis of the finite element approximation of both the state and adjoint state equations. The results cover both convex and non-convex domains and quasi-uniform and graded meshes. Finally, the optimal control problem is analyzed and discretized. Existence and uniqueness of the solution, first-order optimality conditions, and error estimates for the finite element approximation of the control are obtained. Numerical experiments confirming these results are included. A significant highlight is that the discretization error estimates known from the literature, are improved even for the coercive case.


title: M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving

abstract: End-to-end autonomous driving has witnessed remarkable progress. However, the extensive deployment of autonomous vehicles has yet to be realized, primarily due to 1) inefficient multi-modal environment perception: how to integrate data from multi-modal sensors more efficiently; 2) non-human-like scene understanding: how to effectively locate and predict critical risky agents in traffic scenarios like an experienced driver. To overcome these challenges, in this paper, we propose a Multi-Modal fusion transformer incorporating Driver Attention (M2DA) for autonomous driving. To better fuse multi-modal data and achieve higher alignment between different modalities, a novel Lidar-Vision-Attention-based Fusion (LVAFusion) module is proposed. By incorporating driver attention, we empower the human-like scene understanding ability to autonomous vehicles to identify crucial areas within complex scenarios precisely and ensure safety. We conduct experiments on the CARLA simulator and achieve state-of-the-art performance with less data in closed-loop benchmarks. Source codes are available at https://anonymous.4open.science/r/M2DA-4772.


title: Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs

abstract: Existing neural operator architectures face challenges when solving multiphysics problems with coupled partial differential equations (PDEs), due to complex geometries, interactions between physical variables, and the lack of large amounts of high-resolution training data. To address these issues, we propose Codomain Attention Neural Operator (CoDA-NO), which tokenizes functions along the codomain or channel space, enabling self-supervised learning or pretraining of multiple PDE systems. Specifically, we extend positional encoding, self-attention, and normalization layers to the function space. CoDA-NO can learn representations of different PDE systems with a single model. We evaluate CoDA-NO's potential as a backbone for learning multiphysics PDEs over multiple systems by considering few-shot learning settings. On complex downstream tasks with limited data, such as fluid flow simulations and fluid-structure interactions, we found CoDA-NO to outperform existing methods on the few-shot learning task by over $36\%$. The code is available at https://github.com/ashiq24/CoDA-NO.


title: Non-negative tensor factorization for vibration-based local damage detection

abstract: In this study, a novel non-negative tensor factorization (NTF)-based method for vibration-based local damage detection in rolling element bearings is proposed. As the diagnostic signal registered from a faulty machine is non-stationary, the time-frequency method is frequently used as a primary decomposition technique. It is proposed here to extract multi-linear NTF-based components from a 3D array of time-frequency representations of an observed signal partitioned into blocks. As a result, frequency and temporal informative components can be efficiently separated from non-informative ones. The experiments performed on synthetic and real signals demonstrate the high efficiency of the proposed method with respect to the already known non-negative matrix factorization approach.


title: Impact of non-zero strange quark mass $(m_{s}\neq0)$ in $f(R,T)$ gravity admitting observational results of strange stars

abstract: In this article we propose a new class of isotropic strange star using Buchdahl-I metric ansatz in the context of MIT bag model equation of state considering of non-zero strange quark mass $(m_{s})$ in the framework of modified $f(R,T)$ theory of gravity. The barotropic form of MIT bag model equation of state and a specific class of $f(R,T)$ model, {\it viz.}, $f(R,T)=R+2\alpha_{c}T$ where $\alpha_{c}$ is termed as the gravity-matter coupling constant, produces a tractable set of solutions of Einstein field equations. From the allowed numerical values of the coupling constant $(\alpha_{c})$, we have considered a range of $\alpha_{c}$ from -2.0 to 2.0. Maximum mass and radius in this model is found by numerically solving the TOV equations and we note that within the stability window imposed by energy per baryon, for an arbitrary choice of bag constant $B=70~MeV/fm^{3}$, $m_{s}$ and $\alpha_{c}$ act as a constraining factor. Interestingly, the increment of $m_{s}$ and $\alpha_{c}$ results in a softer equation of state which leads to the decrease in the maximum mass and radius while negative values of $\alpha_{c}$ leads to a stiffer equation of state thereby increasing the maximum mass and radius in the present model. For physical application, we consider EXO 1745-248 and study the effects of $m_{s}$ and $\alpha_{c}$ on its radius. Using the formalism, we have analysed the characteristic properties of EXO 1745-248. Apart from that, we have predicted the radii of a wide range of strange star candidates in the context of $f(R,T)$ gravity and the obtained results agree well with the observed results. We note that the proposed model satisfies all the necessary energy conditions and stability criteria to emerge as a viable stellar configuration.


title: Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation

abstract: Previous Sign Language Translation (SLT) methods achieve superior performance by relying on gloss annotations. However, labeling high-quality glosses is a labor-intensive task, which limits the further development of SLT. Although some approaches work towards gloss-free SLT through jointly training the visual encoder and translation network, these efforts still suffer from poor performance and inefficient use of the powerful Large Language Model (LLM). Most seriously, we find that directly introducing LLM into SLT will lead to insufficient learning of visual representations as LLM dominates the learning curve. To address these problems, we propose Factorized Learning assisted with Large Language Model (FLa-LLM) for gloss-free SLT. Concretely, we factorize the training process into two stages. In the visual initialing stage, we employ a lightweight translation model after the visual encoder to pre-train the visual encoder. In the LLM fine-tuning stage, we freeze the acquired knowledge in the visual encoder and integrate it with a pre-trained LLM to inspire the LLM's translation potential. This factorized training strategy proves to be highly effective as evidenced by significant improvements achieved across three SLT datasets which are all conducted under the gloss-free setting.