title: CoheSentia: A Novel Benchmark of Incremental versus Holistic Assessment of Coherence in Generated Texts

abstract: Coherence is a linguistic term that refers to the relations between small textual units (sentences, propositions), which make the text logically consistent and meaningful to the reader. With the advances of generative foundational models in NLP, there is a pressing need to automatically assess the human-perceived coherence of automatically generated texts. Up until now, little work has been done on explicitly assessing the coherence of generated texts and analyzing the factors contributing to (in)coherence. Previous work on the topic used other tasks, e.g., sentence reordering, as proxies of coherence, rather than approaching coherence detection heads on. In this paper, we introduce {\sc CoheSentia}, a novel benchmark of human-perceived coherence of automatically generated texts. Our annotation protocol reflects two perspectives; one is global, assigning a single coherence score, and the other is incremental, scoring sentence by sentence. The incremental method produces an (in)coherence score for each text fragment and also pinpoints reasons for incoherence at that point. Our benchmark contains 500 automatically-generated and human-annotated paragraphs, each annotated in both methods, by multiple raters. Our analysis shows that the inter-annotator agreement in the incremental mode is higher than in the holistic alternative, and our experiments show that standard LMs fine-tuned for coherence detection show varied performance on the different factors contributing to (in)coherence. All in all, these models yield unsatisfactory performance, emphasizing the need for developing more reliable methods for coherence assessment.


title: On the monodromy of holomorphic differential systems

abstract: First we survey and explain the strategy of some recent results that construct holomorphic $\text{sl}(2, \mathbb C)$-differential systems over some Riemann surfaces $\Sigma_g$ of genus $g\geq 2$, satisfying the condition that the image of the associated monodromy homomorphism is (real) Fuchsian \cite{BDHH} or some cocompact Kleinian subgroup $$\Gamma \subset \text{SL}(2, \mathbb C)$$ as in \cite{BDHH2}. As a consequence, there exist holomorphic maps from $\Sigma_g$ to the quotient space $\text{SL}(2, \mathbb C)/ \Gamma$, where $\Gamma \subset \text{SL}(2, \mathbb C)$ is a cocompact lattice, that do not factor through any elliptic curve \cite{BDHH2}. This answers positively a question of Ghys in \cite{Gh}; the question was also raised by Huckleberry and Winkelmann in \cite{HW}. Then we prove that when $M$ is a Riemann surface, a Torelli type theorem holds for the affine group scheme over $\mathbb C$ obtained from the category of holomorphic connections on {\it \'etale trivial} holomorphic bundles. After that, we explain how to compute in a simple way the holonomy of a holomorphic connection on a free vector bundle. Finally, for a compact K\"ahler manifold $M$, we investigate the neutral Tannakian category given by the holomorphic connections on \'etale trivial holomorphic bundles over $M$. If $\varpi$ (respectively, $\Theta$) stands for the affine group scheme over $\mathbb C$ obtained from the category of connections (respectively, connections on free (trivial) vector bundles), then the natural inclusion produces a morphism $v:{\mathcal O}(\Theta)\longrightarrow {\mathcal O}(\varpi)$ of Hopf algebras. We present a description of the transpose of $v$ in terms of the iterated integrals.


title: Brain-Inspired Reservoir Computing Using Memristors with Tunable Dynamics and Short-Term Plasticity

abstract: Recent advancements in reservoir computing research have created a demand for analog devices with dynamics that can facilitate the physical implementation of reservoirs, promising faster information processing while consuming less energy and occupying a smaller area footprint. Studies have demonstrated that dynamic memristors, with nonlinear and short-term memory dynamics, are excellent candidates as information-processing devices or reservoirs for temporal classification and prediction tasks. Previous implementations relied on nominally identical memristors that applied the same nonlinear transformation to the input data, which is not enough to achieve a rich state space. To address this limitation, researchers either diversified the data encoding across multiple memristors or harnessed the stochastic device-to-device variability among the memristors. However, this approach requires additional pre-processing steps and leads to synchronization issues. Instead, it is preferable to encode the data once and pass it through a reservoir layer consisting of memristors with distinct dynamics. Here, we demonstrate that ion-channel-based memristors with voltage-dependent dynamics can be controllably and predictively tuned through voltage or adjustment of the ion channel concentration to exhibit diverse dynamic properties. We show, through experiments and simulations, that reservoir layers constructed with a small number of distinct memristors exhibit significantly higher predictive and classification accuracies with a single data encoding. We found that for a second-order nonlinear dynamical system prediction task, the varied memristor reservoir experimentally achieved a normalized mean square error of 0.0015 using only five distinct memristors. Moreover, in a neural activity classification task, a reservoir of just three distinct memristors experimentally attained an accuracy of 96.5%.


title: Corrupting Neuron Explanations of Deep Visual Features

abstract: The inability of DNNs to explain their black-box behavior has led to a recent surge of explainability methods. However, there are growing concerns that these explainability methods are not robust and trustworthy. In this work, we perform the first robustness analysis of Neuron Explanation Methods under a unified pipeline and show that these explanations can be significantly corrupted by random noises and well-designed perturbations added to their probing data. We find that even adding small random noise with a standard deviation of 0.02 can already change the assigned concepts of up to 28% neurons in the deeper layers. Furthermore, we devise a novel corruption algorithm and show that our algorithm can manipulate the explanation of more than 80% neurons by poisoning less than 10% of probing data. This raises the concern of trusting Neuron Explanation Methods in real-life safety and fairness critical applications.


title: Scalable Optimal Power Management for Large-Scale Battery Energy Storage Systems

abstract: Large-scale battery energy storage systems (BESS) are helping transition the world towards sustainability with their broad use, among others, in electrified transportation, power grid, and renewables. However, optimal power management for them is often computationally formidable. To overcome this challenge, we develop a scalable approach in the paper. The proposed approach partitions the constituting cells of a large-scale BESS into clusters based on their state-of-charge (SoC), temperature, and internal resistance. Each cluster is characterized by a representative model that approximately captures its collective SoC and temperature dynamics, as well as its overall power losses in charging/discharging. Based on the clusters, we then formulate a problem of receding-horizon optimal power control to minimize the power losses while promoting SoC and temperature balancing. The cluster-based power optimization will decide the power quota for each cluster, and then every cluster will split the quota among the constituent cells. Since the number of clusters is much fewer than the number of cells, the proposed approach significantly reduces the computational costs, allowing optimal power management to scale up to large-scale BESS. Extensive simulations are performed to evaluate the proposed approach. The obtained results highlight a significant computational overhead reduction by more than 60% for a small-scale and 98% for a large-scale BESS compared to the conventional cell-level optimization. Experimental validation based on a 20-cell prototype further demonstrates its effectiveness and utility.


title: AccoMontage-3: Full-Band Accompaniment Arrangement via Sequential Style Transfer and Multi-Track Function Prior

abstract: We propose AccoMontage-3, a symbolic music automation system capable of generating multi-track, full-band accompaniment based on the input of a lead melody with chords (i.e., a lead sheet). The system contains three modular components, each modelling a vital aspect of full-band composition. The first component is a piano arranger that generates piano accompaniment for the lead sheet by transferring texture styles to the chords using latent chord-texture disentanglement and heuristic retrieval of texture donors. The second component orchestrates the piano accompaniment score into full-band arrangement according to the orchestration style encoded by individual track functions. The third component, which connects the previous two, is a prior model characterizing the global structure of orchestration style over the whole piece of music. From end to end, the system learns to generate full-band accompaniment in a self-supervised fashion, applying style transfer at two levels of polyphonic composition: texture and orchestration. Experiments show that our system outperforms the baselines significantly, and the modular design offers effective controls in a musically meaningful way.


title: Defense Against Model Extraction Attacks on Recommender Systems

abstract: The robustness of recommender systems has become a prominent topic within the research community. Numerous adversarial attacks have been proposed, but most of them rely on extensive prior knowledge, such as all the white-box attacks or most of the black-box attacks which assume that certain external knowledge is available. Among these attacks, the model extraction attack stands out as a promising and practical method, involving training a surrogate model by repeatedly querying the target model. However, there is a significant gap in the existing literature when it comes to defending against model extraction attacks on recommender systems. In this paper, we introduce Gradient-based Ranking Optimization (GRO), which is the first defense strategy designed to counter such attacks. We formalize the defense as an optimization problem, aiming to minimize the loss of the protected target model while maximizing the loss of the attacker's surrogate model. Since top-k ranking lists are non-differentiable, we transform them into swap matrices which are instead differentiable. These swap matrices serve as input to a student model that emulates the surrogate model's behavior. By back-propagating the loss of the student model, we obtain gradients for the swap matrices. These gradients are used to compute a swap loss, which maximizes the loss of the student model. We conducted experiments on three benchmark datasets to evaluate the performance of GRO, and the results demonstrate its superior effectiveness in defending against model extraction attacks.


title: SMURF-THP: Score Matching-based UnceRtainty quantiFication for Transformer Hawkes Process

abstract: Transformer Hawkes process models have shown to be successful in modeling event sequence data. However, most of the existing training methods rely on maximizing the likelihood of event sequences, which involves calculating some intractable integral. Moreover, the existing methods fail to provide uncertainty quantification for model predictions, e.g., confidence intervals for the predicted event's arrival time. To address these issues, we propose SMURF-THP, a score-based method for learning Transformer Hawkes process and quantifying prediction uncertainty. Specifically, SMURF-THP learns the score function of events' arrival time based on a score-matching objective that avoids the intractable computation. With such a learned score function, we can sample arrival time of events from the predictive distribution. This naturally allows for the quantification of uncertainty by computing confidence intervals over the generated samples. We conduct extensive experiments in both event type prediction and uncertainty quantification of arrival time. In all the experiments, SMURF-THP outperforms existing likelihood-based methods in confidence calibration while exhibiting comparable prediction accuracy.


title: An extension of Thwaites method for turbulent boundary layers

abstract: Thwaites (1949) developed an approximate method for determining the evolution of laminar boundary layers. The approximation follows from an assumption that the growth of a laminar boundary layer in the presence of pressure gradients could be parameterized solely as a function of a flow parameter, $m = \theta^2/\nu \frac{dU_e}{ds}$, thus reducing the von Karman momentum integral to a first-order ordinary differential equation. This method is useful for the analysis of laminar flows, and in computational potential flow solvers to account for the viscous effects. However, for turbulent flows, a similar approximation for turbulent boundary layers subjected to pressure gradients does not yet exist. In this work, an approximate method for determining the momentum thickness of a two-dimensional, turbulent boundary layer is proposed. It is shown that the method provides good estimates of the momentum thickness, when compared to available high-fidelity simulation data, for multiple boundary layers including both favorable and adverse pressure gradient effects, up to the point of separation. In the limit of high Reynolds numbers, it is possible to derive a criterion for the onset of separation from the proposed model which is shown to be in agreement with prior empirical observations (Alber, \textit{$9^{th}$ Aerospace Sciences Meeting, 1971}). The sensitivity of the separation location with respect to upstream perturbations is also analyzed through this model for the NASA/Boeing speed bump and the transonic Bachalo-Johnson bump


title: Generative Pre-training for Speech with Flow Matching

abstract: Generative models have gained more and more attention in recent years for their remarkable success in tasks that required estimating and sampling data distribution to generate high-fidelity synthetic data. In speech, text-to-speech synthesis and neural vocoder are good examples where generative models have shined. While generative models have been applied to different applications in speech, there exists no general-purpose generative model that models speech directly. In this work, we take a step toward this direction by showing a single pre-trained generative model can be adapted to different downstream tasks with strong performance. Specifically, we pre-trained a generative model, named SpeechFlow, on 60k hours of untranscribed speech with Flow Matching and masked conditions. Experiment results show the pre-trained generative model can be fine-tuned with task-specific data to match or surpass existing expert models on speech enhancement, separation, and synthesis. Our work suggested a foundational model for generation tasks in speech can be built with generative pre-training.


title: Exponential relaxation to equilibrium for a kinetic Fokker-Planck-Alignment equation with force

abstract: In this note, we consider a kinetic Fokker-Planck-Alignment equation with Rayleigh-type friction and self-propulsion force which is derived from general environmental averaging models. We show the exponential relaxation in time toward equilibrium of the solutions provided certain spectral gap conditions are satisfied. The result is proved by using Desvillettes-Villani's method for collisional models to establish the global hypocoercivity.


title: RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language Models

abstract: Large language model (LLM) applications in cloud root cause analysis (RCA) have been actively explored recently. However, current methods are still reliant on manual workflow settings and do not unleash LLMs' decision-making and environment interaction capabilities. We present RCAgent, a tool-augmented LLM autonomous agent framework for practical and privacy-aware industrial RCA usage. Running on an internally deployed model rather than GPT families, RCAgent is capable of free-form data collection and comprehensive analysis with tools. Our framework combines a variety of enhancements, including a unique Self-Consistency for action trajectories, and a suite of methods for context management, stabilization, and importing domain knowledge. Our experiments show RCAgent's evident and consistent superiority over ReAct across all aspects of RCA -- predicting root causes, solutions, evidence, and responsibilities -- and tasks covered or uncovered by current rules, as validated by both automated metrics and human evaluations. Furthermore, RCAgent has already been integrated into the diagnosis and issue discovery workflow of the Real-time Compute Platform for Apache Flink of Alibaba Cloud.


title: Elevating Women in the Workplace: The Dual Influence of Spiritual Intelligence and Ethical Environments on Job Satisfaction

abstract: In today's rapidly evolving workplace, the dynamics of job satisfaction and its determinants have become a focal point of organizational studies. This research offers a comprehensive examination of the nexus between spiritual intelligence and job satisfaction among female employees, with particular emphasis on the moderating role of ethical work environments. Beginning with an exploration of the multifaceted nature of human needs, the study delves deep into the psychological underpinnings that drive job satisfaction. It elucidates how various tangible and intangible motivators, such as salary benefits and recognition, play pivotal roles in shaping employee attitudes and behaviors. Moreover, the research spotlights the unique challenges and experiences of female employees, advocating for a more inclusive understanding of their needs. An extensive review of the literature and empirical analysis culminates in the pivotal finding that integrating spiritual intelligence and ethical considerations within organizational practices can significantly enhance job satisfaction. Such a holistic approach, the paper posits, not only bolsters the well-being and contentment of female employees but also augments overall organizational productivity, retention rates, and morale.


title: All-optical correlated noisy channel and its application in recovering quantum coherence

abstract: Attenuation and amplification are the most common processes for optical communications. Amplification can be used to compensate the attenuation of the complex amplitude of an optical field, but is unable to recover the coherence lost, provided that the attenuation channel and the amplification channel are independent. In this work, we show that the quantum coherence of an optical filed can be regained if the attenuation channel and the amplification channel share correlated noise. We propose an all-optical correlated noisy channel relying on four-wave mixing process and demonstrate its capability of recovering quantum coherence within continuous-variable systems. We quantitatively investigate the coherence recovery phenomena for coherent states and two-mode squeezed states. Moreover, we analyze the effect of other photon losses that are independent with the recovery channel on the performance of recovering coherence. Different from correlated noisy channels previously proposed based on electro-optic conversions, the correlated noisy channel in our protocol is all-optical and thus owns larger operational bandwidths.


title: Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models

abstract: Advancements in natural language generation (NLG) and large language models (LLMs) have led to proficient text generation in various tasks. However, integrating intricate constraints into neural text generation, due to LLMs' opacity, remains challenging. This study investigates constrained text generation for LLMs, where predefined constraints are applied during LLM's generation process. Our research mainly focuses on mainstream open-source LLMs, categorizing constraints into lexical, structural, and relation-based types. We also present various benchmarks to facilitate fair evaluation. The study addresses some key research questions, including evaluating, understanding and improving constrained text generation for LLMs. Results illuminate LLMs' capacity and deficiency to incorporate constraints and provide insights for future developments in constrained text generation. Codes and datasets will be released upon acceptance.


title: Baby PIH: Parameterized Inapproximability of Min CSP

abstract: The Parameterized Inapproximability Hypothesis (PIH) is the analog of the PCP theorem in the world of parameterized complexity. It asserts that no FPT algorithm can distinguish a satisfiable 2CSP instance from one which is only $(1-\varepsilon)$-satisfiable (where the parameter is the number of variables) for some constant $0<\varepsilon<1$. We consider a minimization version of CSPs (Min-CSP), where one may assign $r$ values to each variable, and the goal is to ensure that every constraint is satisfied by some choice among the $r \times r$ pairs of values assigned to its variables (call such a CSP instance $r$-list-satisfiable). We prove the following strong parameterized inapproximability for Min CSP: For every $r \ge 1$, it is W[1]-hard to tell if a 2CSP instance is satisfiable or is not even $r$-list-satisfiable. We refer to this statement as "Baby PIH", following the recently proved Baby PCP Theorem (Barto and Kozik, 2021). Our proof adapts the combinatorial arguments underlying the Baby PCP theorem, overcoming some basic obstacles that arise in the parameterized setting. Furthermore, our reduction runs in time polynomially bounded in both the number of variables and the alphabet size, and thus implies the Baby PCP theorem as well.


title: Constructing the Equation of State of QCD in a functional QCD based scheme

abstract: We construct the equation of state (EoS) of QCD based on the finite chemical potential information from the functional QCD approaches, with the assistance of the lattice QCD EoS. The obtained EoS is consistent with the up-to-date estimations of the QCD phase diagram, including a phase transition temperature at zero chemical potential of $T=155$ MeV, the curvature of the transition line $\kappa=0.016$ and also a critical end point at $(T,\mu_B)=(118, 600)$ MeV. In specific, the phase diagram mapping is achieved by incorporating the order parameters into the EoS, namely the dynamical quark mass for the chiral phase transition together with the Polyakov loop parameter for the deconfinement phase transition. We also implement the EoS in hydrodynamic simulations to compute the particle yields, ratios and collective flow, and find that our obtained EoS agrees well with the commonly used one based on the combination of lattice QCD simulation and hadron resonance gas model.


title: The $\nu_{R}$-philic scalar dark matter

abstract: Right-handed neutrinos ($\nu_{R}$) offer an intriguing portal to new physics in hidden sectors where dark matter (DM) may reside. In this work, we delve into the simplest hidden sector involving only a real scalar exclusively coupled to $\nu_{R}$, referred to as the $\nu_{R}$-philic scalar. We investigate the viability of the $\nu_{R}$-philic scalar to serve as a DM candidate, under the constraint that the coupling of $\nu_{R}$ to the standard model is determined by the seesaw relation and is responsible for the observed DM abundance. By analyzing the DM decay channels and solving Boltzmann equations, we identify the viable parameter space. In particular, our study reveals a lower bound ($2.6\times10^{5}$ GeV) on the mass of $\nu_{R}$ for the $\nu_{R}$-philic scalar to be DM. The DM mass may vary from sub-MeV to sub-GeV. Within the viable parameter space, monochromatic neutrino lines from DM decay can be an important signal for DM indirect detection.


title: Transmitting Data Through Reconfigurable Intelligent Surface: A Spatial Sigma-Delta Modulation Approach

abstract: Transmitting data using the phases on reconfigurable intelligent surfaces (RIS) is a promising solution for future energy-efficient communication systems. Recent work showed that a virtual phased massive multiuser multiple-input-multiple-out (MIMO) transmitter can be formed using only one active antenna and a large passive RIS. In this paper, we are interested in using such a system to perform MIMO downlink precoding. In this context, we may not be able to apply conventional MIMO precoding schemes, such as the simple zero-forcing (ZF) scheme, and we typically need to design the phase signals by solving optimization problems with constant modulus constraints or with discrete phase constraints, which pose challenges with high computational complexities. In this work, we propose an alternative approach based on Sigma-Delta ($\Sigma\Delta$) modulation, which is classically famous for its noise-shaping ability. Specifically, first-order $\Sigma\Delta$ modulation is applied in the spatial domain to handle phase quantization in generating constant envelope signals. Under some mild assumptions, the proposed phased $\Sigma\Delta$ modulator allows us to use the ZF scheme to synthesize the RIS reflection phases with negligible complexity. The proposed approach is empirically shown to achieve comparable bit error rate performance to the unquantized ZF scheme.


title: Classification of three-family flavoured DFSZ axion models that have no domain wall problem

abstract: We provide an exhaustive classification of three-family DFSZ axion models that have no cosmological domain wall problem. This result is obtained by making the Peccei-Quinn symmetry flavour dependent in certain specific ways, thus reinforcing a possible connection between the strong CP problem and the flavour puzzle. Known DFSZ flavour variants such as the top-specific model emerge as special cases. Key features of the phenomenology of these models are briefly discussed.


title: DiffRef3D: A Diffusion-based Proposal Refinement Framework for 3D Object Detection

abstract: Denoising diffusion models show remarkable performances in generative tasks, and their potential applications in perception tasks are gaining interest. In this paper, we introduce a novel framework named DiffRef3D which adopts the diffusion process on 3D object detection with point clouds for the first time. Specifically, we formulate the proposal refinement stage of two-stage 3D object detectors as a conditional diffusion process. During training, DiffRef3D gradually adds noise to the residuals between proposals and target objects, then applies the noisy residuals to proposals to generate hypotheses. The refinement module utilizes these hypotheses to denoise the noisy residuals and generate accurate box predictions. In the inference phase, DiffRef3D generates initial hypotheses by sampling noise from a Gaussian distribution as residuals and refines the hypotheses through iterative steps. DiffRef3D is a versatile proposal refinement framework that consistently improves the performance of existing 3D object detection models. We demonstrate the significance of DiffRef3D through extensive experiments on the KITTI benchmark. Code will be available.


title: Unraveling Feature Extraction Mechanisms in Neural Networks

abstract: The underlying mechanism of neural networks in capturing precise knowledge has been the subject of consistent research efforts. In this work, we propose a theoretical approach based on Neural Tangent Kernels (NTKs) to investigate such mechanisms. Specifically, considering the infinite network width, we hypothesize the learning dynamics of target models may intuitively unravel the features they acquire from training data, deepening our insights into their internal mechanisms. We apply our approach to several fundamental models and reveal how these models leverage statistical features during gradient descent and how they are integrated into final decisions. We also discovered that the choice of activation function can affect feature extraction. For instance, the use of the \textit{ReLU} activation function could potentially introduce a bias in features, providing a plausible explanation for its replacement with alternative functions in recent pre-trained language models. Additionally, we find that while self-attention and CNN models may exhibit limitations in learning n-grams, multiplication-based models seem to excel in this area. We verify these theoretical findings through experiments and find that they can be applied to analyze language modeling tasks, which can be regarded as a special variant of classification. Our contributions offer insights into the roles and capacities of fundamental components within large language models, thereby aiding the broader understanding of these complex systems.


title: Fast Algorithms for Separable Linear Programs

abstract: In numerical linear algebra, considerable effort has been devoted to obtaining faster algorithms for linear systems whose underlying matrices exhibit structural properties. A prominent success story is the method of generalized nested dissection~[Lipton-Rose-Tarjan'79] for separable matrices. On the other hand, the majority of recent developments in the design of efficient linear program (LP) solves do not leverage the ideas underlying these faster linear system solvers nor consider the separable structure of the constraint matrix. We give a faster algorithm for separable linear programs. Specifically, we consider LPs of the form $\min_{\mathbf{A}\mathbf{x}=\mathbf{b}, \mathbf{l}\leq\mathbf{x}\leq\mathbf{u}} \mathbf{c}^\top\mathbf{x}$, where the graphical support of the constraint matrix $\mathbf{A} \in \mathbb{R}^{n\times m}$ is $O(n^\alpha)$-separable. These include flow problems on planar graphs and low treewidth matrices among others. We present an $\tilde{O}((m+m^{1/2 + 2\alpha}) \log(1/\epsilon))$ time algorithm for these LPs, where $\epsilon$ is the relative accuracy of the solution. Our new solver has two important implications: for the $k$-multicommodity flow problem on planar graphs, we obtain an algorithm running in $\tilde{O}(k^{5/2} m^{3/2})$ time in the high accuracy regime; and when the support of $\mathbf{A}$ is $O(n^\alpha)$-separable with $\alpha \leq 1/4$, our algorithm runs in $\tilde{O}(m)$ time, which is nearly optimal. The latter significantly improves upon the natural approach of combining interior point methods and nested dissection, whose time complexity is lower bounded by $\Omega(\sqrt{m}(m+m^{\alpha\omega}))=\Omega(m^{3/2})$, where $\omega$ is the matrix multiplication constant. Lastly, in the setting of low-treewidth LPs, we recover the results of [DLY,STOC21] and [GS,22] with significantly simpler data structure machinery.


title: Quantifying the Chirality of Vibrational Modes in Helical Molecular Chains

abstract: The lack of quantitative methods for studying chirality has stunted our theoretical understanding of chirality-induced physical phenomena. The chiral phonon has been proposed to be involved in various physical phenomena, but it is not yet well defined mathematically. Here we examine two approaches for assigning and quantifying the chirality of molecular normal modes in double-helical molecular wires with various levels of twist. First, associating with each normal mode a structure obtained by imposing the corresponding motion on a common atomic origin, we apply the Continuous Chirality Measure (CCM) to quantitatively assess the relationship between the chirality-weighted normal mode spectrum and the chirality of the underlying molecular structure. We find that increasing the amount of twist in the double helix shifts the mean normal mode CCM to drastically higher values, implying that the chirality of molecular normal modes is strongly correlated with that of the underlying molecular structure. Second, we assign to each normal mode a pseudoscaler defined as the product of atomic linear and angular momentum summed over all atoms, and we analyze the handedness of the normal mode spectrum with respect to this quantity. We find that twisting the double-chain structure introduces asymmetry between right and left-handed normal modes so that in twisted structures different frequency bands are characterized by distinct handedness. This may give rise to global phenomena such as thermal chirality.


title: Bound states from the spectral Bethe-Salpeter equation

abstract: We compute the bound state properties of three-dimensional scalar $\phi^4$ theory in the broken phase. To this end, we extend the recently developed technique of spectral Dyson-Schwinger equations to solve the Bethe-Salpeter equation and determine the bound state spectrum. We employ consistent truncations for the two-, three- and four-point functions of the theory that recover the scaling properties in the infinite coupling limit. Our result for the mass of the lowest-lying bound state in this limit agrees very well with lattice determinations.


title: RAMPART: RowHammer Mitigation and Repair for Server Memory Systems

abstract: RowHammer attacks are a growing security and reliability concern for DRAMs and computer systems as they can induce many bit errors that overwhelm error detection and correction capabilities. System-level solutions are needed as process technology and circuit improvements alone are unlikely to provide complete protection against RowHammer attacks in the future. This paper introduces RAMPART, a novel approach to mitigating RowHammer attacks and improving server memory system reliability by remapping addresses in each DRAM in a way that confines RowHammer bit flips to a single device for any victim row address. When RAMPART is paired with Single Device Data Correction (SDDC) and patrol scrub, error detection and correction methods in use today, the system can detect and correct bit flips from a successful attack, allowing the memory system to heal itself. RAMPART is compatible with DDR5 RowHammer mitigation features, as well as a wide variety of algorithmic and probabilistic tracking methods. We also introduce BRC-VL, a variation of DDR5 Bounded Refresh Configuration (BRC) that improves system performance by reducing mitigation overhead and show that it works well with probabilistic sampling methods to combat traditional and victim-focused mitigation attacks like Half-Double. The combination of RAMPART, SDDC, and scrubbing enables stronger RowHammer resistance by correcting bit flips from one successful attack. Uncorrectable errors are much less likely, requiring two successful attacks before the memory system is scrubbed.


title: RedCoast: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs

abstract: The recent progress of AI can be largely attributed to large language models (LLMs). However, their escalating memory requirements introduce challenges for machine learning (ML) researchers and engineers. Addressing this requires developers to partition a large model to distribute it across multiple GPUs or TPUs. This necessitates considerable coding and intricate configuration efforts with existing model parallel tools, such as Megatron-LM, DeepSpeed, and Alpa. These tools require users' expertise in machine learning systems (MLSys), creating a bottleneck in LLM development, particularly for developers without MLSys background. In this work, we present RedCoast (Redco), a lightweight and user-friendly tool crafted to automate distributed training and inference for LLMs, as well as to simplify ML pipeline development. The design of Redco emphasizes two key aspects. Firstly, to automate model parallelism, our study identifies two straightforward rules to generate tensor parallel strategies for any given LLM. Integrating these rules into Redco facilitates effortless distributed LLM training and inference, eliminating the need of additional coding or complex configurations. We demonstrate the effectiveness by applying Redco on a set of LLM architectures, such as GPT-J, LLaMA, T5, and OPT, up to the size of 66B. Secondly, we propose a mechanism that allows for the customization of diverse ML pipelines through the definition of merely three functions, avoiding redundant and formulaic code like multi-host related processing. This mechanism proves adaptable across a spectrum of ML algorithms, from foundational language modeling to complex algorithms like meta-learning and reinforcement learning. As a result, Redco implementations exhibit significantly fewer lines of code compared to their official counterparts.


title: A Multi-Modal Multilingual Benchmark for Document Image Classification

abstract: Document image classification is different from plain-text document classification and consists of classifying a document by understanding the content and structure of documents such as forms, emails, and other such documents. We show that the only existing dataset for this task (Lewis et al., 2006) has several limitations and we introduce two newly curated multilingual datasets WIKI-DOC and MULTIEURLEX-DOC that overcome these limitations. We further undertake a comprehensive study of popular visually-rich document understanding or Document AI models in previously untested setting in document image classification such as 1) multi-label classification, and 2) zero-shot cross-lingual transfer setup. Experimental results show limitations of multilingual Document AI models on cross-lingual transfer across typologically distant languages. Our datasets and findings open the door for future research into improving Document AI models.


title: The Brans-Dicke field in Non-metricity gravity: Cosmological solutions and Conformal transformations

abstract: We consider the Brans-Dicke theory in non-metricity gravity, which belongs to the family of symmetric teleparallel scalar-tensor theories. Our focus lies in exploring the implications of the conformal transformation, as we derive the conformal equivalent theory in the Einstein frame, distinct from the minimally coupled scalar field theory. The fundamental principle of the conformal transformation suggests the mathematical equivalence of the related theories. However, to thoroughly analyze the impact on physical variables, we investigate the spatially flat Friedmann--Lema\^{\i}tre--Robertson--Walker geometry, defining the connection in the non-coincidence gauge. We construct exact solutions for the cosmological model in one frame and compare the physical properties in the conformal related frame. Surprisingly, we find that the general physical properties of the exact solutions remain invariant under the conformal transformation. Finally, we construct, for the first time, an analytic solution for the symmetric teleparallel scalar-tensor cosmology.


title: From Simple to Complex: A Progressive Framework for Document-level Informative Argument Extraction

abstract: Document-level Event Argument Extraction (EAE) requires the model to extract arguments of multiple events from a single document. Considering the underlying dependencies between these events, recent efforts leverage the idea of "memory", where the results of already predicted events are cached and can be retrieved to help the prediction of upcoming events. These methods extract events according to their appearance order in the document, however, the event that appears in the first sentence does not mean that it is the easiest to extract. Existing methods might introduce noise to the extraction of upcoming events if they rely on an incorrect prediction of previous events. In order to provide more reliable memory, we propose a simple-to-complex progressive framework for document-level EAE. Specifically, we first calculate the difficulty of each event and then, we conduct the extraction following a simple-to-complex order. In this way, the memory will store the most certain results, and the model could use these reliable sources to help the prediction of more difficult events. Experiments on WikiEvents show that our model outperforms SOTA by 1.4% in F1, indicating the proposed simple-to-complex framework is useful in the EAE task.


title: Normalized Solutions to Nonautonomous Kirchhoff Equation

abstract: In this paper, we study the existence of normalized solutions to the following Kirchhoff equation with a perturbation: $$ \left\{ \begin{aligned} &-\left(a+b\int _{\mathbb{R}^{N}}\left | \nabla u \right|^{2} dx\right)\Delta u+\lambda u=|u|^{p-2} u+h(x)\left |u\right |^{q-2}u, \quad \text{ in } \mathbb{R}^{N}, \\ &\int_{\mathbb{R}^{N}}\left|u\right|^{2}dx=c, \quad u \in H^{1}(\mathbb{R}^{N}), \end{aligned} \right. $$ where $1\le N\le 3, a,b,c>0, 1\leq q<2$, $\lambda \in \mathbb{R}$. We treat three cases. (i)When $2<p<2+\frac{4}{N},h(x)\ge0$, we obtain the existence of global constraint minimizers. (ii)When $2+\frac{8}{N}<p<2^{*},h(x)\ge0$, we prove the existence of mountain pass solution. (iii)When $2+\frac{8}{N}<p<2^{*},h(x)\leq0$, we establish the existence of bound state solutions.


title: A Comprehensive Review of AI-enabled Unmanned Aerial Vehicle: Trends, Vision , and Challenges

abstract: In recent years, the combination of artificial intelligence (AI) and unmanned aerial vehicles (UAVs) has brought about advancements in various areas. This comprehensive analysis explores the changing landscape of AI-powered UAVs and friendly computing in their applications. It covers emerging trends, futuristic visions, and the inherent challenges that come with this relationship. The study examines how AI plays a role in enabling navigation, detecting and tracking objects, monitoring wildlife, enhancing precision agriculture, facilitating rescue operations, conducting surveillance activities, and establishing communication among UAVs using environmentally conscious computing techniques. By delving into the interaction between AI and UAVs, this analysis highlights the potential for these technologies to revolutionise industries such as agriculture, surveillance practices, disaster management strategies, and more. While envisioning possibilities, it also takes a look at ethical considerations, safety concerns, regulatory frameworks to be established, and the responsible deployment of AI-enhanced UAV systems. By consolidating insights from research endeavours in this field, this review provides an understanding of the evolving landscape of AI-powered UAVs while setting the stage for further exploration in this transformative domain.


title: InstructPTS: Instruction-Tuning LLMs for Product Title Summarization

abstract: E-commerce product catalogs contain billions of items. Most products have lengthy titles, as sellers pack them with product attributes to improve retrieval, and highlight key product aspects. This results in a gap between such unnatural products titles, and how customers refer to them. It also limits how e-commerce stores can use these seller-provided titles for recommendation, QA, or review summarization. Inspired by recent work on instruction-tuned LLMs, we present InstructPTS, a controllable approach for the task of Product Title Summarization (PTS). Trained using a novel instruction fine-tuning strategy, our approach is able to summarize product titles according to various criteria (e.g. number of words in a summary, inclusion of specific phrases, etc.). Extensive evaluation on a real-world e-commerce catalog shows that compared to simple fine-tuning of LLMs, our proposed approach can generate more accurate product name summaries, with an improvement of over 14 and 8 BLEU and ROUGE points, respectively.


title: Neural Potential Field for Obstacle-Aware Local Motion Planning

abstract: Model predictive control (MPC) may provide local motion planning for mobile robotic platforms. The challenging aspect is the analytic representation of collision cost for the case when both the obstacle map and robot footprint are arbitrary. We propose a Neural Potential Field: a neural network model that returns a differentiable collision cost based on robot pose, obstacle map, and robot footprint. The differentiability of our model allows its usage within the MPC solver. It is computationally hard to solve problems with a very high number of parameters. Therefore, our architecture includes neural image encoders, which transform obstacle maps and robot footprints into embeddings, which reduce problem dimensionality by two orders of magnitude. The reference data for network training are generated based on algorithmic calculation of a signed distance function. Comparative experiments showed that the proposed approach is comparable with existing local planners: it provides trajectories with outperforming smoothness, comparable path length, and safe distance from obstacles. Experiment on Husky UGV mobile robot showed that our approach allows real-time and safe local planning. The code for our approach is presented at https://github.com/cog-isa/NPField together with demo video.


title: Finite-Time Analysis of Three-Timescale Constrained Actor-Critic and Constrained Natural Actor-Critic Algorithms

abstract: Actor Critic methods have found immense applications on a wide range of Reinforcement Learning tasks especially when the state-action space is large. In this paper, we consider actor critic and natural actor critic algorithms with function approximation for constrained Markov decision processes (C-MDP) involving inequality constraints and carry out a non-asymptotic analysis for both of these algorithms in a non-i.i.d (Markovian) setting. We consider the long-run average cost criterion where both the objective and the constraint functions are suitable policy-dependent long-run averages of certain prescribed cost functions. We handle the inequality constraints using the Lagrange multiplier method. We prove that these algorithms are guaranteed to find a first-order stationary point (i.e., $\Vert \nabla L(\theta,\gamma)\Vert_2^2 \leq \epsilon$) of the performance (Lagrange) function $L(\theta,\gamma)$, with a sample complexity of $\mathcal{\tilde{O}}(\epsilon^{-2.5})$ in the case of both Constrained Actor Critic (C-AC) and Constrained Natural Actor Critic (C-NAC) algorithms. We also show the results of experiments on three different Safety-Gym environments.


title: Towards Large-scale Masked Face Recognition

abstract: During the COVID-19 coronavirus epidemic, almost everyone is wearing masks, which poses a huge challenge for deep learning-based face recognition algorithms. In this paper, we will present our \textbf{championship} solutions in ICCV MFR WebFace260M and InsightFace unconstrained tracks. We will focus on four challenges in large-scale masked face recognition, i.e., super-large scale training, data noise handling, masked and non-masked face recognition accuracy balancing, and how to design inference-friendly model architecture. We hope that the discussion on these four aspects can guide future research towards more robust masked face recognition systems.


title: G-Invariant Representations using Coorbits: Injectivity Properties

abstract: Consider a real vector space $\mathcal{V}$ and a finite group $G$ acting unitarily on $\mathcal{V}$. We study the general problem of constructing a stable embedding whose domain is the quotient of the vector space modulo the group action, and whose target space is a Euclidean space. We construct an embedding $\Psi$ and we study under which assumptions $\Psi$ is injective in the quotient vector space. The embedding scheme we introduce is based on selecting a fixed subset from the sorted orbit $\downarrow\langle{U_gw_i},{x}\rangle_{g \in G}$, where $w_i$ are appropriate vectors.


title: Green's function and LDOS for non-relativistic electron pair

abstract: The Coulomb Green's function (GF) for non-relativistic charged particle in field of attractive Coulomb force is extended to describe the interaction of two non-relativistic electrons through repulsive Coulomb forces. Closed-form expressions for the GF, in the absence of electron spins, are derived as one-dimensional integrals. The results are then generalized to include electron spins and account for the Pauli exclusion principle. This leads to a final GF composed of two components, one even and the other odd with respect to exchange particles, with closed-form expressions represented as one-dimensional integrals. The Dyson equations for spin-independent potentials is presented. The local density of states (LDOS) is calculated, which is a combination of contributions from both even and odd GFs. This calculation reveals the dependence of LDOS on inter-electron distance and energy. Separate analysis of the impact of the Pauli exclusion principle is provided. An examination of the pseudo-LDOS, arising from the two-body contribution to the Green's function, is undertaken. Complete suppression of the LDOS at~$r=0$ is ensured by this term, which exhibits a restricted spatial extent. The reasons for the emergence of this pseudo-LDOS are elucidated.


title: UniX-Encoder: A Universal $X$-Channel Speech Encoder for Ad-Hoc Microphone Array Speech Processing

abstract: The speech field is evolving to solve more challenging scenarios, such as multi-channel recordings with multiple simultaneous talkers. Given the many types of microphone setups out there, we present the UniX-Encoder. It's a universal encoder designed for multiple tasks, and worked with any microphone array, in both solo and multi-talker environments. Our research enhances previous multi-channel speech processing efforts in four key areas: 1) Adaptability: Contrasting traditional models constrained to certain microphone array configurations, our encoder is universally compatible. 2) Multi-Task Capability: Beyond the single-task focus of previous systems, UniX-Encoder acts as a robust upstream model, adeptly extracting features for diverse tasks including ASR and speaker recognition. 3) Self-Supervised Training: The encoder is trained without requiring labeled multi-channel data. 4) End-to-End Integration: In contrast to models that first beamform then process single-channels, our encoder offers an end-to-end solution, bypassing explicit beamforming or separation. To validate its effectiveness, we tested the UniX-Encoder on a synthetic multi-channel dataset from the LibriSpeech corpus. Across tasks like speech recognition and speaker diarization, our encoder consistently outperformed combinations like the WavLM model with the BeamformIt frontend.


title: Transformer-based Live Update Generation for Soccer Matches from Microblog Posts

abstract: It has been known to be difficult to generate adequate sports updates from a sequence of vast amounts of diverse live tweets, although the live sports viewing experience with tweets is gaining the popularity. In this paper, we focus on soccer matches and work on building a system to generate live updates for soccer matches from tweets so that users can instantly grasp a match's progress and enjoy the excitement of the match from raw tweets. Our proposed system is based on a large pre-trained language model and incorporates a mechanism to control the number of updates and a mechanism to reduce the redundancy of duplicate and similar updates.


title: Cut-free sequent calculi for the provability logic D

abstract: We say that a Kripke model is a GL-model if the accessibility relation $\prec$ is transitive and converse well-founded. We say that a Kripke model is a D-model if it is obtained by attaching infinitely many worlds $t_1, t_2, \ldots$, and $t_\omega$ to a world $t_0$ of a GL-model so that $t_0 \succ t_1 \succ t_2 \succ \cdots \succ t_\omega$. A non-normal modal logic D, which was studied by Beklemishev (1999), is characterized as follows. A formula $\varphi$ is a theorem of D if and only if $\varphi$ is true at $t_\omega$ in any D-model. D is an intermediate logic between the provability logics GL and S. A Hilbert-style proof system for D is known, but there has been no sequent calculus. In this paper, we establish two sequent calculi for D, and show the cut-elimination theorem. We also introduce new Hilbert-style systems for D by interpreting the sequent calculi. Moreover we show a general result as follows. Let $X$ and $X^+$ be arbitrary modal logics. If the relationship between semantics of $X$ and semantics of $X^+$ is equal to that of GL and D, then $X^+$ can be axiomatized based on $X$ in the same way as the new axiomatization of D based on GL.


title: PartRePer-MPI: Combining Fault Tolerance and Performance for MPI Applications

abstract: As we have entered Exascale computing, the faults in high-performance systems are expected to increase considerably. To compensate for a higher failure rate, the standard checkpoint/restart technique would need to create checkpoints at a much higher frequency resulting in an excessive amount of overhead which would not be sustainable for many scientific applications. Replication allows for fast recovery from failures by simply dropping the failed processes and using their replicas to continue the regular operation of the application. In this paper, we have implemented PartRePer-MPI, a novel fault-tolerant MPI library that adopts partial replication of some of the launched MPI processes in order to provide resilience from failures. The novelty of our work is that it combines both fault tolerance, due to the use of the User Level Failure Mitigation (ULFM) framework in the Open MPI library, and high performance, due to the use of communication protocols in the native MPI library that is generally fine-tuned for specific HPC platforms. We have implemented efficient and parallel communication strategies with computational and replica processes, and our library can seamlessly provide fault tolerance support to an existing MPI application. Our experiments using seven NAS Parallel Benchmarks and two scientific applications show that the failure-free overheads in PartRePer-MPI when compared to the baseline MVAPICH2, are only up to 6.4% for the NAS parallel benchmarks and up to 9.7% for the scientific applications.


title: Synergizing Airborne Non-Terrestrial Networks and Reconfigurable Intelligent Surfaces-Aided 6G IoT

abstract: On the one hand, Reconfigurable Intelligent Surfaces (RISs) emerge as a promising solution to meet the demand for higher data rates, improved coverage, and efficient spectrum utilization. On the other hand, Non-Terrestrial Networks (NTNs) offer unprecedented possibilities for global connectivity. Moreover, the NTN can also support the upsurge in the number of Internet of Things (IoT) devices by providing reliable and ubiquitous connectivity. Although NTNs have shown promising results, there are several challenges associated with their usage, such as signal propagation delays, interference, security, etc. In this article, we have discussed the possibilities of integrating RIS with an NTN platform to overcome the issues associated with NTN. Furthermore, through experimental validation, we have demonstrated that the RIS-assisted NTN can play a pivotal role in improving the performance of the entire communication system.


title: A model for drift velocity mediated scalar eddy diffusivity in homogeneous turbulent flows

abstract: Low Stokes number particles at dilute concentrations in turbulent flows can reasonably be approximated as passive scalars. The added presence of a drift velocity due to buoyancy or gravity when considering the transport of such passive scalars can reduce the turbulent dispersion of the scalar via a diminution of the eddy diffusivity. In this work, we propose a model to describe this decay and use a recently developed technique to accurately and efficiently measure the eddy diffusivity using Eulerian fields and quantities. We then show a correspondence between this method and standard Lagrangian definitions of diffusivity and collect data across a range of drift velocities and Reynolds numbers. The proposed model agrees with data from these direct numerical simulations, offers some improvement to previous models in describing other computational and experimental data, and satisfies theoretical constraints that are independent of Reynolds number.


title: Pauli resonance states in light nuclei: how they appear and how they can be eliminated

abstract: Systematic analysis of parameters and properties of the Pauli resonance states are performed for light nuclei $^{6}$Li, $^{7}$Li, $^{8}$Be, $^{9}$Be and $^{10}$B, which are treated as two-cluster systems. The Pauli resonance states are redundant solutions of the resonating group method appearing when one try use more advanced description of the internal structure of interacting clusters. Our calculations are performed in a standard and advanced versions of the resonating group method. The standard version employs wave functions of many-particle shell model to describe internal motion of nucleons within each cluster. The advanced version is based on three-cluster resonating group method. As in the standard version, the internal wave functions of three clusters are approximated by wave functions of many-particle shell model model. However, in advanced version one of pair of clusters forms a bound state, and third cluster is considered to interact with such state. It is found that the Pauli resonance states in nuclei under consideration have energy between 11 and 46 MeV, and their widths vary from 8 keV to 6.7 MeV. Analysis of wave functions of Pauli resonance states and matrix elements of norm kernel allowed us to formulate an effective method for eliminating Pauli resonance states. It is demonstrated that this method effectively eliminate all determined the Pauli resonance states.


title: Joint Distributional Learning via Cramer-Wold Distance

abstract: The assumption of conditional independence among observed variables, primarily used in the Variational Autoencoder (VAE) decoder modeling, has limitations when dealing with high-dimensional datasets or complex correlation structures among observed variables. To address this issue, we introduced the Cramer-Wold distance regularization, which can be computed in a closed-form, to facilitate joint distributional learning for high-dimensional datasets. Additionally, we introduced a two-step learning method to enable flexible prior modeling and improve the alignment between the aggregated posterior and the prior distribution. Furthermore, we provide theoretical distinctions from existing methods within this category. To evaluate the synthetic data generation performance of our proposed approach, we conducted experiments on high-dimensional datasets with multiple categorical variables. Given that many readily available datasets and data science applications involve such datasets, our experiments demonstrate the effectiveness of our proposed methodology.


title: DyExplainer: Explainable Dynamic Graph Neural Networks

abstract: Graph Neural Networks (GNNs) resurge as a trending research subject owing to their impressive ability to capture representations from graph-structured data. However, the black-box nature of GNNs presents a significant challenge in terms of comprehending and trusting these models, thereby limiting their practical applications in mission-critical scenarios. Although there has been substantial progress in the field of explaining GNNs in recent years, the majority of these studies are centered on static graphs, leaving the explanation of dynamic GNNs largely unexplored. Dynamic GNNs, with their ever-evolving graph structures, pose a unique challenge and require additional efforts to effectively capture temporal dependencies and structural relationships. To address this challenge, we present DyExplainer, a novel approach to explaining dynamic GNNs on the fly. DyExplainer trains a dynamic GNN backbone to extract representations of the graph at each snapshot, while simultaneously exploring structural relationships and temporal dependencies through a sparse attention technique. To preserve the desired properties of the explanation, such as structural consistency and temporal continuity, we augment our approach with contrastive learning techniques to provide priori-guided regularization. To model longer-term temporal dependencies, we develop a buffer-based live-updating scheme for training. The results of our extensive experiments on various datasets demonstrate the superiority of DyExplainer, not only providing faithful explainability of the model predictions but also significantly improving the model prediction accuracy, as evidenced in the link prediction task.


title: GADY: Unsupervised Anomaly Detection on Dynamic Graphs

abstract: Anomaly detection on dynamic graphs refers to detecting entities whose behaviors obviously deviate from the norms observed within graphs and their temporal information. This field has drawn increasing attention due to its application in finance, network security, social networks, and more. However, existing methods face two challenges: dynamic structure constructing challenge - difficulties in capturing graph structure with complex time information and negative sampling challenge - unable to construct excellent negative samples for unsupervised learning. To address these challenges, we propose Unsupervised Generative Anomaly Detection on Dynamic Graphs (GADY). To tackle the first challenge, we propose a continuous dynamic graph model to capture the fine-grained information, which breaks the limit of existing discrete methods. Specifically, we employ a message-passing framework combined with positional features to get edge embeddings, which are decoded to identify anomalies. For the second challenge, we pioneer the use of Generative Adversarial Networks to generate negative interactions. Moreover, we design a loss function to alter the training goal of the generator while ensuring the diversity and quality of generated samples. Extensive experiments demonstrate that our proposed GADY significantly outperforms the previous state-of-the-art method on three real-world datasets. Supplementary experiments further validate the effectiveness of our model design and the necessity of each module.


title: Nonlinear steering control under input magnitude and rate constraints with exponential convergence

abstract: A ship steering control is designed for a nonlinear maneuvering model whose rudder manipulation is constrained in both magnitude and rate. In our method, the tracking problem of the target heading angle with input constraints is converted into the tracking problem for a strict-feedback system without any input constraints. To derive this system, hyperbolic tangent ($\tanh$) function and auxiliary variables are introduced to deal with the input constraints. Furthermore, using the feature of the derivative of $\tanh$ function, auxiliary systems are successfully derived in the strict-feedback form. The backstepping method is utilized to construct the feedback control law for the resulting cascade system. The proposed steering control is verified in numerical experiments, and the result shows that the tracking of the target heading angle is successful using the proposed control law.


title: Quantum interferometers: principles and applications

abstract: Interference, which refers to the phenomenon associated with the superposition of waves, has played a crucial role in the advancement of physics and finds a wide range of applications in physical and engineering measurements. Interferometers are experimental setups designed to observe and manipulate interference. With the development of technology, many quantum interferometers have been discovered and have become cornerstone tools in the field of quantum physics. Quantum interferometers not only explore the nature of the quantum world but also have extensive applications in quantum information technology, such as quantum communication, quantum computing, and quantum measurement. In this review, we analyze and summarize three typical quantum interferometers: the Hong-Ou-Mandel (HOM) interferometer, the N00N state interferometer, and the Franson interferometer. We focus on the principles and applications of these three interferometers. In the principles section, we present the theoretical models for these interferometers, including single-mode theory and multi-mode theory. In the applications section, we review the applications of these interferometers in quantum communication, computation, and measurement. We hope that this review article will promote the development of quantum interference in both fundamental science and practical engineering applications.


title: Evaluating General-Purpose AI with Psychometrics

abstract: Comprehensive and accurate evaluation of general-purpose AI systems such as large language models allows for effective mitigation of their risks and deepened understanding of their capabilities. Current evaluation methodology, mostly based on benchmarks of specific tasks, falls short of adequately assessing these versatile AI systems, as present techniques lack a scientific foundation for predicting their performance on unforeseen tasks and explaining their varying performance on specific task items or user inputs. Moreover, existing benchmarks of specific tasks raise growing concerns about their reliability and validity. To tackle these challenges, we suggest transitioning from task-oriented evaluation to construct-oriented evaluation. Psychometrics, the science of psychological measurement, provides a rigorous methodology for identifying and measuring the latent constructs that underlie performance across multiple tasks. We discuss its merits, warn against potential pitfalls, and propose a framework to put it into practice. Finally, we explore future opportunities of integrating psychometrics with the evaluation of general-purpose AI systems.


title: A model for multi-attack classification to improve intrusion detection performance using deep learning approaches

abstract: This proposed model introduces novel deep learning methodologies. The objective here is to create a reliable intrusion detection mechanism to help identify malicious attacks. Deep learning based solution framework is developed consisting of three approaches. The first approach is Long-Short Term Memory Recurrent Neural Network (LSTM-RNN) with seven optimizer functions such as adamax, SGD, adagrad, adam, RMSprop, nadam and adadelta. The model is evaluated on NSL-KDD dataset and classified multi attack classification. The model has outperformed with adamax optimizer in terms of accuracy, detection rate and low false alarm rate. The results of LSTM-RNN with adamax optimizer is compared with existing shallow machine and deep learning models in terms of accuracy, detection rate and low false alarm rate. The multi model methodology consisting of Recurrent Neural Network (RNN), Long-Short Term Memory Recurrent Neural Network (LSTM-RNN), and Deep Neural Network (DNN). The multi models are evaluated on bench mark datasets such as KDD99, NSL-KDD, and UNSWNB15 datasets. The models self-learnt the features and classifies the attack classes as multi-attack classification. The models RNN, and LSTM-RNN provide considerable performance compared to other existing methods on KDD99 and NSL-KDD dataset


title: Simple modules for untwisted affine Lie algebras induced from nilpotent loop subalgebras

abstract: We construct large families of simple modules for untwisted affine Lie algebras using induction from one-dimensional modules over nilpotent loop subalgebras. We also show that the vector space of the first self-extensions for these module has uncountable dimension and that generic tensor products of these modules are simple.


title: Some results on the maximal chromatic polynomials of $2$-connected $k$-chromatic graphs

abstract: In 2015, Brown and Erey conjectured that every $2$-connected graph $G$ on $n$ vertices with chromatic number $k\geq 4$ has at most $(x-1)_{k-1}\big((x-1)^{n-k+1}+(-1)^{n-k}\big)$ proper $x$-colorings for all $x\geq k$. Engbers, Erey, Fox, and He proved this conjecture for $x=k$. In this paper, we prove Brown and Erey's conjecture under the condition that either the clique number of $G$ is $k$, or the independent number of $G$ is $2$.


title: Open-NeRF: Towards Open Vocabulary NeRF Decomposition

abstract: In this paper, we address the challenge of decomposing Neural Radiance Fields (NeRF) into objects from an open vocabulary, a critical task for object manipulation in 3D reconstruction and view synthesis. Current techniques for NeRF decomposition involve a trade-off between the flexibility of processing open-vocabulary queries and the accuracy of 3D segmentation. We present, Open-vocabulary Embedded Neural Radiance Fields (Open-NeRF), that leverage large-scale, off-the-shelf, segmentation models like the Segment Anything Model (SAM) and introduce an integrate-and-distill paradigm with hierarchical embeddings to achieve both the flexibility of open-vocabulary querying and 3D segmentation accuracy. Open-NeRF first utilizes large-scale foundation models to generate hierarchical 2D mask proposals from varying viewpoints. These proposals are then aligned via tracking approaches and integrated within the 3D space and subsequently distilled into the 3D field. This process ensures consistent recognition and granularity of objects from different viewpoints, even in challenging scenarios involving occlusion and indistinct features. Our experimental results show that the proposed Open-NeRF outperforms state-of-the-art methods such as LERF \cite{lerf} and FFD \cite{ffd} in open-vocabulary scenarios. Open-NeRF offers a promising solution to NeRF decomposition, guided by open-vocabulary queries, enabling novel applications in robotics and vision-language interaction in open-world 3D scenes.


title: Distributed Uncertainty Quantification of Kernel Interpolation on Spheres

abstract: For radial basis function (RBF) kernel interpolation of scattered data, Schaback in 1995 proved that the attainable approximation error and the condition number of the underlying interpolation matrix cannot be made small simultaneously. He referred to this finding as an "uncertainty relation", an undesirable consequence of which is that RBF kernel interpolation is susceptible to noisy data. In this paper, we propose and study a distributed interpolation method to manage and quantify the uncertainty brought on by interpolating noisy spherical data of non-negligible magnitude. We also present numerical simulation results showing that our method is practical and robust in terms of handling noisy data from challenging computing environments.


title: Quantum Parametric Amplification and NonClassical Correlations due to 45 nm nMOS Circuitry Effect

abstract: This study unveils a groundbreaking exploration of using semiconductor technology in quantum circuitry. Leveraging the unique operability of 45 nm CMOS technology at deep cryogenic temperatures (~ 300 mK), a novel quantum electronic circuit is meticulously designed. Through the intricate coupling of two matching circuits via a 45 nm nMOS transistor, operating as an open quantum system, the circuit quantum Hamiltonian and the related Heisenberg-Langevin equation are derived, setting the stage for a comprehensive quantum analysis. Central to this investigation are three pivotal coefficients derived, which are the coupling between the coupled oscillator charge and flux operators through the internal circuit of the transistor. These coefficients emerge as critical determinants, shaping both the circuit potential as a parametric amplifier and its impact on quantum properties. The study unfolds a delicate interplay between these coefficients, showcasing their profound influence on quantum discord and the gain of the parametric amplifier. Consequently, the assimilation of 45 nm CMOS technology with quantum circuitry makes it possible to potentially bridge the technological gap in quantum computing applications, where the parametric amplifier is a necessary and critical device. The designed novel quantum device serves not only as a quantum parametric amplifier to amplify quantum signals but also enhances the inherent quantum properties of the signals such as non-classicality. Therefore, one can create an effective parametric amplifier that simultaneously improves the quantum characteristics of the signals. The more interesting result is that if such a theory becomes applicable, the circuit implemented in the deep-cryogenic temperature can be easily compatible with the next step of circuitry while keeping the same electronic features compatibility with the quantum processor.


title: Quantum Nonlocality: Multi-copy Resource Inter-convertibility & Their Asymptotic Inequivalence

abstract: Quantum nonlocality, pioneered in Bell's seminal work and subsequently verified through a series of experiments, has drawn substantial attention due to its practical applications in various protocols. Evaluating and comparing the extent of nonlocality within distinct quantum correlations holds significant practical relevance. Within the resource theoretic framework this can be achieved by assessing the inter-conversion rate among different nonlocal correlations under free local operations and shared randomness. In this study we, however, present instances of quantum nonlocal correlations that are incomparable in the strongest sense. Specifically, when starting with an arbitrary many copies of one nonlocal correlation, it becomes impossible to obtain even a single copy of the other correlation, and this incomparability holds in both directions. Remarkably, these incomparable quantum correlations can be obtained even in the simplest Bell scenario, which involves two parties, each having two dichotomic measurements setups. Notably, there exist an uncountable number of such incomparable correlations. Our result challenges the notion of a 'unique gold coin', often referred to as the 'maximally resourceful state', within the framework of the resource theory of quantum nonlocality, which has nontrivial implications in the study of nonlocality distillation.


title: Frequency-Aware Transformer for Learned Image Compression

abstract: Learned image compression (LIC) has gained traction as an effective solution for image storage and transmission in recent years. However, existing LIC methods are redundant in latent representation due to limitations in capturing anisotropic frequency components and preserving directional details. To overcome these challenges, we propose a novel frequency-aware transformer (FAT) block that for the first time achieves multiscale directional ananlysis for LIC. The FAT block comprises frequency-decomposition window attention (FDWA) modules to capture multiscale and directional frequency components of natural images. Additionally, we introduce frequency-modulation feed-forward network (FMFFN) to adaptively modulate different frequency components, improving rate-distortion performance. Furthermore, we present a transformer-based channel-wise autoregressive (T-CA) model that effectively exploits channel dependencies. Experiments show that our method achieves state-of-the-art rate-distortion performance compared to existing LIC methods, and evidently outperforms latest standardized codec VTM-12.1 by 14.5%, 15.1%, 13.0% in BD-rate on the Kodak, Tecnick, and CLIC datasets.


title: Deepfake Detection: Leveraging the Power of 2D and 3D CNN Ensembles

abstract: In the dynamic realm of deepfake detection, this work presents an innovative approach to validate video content. The methodology blends advanced 2-dimensional and 3-dimensional Convolutional Neural Networks. The 3D model is uniquely tailored to capture spatiotemporal features via sliding filters, extending through both spatial and temporal dimensions. This configuration enables nuanced pattern recognition in pixel arrangement and temporal evolution across frames. Simultaneously, the 2D model leverages EfficientNet architecture, harnessing auto-scaling in Convolutional Neural Networks. Notably, this ensemble integrates Voting Ensembles and Adaptive Weighted Ensembling. Strategic prioritization of the 3-dimensional model's output capitalizes on its exceptional spatio-temporal feature extraction. Experimental validation underscores the effectiveness of this strategy, showcasing its potential in countering deepfake generation's deceptive practices.


title: MVFAN: Multi-View Feature Assisted Network for 4D Radar Object Detection

abstract: 4D radar is recognized for its resilience and cost-effectiveness under adverse weather conditions, thus playing a pivotal role in autonomous driving. While cameras and LiDAR are typically the primary sensors used in perception modules for autonomous vehicles, radar serves as a valuable supplementary sensor. Unlike LiDAR and cameras, radar remains unimpaired by harsh weather conditions, thereby offering a dependable alternative in challenging environments. Developing radar-based 3D object detection not only augments the competency of autonomous vehicles but also provides economic benefits. In response, we propose the Multi-View Feature Assisted Network (\textit{MVFAN}), an end-to-end, anchor-free, and single-stage framework for 4D-radar-based 3D object detection for autonomous vehicles. We tackle the issue of insufficient feature utilization by introducing a novel Position Map Generation module to enhance feature learning by reweighing foreground and background points, and their features, considering the irregular distribution of radar point clouds. Additionally, we propose a pioneering backbone, the Radar Feature Assisted backbone, explicitly crafted to fully exploit the valuable Doppler velocity and reflectivity data provided by the 4D radar sensor. Comprehensive experiments and ablation studies carried out on Astyx and VoD datasets attest to the efficacy of our framework. The incorporation of Doppler velocity and RCS reflectivity dramatically improves the detection performance for small moving objects such as pedestrians and cyclists. Consequently, our approach culminates in a highly optimized 4D-radar-based 3D object detection capability for autonomous driving systems, setting a new standard in the field.


title: Evaluating Pre-trained Language Models for Repairing API Misuses

abstract: API misuses often lead to software bugs, crashes, and vulnerabilities. While several API misuse detectors have been proposed, there are no automatic repair tools specifically designed for this purpose. In a recent study, test-suite-based automatic program repair (APR) tools were found to be ineffective in repairing API misuses. Still, since the study focused on non-learning-aided APR tools, it remains unknown whether learning-aided APR tools are capable of fixing API misuses. In recent years, pre-trained language models (PLMs) have succeeded greatly in many natural language processing tasks. There is a rising interest in applying PLMs to APR. However, there has not been any study that investigates the effectiveness of PLMs in repairing API misuse. To fill this gap, we conduct a comprehensive empirical study on 11 learning-aided APR tools, which include 9 of the state-of-the-art general-purpose PLMs and two APR tools. We evaluate these models with an API-misuse repair dataset, consisting of two variants. Our results show that PLMs perform better than the studied APR tools in repairing API misuses. Among the 9 pre-trained models tested, CodeT5 is the best performer in the exact match. We also offer insights and potential exploration directions for future research.


title: Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization

abstract: Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH) address this problem by minimizing the learning target to find some of the parameters that are critical to the task. However, in OOD problems, such solutions are suboptimal as the learning task contains severe distribution noises, which can mislead the optimization process. Therefore, apart from finding the task-related parameters (i.e., invariant parameters), we propose Exploring Variant parameters for Invariant Learning (EVIL) which also leverages the distribution knowledge to find the parameters that are sensitive to distribution shift (i.e., variant parameters). Once the variant parameters are left out of invariant learning, a robust subnetwork that is resistant to distribution shift can be found. Additionally, the parameters that are relatively stable across distributions can be considered invariant ones to improve invariant learning. By fully exploring both variant and invariant parameters, our EVIL can effectively identify a robust subnetwork to improve OOD generalization. In extensive experiments on integrated testbed: DomainBed, EVIL can effectively and efficiently enhance many popular methods, such as ERM, IRM, SAM, etc.


title: Drift Observations and Mitigation in LCLS-II RF

abstract: The LCLS-II RF system physically spans ~700m and has strict requirements -- on the order of 20 fs -- on the phase stability of the accelerating RF fields in its SRF linac. While each LLRF rack is crudely temperature-stabilized, the weather inside the service building as a whole is usually compared to a tin shack in the California sun. A phase-averaging reference line is the primary system deployed in support of the phase stability goals. There are other, secondary subsystems (SEL phase offset, and determination of cavity detuning) that are also sensitive to RF phase drift. We present measurements of phase shifts observed in the overall RF system, and how diagnostics are able to sense and correct for them during beam operations.


title: ZGUL: Zero-shot Generalization to Unseen Languages using Multi-source Ensembling of Language Adapters

abstract: We tackle the problem of zero-shot cross-lingual transfer in NLP tasks via the use of language adapters (LAs). Most of the earlier works have explored training with adapter of a single source (often English), and testing either using the target LA or LA of another related language. Training target LA requires unlabeled data, which may not be readily available for low resource unseen languages: those that are neither seen by the underlying multilingual language model (e.g., mBERT), nor do we have any (labeled or unlabeled) data for them. We posit that for more effective cross-lingual transfer, instead of just one source LA, we need to leverage LAs of multiple (linguistically or geographically related) source languages, both at train and test-time - which we investigate via our novel neural architecture, ZGUL. Extensive experimentation across four language groups, covering 15 unseen target languages, demonstrates improvements of up to 3.2 average F1 points over standard fine-tuning and other strong baselines on POS tagging and NER tasks. We also extend ZGUL to settings where either (1) some unlabeled data or (2) few-shot training examples are available for the target language. We find that ZGUL continues to outperform baselines in these settings too.


title: Quantum Thermodynamics and Hierarchy of Quantum Correlations and Fidelity of Teleportation in a Two Coupled Double Quantum Dots

abstract: We explore the quantum correlations, fidelity and quantum thermodynamics of two coupled double quantum dots containing two excess electrons. In this regard, we investigate and compare the evolution of those measures under thermal effects and tunneling coupling. We find the hierarchy of quantum correlations, and one-way steering between the two quantum dots. We found, as expect that the quantum correlations are diminishes by increasing the values of temperature. We show that this state can be used for quantum teleportation. On the other, we address the extracting work and efficiency of the state. We compare the extraction work with the bare energies. Our results show that quantum dots states have a reliable and better capacity to preserve quantum correlations and remain one of the good resources for the deployment of quantum information processing protocols.


title: A note on no-hair properties of static black holes in four and higher dimensional spacetimes with cosmological constant

abstract: We study no-hair properties of static black holes in four and higher dimensional spacetimes with a cosmological constant. For the vanishing cosmological constant case, we show a no-hair theorem and also a no-short-hair theorem under certain conditions for the energy-momentum of matter fields. For the positive cosmological constant case, we discuss conditions for hairy static black holes to exist in terms of the energy density of matter fields evaluated at the black hole horizon and the cosmological horizon. For the negative cosmological constant case, we study conditions for hairy black holes by presenting a no-hair theorem in which the asymptotic structure is assumed to be determined by the true cosmological constant.


title: The Residually Indistinguishable Case of Ribet's Method for GL2

abstract: Ribet's method provides a strategy for constructing a nontrivial extension of a $p$-adic Galois representation $\rho_1$ by another such representation $\rho_2$. Suppose we are working over a local ring. An important assumption that occurs throughout literature is that the representations $\rho_i$ are residually distinguishable i.e. are residually non-isomorphic. The main theorem of this paper is a general version of Ribet's Lemma for $\rm{GL}_2$ where we do not impose the assumption that the associated characters are residually distinguished.


title: Learning Efficient Surrogate Dynamic Models with Graph Spline Networks

abstract: While complex simulations of physical systems have been widely used in engineering and scientific computing, lowering their often prohibitive computational requirements has only recently been tackled by deep learning approaches. In this paper, we present GraphSplineNets, a novel deep-learning method to speed up the forecasting of physical systems by reducing the grid size and number of iteration steps of deep surrogate models. Our method uses two differentiable orthogonal spline collocation methods to efficiently predict response at any location in time and space. Additionally, we introduce an adaptive collocation strategy in space to prioritize sampling from the most important regions. GraphSplineNets improve the accuracy-speedup tradeoff in forecasting various dynamical systems with increasing complexity, including the heat equation, damped wave propagation, Navier-Stokes equations, and real-world ocean currents in both regular and irregular domains.


title: Muonic hyperfine structure and the Bohr-Weisskopf effect

abstract: An update is given on the experimental values of the magnetic hyperfine structure and the Bohr-Weisskopf effect in muonic atoms. The need for more measurements and systematic calculations is discussed to allow the differentiation of different models of the Bohr-Weisskopf effect in nuclei.


title: The Brumer--Stark Conjecture over Z

abstract: In this paper we give a complete proof of the Brumer-Stark conjecture over $\mathbf{Z}$.


title: Fuse Your Latents: Video Editing with Multi-source Latent Diffusion Models

abstract: Latent Diffusion Models (LDMs) are renowned for their powerful capabilities in image and video synthesis. Yet, video editing methods suffer from insufficient pre-training data or video-by-video re-training cost. In addressing this gap, we propose FLDM (Fused Latent Diffusion Model), a training-free framework to achieve text-guided video editing by applying off-the-shelf image editing methods in video LDMs. Specifically, FLDM fuses latents from an image LDM and an video LDM during the denoising process. In this way, temporal consistency can be kept with video LDM while high-fidelity from the image LDM can also be exploited. Meanwhile, FLDM possesses high flexibility since both image LDM and video LDM can be replaced so advanced image editing methods such as InstructPix2Pix and ControlNet can be exploited. To the best of our knowledge, FLDM is the first method to adapt off-the-shelf image editing methods into video LDMs for video editing. Extensive quantitative and qualitative experiments demonstrate that FLDM can improve the textual alignment and temporal consistency of edited videos.


title: Graph Neural Networks with a Distribution of Parametrized Graphs

abstract: Traditionally, graph neural networks have been trained using a single observed graph. However, the observed graph represents only one possible realization. In many applications, the graph may encounter uncertainties, such as having erroneous or missing edges, as well as edge weights that provide little informative value. To address these challenges and capture additional information previously absent in the observed graph, we introduce latent variables to parameterize and generate multiple graphs. We obtain the maximum likelihood estimate of the network parameters in an Expectation-Maximization (EM) framework based on the multiple graphs. Specifically, we iteratively determine the distribution of the graphs using a Markov Chain Monte Carlo (MCMC) method, incorporating the principles of PAC-Bayesian theory. Numerical experiments demonstrate improvements in performance against baseline models on node classification for heterogeneous graphs and graph regression on chemistry datasets.


title: Video Referring Expression Comprehension via Transformer with Content-conditioned Query

abstract: Video Referring Expression Comprehension (REC) aims to localize a target object in videos based on the queried natural language. Recent improvements in video REC have been made using Transformer-based methods with learnable queries. However, we contend that this naive query design is not ideal given the open-world nature of video REC brought by text supervision. With numerous potential semantic categories, relying on only a few slow-updated queries is insufficient to characterize them. Our solution to this problem is to create dynamic queries that are conditioned on both the input video and language to model the diverse objects referred to. Specifically, we place a fixed number of learnable bounding boxes throughout the frame and use corresponding region features to provide prior information. Also, we noticed that current query features overlook the importance of cross-modal alignment. To address this, we align specific phrases in the sentence with semantically relevant visual areas, annotating them in existing video datasets (VID-Sentence and VidSTG). By incorporating these two designs, our proposed model (called ConFormer) outperforms other models on widely benchmarked datasets. For example, in the testing split of VID-Sentence dataset, ConFormer achieves 8.75% absolute improvement on Accu.@0.6 compared to the previous state-of-the-art model.


title: Cubulating Drilled bundles over graphs

abstract: We start with a Gromov-hyperbolic surface bundle $E$ over a graph, and drill out essential simple closed curves from fibers to obtain a drilled bundle $F$. We prove that for such drilled bundles $F$, the fundamental group $\pi_1(F)$ is relatively hyperbolic with $(\mathbb{Z}\oplus \mathbb{Z})$ peripheral groups. Combining the relative hyperbolicity of $\pi_1(F)$ thus obtained with a theorem of Wise, we establish virtually special cubulability of $\pi_1(F)$ provided that the maximal undrilled subbundles of $F$ are cubulable.


title: Accelerated linearized alternating direction method of multipliers with Nesterov extrapolation

abstract: The alternating direction method of multipliers (ADMM) has found widespread use in solving separable convex optimization problems. In this paper, by employing Nesterov extrapolation technique, we propose two families of accelerated linearized ADMMs for addressing two-block linearly constrained separable convex optimization problems where each block of the objective function exhibits a ``nonsmooth'' + ``smooth'' composite structure. Our proposed accelerated linearized ADMMs extend two classical Nesterov acceleration methods designed for unconstrained composite optimization problems to linearly constrained problems. These methods are capable of achieving non-ergodic convergence rates of $\mathcal{O}(1/k^2)$, provided that one block of the objective function exhibits strong convexity and the gradients of smooth terms are Lipschitz continuous. We show that the proposed methods can reduce to accelerated linearized augmented Lagrangian methods (ALMs) for solving one-block linearly constrained convex optimization problems. By choosing different extrapolation parameters, we explore the relationship between the proposed methods and some existing accelerated methods. Numerical results are presented to validate the efficacy and reliability of the proposed algorithms.


title: Binary State Recognition by Robots using Visual Question Answering of Pre-Trained Vision-Language Model

abstract: Recognition of the current state is indispensable for the operation of a robot. There are various states to be recognized, such as whether an elevator door is open or closed, whether an object has been grasped correctly, and whether the TV is turned on or off. Until now, these states have been recognized by programmatically describing the state of a point cloud or raw image, by annotating and learning images, by using special sensors, etc. In contrast to these methods, we apply Visual Question Answering (VQA) from a Pre-Trained Vision-Language Model (PTVLM) trained on a large-scale dataset, to such binary state recognition. This idea allows us to intuitively describe state recognition in language without any re-training, thereby improving the recognition ability of robots in a simple and general way. We summarize various techniques in questioning methods and image processing, and clarify their properties through experiments.


title: Radio Frequency Fingerprinting via Deep Learning: Challenges and Opportunities

abstract: Radio Frequency Fingerprinting (RFF) techniques promise to authenticate wireless devices at the physical layer based on inherent hardware imperfections introduced during manufacturing. Such RF transmitter imperfections are reflected into over-the-air signals, allowing receivers to accurately identify the RF transmitting source. Recent advances in Machine Learning, particularly in Deep Learning (DL), have improved the ability of RFF systems to extract and learn complex features that make up the device-specific fingerprint. However, integrating DL techniques with RFF and operating the system in real-world scenarios presents numerous challenges, originating from the embedded systems and the DL research domains. This paper systematically identifies and analyzes the essential considerations and challenges encountered in the creation of DL-based RFF systems across their typical development life-cycle, which include (i) data collection and preprocessing, (ii) training, and finally, (iii) deployment. Our investigation provides a comprehensive overview of the current open problems that prevent real deployment of DL-based RFF systems while also discussing promising research opportunities to enhance the overall accuracy, robustness, and privacy of these systems.


title: Information-Theoretic Generalization Analysis for Topology-aware Heterogeneous Federated Edge Learning over Noisy Channels

abstract: With the rapid growth of edge intelligence, the deployment of federated learning (FL) over wireless networks has garnered increasing attention, which is called Federated Edge Learning (FEEL). In FEEL, both mobile devices transmitting model parameters over noisy channels and collecting data in diverse environments pose challenges to the generalization of trained models. Moreover, devices can engage in decentralized FL via Device-to-Device communication while the communication topology of connected devices also impacts the generalization of models. Most recent theoretical studies overlook the incorporation of all these effects into FEEL when developing generalization analyses. In contrast, our work presents an information-theoretic generalization analysis for topology-aware FEEL in the presence of data heterogeneity and noisy channels. Additionally, we propose a novel regularization method called Federated Global Mutual Information Reduction (FedGMIR) to enhance the performance of models based on our analysis. Numerical results validate our theoretical findings and provide evidence for the effectiveness of the proposed method.


title: Quadrupole-octupole coupling and the onset of octupole collectivity

abstract: Octupole deformation and collective excitations are studied within the interacting boson model. By using the results of the self-consistent mean-field calculations with a universal energy density functional, the Hamiltonian of the interacting $s$, $d$, and $f$ boson system is completely determined. A global systematic study confirms that significant octupole effects are present in actinide, lanthanide, and rare-earth nuclei corresponding to particular nucleon numbers for which octupole correlations are empirically suggested to be enhanced.