title: NetMamba: Efficient Network Traffic Classification via Pre-training Unidirectional Mamba

abstract: Network traffic classification is a crucial research area aiming to enhance service quality, streamline network management, and bolster cybersecurity. To address the growing complexity of transmission encryption techniques, various machine learning and deep learning methods have been proposed. However, existing approaches face two main challenges. Firstly, they struggle with model inefficiency due to the quadratic complexity of the widely used Transformer architecture. Secondly, they suffer from inadequate traffic representation because of discarding important byte information while retaining unwanted biases. To address these challenges, we propose NetMamba, an efficient linear-time state space model equipped with a comprehensive traffic representation scheme. We adopt a specially selected and improved unidirectional Mamba architecture for the networking field, instead of the Transformer, to address efficiency issues. In addition, we design a traffic representation scheme to extract valid information from massive traffic data while removing biased information. Evaluation experiments on six public datasets encompassing three main classification tasks showcase NetMamba's superior classification performance compared to state-of-the-art baselines. It achieves an accuracy rate of nearly 99% (some over 99%) in all tasks. Additionally, NetMamba demonstrates excellent efficiency, improving inference speed by up to 60 times while maintaining comparably low memory usage. Furthermore, NetMamba exhibits superior few-shot learning abilities, achieving better classification performance with fewer labeled data. To the best of our knowledge, NetMamba is the first model to tailor the Mamba architecture for networking.


title: Ion-Based Quantum Computing Hardware: Performance and End-User Perspective

abstract: This is the second paper in a series of papers providing an overview of different quantum computing hardware platforms from an industrial end-user perspective. It follows our first paper on neutral-atom quantum computing. In the present paper, we provide a survey on the current state-of-the-art in trapped-ion quantum computing, taking up again the perspective of an industrial end-user. To this end, our paper covers, on the one hand, a comprehensive introduction to the physical foundations and mechanisms that play an important role in operating a trapped-ion quantum computer. On the other hand, we provide an overview of the key performance metrics that best describe and characterise such a device's current computing capability. These metrics encompass performance indicators such as qubit numbers, gate times and errors, native gate sets, qubit stability and scalability as well as considerations regarding the general qubit types and trap architectures. In order to ensure that these metrics reflect the current state of trapped-ion quantum computing as accurate as possible, they have been obtained by both an extensive review of recent literature and, more importantly, from discussions with various quantum hardware vendors in the field. We combine these factors and provide - again from an industrial end-user perspective - an overview of what is currently possible with trapped-ion quantum computers, which algorithms and problems are especially suitable for this platform, what are the relevant end-to-end wall clock times for calculations, and what might be possible with future fault-tolerant trapped-ion quantum computers.


title: Error Analysis of Three-Layer Neural Network Trained with PGD for Deep Ritz Method

abstract: Machine learning is a rapidly advancing field with diverse applications across various domains. One prominent area of research is the utilization of deep learning techniques for solving partial differential equations(PDEs). In this work, we specifically focus on employing a three-layer tanh neural network within the framework of the deep Ritz method(DRM) to solve second-order elliptic equations with three different types of boundary conditions. We perform projected gradient descent(PDG) to train the three-layer network and we establish its global convergence. To the best of our knowledge, we are the first to provide a comprehensive error analysis of using overparameterized networks to solve PDE problems, as our analysis simultaneously includes estimates for approximation error, generalization error, and optimization error. We present error bound in terms of the sample size $n$ and our work provides guidance on how to set the network depth, width, step size, and number of iterations for the projected gradient descent algorithm. Importantly, our assumptions in this work are classical and we do not require any additional assumptions on the solution of the equation. This ensures the broad applicability and generality of our results.


title: Breuer-Major Theorems for Hilbert Space-Valued Random Variables

abstract: Let $\{X_k\}_{k \in \mathbb{Z}}$ be a stationary Gaussian process with values in a separable Hilbert space $\mathcal{H}_1$, and let $G:\mathcal{H}_1 \to \mathcal{H}_2$ be an operator acting on $X_k$. Under suitable conditions on the operator $G$ and the temporal and cross-sectional correlations of $\{X_k\}_{k \in \mathbb{Z}}$, we derive a central limit theorem (CLT) for the normalized partial sums of $\{G[X_k]\}_{k \in \mathbb{Z}}$. To prove a CLT for the Hilbert space-valued process $\{G[X_k]\}_{k \in \mathbb{Z}}$, we employ techniques from the recently developed infinite dimensional Malliavin-Stein framework. In addition, we provide quantitative and continuous time versions of the derived CLT. In a series of examples, we recover and strengthen limit theorems for a wide array of statistics relevant in functional data analysis, and present a novel limit theorem in the framework of neural operators as an application of our result.


title: Study of relativistic hot accretion flow around Kerr-like Wormhole

abstract: We investigate the structure of relativistic, low-angular momentum, inviscid advective accretion flow in a stationary axisymmetric Kerr-like wormhole (WH) spacetime, characterized by the spin parameter ($a_{\rm k}$), the dimensionless parameter ($\beta$), and the source mass ($M_{\rm WH}$). In doing so, we self-consistently solve the set of governing equations describing the relativistic accretion flow around a Kerr-like WH in the steady state, and for the first time, we obtain all possible classes of global accretion solutions for transonic as well as subsonic flows. We study the properties of dynamical and thermodynamical flow variables and examine how the nature of the accretion solutions alters due to the change of the model parameters, namely energy ($\mathcal{E}$), angular momentum ($\lambda$), $a_{\rm k}$, and $\beta$. Further, we separate the parameter space in $\lambda-\mathcal{E}$ plane according to the nature of the flow solutions, and study the modification of the parameter space by varying $a_{\rm k}$ and $\beta$. Moreover, we retrace the parameter space in $a_{\rm k}-\beta$ plane that allows accretion solutions containing multiple critical points. Finally, we calculate the disc luminosity ($L$) considering free-free emissions for transonic solutions as these solutions are astrophysically relevant and discuss the implication of this model formalism in the context of astrophysical applications.


title: Comparisons Are All You Need for Optimizing Smooth Functions

abstract: When optimizing machine learning models, there are various scenarios where gradient computations are challenging or even infeasible. Furthermore, in reinforcement learning (RL), preference-based RL that only compares between options has wide applications, including reinforcement learning with human feedback in large language models. In this paper, we systematically study optimization of a smooth function $f\colon\mathbb{R}^n\to\mathbb{R}$ only assuming an oracle that compares function values at two points and tells which is larger. When $f$ is convex, we give two algorithms using $\tilde{O}(n/\epsilon)$ and $\tilde{O}(n^{2})$ comparison queries to find an $\epsilon$-optimal solution, respectively. When $f$ is nonconvex, our algorithm uses $\tilde{O}(n/\epsilon^2)$ comparison queries to find an $\epsilon$-approximate stationary point. All these results match the best-known zeroth-order algorithms with function evaluation queries in $n$ dependence, thus suggest that \emph{comparisons are all you need for optimizing smooth functions using derivative-free methods}. In addition, we also give an algorithm for escaping saddle points and reaching an $\epsilon$-second order stationary point of a nonconvex $f$, using $\tilde{O}(n^{1.5}/\epsilon^{2.5})$ comparison queries.


title: Impact Analysis of the Chesa Boudin Administration

abstract: Claims of soft-handed prosecutorial policies and increases in crime were precipitating factors in the removal of Chesa Boudin as district attorney of the city and county of San Francisco. However, little research has been conducted to empirically investigate the veracity of these indictments on the former district attorney. Using regression discontinuity design (RDD), I find that the Boudin administration led to a 36\% and 21\% reduction in monthly prosecutions and convictions respectively for all crimes. Moreover, his tenure increased monthly successful case diversions by 58\%. When only looking at violent crimes during this period, the SFDA's office saw a 36\% decrease, 7\% decrease, and 47\% increase in monthly prosecutions, convictions, and successful case diversions respectively. Although, the decrease in monthly convictions was not statistically significant for the violent crimes subset. Additionally, I did identify a potentially causal relationship between lower numbers of prosecutions and higher levels of criminal activity, however, such findings did not meet the standard for statistical significance. Finally, I conclude that using machine learning algorithms, such as neural networks and K-nearest neighbors, in place of ordinary least squares regression for the estimation of the reduced form equation possibly may decrease the size of the standard errors of the parameters in the structural equation. However, future research needs to be conducted in this space to corroborate these initially promising findings.


title: Biometrics-Based Authenticated Key Exchange with Multi-Factor Fuzzy Extractor

abstract: Existing fuzzy extractors and similar methods provide an effective way for extracting a secret key from a user's biometric data, but are susceptible to impersonation attack: once a valid biometric sample is captured, the scheme is no longer secure. We propose a novel multi-factor fuzzy extractor that integrates both a user's secret (e.g., a password) and a user's biometrics in the generation and reconstruction process of a cryptographic key. We then employ this multi-factor fuzzy extractor to construct personal identity credentials which can be used in a new multi-factor authenticated key exchange protocol that possesses multiple important features. First, the protocol provides mutual authentication. Second, the user and service provider can authenticate each other without the involvement of the identity authority. Third, the protocol can prevent user impersonation from a compromised identity authority. Finally, even when both a biometric sample and the secret are captured, the user can re-register to create a new credential using a new secret (reusable/reissued identity credentials). Most existing works on multi-factor authenticated key exchange only have a subset of these features. We formally prove that the proposed protocol is semantically secure. Our experiments carried out on the finger vein dataset SDUMLA achieved a low equal error rate (EER) of 0.04%, a reasonable averaged computation time of 0.93 seconds for the user and service provider to authenticate and establish a shared session key, and a small communication overhead of only 448 bytes.


title: Deep Dive into Model-free Reinforcement Learning for Biological and Robotic Systems: Theory and Practice

abstract: Animals and robots exist in a physical world and must coordinate their bodies to achieve behavioral objectives. With recent developments in deep reinforcement learning, it is now possible for scientists and engineers to obtain sensorimotor strategies (policies) for specific tasks using physically simulated bodies and environments. However, the utility of these methods goes beyond the constraints of a specific task; they offer an exciting framework for understanding the organization of an animal sensorimotor system in connection to its morphology and physical interaction with the environment, as well as for deriving general design rules for sensing and actuation in robotic systems. Algorithms and code implementing both learning agents and environments are increasingly available, but the basic assumptions and choices that go into the formulation of an embodied feedback control problem using deep reinforcement learning may not be immediately apparent. Here, we present a concise exposition of the mathematical and algorithmic aspects of model-free reinforcement learning, specifically through the use of \textit{actor-critic} methods, as a tool for investigating the feedback control underlying animal and robotic behavior.


title: CPS-LLM: Large Language Model based Safe Usage Plan Generator for Human-in-the-Loop Human-in-the-Plant Cyber-Physical System

abstract: We explore the usage of large language models (LLM) in human-in-the-loop human-in-the-plant cyber-physical systems (CPS) to translate a high-level prompt into a personalized plan of actions, and subsequently convert that plan into a grounded inference of sequential decision-making automated by a real-world CPS controller to achieve a control goal. We show that it is relatively straightforward to contextualize an LLM so it can generate domain-specific plans. However, these plans may be infeasible for the physical system to execute or the plan may be unsafe for human users. To address this, we propose CPS-LLM, an LLM retrained using an instruction tuning framework, which ensures that generated plans not only align with the physical system dynamics of the CPS but are also safe for human users. The CPS-LLM consists of two innovative components: a) a liquid time constant neural network-based physical dynamics coefficient estimator that can derive coefficients of dynamical models with some unmeasured state variables; b) the model coefficients are then used to train an LLM with prompts embodied with traces from the dynamical system and the corresponding model coefficients. We show that when the CPS-LLM is integrated with a contextualized chatbot such as BARD it can generate feasible and safe plans to manage external events such as meals for automated insulin delivery systems used by Type 1 Diabetes subjects.


title: Du-IN: Discrete units-guided mask modeling for decoding speech from Intracranial Neural signals

abstract: Invasive brain-computer interfaces have garnered significant attention due to their high performance. The current intracranial stereoElectroEncephaloGraphy (sEEG) foundation models typically build univariate representations based on a single channel. Some of them further use Transformer to model the relationship among channels. However, due to the locality and specificity of brain computation, their performance on more difficult tasks, e.g., speech decoding, which demands intricate processing in specific brain regions, is yet to be fully investigated. We hypothesize that building multi-variate representations within certain brain regions can better capture the specific neural processing. To explore this hypothesis, we collect a well-annotated Chinese word-reading sEEG dataset, targeting language-related brain networks, over 12 subjects. Leveraging this benchmark dataset, we developed the Du-IN model that can extract contextual embeddings from specific brain regions through discrete codebook-guided mask modeling. Our model achieves SOTA performance on the downstream 61-word classification task, surpassing all baseline models. Model comparison and ablation analysis reveal that our design choices, including (i) multi-variate representation by fusing channels in vSMC and STG regions and (ii) self-supervision by discrete codebook-guided mask modeling, significantly contribute to these performances. Collectively, our approach, inspired by neuroscience findings, capitalizing on multi-variate neural representation from specific brain regions, is suitable for invasive brain modeling. It marks a promising neuro-inspired AI approach in BCI.


title: Structural properties, dielectric relaxation and impedance spectroscopy of NASICON type Na$_{3+x}$Zr$_{2-x}$Pr$_{x}$Si$_2$PO$_{\rm 12}$ ceramics

abstract: We investigate the dielectric and impedance spectroscopic investigation of Pr-doped NASICON type Na$_{3+x}$Zr$_{2-x}$Pr$_{x}$Si$_2$PO$_{\rm 12}$ ($x=$ 0.05--0.2) samples as a function of temperature and frequency. The Rietveld refinement of x-ray diffraction patterns confirms the monoclinic phase having C2/c space groups for all the samples. The scanning electron microscopy shows the granular-like structure and energy dispersive x-ray analysis confirms the desired compositions. The temperature (90--400~K) and frequency (20 Hz-2 MHz) dependence of electric permittivity are explained using Maxwell-Wagner-Sillars (MWS) polarization and space charge polarization mechanisms. The dielectric relaxation shows nearly equal activation energy for all the samples with a non-Debye type of relaxation in the measured temperature range. The complex impedance analysis shows the presence of broad grain and grain boundary relaxation peaks. The stretched exponent analysis of electric modulus using the Kohlrausch-Williams-Watts (KWW) function further confirms the non-Debye type of relaxation. Moreover, scaling analysis of the electric modulus shows a similar type of relaxation for all the samples. The {\it a.c.} conductivity data are fitted using modified power law, where the temperature dependence of exponent ($s$) confirms the correlated barrier hopping (CBH) type conduction for all the samples. Our results indicate that the Pr doped NASICON samples are potential candidates for charge storage devices due to their large electric permittivity.


title: DocReLM: Mastering Document Retrieval with Language Model

abstract: With over 200 million published academic documents and millions of new documents being written each year, academic researchers face the challenge of searching for information within this vast corpus. However, existing retrieval systems struggle to understand the semantics and domain knowledge present in academic papers. In this work, we demonstrate that by utilizing large language models, a document retrieval system can achieve advanced semantic understanding capabilities, significantly outperforming existing systems. Our approach involves training the retriever and reranker using domain-specific data generated by large language models. Additionally, we utilize large language models to identify candidates from the references of retrieved papers to further enhance the performance. We use a test set annotated by academic researchers in the fields of quantum physics and computer vision to evaluate our system's performance. The results show that DocReLM achieves a Top 10 accuracy of 44.12% in computer vision, compared to Google Scholar's 15.69%, and an increase to 36.21% in quantum physics, while that of Google Scholar is 12.96%.


title: Exciton polariton critical non-Hermitian skin effect with spin-momentum-locked gains

abstract: The critical skin effect, an intriguing phenomenon in non-Hermitian systems, displays sensitivity to system size and manifests distinct dynamical behaviors. In this work, we propose a novel scheme to achieve the critical non-Hermitian skin effect of exciton polaritons in an elongated microcavity system. We show that by utilising longitudinal-transverse spin splitting and spin-momentum-locked gain, a critical non-Hermitian skin effect can be achieved in a continuous system without the need of an underlying lattice. We find that a phase transition can be induced by changing the cavity detuning with respect to the exciton energy. We identify a measurable order parameter associated with this phase transition and demonstrate the corresponding critical behavior. Our work offers a flexible approach to manipulate non-Hermitian phases of exciton polaritons, thereby expanding the potential applications of polaritonic devices.


title: Existence of primitive normal pairs over finite fields with prescribed subtrace

abstract: Given positive integers $q,n,m$ and $a\in\mathbb{F}_{q}$, where $q$ is an odd prime power and $n\geq 5$, we investigate the existence of a primitive normal pair $(\epsilon,f(\epsilon))$ in $\mathbb{F}_{q^{n}}$ over $\mathbb{F}_{q}$ such that $\mathrm{STr}_{q^n/q}(\epsilon)=a$, where $f(x)=\frac{f_{1}(x)}{f_{2}(x)}\in\mathbb{F}_{q^n}(x)$ is a rational function together with deg$(f_{1})+$deg$(f_{2})=m$ and $\mathrm{STr}_{q^n/q}(\epsilon) = \sum_{0\leq i<j\leq n-1}^{}\epsilon^{q^i+q^j}$. Finally, we conclude that for $m=3$, $n\geq 6$ and $q=7^k$; $k\in\mathbb{N}$, such a pair will exist certainly for all $(q,n)$ except at most $14$ choices.


title: Efficient Prompt Tuning by Multi-Space Projection and Prompt Fusion

abstract: Prompt tuning is a promising method to fine-tune a pre-trained language model without retraining its large-scale parameters. Instead, it attaches a soft prompt to the input text, whereby downstream tasks can be well adapted by merely learning the embeddings of prompt tokens. Nevertheless, existing methods still suffer from two challenges: (i) they are hard to balance accuracy and efficiency. A longer (shorter) soft prompt generally leads to a better (worse) accuracy but at the cost of more (less) training time. (ii) The performance may not be consistent when adapting to different downstream tasks. We attribute it to the same embedding space but responsible for different requirements of downstream tasks. To address these issues, we propose an Efficient Prompt Tuning method (EPT) by multi-space projection and prompt fusion. Specifically, it decomposes a given soft prompt into a shorter prompt and two low-rank matrices, whereby the number of parameters is greatly reduced as well as the training time. The accuracy is also enhanced by leveraging low-rank matrices and the short prompt as additional knowledge sources to enrich the semantics of the original short prompt. In addition, we project the soft prompt into multiple subspaces to improve the performance consistency, and then adaptively learn the combination weights of different spaces through a gating network. Experimental experiments on 13 natural language processing downstream tasks show that our method significantly and consistently outperforms 11 comparison methods with the relative percentage of improvements up to 28.8%, and training time decreased by 14%.


title: Effective In-Context Example Selection through Data Compression

abstract: In-context learning has been extensively validated in large language models. However, the mechanism and selection strategy for in-context example selection, which is a crucial ingredient in this approach, lacks systematic and in-depth research. In this paper, we propose a data compression approach to the selection of in-context examples. We introduce a two-stage method that can effectively choose relevant examples and retain sufficient information about the training dataset within the in-context examples. Our method shows a significant improvement of an average of 5.90% across five different real-world datasets using four language models.


title: Measuring Impacts of Poisoning on Model Parameters and Embeddings for Large Language Models of Code

abstract: Large language models (LLMs) have revolutionized software development practices, yet concerns about their safety have arisen, particularly regarding hidden backdoors, aka trojans. Backdoor attacks involve the insertion of triggers into training data, allowing attackers to manipulate the behavior of the model maliciously. In this paper, we focus on analyzing the model parameters to detect potential backdoor signals in code models. Specifically, we examine attention weights and biases, and context embeddings of the clean and poisoned CodeBERT and CodeT5 models. Our results suggest noticeable patterns in context embeddings of poisoned samples for both the poisoned models; however, attention weights and biases do not show any significant differences. This work contributes to ongoing efforts in white-box detection of backdoor signals in LLMs of code through the analysis of parameters and embeddings.


title: AdaAugment: A Tuning-Free and Adaptive Approach to Enhance Data Augmentation

abstract: Data augmentation (DA) is widely employed to improve the generalization performance of deep models. However, most existing DA methods use augmentation operations with random magnitudes throughout training. While this fosters diversity, it can also inevitably introduce uncontrolled variability in augmented data, which may cause misalignment with the evolving training status of the target models. Both theoretical and empirical findings suggest that this misalignment increases the risks of underfitting and overfitting. To address these limitations, we propose AdaAugment, an innovative and tuning-free Adaptive Augmentation method that utilizes reinforcement learning to dynamically adjust augmentation magnitudes for individual training samples based on real-time feedback from the target network. Specifically, AdaAugment features a dual-model architecture consisting of a policy network and a target network, which are jointly optimized to effectively adapt augmentation magnitudes. The policy network optimizes the variability within the augmented data, while the target network utilizes the adaptively augmented samples for training. Extensive experiments across benchmark datasets and deep architectures demonstrate that AdaAugment consistently outperforms other state-of-the-art DA methods in effectiveness while maintaining remarkable efficiency.


title: Emphasizing Crucial Features for Efficient Image Restoration

abstract: Image restoration is a challenging ill-posed problem which estimates latent sharp image from its degraded counterpart. Although the existing methods have achieved promising performance by designing novelty architecture of module, they ignore the fact that different regions in a corrupted image undergo varying degrees of degradation. In this paper, we propose an efficient and effective framework to adapt to varying degrees of degradation across different regions for image restoration. Specifically, we design a spatial and frequency attention mechanism (SFAM) to emphasize crucial features for restoration. SFAM consists of two modules: the spatial domain attention module (SDAM) and the frequency domain attention module (FDAM). The SFAM discerns the degradation location through spatial selective attention and channel selective attention in the spatial domain, while the FDAM enhances high-frequency signals to amplify the disparities between sharp and degraded image pairs in the spectral domain. Additionally, to capture global range information, we introduce a multi-scale block (MSBlock) that consists of three scale branches, each containing multiple simplified channel attention blocks (SCABlocks) and a multi-scale feed-forward block (MSFBlock). Finally, we propose our ECFNet, which integrates the aforementioned components into a U-shaped backbone for recovering high-quality images. Extensive experimental results demonstrate the effectiveness of ECFNet, outperforming state-of-the-art (SOTA) methods on both synthetic and real-world datasets.


title: Numerical integration rules based on B-spline bases

abstract: In this work, we present some new integration formulas for any order of accuracy as an application of the B-spline relations obtained in [1]. The resulting rules are defined as a perturbation of the trapezoidal integration method. We prove the order of approximation and extend the results to several dimensions. Finally, some numerical experiments are performed in order to check the theoretical results.


title: VCformer: Variable Correlation Transformer with Inherent Lagged Correlation for Multivariate Time Series Forecasting

abstract: Multivariate time series (MTS) forecasting has been extensively applied across diverse domains, such as weather prediction and energy consumption. However, current studies still rely on the vanilla point-wise self-attention mechanism to capture cross-variable dependencies, which is inadequate in extracting the intricate cross-correlation implied between variables. To fill this gap, we propose Variable Correlation Transformer (VCformer), which utilizes Variable Correlation Attention (VCA) module to mine the correlations among variables. Specifically, based on the stochastic process theory, VCA calculates and integrates the cross-correlation scores corresponding to different lags between queries and keys, thereby enhancing its ability to uncover multivariate relationships. Additionally, inspired by Koopman dynamics theory, we also develop Koopman Temporal Detector (KTD) to better address the non-stationarity in time series. The two key components enable VCformer to extract both multivariate correlations and temporal dependencies. Our extensive experiments on eight real-world datasets demonstrate the effectiveness of VCformer, achieving top-tier performance compared to other state-of-the-art baseline models. Code is available at this repository: https://github.com/CSyyn/VCformer.


title: CMA-ES with Adaptive Reevaluation for Multiplicative Noise

abstract: The covariance matrix adaptation evolution strategy (CMA-ES) is a powerful optimization method for continuous black-box optimization problems. Several noise-handling methods have been proposed to bring out the optimization performance of the CMA-ES on noisy objective functions. The adaptations of the population size and the learning rate are two major approaches that perform well under additive Gaussian noise. The reevaluation technique is another technique that evaluates each solution multiple times. In this paper, we discuss the difference between those methods from the perspective of stochastic relaxation that considers the maximization of the expected utility function. We derive that the set of maximizers of the noise-independent utility, which is used in the reevaluation technique, certainly contains the optimal solution, while the noise-dependent utility, which is used in the population size and leaning rate adaptations, does not satisfy it under multiplicative noise. Based on the discussion, we develop the reevaluation adaptation CMA-ES (RA-CMA-ES), which computes two update directions using half of the evaluations and adapts the number of reevaluations based on the estimated correlation of those two update directions. The numerical simulation shows that the RA-CMA-ES outperforms the comparative method under multiplicative noise, maintaining competitive performance under additive noise.


title: Signatures of the Attractive Interaction in Spin Spectra of 1D Cuprate Chains

abstract: Identifying the minimal model for cuprates is crucial for explaining the high-$T_c$ pairing mechanism. Recent photoemission experiments have suggested a significant near-neighbor attractive interaction $V$ in cuprate chains, favoring pairing instability. To determine its strength, we systematically investigate the dynamical spin structure factors $S(q,\omega)$ using the density matrix renormalization group (DMRG). Our analysis quantitatively reveals a notable softening in the two-spinon continuum, particularly evident in the intense spectrum at large momentum. This softening is primarily driven by the renormalization of the superexchange interaction, as determined by a comparison with the slave-boson theory. We also demonstrate the feasibility of detecting this spectral shift in thin-film samples using resonant inelastic x-ray scattering. Therefore, this provides a distinctive fingerprint for the attractive interaction, motivating future experiments to unveil essential ingredients in cuprates.


title: FIFO-Diffusion: Generating Infinite Videos from Text without Training

abstract: We propose a novel inference technique based on a pretrained diffusion model for text-conditional video generation. Our approach, called FIFO-Diffusion, is conceptually capable of generating infinitely long videos without additional training. This is achieved by iteratively performing diagonal denoising, which concurrently processes a series of consecutive frames with increasing noise levels in a queue; our method dequeues a fully denoised frame at the head while enqueuing a new random noise frame at the tail. However, diagonal denoising is a double-edged sword as the frames near the tail can take advantage of cleaner ones by forward reference but such a strategy induces the discrepancy between training and inference. Hence, we introduce latent partitioning to reduce the training-inference gap and lookahead denoising to leverage the benefit of forward referencing. Practically, FIFO-Diffusion consumes a constant amount of memory regardless of the target video length given a baseline model, while well-suited for parallel inference on multiple GPUs. We have demonstrated the promising results and effectiveness of the proposed methods on existing text-to-video generation baselines. Generated video samples and source codes are available at our project page.


title: T-odd transverse momentum dependent gluon fragmentation functions in a spectator model

abstract: We present a model calculation of the T-odd transverse momentum dependent (TMD) gluon fragmentation functions for a spin-1/2 hadron. Our model is based on the postulation that a time-like off-shell gluon can fragment into a hadron and a single spectator particle, which is considered to be on-shell. We consider the effect of the gluon exchange to calculate all necessary one-loop diagrams for the gluon-gluon correlation functions. Two out of four one-loop diagrams give sizeable contributions to the fragmentation functions. We obtain analytical expressions for the four T-odd TMD fragmentation functions of the gluon. We also provide numerical results on the z-dependence and $k_T$-dependence of the fragmentation functions.


title: String 2-Covers with No Length Restrictions

abstract: A $\lambda$-cover of a string $S$ is a set of strings $\{C_i\}_1^\lambda$ such that every index in $S$ is contained in an occurrence of at least one string $C_i$. The existence of a $1$-cover defines a well-known class of quasi-periodic strings. Quasi-periodicity can be decided in linear time, and all $1$-covers of a string can be reported in linear time plus the size of the output. Since in general it is NP-complete to decide whether a string has a $\lambda$-cover, the natural next step is the development of efficient algorithms for $2$-covers. Radoszewski and Straszy\'nski [ESA 2020] analysed the particular case where the strings in a $2$-cover must be of the same length. They provided an algorithm that reports all such $2$-covers of $S$ in time near-linear in $|S|$ and in the size of the output. In this work, we consider $2$-covers in full generality. Since every length-$n$ string has $\Omega(n^2)$ trivial $2$-covers (every prefix and suffix of total length at least $n$ constitute such a $2$-cover), we state the reporting problem as follows: given a string $S$ and a number $m$, report all $2$-covers $\{C_1,C_2\}$ of $S$ with length $|C_1|+|C_2|$ upper bounded by $m$. We present an $\tilde{O}(n + Output)$ time algorithm solving this problem, with Output being the size of the output. This algorithm admits a simpler modification that finds a $2$-cover of minimum length. We also provide an $\tilde{O}(n)$ time construction of a $2$-cover oracle which, given two substrings $C_1,C_2$ of $S$, reports in poly-logarithmic time whether $\{C_1,C_2\}$ is a $2$-cover of $S$.


title: NubbleDrop: A Simple Way to Improve Matching Strategy for Prompted One-Shot Segmentation

abstract: Driven by large data trained segmentation models, such as SAM , research in one-shot segmentation has experienced significant advancements. Recent contributions like PerSAM and MATCHER , presented at ICLR 2024, utilize a similar approach by leveraging SAM with one or a few reference images to generate high quality segmentation masks for target images. Specifically, they utilize raw encoded features to compute cosine similarity between patches within reference and target images along the channel dimension, effectively generating prompt points or boxes for the target images a technique referred to as the matching strategy. However, relying solely on raw features might introduce biases and lack robustness for such a complex task. To address this concern, we delve into the issues of feature interaction and uneven distribution inherent in raw feature based matching. In this paper, we propose a simple and training-free method to enhance the validity and robustness of the matching strategy at no additional computational cost (NubbleDrop). The core concept involves randomly dropping feature channels (setting them to zero) during the matching process, thereby preventing models from being influenced by channels containing deceptive information. This technique mimics discarding pathological nubbles, and it can be seamlessly applied to other similarity computing scenarios. We conduct a comprehensive set of experiments, considering a wide range of factors, to demonstrate the effectiveness and validity of our proposed method. Our results showcase the significant improvements achieved through this simmple and straightforward approach.


title: Analyze Additive and Interaction Effects via Collaborative Trees

abstract: We present Collaborative Trees, a novel tree model designed for regression prediction, along with its bagging version, which aims to analyze complex statistical associations between features and uncover potential patterns inherent in the data. We decompose the mean decrease in impurity from the proposed tree model to analyze the additive and interaction effects of features on the response variable. Additionally, we introduce network diagrams to visually depict how each feature contributes additively to the response and how pairs of features contribute interaction effects. Through a detailed demonstration using an embryo growth dataset, we illustrate how the new statistical tools aid data analysis, both visually and numerically. Moreover, we delve into critical aspects of tree modeling, such as prediction performance, inference stability, and bias in feature importance measures, leveraging real datasets and simulation experiments for comprehensive discussions. On the theory side, we show that Collaborative Trees, built upon a ``sum of trees'' approach with our own innovative tree model regularization, exhibit characteristics akin to matching pursuit, under the assumption of high-dimensional independent binary input features (or one-hot feature groups). This newfound link sheds light on the superior capability of our tree model in estimating additive effects of features, a crucial factor for accurate interaction effect estimation.


title: Unsupervised Image Prior via Prompt Learning and CLIP Semantic Guidance for Low-Light Image Enhancement

abstract: Currently, low-light conditions present a significant challenge for machine cognition. In this paper, rather than optimizing models by assuming that human and machine cognition are correlated, we use zero-reference low-light enhancement to improve the performance of downstream task models. We propose to improve the zero-reference low-light enhancement method by leveraging the rich visual-linguistic CLIP prior without any need for paired or unpaired normal-light data, which is laborious and difficult to collect. We propose a simple but effective strategy to learn prompts that help guide the enhancement method and experimentally show that the prompts learned without any need for normal-light data improve image contrast, reduce over-enhancement, and reduce noise over-amplification. Next, we propose to reuse the CLIP model for semantic guidance via zero-shot open vocabulary classification to optimize low-light enhancement for task-based performance rather than human visual perception. We conduct extensive experimental results showing that the proposed method leads to consistent improvements across various datasets regarding task-based performance and compare our method against state-of-the-art methods, showing favorable results across various low-light datasets.


title: Phenomenological Analysis of Triply Heavy Pentaquarks with configurations $q\Bar{q}QQQ$ and $qqQQ\Bar{Q}$

abstract: We carried out the systematic analysis of the $s$-wave triply heavy pentaquarks with possible configurations like $q\Bar{q}QQQ$ and $qqQQ\Bar{Q}$, ($q = u, d, s$ and $Q = c, b$ quarks). Special unitary representations are utilized to study the classification scheme for triply heavy configurations like $q\Bar{q}QQQ$ and $qqQQ\Bar{Q}$. We classified the $q\Bar{q}QQQ$-type pentaquarks into an octet and $qqQQ\Bar{Q}$-type pentaquarks into sextet configurations with the help of SU(3) flavor representation. Also, with the help of SU(2) spin representation, we studied the possible spin assignments ($\frac{1}{2}^-$, $\frac{3}{2}^-$, and $\frac{5}{2}^-$) for ground state triply heavy pentaquarks. Furthermore, we used the formalism of the extended Gursey-Radicati mass formula and effective mass scheme to estimate the masses of triply heavy pentaquarks. Additionally, we calculated the magnetic moment assignments using the effective mass and screened charge schemes. The predicted outcomes align well with the existing theoretical data and benefit future studies. Our work provides a comprehensive framework that combines the theoretical aspects of SU(3) and SU(2) symmetries with practical predictions for observables, offering a strong foundation for experimental verification. This integrated approach enhances our understanding of the complex interactions within triply heavy pentaquarks and underscores their potential role in probing deeper into the dynamics of the strong force. These findings are crucial for designing future high-energy experiments that directly observe these exotic states and confirm their properties, paving the way for new insights into quantum chromodynamics.


title: The Moore-Penrose inverses of unbounded closable operators and the Cartesian product of closed operators in Hilbert spaces

abstract: In this paper, we present some interesting results to characterize the Moore-Penrose inverses of unbounded closable operators and the Cartesian product of closed operators in Hilbert spaces.


title: Physics-aware Hand-object Interaction Denoising

abstract: The credibility and practicality of a reconstructed hand-object interaction sequence depend largely on its physical plausibility. However, due to high occlusions during hand-object interaction, physical plausibility remains a challenging criterion for purely vision-based tracking methods. To address this issue and enhance the results of existing hand trackers, this paper proposes a novel physically-aware hand motion de-noising method. Specifically, we introduce two learned loss terms that explicitly capture two crucial aspects of physical plausibility: grasp credibility and manipulation feasibility. These terms are used to train a physically-aware de-noising network. Qualitative and quantitative experiments demonstrate that our approach significantly improves both fine-grained physical plausibility and overall pose accuracy, surpassing current state-of-the-art de-noising methods.


title: Explainable Facial Expression Recognition for People with Intellectual Disabilities

abstract: Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques available to make them more transparent. In this work, we propose a facial expression recognition study for people with intellectual disabilities that would be integrated into a social robot. We train two well-known neural networks with five databases of facial expressions and test them with two databases containing people with and without intellectual disabilities. Finally, we study in which regions the models focus to perceive a particular expression using two different explainability techniques: LIME and RISE, assessing the differences when used on images containing disabled and non-disabled people.


title: MICap: A Unified Model for Identity-aware Movie Descriptions

abstract: Characters are an important aspect of any storyline and identifying and including them in descriptions is necessary for story understanding. While previous work has largely ignored identity and generated captions with someone (anonymized names), recent work formulates id-aware captioning as a fill-in-the-blanks (FITB) task, where, given a caption with blanks, the goal is to predict person id labels. However, to predict captions with ids, a two-stage approach is required: first predict captions with someone, then fill in identities. In this work, we present a new single stage approach that can seamlessly switch between id-aware caption generation or FITB when given a caption with blanks. Our model, Movie-Identity Captioner (MICap), uses a shared auto-regressive decoder that benefits from training with FITB and full-caption generation objectives, while the encoder can benefit from or disregard captions with blanks as input. Another challenge with id-aware captioning is the lack of a metric to capture subtle differences between person ids. To this end, we introduce iSPICE, a caption evaluation metric that focuses on identity tuples created through intermediate scene graphs. We evaluate MICap on Large-Scale Movie Description Challenge (LSMDC), where we show a 4.2% improvement in FITB accuracy, and a 1-2% bump in classic captioning metrics.


title: Measurement of the effective leptonic electroweak mixing angle and Drell-Yan forward-backward asymmetry using pp collisions at $\sqrt{s}=13$ TeV

abstract: A measurement of the effective leptonic weak mixing angle $\sin^2\theta_\mathrm{eff}^\ell$ is presented using the forward-backward asymmetry in Drell-Yan dilepton events produced in pp collisions at $\sqrt{s}=13$ TeV. The data sample corresponds to 137 fb$^{-1}$ of integrated luminosity and consists of dimuon and dielectron events, including the forward electrons reconstructed beyond the coverage of the CMS tracking detectors. Using the CT18Z set of the parton distribution functions (PDF), which provides the best coverage of the central values extracted with the other global PDFs, we obtain $$\sin^2\theta^\ell_\mathrm{eff} = 0.23157 \pm 0.00031,$$ where the total uncertainty includes the statistical uncetainties (0.00010), as well as the correlated experimental (0.00015), theoretical (0.00009), and PDF (0.00027) systematic uncertainties. The measured value agrees well with the Standard Model prediction. This is the most precise measurement at a hadron collider with comparable precision to the two most precise results obtained at LEP and SLD.


title: Evidence for Multiferroicity in Single-Layer CuCrSe$_2$

abstract: Multiferroic materials, which simultaneously exhibit ferroelectricity and magnetism, have attracted substantial attention due to their fascinating physical properties and potential technological applications. With the trends towards device miniaturization, there is an increasing demand for the persistence of multiferroicity in single-layer materials at elevated temperatures. Here, we report high-temperature multiferroicity in single-layer CuCrSe$_2$, which hosts room-temperature ferroelectricity and 120 K ferromagnetism. Notably, the ferromagnetic coupling in single-layer CuCrSe$_2$ is enhanced by the ferroelectricity-induced orbital shift of Cr atoms, which is distinct from both types I and II multiferroicity. These findings are supported by a combination of second-harmonic generation, piezo-response force microscopy, scanning transmission electron microscopy, magnetic, and Hall measurements. Our research provides not only an exemplary platform for delving into intrinsic magnetoelectric interactions at the single-layer limit but also sheds light on potential development of electronic and spintronic devices utilizing two-dimensional multiferroics.


title: Normal traces and applications to continuity equations on bounded domains

abstract: In this work, we study several properties of the normal Lebesgue trace of vector fields introduced by the second and third author in [18] in the context of the energy conservation for the Euler equations in Onsager-critical classes. Among several properties, we prove that the normal Lebesgue trace satisfies the Gauss-Green identity and, by providing explicit counterexamples, that it is a notion sitting strictly between the distributional one for measure-divergence vector fields and the strong one for $BV$ functions. These results are then applied to the study of the uniqueness of weak solutions for continuity equations on bounded domains, allowing to remove the assumption in [15] of global $BV$ regularity up to the boundary, at least around the portion of the boundary where the characteristics exit the domain or are tangent. The proof relies on an explicit renormalization formula completely characterized by the boundary datum and the positive part of the normal Lebesgue trace. In the case when the characteristics enter the domain, a counterexample shows that achieving the normal trace in the Lebesgue sense is not enough to prevent non-uniqueness, and thus a $BV$ assumption seems to be necessary for the uniqueness of weak solutions.


title: "Previously on ..." From Recaps to Story Summarization

abstract: We introduce multimodal story summarization by leveraging TV episode recaps - short video sequences interweaving key story moments from previous episodes to bring viewers up to speed. We propose PlotSnap, a dataset featuring two crime thriller TV shows with rich recaps and long episodes of 40 minutes. Story summarization labels are unlocked by matching recap shots to corresponding sub-stories in the episode. We propose a hierarchical model TaleSumm that processes entire episodes by creating compact shot and dialog representations, and predicts importance scores for each video shot and dialog utterance by enabling interactions between local story groups. Unlike traditional summarization, our method extracts multiple plot points from long videos. We present a thorough evaluation on story summarization, including promising cross-series generalization. TaleSumm also shows good results on classic video summarization benchmarks.


title: Energy Extraction from a Kerr Black Hole via Magnetic Reconnection within the Plunging Region

abstract: Magnetic reconnection within a highly magnetized plasma has been seen as a viable mechanism to extract the energy from a rotating black hole, as it can generate negative energy plasmoids in the ergoregion. For a typical accreting black hole, the ergoregion is filled with bulk plasma plunging from the innermost-stable-circular orbit (ISCO). In this study, we present an analytical study of the energy extraction via magnetic reconnection process in the plunging region. In contrast to the toroidal plasma, where the magnetic field cannot be derived from the MHD scheme, the magnetic field in the plunging plasma was determined by the ideal-MHD condition. We derive the global magnetic field structure in a fast reconnection model, and we read the expressions for the energies of plasmoids ejected from the reconnection region, for general stationary and axisymmetric spacetimes. Then, we demonstrate the behaviors of ejected energies varying with the reconnection locations in the Kerr spacetime, and identify the region where a negative-energy plasmoid can be produced. We find that for a certain magnetization there exists a critical value of the black hole spin, beyond which the energy extraction can occur, and the energy extraction is most efficient for the near-extreme black hole. Moreover, we study the conditions necessary for a plasmoid with positive energy to escape to the infinity, a crucial requirement for effective energy extractions. Considering the escaping conditions, we provide the parameter space in the radius-spin plane in which the energy extraction mechanism is effective.


title: Probing double distribution function models in the lattice Boltzmann method for highly compressible flows

abstract: The double distribution function approach is an efficient route towards extension of kinetic solvers to compressible flows. With a number of realizations available, an overview and comparative study in the context of high speed compressible flows is presented. We discuss the different variants of the energy partition, analyses of hydrodynamic limits and a numerical study of accuracy and performance with the particles on demand realization. Out of three considered energy partition strategies, it is shown that the non-translational energy split requires a higher-order quadrature for proper recovery of the Navier--Stokes--Fourier equations. The internal energy split on the other hand, while recovering the correct hydrodynamic limit with fourth-order quadrature, comes with a non-local --both in space and time-- source term which contributes to higher computational cost and memory overhead. Based on our analysis, the total energy split demonstrates the optimal overall performance.


title: Solar image quality assessment: a proof of concept using Variance of Laplacian method and its application to optical atmospheric condition monitoring

abstract: Here we present a proof of concept for the application of the Variance of Laplacian (VL) method in quantifying the sharpness of optical solar images. We conducted a comprehensive study using over 65,000 individual solar images acquired on more than 160 days. Each image underwent processing using a VL image processing algorithm, which assigns a 'score' based on the sharpness of the solar disk's edges. We studied the scores obtained from images acquired at different conditions. Our findings demonstrate that the sharpness of the images exhibits daily trends that are closely linked to the altitude of the Sun at the observation site. We observed a significant degradation in image quality only below a certain altitude threshold. Furthermore, we compared airmass formulae from the literature with our sharpness observations and concluded that the degradation could be modeled as an Image Sharpness Function (ISF), which exhibits similarities to airmass variations. In addition to assessing image quality, our method has the potential to evaluate the optical atmospheric conditions during daytime observations. Moreover, this technique can be easily and cost-effectively applied to archival or real-time images of other celestial bodies, such as the Moon, bright planets and defocused stars. Given that ISF is unique to each location and sensitive to sky conditions, the development of an ISF is not only beneficial for routine observation preparation but also essential for long-term site monitoring.


title: BOSC: A Backdoor-based Framework for Open Set Synthetic Image Attribution

abstract: Synthetic image attribution addresses the problem of tracing back the origin of images produced by generative models. Extensive efforts have been made to explore unique representations of generative models and use them to attribute a synthetic image to the model that produced it. Most of the methods classify the models or the architectures among those in a closed set without considering the possibility that the system is fed with samples produced by unknown architectures. With the continuous progress of AI technology, new generative architectures continuously appear, thus driving the attention of researchers towards the development of tools capable of working in open-set scenarios. In this paper, we propose a framework for open set attribution of synthetic images, named BOSC (Backdoor-based Open Set Classification), that relies on the concept of backdoor attacks to design a classifier with rejection option. BOSC works by purposely injecting class-specific triggers inside a portion of the images in the training set to induce the network to establish a matching between class features and trigger features. The behavior of the trained model with respect to triggered samples is then exploited at test time to perform sample rejection using an ad-hoc score. Experiments show that the proposed method has good performance, always surpassing the state-of-the-art. Robustness against image processing is also very good. Although we designed our method for the task of synthetic image attribution, the proposed framework is a general one and can be used for other image forensic applications.


title: Enhancing Vehicle Aerodynamics with Deep Reinforcement Learning in Voxelised Models

abstract: Aerodynamic design optimisation plays a crucial role in improving the performance and efficiency of automotive vehicles. This paper presents a novel approach for aerodynamic optimisation in car design using deep reinforcement learning (DRL). Traditional optimisation methods often face challenges in handling the complexity of the design space and capturing non-linear relationships between design parameters and aerodynamic performance metrics. This study addresses these challenges by employing DRL to learn optimal aerodynamic design strategies in a voxelised model representation. The proposed approach utilises voxelised models to discretise the vehicle geometry into a grid of voxels, allowing for a detailed representation of the aerodynamic flow field. The Proximal Policy Optimisation (PPO) algorithm is then employed to train a DRL agent to optimise the design parameters of the vehicle with respect to drag force, kinetic energy, and voxel collision count. Experimental results demonstrate the effectiveness and efficiency of the proposed approach in achieving significant results in aerodynamic performance. The findings highlight the potential of DRL techniques for addressing complex aerodynamic design optimisation problems in automotive engineering, with implications for improving vehicle performance, fuel efficiency, and environmental sustainability.


title: Point Cloud Compression with Implicit Neural Representations: A Unified Framework

abstract: Point clouds have become increasingly vital across various applications thanks to their ability to realistically depict 3D objects and scenes. Nevertheless, effectively compressing unstructured, high-precision point cloud data remains a significant challenge. In this paper, we present a pioneering point cloud compression framework capable of handling both geometry and attribute components. Unlike traditional approaches and existing learning-based methods, our framework utilizes two coordinate-based neural networks to implicitly represent a voxelized point cloud. The first network generates the occupancy status of a voxel, while the second network determines the attributes of an occupied voxel. To tackle an immense number of voxels within the volumetric space, we partition the space into smaller cubes and focus solely on voxels within non-empty cubes. By feeding the coordinates of these voxels into the respective networks, we reconstruct the geometry and attribute components of the original point cloud. The neural network parameters are further quantized and compressed. Experimental results underscore the superior performance of our proposed method compared to the octree-based approach employed in the latest G-PCC standards. Moreover, our method exhibits high universality when contrasted with existing learning-based techniques.


title: Automated Coastline Extraction Using Edge Detection Algorithms

abstract: We analyse the effectiveness of edge detection algorithms for the purpose of automatically extracting coastlines from satellite images. Four algorithms - Canny, Sobel, Scharr and Prewitt are compared visually and using metrics. With an average SSIM of 0.8, Canny detected edges that were closest to the reference edges. However, the algorithm had difficulty distinguishing noisy edges, e.g. due to development, from coastline edges. In addition, histogram equalization and Gaussian blur were shown to improve the effectiveness of the edge detection algorithms by up to 1.5 and 1.6 times respectively.


title: Inelastic electron-light scattering at dielectric thin films

abstract: In a recently developed methodology termed photon induced near-field electron microscopy (PINEM), the inelastic scattering of electrons off illuminated nanostructures provides direct experimental access to the structure of optical near-field modes and their population. Whereas the inelastic scattering probability can be quantitatively linked to the near field distribution, analytical results for simple light scattering geometries are scarce. Here we derive a fully analytical expression for the coupling strength between free electrons and optical near-fields in planar geometries representing dielectric thin films. Contributions to the overall coupling from the electric field above, below and within the sample are analyzed in detail. By carefully choosing the relative angles between electron beam, light and thin film and by accounting for a broad spectrum of photon energies, we demonstrate that one can imprint optical material properties like the reflectivity onto the electron energy distribution.


title: DEMO: A Statistical Perspective for Efficient Image-Text Matching

abstract: Image-text matching has been a long-standing problem, which seeks to connect vision and language through semantic understanding. Due to the capability to manage large-scale raw data, unsupervised hashing-based approaches have gained prominence recently. They typically construct a semantic similarity structure using the natural distance, which subsequently provides guidance to the model optimization process. However, the similarity structure could be biased at the boundaries of semantic distributions, causing error accumulation during sequential optimization. To tackle this, we introduce a novel hashing approach termed Distribution-based Structure Mining with Consistency Learning (DEMO) for efficient image-text matching. From a statistical view, DEMO characterizes each image using multiple augmented views, which are considered as samples drawn from its intrinsic semantic distribution. Then, we employ a non-parametric distribution divergence to ensure a robust and precise similarity structure. In addition, we introduce collaborative consistency learning which not only preserves the similarity structure in the Hamming space but also encourages consistency between retrieval distribution from different directions in a self-supervised manner. Through extensive experiments on three benchmark image-text matching datasets, we demonstrate that DEMO achieves superior performance compared with many state-of-the-art methods.


title: Towards in-situ Psychological Profiling of Cybercriminals Using Dynamically Generated Deception Environments

abstract: Cybercrime is estimated to cost the global economy almost \$10 trillion annually and with businesses and governments reporting an ever-increasing number of successful cyber-attacks there is a growing demand to rethink the strategy towards cyber security. The traditional, perimeter security approach to cyber defence has so far proved inadequate to combat the growing threat of cybercrime. Cyber deception offers a promising alternative by creating a dynamic defence environment. Deceptive techniques aim to mislead attackers, diverting them from critical assets whilst simultaneously gathering cyber threat intelligence on the threat actor. This article presents a proof-of-concept (POC) cyber deception system that has been developed to capture the profile of an attacker in-situ, during a simulated cyber-attack in real time. By dynamically and autonomously generating deception material based on the observed attacker behaviour and analysing how the attacker interacts with the deception material, the system outputs a prediction on the attacker's motive. The article also explores how this POC can be expanded to infer other features of the attacker's profile such as psychological characteristics. By dynamically and autonomously generating deception material based on observed attacker behaviour and analysing how the attacker interacts with the deception material, the system outputs a prediciton on the attacker's motive. The article also explores how this POC can be expanded to infer other features of the attacker's profile such as psychological characteristics.


title: The Effectiveness of Edge Detection Evaluation Metrics for Automated Coastline Detection

abstract: We analyse the effectiveness of RMSE, PSNR, SSIM and FOM for evaluating edge detection algorithms used for automated coastline detection. Typically, the accuracy of detected coastlines is assessed visually. This can be impractical on a large scale leading to the need for objective evaluation metrics. Hence, we conduct an experiment to find reliable metrics. We apply Canny edge detection to 95 coastline satellite images across 49 testing locations. We vary the Hysteresis thresholds and compare metric values to a visual analysis of detected edges. We found that FOM was the most reliable metric for selecting the best threshold. It could select a better threshold 92.6% of the time and the best threshold 66.3% of the time. This is compared RMSE, PSNR and SSIM which could select the best threshold 6.3%, 6.3% and 11.6% of the time respectively. We provide a reason for these results by reformulating RMSE, PSNR and SSIM in terms of confusion matrix measures. This suggests these metrics not only fail for this experiment but are not useful for evaluating edge detection in general.


title: Modes, Bounds, and Synthesis of Optimal Electromagnetic Scatterers

abstract: This paper presents an optimal synthesis of material distributions in obstacles for maximal extinction, scattering, or absorption. The material synthesis is based on an explicit construction utilizing the current distribution derived from physical bounds excited from the far-field. The bounds are expressed in radiation modes for materials restricted by their resistivity and characteristic modes for materials restricted by the contrast. The results are valid for arbitrary shapes, and analytical expressions are provided for spherical shapes.

categories: math-ph math.MP physics.class-ph physics.comp-ph physics.optics


title: Interpreting a Semantic Segmentation Model for Coastline Detection

abstract: We interpret a deep-learning semantic segmentation model used to classify coastline satellite images into land and water. This is to build trust in the model and gain new insight into the process of coastal water body extraction. Specifically, we seek to understand which spectral bands are important for predicting segmentation masks. This is done using a permutation importance approach. Results show that the NIR is the most important spectral band. Permuting this band lead to a decrease in accuracy of 38.12 percentage points. This is followed by Water Vapour, SWIR 1, and Blue bands with 2.58, 0.78 and 0.19 respectively. Water Vapour is not typically used in water indices and these results suggest it may be useful for water body extraction. Permuting, the Coastal Aerosol, Green, Red, RE1, RE2, RE3, RE4, and SWIR 2 bands did not decrease accuracy. This suggests they could be excluded from future model builds reducing complexity and computational requirements.


title: DogFLW: Dog Facial Landmarks in the Wild Dataset

abstract: Affective computing for animals is a rapidly expanding research area that is going deeper than automated movement tracking to address animal internal states, like pain and emotions. Facial expressions can serve to communicate information about these states in mammals. However, unlike human-related studies, there is a significant shortage of datasets that would enable the automated analysis of animal facial expressions. Inspired by the recently introduced Cat Facial Landmarks in the Wild dataset, presenting cat faces annotated with 48 facial anatomy-based landmarks, in this paper, we develop an analogous dataset containing 3,274 annotated images of dogs. Our dataset is based on a scheme of 46 facial anatomy-based landmarks. The DogFLW dataset is available from the corresponding author upon a reasonable request.


title: CTGNN: Crystal Transformer Graph Neural Network for Crystal Material Property Prediction

abstract: The combination of deep learning algorithm and materials science has made significant progress in predicting novel materials and understanding various behaviours of materials. Here, we introduced a new model called as the Crystal Transformer Graph Neural Network (CTGNN), which combines the advantages of Transformer model and graph neural networks to address the complexity of structure-properties relation of material data. Compared to the state-of-the-art models, CTGNN incorporates the graph network structure for capturing local atomic interactions and the dual-Transformer structures to model intra-crystal and inter-atomic relationships comprehensively. The benchmark carried on by the proposed CTGNN indicates that CTGNN significantly outperforms existing models like CGCNN and MEGNET in the prediction of formation energy and bandgap properties. Our work highlights the potential of CTGNN to enhance the performance of properties prediction and accelerates the discovery of new materials, particularly for perovskite materials.


title: Quantum delocalization, structural order, and density response of the strongly coupled electron liquid

abstract: We investigate the impact of electronic correlations and quantum delocalization onto the static structure factor and static density response function of the strongly coupled electron liquid. In contrast to a classical system, the density response of the electron liquid vanishes on small length scales due to quantum delocalization effects, which we rigorously quantify in terms of imaginary-time correlation functions and dynamic Matsubara response functions. This allows us to analyze the interplay of structural order and dynamic quantum effects as it manifests in the dynamic Matsubara local field correction. Finally, we identify an effective electronic attraction in the spin-offdiagonal static density response when the wavelength of the perturbation is commensurate with the average interparticle distance.


title: Machine Learning & Wi-Fi: Unveiling the Path Towards AI/ML-Native IEEE 802.11 Networks

abstract: Artificial intelligence (AI) and machine learning (ML) are nowadays mature technologies considered essential for driving the evolution of future communications systems. Simultaneously, Wi-Fi technology has constantly evolved over the past three decades and incorporated new features generation after generation, thus gaining in complexity. As such, researchers have observed that AI/ML functionalities may be required to address the upcoming Wi-Fi challenges that will be otherwise difficult to solve with traditional approaches. This paper discusses the role of AI/ML in current and future Wi-Fi networks and depicts the ways forward. A roadmap towards AI/ML-native Wi-Fi, key challenges, standardization efforts, and major enablers are also discussed. An exemplary use case is provided to showcase the potential of AI/ML in Wi-Fi at different adoption stages.


title: Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge base

abstract: This paper begins with a theoretical exploration of the rise of large language models (LLMs) in Human-Computer Interaction (HCI), their impact on user experience (HX), and related challenges. It then discusses the benefits of Human-Centered Design (HCD) principles and the possibility of their application within LLMs, subsequently deriving six specific HCD guidelines for LLMs. Following this, a preliminary experiment is presented as an example to demonstrate how HCD principles can be employed to enhance user experience within GPT by using a single document input to GPT's Knowledge base as a new knowledge resource to control the interactions between GPT and users, aiming to meet the diverse needs of hypothetical software learners as much as possible. The experimental results demonstrate the effect of different elements' forms and organizational methods in the document, as well as GPT's relevant configurations, on the interaction effectiveness between GPT and software learners. A series of trials are conducted to explore better methods to realize text and image displaying, and jump action. Two template documents are compared in the aspects of the performances of the four interaction modes. Through continuous optimization, an improved version of the document was obtained to serve as a template for future use and research.


title: Size of the accretion disc in the recurrent nova T CrB

abstract: We present high resolution (0.06 A/px) spectroscopic observations of the recurrent nova T Coronae Borealis obtained during the last 1.5 years (September 2022 -- January 2024), with the 2.0m RCC telecope of the Rozhen National Astronomical Observatory, Bulgaria. Double-peaked emission is visible in the H-alpha line after the end of the superactive state. We subtract the red giant contribution and measure the distance between the peaks ($\Delta v_a$) of the line. For the period July 2023 -- January 2024, we find that $\Delta v_a$ is in range $90 < \Delta v_a < 120$ km/s. Assuming that the emission is from the accretion disc around the white dwarf, we find average radius of the accretion disc $R_{disc} = 89 \pm 19$ R$_\odot$, which is approximately equal to the Roche lobe size of the white dwarf. Our results indicate that tidal torque plays an important role but that the disc can extend up to the Roche lobe of the accreting star.


title: Riemann problem for a nonsymmetric Keyfitz-Kranzer and pressureless gas systems with a time-dependent Coulomb-like friction term

abstract: In this paper, we study the Riemann solutions for two systems: the nonsymmetric Keyfitz-Kranzer system and the pressureless system, both of which have a time-dependent Coulomb-like friction term. Our analysis identified two types of Riemann solutions: contact discontinuities and delta-shock solutions. We obtain generalized Rankine-Hugoniot conditions, which is the support for constructing the delta-shock solution for the nonsymmetric Keyfitz-Kranzer system with a time-dependent Coulomb-like friction term. Furthermore, we demonstrate that as the pressure tends to zero, the Riemann solutions of the nonsymmetric Keyfitz-Kranzer system converge to those of the pressureless system, with both systems incorporating a time-dependent Coulomb-like friction term.


title: An Investigation into the Thermoelectric Characteristics of Silver-based Chalcopyrites Utilizing a Non-empirical Range-separated Dielectric-dependent Hybrid Approach

abstract: Our investigation explores the intricate domain of thermoelectric phenomena within silver (Ag)-infused chalcopyrites, focusing on compositions such as AgXTe$_2$ (where X=Ga, In) and the complex quaternary system Ag$_2$ZnSn/GeY$_2$ (with Y=S, Se). Using a sophisticated combination of methodologies, we integrate a non-empirical screened dielectric-dependent hybrid (DDH) functional with semiclassical Boltzmann transport theory. This approach allows us to conduct a detailed analysis of critical thermoelectric properties, including electrical conductivity, Seebeck coefficient, and power factor. Our methodology goes beyond superficial assessments, delving into the intricate interplay of material properties to reveal their true thermoelectric potential. Additionally, we investigate the often-overlooked phenomena of phonon scattering by leveraging both the elastic constant tensor and the deformation potential method. This enables a rigorous examination of electron relaxation time and lattice thermal conductivity, enhancing the robustness of our predictions and demonstrating our commitment to thorough exploration.Through our rigorous investigation, we identify materials with a thermoelectric figure of merit (ZT = $\sigma S^{2}T/ \kappa$) exceeding the critical threshold of unity. This significant achievement signals the discovery of materials capable of revolutionizing efficient thermoelectric systems. Our findings delineate a promising trajectory, laying the groundwork for the emergence of a new class of Ag-based chalcopyrites distinguished by their exceptional thermoelectric characteristics. This research not only contributes to the understanding of materials science principles but also catalyzes transformative advancements in thermoelectric technology.


title: Regularly oscillating mappings between metric spaces and a theorem of Hardy and Littlewood

abstract: This paper is motivated by the classical theorem due to Hardy and Littlewood which concerns analytic mappings on the unit disk and relates the growth of the derivative with the H\"{o}lder continuity. We obtain a version of this result in a very general setting -- for regularly oscillating mappings on a metric space equipped with a weight, which is a continuous and positive function, with values in another metric space. As a consequence, we derive the Hardy and Littlewood theorem for analytic mappings on the unit ball of a normed space.


title: On some open problems in reliability theory

abstract: We study a stochastic scheduling on an unreliable machine with general up-times and general set-up times which is described by a group of partial differential equations with Dirac-delta functions in the boundary and initial conditions. In special case that the random processing rate of job $i,$ the random up-time rate of job $i$ and the random repair rate of job $i$ are constants, we determine the explicit expression of its time-dependent solution and give the asymptotic behavior of its time-dependent solution. Our result implies that $C_0-$semigroup theory is not suitable for this model. In general case, we determine the Laplace transform of its time-dependent solution. Next, we convert the model into an abstract Cauchy problem whose underlying operator is an evolution family. Finally, we leave some open problems.


title: Online Action Representation using Change Detection and Symbolic Programming

abstract: This paper addresses the critical need for online action representation, which is essential for various applications like rehabilitation, surveillance, etc. The task can be defined as representation of actions as soon as they happen in a streaming video without access to video frames in the future. Most of the existing methods use predefined window sizes for video segments, which is a restrictive assumption on the dynamics. The proposed method employs a change detection algorithm to automatically segment action sequences, which form meaningful sub-actions and subsequently fit symbolic generative motion programs to the clipped segments. We determine the start time and end time of segments using change detection followed by a piece-wise linear fit algorithm on joint angle and bone length sequences. Domain-specific symbolic primitives are fit to pose keypoint trajectories of those extracted segments in order to obtain a higher level semantic representation. Since this representation is part-based, it is complementary to the compositional nature of human actions, i.e., a complex activity can be broken down into elementary sub-actions. We show the effectiveness of this representation in the downstream task of class agnostic repetition detection. We propose a repetition counting algorithm based on consecutive similarity matching of primitives, which can do online repetition counting. We also compare the results with a similar but offline repetition counting algorithm. The results of the experiments demonstrate that, despite operating online, the proposed method performs better or on par with the existing method.


title: Going into Orbit: Massively Parallelizing Episodic Reinforcement Learning

abstract: The possibilities of robot control have multiplied across various domains through the application of deep reinforcement learning. To overcome safety and sampling efficiency issues, deep reinforcement learning models can be trained in a simulation environment, allowing for faster iteration cycles. This can be enhanced further by parallelizing the training process using GPUs. NVIDIA's open-source robot learning framework Orbit leverages this potential by wrapping tensor-based reinforcement learning libraries for high parallelism and building upon Isaac Sim for its simulations. We contribute a detailed description of the implementation of a benchmark reinforcement learning task, namely box pushing, using Orbit. Additionally, we benchmark the performance of our implementation in comparison to a CPU-based implementation and report the performance metrics. Finally, we tune the hyper parameters of our implementation and show that we can generate significantly more samples in the same amount of time by using Orbit.


title: Optimizing Underwater IoT Routing with Multi-Criteria Decision Making and Uncertainty Weights

abstract: Effective data routing is vital in the Internet of Things (IoT) paradigm, especially in underwater mobile sensor networks where inefficiency can lead to significant resource consumption. This article presents an innovative method designed to enhance network performance and reduce resource usage, while also accurately determining component weights in these networks, ensuring quality service. Building upon previous research on multi-criteria decision-making systems in coastal RPL networks, our method involves key adaptations for underwater environments. It integrates comprehensive network features to identify the optimal parent node for each sensor, employing the fuzzy SWARA decision-making approach under uncertain conditions. This method takes into account various factors including hops, energy, ARSSI rate, delay, ETX, link delivery rate, and depth to determine the most effective parent node assignment. Through simulation, our approach demonstrates marked improvements in network performance compared to existing solutions. These advancements are significant, offering a new direction in enhancing underwater IoT communications and suggesting wider applications for IoT systems facing similar challenges.


title: Towards Translating Real-World Code with LLMs: A Study of Translating to Rust

abstract: Large language models (LLMs) show promise in code translation - the task of translating code written in one programming language to another language - due to their ability to write code in most programming languages. However, LLM's effectiveness on translating real-world code remains largely unstudied. In this work, we perform the first substantial study on LLM-based translation to Rust by assessing the ability of five state-of-the-art LLMs, GPT4, Claude 3, Claude 2.1, Gemini Pro, and Mixtral. We conduct our study on code extracted from real-world open source projects. To enable our study, we develop FLOURINE, an end-to-end code translation tool that uses differential fuzzing to check if a Rust translation is I/O equivalent to the original source program, eliminating the need for pre-existing test cases. As part of our investigation, we assess both the LLM's ability to produce an initially successful translation, as well as their capacity to fix a previously generated buggy one. If the original and the translated programs are not I/O equivalent, we apply a set of automated feedback strategies, including feedback to the LLM with counterexamples. Our results show that the most successful LLM can translate 47% of our benchmarks, and also provides insights into next steps for improvements.


title: Towards solving the origin of circular polarisation in FRB 20180301A

abstract: Fast Radio Bursts (FRBs) are short-timescale transients of extragalactic origin. The number of detected FRBs has grown dramatically since their serendipitous discovery from archival data. Some FRBs have also been seen to repeat. The polarimetric properties of repeating FRBs show diverse behaviour and, at times, extreme polarimetric morphology, suggesting a complex magneto-ionic circumburst environment for this class of FRB. The polarimetric properties such as circular polarisation behaviour of FRBs are crucial for understanding their surrounding magnetic-ionic environment. The circular polarisation previously observed in some of the repeating FRB sources has been attributed to propagation effects such as generalised Faraday rotation (GFR), where conversion from linear to circular polarisation occurs due to the non-circular modes of transmission in relativistic plasma. The discovery burst from the repeating FRB$~$20180301A showed significant frequency-dependent circular polarisation behaviour, which was initially speculated to be instrumental due to a sidelobe detection. Here we revisit the properties given the subsequent interferometric localisation of the burst, which indicates that the burst was detected in the primary beam of the Parkes/Murriyang 20-cm multibeam receiver. We develop a Bayesian Stokes-Q, U, and V fit method to model the GFR effect, which is independent of the total polarised flux parameter. Using the GFR model we show that the rotation measure (RM) estimated is two orders of magnitude smaller and opposite sign ($\sim$28 rad$\,$m$^{-2}$) than the previously reported value. We interpret the implication of the circular polarisation on its local magnetic environment and reinterpret its long-term temporal evolution in RM.


title: Polynomial Convergence Rate for Quasi-Periodic Homogenization of Hamilton-Jacobi Equations and Application to Ergodic Estimates

abstract: In this paper, we demonstrate a polynomial convergence rate for homogenization of Hamilton-Jacobi equations with quasi-periodic potentials. We establish a connection between the convergence rate of homogenization and the regularity of the effective Hamiltonian, by using a new quantitative ergodic estimate for bounded quasi-periodic functions with Diophantine frequencies. As an application, we also study the convergent rate for Birkhoff average of unbounded quasi-periodic functions.


title: On the Convergence of No-Regret Dynamics in Information Retrieval Games with Proportional Ranking Functions

abstract: Publishers who publish their content on the web act strategically, in a behavior that can be modeled within the online learning framework. Regret, a central concept in machine learning, serves as a canonical measure for assessing the performance of learning agents within this framework. We prove that any proportional content ranking function with a concave activation function induces games in which no-regret learning dynamics converge. Moreover, for proportional ranking functions, we prove the equivalence of the concavity of the activation function, the social concavity of the induced games and the concavity of the induced games. We also study the empirical trade-offs between publishers' and users' welfare, under different choices of the activation function, using a state-of-the-art no-regret dynamics algorithm. Furthermore, we demonstrate how the choice of the ranking function and changes in the ecosystem structure affect these welfare measures, as well as the dynamics' convergence rate.


title: Weakly and weak$^\ast$ $p$-convergent operators

abstract: Let $p\in[1,\infty]$. Being motivated by weakly $p$-convergent and weak$^\ast$ $p$-convergent operators between Banach spaces introduced by Fourie and Zeekoei, we introduce and study the classes of weakly $p$-convergent and weak$^\ast$ $p$-convergent operators between arbitrary locally convex spaces. Relationships between these classes of operators are given, and we show that they have ideal properties. Numerous characterizations of weakly $p$-convergent and weak$^\ast$ $p$-convergent operators are given.


title: MSNER: A Multilingual Speech Dataset for Named Entity Recognition

abstract: While extensively explored in text-based tasks, Named Entity Recognition (NER) remains largely neglected in spoken language understanding. Existing resources are limited to a single, English-only dataset. This paper addresses this gap by introducing MSNER, a freely available, multilingual speech corpus annotated with named entities. It provides annotations to the VoxPopuli dataset in four languages (Dutch, French, German, and Spanish). We have also releasing an efficient annotation tool that leverages automatic pre-annotations for faster manual refinement. This results in 590 and 15 hours of silver-annotated speech for training and validation, alongside a 17-hour, manually-annotated evaluation set. We further provide an analysis comparing silver and gold annotations. Finally, we present baseline NER models to stimulate further research on this newly available dataset.


title: On Performance of FAS-aided Wireless Powered NOMA Communication Systems

abstract: This paper studies the performance of a wireless powered communication network (WPCN) under the non-orthogonal multiple access (NOMA) scheme, where users take advantage of an emerging fluid antenna system (FAS). More precisely, we consider a scenario where a transmitter is powered by a remote power beacon (PB) to send information to the planar NOMA FAS-equipped users through Rayleigh fading channels. After introducing the distribution of the equivalent channel coefficients to the users, we derive compact analytical expressions for the outage probability (OP) in order to evaluate the system performance. Additionally, we present asymptotic OP in the high signal-to-noise ratio (SNR) regime. Eventually, results reveal that deploying the FAS with only one activated port in NOMA users can significantly enhance the WPCN performance compared with using traditional antenna systems (TAS).


title: Liouville-type theorem for steady helically symmetric MHD system in $\mathbb{R}^{3}$

abstract: We show that any bounded smooth helically symmetric solution $(\Bu, \Bh)$ in $\mathbb{R}^3$ must be constant vectors. This is an extension of previous result \cite[Theorem 1.1]{HWXAHE} from Navier-Stokes system to MHD system. The proof relies on establishing a Saint-Venant type estimate to characterize the growth of Dirichlet integral of nontrivial solutions.


title: A comparative study of augmented inverse propensity weighted estimators using outcome-adaptive lasso and other penalized regression methods

abstract: Confounder selection may be efficiently conducted using penalized regression methods when causal effects are estimated from observational data with many variables. An outcome-adaptive lasso was proposed to build a model for the propensity score that can be employed in conjunction with other variable selection methods for the outcome model to apply the augmented inverse propensity weighted (AIPW) estimator. However, researchers may not know which method is optimal to use for outcome model when applying the AIPW estimator with the outcome-adaptive lasso. This study provided hints on readily implementable penalized regression methods that should be adopted for the outcome model as a counterpart of the outcome-adaptive lasso. We evaluated the bias and variance of the AIPW estimators using the propensity score (PS) model and an outcome model based on penalized regression methods under various conditions by analyzing a clinical trial example and numerical experiments; the estimates and standard errors of the AIPW estimators were almost identical in an example with over 5000 participants. The AIPW estimators using penalized regression methods with the oracle property performed well in terms of bias and variance in numerical experiments with smaller sample sizes. Meanwhile, the bias of the AIPW estimator using the ordinary lasso for the PS and outcome models was considerably larger.


title: Diffusion-Based Hierarchical Image Steganography

abstract: This paper introduces Hierarchical Image Steganography, a novel method that enhances the security and capacity of embedding multiple images into a single container using diffusion models. HIS assigns varying levels of robustness to images based on their importance, ensuring enhanced protection against manipulation. It adaptively exploits the robustness of the Diffusion Model alongside the reversibility of the Flow Model. The integration of Embed-Flow and Enhance-Flow improves embedding efficiency and image recovery quality, respectively, setting HIS apart from conventional multi-image steganography techniques. This innovative structure can autonomously generate a container image, thereby securely and efficiently concealing multiple images and text. Rigorous subjective and objective evaluations underscore our advantage in analytical resistance, robustness, and capacity, illustrating its expansive applicability in content safeguarding and privacy fortification.


title: Simple-Sampling and Hard-Mixup with Prototypes to Rebalance Contrastive Learning for Text Classification

abstract: Text classification is a crucial and fundamental task in natural language processing. Compared with the previous learning paradigm of pre-training and fine-tuning by cross entropy loss, the recently proposed supervised contrastive learning approach has received tremendous attention due to its powerful feature learning capability and robustness. Although several studies have incorporated this technique for text classification, some limitations remain. First, many text datasets are imbalanced, and the learning mechanism of supervised contrastive learning is sensitive to data imbalance, which may harm the model performance. Moreover, these models leverage separate classification branch with cross entropy and supervised contrastive learning branch without explicit mutual guidance. To this end, we propose a novel model named SharpReCL for imbalanced text classification tasks. First, we obtain the prototype vector of each class in the balanced classification branch to act as a representation of each class. Then, by further explicitly leveraging the prototype vectors, we construct a proper and sufficient target sample set with the same size for each class to perform the supervised contrastive learning procedure. The empirical results show the effectiveness of our model, which even outperforms popular large language models across several datasets.


title: Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors

abstract: Conventional Federated Learning (FL) involves collaborative training of a global model while maintaining user data privacy. One of its branches, decentralized FL, is a serverless network that allows clients to own and optimize different local models separately, which results in saving management and communication resources. Despite the promising advancements in decentralized FL, it may reduce model generalizability due to lacking a global model. In this scenario, managing data and model heterogeneity among clients becomes a crucial problem, which poses a unique challenge that must be overcome: How can every client's local model learn generalizable representation in a decentralized manner? To address this challenge, we propose a novel Decentralized FL technique by introducing Synthetic Anchors, dubbed as DeSA. Based on the theory of domain adaptation and Knowledge Distillation (KD), we theoretically and empirically show that synthesizing global anchors based on raw data distribution facilitates mutual knowledge transfer. We further design two effective regularization terms for local training: 1) REG loss that regularizes the distribution of the client's latent embedding with the anchors and 2) KD loss that enables clients to learn from others. Through extensive experiments on diverse client data distributions, we showcase the effectiveness of DeSA in enhancing both inter- and intra-domain accuracy of each client.


title: Register assisted aggregation for Visual Place Recognition

abstract: Visual Place Recognition (VPR) refers to the process of using computer vision to recognize the position of the current query image. Due to the significant changes in appearance caused by season, lighting, and time spans between query images and database images for retrieval, these differences increase the difficulty of place recognition. Previous methods often discarded useless features (such as sky, road, vehicles) while uncontrolled discarding features that help improve recognition accuracy (such as buildings, trees). To preserve these useful features, we propose a new feature aggregation method to address this issue. Specifically, in order to obtain global and local features that contain discriminative place information, we added some registers on top of the original image tokens to assist in model training. After reallocating attention weights, these registers were discarded. The experimental results show that these registers surprisingly separate unstable features from the original image representation and outperform state-of-the-art methods.


title: Laser Offset Stabilization with Chip-Scale Atomic Diffractive Elements

abstract: Achieving precise and adjustable control over laser frequency is an essential requirement in numerous applications such as precision spectroscopy, quantum control, and sensing. In many such applications it is desired to stabilize a laser with a variable detuning from an atomic line. In this study, we employ an offset-stabilization scheme by utilizing phase contrast spectroscopy in microfabricated atomic diffractive elements vapor-cells. The spectroscopic response of such a device generates oscillating optical fringes, providing multiple optical frequency stabilization points across a bandwidth of tens of gigahertz, centered around the absorption resonances of Rb. Using this device, we demonstrate laser stabilization at various offset frequencies with instabilities reaching sub-megahertz levels. We further explore the fundamental limitations of our hybrid atomic-photonic device, drawing parallels to birefringent and dichroic spectroscopy apparatuses, which are commonly employed for offset stabilization. Our system showcases a broad offset lock bandwidth, a highly compact footprint, scalability to chip-scale production, and the ability to operate without reliance on magnetic fields. These attributes pave the way for a multitude of applications in quantum technologies.