title: Online Physical Enhanced Residual Learning for Connected Autonomous Vehicles Platoon Centralized Control

abstract: This paper introduces an online physical enhanced residual learning (PERL) framework for Connected Autonomous Vehicles (CAVs) platoon, aimed at addressing the challenges posed by the dynamic and unpredictable nature of traffic environments. The proposed framework synergistically combines a physical model, represented by Model Predictive Control (MPC), with data-driven online Q-learning. The MPC controller, enhanced for centralized CAV platoons, employs vehicle velocity as a control input and focuses on multi-objective cooperative optimization. The learning-based residual controller enriches the MPC with prior knowledge and corrects residuals caused by traffic disturbances. The PERL framework not only retains the interpretability and transparency of physics-based models but also significantly improves computational efficiency and control accuracy in real-world scenarios. The experimental results present that the online Q-learning PERL controller, in comparison to the MPC controller and PERL controller with a neural network, exhibits significantly reduced position and velocity errors. Specifically, the PERL's cumulative absolute position and velocity errors are, on average, 86.73% and 55.28% lower than the MPC's, and 12.82% and 18.83% lower than the neural network-based PERL's, in four tests with different reference trajectories and errors. The results demonstrate our advanced framework's superior accuracy and quick convergence capabilities, proving its effectiveness in maintaining platoon stability under diverse conditions.


title: A Curious Case of Searching for the Correlation between Training Data and Adversarial Robustness of Transformer Textual Models

abstract: Existing works have shown that fine-tuned textual transformer models achieve state-of-the-art prediction performances but are also vulnerable to adversarial text perturbations. Traditional adversarial evaluation is often done \textit{only after} fine-tuning the models and ignoring the training data. In this paper, we want to prove that there is also a strong correlation between training data and model robustness. To this end, we extract 13 different features representing a wide range of input fine-tuning corpora properties and use them to predict the adversarial robustness of the fine-tuned models. Focusing mostly on encoder-only transformer models BERT and RoBERTa with additional results for BART, ELECTRA and GPT2, we provide diverse evidence to support our argument. First, empirical analyses show that (a) extracted features can be used with a lightweight classifier such as Random Forest to effectively predict the attack success rate and (b) features with the most influence on the model robustness have a clear correlation with the robustness. Second, our framework can be used as a fast and effective additional tool for robustness evaluation since it (a) saves 30x-193x runtime compared to the traditional technique, (b) is transferable across models, (c) can be used under adversarial training, and (d) robust to statistical randomness. Our code will be publicly available.


title: Understanding the wetting of transition metal dichalcogenides from an ab initio perspective

abstract: Transition metal dichalcogenides (TMDs) are a class of two-dimensional (2D) materials been widely studied for emerging electronic properties. In this work, we use computational simulations to examine the water adsorption on TMDs systematically and the wetting property of WSe2 specifically. We start with density functional theory (DFT) based random phase approximation (RPA), assessing the performance of exchange-correlation functionals and comparing water adsorption on various TMDs. We also perform \textit{ab initio} molecular dynamics (AIMD) simulations on tungsten diselenide (WSe$_2$), from which we find that the distribution of interfacial water is sensitive to the exchange-correlation functional selected and a reasonable choice leads to a diffusive contact layer where water molecules prefer the "flat" configuration. Classical molecular dynamics (MD) simulations of water droplets on surfaces using appropriately parameterized water-surface interaction further confirm the dependence of water contact angle on the interaction and the interfacial water structure reproduced by different DFT functionals. Our study highlights the sensitivity of wetting to the water-substrate interaction and provides a starting point for a more accurate theoretical investigation of water-TMD interfaces.


title: An Optimal Dividend Problem for Skew Brownian Motion with Two-Valued Drift

abstract: In this paper we propose a skew Brownian motion with a two-valued drift as a risk model with endogenous regime switching. We solve its two-sided exit problem and consider an optimal control problem for the skew Brownian risk model. In particular, we identify sufficient conditions for either a barrier dividend strategy or a band dividend strategy to be optimal.


title: Advanced Drug Interaction Event Prediction

abstract: Predicting drug-drug interaction adverse events, so-called DDI events, is increasingly valuable as it facilitates the study of mechanisms underlying drug use or adverse reactions. Existing models often neglect the distinctive characteristics of individual event classes when integrating multi-source features, which contributes to systematic unfairness when dealing with highly imbalanced event samples. Moreover, the limited capacity of these models to abstract the unique attributes of each event subclass considerably hampers their application in predicting rare drug-drug interaction events with a limited sample size. Reducing dataset bias and abstracting event subclass characteristics are two unresolved challenges. Recently, prompt tuning with frozen pre-trained graph models, namely "pre-train, prompt, fine-tune" strategy, has demonstrated impressive performance in few-shot tasks. Motivated by this, we propose an advanced method as a solution to address these aforementioned challenges. Specifically, our proposed approach entails a hierarchical pre-training task that aims to capture crucial aspects of drug molecular structure and intermolecular interactions while effectively mitigating implicit dataset bias within the node embeddings. Furthermore, we construct a prototypical graph by strategically sampling data from distinct event types and design subgraph prompts utilizing pre-trained node features. Through comprehensive benchmark experiments, we validate the efficacy of our subgraph prompts in accurately representing event classes and achieve exemplary results in both overall and subclass prediction tasks.


title: Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection

abstract: The proliferation of face forgery techniques has raised significant concerns within society, thereby motivating the development of face forgery detection methods. These methods aim to distinguish forged faces from genuine ones and have proven effective in practical applications. However, this paper introduces a novel and previously unrecognized threat in face forgery detection scenarios caused by backdoor attack. By embedding backdoors into models and incorporating specific trigger patterns into the input, attackers can deceive detectors into producing erroneous predictions for forged faces. To achieve this goal, this paper proposes \emph{Poisoned Forgery Face} framework, which enables clean-label backdoor attacks on face forgery detectors. Our approach involves constructing a scalable trigger generator and utilizing a novel convolving process to generate translation-sensitive trigger patterns. Moreover, we employ a relative embedding method based on landmark-based regions to enhance the stealthiness of the poisoned samples. Consequently, detectors trained on our poisoned samples are embedded with backdoors. Notably, our approach surpasses SoTA backdoor baselines with a significant improvement in attack success rate (+16.39\% BD-AUC) and reduction in visibility (-12.65\% $L_\infty$). Furthermore, our attack exhibits promising performance against backdoor defenses. We anticipate that this paper will draw greater attention to the potential threats posed by backdoor attacks in face forgery detection scenarios. Our codes will be made available at \url{https://github.com/JWLiang007/PFF}


title: Radio polarization of millisecond pulsars with multipolar magnetic fields

abstract: NICER has observed a few millisecond pulsars where the geometry of the X-ray emitting hotspots on the neutron star is analyzed in order to constrain the mass and radius from X-ray light curve modeling. One example, PSR J0030+0451, is shown to possibly have significant multipolar magnetic fields at the stellar surface. Using force-free simulations of the magnetosphere structure, it has been shown that the radio, X-ray, and gamma-ray light curves can be modeled simultaneously with appropriate field configuration. An even more stringent test is to compare predictions of the force-free magnetosphere model with observations of the radio polarization. This paper attempts to reproduce the radio polarization of PSR J0030+0451 using a force-free magnetospheric solution. As a result of our modeling, we can reproduce certain features of the polarization well.


title: On the isomorphism problem for power semigroups

abstract: Denote by $\mathcal P(S)$ the semigroup obtained by equipping the family of all non-empty subsets of a (multiplicatively written) semigroup $S$ with the operation of setwise multiplication induced by $S$ itself. We call a subsemigroup $P$ of $\mathcal P(S)$ downward complete if any element of $S$ lies in at least one set $X \in P$ and any non-empty subset of a set in $P$ is again in $P$. We prove, for a commutative semigroup $S$, a characterization of the cancellative elements of a downward complete subsemigroup of $\mathcal P(S)$ in terms of the cancellative elements of $S$. Consequently, we show that, if $H$ and $K$ are cancellative semigroups and either of them is commutative, then every isomorphism from a downward complete subsemigroup of $\mathcal P(H)$ to a downward complete subsemigroup of $\mathcal P(K)$ restricts to an isomorphism from $H$ to $K$. This solves an open case of a problem of Tamura and Shafer from the late 1960s and generalizes a recent result by Bienvenu and Geroldinger, where it is assumed, among other conditions, that $H$ and $K$ are numerical monoids.


title: EndoOOD: Uncertainty-aware Out-of-distribution Detection in Capsule Endoscopy Diagnosis

abstract: Wireless capsule endoscopy (WCE) is a non-invasive diagnostic procedure that enables visualization of the gastrointestinal (GI) tract. Deep learning-based methods have shown effectiveness in disease screening using WCE data, alleviating the burden on healthcare professionals. However, existing capsule endoscopy classification methods mostly rely on pre-defined categories, making it challenging to identify and classify out-of-distribution (OOD) data, such as undefined categories or anatomical landmarks. To address this issue, we propose the Endoscopy Out-of-Distribution (EndoOOD) framework, which aims to effectively handle the OOD detection challenge in WCE diagnosis. The proposed framework focuses on improving the robustness and reliability of WCE diagnostic capabilities by incorporating uncertainty-aware mixup training and long-tailed in-distribution (ID) data calibration techniques. Additionally, virtual-logit matching is employed to accurately distinguish between OOD and ID data while minimizing information loss. To assess the performance of our proposed solution, we conduct evaluations and comparisons with 12 state-of-the-art (SOTA) methods using two publicly available datasets. The results demonstrate the effectiveness of the proposed framework in enhancing diagnostic accuracy and supporting clinical decision-making.


title: Studying Differential Mental Health Expressions in India

abstract: Psychosocial stressors and the symptomatology of mental disorders vary across cultures. However, current understandings of mental health expressions on social media are predominantly derived from studies in WEIRD (Western, Educated, Industrialized, Rich, and Democratic) contexts. In this paper, we analyze mental health posts on Reddit made by individuals in India, to identify variations in online depression language specific to the Indian context compared to users from the Rest of the World (ROW). Unlike in Western samples, we observe that mental health discussions in India additionally express sadness, use negation, are present-focused, and are related to work and achievement. Illness is uniquely correlated to India, indicating the association between depression and physical health in Indian patients. Two clinical psychologists validated the findings from social media posts and found 95% of the top 20 topics associated with mental health discussions as prevalent in Indians. Significant linguistic variations in online mental health-related language in India compared to ROW, emphasize the importance of developing precision-targeted interventions that are culturally appropriate.


title: Federated Reinforcement Learning for Uplink Centric Broadband Communication Optimization over Unlicensed Spectrum

abstract: To provide Uplink Centric Broadband Communication (UCBC), New Radio Unlicensed (NR-U) network has been standardized to exploit the unlicensed spectrum using Listen Before Talk (LBT) scheme to fairly coexist with the incumbent Wireless Fidelity (WiFi) network. Existing access schemes over unlicensed spectrum are required to perform Clear Channel Assessment (CCA) before transmissions, where fixed Energy Detection (ED) thresholds are adopted to identify the channel as idle or busy. However, fixed ED thresholds setting prevents devices from accessing the channel effectively and efficiently, which leads to the hidden node (HN) and exposed node (EN) problems. In this paper, we first develop a centralized double Deep Q-Network (DDQN) algorithm to optimize the uplink system throughput, where the agent is deployed at the central server to dynamically adjust the ED thresholds for NR-U and WiFi networks. Considering that heterogeneous NR-U and WiFi networks, in practice, cannot share the raw data with the central server directly, we then develop a federated DDQN algorithm, where two agents are deployed in the NR-U and WiFi networks, respectively. Our results have shown that the uplink system throughput increases by over 100%, where cell throughput of NR-U network rises by 150%, and cell throughput of WiFi network decreases by 30%. To guarantee the cell throughput of WiFi network, we redesign the reward function to punish the agent when the cell throughput of WiFi network is below the threshold, and our revised design can still provide over 50% uplink system throughput gain.


title: On solvable Lie superalgebras of maximal rank

abstract: In this paper we establish some basic properties of superderivations of Lie superalgebras. Under certain conditions, for solvable Lie superalgebras with given nilradicals, we give estimates for upper bounds to dimensions of complementary subspaces to the nilradicals. Moreover, under these conditions we describe the solvable Lie superalgebras of maximal rank. Namely, we prove that an arbitrary solvable Lie superalgebra of maximal rank is isomorphic to the maximal solvable extension of nilradical of maximal rank.


title: Pattern-wise Transparent Sequential Recommendation

abstract: A transparent decision-making process is essential for developing reliable and trustworthy recommender systems. For sequential recommendation, it means that the model can identify critical items asthe justifications for its recommendation results. However, achieving both model transparency and recommendation performance simultaneously is challenging, especially for models that take the entire sequence of items as input without screening. In this paper,we propose an interpretable framework (named PTSR) that enables a pattern-wise transparent decision-making process. It breaks the sequence of items into multi-level patterns that serve as atomic units for the entire recommendation process. The contribution of each pattern to the outcome is quantified in the probability space. With a carefully designed pattern weighting correction, the pattern contribution can be learned in the absence of ground-truth critical patterns. The final recommended items are those items that most critical patterns strongly endorse. Extensive experiments on four public datasets demonstrate remarkable recommendation performance, while case studies validate the model transparency. Our code is available at https://anonymous.4open.science/r/PTSR-2237.


title: DictLLM: Harnessing Key-Value Data Structures with Large Language Models for Enhanced Medical Diagnostics

abstract: Structured data offers a sophisticated mechanism for the organization of information. Existing methodologies for the text-serialization of structured data in the context of large language models fail to adequately address the heterogeneity inherent in key-value structured data. These methods are not ideal and frequently result in larger input sizes and poor adaptability to input changes. In this paper, we introduce DictLLM, an innovative framework designed to improve the modeling of key-value structured data, like medical laboratory reports, for generating medical diagnoses. DictLLM integrates three key components: (1) group positional encoding to maintain permutation invariance, (2) hierarchical attention bias to capture the inherent bias in structured data, and (3) an optimal transport alignment layer that aligns the embedding generated by the dictionary encoder with the LLM, thereby producing a sequence of fixed-length virtual tokens. We carry out experiments using various LLM models on a comprehensive real-world medical laboratory report dataset for automatic diagnosis generation, our findings illustrate that DictLLM significantly outperforms established baseline methods and few-shot GPT-4 implementations in terms of both Rouge-L and Knowledge F1 scores. Furthermore, our evaluation of the framework's scalability and robustness, through a series of experiments, underscores its exceptional capability in accurately modeling the complex key-value data structure of medical dictionary data.


title: Martingale Suitable Weak Solutions of $3$-D Stochastic Navier-Stokes Equations with Vorticity Bounds

abstract: In this paper, we construct suitable weak martingale solutions for $3$-dimensional incompressible stochastic Navier-Stokes equations with linear multiplicative noise. In deterministic setting, as widely known, ``suitable weak solutions'' are Leray-Hopf weak solutions enjoying two different types of local energy inequalities. In stochastic setting, we are able to show corresponding stochastic versions of the two local energy inequalities, where a semi-martingale term occurs as the effect of the noise. Note that the exponential formulas, which are widely used to transform the stochastic PDEs system into a random one, DO NOT show up in our formulations of local energy inequality. This is different to \cite{FR02,Rom10} where the additive noise case is dealt. Also, a path-wise result in terms of ``a.e. super-martingale'' is derived from the stochastic local energy inequalities. Further more, if the initial vorticity is a finite Radon measure, we are able to bound the $L^1\big(\Omega;L^\infty([0,T];L^1)\big)$ norm of the vorticity and $L^{\frac{4}{3+\delta}}\big(\Omega\times[0,T]\times\mathbb T^3\big)$ norm of the gradient of the vorticity.


title: A Fisher Information based Receding Horizon Control Method for Signal Strength Model Estimation

abstract: This paper considers the problem of localizing a set of nodes in a wireless sensor network when both their positions and the parameters of the communication model are unknown. We assume that a single agent moves through the environment, taking measurements of the Received Signal Strength (RSS), and seek a controller that optimizes a performance metric based on the Fisher Information Matrix (FIM). We develop a receding horizon (RH) approach that alternates between estimating the parameter values (using a maximum likelihood estimator) and determining where to move so as to maximally inform the estimation problem. The receding horizon controller solves a multi-stage look ahead problem to determine the next control to be applied, executes the move, collects the next measurement, and then re-estimates the parameters before repeating the sequence. We consider both a Dynamic Programming (DP) approach to solving the optimal control problem at each step, and a simplified heuristic based on a pruning algorithm that significantly reduces the computational complexity. We also consider a modified cost function that seeks to balance the information acquired about each of the parameters to ensure the controller does not focus on a single value in its optimization. These approaches are compared against two baselines, one based on a purely random trajectory and one on a greedy control solution. The simulations indicate our RH schemes outperform the baselines, while the pruning algorithm produces significant reductions in computation time with little effect on overall performance.


title: Optimal Quantum State Tomography via Weak Value

abstract: To improve the efficiency of the state tomography strategy via weak value, we have searched the optimal coupling strength between the system and measuring device. For an arbitrary d-dimensional quantum system, the optimal strengths being used in measuring the real and imaginary parts of the density matrix are obtained. The optimal efficiency of the state tomography has also been studied by using mean square error. The minimal mean square errors in the reconstructed density matrices have been derived. The state tomography strategy studied in this article may be useful in the measurement of the unknown quantum states.


title: LEIA: Facilitating Cross-lingual Knowledge Transfer in Language Models with Entity-based Data Augmentation

abstract: Adapting English-based large language models (LLMs) to other languages has become increasingly popular due to the efficiency and potential of cross-lingual transfer. However, existing language adaptation methods often overlook the benefits of cross-lingual supervision. In this study, we introduce LEIA, a language adaptation tuning method that utilizes Wikipedia entity names aligned across languages. This method involves augmenting the target language corpus with English entity names and training the model using left-to-right language modeling. We assess LEIA on diverse question answering datasets using 7B-parameter LLMs, demonstrating significant performance gains across various non-English languages. The source code is available at https://github.com/studio-ousia/leia.


title: Orbital angular momentum spectrum and entanglement in a rotating accelerated reference frame

abstract: The particle definition varies across different theories. The quantum field theory in curved spacetime shows that from the perspective of a linearly accelerated observer, an inertial empty space may be full of thermal particles. This effect is known as the Unruh effect. When the degrees of freedom of orbital angular momentum (OAM) are considered, all OAM modes share the same expected particle number. Here, we examine the OAM spectrum in a rotating accelerated reference frame to see how the spectrum differs from the linear accelerated case. When the observer starts to rotate, not all OAM modes are allowed and some negative energy modes show up. To understand how a rotating accelerated observer actually perceives these particles, the Unruh-DeWitt detector and its detailed balance are studied. This relation is studied both in the comoving inertial frame and in the rest frame. Based on these results, the OAM entanglement degradation is explored in two-dimensional and high-dimensional cases, respectively. The results indicate that the entanglement dimension and the highest order of OAM modes are mainly related to the acceleration and the rotation, respectively. It is then demonstrated that these results can be generalized to all stationary trajectories.


title: Visual Concept-driven Image Generation with Text-to-Image Diffusion Model

abstract: Text-to-image (TTI) diffusion models have demonstrated impressive results in generating high-resolution images of complex and imaginative scenes. Recent approaches have further extended these methods with personalization techniques that allow them to integrate user-illustrated concepts (e.g., the user him/herself) using a few sample image illustrations. However, the ability to generate images with multiple interacting concepts, such as human subjects, as well as concepts that may be entangled in one, or across multiple, image illustrations remains illusive. In this work, we propose a concept-driven TTI personalization framework that addresses these core challenges. We build on existing works that learn custom tokens for user-illustrated concepts, allowing those to interact with existing text tokens in the TTI model. However, importantly, to disentangle and better learn the concepts in question, we jointly learn (latent) segmentation masks that disentangle these concepts in user-provided image illustrations. We do so by introducing an Expectation Maximization (EM)-like optimization procedure where we alternate between learning the custom tokens and estimating masks encompassing corresponding concepts in user-supplied images. We obtain these masks based on cross-attention, from within the U-Net parameterized latent diffusion model and subsequent Dense CRF optimization. We illustrate that such joint alternating refinement leads to the learning of better tokens for concepts and, as a bi-product, latent masks. We illustrate the benefits of the proposed approach qualitatively and quantitatively (through user studies) with a number of examples and use cases that can combine up to three entangled concepts.


title: IRFundusSet: An Integrated Retinal Fundus Dataset with a Harmonized Healthy Label

abstract: Ocular conditions are a global concern and computational tools utilizing retinal fundus color photographs can aid in routine screening and management. Obtaining comprehensive and sufficiently sized datasets, however, is non-trivial for the intricate retinal fundus, which exhibits heterogeneities within pathologies, in addition to variations from demographics and acquisition. Moreover, retinal fundus datasets in the public space suffer fragmentation in the organization of data and definition of a healthy observation. We present Integrated Retinal Fundus Set (IRFundusSet), a dataset that consolidates, harmonizes and curates several public datasets, facilitating their consumption as a unified whole and with a consistent is_normal label. IRFundusSet comprises a Python package that automates harmonization and avails a dataset object in line with the PyTorch approach. Moreover, images are physically reviewed and a new is_normal label is annotated for a consistent definition of a healthy observation. Ten public datasets are initially considered with a total of 46064 images, of which 25406 are curated for a new is_normal label and 3515 are deemed healthy across the sources.


title: What's the Plan? Evaluating and Developing Planning-Aware Techniques for Language Models

abstract: Planning is a fundamental task in artificial intelligence that involves finding a sequence of actions that achieve a specified goal in a given environment. Large language models (LLMs) are increasingly used for applications that require planning capabilities, such as web or embodied agents. In line with recent studies, we demonstrate through experimentation that LLMs lack necessary skills required for planning. Based on these observations, we advocate for the potential of a hybrid approach that combines LLMs with classical planning methodology. Then, we introduce SimPlan, a novel hybrid-method, and evaluate its performance in a new challenging setup. Our extensive experiments across various planning domains demonstrate that SimPlan significantly outperforms existing LLM-based planners.


title: Research status of the Mendeleev Periodic Table: a bibliometric analysis

abstract: In this paper, we present a bibliometric analysis of the Mendeleev Periodic Table. We have conducted a comprehensive analysis of the Scopus-based database using the keyword "Mendeleev Periodic Table". Our findings suggest that the Mendeleev Periodic Table is an influential topic in the field of Inorganic as well as Organic Chemistry. Future researchers may focus on expanding our analysis to include other bibliometric indicators to gain a more comprehensive understanding of the impact of the Mendeleev Periodic Table in chemistry-based scientific investigations and even in the field of astrochemistry.


title: Electromagnetically induced gratings created by extremely short non-overlapping pulses of light in a three-level resonant mediu

abstract: In a fixed spectral range, single- and half-cycle electromagnetic pulses have the shortest duration. Half-cycle pulses are promising tools for ultrafast control of quantum systems. Previously, the possibility of using a sequence of single- and half-cycle attosecond pulses to generate and ultrafast control light-induced population difference gratings has been demonstrated. However, such studies have been carried out using different approximations. For example, when the medium is modelled in the two-level approximation. In this paper, based on the numerical solution of the system of Maxwell-Bloch equations, it is shown that it is possible to generate and control population gratings in a three-level medium without using the approximations used in previous studies. It is shown that taking into account the additional level of the medium does not lead to a violation of the effect of generating such gratings. This extends the applicability of previous results.


title: Exponential Cluster Synchronization in Fast Switching Network Topologies: A Pinning Control Approach with Necessary and Sufficient Conditions

abstract: This research investigates the intricate domain of synchronization problem among multiple agents operating within a dynamic fast switching network topology. We concentrate on cluster synchronization within coupled linear system under pinning control, providing both necessary and sufficient conditions. As a pivotal aspect, this paper aim to president the weakest possible conditions to make the coupled linear system realize cluster synchronization exponentially. Within the context of fast switching framework, we initially examine the necessary conditions, commencing with the transformation of the consensus problem into a stability problem, introducing a new variable to make the coupled system achieve cluster synchronization if the system is controllable; communication topology switching fast enough and the coupling strength should be sufficiently robust. Then, by using the Lyapunov theorem, we also present that the state matrix controllable is necessary for cluster synchronization. Furthermore, this paper culminating in the incorporation of contraction theory and an invariant manifold, demonstrating that the switching topology has an average is imperative for achieving cluster synchronization. Finally, we introduce three simulations to validate the efficacy of the proposed approach.


title: Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation

abstract: In recent years, substantial advancements have been made in the development of large language models, achieving remarkable performance across diverse tasks. To evaluate the knowledge ability of language models, previous studies have proposed lots of benchmarks based on question-answering pairs. We argue that it is not reliable and comprehensive to evaluate language models with a fixed question or limited paraphrases as the query, since language models are sensitive to prompt. Therefore, we introduce a novel concept named knowledge boundary to encompass both prompt-agnostic and prompt-sensitive knowledge within language models. Knowledge boundary avoids prompt sensitivity in language model evaluations, rendering them more dependable and robust. To explore the knowledge boundary for a given model, we propose projected gradient descent method with semantic constraints, a new algorithm designed to identify the optimal prompt for each piece of knowledge. Experiments demonstrate a superior performance of our algorithm in computing the knowledge boundary compared to existing methods. Furthermore, we evaluate the ability of multiple language models in several domains with knowledge boundary.


title: Graph Out-of-Distribution Generalization via Causal Intervention

abstract: Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on graphs involve intricate interconnections between nodes, and the environment labels are often absent in data. In this paper, we adopt a bottom-up data-generative perspective and reveal a key observation through causal analysis: the crux of GNNs' failure in OOD generalization lies in the latent confounding bias from the environment. The latter misguides the model to leverage environment-sensitive correlations between ego-graph features and target nodes' labels, resulting in undesirable generalization on new unseen nodes. Built upon this analysis, we introduce a conceptually simple yet principled approach for training robust GNNs under node-level distribution shifts, without prior knowledge of environment labels. Our method resorts to a new learning objective derived from causal inference that coordinates an environment estimator and a mixture-of-expert GNN predictor. The new approach can counteract the confounding bias in training data and facilitate learning generalizable predictive relations. Extensive experiment demonstrates that our model can effectively enhance generalization with various types of distribution shifts and yield up to 27.4\% accuracy improvement over state-of-the-arts on graph OOD generalization benchmarks. Source codes are available at https://github.com/fannie1208/CaNet.


title: URLBERT:A Contrastive and Adversarial Pre-trained Model for URL Classification

abstract: URLs play a crucial role in understanding and categorizing web content, particularly in tasks related to security control and online recommendations. While pre-trained models are currently dominating various fields, the domain of URL analysis still lacks specialized pre-trained models. To address this gap, this paper introduces URLBERT, the first pre-trained representation learning model applied to a variety of URL classification or detection tasks. We first train a URL tokenizer on a corpus of billions of URLs to address URL data tokenization. Additionally, we propose two novel pre-training tasks: (1) self-supervised contrastive learning tasks, which strengthen the model's understanding of URL structure and the capture of category differences by distinguishing different variants of the same URL; (2) virtual adversarial training, aimed at improving the model's robustness in extracting semantic features from URLs. Finally, our proposed methods are evaluated on tasks including phishing URL detection, web page classification, and ad filtering, achieving state-of-the-art performance. Importantly, we also explore multi-task learning with URLBERT, and experimental results demonstrate that multi-task learning model based on URLBERT exhibit equivalent effectiveness compared to independently fine-tuned models, showing the simplicity of URLBERT in handling complex task requirements. The code for our work is available at https://github.com/Davidup1/URLBERT.


title: Point-Wise Vibration Pattern Production via a Sparse Actuator Array for Surface Tactile Feedback

abstract: Surface vibration tactile feedback is capable of conveying various semantic information to humans via the handheld electronic devices, like smartphone, touch panel,and game controller. However, covering the whole device contacting surface with dense actuator arrangement can affect its normal use, how to produce desired vibration patterns at any contact point with only several sparse actuators deployed on the handled device surface remains a significant challenge. In this work, we develop a tactile feedback board with only five actuators in the size of a smartphone, and achieve the precise vibration pattern production that can focus at any desired position all over the board. Specifically, we investigate the vibration characteristics of single passive coil actuator, and construct its vibration pattern model at any position on the feedback board surface. Optimal phase and amplitude modulation, found with the simulated annealing algorithm, is employed with five actuators in a sparse array. And all actuators' vibration patterns are superimposed linearly to synthetically generate different onboard vibration energy distribution for tactile sensing. Experiments demonstrated that for point-wise vibration pattern production on our tactile board achieved an average level of about 0.9 in the Structural Similarity Index Measure (SSIM) evaluation, when compared to the ideal single-point-focused target vibration pattern. The sparse actuator array can be easily embedded into usual handheld electronic devices, which shows a good significant implication for enriching their haptic interaction functionalities.


title: Thyroid ultrasound diagnosis improvement via multi-view self-supervised learning and two-stage pre-training

abstract: Thyroid nodule classification and segmentation in ultrasound images are crucial for computer-aided diagnosis; however, they face limitations owing to insufficient labeled data. In this study, we proposed a multi-view contrastive self-supervised method to improve thyroid nodule classification and segmentation performance with limited manual labels. Our method aligns the transverse and longitudinal views of the same nodule, thereby enabling the model to focus more on the nodule area. We designed an adaptive loss function that eliminates the limitations of the paired data. Additionally, we adopted a two-stage pre-training to exploit the pre-training on ImageNet and thyroid ultrasound images. Extensive experiments were conducted on a large-scale dataset collected from multiple centers. The results showed that the proposed method significantly improves nodule classification and segmentation performance with limited manual labels and outperforms state-of-the-art self-supervised methods. The two-stage pre-training also significantly exceeded ImageNet pre-training.


title: Verifiably Following Complex Robot Instructions with Foundation Models

abstract: Enabling robots to follow complex natural language instructions is an important yet challenging problem. People want to flexibly express constraints, refer to arbitrary landmarks and verify behavior when instructing robots. Conversely, robots must disambiguate human instructions into specifications and ground instruction referents in the real world. We propose Language Instruction grounding for Motion Planning (LIMP), a system that leverages foundation models and temporal logics to generate instruction-conditioned semantic maps that enable robots to verifiably follow expressive and long-horizon instructions with open vocabulary referents and complex spatiotemporal constraints. In contrast to prior methods for using foundation models in robot task execution, LIMP constructs an explainable instruction representation that reveals the robot's alignment with an instructor's intended motives and affords the synthesis of robot behaviors that are correct-by-construction. We demonstrate LIMP in three real-world environments, across a set of 35 complex spatiotemporal instructions, showing the generality of our approach and the ease of deployment in novel unstructured domains. In our experiments, LIMP can spatially ground open-vocabulary referents and synthesize constraint-satisfying plans in 90% of object-goal navigation and 71% of mobile manipulation instructions. See supplementary videos at https://robotlimp.github.io


title: Acousto-electric tomography by the convergence of Kaczamrz two-point gradient-$\Theta$ method

abstract: We study the numerical reconstruction problem in acousto-electric tomography (AET) of recovering the conductivity distribution in a bounded domain from multiple interior power density data. The Two-Point-Gradient-$\Theta$ (TPG-$\Theta$) in Kaczmarz type is proposed, with a general convex penalty term $\Theta$, the algorithm can be utilized in AET problem for recovering sparse and discontinuous conductivity distributions. We establish the convergence of such iterative regularized method. Extensive numerical experiments are presented to illustrate the feasibility and effectiveness of the proposed approach.


title: A Three-Party Repeated Coalition Formation Game for PLS in Wireless Communications with IRSs

abstract: In this paper, a repeated coalition formation game (RCFG) with dynamic decision-making for physical layer security (PLS) in wireless communications with intelligent reflecting surfaces (IRSs) has been investigated. In the considered system, one central legitimate transmitter (LT) aims to transmit secret signals to a group of legitimate receivers (LRs) under the threat of a proactive eavesdropper (EV), while there exist a number of third-party IRSs (TIRSs) which can choose to form a coalition with either legitimate pairs (LPs) or the EV to improve their respective performances in exchange for potential benefits (e.g., payments). Unlike existing works that commonly restricted to friendly IRSs or malicious IRSs only, we study the complicated dynamic ally-adversary relationships among LPs, EV and TIRSs, under unpredictable wireless channel conditions, and introduce a RCFG to model their long-term strategic interactions. Particularly, we first analyze the existence of Nash equilibrium (NE) in the formulated RCFG, and then propose a switch operations-based coalition selection along with a deep reinforcement learning (DRL)-based algorithm for obtaining such equilibrium. Simulations examine the feasibility of the proposed algorithm and show its superiority over counterparts.


title: Blown-up corona of relatively hyperbolic groups

abstract: We show that under appropriate assumptions, a blown-up corona of a relatively hyperbolic group is equivariant and the compactification of the universal space for proper action by the blown-up corona is contractible. As a corollary, we establish the formula to determine the covering dimension of the blown-up corona by the cohomological dimension of the group. We also show that the blown-up corona of a hyperbolic group with respect to an almost malnormal family of quasiconvex subgroups is homeomorphic to the Gromov boundary of the group.


title: GenAD: Generative End-to-End Autonomous Driving

abstract: Directly producing planning results from raw sensors has been a long-desired solution for autonomous driving and has attracted increasing attention recently. Most existing end-to-end autonomous driving methods factorize this problem into perception, motion prediction, and planning. However, we argue that the conventional progressive pipeline still cannot comprehensively model the entire traffic evolution process, e.g., the future interaction between the ego car and other traffic participants and the structural trajectory prior. In this paper, we explore a new paradigm for end-to-end autonomous driving, where the key is to predict how the ego car and the surroundings evolve given past scenes. We propose GenAD, a generative framework that casts autonomous driving into a generative modeling problem. We propose an instance-centric scene tokenizer that first transforms the surrounding scenes into map-aware instance tokens. We then employ a variational autoencoder to learn the future trajectory distribution in a structural latent space for trajectory prior modeling. We further adopt a temporal model to capture the agent and ego movements in the latent space to generate more effective future trajectories. GenAD finally simultaneously performs motion prediction and planning by sampling distributions in the learned structural latent space conditioned on the instance tokens and using the learned temporal model to generate futures. Extensive experiments on the widely used nuScenes benchmark show that the proposed GenAD achieves state-of-the-art performance on vision-centric end-to-end autonomous driving with high efficiency. Code: https://github.com/wzzheng/GenAD.


title: C. V. Vishveshwara (Vishu) On The Black Hole Trek

abstract: With his seminal and pioneering work on the stability of the Schwarzschild black hole and its interaction with gravitational radiation, Vishu had opened a new window on black hole astrophysics. One of the interesting results that soon followed was that "a black hole has no hair", it is entirely specified by the three parameters, mass, spin and charge, and nothing more. The discovery of gravitational waves in 2016 produced by merger of two black holes, and observed by the Ligo-Virgo collaboration, carried the definitive signature of quasi-normal modes, the phenomenon of black hole ringdown, exactly what Vishu had predicted in his 1970 Nature paper~(See Isaacson's commentary) 46 years ago. This was the crowning glory.


title: To use or not to use proprietary street view images in (health and place) research? That is the question

abstract: Computer vision-based analysis of street view imagery has transformative impacts on environmental assessments. Interactive web services, particularly Google Street View, play an ever-important role in making imagery data ubiquitous. Despite the technical ease of harnessing millions of Google Street View images, this article questions the current practices in using this proprietary data source from a European viewpoint. Our concern lies with Google's terms of service, which restrict bulk image downloads and the generation of street view image-based indices. To reconcile the challenge of advancing society through groundbreaking research while maintaining data license agreements and legal integrity, we believe it is crucial to 1) include an author's statement on using proprietary street view data and the directives it entails, 2) negotiate academic-specific license to democratize Google Street View data access, and 3) adhere to open data principles and utilize open image sources for future research.


title: Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources

abstract: Federated Learning (FL) has recently been applied to the parameter-efficient fine-tuning of Large Language Models (LLMs). While promising, it raises significant challenges due to the heterogeneous resources and data distributions of clients. This study introduces FlexLoRA, a simple yet effective aggregation scheme for LLM fine-tuning, which mitigates the ``bucket effect'' in traditional FL that restricts the potential of clients with ample resources by tying them to the capabilities of the least-resourced participants. FlexLoRA allows for dynamic adjustment of local LoRA ranks, fostering the development of a global model imbued with broader, less task-specific knowledge. By synthesizing a full-size LoRA weight from individual client contributions and employing Singular Value Decomposition (SVD) for weight redistribution, FlexLoRA fully leverages heterogeneous client resources. Involving thousands of clients performing heterogeneous NLP tasks and client resources, our experiments validate the efficacy of FlexLoRA, with the federated global model achieving consistently better improvement over SOTA FL methods in downstream NLP task performance across various heterogeneous distributions. FlexLoRA's practicality is further underscored by our theoretical analysis and its seamless integration with existing LoRA-based FL methods, offering a path toward cross-device, privacy-preserving federated tuning for LLMs.


title: Higgs-strahlung at the LHC in the inert doublet model

abstract: $pp \to W^{\pm} h, Zh$ processes at the LHC are studied in the framework of the inert doublet model (IDM). To quantify the effects of the IDM and their observability in these processes we revisit the NLO (QCD and EW) predictions in the Standard Model (SM) and their uncertainty. Taking all available current constraints on the parameter space of the IDM, we consider both the case of the IDM providing a good Dark Matter (DM) candidate within the freeze-out mechanism as well as when the DM restrictions are relaxed. In the former, deviations from the SM of only a few per-mil in these cross sections at the LHC are found and may not be measured. In the latter, the deviations can reach a few percents and should be observable. Smaller discrepancies in this case require theoretical uncertainties to be improved in particular those arising from the parton distribution functions (PDFs). We stress the importance of the photon induced real corrections and the need for further improvement in the extraction of the photon PDFs. The analysis also showcases the development and exploitation of our automated tool for the computation of one-loop electroweak and QCD corrections for a New Physics model with internal tests such as those concerning the soft and collinear parts provided through both dipole subtraction and phase space slicing besides tests for ultra-violet finiteness and gauge-parameter independence.


title: MAL: Motion-Aware Loss with Temporal and Distillation Hints for Self-Supervised Depth Estimation

abstract: Depth perception is crucial for a wide range of robotic applications. Multi-frame self-supervised depth estimation methods have gained research interest due to their ability to leverage large-scale, unlabeled real-world data. However, the self-supervised methods often rely on the assumption of a static scene and their performance tends to degrade in dynamic environments. To address this issue, we present Motion-Aware Loss, which leverages the temporal relation among consecutive input frames and a novel distillation scheme between the teacher and student networks in the multi-frame self-supervised depth estimation methods. Specifically, we associate the spatial locations of moving objects with the temporal order of input frames to eliminate errors induced by object motion. Meanwhile, we enhance the original distillation scheme in multi-frame methods to better exploit the knowledge from a teacher network. MAL is a novel, plug-and-play module designed for seamless integration into multi-frame self-supervised monocular depth estimation methods. Adding MAL into previous state-of-the-art methods leads to a reduction in depth estimation errors by up to 4.2% and 10.8% on KITTI and CityScapes benchmarks, respectively.


title: Thin-film Lithium Niobate on Insulator Surface Acoustic Wave Devices for 6G Centimeter Bands

abstract: In this work, we investigate the frequency scaling of shear-horizontal (S.H.) surface acoustic wave (SAW) resonators based on a lithium niobate on insulator (LNOI) substrate into the centimeter bands for 6G wireless systems. Prototyped resonators with wavelengths ranging between 240 nm and 400 nm were fabricated, and the experimental results exhibit a successful frequency scaling between 9.05 and 13.37 GHz. However, a noticeable performance degradation can be observed as the resonance frequency (fs) scales. Such an effect is expected to be caused by non-ideal helec/{\lambda} for smaller {\lambda} devices. The optimized LNOI SH-SAW with a {\lambda} of 400 nm exhibits a fs of 9.05 GHz, a keff2 of 15%, Qmax of 213 and a FoM of 32, which indicates a successful implementation for device targeting centimeter bands.


title: Polarization-dependent resonant phenomena in all-dielectric scatterers: inversion of magnetic inductance and electric displacement

abstract: The theoretical description and experimental verification of resonant phenomena in electromagnetic fields generated in the near zone of all-dielectric rectangular thin sub wavelength frames, subjected to an incident microwave, is considered. The geometry of considered problems is presented by means of arrangements of these frames in three orthogonal planes, normal respectively to electric component, magnetic component and wave vector of the incident wave. Such trio paves the way to design of 3D all-dielectric multiresonant microwave unit cell. Displacement currents, generated by linearly polarized electromagnetic waves in the system, lead to the formation of magnetic and electric dipoles, each of which possess own resonant frequency. Resonant inversion of magnetic inductance and electric displacement is observed. The sliding incidence of plane wave on the frame is shown to provide the sharp and deep resonance in the components of generated field. The phase shift equal to $\pi$ between the magnetic components of incident and generated wave indicates the formation of negative magnetic response. There observes the angular anisotropy of arising dipoles, manifested in values of resonance frequencies and in the dependence of depths of resonant spectral dips upon the orientation of dipoles, with respect to the direction of propagation of incident wave.

categories: physics.app-ph cond-mat.mes-hall physics.class-ph physics.optics


title: Underestimation of lung regions on chest X-ray segmentation masks assessed by comparison with total lung volume evaluated on computed tomography

abstract: Lung mask creation lacks well-defined criteria and standardized guidelines, leading to a high degree of subjectivity between annotators. In this study, we assess the underestimation of lung regions on chest X-ray segmentation masks created according to the current state-of-the-art method, by comparison with total lung volume evaluated on computed tomography (CT). We show, that lung X-ray masks created by following the contours of the heart, mediastinum, and diaphragm significantly underestimate lung regions and exclude substantial portions of the lungs from further assessment, which may result in numerous clinical errors.


title: Keller-Segel type approximation for nonlocal Fokker-Planck equations in one-dimensional bounded domain

abstract: Numerous evolution equations with nonlocal convolution-type interactions have been proposed. In some cases, a convolution was imposed as the velocity in the advection term. Motivated by analyzing these equations, we approximate advective nonlocal interactions as local ones, thereby converting the effect of nonlocality. In this study, we investigate whether the solution to the nonlocal Fokker-Planck equation can be approximated using the Keller-Segel system. By singular limit analysis, we show that this approximation is feasible for the Fokker-Planck equation with any potential and that the convergence rate is specified. Moreover, we provide an explicit formula for determining the coefficient of the Lagrange interpolation polynomial with Chebyshev nodes. Using this formula, the Keller-Segel system parameters for the approximation are explicitly specified by the shape of the potential in the Fokker-Planck equation. Consequently, we demonstrate the relationship between advective nonlocal interactions and a local dynamical system.


title: From Prejudice to Parity: A New Approach to Debiasing Large Language Model Word Embeddings

abstract: Embeddings play a pivotal role in the efficacy of Large Language Models. They are the bedrock on which these models grasp contextual relationships and foster a more nuanced understanding of language and consequently perform remarkably on a plethora of complex tasks that require a fundamental understanding of human language. Given that these embeddings themselves often reflect or exhibit bias, it stands to reason that these models may also inadvertently learn this bias. In this work, we build on the seminal previous work and propose DeepSoftDebias, an algorithm that uses a neural network to perform 'soft debiasing'. We exhaustively evaluate this algorithm across a variety of SOTA datasets, accuracy metrics, and challenging NLP tasks. We find that DeepSoftDebias outperforms the current state-of-the-art methods at reducing bias across gender, race, and religion.


title: Exactly solvable model for transmission line with artificial dispersion

abstract: The problem of the emergence of wave dispersion due to the heterogeneity of a transmission line (TL) is considered. An exactly solvable model helps to better understand the physical process of a signal passing through a non-uniform section of the line and to compare the exact solution and solutions obtained using various approximate methods. Based on the transition to new variables, the developed approach made it possible to construct exact analytical solutions of telegraph equations with a continuous distribution of parameters, which depend on the coordinate. The flexibility of the discussed model is due to the presence of a number of free parameters, including two geometric factors characterizing the lengths of inhomogeneities in values of the inductance L and of the capacitance C. In the new variables, the spatiotemporal structure of the solutions is described using sine waves and elementary functions, and the dispersion is determined by the formulas of the waveguide type. The dispersive waveguide-like structure characterized by refractive index N and cut-off frequency $\Omega$. The exact expressions for the complex reflection and transmission coefficients are derived. These expressions describe phase shifts for reflected and transmitted waves. The following interesting cases are analyzed: the passage of waves without phase change, the reflectionless passage of waves, and the passage of signals through a sequence of non-uniform sections. The developed mathematical formalism can be useful for the analysis of a wider range of problems.

categories: physics.app-ph math-ph math.MP nlin.SI physics.class-ph


title: High Quality Microscopic Nuclear Masses of Superheavy Nuclei

abstract: To synthesize new superheavy elements, the accurate prediction of nuclear masses of superheavy nuclei is essential for calculations of reaction $Q$ values, neutron separation energies and $\alpha$-decay energies, which are important for estimating beam energies, survival probabilities and also for identifications. In this work, we include existing $\alpha$-decay energies of superheavy nuclei in the fitting procedure of extended Skyrme density functionals as corresponding nuclear masses are not available. Systematic $\alpha$-decay energies are well reproduced with deviations smaller than 0.2 MeV. The high quality $\alpha$-decay energies make it feasible for direct identification of new elements and new isotopes. The resulting binding energies in the heaviest region are surprisingly close to the inferences by AME2020. Our work should be useful for guiding experimental synthesis of new elements 119 and 120.


title: Optimal Parallelization Strategies for Active Flow Control in Deep Reinforcement Learning-Based Computational Fluid Dynamics

abstract: Deep Reinforcement Learning (DRL) has emerged as a promising approach for handling highly dynamic and nonlinear Active Flow Control (AFC) problems. However, the computational cost associated with training DRL models presents a significant performance bottleneck. To address this challenge and enable efficient scaling on high-performance computing architectures, this study focuses on optimizing DRL-based algorithms in parallel settings. We validate an existing state-of-the-art DRL framework used for AFC problems and discuss its efficiency bottlenecks. Subsequently, by deconstructing the overall framework and conducting extensive scalability benchmarks for individual components, we investigate various hybrid parallelization configurations and propose efficient parallelization strategies. Moreover, we refine input/output (I/O) operations in multi-environment DRL training to tackle critical overhead associated with data movement. Finally, we demonstrate the optimized framework for a typical AFC problem where near-linear scaling can be obtained for the overall framework. We achieve a significant boost in parallel efficiency from around 49% to approximately 78%, and the training process is accelerated by approximately 47 times using 60 CPU cores. These findings are expected to provide valuable insights for further advancements in DRL-based AFC studies.


title: Sharp lifespan estimate for the compressible Euler system with critical time-dependent damping in $\R^2$

abstract: This paper concerns the long time existence to the smooth solutions of the compressible Euler system with critical time dependent damping in $\R^2$. We establish the sharp lifespan estimate from below, with respect to the small parameter of the initial perturbation. For this end, the vector fields $\widehat{Z}$ (defined below) are used instead of the usual one $Z$, to get better decay for the linear error terms. This idea may also apply to the long time behavior study of nonlinear wave equations with time-dependent damping.


title: Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM

abstract: Generating accurate SQL queries for user questions (text-to-SQL) has been a long-standing challenge since it requires a deep understanding of both the user's question and the corresponding database schema in order to retrieve the desired content accurately. Existing methods rely on the comprehensive capability of large language models (LLMs) to generate the SQL. However, some necessary knowledge is not explicitly included in the database schema and user question or has been learned by LLMs. Thus, the generated SQL of the knowledge-insufficient questions may be inaccurate, negatively influencing the text-to-SQL models' performance and robustness. To address this challenge, we propose the Knowledge-to-SQL framework, which employs tailored Data Expert LLM (DELLM) to provide helpful knowledge for all text-to-SQL models. Specifically, we introduce the detailed implementation of DELLM regarding table reading and the basic fine-tuning process. We further propose a Preference Learning via Database Feedback (PLDBF) strategy, refining the DELLM to generate more helpful knowledge for LLMs. Extensive experiments verify that DELLM can enhance the state-of-the-art approaches for text-to-SQL tasks. The corresponding code of DELLM is released for further research.


title: Large Language Model-driven Meta-structure Discovery in Heterogeneous Information Network

abstract: Heterogeneous information networks (HIN) have gained increasing popularity in recent years for capturing complex relations between diverse types of nodes. Meta-structures are proposed as a useful tool to identify the important patterns in HINs, but hand-crafted meta-structures pose significant challenges for scaling up, drawing wide research attention towards developing automatic search algorithms. Previous efforts primarily focused on searching for meta-structures with good empirical performance, overlooking the importance of human comprehensibility and generalizability. To address this challenge, we draw inspiration from the emergent reasoning abilities of large language models (LLMs). We propose ReStruct, a meta-structure search framework that integrates LLM reasoning into the evolutionary procedure. ReStruct uses a grammar translator to encode the meta-structures into natural language sentences, and leverages the reasoning power of LLMs to evaluate their semantic feasibility. Besides, ReStruct also employs performance-oriented evolutionary operations. These two competing forces allow ReStruct to jointly optimize the semantic explainability and empirical performance of meta-structures. Furthermore, ReStruct contains a differential LLM explainer to generate and refine natural language explanations for the discovered meta-structures by reasoning through the search history. Experiments on eight representative HIN datasets demonstrate that ReStruct achieves state-of-the-art performance in both recommendation and node classification tasks. Moreover, a survey study involving 73 graduate students shows that the discovered meta-structures and generated explanations by ReStruct are substantially more comprehensible. Our code and questionnaire are available at https://github.com/LinChen-65/ReStruct.


title: Formation and manipulation of diatomic rotors at the symmetry-breaking surfaces of kagome superconductors

abstract: Artificial molecular rotors and motors hold great promise for functional nanomachines, but constructing diatomic rotors, crucial for these machines, is challenging due to surface constraints and limited chemical design. Here we report the construction of diatomic Cr-Cs and Fe-Cs rotors where a Cr or Fe atom revolves around a Cs atom at the Sb surface of the newly-discovered kagome superconductor CsV3Sb5. The rotation rate is controlled by bias voltage between the rotor and scanning tunneling microscope (STM) tip. The spatial distribution of rates exhibits C2 symmetry, might linked to the symmetry-breaking charge orders of CsV3Sb5. We have expanded rotor construction to include different transition metals (Cr, Fe, V) and alkali metals (Cs, K). Remarkably, designed configurations of rotors are achieved through STM manipulation. Rotor orbits and quantum states are precisely controlled by tunning inter-rotor distance. Our findings establish a novel platform for the atomically precise fabrication of atomic motors on symmetry-breaking quantum materials, paving the way for advanced nanoscale devices.


title: Cross-Attention Fusion of Visual and Geometric Features for Large Vocabulary Arabic Lipreading

abstract: Lipreading involves using visual data to recognize spoken words by analyzing the movements of the lips and surrounding area. It is a hot research topic with many potential applications, such as human-machine interaction and enhancing audio speech recognition. Recent deep-learning based works aim to integrate visual features extracted from the mouth region with landmark points on the lip contours. However, employing a simple combination method such as concatenation may not be the most effective approach to get the optimal feature vector. To address this challenge, firstly, we propose a cross-attention fusion-based approach for large lexicon Arabic vocabulary to predict spoken words in videos. Our method leverages the power of cross-attention networks to efficiently integrate visual and geometric features computed on the mouth region. Secondly, we introduce the first large-scale Lip Reading in the Wild for Arabic (LRW-AR) dataset containing 20,000 videos for 100-word classes, uttered by 36 speakers. The experimental results obtained on LRW-AR and ArabicVisual databases showed the effectiveness and robustness of the proposed approach in recognizing Arabic words. Our work provides insights into the feasibility and effectiveness of applying lipreading techniques to the Arabic language, opening doors for further research in this field. Link to the project page: https://crns-smartvision.github.io/lrwar


title: Rate of convergence for first-order singular perturbation problems: Hamilton-Jacobi-Isaacs equations and mean field games of acceleration

abstract: This work focuses on the rate of convergence for singular perturbation problems for first-order Hamilton-Jacobi equations. As an application we derive the rate of convergence for singularly perturbed two-players zero-sum deterministic differential games (i.e., leading to Hamilton-Jacobi-Isaacs equations) and, subsequently, in case of singularly perturbed mean field games of acceleration. Namely, we show that in both the models the rate of convergence is $\varepsilon$.


title: Unveiling the Secrets of Engaging Conversations: Factors that Keep Users Hooked on Role-Playing Dialog Agents

abstract: With the growing humanlike nature of dialog agents, people are now engaging in extended conversations that can stretch from brief moments to substantial periods of time. Understanding the factors that contribute to sustaining these interactions is crucial, yet existing studies primarily focusing on short-term simulations that rarely explore such prolonged and real conversations. In this paper, we investigate the factors influencing retention rates in real interactions with roleplaying models. By analyzing a large dataset of interactions between real users and thousands of characters, we systematically examine multiple factors and assess their impact on user retention rate. Surprisingly, we find that the degree to which the bot embodies the roles it plays has limited influence on retention rates, while the length of each turn it speaks significantly affects retention rates. This study sheds light on the critical aspects of user engagement with role-playing models and provides valuable insights for future improvements in the development of large language models for role-playing purposes.


title: Neighborhood-Enhanced Supervised Contrastive Learning for Collaborative Filtering

abstract: While effective in recommendation tasks, collaborative filtering (CF) techniques face the challenge of data sparsity. Researchers have begun leveraging contrastive learning to introduce additional self-supervised signals to address this. However, this approach often unintentionally distances the target user/item from their collaborative neighbors, limiting its efficacy. In response, we propose a solution that treats the collaborative neighbors of the anchor node as positive samples within the final objective loss function. This paper focuses on developing two unique supervised contrastive loss functions that effectively combine supervision signals with contrastive loss. We analyze our proposed loss functions through the gradient lens, demonstrating that different positive samples simultaneously influence updating the anchor node's embeddings. These samples' impact depends on their similarities to the anchor node and the negative samples. Using the graph-based collaborative filtering model as our backbone and following the same data augmentation methods as the existing contrastive learning model SGL, we effectively enhance the performance of the recommendation model. Our proposed Neighborhood-Enhanced Supervised Contrastive Loss (NESCL) model substitutes the contrastive loss function in SGL with our novel loss function, showing marked performance improvement. On three real-world datasets, Yelp2018, Gowalla, and Amazon-Book, our model surpasses the original SGL by 10.09%, 7.09%, and 35.36% on NDCG@20, respectively.


title: Fokker-Planck equations on homogeneous Lie groups and probabilistic counterparts

abstract: The well-posedness of Fokker-Planck equations defined on homogeneous Lie groups and the properties of diffusion processes associated with such equations are addressed. The main difficulty arises from the polynomial growth of the coefficients, which is related to the growth of the family of vector fields generating the first layer of the associated Lie algebra. We prove that the Fokker-Planck equation has a unique energy solution, which we can represent as the transition density of the underlying subelliptic diffusion process. Moreover, we show its Holder continuity in time, where the Holder seminorm depends on the degree of homogeneity of the vector fields. Finally, we provide a probabilistic proof of the Feyman-Kac formula, also as a consequence of the uniform boundedness in finite time intervals of all moments.


title: Advancing Translation Preference Modeling with RLHF: A Step Towards Cost-Effective Solution

abstract: Faithfulness, expressiveness, and elegance is the constant pursuit in machine translation. However, traditional metrics like \textit{BLEU} do not strictly align with human preference of translation quality. In this paper, we explore leveraging reinforcement learning with human feedback (\textit{RLHF}) to improve translation quality. It is non-trivial to collect a large high-quality dataset of human comparisons between translations, especially for low-resource languages. To address this issue, we propose a cost-effective preference learning strategy, optimizing reward models by distinguishing between human and machine translations. In this manner, the reward model learns the deficiencies of machine translation compared to human and guides subsequent improvements in machine translation. Experimental results demonstrate that \textit{RLHF} can effectively enhance translation quality and this improvement benefits other translation directions not trained with \textit{RLHF}. Further analysis indicates that the model's language capabilities play a crucial role in preference learning. A reward model with strong language capabilities can more sensitively learn the subtle differences in translation quality and align better with real human translation preferences.


title: Measuring Privacy Loss in Distributed Spatio-Temporal Data

abstract: Statistics about traffic flow and people's movement gathered from multiple geographical locations in a distributed manner are the driving force powering many applications, such as traffic prediction, demand prediction, and restaurant occupancy reports. However, these statistics are often based on sensitive location data of people, and hence privacy has to be preserved while releasing them. The standard way to do this is via differential privacy, which guarantees a form of rigorous, worst-case, person-level privacy. In this work, motivated by several counter-intuitive features of differential privacy in distributed location applications, we propose an alternative privacy loss against location reconstruction attacks by an informed adversary. Our experiments on real and synthetic data demonstrate that our privacy loss better reflects our intuitions on individual privacy violation in the distributed spatio-temporal setting.


title: Holographic Inflation, Primordial Black Holes and Early Structure Formation

abstract: Evidence has accumulated that there are supermassive black holes (SMBHs) in the centers of most galaxies, and that these were formed in the very early universe by some as yet unknown process. In particular, there is evidence [15] that at least some galaxies formed as early as $10^8$ to $10^9$ years after the Big Bang host SMBHs. We suggest that the holographic model of inflation, whose dark matter candidates are primordial black holes carrying a discrete gauge charge, which originated as a small subset of the inflationary horizon volumes in the very early universe, can provide the seeds for this early structure formation. Aspects of the model pointed out long ago suggested an early era of structure formation, with structures dominated by dark matter. The additional assumption that the dark matter consists of discretely charged black holes implies black hole dominance of early structures, which seems to be implied by JWST data.

categories: hep-th astro-ph.CO astro-ph.GA gr-qc hep-ph


title: Signed-Perturbed Sums Estimation of ARX Systems: Exact Coverage and Strong Consistency (Extended Version)

abstract: Sign-Perturbed Sums (SPS) is a system identification method that constructs confidence regions for the unknown system parameters. In this paper, we study SPS for ARX systems, and establish that the confidence regions are guaranteed to include the true model parameter with exact, user-chosen, probability under mild statistical assumptions, a property that holds true for any finite number of observed input-output data. Furthermore, we prove the strong consistency of the method, that is, as the number of data points increases, the confidence region gets smaller and smaller and will asymptotically almost surely exclude any parameter value different from the true one. In addition, we also show that, asymptotically, the SPS region is included in an ellipsoid which is marginally larger than the confidence ellipsoid obtained from the asymptotic theory of system identification. The results are theoretically proven and illustrated in a simulation example.


title: Bailey pairs, radial limits of $q$-hypergeometric false theta functions, and a conjecture of Hikami

abstract: In the first part of this paper we prove a conjecture of Hikami on the values of the radial limits of a family of $q$-hypergeometric false theta functions. Hikami conjectured that the radial limits are obtained by evaluating a truncated version of the series. He proved a special case of his conjecture by computing the Kashaev invariant of certain torus links in two different ways. We prove the full conjecture using Bailey pairs. In the second part of the paper we show how the framework of Bailey pairs leads to further results of this type.


title: Efficient Multimodal Learning from Data-centric Perspective

abstract: Multimodal Large Language Models (MLLMs) have demonstrated notable capabilities in general visual understanding and reasoning tasks. However, their deployment is hindered by substantial computational costs in both training and inference, limiting accessibility to the broader research and user communities. A straightforward solution is to leverage smaller pre-trained vision and language models, which inevitably cause significant performance drops. In this paper, we demonstrate the possibility of training a smaller but better MLLM with high-quality training data. Specifically, we introduce Bunny, a family of lightweight MLLMs with flexible vision and language backbones for efficient multimodal learning from selected training data. Experiments show that our Bunny-4B/8B outperforms the state-of-the-art large MLLMs on multiple benchmarks. We expect that this work can provide the community with a clean and flexible open-source tool for further research and development. The code, models, and data can be found in https://github.com/BAAI-DCAI/Bunny.


title: Computational complexity of the Weisfeiler-Leman dimension

abstract: The Weisfeiler-Leman dimension of a graph $G$ is the least number $k$ such that the $k$-dimensional Weisfeiler-Leman algorithm distinguishes $G$ from every other non-isomorphic graph. The dimension is a standard measure of the descriptive complexity of a graph and recently finds various applications in particular in the context of machine learning. In this paper, we study the computational complexity of computing the Weisfeiler-Leman dimension. We observe that in general the problem of deciding whether the Weisfeiler-Leman dimension of $G$ is at most $k$ is NP-hard. This is also true for the more restricted problem with graphs of color multiplicity at most 4. Therefore, we study parameterized and approximate versions of the problem. We give, for each fixed $k\geq 2$, a polynomial-time algorithm that decides whether the Weisfeiler-Leman dimension of a given graph of color multiplicity at most $5$ is at most $k$. Moreover, we show that for these color multiplicities this is optimal in the sense that this problem is P-hard under logspace-uniform $\text{AC}_0$-reductions. Furthermore, for each larger bound $c$ on the color multiplicity and each fixed $k \geq 2$, we provide a polynomial-time approximation algorithm for the abelian case: given a relational structure with abelian color classes of size at most $c$, the algorithm outputs either that its Weisfeiler-Leman dimension is at most $(k+1)c$ or that it is larger than $k$.


title: Chain-of-Instructions: Compositional Instruction Tuning on Large Language Models

abstract: Fine-tuning large language models (LLMs) with a collection of large and diverse instructions has improved the model's generalization to different tasks, even for unseen tasks. However, most existing instruction datasets include only single instructions, and they struggle to follow complex instructions composed of multiple subtasks. In this work, we propose a novel concept of compositional instructions called chain-of-instructions (CoI), where the output of one instruction becomes an input for the next like a chain. Unlike the conventional practice of solving single instruction tasks, our proposed method encourages a model to solve each subtask step by step until the final answer is reached. CoI-tuning (i.e., fine-tuning with CoI instructions) improves the model's ability to handle instructions composed of multiple subtasks as well as unseen composite tasks such as multilingual summarization. Overall, our study find that simple CoI tuning of existing instruction data can provide consistent generalization to solve more complex, unseen, and longer chains of instructions.


title: Randomness-Efficient Constructions of Capacity-Achieving List-Decodable Codes

abstract: We wish to generate list-decodable codes over small alphabets using as little randomness as possible. Specifically, we hope to generate codes achieving what we term the Elias bound, which means that they are $(\rho,L)$-list-decodable with rate $R \geq 1-h(\rho)-O(1/L)$. A long line of work shows that uniformly random linear codes (RLCs) achieve the Elias bound: hence, we know $O(n^2)$ random bits suffice. Prior works demonstrate that just $O(Ln)$ random bits suffice, via puncturing of low-bias codes. These recent constructions are combinatorial. We provide two new constructions, which are algebraic. Compared to prior works, our constructions are simpler and more direct. Furthermore, our codes are designed in such a way that their duals are also quite easy to analyze. Our first construction -- which can be seen as a generalization of the Wozencraft ensemble -- achieves the Elias bound and consumes $Ln$ random bits. Additionally, its dual code achieves the GV-bound with high probability, and both the primal and dual admit quasilinear-time encoding algorithms. The second construction consumes $2nL$ random bits and yields a code where both it and its dual achieve the Elias bound. As we discuss, properties of a dual code are often crucial for applications in cryptography. In all of the above cases -- including the prior works achieving randomness complexity $O(Ln)$ -- the codes are designed to "approximate" RLCs. Namely, for a given locality parameter $L$ we construct codes achieving the same $L$-local properties as RLCs. This allows one to appeal to known list-decodability results for RLCs and thereby conclude that the code approximating an RLC also achieves the Elias bound. As a final contribution, we indicate that such a proof strategy is inherently unable to generate list-decodable codes of rate $R$ over $\mathbb F_q$ with less than $L(1-R)n\log_2(q)$ bits of randomness.


title: PreAct: Predicting Future in ReAct Enhances Agent's Planning Ability

abstract: Addressing the discrepancies between predictions and actual outcomes often aids individuals in expanding their thought processes and engaging in reflection, thereby facilitating reasoning in the correct direction. In this paper, we introduce $\textbf{PreAct}$, an agent framework that integrates $\textbf{pre}$diction with $\textbf{rea}$soning and $\textbf{act}$ion. Leveraging the information provided by predictions, a large language model (LLM) based agent can offer more diversified and strategically oriented reasoning, which in turn leads to more effective actions that help the agent complete complex tasks. Our experiments demonstrate that PreAct outperforms the ReAct approach in accomplishing complex tasks and that PreAct can be co-enhanced when combined with Reflexion methods. We prompt the model with different numbers of historical predictions and find that historical predictions have a sustained positive effect on LLM planning. The differences in single-step reasoning between PreAct and ReAct show that PreAct indeed offers advantages in terms of diversity and strategic directivity over ReAct.


title: Bayesian uncertainty quantification on nuclear level density data and their impact on $(p,\gamma)$ reactions of astrophysical interest

abstract: The $p$ process nucleosynthesis is responsible for the synthesis of 35 neutron-deficient nuclei from $^{35}$Se to $^{196}$Hg. An important input that can affect the modeling of this process is the nuclear level density at the relevant excitation energies of the nuclei involved in the reaction network. The OSLO method has been extensively used for the measurement of level densities in excitation energies of several MeV. In this work, Bayesian optimization has been used in order to estimate the 95% high density intervals for the parameters of two level density models optimized on the OSLO data. These uncertainties are then propagated on the cross sections of $(p,\gamma)$ reactions leading to the compound nuclei $^{105,106}$Pd and $^{105,106}$Cd inside the astrophysically relevant energy range. Imposing constraints in this region of the isotopic chart is important for network calculations involving the nearby $p$ nuclei $^{102}$Pd and $^{106}$Cd. We discuss the reduction of the range of cross sections due to the uncertainties arising from the level density data compared to the range of the six default level density models available in TALYS and we highlight the need for level density data inside the astrophysically relevant energy ranges.


title: Hausdorff measure estimates for the degenerate quenching problem

abstract: We study analytical and geometric properties of minimizers of non-differentiable functionals epitomizing the degenerate quenching problem. Our main finding unveils finite $(n-1)-$Hausdorff measure estimates for the pertaining free boundaries. The approach hinges upon deriving optimal gradient decay estimates, coupled with a fine analysis of an intrinsic auxiliary equation stripped of the singularity.


title: Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning

abstract: Through pretraining on a corpus with various sources, Large Language Models (LLMs) have gained impressive performance. However, the impact of each component of the pretraining corpus remains opaque. As a result, the organization of the pretraining corpus is still empirical and may deviate from the optimal. To address this issue, we systematically analyze the impact of 48 datasets from 5 major categories of pretraining data of LLMs and measure their impacts on LLMs using benchmarks about nine major categories of model capabilities. Our analyses provide empirical results about the contribution of multiple corpora on the performances of LLMs, along with their joint impact patterns, including complementary, orthogonal, and correlational relationships. We also identify a set of ``high-impact data'' such as Books that is significantly related to a set of model capabilities. These findings provide insights into the organization of data to support more efficient pretraining of LLMs.


title: PASCL: Supervised Contrastive Learning with Perturbative Augmentation for Particle Decay Reconstruction

abstract: In high-energy physics, particles produced in collision events decay in a format of a hierarchical tree structure, where only the final decay products can be observed using detectors. However, the large combinatorial space of possible tree structures makes it challenging to recover the actual decay process given a set of final particles. To better analyse the hierarchical tree structure, we propose a graph-based deep learning model to infer the tree structure to reconstruct collision events. In particular, we use a compact matrix representation termed as lowest common ancestor generations (LCAG) matrix, to encode the particle decay tree structure. Then, we introduce a perturbative augmentation technique applied to node features, aiming to mimic experimental uncertainties and increase data diversity. We further propose a supervised graph contrastive learning algorithm to utilize the information of inter-particle relations from multiple decay processes. Extensive experiments show that our proposed supervised graph contrastive learning with perturbative augmentation (PASCL) method outperforms state-of-the-art baseline models on an existing physics-based dataset, significantly improving the reconstruction accuracy. This method provides a more effective training strategy for models with the same parameters and makes way for more accurate and efficient high-energy particle physics data analysis.


title: Zagier-Hoffman's conjectures in positive characteristic II

abstract: Zagier-Hoffman's conjectures predict the dimension and a basis for the $\mathbb Q$-vector spaces spanned by $N$th cyclotomic multiple zeta values (MZV's) of fixed weight where $N$ is a natural number. For $N=1$ (MZV's case), half of these conjectures have been solved by the work of Terasoma, Deligne-Goncharov and Brown with the help of Zagier's identity. The other half are completely open. For $N=2$ (alternating MZV's case) and $N=3,4,8$, Deligne-Goncharov and Deligne solved the same half of these conjectures for $N$th-cyclotomic MZV's. For other values of $N$, no sharp upper bound on the dimension is known. In this paper we completely establish, for all $N$, Zagier-Hoffman's conjectures for $N$th cyclotomic multiple zeta values in positive characteristic. By working with the tower of all cyclotomic extensions, we present a proof that is uniform on $N$ and give an effective algorithm to express any cyclotomic multiple zeta value in the chosen basis. This generalizes all previous work on these conjectures for MZV's and alternating MZV's in positive characteristic.


title: CPN: Complementary Proposal Network for Unconstrained Text Detection

abstract: Existing methods for scene text detection can be divided into two paradigms: segmentation-based and anchor-based. While Segmentation-based methods are well-suited for irregular shapes, they struggle with compact or overlapping layouts. Conversely, anchor-based approaches excel for complex layouts but suffer from irregular shapes. To strengthen their merits and overcome their respective demerits, we propose a Complementary Proposal Network (CPN) that seamlessly and parallelly integrates semantic and geometric information for superior performance. The CPN comprises two efficient networks for proposal generation: the Deformable Morphology Semantic Network, which generates semantic proposals employing an innovative deformable morphological operator, and the Balanced Region Proposal Network, which produces geometric proposals with pre-defined anchors. To further enhance the complementarity, we introduce an Interleaved Feature Attention module that enables semantic and geometric features to interact deeply before proposal generation. By leveraging both complementary proposals and features, CPN outperforms state-of-the-art approaches with significant margins under comparable computation cost. Specifically, our approach achieves improvements of 3.6%, 1.3% and 1.0% on challenging benchmarks ICDAR19-ArT, IC15, and MSRA-TD500, respectively. Code for our method will be released.


title: Large Language Models Can Better Understand Knowledge Graphs Than We Thought

abstract: As the parameter scale of large language models (LLMs) grows, jointly training knowledge graph (KG) embeddings with model parameters to enhance LLM capabilities becomes increasingly costly. Consequently, the community has shown interest in developing prompt strategies that effectively integrate KG information into LLMs. However, the format for incorporating KGs into LLMs lacks standardization; for instance, KGs can be transformed into linearized triples or natural language (NL) text. Current prompting methods often rely on a trial-and-error approach, leaving researchers with an incomplete understanding of which KG input format best facilitates LLM comprehension of KG content. To elucidate this, we design a series of experiments to explore LLMs' understanding of different KG input formats within the context of prompt engineering. Our analysis examines both literal and attention distribution levels. Through extensive experiments, we indicate a counter-intuitive phenomenon: when addressing fact-related questions, unordered linearized triples are more effective for LLMs' understanding of KGs compared to fluent NL text. Furthermore, noisy, incomplete, or marginally relevant subgraphs can still enhance LLM performance. Finally, different LLMs have distinct preferences for different formats of organizing unordered triples.


title: Question Answering Over Spatio-Temporal Knowledge Graph

abstract: Spatio-temporal knowledge graphs (STKGs) extend the concept of knowledge graphs (KGs) by incorporating time and location information. While the research community's focus on Knowledge Graph Question Answering (KGQA), the field of answering questions incorporating both spatio-temporal information based on STKGs remains largely unexplored. Furthermore, a lack of comprehensive datasets also has hindered progress in this area. To address this issue, we present STQAD, a dataset comprising 10,000 natural language questions for spatio-temporal knowledge graph question answering (STKGQA). Unfortunately, various state-of-the-art KGQA approaches fall far short of achieving satisfactory performance on our dataset. In response, we propose STCQA, a new spatio-temporal KGQA approach that utilizes a novel STKG embedding method named STComplEx. By extracting temporal and spatial information from a question, our QA model can better comprehend the question and retrieve accurate answers from the STKG. Through extensive experiments, we demonstrate the quality of our dataset and the effectiveness of our STKGQA method.


title: Enhancing Energy Sector Resilience: Integrating Security by Design Principles

abstract: Security by design, Sbd is a concept for developing and maintaining systems that are, to the greatest extent possible, free from security vulnerabilities and impervious to security attacks. In addition to technical aspects, such as how to develop a robust industrial control systems hardware, software, communication product, etc., SbD includes also soft aspects, such as organizational managerial attitude and behavior, and employee awareness. Under the Sbd concept, systems, ICS in our context, will be considered more trustworthy by users. User's trust in the systems will be derived from the meticulous adherence to the SbD processes and policies. In accordance with the SbD concept, security is considered. Security measures are implemented, at every stage of the product and systems development life cycle, rather than afterwards. This document presents the security requirements for the implementation of the SbD in industrial control systems. The information presented does not negate any existing security and cyber security standards, etc. Instead, we strongly recommend that organizations should implement and comply with those standards and best practices. Security by design is not a one-time process. It starts at the very beginning of the products of the system design and continues through all its lifecycle. Due to the benefits of the SbD, higher level of security, and robustness to cyber attacks, all organizations associated with the energy sector should strive to establish an ecosystem. The requirements presented in this document may be perceived as burdensome by organizations. However, strict compliance with the requirements and existing security standards and best practices, including continuous monitoring, as specified in this document, is essential to realize an ecosystem driven and protected by the SbD


title: On efficient normal bases over binary fields

abstract: Binary field extensions are fundamental to many applications, such as multivariate public key cryptography, code-based cryptography, and error-correcting codes. Their implementation requires a foundation in number theory and algebraic geometry and necessitates the utilization of efficient bases. The continuous increase in the power of computation, and the design of new (quantum) computers increase the threat to the security of systems and impose increasingly demanding encryption standards with huge polynomial or extension degrees. For cryptographic purposes or other common implementations of finite fields arithmetic, it is essential to explore a wide range of implementations with diverse bases. Unlike some bases, polynomial and Gaussian normal bases are well-documented and widely employed. In this paper, we explore other forms of bases of $\mathbb{F}_{2^n}$ over $\mathbb{F}_2$ to demonstrate efficient implementation of operations within different ranges. To achieve this, we leverage results on fast computations and elliptic periods introduced by Couveignes and Lercier, and subsequently expanded upon by Ezome and Sall. This leads to the establishment of new tables for efficient computation over binary fields.


title: High-order QMC nonconforming FEMs for nearly incompressible planar stochastic elasticity equations

abstract: In a recent work (Dick et al, arXiv:2310.06187), we considered a linear stochastic elasticity equation with random Lam\'e parameters which are parameterized by a countably infinite number of terms in separate expansions. We estimated the expected values over the infinite dimensional parametric space of linear functionals ${\mathcal L}$ acting on the continuous solution $\vu$ of the elasticity equation. This was achieved by truncating the expansions of the random parameters, then using a high-order quasi-Monte Carlo (QMC) method to approximate the high dimensional integral combined with the conforming Galerkin finite element method (FEM) to approximate the displacement over the physical domain $\Omega.$ In this work, as a further development of aforementioned article, we focus on the case of a nearly incompressible linear stochastic elasticity equation. To serve this purpose, in the presence of stochastic inhomogeneous (variable Lam\'e parameters) nearly compressible material, we develop a new locking-free symmetric nonconforming Galerkin FEM that handles the inhomogeneity. In the case of nearly incompressible material, one known important advantage of nonconforming approximations is that they yield optimal order convergence rates that are uniform in the Poisson coefficient. Proving the convergence of the nonconforming FEM leads to another challenge that is summed up in showing the needed regularity properties of $\vu$. For the error estimates from the high-order QMC method, which is needed to estimate the expected value over the infinite dimensional parametric space of ${\mathcal L}\vu,$ we %rely on (Dick et al. 2022). We are required here to show certain regularity properties of $\vu$ with respect to the random coefficients. Some numerical results are delivered at the end.