title: Interventional Imbalanced Multi-Modal Representation Learning via $\beta$-Generalization Front-Door Criterion

abstract: Multi-modal methods establish comprehensive superiority over uni-modal methods. However, the imbalanced contributions of different modalities to task-dependent predictions constantly degrade the discriminative performance of canonical multi-modal methods. Based on the contribution to task-dependent predictions, modalities can be identified as predominant and auxiliary modalities. Benchmark methods raise a tractable solution: augmenting the auxiliary modality with a minor contribution during training. However, our empirical explorations challenge the fundamental idea behind such behavior, and we further conclude that benchmark approaches suffer from certain defects: insufficient theoretical interpretability and limited exploration capability of discriminative knowledge. To this end, we revisit multi-modal representation learning from a causal perspective and build the Structural Causal Model. Following the empirical explorations, we determine to capture the true causality between the discriminative knowledge of predominant modality and predictive label while considering the auxiliary modality. Thus, we introduce the $\beta$-generalization front-door criterion. Furthermore, we propose a novel network for sufficiently exploring multi-modal discriminative knowledge. Rigorous theoretical analyses and various empirical evaluations are provided to support the effectiveness of the innate mechanism behind our proposed method.


title: Freely Decaying Saffman Turbulence Experimentally Generated by Magnetic Stirrers

abstract: We investigate experimentally the decay of three-dimensional hydrodynamic turbulence, initially generated by the erratic motions of centimeter-size magnetic stirrers in a closed container. Such zero-mean-flow homogeneous isotropic turbulence is well suited to test Saffman's model and Batchelor's model of freely decaying turbulence. Here, we report a consistent set of experimental measurements (temporal decay of the turbulent kinetic energy, of the energy dissipation rate, and growth of the integral scale) strongly supporting the Saffman model. We also measure the conservation of the Saffman invariant at early times of the decay and show that the energy spectrum scales as $k^{2}$ at large scales and keeps its self-similar shape during the decay. This letter thus presents the first experimental evidence of the validity of the connection between the Saffman invariant and the $k^{2}$-energy spectrum of the large scales. The final decay regime closely corresponds to Saffman's model when the container size is sufficiently large.


title: Energy Reduction Opportunities in HDR Video Encoding

abstract: This paper investigates the energy consumption of video encoding for high dynamic range videos. Specifically, we compare the energy consumption of the compression process using 10-bit input sequences, a tone-mapped 8-bit input sequence at 10-bit internal bit depth, and encoding an 8-bit input sequence using an encoder with an internal bit depth of 8 bit. We find that linear scaling of the luminance and chrominance values leads to degradations of the visual quality, but that significant encoding complexity and thus encoding energy can be saved. An important reason for this is the availability of vector instructions, which are not available for the 10-bit encoder. Furthermore, we find that at sufficiently low target bitrates, the compression efficiency at an internal bit depth of 8 bit exceeds the compression efficiency of regular 10-bit encoding.


title: Two-point Equidistant Projection and Degree-of-interest Filtering for Smooth Exploration of Geo-referenced Networks

abstract: The visualization and interactive exploration of geo-referenced networks poses challenges if the network's nodes are not evenly distributed. Our approach proposes new ways of realizing animated transitions for exploring such networks from an ego-perspective. We aim to reduce the required screen estate while maintaining the viewers' mental map of distances and directions. A preliminary study provides first insights of the comprehensiveness of animated geographic transitions regarding directional relationships between start and end point in different projections. Two use cases showcase how ego-perspective graph exploration can be supported using less screen space than previous approaches.


title: Enabling Ab-Initio Molecular Dynamics under Bias: The CP2K+SMEAGOL Interface for Integrating Density Functional Theory and Non-Equilibrium Green Functions

abstract: Density functional theory (DFT) combined with non-equilibrium Greens functions (NEGF) is a powerful approach to model quantum transport under external bias potentials, at reasonable computational cost. In this work we present a new interface between the popular mixed Gaussian/plane wave electronic structure package CP2K and the NEGF code SMEAGOL, the most feature-rich implementation of DFT-NEGF available for CP2K to-date. The CP2K+SMEAGOL interface includes the implementation of current induced forces. We verify this implementation for a variety of systems: an infinite 1D Au wire, a parallel-plate capacitor and a Au-H2-Au junction. We find good agreement with SMEAGOL calculations performed with SIESTA for the same systems, and with the example of a solvated Au wire demonstrate for the first time that DFT-NEGF can be used to perform molecular dynamics simulations under bias of large-scale condensed phase systems under realistic operating conditions.


title: Online Context Learning for Socially-compliant Navigation

abstract: Robot social navigation needs to adapt to different human factors and environmental contexts. However, since these factors and contexts are difficult to predict and cannot be exhaustively enumerated, traditional learning-based methods have difficulty in ensuring the social attributes of robots in long-term and cross-environment deployments. This letter introduces an online context learning method that aims to empower robots to adapt to new social environments online. The proposed method adopts a two-layer structure. The bottom layer is built using a deep reinforcement learning-based method to ensure the output of basic robot navigation commands. The upper layer is implemented using an online robot learning-based method to socialize the control commands suggested by the bottom layer. Experiments using a community-wide simulator show that our method outperforms the state-of-the-art ones. Experimental results in the most challenging scenarios show that our method improves the performance of the state-of-the-art by 8%. The source code of the proposed method, the data used, and the tools for the per-training step will be publicly available at https://github.com/Nedzhaken/SOCSARL-OL.


title: Decentralized Collaborative Pricing and Shunting for Multiple EV Charging Stations Based on Multi-Agent Reinforcement Learning

abstract: The extraordinary electric vehicle (EV) popularization in the recent years has facilitated research studies in alleviating EV energy charging demand. Previous studies primarily focused on the optimizations over charging stations (CS) profit and EV users cost savings through charge/discharge scheduling events. In this work, the random behaviors of EVs are considered, with EV users preferences over multi-CS characteristics modelled to imitate the potential CS selection disequilibrium. A price scheduling strategy under decentralized collaborative framework is proposed to achieve EV shunting in a multi-CS environment, while minimizing the charging cost through multi agent reinforcement learning. The proposed problem is formulated as a Markov Decision Process (MDP) with uncertain transition probability.


title: CrAM: Credibility-Aware Attention Modification in LLMs for Combating Misinformation in RAG

abstract: Retrieval-Augmented Generation (RAG) can alleviate hallucinations of Large Language Models (LLMs) by referencing external documents. However, the misinformation in external documents may mislead LLMs' generation. To address this issue, we explore the task of "credibility-aware RAG", in which LLMs automatically adjust the influence of retrieved documents based on their credibility scores to counteract misinformation. To this end, we introduce a plug-and-play method named $\textbf{Cr}$edibility-aware $\textbf{A}$ttention $\textbf{M}$odification (CrAM). CrAM identifies influential attention heads in LLMs and adjusts their attention weights based on the credibility of the documents, thereby reducing the impact of low-credibility documents. Experiments on Natual Questions and TriviaQA using Llama2-13B, Llama3-8B, and Qwen-7B show that CrAM improves the RAG performance of LLMs against misinformation pollution by over 20%, even surpassing supervised fine-tuning methods.


title: Energy efficiency: a Lattice Boltzmann study

abstract: The energy consumption and the compute performance of a fluid dynamic code have been investigated varying parallelization approach, arithmetic precision and clock speed. The code is based on a Lattice Boltzmann approximation, is written in Fortran and was executed on high-end GPUs of Leonardo Booster supercomputer. Tests were conducted on single server nodes (up to 4 GPUs in parallel). Performance metrics like the number of operations per second and energy consumption are reported, to quantify how smart coding approach and system adjustment can contribute to reduction of energy footprint while keeping the scientific throughput almost unaltered or with acceptable level of degradation. Results indicate that this application can be executed with 20% of energy saving and reduced thermal stress, at the cost of 5% more computing time. The paper presents preliminary conclusions, as it is a first step of a larger study dedicated to energy efficiency at scale.


title: Random Leja points

abstract: Leja points on a compact $K \subset \mathbb{C}$ are known to provide efficient points for interpolation, but their actual implementation can be computationally challenging. So-called pseudo Leja points are a more tractable solution, yet they require a tailored implementation to the compact at hand. We introduce several more flexible random alternatives, starting from a new family we call random Leja points. To make them tractable, we propose an approximate version which relies on the Metropolis-Hastings algorithm with the uniform measure. We also analyse a different family of points inspired by recently introduced randomised admissible meshes, obtained by uniform sampling. When the number of iterations or drawn points is appropriately chosen, we establish that the two resulting families of points provide good points for interpolation. That is, they almost surely lead to convergent interpolating polynomials for holomorphic functions. The two last families of points are readily implemented assuming one knows how to sample uniformly at random in $K$. These makes them more modular than competing deterministic methods. We run numerical experiments to compare the proposed methods in terms of accuracy and computational complexity, for various types of compact sets.


title: ESI-GAL: EEG Source Imaging-based Kinematics Parameter Estimation for Grasp and Lift Task

abstract: Objective: Electroencephalogram (EEG) signals-based motor kinematics prediction (MKP) has been an active area of research to develop brain-computer interface (BCI) systems such as exosuits, prostheses, and rehabilitation devices. However, EEG source imaging (ESI) based kinematics prediction is sparsely explored in the literature. Approach: In this study, pre-movement EEG features are utilized to predict three-dimensional (3D) hand kinematics for the grasp-and-lift motor task. A public dataset, WAY-EEG-GAL, is utilized for MKP analysis. In particular, sensor-domain (EEG data) and source-domain (ESI data) based features from the frontoparietal region are explored for MKP. Deep learning-based models are explored to achieve efficient kinematics decoding. Various time-lagged and window sizes are analyzed for hand kinematics prediction. Subsequently, intra-subject and inter-subject MKP analysis is performed to investigate the subject-specific and subject-independent motor-learning capabilities of the neural decoders. The Pearson correlation coefficient (PCC) is used as the performance metric for kinematics trajectory decoding. Main results: The rEEGNet neural decoder achieved the best performance with sensor-domain and source-domain features with the time lag and window size of 100 ms and 450 ms, respectively. The highest mean PCC values of 0.790, 0.795, and 0.637 are achieved using sensor-domain features, while 0.769, 0.777, and 0.647 are achieved using source-domain features in x, y, and z-directions, respectively. Significance: This study explores the feasibility of trajectory prediction using EEG sensor-domain and source-domain EEG features for the grasp-and-lift task. Furthermore, inter-subject trajectory estimation is performed using the proposed deep learning decoder with EEG source domain features.


title: Teleporter Theory: A General and Simple Approach for Modeling Cross-World Counterfactual Causality

abstract: Leveraging the development of structural causal model (SCM), researchers can establish graphical models for exploring the causal mechanisms behind machine learning techniques. As the complexity of machine learning applications rises, single-world interventionism causal analysis encounters theoretical adaptation limitations. Accordingly, cross-world counterfactual approach extends our understanding of causality beyond observed data, enabling hypothetical reasoning about alternative scenarios. However, the joint involvement of cross-world variables, encompassing counterfactual variables and real-world variables, challenges the construction of the graphical model. Twin network is a subtle attempt, establishing a symbiotic relationship, to bridge the gap between graphical modeling and the introduction of counterfactuals albeit with room for improvement in generalization. In this regard, we demonstrate the theoretical breakdowns of twin networks in certain cross-world counterfactual scenarios. To this end, we propose a novel teleporter theory to establish a general and simple graphical representation of counterfactuals, which provides criteria for determining teleporter variables to connect multiple worlds. In theoretical application, we determine that introducing the proposed teleporter theory can directly obtain the conditional independence between counterfactual variables and real-world variables from the cross-world SCM without requiring complex algebraic derivations. Accordingly, we can further identify counterfactual causal effects through cross-world symbolic derivation. We demonstrate the generality of the teleporter theory to the practical application. Adhering to the proposed theory, we build a plug-and-play module, and the effectiveness of which are substantiated by experiments on benchmarks.


title: The Optical Design Concept for the Atacama Large Aperture Submillimeter Telescope (AtLAST)

abstract: The Atacama Large Aperture Submillimeter Telescope (AtLAST) aims to be the premier next generation large diameter (50-meter) single dish observatory capable of observations across the millimeter/sub-millimeter spectrum, from 30 to 950~GHz. The large primary mirror diameter, the 2-degree field of view and its large 4.7-meter focal surface give AtLAST a high throughput (aperture size times field of view) and grasp (throughput times spectral reach), with the ability to illuminate $>\mathcal{O}(10^7)$ detectors. The optical design concept for AtLAST consists of a numerically optimized two-mirror Ritchey-Chr\'etien system with an additional flat folding mirror, which enables a quick selection among its planned six instrument positions. We present the optical design concept and discuss the expected optical performance of AtLAST. We then present design concepts that can be implemented in the receiver and instrument optics to correct for astigmatism and mitigate the high degree of curvature of the focal surface in order to recover significant fractions of the geometric field of view at sub-millimeter wavelengths.


title: GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generation

abstract: Large language models have seen widespread adoption in math problem-solving. However, in geometry problems that usually require visual aids for better understanding, even the most advanced multi-modal models currently still face challenges in effectively using image information. High-quality data is crucial for enhancing the geometric capabilities of multi-modal models, yet existing open-source datasets and related efforts are either too challenging for direct model learning or suffer from misalignment between text and images. To overcome this issue, we introduce a novel pipeline that leverages GPT-4 and GPT-4V to generate relatively basic geometry problems with aligned text and images, facilitating model learning. We have produced a dataset of 4.9K geometry problems and combined it with 19K open-source data to form our GeoGPT4V dataset. Experimental results demonstrate that the GeoGPT4V dataset significantly improves the geometry performance of various models on the MathVista and MathVision benchmarks. The code is available at https://github.com/Lanyu0303/GeoGPT4V_Project


title: On the Feasibility of Fidelity$^-$ for Graph Pruning

abstract: As one of popular quantitative metrics to assess the quality of explanation of graph neural networks (GNNs), fidelity measures the output difference after removing unimportant parts of the input graph. Fidelity has been widely used due to its straightforward interpretation that the underlying model should produce similar predictions when features deemed unimportant from the explanation are removed. This raises a natural question: "Does fidelity induce a global (soft) mask for graph pruning?" To solve this, we aim to explore the potential of the fidelity measure to be used for graph pruning, eventually enhancing the GNN models for better efficiency. To this end, we propose Fidelity$^-$-inspired Pruning (FiP), an effective framework to construct global edge masks from local explanations. Our empirical observations using 7 edge attribution methods demonstrate that, surprisingly, general eXplainable AI methods outperform methods tailored to GNNs in terms of graph pruning performance.


title: Making Alice Appear Like Bob: A Probabilistic Preference Obfuscation Method For Implicit Feedback Recommendation Models

abstract: Users' interaction or preference data used in recommender systems carry the risk of unintentionally revealing users' private attributes (e.g., gender or race). This risk becomes particularly concerning when the training data contains user preferences that can be used to infer these attributes, especially if they align with common stereotypes. This major privacy issue allows malicious attackers or other third parties to infer users' protected attributes. Previous efforts to address this issue have added or removed parts of users' preferences prior to or during model training to improve privacy, which often leads to decreases in recommendation accuracy. In this work, we introduce SBO, a novel probabilistic obfuscation method for user preference data designed to improve the accuracy--privacy trade-off for such recommendation scenarios. We apply SBO to three state-of-the-art recommendation models (i.e., BPR, MultVAE, and LightGCN) and two popular datasets (i.e., MovieLens-1M and LFM-2B). Our experiments reveal that SBO outperforms comparable approaches with respect to the accuracy--privacy trade-off. Specifically, we can reduce the leakage of users' protected attributes while maintaining on-par recommendation accuracy.


title: Embedded Hierarchical MPC for Autonomous Navigation

abstract: To efficiently deploy robotic systems in society, mobile robots need to autonomously and safely move through complex environments. Nonlinear model predictive control (MPC) methods provide a natural way to find a dynamically feasible trajectory through the environment without colliding with nearby obstacles. However, the limited computation power available on typical embedded robotic systems, such as quadrotors, poses a challenge to running MPC in real-time, including its most expensive tasks: constraints generation and optimization. To address this problem, we propose a novel hierarchical MPC scheme that interconnects a planning and a tracking layer. The planner constructs a trajectory with a long prediction horizon at a slow rate, while the tracker ensures trajectory tracking at a relatively fast rate. We prove that the proposed framework avoids collisions and is recursively feasible. Furthermore, we demonstrate its effectiveness in simulations and lab experiments with a quadrotor that needs to reach a goal position in a complex static environment. The code is efficiently implemented on the quadrotor's embedded computer to ensure real-time feasibility. Compared to a state-of-the-art single-layer MPC formulation, this allows us to increase the planning horizon by a factor of 5, which results in significantly better performance.


title: Prior Normality Prompt Transformer for Multi-class Industrial Image Anomaly Detection

abstract: Image anomaly detection plays a pivotal role in industrial inspection. Traditional approaches often demand distinct models for specific categories, resulting in substantial deployment costs. This raises concerns about multi-class anomaly detection, where a unified model is developed for multiple classes. However, applying conventional methods, particularly reconstruction-based models, directly to multi-class scenarios encounters challenges such as identical shortcut learning, hindering effective discrimination between normal and abnormal instances. To tackle this issue, our study introduces the Prior Normality Prompt Transformer (PNPT) method for multi-class image anomaly detection. PNPT strategically incorporates normal semantics prompting to mitigate the "identical mapping" problem. This entails integrating a prior normality prompt into the reconstruction process, yielding a dual-stream model. This innovative architecture combines normal prior semantics with abnormal samples, enabling dual-stream reconstruction grounded in both prior knowledge and intrinsic sample characteristics. PNPT comprises four essential modules: Class-Specific Normality Prompting Pool (CS-NPP), Hierarchical Patch Embedding (HPE), Semantic Alignment Coupling Encoding (SACE), and Contextual Semantic Conditional Decoding (CSCD). Experimental validation on diverse benchmark datasets and real-world industrial applications highlights PNPT's superior performance in multi-class industrial anomaly detection.


title: Leveraging Cooperative Connected Automated Vehicles for Mixed Traffic Safety

abstract: The introduction of connected and automated vehicles (CAV) is believed to reduce congestion, enhance safety, and improve traffic efficiency. Numerous research studies have focused on controlling pure CAV platoons in fully connected automated traffic, as well as single or multiple CAVs in mixed traffic with human-driven vehicles (HVs). CAV cruising control designs have been proposed to stabilize the car-following traffic dynamics, but few studies has considered their safety impact, particularly the trade-offs between stability and safety. In this paper, we study how cooperative control strategies for CAVs can be designed to enhance the safety and smoothness of mixed traffic under varying penetrations of connectivity and automation. Considering mixed traffic where a pair of CAVs travels amongst HVs, we design cooperative feedback controllers for the pair CAVs to stabilize traffic via cooperation and, possibly, by also leveraging connectivity with HVs. The real-time safety impact of the CAV controllers is investigated using control barrier functions (CBF). We construct CBF safety constraints, based on which we propose safety-critical control designs to guarantee CAV safety, HV safety and platoon safety. Both theoretical and numerical analyses have been conducted to explore the effect of CAV cooperation and HV connectivity on stability and safety. Our results show that the cooperation of CAVs helps to stabilize the mixed traffic while safety can be guaranteed with the safety filters. Moreover, connectivity between CAVs and HVs offers additional benefits: if an HV connects to an upstream CAV (i.e., the CAV looks ahead), it helps the CAV to stabilize the upstream traffic, while if an HV connects to a downstream CAV (i.e., the CAV looks behind), the safety of this connected HV can be enhanced.


title: Reductions of path structures and classification of homogeneous structures in dimension three

abstract: In this paper we show that if a path structure has non-vanishing curvature at apoint then it has a canonical reduction to a Z/2Z-structure at a neighbourhood of thatpoint (in many cases it has a canonical parallelism). A simple implication of this resultis that the automorphism group of a non-flat path structure is of maximal dimensionthree (a result by Tresse of 1896). We also classify the invariant path structures onthree-dimensional Lie groups.


title: Rigidity of periodic points for loxodromic automorphisms of affine surfaces

abstract: We show that two automorphisms of an affine surface with dynamical degree strictly larger than 1 share a Zariski dense set of periodic points if and only if they have the same periodic points. We construct canonical heights for these automorphisms and use arithmetic equidistribution for adelic line bundles over quasiprojective varieties following the work of Yuan and Zhang. Finally, we extend the local arithmetic Hodge index theorem to a certain class of vertical adelic line bundles over quasiprojective varieties to conclude the proof.


title: Decentralized Credential Status Management: A Paradigm Shift in Digital Trust

abstract: Public key infrastructures are essential for Internet security, ensuring robust certificate management and revocation mechanisms. The transition from centralized to decentralized systems presents challenges such as trust distribution and privacy-preserving credential management. The transition from centralized to decentralized systems is motivated by addressing the single points of failure inherent in centralized systems and leveraging decentralized technologies' transparency and resilience. This paper explores the evolution of certificate status management from centralized to decentralized frameworks, focusing on blockchain technology and advanced cryptography. We provide a taxonomy of the challenges of centralized systems and discuss opportunities provided by existing decentralized technologies. Our findings reveal that, although blockchain technologies enhance security and trust distribution, they represent a bottleneck for parallel computation and face inefficiencies in cryptographic computations. For this reason, we propose a framework of decentralized technology components that addresses such shortcomings to advance the paradigm shift toward decentralized credential status management.


title: Asymptotic Behaviors of Moduli of One-dimensional Sheaves on Surfaces

abstract: In this paper, we study the asymptotic behaviors of the Betti numbers and Picard numbers of the moduli space $M_{\beta,\chi}$ of one-dimensional sheaves supported in a curve class $\beta$ on $S$ with Euler characteristic $\chi$. We determine the intersection cohomology Betti numbers of $M_{\beta,\chi}$ when $S$ is a del Pezzo surface and $\beta$ is sufficiently positive. As an application, we formulate a $P = C$ conjecture regarding the refined BPS invariants for local del Pezzo surfaces.


title: Structured Jet Model for Multiwavelength Observations of the Jetted Tidal Disruption Event AT 2022cmc

abstract: AT 2022cmc is a recently documented tidal disruption event (TDE) that exhibits a luminous jet, accompanied by fast-declining X-ray and long-lasting radio/millimeter emission. Motivated by the distinct spectral and temporal signatures between X-ray and radio observations, we propose a multizone model involving relativistic jets with different Lorentz factors. We systematically study the evolution of the faster and slower jets in an external density profile, considering the continuous energy injection rate associated with the time-dependent accretion rates before and after the mass fallback time. We investigate time-dependent multiwavelength emission from both the forward shock and reverse shock regions of the fast and slow jets, in a self-consistent manner. Our analysis demonstrates that the energy injection rate can significantly impact the jet evolution and subsequently influence the lightcurves. We find that the X-ray spectra and lightcurves can be described by the electron synchrotron emission from the reverse shock of the faster jet, in which the late-time X-ray upper limits, extending to 400 days after the disruption, could be interpreted as the jet break steepening. Meanwhile, the radio observations can be interpreted as a result of synchrotron emissions from the forward shock region of the slower jet. We also discuss prospects for testing the model with current and future observations.


title: Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMs

abstract: Large Language Models (LLMs) excel in various natural language processing tasks but struggle with hallucination issues. Existing solutions have considered utilizing LLMs' inherent reasoning abilities to alleviate hallucination, such as self-correction and diverse sampling methods. However, these methods often overtrust LLMs' initial answers due to inherent biases. The key to alleviating this issue lies in overriding LLMs' inherent biases for answer inspection. To this end, we propose a CounterFactual Multi-Agent Debate (CFMAD) framework. CFMAD presets the stances of LLMs to override their inherent biases by compelling LLMs to generate justifications for a predetermined answer's correctness. The LLMs with different predetermined stances are engaged with a skeptical critic for counterfactual debate on the rationality of generated justifications. Finally, the debate process is evaluated by a third-party judge to determine the final answer. Extensive experiments on four datasets of three tasks demonstrate the superiority of CFMAD over existing methods.


title: Obfuscating IoT Device Scanning Activity via Adversarial Example Generation

abstract: Nowadays, attackers target Internet of Things (IoT) devices for security exploitation, and search engines for devices and services compromise user privacy, including IP addresses, open ports, device types, vendors, and products.Typically, application banners are used to recognize IoT device profiles during network measurement and reconnaissance. In this paper, we propose a novel approach to obfuscating IoT device banners (BANADV) based on adversarial examples. The key idea is to explore the susceptibility of fingerprinting techniques to a slight perturbation of an IoT device banner. By modifying device banners, BANADV disrupts the collection of IoT device profiles. To validate the efficacy of BANADV, we conduct a set of experiments. Our evaluation results show that adversarial examples can spoof state-of-the-art fingerprinting techniques, including learning- and matching-based approaches. We further provide a detailed analysis of the weakness of learning-based/matching-based fingerprints to carefully crafted samples. Overall, the innovations of BANADV lie in three aspects: (1) it utilizes an IoT-related semantic space and a visual similarity space to locate available manipulating perturbations of IoT banners; (2) it achieves at least 80\% success rate for spoofing IoT scanning techniques; and (3) it is the first to utilize adversarial examples of IoT banners in network measurement and reconnaissance.


title: Tri-boson and WH production in the $\mathrm{W}^+\mathrm{W}^+\mathrm{j}\mathrm{j}$ channel: predictions at full NLO accuracy and beyond

abstract: In this work, we present the first full NLO predictions for the process $\mathrm{p}\mathrm{p}\to\mu^+\nu_\mu\mathrm{e}^+\nu_\mathrm{e}\mathrm{j}\mathrm{j}$ at the LHC in a typical tri-boson phase space. The NLO corrections reach 50% at the level of the fiducial cross section and have a very different hierarchy with respect to vector-boson-scattering phase spaces. By comparing the cross section of the full off-shell process with the sum of contributing on-shell electroweak-boson production subchannels, we find that the process is dominated by WWW and WH production, while vector-boson-scattering topologies still play a non-negligible role. In addition, NLO QCD predictions matched to parton shower which are supplemented by approximate electroweak corrections are provided. For the fiducial cross section, the electroweak corrections turn out to be small but the QCD corrections reach 47%. For the inclusive cross section, matching to parton shower affects the predictions by 7%. However, for differential distributions corrections due to the parton shower can be much more sizeable, depending on the region of phase space.


title: Revisiting Spurious Correlation in Domain Generalization

abstract: Without loss of generality, existing machine learning techniques may learn spurious correlation dependent on the domain, which exacerbates the generalization of models in out-of-distribution (OOD) scenarios. To address this issue, recent works build a structural causal model (SCM) to describe the causality within data generation process, thereby motivating methods to avoid the learning of spurious correlation by models. However, from the machine learning viewpoint, such a theoretical analysis omits the nuanced difference between the data generation process and representation learning process, resulting in that the causal analysis based on the former cannot well adapt to the latter. To this end, we explore to build a SCM for representation learning process and further conduct a thorough analysis of the mechanisms underlying spurious correlation. We underscore that adjusting erroneous covariates introduces bias, thus necessitating the correct selection of spurious correlation mechanisms based on practical application scenarios. In this regard, we substantiate the correctness of the proposed SCM and further propose to control confounding bias in OOD generalization by introducing a propensity score weighted estimator, which can be integrated into any existing OOD method as a plug-and-play module. The empirical results comprehensively demonstrate the effectiveness of our method on synthetic and large-scale real OOD datasets.


title: Second order asymptotics and uniqueness for self-similar profiles to a singular diffusion equation with gradient absorption

abstract: Solutions in self-similar form presenting finite time extinction to the singular diffusion equation with gradient absorption $$\partial_t u - \mathrm{div}(|\nabla u|^{p-2}\nabla u) +|\nabla u|^{q}=0 \qquad {\rm in} \ (0,\infty)\times\mathbb{R}^N$$ are studied when $N\geq1$ and the exponents $(p,q)$ satisfy $p_c=\frac{2N}{N+1}$, $p-1<q<\frac{p}{2}$. Existence and uniqueness of such a solution are established in dimension $N=1$. In dimension $N\geq2$, existence of radially symmetric self-similar solutions is proved and a fine description of their behavior as $|x|\to\infty$ is provided.


title: HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model

abstract: Foundation models (FMs) are revolutionizing the analysis and understanding of remote sensing (RS) scenes, including aerial RGB, multispectral, and SAR images. However, hyperspectral images (HSIs), which are rich in spectral information, have not seen much application of FMs, with existing methods often restricted to specific tasks and lacking generality. To fill this gap, we introduce HyperSIGMA, a vision transformer-based foundation model for HSI interpretation, scalable to over a billion parameters. To tackle the spectral and spatial redundancy challenges in HSIs, we introduce a novel sparse sampling attention (SSA) mechanism, which effectively promotes the learning of diverse contextual features and serves as the basic block of HyperSIGMA. HyperSIGMA integrates spatial and spectral features using a specially designed spectral enhancement module. In addition, we construct a large-scale hyperspectral dataset, HyperGlobal-450K, for pre-training, which contains about 450K hyperspectral images, significantly surpassing existing datasets in scale. Extensive experiments on various high-level and low-level HSI tasks demonstrate HyperSIGMA's versatility and superior representational capability compared to current state-of-the-art methods. Moreover, HyperSIGMA shows significant advantages in scalability, robustness, cross-modal transferring capability, and real-world applicability.


title: Operator Deep Smoothing for Implied Volatility

abstract: We devise a novel method for implied volatility smoothing based on neural operators. The goal of implied volatility smoothing is to construct a smooth surface that links the collection of prices observed at a specific instant on a given option market. Such price data arises highly dynamically in ever-changing spatial configurations, which poses a major limitation to foundational machine learning approaches using classical neural networks. While large models in language and image processing deliver breakthrough results on vast corpora of raw data, in financial engineering the generalization from big historical datasets has been hindered by the need for considerable data pre-processing. In particular, implied volatility smoothing has remained an instance-by-instance, hands-on process both for neural network-based and traditional parametric strategies. Our general operator deep smoothing approach, instead, directly maps observed data to smoothed surfaces. We adapt the graph neural operator architecture to do so with high accuracy on ten years of raw intraday S&P 500 options data, using a single set of weights. The trained operator adheres to critical no-arbitrage constraints and is robust with respect to subsampling of inputs (occurring in practice in the context of outlier removal). We provide extensive historical benchmarks and showcase the generalization capability of our approach in a comparison with SVI, an industry standard parametrization for implied volatility. The operator deep smoothing approach thus opens up the use of neural networks on large historical datasets in financial engineering.


title: Femtosecond laser upscaling strategy and biological validation for dental screws with improved osteogenic performance

abstract: Osseointegration is one of the key conditions for long term successful dental implantation. To this end, titanium alloys undergo plethora of surface treatments able to sustain osteogenic differentiation. For these surface treatments, femtosecond laser (FSL) can generate precise and reproducible surface patterns on titanium, avoiding thermal damage and chemical pollution. We recently identify that laser-induced periodic surface structure (LIPSS) with radial orientation, generated on model (flat) titanium surface, has a high osteogenic potential. However, nano-texturing is time consuming. In the present study, we aimed to reduce the texturing time of radial LIPSS, as well as processing of large commercially available dental screws by ways of laser beam engineering. Our objectives were to maintain at least osteogenic properties demonstrated on model surfaces by adjusting laser beam diameters and to demonstrate maintenance of performance with a dental screw texturing process not exceeding 1 minute.We first textured model surfaces with radial LIPSS by laser beams of different diameters, with surface impacts of 24$\mu$m, 80$\mu$m or 180$\mu$m, named as R24, R80 or R180 respectively. Osteogenic performance of human mesenchymal stem cells (hMSCs) were compared; seeded on polished control surfaces and textured surfaces and subjected to osteogenic evaluation by cell/matrix imaging, qRT-PCR and mineral deposition quantification. All textured surfaces showed greater osteogenic potential than the control surfaces, with significantly higher efficacy on R180 surface. Therefore, R180 pattern with large beam impacts was chosen for texturing on a dental screw and its osteogenic activity was compared to that of a non-textured screw. Interestingly, R180 required only 40 seconds to be textured on whole screws, on which it preserved a high osteogenic potential. Thus, by using FSL technology, we have improved the osteogenic potential of a topographic pattern while optimizing and scaling up its processing time on a medical device.


title: FullCert: Deterministic End-to-End Certification for Training and Inference of Neural Networks

abstract: Modern machine learning models are sensitive to the manipulation of both the training data (poisoning attacks) and inference data (adversarial examples). Recognizing this issue, the community has developed many empirical defenses against both attacks and, more recently, provable certification methods against inference-time attacks. However, such guarantees are still largely lacking for training-time attacks. In this work, we present FullCert, the first end-to-end certifier with sound, deterministic bounds, which proves robustness against both training-time and inference-time attacks. We first bound all possible perturbations an adversary can make to the training data under the considered threat model. Using these constraints, we bound the perturbations' influence on the model's parameters. Finally, we bound the impact of these parameter changes on the model's prediction, resulting in joint robustness guarantees against poisoning and adversarial examples. To facilitate this novel certification paradigm, we combine our theoretical work with a new open-source library BoundFlow, which enables model training on bounded datasets. We experimentally demonstrate FullCert's feasibility on two different datasets.


title: Guiding the Last Centimeter: Novel Anatomy-Aware Probe Servoing for Standardized Imaging Plane Navigation in Robotic Lung Ultrasound

abstract: Navigating the ultrasound (US) probe to the standardized imaging plane (SIP) for image acquisition is a critical but operator-dependent task in conventional freehand diagnostic US. Robotic US systems (RUSS) offer the potential to enhance imaging consistency by leveraging real-time US image feedback to optimize the probe pose, thereby reducing reliance on operator expertise. However, determining the proper approach to extracting generalizable features from the US images for probe pose adjustment remain challenging. In this work, we propose a SIP navigation framework for RUSS, exemplified in the context of robotic lung ultrasound (LUS). This framework facilitates automatic probe adjustment when in proximity to the SIP. This is achieved by explicitly extracting multiple anatomical features presented in real-time LUS images and performing non-patient-specific template matching to generate probe motion towards the SIP using image-based visual servoing (IBVS). This framework is further integrated with the active-sensing end-effector (A-SEE), a customized robot end-effector that leverages patient external body geometry to maintain optimal probe alignment with the contact surface, thus preserving US signal quality throughout the navigation. The proposed approach ensures procedural interpretability and inter-patient adaptability. Validation is conducted through anatomy-mimicking phantom and in-vivo evaluations involving five human subjects. The results show the framework's high navigation precision with the probe correctly located at the SIP for all cases, exhibiting positioning error of under 2 mm in translation and under 2 degree in rotation. These results demonstrate the navigation process's capability to accomondate anatomical variations among patients.


title: Explainable Artificial Intelligence and Multicollinearity : A Mini Review of Current Approaches

abstract: Explainable Artificial Intelligence (XAI) methods help to understand the internal mechanism of machine learning models and how they reach a specific decision or made a specific action. The list of informative features is one of the most common output of XAI methods. Multicollinearity is one of the big issue that should be considered when XAI generates the explanation in terms of the most informative features in an AI system. No review has been dedicated to investigate the current approaches to handle such significant issue. In this paper, we provide a review of the current state-of-the-art approaches in relation to the XAI in the context of recent advances in dealing with the multicollinearity issue. To do so, we searched in three repositories that are: Web of Science, Scopus and IEEE Xplore to find pertinent published papers. After excluding irrelevant papers, seven papers were considered in the review. In addition, we discuss the current XAI methods and their limitations in dealing with the multicollinearity and suggest future directions.


title: ELMO2EDS: Transforming Educational Credentials into Self-Sovereign Identity Paradigm

abstract: Digital credentials in education make it easier for students to apply for a course of study, a new job, or change a higher education institute. Academic networks, such as EMREX, support the exchange of digital credentials between students and education institutes. Students can fetch results from one educational institute and apply for a course of study at another educational institute. Digital signatures of the issuing institution can verify the authenticity of digital credentials. Each institution must provide the integration of EMREX using its identity management system. In this paper, we investigate how digital credentials can be integrated into the Self-Sovereign Identity ecosystem to overcome the known issues of academic networks. We examine known issues such as the authentication of students. Self-Sovereign Identity is a paradigm that gives individuals control of their digital identities. Based on our findings, we propose ELMO2EDS, a solution that 1) converts digital credentials from EMREX to a suitable Self-Sovereign Identy data format, 2) enables authenticating a student, and 3) enables issuing, storing, and verification of achieved study.


title: Strongly A^1-invariant sheaves (after F. Morel)

abstract: Strongly (respectively strictly) A1-invariant sheaves are foundational for motivic homotopy theory over fields. They are sheaves of (abelian) groups on the Nisnevich site of smooth varieties over a field k, with the property that their zeroth and first Nisnevich cohomology sets (respectively all Nisnevich cohomology groups) are invariant under replacing a variety X by the affine line over X. A celebrated theorem of Fabien Morel states that if the base field k is perfect, then any strongly A1-invariant sheaf of abelian groups is automatically strictly A1-invariant. The aim of these lecture notes is twofold: (1) provide a complete proof if this result, and (2) outline some of its applications.


title: Sliding-dependent electronic structures of alternating-twist tetralayer graphene

abstract: We study the electronic structure of alternating-twist tetralayer graphene, especially near its magic angle $\theta = 1.75^\circ$, for different AA, AB, and SP sliding geometries at their middle interface that divides two twisted bilayer graphenes. This sliding dependence is shown for the bandwidths, bandgaps, and $K$-valley Chern numbers of the lowest-energy valence and conduction bands as a function of twist angle and interlayer potential difference. Our analysis reveals that the AA sliding is most favorable for narrow bands and gaps, and the AB sliding is most prone to developing finite valley Chern numbers. We further analyze the linear longitudinal optical absorptions as a function of photon energy and the absorption map in the moir\'{e} Brillouin zone for specific transition energies. A self-consistent Hartree calculation reveals that the AA system's electronic structure is most sensitive to variations in carrier density.


title: Optimal Robust Contract Design

abstract: We consider the robust contract design problem when the principal only has limited information about the actions the agent can take. The principal evaluates a contract according to its worst-case performance caused by the uncertain action space. Carroll (AER 2015) showed that a linear contract is optimal among deterministic contracts. Recently, Kambhampati (JET 2023) showed that the principal's payoff can be strictly increased via randomization over linear contracts. In this paper, we characterize the optimal randomized contract, which remains linear and admits a closed form of its cumulative density function. The advantage of randomized contracts over deterministic contracts can be arbitrarily large even when the principal knows only one non-trivial action of the agent. Furthermore, our result generalizes to the model of contracting with teams, by Dai and Toikka (Econometrica 2022).


title: Fourier transform in cyclic groups

abstract: On a cyclic group of prime order, the non-trivial Dirichlet characters together with their Fourier transforms are functions that vanish at 0 and whose modulus is constant outside 0. Answering a question of H. Cohn, we construct new functions with these properties for non-safe primes. The proof relies on Floer homology. In the appendix we also apply this method to the biunimodular functions problem.


title: Insights on the Formation Conditions of Uranus and Neptune from their Deep Elemental Compositions

abstract: This study, placed in the context of the preparation for the Uranus Orbiter Probe mission, aims to predict the bulk volatile compositions of Uranus and Neptune. Using a protoplanetary disk model, it examines the evolution of trace species through vapor and solid transport as dust and pebbles. Due to the high carbon abundance found in their envelopes, the two planets are postulated to have formed at the carbon monoxide iceline within the protosolar nebula. The time evolution of the abundances of the major volatile species at the location of the CO iceline is then calculated to derive the abundance ratios of the corresponding key elements, including the heavy noble gases, in the feeding zones of Uranus and Neptune. Supersolar metallicity in their envelopes likely results from accreting solids in these zones. Two types of solids are considered: pure condensates (Case 1) and a mixture of pure condensates and clathrates (Case 2). The model, calibrated to observed carbon enrichments, predicts deep compositions. In Case 1, argon is deeply depleted, while nitrogen, oxygen, krypton, phosphorus, sulfur, and xenon are significantly enriched relative to their protosolar abundances in the two planets. Case 2 predicts significant enrichments for all species, including argon, relative to their protosolar abundances. Consequently, Case 1 predicts near-zero Ar/Kr or Ar/Xe ratios, while Case 2 suggests these ratios are 0.1 and 0.5-1 times their protosolar ratios. Both cases predict a bulk sulfur-to-nitrogen ratio consistent with atmospheric measurements.


title: Precompactness in matrix weighted Bourgain-Morrey spaces

abstract: In this paper, we introduce matrix weighted Bourgain-Morrey spaces and obtain two sufficient conditions for precompact sets in matrix weighted Bourgain-Morrey spaces. We prove that the dyadic average operator is bounded on some matrix weighted Bourgain-Morrey spaces. With this result, we obtain the necessity for precompact sets in some matrix weighted Bourgain-Morrey spaces.


title: Global well-posedness, scattering and blow-up for the energy-critical, Schr\"odinger equation with general nonlinearity in the radial case

abstract: In this paper, we study the well-posedness theory and the scattering asymptotics for the energy-critical, Schr\"odinger equation with general nonlinearity \begin{equation*} \left\{\begin{array}{l} i \partial_t u+\Delta u + f(u)=0,\ (x, t) \in \mathbb{R}^N \times \mathbb{R}, \\ \left.u\right|_{t=0}=u_0 \in H ^1(\mathbb{R}^N), \end{array}\right. \end{equation*} where $f:\mathbb{C}\rightarrow \mathbb{C}$ satisfies Sobolev critical growth condition. Using contraction mapping method and concentration compactness argument, we obtain the well-posedness theory in proper function spaces and scattering asymptotics. This paper generalizes the conclusions in \cite{KCEMF2006}(Invent. Math).


title: High-Dimensional Subspace Expansion Using Classical Shadows

abstract: We introduce a post-processing technique for classical shadow measurement data that enhances the precision of ground state estimation through high-dimensional subspace expansion; the dimensionality is only limited by the amount of classical post-processing resources rather than by quantum resources. Crucial steps of our approach are the efficient identification of useful observables from shadow data, followed by our regularised subspace expansion that is designed to be numerically stable even when using noisy data. We analytically investigate noise propagation within our method, and upper bound the statistical fluctuations due to the limited number of snapshots in classical shadows. In numerical simulations, our method can achieve a reduction in the energy estimation errors in many cases, sometimes by more than an order of magnitude. We also demonstrate that our performance improvements are robust against both coherent errors (bad initial state) and gate noise in the state-preparation circuits. Furthermore, performance is guaranteed to be at least as good - and in many cases better - than direct energy estimation without using additional quantum resources and the approach is thus a very natural alternative for estimating ground state energies directly from classical shadow data.


title: Inpainting the Gaps: A Novel Framework for Evaluating Explanation Methods in Vision Transformers

abstract: The perturbation test remains the go-to evaluation approach for explanation methods in computer vision. This evaluation method has a major drawback of test-time distribution shift due to pixel-masking that is not present in the training set. To overcome this drawback, we propose a novel evaluation framework called \textbf{Inpainting the Gaps (InG)}. Specifically, we propose inpainting parts that constitute partial or complete objects in an image. In this way, one can perform meaningful image perturbations with lower test-time distribution shifts, thereby improving the efficacy of the perturbation test. InG is applied to the PartImageNet dataset to evaluate the performance of popular explanation methods for three training strategies of the Vision Transformer (ViT). Based on this evaluation, we found Beyond Intuition and Generic Attribution to be the two most consistent explanation models. Further, and interestingly, the proposed framework results in higher and more consistent evaluation scores across all the ViT models considered in this work. To the best of our knowledge, InG is the first semi-synthetic framework for the evaluation of ViT explanation methods.


title: Decentralized Credential Verification

abstract: This paper presents a decentralized application (dApp) for secure and efficient digital credential management using blockchain and verifiable credentials. The dApp supports OID4VC and SD-JWT-compliant wallets for privacy-preserving credential management. Primarily demonstrated through resume verification, the framework is versatile across various domains. By integrating Decentralized Identifiers and advanced cryptographic methods, the dApp addresses inefficiency, high costs, and fraud vulnerabilities, providing a robust solution for modern credential management.


title: RO-SVD: A Reconfigurable Hardware Copyright Protection Framework for AIGC Applications

abstract: The dramatic surge in the utilisation of generative artificial intelligence (GenAI) underscores the need for a secure and efficient mechanism to responsibly manage, use and disseminate multi-dimensional data generated by artificial intelligence (AI). In this paper, we propose a blockchain-based copyright traceability framework called ring oscillator-singular value decomposition (RO-SVD), which introduces decomposition computing to approximate low-rank matrices generated from hardware entropy sources and establishes an AI-generated content (AIGC) copyright traceability mechanism at the device level. By leveraging the parallelism and reconfigurability of field-programmable gate arrays (FPGAs), our framework can be easily constructed on existing AI-accelerated devices and provide a low-cost solution to emerging copyright issues of AIGC. We developed a hardware-software (HW/SW) co-design prototype based on comprehensive analysis and on-board experiments with multiple AI-applicable FPGAs. Using AI-generated images as a case study, our framework demonstrated effectiveness and emphasised customisation, unpredictability, efficiency, management and reconfigurability. To the best of our knowledge, this is the first practical hardware study discussing and implementing copyright traceability specifically for AI-generated content.


title: From entropic transport to martingale transport, and applications to model calibration

abstract: We propose a discrete time formulation of the semi martingale optimal transport problembased on multi-marginal entropic transport. This approach offers a new way to formulate and solve numerically the calibration problem proposed by Guo et al. 2022, using a multi-marginal extension of Sinkhorn algorithm as in Benamou, Carlier, and Nenna 2019; Carlier et al. 2017; Benamou et al. 2019. In the limit when the time step goes to zero we recover, as detailed in the companion paper Benamou et al. 2024, a semi-martingale process, solution to a semi-martingale optimal transport problem, with a cost function involving the so-called specific entropy introduced in Gantert 1991, see also F{\"o}llmer 2022 and Backhoff-Veraguas and Unterberger 2023.


title: Improving Quality Control of Whole Slide Images by Explicit Artifact Augmentation

abstract: The problem of artifacts in whole slide image acquisition, prevalent in both clinical workflows and research-oriented settings, necessitates human intervention and re-scanning. Overcoming this challenge requires developing quality control algorithms, that are hindered by the limited availability of relevant annotated data in histopathology. The manual annotation of ground-truth for artifact detection methods is expensive and time-consuming. This work addresses the issue by proposing a method dedicated to augmenting whole slide images with artifacts. The tool seamlessly generates and blends artifacts from an external library to a given histopathology dataset. The augmented datasets are then utilized to train artifact classification methods. The evaluation shows their usefulness in classification of the artifacts, where they show an improvement from 0.10 to 0.01 AUROC depending on the artifact type. The framework, model, weights, and ground-truth annotations are freely released to facilitate open science and reproducible research.


title: Origin of the strong sodium absorption of the lensed supernova 2016geu at z=0.4

abstract: The origin of strong sodium absorption, which has been observed for a few nearby Type Ia supernovae (SNe Ia), remains elusive. Here we analyse two high-signal-to-noise, intermediate-resolution VLT/X-shooter spectra at epochs $+$18 and $+$27 days past peak brightness of the strongly lensed and multiply-imaged Type Ia SN 2016geu which exploded at a redshift of $z = 0.4$. We show that SN 2016geu exhibits very strong, multiple Na I and Ca II absorption lines with a large total Na I D restframe equivalent width of 5.2 $\pm$ 0.2 A, among the highest ever detected for a SN Ia and similar to only a handful of nearby SNe Ia with extraordinary large Na I D EWs. The absorption system is time-invariant and extends over a large velocity span $\sim$ 250 km s$^{-1}$. The majority of the absorption is blueshifted relative to the strongest component, while there are both blueshifted and redshifted components relative to the systemic redshift of the galaxy. The column density ratios and widths of the absorption lines indicate that the absorption likely arises from a combination of interstellar dusty molecular clouds and circumgalactic in- and outflowing material, rather than circumstellar matter around the SN.


title: Model-Based Deep Learning for Music Information Research

abstract: In this article, we investigate the notion of model-based deep learning in the realm of music information research (MIR). Loosely speaking, we refer to the term model-based deep learning for approaches that combine traditional knowledge-based methods with data-driven techniques, especially those based on deep learning, within a diff erentiable computing framework. In music, prior knowledge for instance related to sound production, music perception or music composition theory can be incorporated into the design of neural networks and associated loss functions. We outline three specifi c scenarios to illustrate the application of model-based deep learning in MIR, demonstrating the implementation of such concepts and their potential.


title: Volume Above Distance Below with Boundary II

abstract: It was shown by B. Allen, R. Perales, and C. Sormani that on a closed manifold where the diameter of a sequence of Riemannian metrics is bounded, if the volume converges to the volume of a limit manifold, and the sequence of Riemannian metrics are $C^0$ converging from below then one can conclude volume preserving Sormani-Wenger Intrinsic Flat convergence. The result was extended to manifolds with boundary by B. Allen and R. Perales by a doubling with necks procedure which produced a closed manifold and reduced the case with boundary to the case without boundary. The consequence of the doubling with necks procedure was requiring a stronger condition than necessary on the boundary. Using the estimates for the Sormani-Wenger Intrinsic Flat distance on manifolds with boundary developed by B. Allen and R. Perales, we show that only a bound on the area of the boundary is needed in order to conclude volume preserving intrinsic flat convergence for manifolds with boundary. We also provide an example which shows that one should not expect convergence without a bound on area.


title: Gradient potential estimates for elliptic double obstacle problems with Orlicz growth

abstract: In this paper,we consider the solutions of the elliptic double obstacle problems with Orlicz growth involving measure data. Some pointwise estimates for the approximable solutions to these problems are obtained in terms of fractional maximal operators. Furthermore, we establish pointwise and oscillation estimates for the gradients of solutions via the non-linear Wolff potentials, which in turn yield $C^{1,\alpha}$-regularity of solutions.


title: Revisiting the large-scale CMB anomalies: The impact of the SZ signal from the Local Universe

abstract: The full sky measurements of the Cosmic Microwave Background (CMB) temperature anisotropies by $\textit{WMAP}$ and $\textit{Planck}$ have highlighted the presence of several unexpected isotropy-breaking features on the largest angular scales. In this work, we investigate the impact of the local large-scale structure on these anomalies through the thermal and kinetic Sunyaev-Zeldovich effects. We use a constrained hydrodynamical simulation that reproduces the local Universe in a box of $500\,h^{-1}\,$Mpc to construct full sky maps of the temperature anisotropies produced by these two CMB secondary effects and discuss their statistical properties on large angular scales. We show the significant role played by the Virgo cluster on these scales, and compare it to theoretical predictions and random patches of the universe obtained from the hydrodynamical simulation $\textit{Magneticum}$. We explore three of the main CMB large-scale anomalies -- i.e., lack of correlation, quadrupole-octopole alignment and hemispherical asymmetry -- , both in the latest $\textit{Planck}$ data (PR4), where they are detected at a similar level to the previous releases, and using the simulated secondaries from the local Universe, verifying their negligible impact.


title: Do Parameters Reveal More than Loss for Membership Inference?

abstract: Membership inference attacks aim to infer whether an individual record was used to train a model, serving as a key tool for disclosure auditing. While such evaluations are useful to demonstrate risk, they are computationally expensive and often make strong assumptions about potential adversaries' access to models and training environments, and thus do not provide very tight bounds on leakage from potential attacks. We show how prior claims around black-box access being sufficient for optimal membership inference do not hold for most useful settings such as stochastic gradient descent, and that optimal membership inference indeed requires white-box access. We validate our findings with a new white-box inference attack IHA (Inverse Hessian Attack) that explicitly uses model parameters by taking advantage of computing inverse-Hessian vector products. Our results show that both audits and adversaries may be able to benefit from access to model parameters, and we advocate for further research into white-box methods for membership privacy auditing.


title: Fingertip Contact Force Direction Control using Tactile Feedback

abstract: The human hand is an immensely sophisticated tool adept at manipulating and grasping objects of unknown characteristics. Its capability lies in perceiving interaction dynamics through touch and adjusting contact force direction and magnitude to ensure successful manipulation. Despite advancements in control algorithms, sensing technologies, compliance integration, and ongoing research, precise finger force control for dexterous manipulation using tactile sensing remains relatively unexplored.In this work, we explore the challenges related to individual finger contact force control and propose a method for directing such forces perceived through tactile sensing. The proposed method is evaluated using an Allegro hand with Xela tactile sensors. Results are presented and discussed, alongside consideration for potential future improvements.


title: GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement

abstract: The evolution of speech technology has been spurred by the rapid increase in dataset sizes. Traditional speech models generally depend on a large amount of labeled training data, which is scarce for low-resource languages. This paper presents GigaSpeech 2, a large-scale, multi-domain, multilingual speech recognition corpus. It is designed for low-resource languages and does not rely on paired speech and text data. GigaSpeech 2 comprises about 30,000 hours of automatically transcribed speech, including Thai, Indonesian, and Vietnamese, gathered from unlabeled YouTube videos. We also introduce an automated pipeline for data crawling, transcription, and label refinement. Specifically, this pipeline uses Whisper for initial transcription and TorchAudio for forced alignment, combined with multi-dimensional filtering for data quality assurance. A modified Noisy Student Training is developed to further refine flawed pseudo labels iteratively, thus enhancing model performance. Experimental results on our manually transcribed evaluation set and two public test sets from Common Voice and FLEURS confirm our corpus's high quality and broad applicability. Notably, ASR models trained on GigaSpeech 2 can reduce the word error rate for Thai, Indonesian, and Vietnamese on our challenging and realistic YouTube test set by 25% to 40% compared to the Whisper large-v3 model, with merely 10% model parameters. Furthermore, our ASR models trained on Gigaspeech 2 yield superior performance compared to commercial services. We believe that our newly introduced corpus and pipeline will open a new avenue for low-resource speech recognition and significantly facilitate research in this area.


title: GECOBench: A Gender-Controlled Text Dataset and Benchmark for Quantifying Biases in Explanations

abstract: Large pre-trained language models have become popular for many applications and form an important backbone of many downstream tasks in natural language processing (NLP). Applying 'explainable artificial intelligence' (XAI) techniques to enrich such models' outputs is considered crucial for assuring their quality and shedding light on their inner workings. However, large language models are trained on a plethora of data containing a variety of biases, such as gender biases, affecting model weights and, potentially, behavior. Currently, it is unclear to what extent such biases also impact model explanations in possibly unfavorable ways. We create a gender-controlled text dataset, GECO, in which otherwise identical sentences appear in male and female forms. This gives rise to ground-truth 'world explanations' for gender classification tasks, enabling the objective evaluation of the correctness of XAI methods. We also provide GECOBench, a rigorous quantitative evaluation framework benchmarking popular XAI methods, applying them to pre-trained language models fine-tuned to different degrees. This allows us to investigate how pre-training induces undesirable bias in model explanations and to what extent fine-tuning can mitigate such explanation bias. We show a clear dependency between explanation performance and the number of fine-tuned layers, where XAI methods are observed to particularly benefit from fine-tuning or complete retraining of embedding layers. Remarkably, this relationship holds for models achieving similar classification performance on the same task. With that, we highlight the utility of the proposed gender-controlled dataset and novel benchmarking approach for research and development of novel XAI methods. All code including dataset generation, model training, evaluation and visualization is available at: https://github.com/braindatalab/gecobench


title: AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulation

abstract: The ability to reflect on and correct failures is crucial for robotic systems to interact stably with real-life objects.Observing the generalization and reasoning capabilities of Multimodal Large Language Models (MLLMs), previous approaches have aimed to utilize these models to enhance robotic systems accordingly.However, these methods typically focus on high-level planning corrections using an additional MLLM, with limited utilization of failed samples to correct low-level contact poses. To address this gap, we propose an Autonomous Interactive Correction (AIC) MLLM, which makes use of previous low-level interaction experiences to correct SE(3) pose predictions. Specifically, AIC MLLM is initially fine-tuned to acquire both pose prediction and feedback prompt comprehension abilities.We carefully design two types of prompt instructions through interactions with objects: 1) visual masks to highlight unmovable parts for position correction, and 2)textual descriptions to indicate potential directions for rotation correction.During inference, a Feedback Information Extraction module is introduced to recognize the failure cause, allowing AIC MLLM to adaptively correct the pose prediction using the corresponding prompts. To further enhance manipulation stability, we devise a Test Time Adaptation strategy that enables AIC MLLM to better adapt to the current scene configuration.Finally, extensive experiments are conducted in both simulated and real-world environments to evaluate the proposed method. The results demonstrate that our AIC MLLM can efficiently correct failure samples by leveraging interaction experience prompts.Real-world demonstration can be found at https://sites.google.com/view/aic-mllm


title: Size effect on the structural and magnetic phase transformations of iron nanoparticles

abstract: Iron nanoparticles are among the most promising low-dimensional materials in terms of applications. This particularity is attributable to the magnetic properties of these nanoparticles, which exhibit different allotropes as a function of temperature. In this work, we sought to characterise at the atomic scale how their structural and magnetic transformations can be affected by the size. To achieve this objective, we developed a tight-binding model incorporating a magnetic contribution via a Stoner term implemented in a Monte Carlo code to relax the structure and the magnetic state. Using our approach, we show that magnetism is strongly reinforced by the surface, which leads to increase the Curie temperature as the size of the particle decreases contrary to the solid-solid transition temperature. Our work thus provides a deep understanding at the atomic scale of the key factors that determines the structural and magnetic properties of Fe nanoparticles, shedding more light on their unique character which is crucial for further applications.


title: Low Energy Nuclear Reactions Through Weak Interactions

abstract: We consider the possibility that low-energy nuclear reactions (LENR) arise due to the conversion of proton to neutron through weak interactions. The resulting neutron forms a short-lived virtual state, which then gets captured by another nucleus through photon emission. This whole process happens under the framework of second-order perturbation theory. We find that the rate of this process is negligibly small in most cases. However, in the presence of a resonance, the rate can be substantial and observable.


title: Simple Yet Efficient: Towards Self-Supervised FG-SBIR with Unified Sample Feature Alignment

abstract: Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims to minimize the distance between sketches and corresponding images in the embedding space. However, scalability is hindered by the growing complexity of solutions, mainly due to the abstract nature of fine-grained sketches. In this paper, we propose a simple yet efficient approach to narrow the gap between the two modes. It mainly facilitates unified mutual information sharing both intra- and inter-samples, rather than treating them as a single feature alignment problem between modalities. Specifically, our approach includes: (i) Employing dual weight-sharing networks to optimize alignment within sketch and image domain, which also effectively mitigates model learning saturation issues. (ii) Introducing an objective optimization function based on contrastive loss to enhance the model's ability to align features intra- and inter-samples. (iii) Presenting a learnable TRSM combined of self-attention and cross-attention to promote feature representations among tokens, further enhancing sample alignment in the embedding space. Our framework achieves excellent results on CNN- and ViT-based backbones. Extensive experiments demonstrate its superiority over existing methods. We also introduce Cloths-V1, the first professional fashion sketches and images dataset, utilized to validate our method and will be beneficial for other applications.


title: A systematically-selected sample of luminous, long-duration, ambiguous nuclear transients

abstract: We present a search for luminous, long-duration ambiguous nuclear transients (ANTs) similar to the unprecedented discovery of the extreme, ambiguous event AT2021lwx with a $>150$ d rise time and luminosity $10^{45.7}$ erg s$^{-1}$. We use the Lasair transient broker to search Zwicky Transient Facility (ZTF) data for transients lasting more than one year and exhibiting smooth declines. Our search returns 59 events, seven of which we classify as ANTs assumed to be driven by accretion onto supermassive black holes. We propose the remaining 52 are stochastic variability from regular supermassive black hole accretion rather than distinct transients. We supplement the seven ANTs with three nuclear transients in ZTF that fail the light curve selection but have clear single flares and spectra that do not resemble typical AGN. All but one of these 10 ANTs have a mid-infrared flare from an assumed dust echo, implying the ubiquity of dust around the black holes giving rise to ANTs. No events are more luminous than AT2021lwx, but one (ZTF19aamrjar) has twice the duration and a higher integrated energy release. On the other extreme, ZTF20abodaps reaches a luminosity close to AT2021lwx with a rise time $<20$ d and that fades smoothly in $>600$ d. We define a portion of rise-time versus flare amplitude space that selects ANTs with $\sim50$ per cent purity against variable active galactic nuclei. We calculate a volumetric rate of $\gtrsim 3\times10^{-11}$ Mpc$^{-1}$ yr$^{-1}$, consistent with the events being caused by tidal disruptions of intermediate and high-mass stars.


title: The Susceptibility Paradox in Online Social Influence

abstract: Understanding susceptibility to online influence is crucial for mitigating the spread of misinformation and protecting vulnerable audiences. This paper investigates susceptibility to influence within social networks, focusing on the differential effects of influence-driven versus spontaneous behaviors on user content adoption. Our analysis reveals that influence-driven adoption exhibits high homophily, indicating that individuals prone to influence often connect with similarly susceptible peers, thereby reinforcing peer influence dynamics. Conversely, spontaneous adoption shows significant but lower homophily. Additionally, we extend the Generalized Friendship Paradox to influence-driven behaviors, demonstrating that users' friends are generally more susceptible to influence than the users themselves, de facto establishing the notion of Susceptibility Paradox in online social influence. This pattern does not hold for spontaneous behaviors, where friends exhibit fewer spontaneous adoptions. We find that susceptibility to influence can be accurately predicted using friends' susceptibility alone, while predicting spontaneous adoption requires additional features, such as user metadata. These findings highlight the complex interplay between user engagement and preferences in spontaneous content adoption. Our results provide new insights into social influence mechanisms and offer implications for designing more effective moderation strategies to protect vulnerable audiences.


title: Magnetism in LAMOST CP stars observed by TESS

abstract: Context. A thousand new magnetic candidate CP stars have been identified with LAMOST, among which about 700 prime targets have rotational modulation determined from TESS. Aims. We aim to check for the presence of a magnetic field in a subsample of these LAMOST CP stars, test the viability of the 5200 A depression used to select the mCP candidates in the LAMOST survey as a reliable indicator of magnetism, and expand on the limited database of known magnetic hot stars. The sample includes some pulsators that would be valuable targets for magneto-asteroseismology. Methods. We selected approx. 100 magnetic candidate LAMOST CP stars, presenting a depression at 5200 A in their spectrum and that also display rotational modulation in their TESS photometric lightcurves. We obtained spectropolarimetric observations of 39 targets from this sample with ESPaDOnS at CFHT. We utilise the Least Squares Deconvolution method to generate the mean profile of the Stokes V and I parameters, from which the longitudinal magnetic field strength for each target can be determined. For HD 49198, we performed more in-depth analysis to determine the polar magnetic field strength and configuration. Results. We detect fields in at least 36 of our sample of 39 targets. This success rate in detecting magnetic field (above 92%) is very high compared to the occurrence of magnetic fields in hot stars (about 10%). Four of these newly discovered magnetic stars are magnetic pulsators. In particular, we detect the strongest field around a delta Scuti star discovered to date: a 12 kG dipolar field in HD 49198. Conclusions. From our analysis, we conclude that using the 5200 A depression displayed in the spectra in combination with rotational modulation in photometric data is a very reliable method for identifying magnetic candidates in this population of stars.


title: Input Conditioned Graph Generation for Language Agents

abstract: Recent progress in Large Language Models (LLMs) and language agents has demonstrated significant promise for various future applications across multiple disciplines. While traditional approaches to language agents often rely on fixed, handcrafted designs, our research aims to develop both learnable and dynamic agents. Our method uses an existing framework that abstracts language agents as graphs. Within this graph framework, we aim to learn a model that can generate edges for every given input to the language agent. This allows us to generate edges that represent the flow of communication within the graph based on the given input, thereby adjusting the internal communication of a language agent. We learn to generate these edges using a pretrained LLM that is fine-tuned with reinforcement learning. This LLM can be fine-tuned on several datasets simultaneously, and we hypothesize that the model learns to adapt to these different domains during training, achieving good overall performance when encountering data from different domains during deployment. We demonstrate that our approach surpasses the previous static approach by nearly 6% accuracy on a combined dataset of MMLU and CMMLU, and by more than 10% when trained with a sparsity-inducing loss. It also performs superior in additional experiments conducted with the MMLU and Mini Crossword Puzzles datasets. The code is available at https://github.com/lukasVierling/DynamicGPTSwarm.


title: PLATO's signal and noise budget

abstract: ESA's PLATO mission aims the detection and characterization of terrestrial planets around solar-type stars as well as the study of host star properties. The noise-to-signal ratio (NSR) is the main performance parameter of the PLATO instrument, which consists of 24 Normal Cameras and 2 Fast Cameras. In order to justify, verify and breakdown NSR-relevant requirements the software simulator PINE was developed. PINE models the signal pathway from a target star to the digital output of a camera based on physical models and considers the major noise contributors. In this paper, the simulator's coarse mode is introduced which allows fast performance analyses on instrument level. The added value of PINE is illustrated by exemplary applications.


title: Holographic spectral function of fermion in instantonic plasma

abstract: Using the gauge-gravity duality, we investigate the fermionic correlation function in the D(-1)-D3 brane system which describes the instantonic plasma in holography. In this system, the charge of the D(-1) brane as the D-instanton gives the gluon condensate. To simplify the holographic setup, we first reduce briefly the ten-dimensional supergravity background produced by D(-1)-D3-branes to an equivalently five-dimensional background. Then using the standard method for computing the Green function in the AdS/CFT dictionary, we derive the equations for the fermionic correlation functions and solve them numerically with the infalling boundary condition. Our numerical results illustrate that the fermionic correlation function as spectral function includes two branches of the dispersion curves whose behavior is very close to the results obtained from the method of hard thermal loop. And the effective mass generated by the medium effect of fermion splits into two values due to the spin-dependent interactions induced by instantons. Therefore, this work in holography demonstrates the instantonic configuration is very influential to the fermionic plasmino in plasma.


title: Unleashing OpenTitan's Potential: a Silicon-Ready Embedded Secure Element for Root of Trust and Cryptographic Offloading

abstract: The rapid advancement and exploration of open-hardware RISC-V platforms are driving significant changes in sectors like autonomous vehicles, smart-city infrastructure, and medical devices. OpenTitan stands out as a groundbreaking open-source RISC-V design with a comprehensive security toolkit as a standalone system-on-chip (SoC). OpenTitan includes Earl Grey, a fully implemented and silicon-proven SoC, and Darjeeling, announced but not yet fully implemented. Earl Grey targets standalone SoC implementations, while Darjeeling is for integrable implementations. The literature lacks a silicon-ready embedded implementation of an open-source Root of Trust, despite lowRISC's efforts on Darjeeling. We address the limitations of existing implementations by optimizing data transfer latency between memory and cryptographic accelerators to prevent under-utilization and ensure efficient task acceleration. Our contributions include a comprehensive methodology for integrating custom extensions and IPs into the Earl Grey architecture, architectural enhancements for system-level integration, support for varied boot modes, and improved data movement across the platform. These advancements facilitate deploying OpenTitan in broader SoCs, even without specific technology-dependent IPs, providing a deployment-ready research vehicle for the community. We integrated the extended Earl Grey architecture into a reference architecture in a 22nm FDX technology node, benchmarking the enhanced architecture's performance. The results show significant improvements in cryptographic processing speed, achieving up to 2.7x speedup for SHA-256/HMAC and 1.6x for AES accelerators compared to the baseline Earl Grey architecture.


title: On the use of far-infrared and sub-millimeter line ratios to constrain the physical properties of gas in high-z galaxies

abstract: Optical emission line diagnostics, which are a common tool to constrain the properties of the interstellar medium (ISM) of galaxies, become progressively inaccessible at higher redshifts for ground-based facilities. Far-infrared (FIR) emission lines, which are redshifted into atmospheric windows accessible by ground-based sub-millimeter facilities, could provide alternative ISM diagnostics to optical emission lines. We investigate FIR line ratios involving [CII]$\lambda 158 \mu$m, [OIII]$\lambda 88 \mu$m, [OIII]$\lambda 52 \mu$m, [NII]$\lambda 122 \mu$m and [NIII$\lambda 57 \mu$m, using synthetic emission lines applied to a high-resolution (m$_{\rm gas}$= 883.4 M$_{\odot}$) cosmological zoom-in simulation, including radiative-transfer post processing with KramsesRT at z = 6.5. We find that the [CII]/[NII]122 ratio is sensitive to the temperature and density of photo-dissociation regions, and thus could be a useful tool to trace the properties of this gas phase in galaxies. We also find that [NII]/[NIII] is a good tracer of the temperature and [OIII]52/[OIII]88 a good tracer of the gas density of HII regions. Emission line ratios containing the [OIII]$\lambda 88 \mu$m line are sensitive to high velocity outflowing gas.


title: GA-Unity: A Production-Ready Unity Package for Seamless Integration of Geometric Algebra in Networked Collaborative Applications

abstract: This paper introduces GA-Unity, the first Unity package specifically designed for seamless integration of Geometric Algebra (GA) into collaborative networked applications. Indeed, in such contexts, it has been demonstrated that using multivectors for interpolation between transmitted poses reduces runtime by 16% and bandwidth usage by an average of 50% compared to traditional representation forms (vectors and quaternions); we demonstrate that GA-Unity further enhances runtime performance. Tailored for 3D Conformal Geometric Algebra, GA-Unity also offers an intuitive interface within the Unity game engine, simplifying GA integration for researchers and programmers. By eliminating the need for users to develop GA functionalities from scratch, GA-Unity expedites GA experimentation and implementation processes. Its seamless integration enables easy representation of transformation properties using multivectors, facilitating deformations and interpolations without necessitating modifications to the rendering pipeline. Furthermore, its graphical interface establishes a GA playground for developers within the familiar confines of a modern game engine. In summary, GA-Unity represents a significant advancement in GA accessibility and usability, particularly in collaborative networked environments, empowering innovation and facilitating widespread adoption across various research and programming domains while upholding high-performance standards.


title: Quiver Polymerisation

abstract: Two new diagrammatic techniques on $3d\;\mathcal N=4$ quiver gauge theories, termed chain and cyclic quiver polymerisation are introduced. These gauge a diagonal $\mathrm{SU}/\mathrm{U}(k)$ subgroup of the Coulomb branch global symmetry of a quiver (or pair of quivers) with multiple legs. The action on the Coulomb branch is that of a $\mathrm{SU}/\mathrm{U}(k)$ hyper-K\"ahler quotient. The polymerisation techniques build and generalise known composition methods from class $\mathcal S$. Polymerisation is used to generate a wide range of magnetic quivers from various physical contexts. These include polymerisation constructions for Kronheimer-Nakajima quivers, which generalise the ADHM construction for the moduli space of $k\;\mathrm{SU}(N)$ instantons on $\mathbb C^2$ to A-type singularities. Also a polymerisation construction of the magnetic quiver for the $6d\;\mathcal N=(1,0)$ coming from two $\frac{1}{2}$ M5 branes probing an $E_6$ Klein singularity. We find a method of extending magnetic quivers for Class $\mathcal S$ theories to cure the incomplete Higgsing that arises when gluing punctures into the loops associated with higher genus theories. Other novel constructions include a unitary magnetic quiver for the closure of a height four nilpotent orbit of $\mathrm{SO}(7)$. We explore the relationships between the Coulomb and Higgs branches of quivers under polymerisation.


title: An Imitative Reinforcement Learning Framework for Autonomous Dogfight

abstract: Unmanned Combat Aerial Vehicle (UCAV) dogfight, which refers to a fight between two or more UCAVs usually at close quarters, plays a decisive role on the aerial battlefields. With the evolution of artificial intelligence, dogfight progressively transits towards intelligent and autonomous modes. However, the development of autonomous dogfight policy learning is hindered by challenges such as weak exploration capabilities, low learning efficiency, and unrealistic simulated environments. To overcome these challenges, this paper proposes a novel imitative reinforcement learning framework, which efficiently leverages expert data while enabling autonomous exploration. The proposed framework not only enhances learning efficiency through expert imitation, but also ensures adaptability to dynamic environments via autonomous exploration with reinforcement learning. Therefore, the proposed framework can learn a successful dogfight policy of 'pursuit-lock-launch' for UCAVs. To support data-driven learning, we establish a dogfight environment based on the Harfang3D sandbox, where we conduct extensive experiments. The results indicate that the proposed framework excels in multistage dogfight, significantly outperforms state-of-the-art reinforcement learning and imitation learning methods. Thanks to the ability of imitating experts and autonomous exploration, our framework can quickly learn the critical knowledge in complex aerial combat tasks, achieving up to a 100% success rate and demonstrating excellent robustness.


title: Intersymbolic AI: Interlinking Symbolic AI and Subsymbolic AI

abstract: This perspective piece calls for the study of the new field of Intersymbolic AI, by which we mean the combination of symbolic AI, whose building blocks have inherent significance/meaning, with subsymbolic AI, whose entirety creates significance/effect despite the fact that individual building blocks escape meaning. Canonical kinds of symbolic AI are logic, games and planning. Canonical kinds of subsymbolic AI are (un)supervised machine and reinforcement learning. Intersymbolic AI interlinks the worlds of symbolic AI with its compositional symbolic significance and meaning and of subsymbolic AI with its summative significance or effect to enable culminations of insights from both worlds by going between and across symbolic AI insights with subsymbolic AI techniques that are being helped by symbolic AI principles. For example, Intersymbolic AI may start with symbolic AI to understand a dynamic system, continue with subsymbolic AI to learn its control, and end with symbolic AI to safely use the outcome of the learned subsymbolic AI controller in the dynamic system. Intersymbolic AI combines both symbolic and subsymbolic AI to increase the effectiveness of AI compared to either kind of AI alone, in much the same way that the combination of both conscious and subconscious thought increases the effectiveness of human thought compared to either kind of thought alone. Some successful contributions to the Intersymbolic AI paradigm are surveyed here but many more are considered possible by advancing Intersymbolic AI.


title: Quasicircular Orbital Parameters for Numerical Relativity Revisited

abstract: In the post-Newtonian (PN) expansion, we extend the determination of quasicircular orbital parameters to be used by subsequent full numerical simulations to the 3.5PN order, and find that this leads to lower eccentricities, $e$, than with our previous method that used up to 3PN order. We also supplement the computation of the radial infall due to radiation reaction and the location of the center of mass to 3.5PN order, providing explicit formulas. In addition, we consider the small mass ratio limit by explicitly including the Schwarzschild and Kerr limits, the later in quasi-isotropic as well as in our standard use of ADMTT coordinates. We evolve binaries with a $q=1/16$ mass ratio by using 3PN, 3.5PN, 3.5PN+Schwarzschild, 3.5PN+KerrQISO and 3.5PN+KerrADMTT quasicircular data for three different configurations where the larger hole intrinsic spins are $\chi^z=-0.8$, $-0.4$ and $+0.8$. Using different measures of eccentricity from the black hole trajectories and from the waveform amplitudes and phases, we determine a systematic reduction of eccentricities with respect to the 3PN initial values by factors of up to an order of magnitude, and reaching the desired $e\sim10^{-3}$ threshold.


title: Extrinsic Evaluation of Cultural Competence in Large Language Models

abstract: Productive interactions between diverse users and language technologies require outputs from the latter to be culturally relevant and sensitive. Prior works have evaluated models' knowledge of cultural norms, values, and artifacts, without considering how this knowledge manifests in downstream applications. In this work, we focus on extrinsic evaluation of cultural competence in two text generation tasks, open-ended question answering and story generation. We quantitatively and qualitatively evaluate model outputs when an explicit cue of culture, specifically nationality, is perturbed in the prompts. Although we find that model outputs do vary when varying nationalities and feature culturally relevant words, we also find weak correlations between text similarity of outputs for different countries and the cultural values of these countries. Finally, we discuss important considerations in designing comprehensive evaluation of cultural competence in user-facing tasks.


title: MEMLA: Enhancing Multilingual Knowledge Editing with Neuron-Masked Low-Rank Adaptation

abstract: Knowledge editing aims to adjust the knowledge within large language models (LLMs) to prevent their responses from becoming obsolete or inaccurate. However, existing works on knowledge editing are primarily conducted in a single language, which is inadequate for multilingual language models. In this paper, we focus on multilingual knowledge editing (MKE), which requires propagating updates across multiple languages. This necessity poses a significant challenge for the task. Furthermore, the limited availability of a comprehensive dataset for MKE exacerbates this challenge, hindering progress in this area. Hence, we introduce the Multilingual Knowledge Editing Benchmark (MKEB), a novel dataset comprising 12 languages and providing a complete evaluation framework. Additionally, we propose a method that enhances Multilingual knowledge Editing with neuron-Masked Low-Rank Adaptation (MEMLA). Specifically, we identify two categories of knowledge neurons to improve editing precision. Moreover, we perform LoRA-based editing with neuron masks to efficiently modify parameters and facilitate the propagation of updates across multiple languages. Experiments demonstrate that our method outperforms existing baselines and significantly enhances the multi-hop reasoning capability of the edited model, with minimal impact on its downstream task performance. The dataset and code will be made publicly available.


title: Quaternion Generative Adversarial Neural Networks and Applications to Color Image Inpainting

abstract: Color image inpainting is a challenging task in imaging science. The existing method is based on real operation, and the red, green and blue channels of the color image are processed separately, ignoring the correlation between each channel. In order to make full use of the correlation between each channel, this paper proposes a Quaternion Generative Adversarial Neural Network (QGAN) model and related theory, and applies it to solve the problem of color image inpainting with large area missing. Firstly, the definition of quaternion deconvolution is given and the quaternion batch normalization is proposed. Secondly, the above two innovative modules are applied to generate adversarial networks to improve stability. Finally, QGAN is applied to color image inpainting and compared with other state-of-the-art algorithms. The experimental results show that QGAN has superiority in color image inpainting with large area missing.