title: Unveiling the Ambiguity in Neural Inverse Rendering: A Parameter Compensation Analysis

abstract: Inverse rendering aims to reconstruct the scene properties of objects solely from multiview images. However, it is an ill-posed problem prone to producing ambiguous estimations deviating from physically accurate representations. In this paper, we utilize Neural Microfacet Fields (NMF), a state-of-the-art neural inverse rendering method to illustrate the inherent ambiguity. We propose an evaluation framework to assess the degree of compensation or interaction between the estimated scene properties, aiming to explore the mechanisms behind this ill-posed problem and potential mitigation strategies. Specifically, we introduce artificial perturbations to one scene property and examine how adjusting another property can compensate for these perturbations. To facilitate such experiments, we introduce a disentangled NMF where material properties are independent. The experimental findings underscore the intrinsic ambiguity present in neural inverse rendering and highlight the importance of providing additional guidance through geometry, material, and illumination priors.


title: Introducing spontaneous curvature to the Helfrich flow: Singularities and convergence

abstract: While there are various results on the long-time behavior of the Willmore flow, the Helfrich flow with non-zero spontaneous curvature as its natural generalization is not yet well-understood. Past results for the gradient flow of a locally area- and volume-constrained Willmore flow indicate the existence of finite-time singularities which corresponds to the scaling-behavior of the underlying energy. However, for a non-vanishing spontaneous curvature, the scaling behavior is not quite as conclusive. Indeed, in this article, we find that a negative spontaneous curvature corresponds to finite-time singularities of the locally constrained Helfrich flow if the initial surface is energetically close to a round sphere. Conversely however, in the case of a positive spontaneous curvature, we find a positive result in terms of the convergence behavior: The locally area-constrained Helfrich flow starting in a spherical immersion with suitably small Helfrich energy exists globally and converges to a Helfrich immersion after reparametrization. Moreover, this energetic smallness assumption is given by an explicit energy threshold depending on the spontaneous curvature and the local area constraint of the energy.


title: Benchmarking the performance of a self-custody, non-ledger-based, obliviously managed digital payment system

abstract: As global governments intensify efforts to operationalize retail central bank digital currencies (CBDCs), the imperative for architectures that preserve user privacy has never been more pronounced. This paper advances an existing retail CBDC framework developed at University College London. Utilizing the capabilities of the Comet research framework, our proposed design allows users to retain direct custody of their assets without the need for intermediary service providers, all while preserving transactional anonymity. The study unveils a novel technique to expedite the retrieval of Proof of Provenance, significantly accelerating the verification of transaction legitimacy through the refinement of Merkle Trie structures. In parallel, we introduce a streamlined Digital Ledger designed to offer fast, immutable, and decentralized transaction validation within a permissioned ecosystem. The ultimate objective of this research is to benchmark the performance of the legacy system formulated by the original Comet research team against the newly devised system elucidated in this paper. Our endeavour is to establish a foundational design for a scalable national infrastructure proficient in seamlessly processing thousands of transactions in real-time, without compromising consumer privacy or data integrity.


title: Mixed Polyanionic NaFe$_{1.6}$V$_{0.4}$(PO$_{4}$)(SO$_{4}$)$_{2}$@CNT Cathode for Sodium-ion Batteries: Electrochemical Diffusion Kinetics and Distribution of Relaxation Time Analysis at Different Temperatures

abstract: We report the electrochemical sodium-ion kiinetics and distribution of relaxation time (DRT) analysis of a newly designed mixed polyanionic NaFe$_{1.6}$V$_{0.4}$(PO$_{4}$)(SO$_{4}$)$_{2}$@CNT composite as a cathode. The specific capacity of 104 mAhg$^{-1}$ is observed at 0.1~C with the average working voltage of $\sim$3~V. Intriguingly, a remarkable rate capability and reversibility are demonstrated up to very high current rate of 25~C. The long cycling test up to 10~C shows high capacity retention even after 2000 cycles. The detailed analysis of galvanostatic intermittent titration technique (GITT) and cyclic voltammetry (CV) data reveal the diffusion coefficient of 10$^{-8}$--10$^{-11}$ cm$^{2}$s$^{-1}$. We find excellent stability in the thermal testing between 25--55$^\circ$C temperatures and 80\% capacity retention up to 100 cycles at 5~C. Further, we analyse the individual electrochemical processes in the time domain using the novel DRT technique at different temperatures. The {\it ex-situ} investigation shows the stable and reversible structure, morphology and electronic states of the long cycled cathode material. More importantly, we demonstrate relatively high specific energy of $\approx$155 Wh kg$^{-1}$ (considering the total active material loading of both the electrodes) at 0.2~C for full cell battery having excellent rate capability up to 10~C and long cyclic stability at 1~C.


title: Nodal auxiliary space preconditioners for mixed virtual element methods

abstract: We propose nodal auxiliary space preconditioners for facet and edge virtual elements of lowest order by deriving discrete regular decompositions on polytopal grids and generalizing the Hiptmair-Xu preconditioner to the virtual element framework. The preconditioner consists of solving a sequence of elliptic problems on the nodal virtual element space, combined with appropriate smoother steps. Under assumed regularity of the mesh, the preconditioned system is proven to have bounded spectral condition number independent of the mesh size and this is verified by numerical experiments on a sequence of polygonal meshes. Moreover, we observe numerically that the preconditioner is robust on meshes containing elements with high aspect ratios.


title: MAexp: A Generic Platform for RL-based Multi-Agent Exploration

abstract: The sim-to-real gap poses a significant challenge in RL-based multi-agent exploration due to scene quantization and action discretization. Existing platforms suffer from the inefficiency in sampling and the lack of diversity in Multi-Agent Reinforcement Learning (MARL) algorithms across different scenarios, restraining their widespread applications. To fill these gaps, we propose MAexp, a generic platform for multi-agent exploration that integrates a broad range of state-of-the-art MARL algorithms and representative scenarios. Moreover, we employ point clouds to represent our exploration scenarios, leading to high-fidelity environment mapping and a sampling speed approximately 40 times faster than existing platforms. Furthermore, equipped with an attention-based Multi-Agent Target Generator and a Single-Agent Motion Planner, MAexp can work with arbitrary numbers of agents and accommodate various types of robots. Extensive experiments are conducted to establish the first benchmark featuring several high-performance MARL algorithms across typical scenarios for robots with continuous actions, which highlights the distinct strengths of each algorithm in different scenarios.


title: 360{\deg} phase detector cell for measurement systems based on switched dual multipliers

abstract: This letter presents a 360{\deg} phase detector cell for performing phase-shift measurements on multiple output systems. An analog phase detector, capable of detecting a maximum range of {\pm}90{\deg}, has been used to perform a double multiplication of two signals, both in-phase and phase-shifted. The proposed solution broadens the frequency range beyond other solutions that require to fulfill the quadrature condition. Subsequently, the possibility of reaching the theoretical limit of phase shift within a hybrid coupler ({\Phi} < 90{\deg} {\pm} 90{\deg}) is discussed by using four straight-line equations to characterize the phase detector response. The proposed solution allows to extend up to 360{\deg} the phase detection range and provide an increased immunity with respect to both impedance mismatching and phase deviations within the hybrid coupler. To demonstrate the feasibility of the proposed design, a phase detector cell prototype has been implemented using a commercial hybrid coupler with a phase shift of 92.5{\deg} {\pm} 0.5{\deg} at 3.1-5.9 GHz, an external switch and a microcontroller with 2 kB of memory. Measurements show a range of detection of 360{\deg} ({\pm}180{\deg}) across the tested frequency band of 2.7-6 GHz.


title: Semi-harmonious and harmonious quasi-projection pairs on Hilbert $C^*$-modules

abstract: For each adjointable idempotent $Q$ on a Hilbert $C^*$-module $H$, a specific projection $m(Q)$ called the matched projection of $Q$ was introduced recently due to the characterization of the minimum value among all the distances from projections to $Q$. Inspired by the relationship between $m(Q)$ and $Q$, another term called the quasi-projection pair $(P,Q)$ was also introduced recently, where $P$ is a projection on $H$ satisfying $Q^*=(2P-I)Q(2P-I)$, in which $Q^*$ is the adjoint operator of the idempotent $Q$ and $I$ is the identity operator on $H$. Some fundamental issues on quasi-projection pairs, such as the block matrix representations for quasi-projection pairs and the $C^*$-morphisms associated with quasi-projection pairs, are worthwhile to be investigated. This paper aims to make some detailed preparations. Two objects called the semi-harmonious quasi-projection pair and the harmonious quasi-projection pair are introduced and are systematically studied in the general setting of the adjointable operators on Hilbert $C^*$-modules. Some applications concerning the common similarity of operators and a norm equation associated with the Friedrichs angle are also dealt with. Furthermore, many examples are provided to illustrate the non-triviality of the associated characterizations.


title: CT-ADE: An Evaluation Benchmark for Adverse Drug Event Prediction from Clinical Trial Results

abstract: Adverse drug events (ADEs) significantly impact clinical research and public health, contributing to failures in clinical trials and leading to increased healthcare costs. The accurate prediction and management of ADEs are crucial for improving the development of safer, more effective medications, and enhancing patient outcomes. To support this effort, we introduce CT-ADE, a novel dataset compiled to enhance the predictive modeling of ADEs. Encompassing over 12,000 instances extracted from clinical trial results, the CT-ADE dataset integrates drug, patient population, and contextual information for multilabel ADE classification tasks in monopharmacy treatments, providing a comprehensive resource for developing advanced predictive models. To mirror the complex nature of ADEs, annotations are standardized at the system organ class level of the Medical Dictionary for Regulatory Activities (MedDRA) ontology. Preliminary analyses using baseline models have demonstrated promising results, achieving 73.33% F1 score and 81.54% balanced accuracy, highlighting CT-ADE's potential to advance ADE prediction. CT-ADE provides an essential tool for researchers aiming to leverage the power of artificial intelligence and machine learning to enhance patient safety and minimize the impact of ADEs on pharmaceutical research and development. Researchers interested in using the CT-ADE dataset can find all necessary resources at https://github.com/xxxx/xxxx.


title: Low solution rank of the matrix LASSO under RIP with consequences for rank-constrained algorithms

abstract: We show that solutions to the popular convex matrix LASSO problem (nuclear-norm--penalized linear least-squares) have low rank under similar assumptions as required by classical low-rank matrix sensing error bounds. Although the purpose of the nuclear norm penalty is to promote low solution rank, a proof has not yet (to our knowledge) been provided outside very specific circumstances. Furthermore, we show that this result has significant theoretical consequences for nonconvex rank-constrained optimization approaches. Specifically, we show that if (a) the ground truth matrix has low rank, (b) the (linear) measurement operator has the matrix restricted isometry property (RIP), and (c) the measurement error is small enough relative to the nuclear norm penalty, then the (unique) LASSO solution has rank (approximately) bounded by that of the ground truth. From this, we show (a) that a low-rank--projected proximal gradient descent algorithm will converge linearly to the LASSO solution from any initialization, and (b) that the nonconvex landscape of the low-rank Burer-Monteiro--factored problem formulation is benign in the sense that all second-order critical points are globally optimal and yield the LASSO solution.


title: LiMe: a Latin Corpus of Late Medieval Criminal Sentences

abstract: The Latin language has received attention from the computational linguistics research community, which has built, over the years, several valuable resources, ranging from detailed annotated corpora to sophisticated tools for linguistic analysis. With the recent advent of large language models, researchers have also started developing models capable of generating vector representations of Latin texts. The performances of such models remain behind the ones for modern languages, given the disparity in available data. In this paper, we present the LiMe dataset, a corpus of 325 documents extracted from a series of medieval manuscripts called Libri sententiarum potestatis Mediolani, and thoroughly annotated by experts, in order to be employed for masked language model, as well as supervised natural language processing tasks.


title: Optimal Training Design for Over-the-Air Polynomial Power Amplifier Model Estimation

abstract: The current evolution towards a massive number of antennas and a large variety of transceiver architectures forces to revisit the conventional techniques used to improve the fundamental power amplifier (PA) linearity-efficiency trade-off. Most of the digital linearization techniques rely on PA measurements using a dedicated feedback receiver. However, in modern systems with large amount of RF chains and high carrier frequency, dedicated receiver per RF chain is costly and complex to implement. This issue can be addressed by measuring PAs over the air, but in that case, this extra signalling is sharing resources with the actual data transmission. In this paper, we look at the problem from an estimation theory point of view so as to minimize pilot overhead while optimizing estimation performance. We show that conventional results in the mathematical statistics community can be used. We find the least squares (LS) optimal training design, minimizing the maximal mean squared error (MSE) of the reconstructed PA response over its whole input range. As compared to uniform training, simulations demonstrate a factor 10 reduction of the maximal MSE for a L = 7 PA polynomial order. Using prior information, the LMMSE estimator can achieve an additional gain of a factor up to 300 at low signal-to-noise ratio (SNR).


title: On extremal points for some vectorial total variation seminorms

abstract: We consider the set of extremal points of the generalized unit ball induced by gradient total variation seminorms for vector-valued functions on bounded Euclidean domains. These extremal points are central to the understanding of sparse solutions and sparse optimization algorithms for variational regularization problems posed among such functions. For not fully vectorial cases in which either the domain or the target are one dimensional, or the sum of the total variations of each component is used, we prove that these extremals are fully characterized as in the scalar-valued case, that is, they consist of piecewise constant functions with two regions. For definitions involving more involved matrix norms and in particular spectral norms, which are of interest in image processing, we produce families of examples to show that the resulting set of extremal points is larger and includes piecewise constant functions with more than two regions. We also consider the total deformation induced by the symmetrized gradient, for which minimization with linear constraints appears in problems of determination of limit loads in a number of continuum mechanical models involving plasticity, bringing relevance to the corresponding extremal points. For this case, we show piecewise infinitesimally rigid functions with two pieces to be extremal under mild assumptions. Finally, as an example of an extremal which is not piecewise constant, we prove that unit radial vector fields are extremal for the Frobenius total variation in the plane.


title: COIN: Counterfactual inpainting for weakly supervised semantic segmentation for medical images

abstract: Deep learning is dramatically transforming the field of medical imaging and radiology, enabling the identification of pathologies in medical images, including computed tomography (CT) and X-ray scans. However, the performance of deep learning models, particularly in segmentation tasks, is often limited by the need for extensive annotated datasets. To address this challenge, the capabilities of weakly supervised semantic segmentation are explored through the lens of Explainable AI and the generation of counterfactual explanations. The scope of this research is development of a novel counterfactual inpainting approach (COIN) that flips the predicted classification label from abnormal to normal by using a generative model. For instance, if the classifier deems an input medical image X as abnormal, indicating the presence of a pathology, the generative model aims to inpaint the abnormal region, thus reversing the classifier's original prediction label. The approach enables us to produce precise segmentations for pathologies without depending on pre-existing segmentation masks. Crucially, image-level labels are utilized, which are substantially easier to acquire than creating detailed segmentation masks. The effectiveness of the method is demonstrated by segmenting synthetic targets and actual kidney tumors from CT images acquired from Tartu University Hospital in Estonia. The findings indicate that COIN greatly surpasses established attribution methods, such as RISE, ScoreCAM, and LayerCAM, as well as an alternative counterfactual explanation method introduced by Singla et al. This evidence suggests that COIN is a promising approach for semantic segmentation of tumors in CT images, and presents a step forward in making deep learning applications more accessible and effective in healthcare, where annotated data is scarce.


title: How Far Can We Go with Practical Function-Level Program Repair?

abstract: Recently, multiple Automated Program Repair (APR) techniques based on Large Language Models (LLMs) have been proposed to enhance the repair performance. While these techniques mainly focus on the single-line or hunk-level repair, they face significant challenges in real-world application due to the limited repair task scope and costly statement-level fault localization. However, the more practical function-level APR, which broadens the scope of APR task to fix entire buggy functions and requires only cost-efficient function-level fault localization, remains underexplored. In this paper, we conduct the first comprehensive study of LLM-based function-level APR including investigating the effect of the few-shot learning mechanism and the auxiliary repair-relevant information. Specifically, we adopt six widely-studied LLMs and construct a benchmark in both the Defects4J 1.2 and 2.0 datasets. Our study demonstrates that LLMs with zero-shot learning are already powerful function-level APR techniques, while applying the few-shot learning mechanism leads to disparate repair performance. Moreover, we find that directly applying the auxiliary repair-relevant information to LLMs significantly increases function-level repair performance. Inspired by our findings, we propose an LLM-based function-level APR technique, namely SRepair, which adopts a dual-LLM framework to leverage the power of the auxiliary repair-relevant information for advancing the repair performance. The evaluation results demonstrate that SRepair can correctly fix 300 single-function bugs in the Defects4J dataset, largely surpassing all previous APR techniques by at least 85%, without the need for the costly statement-level fault location information. Furthermore, SRepair successfully fixes 32 multi-function bugs in the Defects4J dataset, which is the first time achieved by any APR technique ever to our best knowledge.


title: A note on Combinatorial Invariance of Kazhdan--Lusztig polynomials

abstract: We introduce the concepts of an amazing hypercube decomposition and a double shortcut for it, and use these new ideas to formulate a conjecture implying the Combinatorial Invariance Conjecture of the Kazhdan--Lusztig polynomials for the symmetric group. This conjecture has the advantage of being combinatorial in nature.


title: Distinguishing radiation mechanisms and particle populations in blazar jets through long-term multi-band monitoring with RINGO3 and Fermi

abstract: We present the results of seven years of multicolour photometric monitoring of a sample of 31 $\gamma$-ray bright blazars using the RINGO3 polarimeter on the Liverpool Telescope from 2013--2020. We explore the relationships between simultaneous observations of flux in three optical wavebands along with Fermi $\gamma$-ray data in order to explore the radiation mechanisms and particle populations in blazar jets. We find significant correlations between optical and $\gamma$-ray flux with no detectable time lag, suggesting leptonic emission processes in the jets of these sources. Furthermore, we find the spectral behaviour against optical and $\gamma$-ray flux for many sources is best fit logarithmically. This is suggestive of a transition between bluer-/redder-when-brighter into stable-when-brighter behaviour during high activity states; a behaviour that might be missed in poorly sampled data, resulting in apparent linear relationships.


title: Martin's Maximum${}^{\ast, ++}_{\mathfrak{c}}$ in $\mathbb{P}_{\max}$ extensions of strong models of determinacy

abstract: We study a strengthening of $\mathrm{MM}^{++}$ which is called $\mathrm{MM}^{\ast, ++}$ and which was introduced by Asper\'o and Schindler. We force its bounded version $\mathrm{MM}^{\ast, ++}_{\mathfrak{c}}$, which is stronger than both $\mathrm{MM}^{++}(\mathfrak{c})$ as well as $\mathrm{BMM}^{++}$, by $\mathbb{P}_{\max}$ forcing over a determinacy model $L^{F_{\mathrm{uB}}}({\mathbb R}^*,\mbox{Hom}^{\ast})$. The construction of the ground model $L^{F_{\mathrm{uB}}}({\mathbb R}^{\ast},\mbox{Hom}^{\ast})$ builds upon Gappo and Sargsyan, and the derived model construction of Larson, Sargsyan, and Wilson.


title: Towards a decentralized data privacy protocol for self-sovereignty in the digital world

abstract: A typical user interacts with many digital services nowadays, providing these services with their data. As of now, the management of privacy preferences is service-centric: Users must manage their privacy preferences according to the rules of each service provider, meaning that every provider offers its unique mechanisms for users to control their privacy settings. However, managing privacy preferences holistically (i.e., across multiple digital services) is just impractical. In this vision paper, we propose a paradigm shift towards an enriched user-centric approach for cross-service privacy preferences management: the realization of a decentralized data privacy protocol.


title: Getting to the Root of the Problem: Sums of Squares for Infinite Trees

abstract: The inducibility of a graph represents its maximum density as an induced subgraph over all possible sequences of graphs of size growing to infinity. This invariant of graphs has been extensively studied since its introduction in $1975$ by Pippenger and Golumbic. In $2017$, Czabarka, Sz\'ekely and Wagner extended this notion to leaf-labeled rooted binary trees, which are objects widely studied in the field of phylogenetics. They obtain the first results and bounds for the densities and inducibilities of such trees. Following up on their work, we apply Razborov's flag algebra theory to this setting, introducing the flag algebra of rooted leaf-labeled binary trees. This framework allows us to use polynomial optimization methods, based on semidefinite programming, to efficiently obtain new upper bounds for the inducibility of trees and to improve existing ones. Additionally, we obtain the first outer approximations of profiles of trees, which represent all possible simultaneous densities of a pair of trees. Finally, we are able to prove the non-convexity of some of these profiles.


title: ECOR: Explainable CLIP for Object Recognition

abstract: Large Vision Language Models (VLMs), such as CLIP, have significantly contributed to various computer vision tasks, including object recognition and object detection. Their open vocabulary feature enhances their value. However, their black-box nature and lack of explainability in predictions make them less trustworthy in critical domains. Recently, some work has been done to force VLMs to provide reasonable rationales for object recognition, but this often comes at the expense of classification accuracy. In this paper, we first propose a mathematical definition of explainability in the object recognition task based on the joint probability distribution of categories and rationales, then leverage this definition to fine-tune CLIP in an explainable manner. Through evaluations of different datasets, our method demonstrates state-of-the-art performance in explainable classification. Notably, it excels in zero-shot settings, showcasing its adaptability. This advancement improves explainable object recognition, enhancing trust across diverse applications. The code will be made available online upon publication.


title: On the $L^2$ volume of Bergman spaces

abstract: In this paper, we show that the Calabi volume and Mabuchi volume of Bergman spaces on the product of a projective manifold and a projective space is infinite. Our result is inspired by a conjecture of Shiffman-Zelditch in [arXiv:2303.11559].


title: Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet

abstract: Deepfake technology, derived from deep learning, seamlessly inserts individuals into digital media, irrespective of their actual participation. Its foundation lies in machine learning and Artificial Intelligence (AI). Initially, deepfakes served research, industry, and entertainment. While the concept has existed for decades, recent advancements render deepfakes nearly indistinguishable from reality. Accessibility has soared, empowering even novices to create convincing deepfakes. However, this accessibility raises security concerns.The primary deepfake creation algorithm, GAN (Generative Adversarial Network), employs machine learning to craft realistic images or videos. Our objective is to utilize CNN (Convolutional Neural Network) and CapsuleNet with LSTM to differentiate between deepfake-generated frames and originals. Furthermore, we aim to elucidate our model's decision-making process through Explainable AI, fostering transparent human-AI relationships and offering practical examples for real-life scenarios.


title: Accurate and Fast Geometry Optimization with Time Estimation and Method Switching

abstract: Geometry optimization is an important task in quantum chemical calculations to analyze the characteristics of molecules. A top concern on it is a long execution time because time-consuming energy and gradient calculations are repeated across several to tens of steps. In this work, we present a scheme to estimate the execution times of geometry optimization of a target molecule at different accuracy levels (i.e., the combinations of ab initio methods and basis sets). It enables to identify the accuracy levels where geometry optimization will finish in an acceptable time. In addition, we propose a gradient-based method switching (GMS) technique that reduces the execution time by dynamically switching multiple methods during geometry optimization. Our evaluation using 46 molecules in total shows that the geometry optimization times at 20 accuracy levels are estimated with a mean error of 29.5%, and GMS reduces the execution time by up to 42.7% without affecting the accuracy of geometry optimization.


title: Towards Logically Consistent Language Models via Probabilistic Reasoning

abstract: Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict themselves when prompted to reason about beliefs of the world. These problems are currently addressed with large scale fine-tuning or by delegating consistent reasoning to external tools. In this work, we strive for a middle ground and introduce a training objective based on principled probabilistic reasoning that teaches a LLM to be consistent with external knowledge in the form of a set of facts and rules. Fine-tuning with our loss on a limited set of facts enables our LLMs to be more logically consistent than previous baselines and allows them to extrapolate to unseen but semantically similar factual knowledge more systematically.


title: Failures of integral Springer's Theorem

abstract: We discuss the phenomenon where an element in a number field is not integrally represented by a given positive definite quadratic form, but becomes integrally represented by this form over a totally real extension of odd degree. We prove that this phenomenon happens infinitely often, and, conversely, establish finiteness results about the situation when the quadratic form is fixed.


title: TartuNLP @ SIGTYP 2024 Shared Task: Adapting XLM-RoBERTa for Ancient and Historical Languages

abstract: We present our submission to the unconstrained subtask of the SIGTYP 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languages for morphological annotation, POS-tagging, lemmatization, character- and word-level gap-filling. We developed a simple, uniform, and computationally lightweight approach based on the adapters framework using parameter-efficient fine-tuning. We applied the same adapter-based approach uniformly to all tasks and 16 languages by fine-tuning stacked language- and task-specific adapters. Our submission obtained an overall second place out of three submissions, with the first place in word-level gap-filling. Our results show the feasibility of adapting language models pre-trained on modern languages to historical and ancient languages via adapter training.


title: KoReA-SFL: Knowledge Replay-based Split Federated Learning Against Catastrophic Forgetting

abstract: Although Split Federated Learning (SFL) is good at enabling knowledge sharing among resource-constrained clients, it suffers from the problem of low training accuracy due to the neglect of data heterogeneity and catastrophic forgetting. To address this issue, we propose a novel SFL approach named KoReA-SFL, which adopts a multi-model aggregation mechanism to alleviate gradient divergence caused by heterogeneous data and a knowledge replay strategy to deal with catastrophic forgetting. Specifically, in KoReA-SFL cloud servers (i.e., fed server and main server) maintain multiple branch model portions rather than a global portion for local training and an aggregated master-model portion for knowledge sharing among branch portions. To avoid catastrophic forgetting, the main server of KoReA-SFL selects multiple assistant devices for knowledge replay according to the training data distribution of each server-side branch-model portion. Experimental results obtained from non-IID and IID scenarios demonstrate that KoReA-SFL significantly outperforms conventional SFL methods (by up to 23.25\% test accuracy improvement).


title: Banach Lie groupoid of partial isometries over restricted Grassmannian

abstract: The differential structure on the set of partial isometries over the restricted Grassmannian is constructed, which makes it a Banach Lie groupoid.


title: Boundary regularity for a general nonlinear parabolic equation in non-divergence form

abstract: We characterize regular boundary points in terms of a barrier family for a general form of a parabolic equation that generalizes both the standard parabolic $p$-Laplace equation and the normalized version arising from stochastic game theory. Using this result we prove geometric conditions that ensure regularity by constructing suitable barrier families. We also prove that when $q<2$, a single barrier does not suffice to guarantee regularity.


title: An improvement and generalization of Rotfel'd type inequalities for sectorial matrices

abstract: Byusing equivalence conditions for sectorial matrices obtained by Alakhrass and Sababheh in 2020, we improve a Rotfel'd type inequality for sectorial matrices derived by P. Zhang in 2015 and generalize a result derived by Y. Mao et al. in 2024.


title: CaBaFL: Asynchronous Federated Learning via Hierarchical Cache and Feature Balance

abstract: Federated Learning (FL) as a promising distributed machine learning paradigm has been widely adopted in Artificial Intelligence of Things (AIoT) applications. However, the efficiency and inference capability of FL is seriously limited due to the presence of stragglers and data imbalance across massive AIoT devices, respectively. To address the above challenges, we present a novel asynchronous FL approach named CaBaFL, which includes a hierarchical Cache-based aggregation mechanism and a feature Balance-guided device selection strategy. CaBaFL maintains multiple intermediate models simultaneously for local training. The hierarchical cache-based aggregation mechanism enables each intermediate model to be trained on multiple devices to align the training time and mitigate the straggler issue. In specific, each intermediate model is stored in a low-level cache for local training and when it is trained by sufficient local devices, it will be stored in a high-level cache for aggregation. To address the problem of imbalanced data, the feature balance-guided device selection strategy in CaBaFL adopts the activation distribution as a metric, which enables each intermediate model to be trained across devices with totally balanced data distributions before aggregation. Experimental results show that compared with the state-of-the-art FL methods, CaBaFL achieves up to 9.26X training acceleration and 19.71\% accuracy improvements.


title: A Semi-orthogonal Sequence in the Derived Category of the Hilbert Scheme of Three Points

abstract: For a smooth projective variety $X$ of dimension $d \geq 5$ over an algebraically closed field $k$ of characteristic zero, it is shown in this paper that the bounded derived category of the Hilbert scheme of three points $X^{[3]}$ admits a semi-orthogonal sequence of length $\binom{d-3}{2}$. Each subcategory in this sequence is equivalent to the derived category of $X$ and realized as the image of a Fourier-Mukai transform along a Grassmannian bundle $\mathbb{G}$ over $X$ parametrizing planar subschemes in $X^{[3]}$. The main ingredient in the proof is the computation of the normal bundle of $\mathbb{G}$ in $X^{[3]}$. An analogous result for generalized Kummer varieties is deduced at the end.


title: LSP Framework: A Compensatory Model for Defeating Trigger Reverse Engineering via Label Smoothing Poisoning

abstract: Deep neural networks are vulnerable to backdoor attacks. Among the existing backdoor defense methods, trigger reverse engineering based approaches, which reconstruct the backdoor triggers via optimizations, are the most versatile and effective ones compared to other types of methods. In this paper, we summarize and construct a generic paradigm for the typical trigger reverse engineering process. Based on this paradigm, we propose a new perspective to defeat trigger reverse engineering by manipulating the classification confidence of backdoor samples. To determine the specific modifications of classification confidence, we propose a compensatory model to compute the lower bound of the modification. With proper modifications, the backdoor attack can easily bypass the trigger reverse engineering based methods. To achieve this objective, we propose a Label Smoothing Poisoning (LSP) framework, which leverages label smoothing to specifically manipulate the classification confidences of backdoor samples. Extensive experiments demonstrate that the proposed work can defeat the state-of-the-art trigger reverse engineering based methods, and possess good compatibility with a variety of existing backdoor attacks.


title: Perspective on descriptors of mechanical behavior of cubic transition-metal carbides and nitrides

abstract: Cubic rocksalt structured transition-metal carbides, nitrides, and related alloys (TMC/Ns) are attractive for a wide variety of applications, notably as hard, wear-resistant material. To-date, valence electron concentration (VEC) is used as a good indicator of stability and mechanical properties of these refractory compounds. In this perspective, we argue for the need for electronic descriptors beyond VEC to explain and predict the mechanical behavior of the cubic TMC/Ns. As such, we point out that descriptors that highlight differences between constituent have been underused, along with semi-empirical models of mechanical properties. Additionally, it appears promising to partition VEC into contribution to ionic, covalent, and metallic bonds and we suggest that such partition could provide more insight into predicting mechanical properties in the future.


title: Migrating Software Systems towards Post-Quantum-Cryptography -- A Systematic Literature Review

abstract: Networks such as the Internet are essential for our connected world. Quantum computing poses a threat to this heterogeneous infrastructure since it threatens fundamental security mechanisms. Therefore, a migration to post-quantum-cryptography (PQC) is necessary for networks and their components. At the moment, there is little knowledge on how such migrations should be structured and implemented in practice. Our systematic literature review addresses migration approaches for IP networks towards PQC. It surveys papers about the migration process and exemplary real-world software system migrations. On the process side, we found that terminology, migration steps, and roles are not defined precisely or consistently across the literature. Still, we identified four major phases and appropriate substeps which we matched with also emerging archetypes of roles. In terms of real-world migrations, we see that reports used several different PQC implementations and hybrid solutions for migrations of systems belonging to a wide range of system types. Across all papers we noticed three major challenges for adopters: missing experience of PQC and a high realization effort, concerns about the security of the upcoming system, and finally, high complexity. Our findings indicate that recent standardization efforts already push quantum-safe networking forward. However, the literature is still not in consensus about definitions and best practices. Implementations are mostly experimental and not necessarily practical, leading to an overall chaotic situation. To better grasp this fast moving field of (applied) research, our systematic literature review provides a comprehensive overview of its current state and serves as a starting point for delving into the matter of PQC migration.


title: Ransomware Detection and Classification Using Random Forest: A Case Study with the UGRansome2024 Dataset

abstract: Cybersecurity faces challenges in identifying and mitigating ransomware, which is important for protecting critical infrastructures. The absence of datasets for distinguishing normal versus abnormal network behaviour hinders the development of proactive detection strategies against ransomware. An obstacle in proactive prevention methods is the absence of comprehensive datasets for contrasting normal versus abnormal network behaviours. The dataset enabling such contrasts would significantly expedite threat anomaly mitigation. In this study, we introduce UGRansome2024, an optimised dataset for ransomware detection in network traffic. This dataset is derived from the UGRansome data using an intuitionistic feature engineering approach that considers only relevant patterns in network behaviour analysis. The study presents an analysis of ransomware detection using the UGRansome2024 dataset and the Random Forest algorithm. Through encoding and feature relevance determination, the Random Forest achieved a classification accuracy of 96% and effectively identified unusual ransomware transactions. Findings indicate that certain ransomware variants, such as those utilising Encrypt Decrypt Algorithms (EDA) and Globe ransomware, have the highest financial impact. These insights have significant implications for real-world cybersecurity practices, highlighting the importance of machine learning in ransomware detection and mitigation. Further research is recommended to expand datasets, explore alternative detection methods, and address limitations in current approaches.


title: Language-Driven Active Learning for Diverse Open-Set 3D Object Detection

abstract: Object detection is crucial for ensuring safe autonomous driving. However, data-driven approaches face challenges when encountering minority or novel objects in the 3D driving scene. In this paper, we propose VisLED, a language-driven active learning framework for diverse open-set 3D Object Detection. Our method leverages active learning techniques to query diverse and informative data samples from an unlabeled pool, enhancing the model's ability to detect underrepresented or novel objects. Specifically, we introduce the Vision-Language Embedding Diversity Querying (VisLED-Querying) algorithm, which operates in both open-world exploring and closed-world mining settings. In open-world exploring, VisLED-Querying selects data points most novel relative to existing data, while in closed-world mining, it mines novel instances of known classes. We evaluate our approach on the nuScenes dataset and demonstrate its efficiency compared to random sampling and entropy-querying methods. Our results show that VisLED-Querying consistently outperforms random sampling and offers competitive performance compared to entropy-querying despite the latter's model-optimality, highlighting the potential of VisLED for improving object detection in autonomous driving scenarios. We make our code publicly available at https://github.com/Bjork-crypto/VisLED-Querying


title: Development of Two-Dimensional Neutron Imager with a Sandwich Configuration

abstract: We have developed a two-dimensional neutron imager based on a semiconductor pixelated sensor, especially designed for experiments measuring of a spatial and a temporal behavior of quantum bound states of ultra-cold neutrons. Through these measurements, we expect to measure the ratio between the inertial and gravitational masses of neutrons and to test the equivalence principle in the quantum regime. As one of the principal neutron imagers, we fabricated a sensor with a sandwich configuration, named 10B-INTPIX4-sw, and tested its response to ultra-cold neutrons at the Los Alamos Neutron Science Center (LANSCE). We observed simultaneous events on both sandwiching sensors without significant loss of detection efficiency. The efficiency was evaluated to be about 16%, relative to the 10B/ZnS reference detector. The coincidence condition reduces its efficiency by a factor of about 3.


title: Relative Energy Method For Weak-Strong Uniqueness Of The Inhomogeneous Navier-Stokes Equations

abstract: We present a weak-strong uniqueness result for the inhomogeneous Navier-Stokes (INS) equations in $\mathbb{R}^d$ ($d=2,3$) for bounded initial densities that are far from vacuum. Given a strong solution within the class employed in Paicu, Zhang and Zhang (2013) and Chen, Zhang and Zhao (2016), and a Leray-Hopf weak solution, we establish that they coincide if the initial data agree. The strategy of our proof is based on the relative energy method and new $W^{-1,p}$-type stability estimates for the density. A key point lies in proving that every Leray-Hopf weak solution originating from initial densities far from vacuum remains distant from vacuum at all times.


title: Circular Photocurrents in Centrosymmetric Semiconductors with Hidden Spin Polarization

abstract: Centrosymmetric materials with site inversion asymmetries possess hidden spin polarization, which remains challenging to be converted into spin currents because the global inversion symmetry is still conserved. This study demonstrates the spin-polarized DC circular photocurrents (CPC) in centrosymmetric transition metal dichalcogenides (TMDCs) at normal incidence without applying electric bias. The global inversion symmetry is broken by using a spatially-varying circularly polarized light beam, which could generate spin gradient owing to the hidden spin polarization. The dependences of the CPC on electrode configuration, illumination position, and beam spot size indicate an emergence of circulating electric current under spatially inhomogeneous light, which is associated with the deflection of spin-polarized current through the inverse spin Hall effect (ISHE). The CPC is subsequently utilized to probe the spin polarization and ISHE under different excitation wavelengths and temperatures. The results of this study demonstrate the feasibility of using centrosymmetric materials with hidden spin polarization and non-vanishing Berry curvature for spintronic device applications.


title: Nonreciprocal PT-symmetric phase transition in a non-Hermitian chiral quantum optical system

abstract: Phase transitions, non-Hermiticity and nonreciprocity play central roles in fundamental physics. However, the triple interplay of these three fields is of lack in the quantum domain. Here, we show nonreciprocal parity-time-symmetric phase transition in a non-Hermitian chiral quantum electrodynamical system, caused by the directional system dissipation. In remarkable contrast to previously reported nonreciprocal phase transitions, the nonreciprocal parity-time-symmetric phases appear even when the atom-resonator coupling is reciprocal. Nonreciprocal photon blockade is obtained in the nonreciprocal phase region. These results may deepen the fundamental insight of nonreciprocal and non-Hermitian quantum physics, and also open a new door for unconventional quantum manipulation.


title: Foundation Model assisted Weakly Supervised LiDAR Semantic Segmentation

abstract: Current point cloud semantic segmentation has achieved great advances when given sufficient labels. However, the dense annotation of LiDAR point clouds remains prohibitively expensive and time-consuming, unable to keep up with the continuously growing volume of data. In this paper, we propose annotating images with scattered points, followed by utilizing SAM (a Foundation model) to generate semantic segmentation labels for the images. Finally, by mapping the segmentation labels of the images to the LiDAR space using the intrinsic and extrinsic parameters of the camera and LiDAR, we obtain labels for point cloud semantic segmentation, and release Scatter-KITTI and Scatter-nuScenes, which are the first works to utilize image segmentation-based SAM for weakly supervised point cloud semantic segmentation. Furthermore, to mitigate the influence of erroneous pseudo labels obtained from sparse annotations on point cloud features, we propose a multi-modal weakly supervised network for LiDAR semantic segmentation, called MM-ScatterNet. This network combines features from both point cloud and image modalities, enhancing the representation learning of point clouds by introducing consistency constraints between multi-modal features and point cloud features. On the SemanticKITTI dataset, we achieve 66\% of fully supervised performance using only 0.02% of annotated data, and on the NuScenes dataset, we achieve 95% of fully supervised performance using only 0.1% labeled points.


title: A Guide to Feature Importance Methods for Scientific Inference

abstract: While machine learning (ML) models are increasingly used due to their high predictive power, their use in understanding the data-generating process (DGP) is limited. Understanding the DGP requires insights into feature-target associations, which many ML models cannot directly provide, due to their opaque internal mechanisms. Feature importance (FI) methods provide useful insights into the DGP under certain conditions. Since the results of different FI methods have different interpretations, selecting the correct FI method for a concrete use case is crucial and still requires expert knowledge. This paper serves as a comprehensive guide to help understand the different interpretations of FI methods. Through an extensive review of FI methods and providing new proofs regarding their interpretation, we facilitate a thorough understanding of these methods and formulate concrete recommendations for scientific inference. We conclude by discussing options for FI uncertainty estimation and point to directions for future research aiming at full statistical inference from black-box ML models.


title: Grid-aware Scheduling and Control of Electric Vehicle Charging Stations for Dispatching Active Distribution Networks. Part-I: Day-ahead and Numerical Validation

abstract: This paper proposes a grid-aware scheduling and control framework for Electric Vehicle Charging Stations (EVCSs) for dispatching the operation of an active power distribution network. The framework consists of two stages. In the first stage, we determine an optimal day-ahead power schedule at the grid connection point (GCP), referred to as the dispatch plan. Then, in the second stage, a real-time model predictive control is proposed to track the day-ahead dispatch plan using flexibility from EVCSs. The dispatch plan accounts for the uncertainties of vehicles connected to the EVCS along with other uncontrollable power injections, by day-ahead predicted scenarios. We propose using a Gaussian-Mixture-Model (GMM) for the forecasting of EVCS demand using the historical dataset on arrival, departure times, EV battery capacity, State-of-Charge (SoC) targets, etc. The framework ensures that the grid is operated within its voltage and branches power-flow operational bounds, modeled by a linearized optimal power-flow model, maintaining the tractability of the problem formulation. The scheme is numerically and experimentally validated on a real-life distribution network at the EPFL connected to two EVCSs, two batteries, three photovoltaic plants, and multiple heterogeneous loads. The day-ahead and real-time stages are described in Part-I and Part-II papers respectively.


title: Nyon Unchained: Forensic Analysis of Bosch's eBike Board Computers

abstract: Modern eBike on-board computers are basically small PCs that not only offer motor control, navigation, and performance monitoring, but also store lots of sensitive user data. The Bosch Nyon series of board computers are cutting-edge devices from one of the market leaders in the eBike business, which is why they are especially interesting for forensics. Therefore, we conducted an in-depth forensic analysis of the two available Nyon models released in 2014 and 2021. On a first-generation Nyon device, Telnet access could be established by abusing a design flaw in the update procedure, which allowed the acquisition of relevant data without risking damage to the hardware. Besides the user's personal information, the data analysis revealed databases containing user activities, including timestamps and GPS coordinates. Furthermore, it was possible to forge the data on the device and transfer it to Bosch's servers to be persisted across their online service and smartphone app. On a current second-generation Nyon device, no software-based access could be obtained. For this reason, more intrusive hardware-based options were considered, and the data could be extracted via chip-off eventually. Despite encryption, the user data could be accessed and evaluated. Besides location and user information, the newer model holds even more forensically relevant data, such as nearby Bluetooth devices.


title: A minimal model of boosting and waning iin a recurrent seasonal epidemic

abstract: We propose a model of the immunity to a cyclical epidemic disease taking account not only of seasonal boosts during the infectious season, but also of residual immunity remaining from one season to the next. The focus is on the exponential waning process over successive cycles, imposed on the temporal distribution of infections or exposures over a season. This distribution, interacting with the waning function, is all that is necessary to reproduce, in mathematically closed form, the mechanical cycle of boosting and waning immunity characteristic of recurrent seasonal infectious disease. Distinct from epidemiological models predicting numbers of individuals moving between infectivity compartments, our result enables us to directly estimate parameters of waning and the infectivity distribution. We can naturally iterate the cyclical process to simulate immunity trajectories over many years and thus to quantify the strong relationship between residual immunity and the time elapsed between annual infectivity peaks.


title: How Does the Textual Information Affect the Retrieval of Multimodal In-Context Learning?

abstract: The increase in parameter size of multimodal large language models (MLLMs) introduces significant capabilities, particularly in-context learning, where MLLMs enhance task performance without updating pre-trained parameters. This effectiveness, however, hinges on the appropriate selection of in-context examples, a process that is currently biased towards visual data, overlooking textual information. Furthermore, the area of supervised retrievers for MLLMs, crucial for optimal in-context example selection, continues to be uninvestigated. Our study offers an in-depth evaluation of the impact of textual information on the unsupervised selection of in-context examples in multimodal contexts, uncovering a notable sensitivity of retriever performance to the employed modalities. Responding to this, we introduce a novel supervised MLLM-retriever MSIER that employs a neural network to select examples that enhance multimodal in-context learning efficiency. This approach is validated through extensive testing across three distinct tasks, demonstrating the method's effectiveness. Additionally, we investigate the influence of modalities on our supervised retrieval method's training and pinpoint factors contributing to our model's success. This exploration paves the way for future advancements, highlighting the potential for refined in-context learning in MLLMs through the strategic use of multimodal data.


title: FipTR: A Simple yet Effective Transformer Framework for Future Instance Prediction in Autonomous Driving

abstract: The future instance prediction from a Bird's Eye View(BEV) perspective is a vital component in autonomous driving, which involves future instance segmentation and instance motion prediction. Existing methods usually rely on a redundant and complex pipeline which requires multiple auxiliary outputs and post-processing procedures. Moreover, estimated errors on each of the auxiliary predictions will lead to degradation of the prediction performance. In this paper, we propose a simple yet effective fully end-to-end framework named Future Instance Prediction Transformer(FipTR), which views the task as BEV instance segmentation and prediction for future frames. We propose to adopt instance queries representing specific traffic participants to directly estimate the corresponding future occupied masks, and thus get rid of complex post-processing procedures. Besides, we devise a flow-aware BEV predictor for future BEV feature prediction composed of a flow-aware deformable attention that takes backward flow guiding the offset sampling. A novel future instance matching strategy is also proposed to further improve the temporal coherence. Extensive experiments demonstrate the superiority of FipTR and its effectiveness under different temporal BEV encoders.


title: Coding for Composite DNA to Correct Substitutions, Strand Losses, and Deletions

abstract: Composite DNA is a recent method to increase the base alphabet size in DNA-based data storage.This paper models synthesizing and sequencing of composite DNA and introduces coding techniques to correct substitutions, losses of entire strands, and symbol deletion errors. Non-asymptotic upper bounds on the size of codes with $t$ occurrences of these error types are derived. Explicit constructions are presented which can achieve the bounds.


title: Tribo-piezoelectric Nanogenerators for Energy Harvesting: a first-principles study

abstract: Two-dimensional transition metal dichalcogenides (TMDs) are highly promising candidates for various applications due to their unique electrical, optical, mechanical, and chemical properties. Furthermore, heterostructures consisting of TMDs with metals, oxides, and conductive materials have attracted significant research interest due to their exceptional electronic properties. In this study, we utilized density functional theory to investigate those electronic and transport properties, which are relevant for the application of tribo-piezoelectricity in creating novel nanogenerators: an interdisciplinary approach with promising implications. The results of the study demonstrate that the enhancement of charge transfer between layers and the orbital contribution to the Fermi level under applied strain in MoS/IrO, MoS/TiO, MoS/WTe, and MoTe/WS heterostructures is noteworthy. Additionally, non-equilibrium Green's function calculations of electron transport properties provide valuable insights into the behavior of these materials under different conditions. While MoS/IrO and MoS/TiO hetero-bilayers are unsuitable due to their tendency to exhibit large current flow with increasing voltage, others like MoS/WTe and MoTe/WS hetero bilayers show promise due to their ability to prevent voltage drop. The presented innovative concept of utilizing compressive strain of TMD bilayers to generate a tribo-piezoelectric effect for nanogenerators has a potential to contribute to the development of efficient and sustainable energy harvesting devices.


title: Grid-aware Scheduling and Control of Electric Vehicle Charging Stations for Dispatching Active Distribution Networks. Part-II: Intra-day and Experimental Validation

abstract: In Part-I, we presented an optimal day-ahead scheduling scheme for dispatching active distribution networks accounting for the flexibility provided by electric vehicle charging stations (EVCSs) and other controllable resources such as battery energy storage systems (BESSs). Part-II presents the intra-day control layer for tracking the dispatch plan computed from the day-ahead scheduling stage. The control problem is formulated as model predictive control (MPC) with an objective to track the dispatch plan setpoint every 5 minutes, while actuated every 30 seconds. MPC accounts for the uncertainty of the power injections from stochastic resources (such as demand and generation from photovoltaic - PV plants) by short-term forecasts. MPC also accounts for the grid's operational constraints (i.e., the limits on the nodal voltages and the line power-flows) by a linearized optimal power flow (LOPF) model based on the power-flow sensitivity coefficients, and for the operational constraints of the controllable resources (i.e., BESSs and EVCSs). The proposed framework is experimentally validated on a real-life ADN at the EPFL's Distributed Electrical Systems Laboratory and is composed of a medium voltage (MV) bus connected to three low voltage distribution networks. It hosts two controllable EVCSs (172 kWp and 32 F~kWp), multiple PV plants (aggregated generation of 42~kWp), uncontrollable demand from office buildings (20 kWp), and two controllable BESSs (150kW/300kWh and 25kW/25kWh).


title: Expanding the Katz Index for Link Prediction: A Case Study on a Live Fish Movement Network

abstract: In aquaculture, disease spread models often neglect the dynamic interactions between farms, hindering accuracy. This study enhances the Katz index (KI) to incorporate spatial and temporal patterns of fish movement, improving the prediction of farms susceptible to disease via live fish transfers. We modified the Katz index to create models like the Weighted Katz Index (WKI), Edge Weighted Katz Index (EWKI), and combined models (e.g., KIEWKI). These incorporate spatial distances and temporal movement patterns for a comprehensive aquaculture network connection prediction framework. Model performance was evaluated using precision, recall, F1-scores, AUPR, and AUROC. The EWKI model significantly outperformed the traditional KI and other variations. It achieved high precision (0.988), recall (0.712), F1-score (0.827), and AUPR (0.970). Combined models (KIEWKI, WKIEWKI) approached, but couldn't surpass, EWKI performance. This study highlights the value of extending Katz index models to improve disease spread predictions in aquaculture networks. The EWKI model's performance demonstrates an innovative and flexible approach to tackling spatial challenges within network analysis.


title: LLM-R2: A Large Language Model Enhanced Rule-based Rewrite System for Boosting Query Efficiency

abstract: Query rewrite, which aims to generate more efficient queries by altering a SQL query's structure without changing the query result, has been an important research problem. In order to maintain equivalence between the rewritten query and the original one during rewriting, traditional query rewrite methods always rewrite the queries following certain rewrite rules. However, some problems still remain. Firstly, existing methods of finding the optimal choice or sequence of rewrite rules are still limited and the process always costs a lot of resources. Methods involving discovering new rewrite rules typically require complicated proofs of structural logic or extensive user interactions. Secondly, current query rewrite methods usually rely highly on DBMS cost estimators which are often not accurate. In this paper, we address these problems by proposing a novel method of query rewrite named LLM-R2, adopting a large language model (LLM) to propose possible rewrite rules for a database rewrite system. To further improve the inference ability of LLM in recommending rewrite rules, we train a contrastive model by curriculum to learn query representations and select effective query demonstrations for the LLM. Experimental results have shown that our method can significantly improve the query execution efficiency and outperform the baseline methods. In addition, our method enjoys high robustness across different datasets.


title: Wrinkling instability of 3D auxetic bilayers in tension

abstract: Bilayers (soft substrates coated with stiff films) are commonly found in nature with examples including skin tissue, vesicles, or organ membranes. They exhibit various types of instabilities when subjected to compression, depending on the contrast in material properties between the two components. We present wrinkling instabilities for 3D hyperelastic bilayer systems, including auxetics (materials with negative Poisson's ratio), under uni-axial tension. In tension, a soft bilayer can experience large lateral contraction, and we find that with an adequate contrast in the Poisson ratios, compressive stresses may develop and generate wrinkles aligned with the tensile direction. We rely on an analytic modelling of the phenomenon, and validate it with a user-defined Python script with periodic boundary conditions and constitutive relation implementation in advanced Finite Element simulations. Our findings reveal that wrinkles are observed when the Poisson ratio of the substrate is greater than that of the film. As the two Poisson ratios converge to a common value, the critical stretch of instability shoots up rapidly, and the wrinkling disappears. We also confirm these results by asymptotic analysis. This wrinkling analysis has significant potential in controlling surface patterns of auxetic skin grafts and hydrogel organ patches under mechanical loads. Moreover, the asymptotic expressions in this work can be used under finite strain for buckling-based metrology applications.


title: Physical Layer Authentication Using Information Reconciliation

abstract: User authentication in future wireless communication networks is expected to become more complicated due to their large scale and heterogeneity. Furthermore, the computational complexity of classical cryptographic approaches based on public key distribution can be a limiting factor for using in simple, low-end Internet of things (IoT) devices. This paper proposes physical layer authentication (PLA) expected to complement existing traditional approaches, e.g., in multi-factor authentication protocols. The precision and consistency of PLA is impacted because of random variations of wireless channel realizations between different time slots, which can impair authentication performance. In order to address this, a method based on error-correcting codes in the form of reconciliation is considered in this work. In particular, we adopt distributed source coding (Slepian-Wolf) reconciliation using polar codes to reconcile channel measurements spread in time. Hypothesis testing is then applied to the reconciled vectors to accept or reject the device as authenticated. Simulation results show that the proposed PLA using reconciliation outperforms prior schemes even in low signal-to-noise ratio scenarios.


title: A comprehensive study of compact stars with dark matter

abstract: We present a comprehensive study of compact stars admixed with non-self annihilating self-interacting fermionic dark matter, delineating the dependence on the nuclear equation of state by considering the two limiting parametrized equations of state for neutron star matter obtained by smoothly matching the low-density chiral effective theory and the high-density perturbative QCD. These two parametrizations are the limiting cases of a wide variety of smooth equations of state, i.e. the softest and stiffest possible one without a phase transition, that generate masses and radii compatible with 2M$_\odot$ observations and the tidal constraint from GW170817. With an exhaustive analysis of the possible stable mass-radius configurations, we determine the quantity of dark matter contained in stars with masses and radii compatible with the aforementioned astrophysical constraints. We find that for dark particle masses of a few tenths of GeV, the dark core collapses and no stable solutions are found irrespective on the chosen nuclear equation of state. For lower masses, the dark matter fraction is limited to 10%, being at most 1% for masses ranging from 0.1 to 10 GeV for the limiting soft nuclear equation of state. For the limiting stiff nuclear equation of state, the dark matter fraction can reach values of more than 10%, but the dark particle mass is being constrained to 0.3 GeV and 10 GeV for the weak self-interacting case and has to be at least 5 GeV for the strong self-interacting one. For dark particle masses of less than 0.1 GeV, stable neutron star configurations should have less than 1% of self-interacting dark matter to be compatible with the constraint of the tidal deformability from GW170817 irrespective on the chosen nuclear equation of state.


title: A Large-scale Medical Visual Task Adaptation Benchmark

abstract: Visual task adaptation has been demonstrated to be effective in adapting pre-trained Vision Transformers (ViTs) to general downstream visual tasks using specialized learnable layers or tokens. However, there is yet a large-scale benchmark to fully explore the effect of visual task adaptation on the realistic and important medical domain, particularly across diverse medical visual modalities, such as color images, X-ray, and CT. To close this gap, we present Med-VTAB, a large-scale Medical Visual Task Adaptation Benchmark consisting of 1.68 million medical images for diverse organs, modalities, and adaptation approaches. Based on Med-VTAB, we explore the scaling law of medical prompt tuning concerning tunable parameters and the generalizability of medical visual adaptation using non-medical/medical pre-train weights. Besides, we study the impact of patient ID out-of-distribution on medical visual adaptation, which is a real and challenging scenario. Furthermore, results from Med-VTAB indicate that a single pre-trained model falls short in medical task adaptation. Therefore, we introduce GMoE-Adapter, a novel method that combines medical and general pre-training weights through a gated mixture-of-experts adapter, achieving state-of-the-art results in medical visual task adaptation.


title: Torsors on moduli spaces of principal $G$-bundles

abstract: Let $G$ be a semisimple complex algebraic group with a simple Lie algebra $\mathfrak{g}$, and let $\mathcal{M}^0_{G}$ denote the moduli stack of topologically trivial stable $G$-bundles on a smooth projective curve $C$. Fix a theta characteristic $\kappa$ on $C$ which is even in case $\dim{\mathfrak{g}}$ is odd. We show that there is a nonempty Zariski open substack ${\mathcal U}_\kappa$ of $\mathcal{M}^0_{G}$ such that $H^i(C,\, \text{ad}(E_G)\otimes\kappa) \,=\, 0$, $i\,=\, 1,\, 2$, for all $E_G\,\in\, {\mathcal U}_\kappa$. It is shown that any such $E_G$ has a canonical connection. It is also shown that the tangent bundle $T{U}_\kappa$ has a natural splitting, where $U_{\kappa}$ is the restriction of $\mathcal{U}_{\kappa}$ to the semi-stable locus. We also produce an isomorphism between two naturally occurring $\Omega^1_{{M}^{rs}_{G}}$--torsors on the moduli space of regularly stable ${M}^{rs}_{G}$.


title: John's blow up examples and scattering solutions for semi-linear wave equations

abstract: In light of recent work of the third author, we revisit a classic example given by Fritz John of a semi-linear wave equation which exhibits finite in time blow up for all compactly supported data. We present the construction of future global solutions from asymptotic data given in arXiv:2204.12870(2022) for this specific example, and clarify the relation of this result of Yu to John's theorem. Furthermore we present a novel blow up result for finite energy solutions satisfying a sign condition due to the first author, and invoke this result to show that the constructed backwards in time solutions blow up in the past.


title: Unlocking Multi-View Insights in Knowledge-Dense Retrieval-Augmented Generation

abstract: While Retrieval-Augmented Generation (RAG) plays a crucial role in the application of Large Language Models (LLMs), existing retrieval methods in knowledge-dense domains like law and medicine still suffer from a lack of multi-perspective views, which are essential for improving interpretability and reliability. Previous research on multi-view retrieval often focused solely on different semantic forms of queries, neglecting the expression of specific domain knowledge perspectives. This paper introduces a novel multi-view RAG framework, MVRAG, tailored for knowledge-dense domains that utilizes intention-aware query rewriting from multiple domain viewpoints to enhance retrieval precision, thereby improving the effectiveness of the final inference. Experiments conducted on legal and medical case retrieval demonstrate significant improvements in recall and precision rates with our framework. Our multi-perspective retrieval approach unleashes the potential of multi-view information enhancing RAG tasks, accelerating the further application of LLMs in knowledge-intensive fields.


title: Semantic Security with Unreliable Entanglement Assistance: Interception and Loss

abstract: Semantic security is considered with unreliable entanglement assistance, due to one of two reasons: Interception or loss. We consider two corresponding models. In the first model, Eve may intercept the entanglement resource. In the second model, Eve is passive, and the resource may dissipate to the environment beyond her reach. We derive achievable rates for both models, subject to a maximal error criterion and semantic security. As an example, we consider the amplitude damping channel. Under interception, time division is not necessarily possible, and the boundary of our achievable region is disconnected. In the passive model, our rate region outperforms time division.


title: On the field independent additive constant in Wilson actions

abstract: We discuss the field independent additive constant in Wilson actions carefully within the exact renormalization group formalism. The additive constant does not affect the correlation functions of fields normalized by the partition function, and for that reason it is often ignored. But it is an essential part of the partition function, and in the limit where the UV cutoff goes to zero, the constant gives a renormalized vacuum energy density. We discuss two concrete examples: the Gaussian theory and the linear sigma model in the large $N$ limit.


title: The modified conditional sum-of-squares estimator for fractionally integrated models

abstract: In this paper, we analyse the influence of estimating a constant term on the bias of the conditional sum-of-squares (CSS) estimator in a stationary or non-stationary type-II ARFIMA ($p_1$,$d$,$p_2$) model. We derive expressions for the estimator's bias and show that the leading term can be easily removed by a simple modification of the CSS objective function. We call this new estimator the modified conditional sum-of-squares (MCSS) estimator. We show theoretically and by means of Monte Carlo simulations that its performance relative to that of the CSS estimator is markedly improved even for small sample sizes. Finally, we revisit three classical short datasets that have in the past been described by ARFIMA($p_1$,$d$,$p_2$) models with constant term, namely the post-second World War real GNP data, the extended Nelson-Plosser data, and the Nile data.


title: TimelinePTC: Development of a unified interface for pathways to care collection, visualization, and collaboration in first episode psychosis

abstract: This paper presents TimelinePTC, a web-based tool developed to improve the collection and analysis of Pathways to Care (PTC) data in first episode psychosis (FEP) research. Accurately measuring the duration of untreated psychosis (DUP) is essential for effective FEP treatment, requiring detailed understanding of the patient's journey to care. However, traditional PTC data collection methods, mainly manual and paper-based, are time-consuming and often fail to capture the full complexity of care pathways. TimelinePTC addresses these limitations by providing a digital platform for collaborative, real-time data entry and visualization, thereby enhancing data accuracy and collection efficiency. Initially created for the Specialized Treatment Early in Psychosis (STEP) program in New Haven, Connecticut, its design allows for straightforward adaptation to other healthcare contexts, facilitated by its open-source codebase. The tool significantly simplifies the data collection process, making it more efficient and user-friendly. It automates the conversion of collected data into a format ready for analysis, reducing manual transcription errors and saving time. By enabling more detailed and consistent data collection, TimelinePTC has the potential to improve healthcare access research, supporting the development of targeted interventions to reduce DUP and improve patient outcomes.


title: Expanding \v{C}ech cohomology for quantales

abstract: We expand \v{C}ech cohomology of a topological space $X$ with values in a presheaf on $X$ to \v{C}ech cohomology of a commutative ring with unity $R$ with values in a presheaf on $R$. The strategy is to observe that both the set of open subsets of $X$ and the set of ideals of $R$ provide examples of a (semicartesian) quantale. We study a particular pair of (adjoint) functors $(\theta, \tau)$ between the quantale of open subsets of $X$ and the quantale of ideals of $C(X)$, the ring of real-valued continuous functions on $X$. This leads to the main result of this paper: the $q$th \v{C}ech cohomology groups of $X$ with values on the constant sheaf $F$ on $X$ is isomorphic to the $q$th \v{C}ech cohomology groups of the ring $C(X)$ with values on a sheaf $F \circ \tau$ on $C(X)$.


title: Testbeam results of irradiated SiGe BiCMOS monolithic silicon pixel detector without internal gain layer

abstract: Samples of the monolithic silicon pixel ASIC prototype produced in 2022 within the framework of the Horizon 2020 MONOLITH ERC Advanced project were irradiated with 70 MeV protons up to a fluence of 1 x 1016 neq/cm2, and then tested using a beam of 120 GeV/c pions. The ASIC contains a matrix of 100 \mu m pitch hexagonal pixels, readout out by low noise and very fast frontend electronics produced in a 130 nm SiGe BiCMOS technology process. The dependence on the proton fluence of the efficiency and the time resolution of this prototype was measured with the frontend electronics operated at a power density between 0.13 and 0.9 W/cm2. The testbeam data show that the detection efficiency of 99.96% measured at sensor bias voltage of 200 V before irradiation becomes 96.2% after a fluence of 1 x 1016 neq/cm2. An increase of the sensor bias voltage to 300 V provides an efficiency to 99.7% at that proton fluence. The timing resolution of 20 ps measured before irradiation rises for a proton fluence of 1 x 1016 neq/cm2 to 53 and 45 ps at HV = 200 and 300 V, respectively.


title: MCM: Multi-condition Motion Synthesis Framework

abstract: Conditional human motion synthesis (HMS) aims to generate human motion sequences that conform to specific conditions. Text and audio represent the two predominant modalities employed as HMS control conditions. While existing research has primarily focused on single conditions, the multi-condition human motion synthesis remains underexplored. In this study, we propose a multi-condition HMS framework, termed MCM, based on a dual-branch structure composed of a main branch and a control branch. This framework effectively extends the applicability of the diffusion model, which is initially predicated solely on textual conditions, to auditory conditions. This extension encompasses both music-to-dance and co-speech HMS while preserving the intrinsic quality of motion and the capabilities for semantic association inherent in the original model. Furthermore, we propose the implementation of a Transformer-based diffusion model, designated as MWNet, as the main branch. This model adeptly apprehends the spatial intricacies and inter-joint correlations inherent in motion sequences, facilitated by the integration of multi-wise self-attention modules. Extensive experiments show that our method achieves competitive results in single-condition and multi-condition HMS tasks.


title: 3D Multi-frame Fusion for Video Stabilization

abstract: In this paper, we present RStab, a novel framework for video stabilization that integrates 3D multi-frame fusion through volume rendering. Departing from conventional methods, we introduce a 3D multi-frame perspective to generate stabilized images, addressing the challenge of full-frame generation while preserving structure. The core of our approach lies in Stabilized Rendering (SR), a volume rendering module, which extends beyond the image fusion by incorporating feature fusion. The core of our RStab framework lies in Stabilized Rendering (SR), a volume rendering module, fusing multi-frame information in 3D space. Specifically, SR involves warping features and colors from multiple frames by projection, fusing them into descriptors to render the stabilized image. However, the precision of warped information depends on the projection accuracy, a factor significantly influenced by dynamic regions. In response, we introduce the Adaptive Ray Range (ARR) module to integrate depth priors, adaptively defining the sampling range for the projection process. Additionally, we propose Color Correction (CC) assisting geometric constraints with optical flow for accurate color aggregation. Thanks to the three modules, our RStab demonstrates superior performance compared with previous stabilizers in the field of view (FOV), image quality, and video stability across various datasets.


title: Learn2Talk: 3D Talking Face Learns from 2D Talking Face

abstract: Speech-driven facial animation methods usually contain two main classes, 3D and 2D talking face, both of which attract considerable research attention in recent years. However, to the best of our knowledge, the research on 3D talking face does not go deeper as 2D talking face, in the aspect of lip-synchronization (lip-sync) and speech perception. To mind the gap between the two sub-fields, we propose a learning framework named Learn2Talk, which can construct a better 3D talking face network by exploiting two expertise points from the field of 2D talking face. Firstly, inspired by the audio-video sync network, a 3D sync-lip expert model is devised for the pursuit of lip-sync between audio and 3D facial motion. Secondly, a teacher model selected from 2D talking face methods is used to guide the training of the audio-to-3D motions regression network to yield more 3D vertex accuracy. Extensive experiments show the advantages of the proposed framework in terms of lip-sync, vertex accuracy and speech perception, compared with state-of-the-arts. Finally, we show two applications of the proposed framework: audio-visual speech recognition and speech-driven 3D Gaussian Splatting based avatar animation.


title: On the probability of linear separability through intrinsic volumes

abstract: A dataset with two labels is linearly separable if it can be split into its two classes with a hyperplane. This inflicts a curse on some statistical tools (such as logistic regression) but forms a blessing for others (e.g. support vector machines). Recently, the following question has regained interest: What is the probability that the data are linearly separable? We provide a formula for the probability of linear separability for Gaussian features and labels depending only on one marginal of the features (as in generalized linear models). In this setting, we derive an upper bound that complements the recent result by Hayakawa, Lyons, and Oberhauser [2023], and a sharp upper bound for sign-flip noise. To prove our results, we exploit that this probability can be expressed as a sum of the intrinsic volumes of a polyhedral cone of the form $\text{span}\{v\}\oplus[0,\infty)^n$, as shown in Cand\`es and Sur [2020]. After providing the inequality description for this cone, and an algorithm to project onto it, we calculate its intrinsic volumes. In doing so, we encounter Youden's demon problem, for which we provide a formula following Kabluchko and Zaporozhets [2020]. The key insight of this work is the following: The number of correctly labeled observations in the data affects the structure of this polyhedral cone, allowing the translation of insights from geometry into statistics.


title: Orbital Stability of Optical Solitons in 2d

abstract: We present a stability result for ground states of a Schrodinger-Poisson system in $(2+1)$ dimension, modelling the propagation of a light beam through a liquid crystal with nonlocal nonlinear response. A new estimate for perturbations of the medium configuration allows to explicitly prove strict positivity of the second derivative of the action on a ground state. In addition we prove existence of a ground state with frequency $\sigma$ for any $\sigma \in (0,1)$ by a continuity method.


title: Commuting probability for approximate subgroups of a finite group

abstract: For subsets X,Y of a finite group G, we write Pr(X,Y) for the probability that two random elements x in X and y in Y commute. This paper addresses the relation between the structure of an approximate subgroup A of G and the probabilities Pr(A,G) and Pr(A,A).


title: A Machine Learning-Based Error Mitigation Approach For Reliable Software Development On IBM'S Quantum Computers

abstract: Quantum computers have the potential to outperform classical computers for some complex computational problems. However, current quantum computers (e.g., from IBM and Google) have inherent noise that results in errors in the outputs of quantum software executing on the quantum computers, affecting the reliability of quantum software development. The industry is increasingly interested in machine learning (ML)--based error mitigation techniques, given their scalability and practicality. However, existing ML-based techniques have limitations, such as only targeting specific noise types or specific quantum circuits. This paper proposes a practical ML-based approach, called Q-LEAR, with a novel feature set, to mitigate noise errors in quantum software outputs. We evaluated Q-LEAR on eight quantum computers and their corresponding noisy simulators, all from IBM, and compared Q-LEAR with a state-of-the-art ML-based approach taken as baseline. Results show that, compared to the baseline, Q-LEAR achieved a 25% average improvement in error mitigation on both real quantum computers and simulators. We also discuss the implications and practicality of Q-LEAR, which, we believe, is valuable for practitioners.


title: The Power of Words: Generating PowerShell Attacks from Natural Language

abstract: As the Windows OS stands out as one of the most targeted systems, the PowerShell language has become a key tool for malicious actors and cybersecurity professionals (e.g., for penetration testing). This work explores an uncharted domain in AI code generation by automatically generating offensive PowerShell code from natural language descriptions using Neural Machine Translation (NMT). For training and evaluation purposes, we propose two novel datasets with PowerShell code samples, one with manually curated descriptions in natural language and another code-only dataset for reinforcing the training. We present an extensive evaluation of state-of-the-art NMT models and analyze the generated code both statically and dynamically. Results indicate that tuning NMT using our dataset is effective at generating offensive PowerShell code. Comparative analysis against the most widely used LLM service ChatGPT reveals the specialized strengths of our fine-tuned models.


title: Mapping the path to Cryogenic Atom Probe Tomography Analysis of biomolecules

abstract: The understanding of protein structure, folding, and interaction with other proteins remains one of the grand challenges of modern biology. Tremendous progress has been made thanks to X-ray- or electron-based techniques that have provided atomic configurations of proteins, and their solvation shell. These techniques though require a large number of similar molecules to provide an average view, and lack detailed compositional information that might play a major role in the biochemical activity of these macromolecules. Based on its intrinsic performance and recent impact in materials science, atom probe tomography (APT) has been touted as a potential novel tool to analyse biological materials, including proteins. However, analysis of biomolecules in their native, hydrated state by APT have not yet been routinely achieved, and the technique's true capabilities remain to be demonstrated. Here, we present and discuss systematic analyses of individual amino-acids in frozen aqueous solutions on two different nanoporous metal supports across a wide range of analysis conditions. Using a ratio of the molecular ions of water as a descriptor for the conditions of electrostatic field, we study the fragmentation and behavior of those amino acids. We discuss the importance sample support, specimen preparation route, acquisition conditions and data analysis, to pave the way towards establishing guidelines for cryo-APT analysis of biomolecules.


title: The emergence of the width of subjective temporality: the self-simulational theory of temporal extension from the perspective of the free energy principle

abstract: The self-simulational theory of temporal extension describes an information-theoretically formalized mechanism by which the width of subjective temporality emerges from the architecture of self-modelling. In this paper, the perspective of the free energy principle will be assumed, to cast the emergence of subjective temporality, along with a mechanism for duration estimation, from first principles of the physics of self-organization. Using active inference, a deep parametric generative model of temporal inference is simulated, which realizes the described dynamics on a computational level. Two biases (i.e. variations) of time-perception naturally emerge from the simulation. This concerns the intentional binding effect (i.e. the subjective compression of the temporal interval between voluntarily initiated actions and subsequent sensory consequences) and empirically documented alterations of subjective time experience in deep and concentrated states of meditative absorption. Generally, numerous systematic and domain-specific variations of subjective time experience are computationally explained, as enabled by integration with current active inference accounts mapping onto the respective domains. This concerns the temporality modulating role of negative valence, impulsivity, boredom, flow-states, and near death-experiences, amongst others. The self-simulational theory of temporal extension, from the perspective of the free energy principle, explains how the subjective temporal Now emerges and varies from first principles, accounting for why sometimes, subjective time seems to fly, and sometimes, moments feel like eternities; with the computational mechanism being readily deployable synthetically.


title: Quantitative Ultrasound for Periodontal Soft Tissue Characterization

abstract: Periodontal diseases affect 45.9\% of adults aged 30 or older in the United States. Current diagnostic methods for clinical assessment of these diseases are visual examination and bleeding on probing that are subjective, qualitative, and/or invasive. Thus, there is a critical need for research on noninvasive modalities for periodontal tissue characterization. Quantitative Ultrasound (QUS) has shown promising results in noninvasive characterization of various soft tissues; however, it has not been used in periodontics. This study is among initial investigations into the application of QUS for periodontal tissue characterization in the literature. Here, QUS analysis of oral soft tissues (alveolar mucosa and gingiva) is performed in an in vivo animal study including 10 swine. US scanning was performed at the first molar of all four oral quadrants, resulting in a total of 40 scans. We investigated first order speckle statistics of oral tissues by using the two-parameter Burr (power-law b and scale factor l) and Nakagami models (shape factor m and scale factor $\alpha$). Parametric imaging of these parameters was created using a sliding kernel method sweeping regions of interest with a kernel size of 10 wavelengths from a phantom study. Results showed that the difference between gingiva and alveolar mucosa were statistically significant using Burr and Nakagami parameters ($p-value<0.0001$). The Burr b and Nakagami m were higher in gingiva while the Burr l and Nakagami {$\alpha$} were higher in alveolar mucosa. Findings from QUS analyses agreed with observation from histology that showed denser stains for gingiva. Linear classifications of these tissues using 2D parameter spaces of the Burr and Nakagami models resulted in a segmentation accuracy of 93.51\% and 90.91\%, respectively. We propose that QUS holds promising potentials as an augmented tool for disease diagnosis in periodontology.


title: Enabling Natural Zero-Shot Prompting on Encoder Models via Statement-Tuning

abstract: While Large Language Models (LLMs) exhibit remarkable capabilities in zero-shot and few-shot scenarios, they often require computationally prohibitive sizes. Conversely, smaller Masked Language Models (MLMs) like BERT and RoBERTa achieve state-of-the-art results through fine-tuning but struggle with extending to few-shot and zero-shot settings due to their architectural constraints. Hence, we propose Statement-Tuning, a technique that models discriminative tasks as a set of finite statements and trains an Encoder model to discriminate between the potential statements to determine the label. We do Statement-Tuning on multiple tasks to enable cross-task generalization. Experimental results demonstrate that Statement Tuning achieves competitive performance compared to state-of-the-art LLMs with significantly fewer parameters. Moreover, the study investigates the impact of several design choices on few-shot and zero-shot generalization, revealing that Statement Tuning can achieve sufficient performance with modest training data and benefits from task and statement diversity for unseen task generalizability.


title: Hall mass and transverse Noether spin currents in noncollinear antiferromagnets

abstract: Noncollinear antiferromagnets (AFMs) in the family of Mn$_3X$ ($X$=Ir, Sn, Ge, Pt, etc.) have recently attracted attention in the emerging field of antiferromagnetic spintronics because of their various interesting transport, magnetic, and optical properties. Due to the noncollinear magnetic order, the localized electron spins on different magnetic sublattices are not conserved even when spin-orbit coupling is neglected, making it difficult to understand the transport of spin angular momentum. Here we study the conserved Noether current associated with spin-rotation symmetry of the local spins in noncollinear AFMs. We found that a Hall component of the d.c. spin current can be created by a longitudinal driving force associated with a propagating spin wave, and is proportional to a response coefficient that we denote as the Hall (inverse) mass. Such a Hall spin current can be generated by spin pumping in a ferromagnet (FM)-noncollinear AFM bilayer structure as we demonstrated numerically. Finally we showed that the Hall mass is an isotropic quantity, similar to the isotropic spin Hall conductivity, and should generally exist in noncollinear AFMs and their polycrystals. Our results shed light on the potential of noncollinear AFMs in manipulating the polarization and flow of spin currents in general spintronic devices.


title: Bayesian Co-navigation: Dynamic Designing of the Materials Digital Twins via Active Learning

abstract: Scientific advancement is universally based on the dynamic interplay between theoretical insights, modelling, and experimental discoveries. However, this feedback loop is often slow, including delayed community interactions and the gradual integration of experimental data into theoretical frameworks. This challenge is particularly exacerbated in domains dealing with high-dimensional object spaces, such as molecules and complex microstructures. Hence, the integration of theory within automated and autonomous experimental setups, or theory in the loop automated experiment, is emerging as a crucial objective for accelerating scientific research. The critical aspect is not only to use theory but also on-the-fly theory updates during the experiment. Here, we introduce a method for integrating theory into the loop through Bayesian co-navigation of theoretical model space and experimentation. Our approach leverages the concurrent development of surrogate models for both simulation and experimental domains at the rates determined by latencies and costs of experiments and computation, alongside the adjustment of control parameters within theoretical models to minimize epistemic uncertainty over the experimental object spaces. This methodology facilitates the creation of digital twins of material structures, encompassing both the surrogate model of behavior that includes the correlative part and the theoretical model itself. While demonstrated here within the context of functional responses in ferroelectric materials, our approach holds promise for broader applications, the exploration of optical properties in nanoclusters, microstructure-dependent properties in complex materials, and properties of molecular systems. The analysis code that supports the funding is publicly available at https://github.com/Slautin/2024_Co-navigation/tree/main


title: Training-and-prompt-free General Painterly Harmonization Using Image-wise Attention Sharing

abstract: Painterly Image Harmonization aims at seamlessly blending disparate visual elements within a single coherent image. However, previous approaches often encounter significant limitations due to training data constraints, the need for time-consuming fine-tuning, or reliance on additional prompts. To surmount these hurdles, we design a Training-and-prompt-Free General Painterly Harmonization method using image-wise attention sharing (TF-GPH), which integrates a novel "share-attention module". This module redefines the traditional self-attention mechanism by allowing for comprehensive image-wise attention, facilitating the use of a state-of-the-art pretrained latent diffusion model without the typical training data limitations. Additionally, we further introduce "similarity reweighting" mechanism enhances performance by effectively harnessing cross-image information, surpassing the capabilities of fine-tuning or prompt-based approaches. At last, we recognize the deficiencies in existing benchmarks and propose the "General Painterly Harmonization Benchmark", which employs range-based evaluation metrics to more accurately reflect real-world application. Extensive experiments demonstrate the superior efficacy of our method across various benchmarks. The code and web demo are available at https://github.com/BlueDyee/TF-GPH.