title: Open-Set Recognition in the Age of Vision-Language Models

abstract: Are vision-language models (VLMs) open-set models because they are trained on internet-scale datasets? We answer this question with a clear no - VLMs introduce closed-set assumptions via their finite query set, making them vulnerable to open-set conditions. We systematically evaluate VLMs for open-set recognition and find they frequently misclassify objects not contained in their query set, leading to alarmingly low precision when tuned for high recall and vice versa. We show that naively increasing the size of the query set to contain more and more classes does not mitigate this problem, but instead causes diminishing task performance and open-set performance. We establish a revised definition of the open-set problem for the age of VLMs, define a new benchmark and evaluation protocol to facilitate standardised evaluation and research in this important area, and evaluate promising baseline approaches based on predictive uncertainty and dedicated negative embeddings on a range of VLM classifiers and object detectors.


title: Exploit High-Dimensional RIS Information to Localization: What Is the Impact of Faulty Element?

abstract: This paper proposes a novel localization algorithm using the reconfigurable intelligent surface (RIS) received signal, i.e., RIS information. Compared with BS received signal, i.e., BS information, RIS information offers higher dimension and richer feature set, thereby providing an enhanced capacity to distinguish positions of the mobile users (MUs). Additionally, we address a practical scenario where RIS contains some unknown (number and places) faulty elements that cannot receive signals. Initially, we employ transfer learning to design a two-phase transfer learning (TPTL) algorithm, designed for accurate detection of faulty elements. Then our objective is to regain the information lost from the faulty elements and reconstruct the complete high-dimensional RIS information for localization. To this end, we propose a transfer-enhanced dual-stage (TEDS) algorithm. In \emph{Stage I}, we integrate the CNN and variational autoencoder (VAE) to obtain the RIS information, which in \emph{Stage II}, is input to the transferred DenseNet 121 to estimate the location of the MU. To gain more insight, we propose an alternative algorithm named transfer-enhanced direct fingerprint (TEDF) algorithm which only requires the BS information. The comparison between TEDS and TEDF reveals the effectiveness of faulty element detection and the benefits of utilizing the high-dimensional RIS information for localization. Besides, our empirical results demonstrate that the performance of the localization algorithm is dominated by the high-dimensional RIS information and is robust to unoptimized phase shifts and signal-to-noise ratio (SNR).


title: An Intermediate Fusion ViT Enables Efficient Text-Image Alignment in Diffusion Models

abstract: Diffusion models have been widely used for conditional data cross-modal generation tasks such as text-to-image and text-to-video. However, state-of-the-art models still fail to align the generated visual concepts with high-level semantics in a language such as object count, spatial relationship, etc. We approach this problem from a multimodal data fusion perspective and investigate how different fusion strategies can affect vision-language alignment. We discover that compared to the widely used early fusion of conditioning text in a pretrained image feature space, a specially designed intermediate fusion can: (i) boost text-to-image alignment with improved generation quality and (ii) improve training and inference efficiency by reducing low-rank text-to-image attention calculations. We perform experiments using a text-to-image generation task on the MS-COCO dataset. We compare our intermediate fusion mechanism with the classic early fusion mechanism on two common conditioning methods on a U-shaped ViT backbone. Our intermediate fusion model achieves a higher CLIP Score and lower FID, with 20% reduced FLOPs, and 50% increased training speed compared to a strong U-ViT baseline with an early fusion.


title: Giant Hall effect in two-dimensional CoSi$_2$ granular arrays

abstract: Granular metals offer tailorable electronic properties and play crucial roles in device and sensor applications. We have fabricated a series of nonmagnetic granular CoSi2 thin films and studied the Hall effect and transport properties. We observed a two orders of magnitude enhancement in the Hall coefficient in films fall slightly above the metal-insulator transition. This giant Hall effect (GHE) is ascribed to the local quantum-interference effect induced reduction of the charge carriers. Transmission electron microscopy images and transport properties indicate that our films form two dimensional granular arrays. The GHE may provide useful and sensitive applications.


title: Uncovering faint lensed gravitational-wave signals and reprioritizing their follow-up analysis using galaxy lensing forecasts with detected counterparts

abstract: Like light, gravitational waves can be gravitationally lensed by massive astrophysical objects. For galaxy and galaxy-cluster lenses, one expects to see strong lensing -- forecasted to become observable in the coming years -- where the original wave is split into multiple copies with the same frequency evolution but different overall arrival times, phases, amplitudes, and signal strengths. Some of these images can be below the detection threshold and require targeted search methods, based on tailor-made template banks. These searches can be made more sensitive by using our knowledge of the typical distribution and morphology of lenses to predict the time delay, magnification, and image-type ordering of the lensed images. Here, we show that when a subset of the images is super-threshold, they can be used to construct a more constrained prediction of the arrival time of the remaining signals, enhancing our ability to identify lensing candidate signals. Our suggested method effectively reduces the list of triggers requiring follow-up and generally re-ranks the genuine counterpart higher in the lensing candidate list. Therefore, in the future, if one observes two or three lensed images, the information they provide can be used to identify their sub-threshold counterparts, thus allowing identification of additional lensed images. Finding such images would also strengthen our evidence for the event being lensed.


title: XAV: A High-Performance Regular Expression Matching Engine for Packet Processing

abstract: Regular expression matching is the core function of various network security applications such as network intrusion detection systems. With the network bandwidth increases, it is a great challenge to implement regular expression matching for line rate packet processing. To this end, a novel scheme named XAV targeting high-performance regular expression matching is proposed in this paper. XAV first employs anchor DFA to tackle the state explosion problem of DFA. Then based on anchor DFA, two techniques including pre-filtering and regex decomposition are utilized to improve the average time complexity. Through implementing XAV with an FPGA-CPU architecture, comprehensive experiments show that a high matching throughput of up to 75 Gbps can be achieved for the large and complex Snort rule-set. Compared to state-of-the-art software schemes, XAV achieves two orders of magnitude of performance improvement. While compared to state-of-the-art FPGA-based schemes, XAV achieves more than 2.5x performance improvement with the same hardware resource consumption.


title: Stellar Metallicity of Galaxies: New Insight on the Formation and Evolution of Low Surface Brightness Galaxies in the IllustrisTNG Simulation

abstract: In this work, we investigate the stellar metallicities of low surface brightness galaxies (LSBGs) and normal high surface brightness galaxies (HSBGs) in the IllustrisTNG100-1 simulation. LSBGs and HSBGs are classified as galaxies with mean central surface brightness $\mu_{\rm r} > 22.0 \ mag \ arcsec^{-2}$ and $\mu_{\rm r} < 22.0 \ mag \ arcsec^{-2}$, respectively. Our findings indicate that both LSBGs and HSBGs exhibit similar number distributions of stellar metallicities at high redshifts ($z>1.5$). However, at low redshifts ($z<1.5$), a clear bimodal distribution of stellar metallicities in galaxies emerges, with LSBGs tending to be more metal-poor than HSBGs. The lower metallicity of LSBGs compared to HSBGs is mostly attributed to the pronounced gradient in the radial distribution of stellar metallicities. The bimodality of stellar metallicity is not attributed to colour distinctions but rather to the slower metal enrichment in LSBGs compared to HSBGs. This suggests that the mechanisms driving metal enrichment in LSBGs differ from those in HSBGs.


title: Arm-Constrained Curriculum Learning for Loco-Manipulation of the Wheel-Legged Robot

abstract: Incorporating a robotic manipulator into a wheel-legged robot enhances its agility and expands its potential for practical applications. However, the presence of potential instability and uncertainties presents additional challenges for control objectives. In this paper, we introduce an arm-constrained curriculum learning architecture to tackle the issues introduced by adding the manipulator. Firstly, we develop an arm-constrained reinforcement learning algorithm to ensure safety and stability in control performance. Additionally, to address discrepancies in reward settings between the arm and the base, we propose a reward-aware curriculum learning method. The policy is first trained in Isaac gym and transferred to the physical robot to do dynamic grasping tasks, including the door-opening task, fan-twitching task and the relay-baton-picking and following task. The results demonstrate that our proposed approach effectively controls the arm-equipped wheel-legged robot to master dynamic grasping skills, allowing it to chase and catch a moving object while in motion. Please refer to our website (https://acodedog.github.io/wheel-legged-loco-manipulation) for the code and supplemental videos.


title: VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting

abstract: Combining CNNs or ViTs, with RNNs for spatiotemporal forecasting, has yielded unparalleled results in predicting temporal and spatial dynamics. However, modeling extensive global information remains a formidable challenge; CNNs are limited by their narrow receptive fields, and ViTs struggle with the intensive computational demands of their attention mechanisms. The emergence of recent Mamba-based architectures has been met with enthusiasm for their exceptional long-sequence modeling capabilities, surpassing established vision models in efficiency and accuracy, which motivates us to develop an innovative architecture tailored for spatiotemporal forecasting. In this paper, we propose the VMRNN cell, a new recurrent unit that integrates the strengths of Vision Mamba blocks with LSTM. We construct a network centered on VMRNN cells to tackle spatiotemporal prediction tasks effectively. Our extensive evaluations show that our proposed approach secures competitive results on a variety of tasks while maintaining a smaller model size. Our code is available at https://github.com/yyyujintang/VMRNN-PyTorch.


title: Fluorophore signal and detection enhancement in nanowire biosensors

abstract: Semiconductor nanowires have been demonstrated as an efficient platform for fluorescence-based biosensors. Here, we study theoretically how GaP nanowires (i) enhance the excitation intensity at the position of fluorophores attached to the nanowire sidewall, (ii) enhance the probability to collect photons emitted from the fluorophores by directing them preferentially into the numerical aperture of collection objective, and (iii) through the Purcell effect increase the quantum yield of fluorophores. We find that the optimum diameter depends strongly on the fluorophore emission wavelength. In addition to an overall signal-detection scheme, we model imaging-based detection of the fluorescence.


title: Broadband and fabrication-tolerant 3-dB couplers with topological valley edge modes

abstract: 3-dB couplers, which are commonly used in photonic integrated circuits for on-chip information processing, precision measurement, and quantum computing, face challenges in achieving robust performance due to their limited 3-dB bandwidths and sensitivity to fabrication errors. To address this, we introduce topological physics to nanophotonics, developing a framework for topological 3-dB couplers. These couplers exhibit broad working wavelength range and robustness against fabrication dimensional errors. By leveraging valley-Hall topology and mirror symmetry, the photonic-crystal-slab couplers achieve ideal 3-dB splitting characterized by a wavelength-insensitive scattering matrix. Tolerance analysis confirms the superiority on broad bandwidth of 48 nm and robust splitting against dimensional errors of 20 nm. We further propose a topological interferometer for on-chip distance measurement, which also exhibits robustness against dimensional errors. This extension of topological principles to the fields of interferometers, may open up new possibilities for constructing robust wavelength division multiplexing, temperature-drift-insensitive sensing, and optical coherence tomography applications.


title: Data-Efficient 3D Visual Grounding via Order-Aware Referring

abstract: 3D visual grounding aims to identify the target object within a 3D point cloud scene referred to by a natural language description. Previous works usually require significant data relating to point color and their descriptions to exploit the corresponding complicated verbo-visual relations. In our work, we introduce Vigor, a novel Data-Efficient 3D Visual Grounding framework via Order-aware Referring. Vigor leverages LLM to produce a desirable referential order from the input description for 3D visual grounding. With the proposed stacked object-referring blocks, the predicted anchor objects in the above order allow one to locate the target object progressively without supervision on the identities of anchor objects or exact relations between anchor/target objects. In addition, we present an order-aware warm-up training strategy, which augments referential orders for pre-training the visual grounding framework. This allows us to better capture the complex verbo-visual relations and benefit the desirable data-efficient learning scheme. Experimental results on the NR3D and ScanRefer datasets demonstrate our superiority in low-resource scenarios. In particular, Vigor surpasses current state-of-the-art frameworks by 9.3% and 7.6% grounding accuracy under 1% data and 10% data settings on the NR3D dataset, respectively.


title: Enhancing Cross-Dataset EEG Emotion Recognition: A Novel Approach with Emotional EEG Style Transfer Network

abstract: Recognizing the pivotal role of EEG emotion recognition in the development of affective Brain-Computer Interfaces (aBCIs), considerable research efforts have been dedicated to this field. While prior methods have demonstrated success in intra-subject EEG emotion recognition, a critical challenge persists in addressing the style mismatch between EEG signals from the source domain (training data) and the target domain (test data). To tackle the significant inter-domain differences in cross-dataset EEG emotion recognition, this paper introduces an innovative solution known as the Emotional EEG Style Transfer Network (E$^2$STN). The primary objective of this network is to effectively capture content information from the source domain and the style characteristics from the target domain, enabling the reconstruction of stylized EEG emotion representations. These representations prove highly beneficial in enhancing cross-dataset discriminative prediction. Concretely, E$^2$STN consists of three key modules\textemdash transfer module, transfer evaluation module, and discriminative prediction module\textemdash which address the domain style transfer, transfer quality evaluation, and discriminative prediction, respectively. Extensive experiments demonstrate that E$^2$STN achieves state-of-the-art performance in cross-dataset EEG emotion recognition tasks.


title: Effects of tensor spin polarization on the chiral restoration and deconfinement phase transitions

abstract: Effects of tensor spin polarization (TSP) on the chiral restoration and deconfinement phase transitions are studied in Polyakov loop extended Nambu-Jona-Lasinio (PNJL) model. For chiral phase transition, the higher the polarized degree of quark-antiquark pairs under the strong magnetic field, the higher the phase transition temperature. The TSP corrects the position of the critical end point. The small impact of TSP on the phase transition temperature is found for the deconfinement phase transition. On the other hand, we divide the phase space into three ranges based on the phase diagram obtained from the PNJL model: the confinement phase with chiral symmetry broken, the deconfinement phase with restored chiral symmetry, and the confinement phase with restored chiral symmetry (quarkyonic phase). It is found that TSP has only a very small effect on the anisotropic pressure in the deconfined phase with chiral symmetry restored and the quarkyonic phase, but it has a very strong effect on the anisotropic pressure in the confined phase with chiral symmetry broken. This is because TSP is closely related to chiral symmetry. The restoration of chiral symmetry means the dissociation of spin polarization condensate.


title: Differentially Private Online Federated Learning with Correlated Noise

abstract: We propose a novel differentially private algorithm for online federated learning that employs temporally correlated noise to improve the utility while ensuring the privacy of the continuously released models. To address challenges stemming from DP noise and local updates with streaming noniid data, we develop a perturbed iterate analysis to control the impact of the DP noise on the utility. Moreover, we demonstrate how the drift errors from local updates can be effectively managed under a quasi-strong convexity condition. Subject to an $(\epsilon, \delta)$-DP budget, we establish a dynamic regret bound over the entire time horizon that quantifies the impact of key parameters and the intensity of changes in dynamic environments. Numerical experiments validate the efficacy of the proposed algorithm.


title: Efficient Information Extraction in Few-Shot Relation Classification through Contrastive Representation Learning

abstract: Differentiating relationships between entity pairs with limited labeled instances poses a significant challenge in few-shot relation classification. Representations of textual data extract rich information spanning the domain, entities, and relations. In this paper, we introduce a novel approach to enhance information extraction combining multiple sentence representations and contrastive learning. While representations in relation classification are commonly extracted using entity marker tokens, we argue that substantial information within the internal model representations remains untapped. To address this, we propose aligning multiple sentence representations, such as the [CLS] token, the [MASK] token used in prompting, and entity marker tokens. Our method employs contrastive learning to extract complementary discriminative information from these individual representations. This is particularly relevant in low-resource settings where information is scarce. Leveraging multiple sentence representations is especially effective in distilling discriminative information for relation classification when additional information, like relation descriptions, are not available. We validate the adaptability of our approach, maintaining robust performance in scenarios that include relation descriptions, and showcasing its flexibility to adapt to different resource constraints.


title: The Role of Mean Absolute Deviation Function in Obtaining Smooth Estimation for Distribution and Density Functions: Beta Regression Approach

abstract: Smooth Estimation of probability density and distribution functions from its sample is an attractive and an important problem that has applications in several fields such as, business, medicine, and environment. This article introduces a simple approach but novel for estimating both functions to have smooth curves for both via left mean absolute deviation (MAD) function and beta regression approach. Our approach explores estimation of both functions by smoothing the first derivative of left MAD function to obtain the final optimal smooth estimates. The final smooth estimates are obtained under the assumption that nondecreasing distribution function and the density function remains nonnegative. This is achieved by using beta regression with various link functions (logit, probit, cloglog, and cauchit) applied to a polynomial whose degree is determined by the first derivative of the left MAD function. The chosen polynomial degree minimizes the mean absolute regression errors, provided that the first derivative of the regression vector of expected values is nonnegative. Additionally, pointwise confidence limits for the distribution function are derived using the beta distribution. The method is utilized on simulated datasets featuring unimodal, bimodal, and tri-modal, with a demonstration on an actual dataset. The results suggest that this method exhibits strong performance relative to the kerne-based method, especially notable for its superior attributes in sample sizes and smoothness


title: Exposing the hidden layers and interplay in the quantum software stack

abstract: Current and near-future quantum computers face resource limitations due to noise and low qubit counts. Despite this, effective quantum advantage can still be achieved due to the exponential nature of bit-to-qubit conversion. However, optimizing the software architecture of these systems is essential to utilize available resources efficiently. Unfortunately, the focus on user-friendly quantum computers has obscured critical steps in the software stack, leading to ripple effects into the stack's upper layer induced by limitations in current qubit implementations. This paper unveils the hidden interplay among layers of the quantum software stack.


title: Unipolar opical transitons in nanoclusters of ellipsoidal geometry

abstract: The quantum states of an ellipsoidal nanocluster of a heterophase system InAs / GaAs are studied using an exact analytical approach, in contrast to the generally accepted theoretical model based on the adiabatic approximation. It is shown that the spectrum of a nanoobject is formed from local groups, consisting of discrete levels, separated by terahertz frequency intervals. A double random degeneration of certain spectrum states is revealed. Allowed mid-infrared (IR) optical transitions between different spectral states are analyzed. The role of dimensional parameters and features of the shape of a nanoobject in the characteristics of unipolar transitions is assessed. The absorption spectrum for the transition in the lower part of the substructure spectrum is calculated.


title: Frequency Comb Enhancement via the Self-Crystallization of Vectorial Cavity Solitons

abstract: Long range interactions between dark vectorial temporal cavity solitons are induced though the spontaneous symmetry breaking of orthogonally polarized fields in ring resonators. Turing patterns of alternating polarizations form between adjacent solitons, pushing them apart so that a random distribution of solitons along the cavity length reaches equal equilibrium distances. Enhancement of the frequency comb is achieved through the spontaneous formation of regularly spaced soliton crystals, 'self-crystallization', with greater power and spacing of the spectral lines for increasing soliton numbers.


title: The Effect of Light Nuclei on Chemical Freeze-out Parameters at RHIC Energy

abstract: This study examines the chemical freeze-out of hadrons, encompassing light-flavor, strange-flavor, and light nuclei produced in Au+Au collisions at the Relativistic Heavy Ion Collider (RHIC). By conducting a thermal analysis of hadron yields with and without the inclusion of light nuclei yields, we observe a discernible decrease in the chemical freeze-out temperature $T_{\textrm{ch}}$ when light nuclei yields are considered. This suggests that light nuclei formation occurs at a later stage of the system evolution. Furthermore, the $T_{\textrm{ch}}$ associated with strange-flavor particles is found to be approximately $20-30$ MeV higher than that for light-flavor particles and light nuclei, hinting at the existence of multiple freeze-out hyper-surfaces for different hadron types in heavy-ion collisions. We present parameterized formulas that describe the energy dependence of $T_{\textrm{ch}}$ and $\mu_B$ for four distinct particle sets in central Au+Au collisions. These formulas allow for the selection of appropriate parameters tailored to specific studies, facilitating a more nuanced understanding of the freeze-out process.


title: A new invariant for a cycle of an interval map

abstract: We \emph{propose} a new \emph{invariant} for a \emph{cycle} of an \emph{interval map} $f:[0,1] \to [0,1]$, called its \emph{unfolding number}.


title: Coupling elastic media to gravitational waves: an effective field theory approach

abstract: The interaction of a gravitational wave (GW) with an elastic body is usually described in terms of a GW "force" driving the oscillations of the body's normal modes. However, this description is only possible for GW frequencies for which the response of the elastic body is dominated by a few normal modes. At higher frequencies the normal modes blend into a quasi-continuum and a field-theoretical description, as pioneered by Dyson already in 1969, becomes necessary. However, since the metric perturbation $h_{\mu\nu}$ is an intrinsically relativistic object, a consistent coupling to GWs can only be obtained within a relativistic (and, in fact generally covariant) theory of elasticity. We develop such a formalism using the methods of modern effective field theories, and we use it to provide a derivation of the interaction of elastic bodies with GWs valid also in the high-frequency regime, providing a first-principle derivation of Dyson's result (and partially correcting it). We also stress that the field-theoretical results are obtained working in the TT frame, while the description in terms of a force driving the normal modes is only valid in the proper detector frame. We show how to transform the results between the two frames. Beside an intrinsic conceptual interest, these results are relevant to the computation of the sensitivity of the recently proposed Lunar Gravitational Wave Antenna.


title: Droughts in Germany -- Why global climate change amplifies hydrological extremes

abstract: The warmer temperatures of global climate change strengthen the water cycle, evaporation and precipitation increase. But the extremes of heavy rain, floods, dry periods and droughts will also increase. How does this fit together? Simple physical considerations show which factors mainly regulate the strength of the water cycle in the Earth system, and how this determines water availability on land. This can be used to interpret the observed changes in the water balance in Germany and explain the increasing dryness in Germany.


title: QKFormer: Hierarchical Spiking Transformer using Q-K Attention

abstract: Spiking Transformers, which integrate Spiking Neural Networks (SNNs) with Transformer architectures, have attracted significant attention due to their potential for energy efficiency and high performance. However, existing models in this domain still suffer from suboptimal performance. We introduce several innovations to improve the performance: i) We propose a novel spike-form Q-K attention mechanism, tailored for SNNs, which efficiently models the importance of token or channel dimensions through binary vectors with linear complexity. ii) We incorporate the hierarchical structure, which significantly benefits the performance of both the brain and artificial neural networks, into spiking transformers to obtain multi-scale spiking representation. iii) We design a versatile and powerful patch embedding module with a deformed shortcut specifically for spiking transformers. Together, we develop QKFormer, a hierarchical spiking transformer based on Q-K attention with direct training. QKFormer shows significantly superior performance over existing state-of-the-art SNN models on various mainstream datasets. Notably, with comparable size to Spikformer (66.34 M, 74.81%), QKFormer (64.96 M) achieves a groundbreaking top-1 accuracy of 85.65% on ImageNet-1k, substantially outperforming Spikformer by 10.84%. To our best knowledge, this is the first time that directly training SNNs have exceeded 85% accuracy on ImageNet-1K. The code and models are publicly available at https://github.com/zhouchenlin2096/QKFormer


title: Imaging quantum interference in a monolayer Kitaev quantum spin liquid candidate

abstract: Single atomic defects are prominent windows to look into host quantum states because collective responses from the host states emerge as localized states around the defects. Friedel oscillations and Kondo clouds in Fermi liquids are quintessential examples. However, the situation is quite different for quantum spin liquid (QSL), an exotic state of matter with fractionalized quasiparticles and topological order arising from a profound impact of quantum entanglement. Elucidating the underlying local electronic property has been challenging due to the charge neutrality of fractionalized quasiparticles and the insulating nature of QSLs. Here, using spectroscopic-imaging scanning tunneling microscopy, we report atomically resolved images of monolayer $\alpha$-RuCl$_3$, the most promising Kitaev QSL candidate, on metallic substrates. We find quantum interference in the insulator manifesting as incommensurate and decaying spatial oscillations of the local density of states around defects with a characteristic bias dependence. The oscillation differs from any known spatial structures in its nature and does not exist in other Mott insulators, implying it is an exotic oscillation involved with excitations unique to $\alpha$-RuCl$_3$. Numerical simulations can reproduce the observed oscillation by assuming that itinerant Majorana fermions of Kitaev QSL are scattered across the Majorana Fermi surface. The oscillation provides a new approach to exploring Kitaev QSLs through the local response against defects like Friedel oscillations in metals.


title: PE: A Poincare Explanation Method for Fast Text Hierarchy Generation

abstract: The black-box nature of deep learning models in NLP hinders their widespread application. The research focus has shifted to Hierarchical Attribution (HA) for its ability to model feature interactions. Recent works model non-contiguous combinations with a time-costly greedy search in Eculidean spaces, neglecting underlying linguistic information in feature representations. In this work, we introduce a novel method, namely Poincare Explanation (PE), for modeling feature interactions with hyperbolic spaces in a time efficient manner. Specifically, we take building text hierarchies as finding spanning trees in hyperbolic spaces. First we project the embeddings into hyperbolic spaces to elicit inherit semantic and syntax hierarchical structures. Then we propose a simple yet effective strategy to calculate Shapley score. Finally we build the the hierarchy with proving the constructing process in the projected space could be viewed as building a minimum spanning tree and introduce a time efficient building algorithm. Experimental results demonstrate the effectiveness of our approach.


title: Hybrid low-dimensional limiting state of charge estimator for multi-cell lithium-ion batteries

abstract: The state of charge (SOC) of lithium-ion batteries needs to be accurately estimated for safety and reliability purposes. For battery packs made of a large number of cells, it is not always feasible to design one SOC estimator per cell due to limited computational resources. Instead, only the minimum and the maximum SOC need to be estimated. The challenge is that the cells having minimum and maximum SOC typically change over time. In this context, we present a low-dimensional hybrid estimator of the minimum (maximum) SOC, whose convergence is analytically guaranteed. We consider for this purpose a battery consisting of cells interconnected in series, which we model by electric equivalent circuit models. We then present the hybrid estimator, which runs an observer designed for a single cell at any time instant, selected by a switching-like logic mechanism. We establish a practical exponential stability property for the estimation error on the minimum (maximum) SOC thereby guaranteeing the ability of the hybrid scheme to generate accurate estimates of the minimum (maximum) SOC. The analysis relies on non-smooth hybrid Lyapunov techniques. A numerical illustration is provided to showcase the relevance of the proposed approach.


title: Connectivity of Parameter Regions of Multistationarity for Multisite Phosphorylation Networks

abstract: The parameter region of multistationarity of a reaction network contains all the parameters for which the associated dynamical system exhibits multiple steady states. Describing this region is challenging and remains an active area of research. In this paper, we concentrate on two biologically relevant families of reaction networks that model multisite phosphorylation and dephosphorylation of a substrate at $n$ sites. For small values of $n$, it had previously been shown that the parameter region of multistationarity is connected. Here, we extend these results and provide a proof that applies to all values of $n$. Our techniques are based on the study of the critical polynomial associated with these reaction networks together with polyhedral geometric conditions of the signed support of this polynomial.


title: Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients

abstract: Federated Learning (FL) is a distributed machine learning framework in communication network systems. However, the systems' Non-Independent and Identically Distributed (Non-IID) data negatively affect the convergence efficiency of the global model, since only a subset of these data samples are beneficial for model convergence. In pursuit of this subset, a reliable approach involves determining a measure of validity to rank the samples within the dataset. In this paper, We propose the BHerd strategy which selects a beneficial herd of local gradients to accelerate the convergence of the FL model. Specifically, we map the distribution of the local dataset to the local gradients and use the Herding strategy to obtain a permutation of the set of gradients, where the more advanced gradients in the permutation are closer to the average of the set of gradients. These top portion of the gradients will be selected and sent to the server for global aggregation. We conduct experiments on different datasets, models and scenarios by building a prototype system, and experimental results demonstrate that our BHerd strategy is effective in selecting beneficial local gradients to mitigate the effects brought by the Non-IID dataset, thus accelerating model convergence.


abstract: Multi-modal Large Language Models (MLLMs) have demonstrated their ability to perceive objects in still images, but their application in video-related tasks, such as object tracking, remains understudied. This lack of exploration is primarily due to two key challenges. Firstly, extensive pretraining on large-scale video datasets is required to equip MLLMs with the capability to perceive objects across multiple frames and understand inter-frame relationships. Secondly, processing a large number of frames within the context window of Large Language Models (LLMs) can impose a significant computational burden. To address the first challenge, we introduce ElysiumTrack-1M, a large-scale video dataset supported for three tasks: Single Object Tracking (SOT), Referring Single Object Tracking (RSOT), and Video Referring Expression Generation (Video-REG). ElysiumTrack-1M contains 1.27 million annotated video frames with corresponding object boxes and descriptions. Leveraging this dataset, we conduct training of MLLMs and propose a token-compression model T-Selector to tackle the second challenge. Our proposed approach, Elysium: Exploring Object-level Perception in Videos via MLLM, is an end-to-end trainable MLLM that attempts to conduct object-level tasks in videos without requiring any additional plug-in or expert models. All codes and datasets are available at https://github.com/Hon-Wong/Elysium.


title: On divergent on average trajectories for higher rank actions

abstract: For $d\ge 3$ we first show that the Hausdorff dimension of the set of $A$-divergent on average points in the $(d-1)$-dimensional closed horosphere in the space of $d$-dimensional Euclidean lattices, where $A$ is the group of positive diagonal matrices, is at most $\frac{d-1}{2}$. In particular, this upper bound is sharp for $d=3$. We apply this to compute the Hausdorff dimension of the set of exceptions to the inhomogeneous uniform version of Littlewood conjecture. We say that a pair $(\xi_1,\xi_2)\in\mathbb{R}^2$ satisfies the inhomogeneous Littlewood conjecture if $$\liminf_{q\to\infty}q\|q\xi_1-\theta_1\|_{\mathbb{Z}}\|q\xi_2-\theta_2\|_{\mathbb{Z}}=0$$ for all $(\theta_1,\theta_2)\in\mathbb{R}^2$, where $\|\cdot\|_\mathbb{Z}$ denotes the distance to the nearest integer. We prove that the Hausdorff dimension of the set of pairs $(\xi_1,\xi_2)\in\mathbb{R}^2$ not satisfying the inhomogeneous Littlewood conjecture is $1$, which is equal to the Hausdorff dimension of the conjectural set of exceptions.


title: Active Admittance Control with Iterative Learning for General-Purpose Contact-Rich Manipulation

abstract: Force interaction is inevitable when robots face multiple operation scenarios. How to make the robot competent in force control for generalized operations such as multi-tasks still remains a challenging problem. Aiming at the reproducibility of interaction tasks and the lack of a generalized force control framework for multi-task scenarios, this paper proposes a novel hybrid control framework based on active admittance control with iterative learning parameters-tunning mechanism. The method adopts admittance control as the underlying algorithm to ensure flexibility, and iterative learning as the high-level algorithm to regulate the parameters of the admittance model. The whole algorithm has flexibility and learning ability, which is capable of achieving the goal of excellent versatility. Four representative interactive robot manipulation tasks are chosen to investigate the consistency and generalisability of the proposed method. Experiments are designed to verify the effectiveness of the whole framework, and an average of 98.21% and 91.52% improvement of RMSE is obtained relative to the traditional admittance control as well as the model-free adaptive control, respectively.


title: FedFixer: Mitigating Heterogeneous Label Noise in Federated Learning

abstract: Federated Learning (FL) heavily depends on label quality for its performance. However, the label distribution among individual clients is always both noisy and heterogeneous. The high loss incurred by client-specific samples in heterogeneous label noise poses challenges for distinguishing between client-specific and noisy label samples, impacting the effectiveness of existing label noise learning approaches. To tackle this issue, we propose FedFixer, where the personalized model is introduced to cooperate with the global model to effectively select clean client-specific samples. In the dual models, updating the personalized model solely at a local level can lead to overfitting on noisy data due to limited samples, consequently affecting both the local and global models' performance. To mitigate overfitting, we address this concern from two perspectives. Firstly, we employ a confidence regularizer to alleviate the impact of unconfident predictions caused by label noise. Secondly, a distance regularizer is implemented to constrain the disparity between the personalized and global models. We validate the effectiveness of FedFixer through extensive experiments on benchmark datasets. The results demonstrate that FedFixer can perform well in filtering noisy label samples on different clients, especially in highly heterogeneous label noise scenarios.


title: Phantom scalar field cosmologies constrained by early cosmic measurements

abstract: In this work, we explore new constraints on phantom scalar field cosmologies with a scalar field employing early times catalogues related to CMB measurements, along with the local standard observables, like Supernovae Type Ia (SNIa), $H(z)$ measurements (Cosmic Clocks), and Baryon Acoustic Oscillations (BAO) baselines. In particular, we studied a tracker phantom field with hyperbolic polar coordinates that have been proposed in the literature. The main goal is to obtain precise cosmological constraints for $H_0$ and $\sigma_8$, in comparison to other constructions that present tension in early cosmological parameters. Our results show that phantom scalar field cosmologies have a reduced statistical tension on $H_0$ that it is less than 3$\sigma$ using model-independent CMB catalogues as SPT-3G+WMAP9 and ACTPol DR-4+WMAP9 baselines. This suggests these models using a different phantom potential might address the Hubble constant problem and reduce the systematics involved.


title: Moments of Margulis functions and indefinite ternary quadratic forms

abstract: In this paper, we study the moments of the Margulis $\alpha$-function integrating over expanding translates of a unipotent orbit in $\operatorname{SL}_3(\mathbb{R})/\operatorname{SL}_3(\mathbb{Z})$. We show that for some $\lambda>1$ the $\lambda$-moments of the Margulis $\alpha$-function over expanding translates of a unipotent orbit are uniformly bounded, under suitable Diophantine conditions of the initial unipotent orbit. As an application, we prove that for any indefinite irrational ternary quadratic form $Q$ with suitable Diophantine conditions and $a<b$ the number of integral vectors of norm at most $T$ satisfying $a<Q(v)<b$ is asymptotically equivalent to $\mathsf{C}_Q(b-a)T$ as $T$ tends to infinity, where the constant $\mathsf{C}_Q>0$ depends only on $Q$.


title: Molecular Communication-Based Intelligent Dopamine Rate Modulator for Parkinson's Disease Treatment

abstract: Parkinson's disease (PD) is a progressive neurodegenerative disease, and it is caused by the loss of dopaminergic neurons in the basal ganglia (BG). Currently, there is no definite cure for PD, and available treatments mainly aim to alleviate its symptoms. Due to impaired neurotransmitter-based information transmission in PD, molecular communication-based approaches can be employed as potential solutions to address this issue. Molecular Communications (MC) is a bio-inspired communication method utilizing molecules for carrying information. This mode of communication stands out for developing bio-compatible nanomachines for diagnosing and treating, particularly in addressing neurodegenerative diseases like PD, due to its compatibility with biological systems. This study presents a novel treatment method that introduces an Intelligent Dopamine Rate Modulator (IDRM), which is located in the synaptic gap between the substantia nigra pars compacta (SNc) and striatum to compensate for insufficiency dopamine release in BG caused by PD. For storing dopamine in the IDRM, dopamine compound (DAC) is swallowed and crossed through the digestive system, blood circulatory system, blood-brain barrier (BBB), and brain extracellular matrix uptakes with IDRMs. Here, the DAC concentration is calculated in these regions, revealing that the required exogenous dopamine consistently reaches IDRM. Therefore, the perpetual dopamine insufficiency in BG associated with PD can be compensated. This method reduces drug side effects because dopamine is not released in other brain regions. Unlike other treatments, this approach targets the root cause of PD rather than just reducing symptoms.


title: Decoupling parameter variation from noise: Biquadratic Lyapunov forms in data-driven LPV control

abstract: A promising step from linear towards nonlinear data-driven control is via the design of controllers for linear parameter-varying (LPV) systems, which are linear systems whose parameters are varying along a measurable scheduling signal. However, the interplay between uncertainty arising from corrupted data and the parameter-varying nature of these systems impacts the stability analysis, and limits the generalization of well-understood data-driven methods for linear time-invariant systems. In this work, we decouple this interplay using a recently developed variant of the Fundamental Lemma for LPV systems and the viewpoint of data-informativity, in combination with biquadratic Lyapunov forms. Together, these allow us to develop novel linear matrix inequality conditions for the existence of scheduling-dependent Lyapunov functions, incorporating the intrinsic nonlinearity. Appealingly, these results are stated purely in terms of the collected data and bounds on the noise, and they are computationally favorable to check.


title: Non-commutative divergence and the Turaev cobracket

abstract: The divergence map, an important ingredient in the algebraic description of the Turaev cobracket on a connected oriented compact surface with boundary, is reformulated in the context of non-commutative geometry using a flat connection on the space of 1-forms on a formally smooth associative algebra. We then extend this construction to the case of associative algebras with any finite cohomological dimension, which allows us to give a similar algebraic description of the Turaev cobracket on a closed surface. We also look into a relation between the Satoh trace and the divergence map on a free Lie algebra via geometry over Lie operad.


title: Higher-spin gauge theories in three spacetime dimensions

abstract: These lecture notes provide an introduction to higher-spin gauge theories in three spacetime dimensions, with a focus on their asymptotic symmetries, their holographic description in terms of conformal field theories with W-symmetries as well as on their couplings to scalar matter.


title: Gravitational waves from domain wall collapses and dark matter in the SM with a complex scalar

abstract: We study domain wall induced by spontaneously broken $\mathbb{Z}_2$ symmetry and its gravitational wave signature in the standard model with a complex scalar in connection with dark matter physics. In a minimal setup, a linear term of the singlet field is added to the scalar potential as an explicit $\mathbb{Z}_2$ breaking term to make the domain wall unstable. We obtain its minimal size from cosmological constraints and show that the parameter space that can be probed by current and future pulsar time array experiments requires the vacuum expectation value of the singlet field to be greater than $\mathcal{O}(10-100)$ TeV, along with a singlet-like Higgs mass of $\mathcal{O}(1-100)$ TeV. However, such a region is severely restricted by the dark matter relic density, which places an upper bound on the singlet vacuum expectation value at approximately 200 TeV, and limits the dark matter mass to about half of the singlet-like Higgs boson mass.


title: Revealing Vulnerabilities of Neural Networks in Parameter Learning and Defense Against Explanation-Aware Backdoors

abstract: Explainable Artificial Intelligence (XAI) strategies play a crucial part in increasing the understanding and trustworthiness of neural networks. Nonetheless, these techniques could potentially generate misleading explanations. Blinding attacks can drastically alter a machine learning algorithm's prediction and explanation, providing misleading information by adding visually unnoticeable artifacts into the input, while maintaining the model's accuracy. It poses a serious challenge in ensuring the reliability of XAI methods. To ensure the reliability of XAI methods poses a real challenge, we leverage statistical analysis to highlight the changes in CNN weights within a CNN following blinding attacks. We introduce a method specifically designed to limit the effectiveness of such attacks during the evaluation phase, avoiding the need for extra training. The method we suggest defences against most modern explanation-aware adversarial attacks, achieving an approximate decrease of ~99\% in the Attack Success Rate (ASR) and a ~91\% reduction in the Mean Square Error (MSE) between the original explanation and the defended (post-attack) explanation across three unique types of attacks.


title: Spectropolarimetry of Fraunhofer lines in local upper solar atmosphere

abstract: Spectropolarimetric results of Fraunhofer lines between 516.3nm and 532.6nm are presented in local upper solar chromosphere, transition zone and inner corona below a height of about 0.04 solar radius above the solar limb. The data were acquired on Nov.3, 2013 during a total solar eclipse in Gabon by the prototype Fiber Arrayed Solar Optical Telescope(FASOT). It is found that the polarization amplitudes of the Fraunhofer lines in these layers depend strongly on specific spectral lines. Fraunhofer line at MgI$b_{1}$518.4nm can have a polarization amplitude up to 0.36$\%$ with respective to the continuum polarization level, while the polarizations of some lines like FeI/CrI524.7nm and FeI525.0nm are often under the detection limit 6.0$\times 10^{-4}$. The polarizations of the Fraunhofer lines, like the emission lines and the continuum, increase with height as a whole trend. The fractional linear polarization amplitudes of inner F-corona can be close to those of inner E-corona, and in general larger than those of inner K-corona. Rotation of the polarization direction of Fraunhofer line is often accompanied with variations in their polarization amplitudes and profile shapes. It is also judged from these polarimetric properties, along with evidences, that neutral atoms exist in these atmospheric layers. Thus the inner F-corona described here is induced by the neutral atoms, and the entropy of the inner corona evaluated becomes larger than those in the underneath layers due to more microstates found.


title: NSINA: A News Corpus for Sinhala

abstract: The introduction of large language models (LLMs) has advanced natural language processing (NLP), but their effectiveness is largely dependent on pre-training resources. This is especially evident in low-resource languages, such as Sinhala, which face two primary challenges: the lack of substantial training data and limited benchmarking datasets. In response, this study introduces NSINA, a comprehensive news corpus of over 500,000 articles from popular Sinhala news websites, along with three NLP tasks: news media identification, news category prediction, and news headline generation. The release of NSINA aims to provide a solution to challenges in adapting LLMs to Sinhala, offering valuable resources and benchmarks for improving NLP in the Sinhala language. NSINA is the largest news corpus for Sinhala, available up to date.


title: Weighted Composition Operator on Fock Space

abstract: In this thesis, we establish a necessary and sufficient condition for a weighted composition operator to commute with a self-adjoint weighted composition operator on the Fock space, then obtain a sufficient condition for these commuting weighted composition operators to be normal.


title: Near-field Beam Steering with Planar Antenna Array

abstract: Beam steering enables manipulation of the electromagnetic radiation patterns in antenna array systems. A methodology for steering beams in the near field of a planar antenna array with known phase wavefront functions towards arbitrary azimuth and elevation angles is described in this paper. Rotation of the phase wavefront function is used while preserving the shape. The phase shifts for antenna element excitation currents are determined based on the distances from antenna elements to the nearest point on the rotated wavefront. Beam steering utilizing a Gaussian and a Bessel beam is studied. Phase distribution examples for various steering directions are considered. For Bessel beam steering, a discussion on the resulting beam shapes and the steering impact on the polarization mismatch is provided. The results show a non-negligible magnitude of the cross-polarization with values depending on the steering direction.


title: Rotating metrics and new multipole moments from scattering amplitudes in arbitrary dimensions

abstract: We compute the vacuum metric generated by a generic rotating object in arbitrary dimensions up to third post-Minkowskian order by computing the classical contribution of scattering amplitudes describing the graviton emission by massive spin-1 particles up to two loops. The solution depends on the mass, angular momenta, and on up to two parameters related to generic quadrupole moments. In $D=4$ spacetime dimensions, we recover the vacuum Hartle-Thorne solution describing a generic spinning object to second order in the angular momentum, of which the Kerr metric is a particular case obtained for a specific mass quadrupole moment dictated by the uniqueness theorem. At the level of the effective action, the case of minimal couplings corresponds to the Kerr black hole, while any other mass quadrupole moment requires non-minimal couplings. In $D>4$, the absence of black-hole uniqueness theorems implies that there are multiple spinning black hole solutions with different topology. Using scattering amplitudes, we find a generic solution depending on the mass, angular momenta, the mass quadrupole moment, and a new stress quadrupole moment which does not exist in $D=4$. As special cases, we recover the Myers-Perry and the single-angular-momentum black ring solutions, to third and first post-Minkowksian order, respectively. Interestingly, at variance with the four dimensional case, none of these solutions corresponds to the minimal coupling in the effective action. This shows that, from the point of view of scattering amplitudes, black holes are the "simplest" General Relativity vacuum solutions only in $D=4$.


title: A Measure of Synergy based on Union Information

abstract: The partial information decomposition (PID) framework is concerned with decomposing the information that a set of (two or more) random variables (the sources) has about another variable (the target) into three types of information: unique, redundant, and synergistic. Classical information theory alone does not provide a unique way to decompose information in this manner and additional assumptions have to be made. One often overlooked way to achieve this decomposition is using a so-called measure of union information - which quantifies the information that is present in at least one of the sources - from which a synergy measure stems. In this paper, we introduce a new measure of union information based on adopting a communication channel perspective, compare it with existing measures, and study some of its properties. We also include a comprehensive critical review of characterizations of union information and synergy measures that have been proposed in the literature.


title: Antigen-Specific Antibody Design via Direct Energy-based Preference Optimization

abstract: Antibody design, a crucial task with significant implications across various disciplines such as therapeutics and biology, presents considerable challenges due to its intricate nature. In this paper, we tackle antigen-specific antibody sequence-structure co-design as an optimization problem towards specific preferences, considering both rationality and functionality. Leveraging a pre-trained conditional diffusion model that jointly models sequences and structures of antibodies with equivariant neural networks, we propose direct energy-based preference optimization to guide the generation of antibodies with both rational structures and considerable binding affinities to given antigens. Our method involves fine-tuning the pre-trained diffusion model using a residue-level decomposed energy preference. Additionally, we employ gradient surgery to address conflicts between various types of energy, such as attraction and repulsion. Experiments on RAbD benchmark show that our approach effectively optimizes the energy of generated antibodies and achieves state-of-the-art performance in designing high-quality antibodies with low total energy and high binding affinity simultaneously, demonstrating the superiority of our approach.


title: Partially-Precise Computing Paradigm for Efficient Hardware Implementation of Application-Specific Embedded Systems

abstract: Nowadays, the number of emerging embedded systems rapidly grows in many application domains, due to recent advances in artificial intelligence and internet of things. The main inherent specification of these application-specific systems is that they have not a general nature and are basically developed to only perform a particular task and therefore, deal only with a limited and predefined range of custom input values. Despite this significant feature, these emerging applications are still conventionally implemented using general-purpose and precise digital computational blocks, which are essentially developed to provide the correct result for all possible input values. This highly degrades the physical properties of these applications while does not improve their functionality. To resolve this conflict, a novel computational paradigm named as partially-precise computing is introduced in this paper, based on an inspiration from the brain information reduction hypothesis as a tenet of neuroscience. The main specification of a Partially-Precise Computational (PPC) block is that it provides the precise result only for a desired, limited, and predefined set of input values. This relaxes its internal structure which results in improved physical properties with respect to a conventional precise block. The PPC blocks improve the implementation costs of the embedded applications, with a negligible or even without any output quality degradation with respect to the conventional implementation. The applicability and efficiency of the first instances of PPC adders and multipliers in a Gaussian denoising filter, an image blending and a face recognition neural network are demonstrated by means of a wide range of simulation and synthesis results.


title: SegICL: A Multimodal In-context Learning Framework for Enhanced Segmentation in Medical Imaging

abstract: In the field of medical image segmentation, tackling Out-of-Distribution (OOD) segmentation tasks in a cost-effective manner remains a significant challenge. Universal segmentation models is a solution, which aim to generalize across the diverse modality of medical images, yet their effectiveness often diminishes when applied to OOD data modalities and tasks, requiring intricate fine-tuning of model for optimal performance. Few-shot learning segmentation methods are typically designed for specific modalities of data and cannot be directly transferred for use with another modality. Therefore, we introduce SegICL, a novel approach leveraging In-Context Learning (ICL) for image segmentation. Unlike existing methods, SegICL has the capability to employ text-guided segmentation and conduct in-context learning with a small set of image-mask pairs, eliminating the need for training the model from scratch or fine-tuning for OOD tasks (including OOD modality and dataset). Extensive experimental demonstrates a positive correlation between the number of shots and segmentation performance on OOD tasks. The performance of segmentation when provided thre-shots is approximately 1.5 times better than the performance in a zero-shot setting. This indicates that SegICL effectively address new segmentation tasks based on contextual information. Additionally, SegICL also exhibits comparable performance to mainstream models on OOD and in-distribution tasks. Our code will be released after paper review.


title: Experimental demonstration of a thermal-EM concentrator for enhancing EM signals and converging heat fluxes simultaneously

abstract: Simultaneously concentrating EM waves and heat fluxes to the same target region within an on-chip system carries substantial academic research importance and practical application value. Nevertheless, existing researches are primarily aimed at the design and experimentation of concentrators for individual EM waves or temperature fields. In this work, a thermal-EM concentrator, capable of simultaneously concentrating EM waves and heat fluxes, is designed using transformation optics/thermodynamics and fabricated with engineered EM-thermal metamaterials. The concentrating effects of the proposed thermal-EM concentrator on the thermal fluxes and EM waves are verified through numerical simulations and experimental measurements, respectively, which are in good agreement with each other. Both numerically simulated and experimentally measured results demonstrate the concentrating capability of the proposed thermal-EM concentrator, which can concentrate broadband TM-polarized EM waves ranging from 8-12 GHz and heat/cold flows to the same target region within an on-chip operating environment. The thermal-EM concentrator exhibits a thermal focusing efficiency close to 100% and more than three times enhancement of the magnetic field at the designed center frequency of 10 GHz. The proposed thermal-EM concentrator can be utilized for efficient cooling for the specified component and simultaneously enhancing the EM antenna's radiation/reception efficiency within an on-chip system.


title: Identification of Cyclists' Route Choice Criteria

abstract: The behavior of cyclists when choosing the path to follow along a road network is not uniform. Some of them are mostly interested in minimizing the travelled distance, but some others may also take into account other features such as safety of the roads or pollution. Individuating the different groups of users, estimating the numerical consistency of each of these groups, and reporting the weights assigned by each group to different characteristics of the road network, is quite relevant. Indeed, when decision makers need to assign some budget for infrastructural interventions, they need to know the impact of their decisions, and this is strictly related to the way users perceive different features of the road network. In this paper, we propose an optimization approach to detect the weights assigned to different road features by various user groups, leveraging knowledge of the true paths followed by them, accessible, for example, through data collected by bike-sharing services.


title: Cosmic dipoles of active galactic nuclei at optical and radio wavelengths display much larger amplitudes than the cosmic microwave background dipole

abstract: Sky distributions of large samples of distant active galactic nuclei (AGNs) have shown dipoles significantly larger than the cosmic microwave background (CMB) dipole. However, a recent Bayesian analysis of the QUAIA sample, comprising 1.3 million quasars, has yielded a dipole that seems to be in tandem with the CMB dipole, in contravention of most previous studies of AGN dipoles. Since the question has large cosmological implications, we investigate the QUAIA quasar sample afresh, by directly computing the dipole from asymmetries observed in the source number counts. We instead find a dipole 3-4 times as large as the CMB dipole though in the same direction. Further, it has been claimed elsewhere that the difference between the CMB dipole and the radio dipole estimated from the NRAO VLA Sky Survey (NVSS), the first large catalogue that showed an AGN dipole about four times larger than the CMB dipole, can be fully accounted for by incorporating the shot-noise and clustering contributions to the total NVSS dipole. A careful reinvestigation of the NVSS dipole, however, shows that the random phenomena like shot noise or clustering cannot account for the actually observed NVSS asymmetries, which show a systematic dipole pattern over the sky.


title: In the Search for Optimal Multi-view Learning Models for Crop Classification with Global Remote Sensing Data

abstract: Crop classification is of critical importance due to its role in studying crop pattern changes, resource management, and carbon sequestration. When employing data-driven techniques for its prediction, utilizing various temporal data sources is necessary. Deep learning models have proven to be effective for this task by mapping time series data to high-level representation for prediction. However, they face substantial challenges when dealing with multiple input patterns. The literature offers limited guidance for Multi-View Learning (MVL) scenarios, as it has primarily focused on exploring fusion strategies with specific encoders and validating them in local regions. In contrast, we investigate the impact of simultaneous selection of the fusion strategy and the encoder architecture evaluated on a global-scale cropland and crop-type classifications. We use a range of five fusion strategies (Input, Feature, Decision, Ensemble, Hybrid) and five temporal encoder architectures (LSTM, GRU, TempCNN, TAE, L-TAE) as possible MVL model configurations. The validation is on the CropHarvest dataset that provides optical, radar, and weather time series, and topographic information as input data. We found that in scenarios with a limited number of labeled samples, a unique configuration is insufficient for all the cases. Instead, a specialized combination, including encoder and fusion strategy, should be meticulously sought. To streamline this search process, we suggest initially identifying the optimal encoder architecture tailored for a particular fusion strategy, and then determining the most suitable fusion strategy for the classification task. We provide a technical framework for researchers exploring crop classification or related tasks through a MVL approach.


title: Amino Acids and Their Biological Derivatives Modulate Protein-Protein Interactions In an Additive Way

abstract: Protein-protein interactions (PPI) differ when measured in test tubes and cells due to the complexity of the intracellular environment. Free amino acids (AAs) and their derivatives constitute a significant fraction of the intracellular volume and mass. Recently, we have found that AAs have a general property of rendering protein dispersions more stable by reducing the net attractive part of PPI. Here, we study the effects on PPI of different AA derivatives, AA mixtures, and short peptides. We find that all the tested AA derivatives modulate PPI in solution as well as AAs. Furthermore, we show that the modulation effect is additive when AAs form mixtures or are bound into short peptides. Therefore, this study demonstrates the universal effect of a class of small molecules (i.e. AAs and their biological derivatives) on the modulation of PPI and provides insights into rationally designing biocompatible molecules for stabilizing protein interactions and consequently tuning protein functions.


title: Can Large Language Models (or Humans) Disentangle Text?

abstract: We investigate the potential of large language models (LLMs) to disentangle text variables--to remove the textual traces of an undesired forbidden variable in a task sometimes known as text distillation and closely related to the fairness in AI and causal inference literature. We employ a range of various LLM approaches in an attempt to disentangle text by identifying and removing information about a target variable while preserving other relevant signals. We show that in the strong test of removing sentiment, the statistical association between the processed text and sentiment is still detectable to machine learning classifiers post-LLM-disentanglement. Furthermore, we find that human annotators also struggle to disentangle sentiment while preserving other semantic content. This suggests there may be limited separability between concept variables in some text contexts, highlighting limitations of methods relying on text-level transformations and also raising questions about the robustness of disentanglement methods that achieve statistical independence in representation space.


title: Sparsity-Constrained Linear Quadratic Regulation Problem: Greedy Approach with Performance Guarantee

abstract: We study a linear quadratic regulation problem with a constraint where the control input can be nonzero only at a limited number of times. Given that this constraint leads to a combinational optimization problem, we adopt a greedy method to find a suboptimal solution. To quantify the performance of the greedy algorithm, we employ two metrics that reflect the submodularity level of the objective function: The submodularity ratio and curvature. We first present an explicit form of the optimal control input that is amenable to evaluating these metrics. Subsequently, we establish bounds on the submodularity ratio and curvature, which enable us to offer a practical performance guarantee for the greedy algorithm. The effectiveness of our guarantee is further demonstrated through numerical simulations.


title: Intrinsic Dipole Hall effect in tMoTe$_2$ moir\'{e}: magnetoelectricity and contact-free signature of topological transitions

abstract: We discover an intrinsic dipole Hall effect in a variety of magnetic insulating states at integer fillings of twisted MoTe$_2$ moir\'e superlattice, including topologically trivial and nontrivial ferro-, antiferro-, and ferri-magnetic configurations. The dipole Hall current, in linear response to in-plane electric field, generates an in-plane orbital magnetization $M_{\parallel}$ along the field, through which an AC field can drive magnetization oscillation up to THz range. Upon the continuous topological phase transitions from trivial to quantum anomalous Hall states in both ferromagnetic and antiferromagnetic configurations, the dipole Hall current and $M_{\parallel}$ have an abrupt sign change, enabling contact free detection of the transitions through the magnetic stray field. In configurations where the linear response is forbidden by symmetry, the dipole Hall current and $M_{\parallel}$ appear as a crossed nonlinear response to both in-plane and out-of-plane electric fields. These magnetoelectric phenomena showcase novel functionalities of insulators from the interplay between magnetism, topology and electrical polarization.


title: A nonlocal approach to graded surface modeling in topology optimization

abstract: Additively manufactured structures often exhibit a correlation between their mechanical properties, such as stiffness, strength, and porosity, and their wall thickness. This correlation stems from the interplay between the manufacturing process and the properties of the filler material. In this study, we investigate the thickness-dependent effect on structural stiffness and propose a nonlocal integral model that introduces surface grading of Young's modulus to capture this phenomenon. We incorporate this model into topology optimization for designing structures with optimized compliance subject to a volume constraint. Notably, elastically degraded surfaces penalize excessively thin features, effectively eliminating them from the optimized design. We showcase the efficacy of our proposed framework by optimizing the design of a two-dimensional cantilever beam and a bridge.


title: Linearised Calder\'on problem: Reconstruction of unbounded perturbations in 3D

abstract: Recently an algorithm was given in [Garde & Hyv\"onen, SIAM J. Math. Anal., 2024] for exact direct reconstruction of any $L^2$ perturbation from linearised data in the two-dimensional linearised Calder\'on problem. It was a simple forward substitution method based on a 2D Zernike basis. We now consider the three-dimensional linearised Calder\'on problem in a ball, and use a 3D Zernike basis to obtain a method for exact direct reconstruction of any $L^3$ perturbation from linearised data. The method is likewise a forward substitution, hence making it very efficient to numerically implement. Moreover, the 3D method only makes use of a relatively small subset of boundary measurements for exact reconstruction, compared to a full $L^2$ basis of current densities.


title: Sumsets in the Hypercube

abstract: A subset $S$ of the Boolean hypercube $\mathbb{F}_2^n$ is a sumset if $S = A+A = \{a + b \ | \ a, b\in A\}$ for some $A \subseteq \mathbb{F}_2^n$. We prove that the number of sumsets in $\mathbb{F}_2^n$ is asymptotically $(2^n-1)2^{2^{n-1}}$. Furthermore, we show that the family of sumsets in $\mathbb{F}_2^n$ is almost identical to the family of all subsets of $\mathbb{F}_2^n$ that contain a complete linear subspace of co-dimension $1$.


title: Extremal properties of max-autoregressive moving average processes for modelling extreme river flows

abstract: Max-autogressive moving average (Max-ARMA) processes are powerful tools for modelling time series data with heavy-tailed behaviour; these are a non-linear version of the popular autoregressive moving average models. River flow data typically have features of heavy tails and non-linearity, as large precipitation events cause sudden spikes in the data that then exponentially decay. Therefore, stationary Max-ARMA models are a suitable candidate for capturing the unique temporal dependence structure exhibited by river flows. This paper contributes to advancing our understanding of the extremal properties of stationary Max-ARMA processes. We detail the first approach for deriving the extremal index, the lagged asymptotic dependence coefficient, and an efficient simulation for a general Max-ARMA process. We use the extremal properties, coupled with the belief that Max-ARMA processes provide only an approximation to extreme river flow, to fit such a model which can broadly capture river flow behaviour over a high threshold. We make our inference under a reparametrisation which gives a simpler parameter space that excludes cases where any parameter is non-identifiable. We illustrate results for river flow data from the UK River Thames.


title: Deciphering the Interplay between Local Differential Privacy, Average Bayesian Privacy, and Maximum Bayesian Privacy

abstract: The swift evolution of machine learning has led to emergence of various definitions of privacy due to the threats it poses to privacy, including the concept of local differential privacy (LDP). Although widely embraced and utilized across numerous domains, this conventional approach to measure privacy still exhibits certain limitations, spanning from failure to prevent inferential disclosure to lack of consideration for the adversary's background knowledge. In this comprehensive study, we introduce Bayesian privacy and delve into the intricate relationship between LDP and its Bayesian counterparts, unveiling novel insights into utility-privacy trade-offs. We introduce a framework that encapsulates both attack and defense strategies, highlighting their interplay and effectiveness. The relationship between LDP and Maximum Bayesian Privacy (MBP) is first revealed, demonstrating that under uniform prior distribution, a mechanism satisfying $\xi$-LDP will satisfy $\xi$-MBP and conversely $\xi$-MBP also confers 2$\xi$-LDP. Our next theoretical contribution are anchored in the rigorous definitions and relationships between Average Bayesian Privacy (ABP) and Maximum Bayesian Privacy (MBP), encapsulated by equations $\epsilon_{p,a} \leq \frac{1}{\sqrt{2}}\sqrt{(\epsilon_{p,m} + \epsilon)\cdot(e^{\epsilon_{p,m} + \epsilon} - 1)}$. These relationships fortify our understanding of the privacy guarantees provided by various mechanisms. Our work not only lays the groundwork for future empirical exploration but also promises to facilitate the design of privacy-preserving algorithms, thereby fostering the development of trustworthy machine learning solutions.


title: TrustAI at SemEval-2024 Task 8: A Comprehensive Analysis of Multi-domain Machine Generated Text Detection Techniques

abstract: The Large Language Models (LLMs) exhibit remarkable ability to generate fluent content across a wide spectrum of user queries. However, this capability has raised concerns regarding misinformation and personal information leakage. In this paper, we present our methods for the SemEval2024 Task8, aiming to detect machine-generated text across various domains in both mono-lingual and multi-lingual contexts. Our study comprehensively analyzes various methods to detect machine-generated text, including statistical, neural, and pre-trained model approaches. We also detail our experimental setup and perform a in-depth error analysis to evaluate the effectiveness of these methods. Our methods obtain an accuracy of 86.9\% on the test set of subtask-A mono and 83.7\% for subtask-B. Furthermore, we also highlight the challenges and essential factors for consideration in future studies.


title: Counter-example guided Imitation Learning of Feedback Controllers from Temporal Logic Specifications

abstract: We present a novel method for imitation learning for control requirements expressed using Signal Temporal Logic (STL). More concretely we focus on the problem of training a neural network to imitate a complex controller. The learning process is guided by efficient data aggregation based on counter-examples and a coverage measure. Moreover, we introduce a method to evaluate the performance of the learned controller via parameterization and parameter estimation of the STL requirements. We demonstrate our approach with a flying robot case study.


title: EDUE: Expert Disagreement-Guided One-Pass Uncertainty Estimation for Medical Image Segmentation

abstract: Deploying deep learning (DL) models in medical applications relies on predictive performance and other critical factors, such as conveying trustworthy predictive uncertainty. Uncertainty estimation (UE) methods provide potential solutions for evaluating prediction reliability and improving the model confidence calibration. Despite increasing interest in UE, challenges persist, such as the need for explicit methods to capture aleatoric uncertainty and align uncertainty estimates with real-life disagreements among domain experts. This paper proposes an Expert Disagreement-Guided Uncertainty Estimation (EDUE) for medical image segmentation. By leveraging variability in ground-truth annotations from multiple raters, we guide the model during training and incorporate random sampling-based strategies to enhance calibration confidence. Our method achieves 55% and 23% improvement in correlation on average with expert disagreements at the image and pixel levels, respectively, better calibration, and competitive segmentation performance compared to the state-of-the-art deep ensembles, requiring only a single forward pass.


title: The Adaptive Workplace: Orchestrating Architectural Services around the Wellbeing of Individual Occupants

abstract: As the academic consortia members of the EU Horizon project SONATA ("Situation-aware OrchestratioN of AdapTive Architecture"), we respond to the workshop call for "Office Wellbeing by Design: Don't Stand for Anything Less" by proposing the "Adaptive Workplace" concept. In essence, our vision aims to adapt a workplace to the ever-changing needs of individual occupants, instead of that occupants are expected to adapt to their workplace.


title: Limits on an improved action for contact effective field theory in two-body systems

abstract: We consider a possible resummation of subleading effects in two-body systems with a large scattering length as described by a short-range effective field theory (EFT). In particular, we investigate the consequences of a resummation of part of the range corrections. Explicit calculations of the two-body phase shifts and charge form factor indicate that, except for extreme choices, resummations do not alter the convergence of the EFT expansion and are often beneficial at lowest orders. We have considered the expansion when the regulator cutoff is removed as well as when it is finite, and find that the cutoff is not an important factor for resummations. Our results connect with other works where the partial resummation is induced by potentials with finite cutoffs or interaction ranges.


title: GNS-construction for positive C*-valued sesquilinear maps on a quasi *-algebra

abstract: The GNS construction for positive invariant sesquilinear forms on quasi *-algebras is generalized to a class of positive C*-valued sesquilinear maps on quasi *-algebras. The result is a *-representation taking values in a space of operators acting on a certain quasi-normed C-module.


title: Universal properties of branched copolymers in dilute solutions

abstract: We analyze the universal conformational properties of complex copolymer macromolecules, based on two topologies: the rosette structure containing $f_c$ linear branches and $f_r$ closed loops grafted to the central core, and the symmetric pom-pom structure, consisting of a backbone linear chain terminated by two branching points with functionalities $f$. We assume that the constituent strands (branches) of these structures can be of two different chemical species $a$ and $b$. Depending on the solvent conditions, the inter- or intrachain interactions of some links may vanish, which corresponds to $\Theta$-state of the corresponding polymer species. Applying both the analytical approach within the frames of direct polymer renormalization and numerical simulations based on the lattice model of polymer, we evaluated the set of parameters characterizing the size properties of constituent parts of two complex topologies and estimated quantitatively the impact of interactions between constituent parts on these size characteristics.


title: Superadiabatic dynamical density functional theory for colloidal suspensions under homogeneous steady-shear

abstract: The superadiabatic dynamical density functional theory (superadiabatic-DDFT) is a promising new method for the study of colloidal systems out-of-equilibrium. Within this approach the viscous forces arising from interparticle interactions are accounted for in a natural way by treating explicitly the dynamics of the two-body correlations. For bulk systems subject to spatially homogeneous shear we use the superadiabatic-DDFT framework to calculate the steady-state pair distribution function and the corresponding viscosity for low values of the shear-rate. We then consider a variant of the central approximation underlying this superadiabatic theory and obtain an inhomogeneous generalization of a rheological bulk theory due to Russel and Gast. This paper thus establishes for the first time a connection between DDFT approaches, formulated to treat inhomogeneous systems, and existing work addressing nonequilibrium microstructure and rheology in bulk colloidal suspensions.


title: Research Challenges for Adaptive Architecture: Empowering Occupants of Multi-Occupancy Buildings

abstract: This positional paper outlines our vision of 'adaptive architecture', which involves the integration of robotic technology to physically change an architectural space in supporting the changing needs of its occupants, in response to the CHI'24 workshop "HabiTech - Inhabiting Buildings, Data & Technology" call on "How do new technologies enable and empower the inhabitants of multi-occupancy buildings?". Specifically, while adaptive architecture holds promise for enhancing occupant satisfaction, comfort, and overall health and well-being, there remains a range of research challenges of (1) how it can effectively support individual occupants, while (2) mediating the conflicting needs of collocated others, and (3) integrating meaningfully into the sociocultural characteristics of their building community.


title: Singular profile of free boundary of incompressible inviscid fluid with external force

abstract: This article is devoted to investigate the singular profile of the free boundary of two-dimensional incompressible inviscid fluid with external force near the stagnation point. More precisely, given an external force with some polynomial type decay close to the stagnation point, the singular profile of the free boundary at stagnation point possible are corner wave, flat and cusp singularity. Through excluding the cusp and flat singularity, we know the only singular profile is corner wave singularity, and the corner depends on the decay rate of the solution near the stagnation point. The analysis depends on the geometric method to a class of Bernoulli-type free boundary problem with given degenerate gradient function on free boundary. This work is motivated by the significant work [E. V$\breve{a}$rv$\breve{a}$ruc$\breve{a}$ and G. Weiss, Acta Math, 206, 363-403, (2011)] on Stokes conjecture to the incompressible inviscid fluid acted on by gravity.


title: Continuous primitives for higher degree differential forms in Euclidean spaces, Heisenberg groups and applications

abstract: It is shown that higher degree exact differential forms on compact Riemannian $n$-manifolds possess continuous primitives whose uniform norm is controlled by their $L^n$ norm. A contact sub-Riemannian analogue is proven, with differential forms replaced with Rumin differential forms.


title: On the Zp-extensions of a totally p-adic imaginary quadratic field -- With an appendix by Jean-Fran\c{c}ois Jaulent

abstract: Let k be an imaginary quadratic field, and let p be an odd prime number split in k. We analyze some properties of arbitrary Zp-extensions K/k. These properties are governed by the Hase norm residue symbol of the fundamental p-unit of k, in terms of the valuation $\delta$p(k) of a Fermat quotient, which determines the order of the logarithmic class group Clogk (Theorem 2.2, Appendix 1) and leads, under some conditions, to generalizations of Gold's criterion characterizing $\lambda$p(K/k) = 1 (Theorems 5.1, 5.3, 5.5). This uses the higher rank Chevalley--Herbrand formulas, for the filtrations of the p-class groups in K, that we gave in the 1994's, and the theorem of $\lambda$-stability (2022). This study is in connection with articles of Gold, Sands, Dummit--Ford--Kisilevsky--Sands, Ozaki, Hubbard--Washington,Kataoka, Ray, Jaulent, Fujii. In Appendix A, is given a general proof, by Jaulent, of the link between Clogk and $\delta$p(k) in a broader context. Numerical illustrations (with pari/gp programs) are given.


title: Finite size effects and optimization of the calculation of the surface tension in surfactant mixtures at liquid/vapour interfaces

abstract: The surface tension of monolayers with mixtures of anionic and nonionic surfactant at the liquid/vapour interface is studied. Previous works have observed that calculations of the surface tension of simple fluids show artificial oscillations for small interfacial areas, indicating that the surface tension data fluctuate due to the finite size effects and periodic boundary conditions. In the case of simulations of monolayers composed of surfactant mixtures, the surface tension not only oscillates for small areas but can also give non-physical data, such as negative values. Analysis of the monolayers with different surfactant mixtures, ionic (DTAB, CTAB, SDS) and nonionic (SB3-12), was done for density profiles, parameters of order and pair correlation functions for small and large box areas and all of them present similar behaviour. The fluctuations and the non-physical values of the surface tension are corrected when boxes with large interfacial areas are considered. The results indicate that in order to obtain reliable values of the surface tension, in computer simulations, it is important to choose not only the correct force field but also the appropriate size of the simulation box.


title: SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation

abstract: In recent years, semantic segmentation has become a pivotal tool in processing and interpreting satellite imagery. Yet, a prevalent limitation of supervised learning techniques remains the need for extensive manual annotations by experts. In this work, we explore the potential of generative image diffusion to address the scarcity of annotated data in earth observation tasks. The main idea is to learn the joint data manifold of images and labels, leveraging recent advancements in denoising diffusion probabilistic models. To the best of our knowledge, we are the first to generate both images and corresponding masks for satellite segmentation. We find that the obtained pairs not only display high quality in fine-scale features but also ensure a wide sampling diversity. Both aspects are crucial for earth observation data, where semantic classes can vary severely in scale and occurrence frequency. We employ the novel data instances for downstream segmentation, as a form of data augmentation. In our experiments, we provide comparisons to prior works based on discriminative diffusion models or GANs. We demonstrate that integrating generated samples yields significant quantitative improvements for satellite semantic segmentation -- both compared to baselines and when training only on the original data.


title: ROXIE: Defining a Robotic eXplanation and Interpretability Engine

abstract: In an era where autonomous robots increasingly inhabit public spaces, the imperative for transparency and interpretability in their decision-making processes becomes paramount. This paper presents the overview of a Robotic eXplanation and Interpretability Engine (ROXIE), which addresses this critical need, aiming to demystify the opaque nature of complex robotic behaviors. This paper elucidates the key features and requirements needed for providing information and explanations about robot decision-making processes. It also overviews the suite of software components and libraries available for deployment with ROS 2, empowering users to provide comprehensive explanations and interpretations of robot processes and behaviors, thereby fostering trust and collaboration in human-robot interactions.


title: Enhancing Industrial Transfer Learning with Style Filter: Cost Reduction and Defect-Focus

abstract: Addressing the challenge of data scarcity in industrial domains, transfer learning emerges as a pivotal paradigm. This work introduces Style Filter, a tailored methodology for industrial contexts. By selectively filtering source domain data before knowledge transfer, Style Filter reduces the quantity of data while maintaining or even enhancing the performance of transfer learning strategy. Offering label-free operation, minimal reliance on prior knowledge, independence from specific models, and re-utilization, Style Filter is evaluated on authentic industrial datasets, highlighting its effectiveness when employed before conventional transfer strategies in the deep learning domain. The results underscore the effectiveness of Style Filter in real-world industrial applications.


title: Vector Ising Spin Annealer for Minimizing Ising Hamiltonians

abstract: We introduce the Vector Ising Spin Annealer (VISA), a framework in gain-based computing that harnesses light-matter interactions to solve complex optimization problems encoded in spin Hamiltonians. Traditional driven-dissipative systems often select excited states due to limitations in spin movement. VISA transcends these constraints by enabling spins to operate in a three-dimensional space, offering a robust solution to minimize Ising Hamiltonians effectively. Our comparative analysis reveals VISA's superior performance over conventional single-dimension spin optimizers, demonstrating its ability to bridge substantial energy barriers in complex landscapes. Through detailed studies on cyclic and random graphs, we show VISA's proficiency in dynamically evolving the energy landscape with time-dependent gain and penalty annealing, illustrating its potential to redefine optimization in physical systems.

categories: quant-ph cond-mat.other physics.comp-ph physics.optics


title: Conversational Grounding: Annotation and Analysis of Grounding Acts and Grounding Units

abstract: Successful conversations often rest on common understanding, where all parties are on the same page about the information being shared. This process, known as conversational grounding, is crucial for building trustworthy dialog systems that can accurately keep track of and recall the shared information. The proficiencies of an agent in grounding the conveyed information significantly contribute to building a reliable dialog system. Despite recent advancements in dialog systems, there exists a noticeable deficit in their grounding capabilities. Traum provided a framework for conversational grounding introducing Grounding Acts and Grounding Units, but substantial progress, especially in the realm of Large Language Models, remains lacking. To bridge this gap, we present the annotation of two dialog corpora employing Grounding Acts, Grounding Units, and a measure of their degree of grounding. We discuss our key findings during the annotation and also provide a baseline model to test the performance of current Language Models in categorizing the grounding acts of the dialogs. Our work aims to provide a useful resource for further research in making conversations with machines better understood and more reliable in natural day-to-day collaborative dialogs.


title: Distributed collaborative anomalous sound detection by embedding sharing

abstract: To develop a machine sound monitoring system, a method for detecting anomalous sound is proposed. In this paper, we explore a method for multiple clients to collaboratively learn an anomalous sound detection model while keeping their raw data private from each other. In the context of industrial machine anomalous sound detection, each client possesses data from different machines or different operational states, making it challenging to learn through federated learning or split learning. In our proposed method, each client calculates embeddings using a common pre-trained model developed for sound data classification, and these calculated embeddings are aggregated on the server to perform anomalous sound detection through outlier exposure. Experiments showed that our proposed method improves the AUC of anomalous sound detection by an average of 6.8%.


title: Investigating the impact of the modeling of Earth structure on the neutrino propagation at ultra-high-energies

abstract: The flux of atmospheric and astrophysical neutrinos measured in UHE neutrino detectors is strongly dependent on the description of the propagation and absorption of the neutrinos during the passage through Earth to the detector. In particular, the attenuation of the incident neutrino flux depends on the details of the matter structure between the source and the detector. In this paper, we will investigate the impact of different descriptions for the density profile of Earth on the transmission coefficient, defined as the ratio between the flux measured in the detector and the incoming neutrino flux. We will consider five different models for the Earth's density profile and estimate how these different models modify the target column density and transmission coefficients for different flavors. The results are derived by solving the cascade equations taking into account the NC interactions and tau regeneration. A comparison with approximated solutions is also presented. Our results indicated that the predictions are sensitive to the model considered for the density profile, with the simplified three layer model providing a satisfactory description when compared with the PREM results.


title: Calibrating Bayesian UNet++ for Sub-Seasonal Forecasting

abstract: Seasonal forecasting is a crucial task when it comes to detecting the extreme heat and colds that occur due to climate change. Confidence in the predictions should be reliable since a small increase in the temperatures in a year has a big impact on the world. Calibration of the neural networks provides a way to ensure our confidence in the predictions. However, calibrating regression models is an under-researched topic, especially in forecasters. We calibrate a UNet++ based architecture, which was shown to outperform physics-based models in temperature anomalies. We show that with a slight trade-off between prediction error and calibration error, it is possible to get more reliable and sharper forecasts. We believe that calibration should be an important part of safety-critical machine learning applications such as weather forecasters.


title: Technical Development of a Semi-Autonomous Robotic Partition

abstract: This technical description details the design and engineering process of a semi-autonomous robotic partition. This robotic partition prototype was subsequently employed in a longer-term evaluation in-the-wild study conducted by the authors in a real-world office setting.


title: Semantically Enriched Cross-Lingual Sentence Embeddings for Crisis-related Social Media Texts

abstract: Tasks such as semantic search and clustering on crisis-related social media texts enhance our comprehension of crisis discourse, aiding decision-making and targeted interventions. Pre-trained language models have advanced performance in crisis informatics, but their contextual embeddings lack semantic meaningfulness. Although the CrisisTransformers family includes a sentence encoder to address the semanticity issue, it remains monolingual, processing only English texts. Furthermore, employing separate models for different languages leads to embeddings in distinct vector spaces, introducing challenges when comparing semantic similarities between multi-lingual texts. Therefore, we propose multi-lingual sentence encoders (CT-XLMR-SE and CT-mBERT-SE) that embed crisis-related social media texts for over 50 languages, such that texts with similar meanings are in close proximity within the same vector space, irrespective of language diversity. Results in sentence encoding and sentence matching tasks are promising, suggesting these models could serve as robust baselines when embedding multi-lingual crisis-related social media texts. The models are publicly available at: https://huggingface.co/crisistransformers.