title: Research and application of Transformer based anomaly detection model: A literature review

abstract: Transformer, as one of the most advanced neural network models in Natural Language Processing (NLP), exhibits diverse applications in the field of anomaly detection. To inspire research on Transformer-based anomaly detection, this review offers a fresh perspective on the concept of anomaly detection. We explore the current challenges of anomaly detection and provide detailed insights into the operating principles of Transformer and its variants in anomaly detection tasks. Additionally, we delineate various application scenarios for Transformer-based anomaly detection models and discuss the datasets and evaluation metrics employed. Furthermore, this review highlights the key challenges in Transformer-based anomaly detection research and conducts a comprehensive analysis of future research trends in this domain. The review includes an extensive compilation of over 100 core references related to Transformer-based anomaly detection. To the best of our knowledge, this is the first comprehensive review that focuses on the research related to Transformer in the context of anomaly detection. We hope that this paper can provide detailed technical information to researchers interested in Transformer-based anomaly detection tasks.


title: Confidence-aware Fine-tuning of Sequential Recommendation Systems via Conformal Prediction

abstract: In Sequential Recommendation Systems, Cross-Entropy (CE) loss is commonly used but fails to harness item confidence scores during training. Recognizing the critical role of confidence in aligning training objectives with evaluation metrics, we propose CPFT, a versatile framework that enhances recommendation confidence by integrating Conformal Prediction (CP)-based losses with CE loss during fine-tuning. CPFT dynamically generates a set of items with a high probability of containing the ground truth, enriching the training process by incorporating validation data without compromising its role in model selection. This innovative approach, coupled with CP-based losses, sharpens the focus on refining recommendation sets, thereby elevating the confidence in potential item predictions. By fine-tuning item confidence through CP-based losses, CPFT significantly enhances model performance, leading to more precise and trustworthy recommendations that increase user trust and satisfaction. Our extensive evaluation across five diverse datasets and four distinct sequential models confirms CPFT's substantial impact on improving recommendation quality through strategic confidence optimization. Access to the framework's code will be provided following the acceptance of the paper.


title: Derivative sampling expansions in shift-invariant spaces with error estimates covering discontinuous signals

abstract: This paper is concerned with the problem of sampling and interpolation involving derivatives in shift-invariant spaces and the error analysis of the derivative sampling expansions for fundamentally large classes of functions. A new type of polynomials based on derivative samples is introduced, which is different from the Euler-Frobenius polynomials for the multiplicity $r>1$. A complete characterization of uniform sampling with derivatives is given using Laurent operators. The rate of approximation of a signal (not necessarily continuous) by the derivative sampling expansions in shift-invariant spaces generated by compactly supported functions is established in terms of $L^p$- average modulus of smoothness. Finally, several typical examples illustrating the various problems are discussed in detail.


title: Prismatic: Interactive Multi-View Cluster Analysis of Concept Stocks

abstract: Financial cluster analysis allows investors to discover investment alternatives and avoid undertaking excessive risks. However, this analytical task faces substantial challenges arising from many pairwise comparisons, the dynamic correlations across time spans, and the ambiguity in deriving implications from business relational knowledge. We propose Prismatic, a visual analytics system that integrates quantitative analysis of historical performance and qualitative analysis of business relational knowledge to cluster correlated businesses interactively. Prismatic features three clustering processes: dynamic cluster generation, knowledge-based cluster exploration, and correlation-based cluster validation. Utilizing a multi-view clustering approach, it enriches data-driven clusters with knowledge-driven similarity, providing a nuanced understanding of business correlations. Through well-coordinated visual views, Prismatic facilitates a comprehensive interpretation of intertwined quantitative and qualitative features, demonstrating its usefulness and effectiveness via case studies on formulating concept stocks and extensive interviews with domain experts.


title: Learning-enabled Flexible Job-shop Scheduling for Scalable Smart Manufacturing

abstract: In smart manufacturing systems (SMSs), flexible job-shop scheduling with transportation constraints (FJSPT) is essential to optimize solutions for maximizing productivity, considering production flexibility based on automated guided vehicles (AGVs). Recent developments in deep reinforcement learning (DRL)-based methods for FJSPT have encountered a scale generalization challenge. These methods underperform when applied to environment at scales different from their training set, resulting in low-quality solutions. To address this, we introduce a novel graph-based DRL method, named the Heterogeneous Graph Scheduler (HGS). Our method leverages locally extracted relational knowledge among operations, machines, and vehicle nodes for scheduling, with a graph-structured decision-making framework that reduces encoding complexity and enhances scale generalization. Our performance evaluation, conducted with benchmark datasets, reveals that the proposed method outperforms traditional dispatching rules, meta-heuristics, and existing DRL-based approaches in terms of makespan performance, even on large-scale instances that have not been experienced during training.


title: OmniBOR: A System for Automatic, Verifiable Artifact Resolution across Software Supply Chains

abstract: Software supply chain attacks, which exploit the build process or artifacts used in the process of building a software product, are increasingly of concern. To combat these attacks, one must be able to check that every artifact that a software product depends on does not contain vulnerabilities. In this paper, we introduce OmniBOR, (Universal Bill of Receipts) a minimalistic scheme for build tools to create an artifact dependency graph which can be used to track every software artifact incorporated into a built software product. We present the architecture of OmniBOR, the underlying data representations, and two implementations that produce OmniBOR data and embed an OmniBOR Identifier into built software, including a compiler-based approach and one based on tracing the build process. We demonstrate the efficacy of this approach on benchmarks including a Linux distribution for applications such as Common Vulnerabilities and Exposures (CVE) detection and software bill of materials (SBOM) computation.


title: On the hardness of conversion from entangled proof into separable one

abstract: A quantum channel whose image approximates the set of separable states is called a disentangler, which plays a prominent role in the investigation of variants of the computational model called Quantum Merlin Arthur games, and has potential applications in classical and quantum algorithms for the separability testing and NP-complete problems. So far, two types of a disentangler, constructed based on $\epsilon$-nets and the quantum de Finetti theorem, have been known; however, both of them require an exponentially large input system. Moreover, in 2008, John Watrous conjectured that any disentangler requires an exponentially large input system, called the disentangler conjecture. In this paper, we show that both of the two known disentanglers can be regarded as examples of a strong disentangler, which is a disentangler approximately breaking entanglement between one output system and the composite system of another output system and the arbitrarily large environment. Note that the strong disentangler is essentially an approximately entanglement-breaking channel while the original disentangler is an approximately entanglement-annihilating channel, and the set of strong disentanglers is a subset of disentanglers. As a main result, we show that the disentangler conjecture is true for this subset, the set of strong disentanglers, for a wide range of approximation parameters without any computational hardness assumptions.


title: MEL: Efficient Multi-Task Evolutionary Learning for High-Dimensional Feature Selection

abstract: Feature selection is a crucial step in data mining to enhance model performance by reducing data dimensionality. However, the increasing dimensionality of collected data exacerbates the challenge known as the "curse of dimensionality", where computation grows exponentially with the number of dimensions. To tackle this issue, evolutionary computational (EC) approaches have gained popularity due to their simplicity and applicability. Unfortunately, the diverse designs of EC methods result in varying abilities to handle different data, often underutilizing and not sharing information effectively. In this paper, we propose a novel approach called PSO-based Multi-task Evolutionary Learning (MEL) that leverages multi-task learning to address these challenges. By incorporating information sharing between different feature selection tasks, MEL achieves enhanced learning ability and efficiency. We evaluate the effectiveness of MEL through extensive experiments on 22 high-dimensional datasets. Comparing against 24 EC approaches, our method exhibits strong competitiveness. Additionally, we have open-sourced our code on GitHub at https://github.com/wangxb96/MEL.


title: SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding

abstract: As large language models (LLMs) become increasingly integrated into real-world applications such as code generation and chatbot assistance, extensive efforts have been made to align LLM behavior with human values, including safety. Jailbreak attacks, aiming to provoke unintended and unsafe behaviors from LLMs, remain a significant/leading LLM safety threat. In this paper, we aim to defend LLMs against jailbreak attacks by introducing SafeDecoding, a safety-aware decoding strategy for LLMs to generate helpful and harmless responses to user queries. Our insight in developing SafeDecoding is based on the observation that, even though probabilities of tokens representing harmful contents outweigh those representing harmless responses, safety disclaimers still appear among the top tokens after sorting tokens by probability in descending order. This allows us to mitigate jailbreak attacks by identifying safety disclaimers and amplifying their token probabilities, while simultaneously attenuating the probabilities of token sequences that are aligned with the objectives of jailbreak attacks. We perform extensive experiments on five LLMs using six state-of-the-art jailbreak attacks and four benchmark datasets. Our results show that SafeDecoding significantly reduces the attack success rate and harmfulness of jailbreak attacks without compromising the helpfulness of responses to benign user queries. SafeDecoding outperforms six defense methods.


title: Interface logistic problems: large diffusion and singular perturbation results

abstract: In this work we consider an interface logistic problem where two populations live in two different regions, separated by a membrane or interface where it happens an interchange of flux. Thus, the two populations only interact or are coupled through such a membrane where we impose the so-called Kedem-Katchalsky boundary conditions. For this particular scenario we analyze the existence and uniqueness of positive solutions depending on the parameters involve in the system, obtaining interesting results where one can see for the first time the effect of the membrane under such boundary conditions. To do so, we first ascertain the asymptotic behaviour of several linear and nonlinear problems for which we include a diffusion coefficient and analyse the behaviour of the solutions when such a diffusion parameter goes to zero or infinity. Despite their own interest, since these asymptotic results have never been studied before, they will be crucial in analyzing the existence and uniqueness for the main interface logistic problems under analysis. Finally, we apply such an asymptotic analysis to characterize the existence of solutions in terms of the growth rate of the populations, when both populations possess the same growth rate and, also, when they depend on different parameters.


title: Quantum Algorithm Exploration using Application-Oriented Performance Benchmarks

abstract: The QED-C suite of Application-Oriented Benchmarks provides the ability to gauge performance characteristics of quantum computers as applied to real-world applications. Its benchmark programs sweep over a range of problem sizes and inputs, capturing key performance metrics related to the quality of results, total time of execution, and quantum gate resources consumed. In this manuscript, we investigate challenges in broadening the relevance of this benchmarking methodology to applications of greater complexity. First, we introduce a method for improving landscape coverage by varying algorithm parameters systematically, exemplifying this functionality in a new scalable HHL linear equation solver benchmark. Second, we add a VQE implementation of a Hydrogen Lattice simulation to the QED-C suite, and introduce a methodology for analyzing the result quality and run-time cost trade-off. We observe a decrease in accuracy with increased number of qubits, but only a mild increase in the execution time. Third, unique characteristics of a supervised machine-learning classification application are explored as a benchmark to gauge the extensibility of the framework to new classes of application. Applying this to a binary classification problem revealed the increase in training time required for larger anzatz circuits, and the significant classical overhead. Fourth, we add methods to include optimization and error mitigation in the benchmarking workflow which allows us to: identify a favourable trade off between approximate gate synthesis and gate noise; observe the benefits of measurement error mitigation and a form of deterministic error mitigation algorithm; and to contrast the improvement with the resulting time overhead. Looking ahead, we discuss how the benchmark framework can be instrumental in facilitating the exploration of algorithmic options and their impact on performance.


title: Detecting Adversarial Spectrum Attacks via Distance to Decision Boundary Statistics

abstract: Machine learning has been adopted for efficient cooperative spectrum sensing. However, it incurs an additional security risk due to attacks leveraging adversarial machine learning to create malicious spectrum sensing values to deceive the fusion center, called adversarial spectrum attacks. In this paper, we propose an efficient framework for detecting adversarial spectrum attacks. Our design leverages the concept of the distance to the decision boundary (DDB) observed at the fusion center and compares the training and testing DDB distributions to identify adversarial spectrum attacks. We create a computationally efficient way to compute the DDB for machine learning based spectrum sensing systems. Experimental results based on realistic spectrum data show that our method, under typical settings, achieves a high detection rate of up to 99\% and maintains a low false alarm rate of less than 1\%. In addition, our method to compute the DDB based on spectrum data achieves 54\%--64\% improvements in computational efficiency over existing distance calculation methods. The proposed DDB-based detection framework offers a practical and efficient solution for identifying malicious sensing values created by adversarial spectrum attacks.


title: Multi-modality transrectal ultrasound video classification for identification of clinically significant prostate cancer

abstract: Prostate cancer is the most common noncutaneous cancer in the world. Recently, multi-modality transrectal ultrasound (TRUS) has increasingly become an effective tool for the guidance of prostate biopsies. With the aim of effectively identifying prostate cancer, we propose a framework for the classification of clinically significant prostate cancer (csPCa) from multi-modality TRUS videos. The framework utilizes two 3D ResNet-50 models to extract features from B-mode images and shear wave elastography images, respectively. An adaptive spatial fusion module is introduced to aggregate two modalities' features. An orthogonal regularized loss is further used to mitigate feature redundancy. The proposed framework is evaluated on an in-house dataset containing 512 TRUS videos, and achieves favorable performance in identifying csPCa with an area under curve (AUC) of 0.84. Furthermore, the visualized class activation mapping (CAM) images generated from the proposed framework may provide valuable guidance for the localization of csPCa, thus facilitating the TRUS-guided targeted biopsy. Our code is publicly available at https://github.com/2313595986/ProstateTRUS.


title: An In-Depth Investigation of LEO Satellite Topology Design Parameters

abstract: Low Earth Orbit (LEO) satellite networks are rapidly gaining traction today. Although several real-world deployments exist, our preliminary analysis of LEO topology performance with the soon-to-be operational Inter-Satellite Links (ISLs) reveals several interesting characteristics that are difficult to explain based on our current understanding of topologies. For example, a real-world satellite shell with a low density of satellites offers better latency performance than another shell with nearly double the number of satellites. In this work, we conduct an in-depth investigation of LEO satellite topology design parameters and their impact on network performance while using the ISLs. In particular, we focus on three design parameters: the number of orbits in a shell, the inclination of orbits, and the number of satellites per orbit. Through an extensive analysis of real-world and synthetic satellite configurations, we uncover several interesting properties of satellite topologies. Notably, there exist thresholds for the number of satellites per orbit and the number of orbits below which the latency performance degrades significantly. Moreover, network delay between a pair of traffic endpoints depends on the alignment of the satellite's orbit (Inclination) with the geographic locations of endpoints.


title: An Algorithmic Meta Theorem for Homomorphism Indistinguishability

abstract: Two graphs $G$ and $H$ are homomorphism indistinguishable over a family of graphs $\mathcal{F}$ if for all graphs $F \in \mathcal{F}$ the number of homomorphisms from $F$ to $G$ is equal to the number of homomorphism from $F$ to $H$. Many natural equivalence relations comparing graphs such as (quantum) isomorphism, cospectrality, and logical equivalences can be characterised as homomorphism indistinguishability relations over various graph classes. For a fixed graph class $\mathcal{F}$, the decision problem HomInd($\mathcal{F}$) asks to determine whether two input graphs $G$ and $H$ are homomorphism indistinguishable over $\mathcal{F}$. The problem HomInd($\mathcal{F}$) is known to be decidable only for few graph classes $\mathcal{F}$. We show that HomInd($\mathcal{F}$) admits a randomised polynomial-time algorithm for every graph class $\mathcal{F}$ of bounded treewidth which is definable in counting monadic second-order logic CMSO2. Thereby, we give the first general algorithm for deciding homomorphism indistinguishability. This result extends to a version of HomInd where the graph class $\mathcal{F}$ is specified by a CMSO2-sentence and a bound $k$ on the treewidth, which are given as input. For fixed $k$, this problem is randomised fixed-parameter tractable. If $k$ is part of the input then it is coNP- and coW[1]-hard. Addressing a problem posed by Berkholz (2012), we show coNP-hardness by establishing that deciding indistinguishability under the $k$-dimensional Weisfeiler--Leman algorithm is coNP-hard when $k$ is part of the input.


title: Global controllability to harmonic maps of the heat flow from a circle to a sphere

abstract: In this paper, we study the global controllability and stabilization problems of the harmonic map heat flow from a circle to a sphere. Combining ideas from control theory, heat flow, differential geometry, and asymptotic analysis, we obtain several important properties, such as small-time local controllability, local quantitative rapid stabilization, obstruction to semi-global asymptotic stabilization, and global controllability to geodesics. Surprisingly, due to the geometric feature of the equation we also discover the small-time global controllability between harmonic maps within the same homotopy class for general compact Riemannian manifold targets, which is to be compared with the analogous but longstanding problem for the nonlinear heat equations.


title: Towards Robust Model-Based Reinforcement Learning Against Adversarial Corruption

abstract: This study tackles the challenges of adversarial corruption in model-based reinforcement learning (RL), where the transition dynamics can be corrupted by an adversary. Existing studies on corruption-robust RL mostly focus on the setting of model-free RL, where robust least-square regression is often employed for value function estimation. However, these techniques cannot be directly applied to model-based RL. In this paper, we focus on model-based RL and take the maximum likelihood estimation (MLE) approach to learn transition model. Our work encompasses both online and offline settings. In the online setting, we introduce an algorithm called corruption-robust optimistic MLE (CR-OMLE), which leverages total-variation (TV)-based information ratios as uncertainty weights for MLE. We prove that CR-OMLE achieves a regret of $\tilde{\mathcal{O}}(\sqrt{T} + C)$, where $C$ denotes the cumulative corruption level after $T$ episodes. We also prove a lower bound to show that the additive dependence on $C$ is optimal. We extend our weighting technique to the offline setting, and propose an algorithm named corruption-robust pessimistic MLE (CR-PMLE). Under a uniform coverage condition, CR-PMLE exhibits suboptimality worsened by $\mathcal{O}(C/n)$, nearly matching the lower bound. To the best of our knowledge, this is the first work on corruption-robust model-based RL algorithms with provable guarantees.


title: Variance Reduction and Low Sample Complexity in Stochastic Optimization via Proximal Point Method

abstract: This paper proposes a stochastic proximal point method to solve a stochastic convex composite optimization problem. High probability results in stochastic optimization typically hinge on restrictive assumptions on the stochastic gradient noise, for example, sub-Gaussian distributions. Assuming only weak conditions such as bounded variance of the stochastic gradient, this paper establishes a low sample complexity to obtain a high probability guarantee on the convergence of the proposed method. Additionally, a notable aspect of this work is the development of a subroutine to solve the proximal subproblem, which also serves as a novel technique for variance reduction.


title: The polyhedral type of a polynomial map on the plane

abstract: Two continuous maps $f, g : \mathbb{C}^2\to\mathbb{C}^2$ are said to be topologically equivalent if there exist homeomorphisms $\varphi,\psi:\mathbb{C}^2\to\mathbb{C}^2$ satisfying $\psi\circ f\circ\varphi = g$. It is known that there are finitely many topologically non-equivalent polynomial maps $\mathbb{C}^2\to\mathbb{C}^2$ with any given degree $d$. The number $T(d)$ of these topological types is known only whenever $d=2$. In this paper, we describe the topology of generic complex polynomial maps on the plane using the corresponding pair of Newton polytopes and establish a method for constructing topologically non-equivalent maps of degree $d$. We furthermore provide a software implementation of the resulting algorithm, and present lower bounds on $T(d)$ whenever $d=3$ and $d=4$.


title: CLIP-MUSED: CLIP-Guided Multi-Subject Visual Neural Information Semantic Decoding

abstract: The study of decoding visual neural information faces challenges in generalizing single-subject decoding models to multiple subjects, due to individual differences. Moreover, the limited availability of data from a single subject has a constraining impact on model performance. Although prior multi-subject decoding methods have made significant progress, they still suffer from several limitations, including difficulty in extracting global neural response features, linear scaling of model parameters with the number of subjects, and inadequate characterization of the relationship between neural responses of different subjects to various stimuli. To overcome these limitations, we propose a CLIP-guided Multi-sUbject visual neural information SEmantic Decoding (CLIP-MUSED) method. Our method consists of a Transformer-based feature extractor to effectively model global neural representations. It also incorporates learnable subject-specific tokens that facilitates the aggregation of multi-subject data without a linear increase of parameters. Additionally, we employ representational similarity analysis (RSA) to guide token representation learning based on the topological relationship of visual stimuli in the representation space of CLIP, enabling full characterization of the relationship between neural responses of different subjects under different stimuli. Finally, token representations are used for multi-subject semantic decoding. Our proposed method outperforms single-subject decoding methods and achieves state-of-the-art performance among the existing multi-subject methods on two fMRI datasets. Visualization results provide insights into the effectiveness of our proposed method. Code is available at https://github.com/CLIP-MUSED/CLIP-MUSED.


title: AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systems

abstract: Recently, Large Language Model based Autonomous system(LLMAS) has gained great popularity for its potential to simulate complicated behaviors of human societies. One of its main challenges is to present and analyze the dynamic events evolution of LLMAS. In this work, we present a visualization approach to explore detailed statuses and agents' behavior within LLMAS. We propose a general pipeline that establishes a behavior structure from raw LLMAS execution events, leverages a behavior summarization algorithm to construct a hierarchical summary of the entire structure in terms of time sequence, and a cause trace method to mine the causal relationship between agent behaviors. We then develop AgentLens, a visual analysis system that leverages a hierarchical temporal visualization for illustrating the evolution of LLMAS, and supports users to interactively investigate details and causes of agents' behaviors. Two usage scenarios and a user study demonstrate the effectiveness and usability of our AgentLens.


title: Multi-Task Learning of Active Fault-Tolerant Controller for Leg Failures in Quadruped robots

abstract: Electric quadruped robots used in outdoor exploration are susceptible to leg-related electrical or mechanical failures. Unexpected joint power loss and joint locking can immediately pose a falling threat. Typically, controllers lack the capability to actively sense the condition of their own joints and take proactive actions. Maintaining the original motion patterns could lead to disastrous consequences, as the controller may produce irrational output within a short period of time, further creating the risk of serious physical injuries. This paper presents a hierarchical fault-tolerant control scheme employing a multi-task training architecture capable of actively perceiving and overcoming two types of leg joint faults. The architecture simultaneously trains three joint task policies for health, power loss, and locking scenarios in parallel, introducing a symmetric reflection initialization technique to ensure rapid and stable gait skill transformations. Experiments demonstrate that the control scheme is robust in unexpected scenarios where a single leg experiences concurrent joint faults in two joints. Furthermore, the policy retains the robot's planar mobility, enabling rough velocity tracking. Finally, zero-shot Sim2Real transfer is achieved on the real-world SOLO8 robot, countering both electrical and mechanical failures.


title: K-biframes in Hilbert spaces

abstract: In this paper, we introduce a new concept of K-biframes for Hilbert spaces. We then examine several characterizations with the assistance of a biframe operator. Moreover, we investigate their properties from the perspective of operator theory by establishing various relationships and properties.


title: Nearly Minimax Optimal Regret for Learning Linear Mixture Stochastic Shortest Path

abstract: We study the Stochastic Shortest Path (SSP) problem with a linear mixture transition kernel, where an agent repeatedly interacts with a stochastic environment and seeks to reach certain goal state while minimizing the cumulative cost. Existing works often assume a strictly positive lower bound of the cost function or an upper bound of the expected length for the optimal policy. In this paper, we propose a new algorithm to eliminate these restrictive assumptions. Our algorithm is based on extended value iteration with a fine-grained variance-aware confidence set, where the variance is estimated recursively from high-order moments. Our algorithm achieves an $\tilde{\mathcal O}(dB_*\sqrt{K})$ regret bound, where $d$ is the dimension of the feature mapping in the linear transition kernel, $B_*$ is the upper bound of the total cumulative cost for the optimal policy, and $K$ is the number of episodes. Our regret upper bound matches the $\Omega(dB_*\sqrt{K})$ lower bound of linear mixture SSPs in Min et al. (2022), which suggests that our algorithm is nearly minimax optimal.


title: Exploring Federated Deep Learning for Standardising Naming Conventions in Radiotherapy Data

abstract: Standardising structure volume names in radiotherapy (RT) data is necessary to enable data mining and analyses, especially across multi-institutional centres. This process is time and resource intensive, which highlights the need for new automated and efficient approaches to handle the task. Several machine learning-based methods have been proposed and evaluated to standardise nomenclature. However, no studies have considered that RT patient records are distributed across multiple data centres. This paper introduces a method that emulates real-world environments to establish standardised nomenclature. This is achieved by integrating decentralised real-time data and federated learning (FL). A multimodal deep artificial neural network was proposed to standardise RT data in federated settings. Three types of possible attributes were extracted from the structures to train the deep learning models: tabular, visual, and volumetric. Simulated experiments were carried out to train the models across several scenarios including multiple data centres, input modalities, and aggregation strategies. The models were compared against models developed with single modalities in federated settings, in addition to models trained in centralised settings. Categorical classification accuracy was calculated on hold-out samples to inform the models performance. Our results highlight the need for fusing multiple modalities when training such models, with better performance reported with tabular-volumetric models. In addition, we report comparable accuracy compared to models built in centralised settings. This demonstrates the suitability of FL for handling the standardization task. Additional ablation analyses showed that the total number of samples in the data centres and the number of data centres highly affects the training process and should be carefully considered when building standardisation models.


title: Chiral Interaction Induced Near-Perfect Photon Blockade

abstract: Based on the scattering matrix method, we theoretically demonstrate that the chiral interaction can induce the almost perfect photon blockade (PB) in the waveguide-cavity quantum electrodynamics (QED) system. The mechanism relies on the multi-photon-paths interference within the waveguide, which is clearly shown by the analytical parameter regime for $g^{(2)}(0)\approx0$. When $N$ cavities are introduced into the system, there are $N$ optimal parameter points accordingly for the almost perfect PB, and the required chirality decreases exponentially with increasing $N$. Under the conditions of resonant driving and specific chirality, the output light only relies on the parity of $N$ ($N\ge2$), where the coherent state and single-photon state correspond to the case of system including the odd and even number of cavities, respectively. Our work offers an alternative route for achieving almost perfect PB effects by employing the chirality of system, with potential application in the on-chip single-photon source with integrability.


title: A Comprehensive Review of Software and Hardware Energy Efficiency of Video Decoders

abstract: Energy and compression efficiency are two essential parts of modern video decoder implementations that have to be considered. This work comprehensively studies the following six video coding formats regarding compression and decoding energy efficiency: AVC, VP9, HEVC, AV1, VVC, and AVM. We first evaluate the energy demand of reference and optimized software decoder implementations. Furthermore, we consider the influence of the usage of SIMD instructions on those decoder implementations. We find that AV1 is a sweet spot for optimized software decoder implementations with an additional energy demand of 16.55% and bitrate savings of -43.95% compared to VP9. We furthermore evaluate the hardware decoding energy demand of four video coding formats. Thereby, we show that AV1 has energy demand increases by 117.50% compared to VP9. For HEVC, we found a sweet spot in terms of energy demand with an increase of 6.06% with respect to VP9. Relative to their optimized software counterparts, hardware video decoders reduce the energy consumption to less than 9% compared to software decoders.


title: An example of an "unlinked" set of $2k + 3$ points in $2k$-space

abstract: Take any $d + 3$ points in $\mathbb{R}^d$. It is known that (a) if $d = 2k + 1$, then there are two linked $(k + 1)$-simplices with the vertices at these points; (b) if $d = 2k$, then there are two disjoint $(k + 1)$-tuples of these points such that their convex hulls intersect. The analogue of (b) for $d = 2k + 1$, which is also the analogue of (a) for intersections (instead of linkings), states that there are two disjoint $(k + 1)$- and $(k + 2)$-tuples of these points such that their convex hulls intersect. This analogue is correct by (a).


title: High-level moving excursions for spatiotemporal Gaussian random fields with long range dependence

abstract: This paper analyzes the limit distribution of spatiotemporal sojourn measures of Gaussian subordinated random fields. The family of Gaussian spatiotemporal random fields studied displays long--range dependence. The approach presented is based on Hermite expansion, and reduction theorems. Two new ingredients are incorporated to this analysis. Specifically, on the one hand, the limiting distribution is computed under increasing domain asymptotics in space and/or time, and, on the other hand, the involved non--linear transformation in the Gaussian subordination is time dependent. In particular, a central limit theorem is obtained for first Minkowski functional providing the spatiotemporal volume of excursion sets of spatiotemporal Gaussian random fields under moving levels. These results are also applied to the case where subordination to a spherical Gaussian random field, defined by restriction to the sphere, is performed.


title: Gradient Alignment with Prototype Feature for Fully Test-time Adaptation

abstract: In context of Test-time Adaptation(TTA), we propose a regularizer, dubbed Gradient Alignment with Prototype feature (GAP), which alleviates the inappropriate guidance from entropy minimization loss from misclassified pseudo label. We developed a gradient alignment loss to precisely manage the adaptation process, ensuring that changes made for some data don't negatively impact the model's performance on other data. We introduce a prototype feature of a class as a proxy measure of the negative impact. To make GAP regularizer feasible under the TTA constraints, where model can only access test data without labels, we tailored its formula in two ways: approximating prototype features with weight vectors of the classifier, calculating gradient without back-propagation. We demonstrate GAP significantly improves TTA methods across various datasets, which proves its versatility and effectiveness.


title: Excitation signatures of isochorically heated electrons in solids at finite wavenumber explored from first principles

abstract: Ultrafast heating of solids with modern X-ray free electron lasers (XFELs) leads to a unique set of conditions that is characterized by the simultaneous presence of heated electrons in a cold ionic lattice. In this work, we analyze the effect of electronic heating on the dynamic structure factor (DSF) in bulk Aluminium (Al) with a face-centered cubic lattice and in silicon (Si) with a crystal diamond structure using first-principles linear-response time-dependent density functional theory simulations. We find a thermally induced red shift of the collective plasmon excitation in both materials. In addition, we show that the heating of the electrons in Al can lead to the formation of a double-plasmon peak due to the extension of the Landau damping region to smaller wavenumbers. Finally, we demonstrate that thermal effects generate a measurable and distinct signature (peak-valley structure) in the DSF of Si at small frequencies. Our simulations indicate that there is a variety of new features in the spectrum of X-ray-driven solids, specifically at finite momentum transfer, which can probed in upcoming X-ray Thomson scattering (XRTS) experiments at various XFEL facilities.


title: DRL-Based Orchestration of Multi-User MISO Systems with Stacked Intelligent Metasurfaces

abstract: Stacked intelligent metasurfaces (SIM) represents an advanced signal processing paradigm that enables over-the-air processing of electromagnetic waves at the speed of light. Its multi-layer structure exhibits customizable increased computational capability compared to conventional single-layer reconfigurable intelligent surfaces and metasurface lenses. In this paper, we deploy SIM to improve the performance of multi-user multiple-input single-output (MISO) wireless systems with low complexity transmit radio frequency (RF) chains. In particular, an optimization formulation for the joint design of the SIM phase shifts and the transmit power allocation is presented, which is efficiently solved via a customized deep reinforcement learning (DRL) approach that continuously observes pre-designed states of the SIM-parametrized smart wireless environment. The presented performance evaluation results showcase the proposed method's capability to effectively learn from the wireless environment while outperforming conventional precoding schemes under low transmit power conditions. Finally, a whitening process is presented to further augment the robustness of the proposed scheme.


title: Enhancing Hemodynamic Parameter Estimations: Nonlinear Blood Behavior in 4D Flow MRI

abstract: Hemodynamic parameters have been estimated assuming a Newtonian constant viscosity, even when blood exhibits shear-thinning behavior. This article investigates the influence of blood rheology and hematocrit percentage on estimating Wall Shear Stress (WSS) and Energy Loss ($E_L$) at different time instants of the cardiac cycle, as well as the Oscillatory Shear Index (OSI). We specifically focus on a hematocrit-dependent power-law non-Newtonian model, considering a wide range of hematocrit values. The rheological parameters are obtained from experimentally fitted data reported previously. This study contributes to understanding the impact of blood rheology on hemodynamic parameter estimations using both in-silico and in-vivo aortic 4D Flow magnetic resonance images. Across all cases, we systematically compared WSS, $E_L$, and OSI parameters using Newtonian and power-law models, highlighting the crucial role of blood rheology in accurately assessing cardiovascular diseases.


title: Multi-Query Focused Disaster Summarization via Instruction-Based Prompting

abstract: Automatic summarization of mass-emergency events plays a critical role in disaster management. The second edition of CrisisFACTS aims to advance disaster summarization based on multi-stream fact-finding with a focus on web sources such as Twitter, Reddit, Facebook, and Webnews. Here, participants are asked to develop systems that can extract key facts from several disaster-related events, which ultimately serve as a summary. This paper describes our method to tackle this challenging task. We follow previous work and propose to use a combination of retrieval, reranking, and an embarrassingly simple instruction-following summarization. The two-stage retrieval pipeline relies on BM25 and MonoT5, while the summarizer module is based on the open-source Large Language Model (LLM) LLaMA-13b. For summarization, we explore a Question Answering (QA)-motivated prompting approach and find the evidence useful for extracting query-relevant facts. The automatic metrics and human evaluation show strong results but also highlight the gap between open-source and proprietary systems.


title: A Practical and Online Trajectory Planner for Autonomous Ships' Berthing, Incorporating Speed Control

abstract: Autonomous ships are essentially designed and equipped to perceive their internal and external environment and subsequently perform appropriate actions depending on the predetermined objective(s) without human intervention. Consequently, trajectory planning algorithms for autonomous berthing must consider factors such as system dynamics, ship actuators, environmental disturbances, and the safety of the ship, other ships, and port structures, among others. In this study, basing the ship dynamics on the low-speed MMG model, trajectory planning for an autonomous ship is modeled as an optimal control problem (OCP) that is transcribed into a nonlinear programming problem (NLP) using the direct multiple shooting technique. To enhance berthing safety, besides considering wind disturbances, speed control, actuators' limitations, and collision avoidance features are incorporated as constraints in the NLP, which is then solved using the Sequential Quadratic Programming (SQP) algorithm in MATLAB. Finally, the performance of the proposed planner is evaluated through (i) comparison with solutions obtained using CMA-ES for two different model ships, (ii) trajectory planning for different harbor entry and berth approach scenarios, and (iii) feasibility study using stochastically generated initial conditions and positions within the port boundaries. Simulation results indicate enhanced berthing safety as well as practical and computational feasibility making the planner suitable for real-time applications.


title: The invisible black widow PSR J1720-0534: implications for the electron density towards the North Polar Spur

abstract: Radio emission from pulsars can be used to map out their distances through dispersion measure (DM), which quantifies the amount of radio pulse dispersion. However, this method relies on accurately modelling the free electron density in the line of sight. Here, we present a detailed study of the multiwavelength emission from PSR J1720$-$0534, a black widow compact binary millisecond pulsar discovered in 2021, which the latest electron density model of the Galaxy (Yao et al. 2017) places at only 191 pc. We obtained and analysed deep multiwavelength observations in the $\gamma$-ray (Fermi-Large Area Telescope, 2008-2022), optical (Las Cumbres Observatory, 2.7 h), near-infrared (Nordic Optical Telescope, 3.5 h), and X-ray (Swift-X-Ray Telescope, 10 ks) bands. We found no significant detection of $\gamma$-ray, optical, near-infrared, or X-ray counterparts around the radio-timing position of PSR J1720$-$0534, which we thus nickname 'the invisible black widow'. Employing the most constraining near-infrared limit ($J>23.4$ mag), we established a lower limit on the source distance, $d>1.1$ kpc, assuming conservative properties for the black widow companion star. This distance lower limit differs drastically (by a factor of more than 5) from the Yao et al. DM distance estimate. We attribute this difference to the inclusion in the Yao et al. model of a large and dense component towards the North Polar Spur. Considering our results and recent parallax distances to other pulsars in this direction, we argue that such a local and large component in the electron density model of the Galaxy is unnecessary.


title: Improved Deterministic Distributed Maximum Weight Independent Set Approximation in Sparse Graphs

abstract: We design new deterministic CONGEST approximation algorithms for \emph{maximum weight independent set (MWIS)} in \emph{sparse graphs}. As our main results, we obtain new $\Delta(1+\epsilon)$-approximation algorithms as well as algorithms whose approximation ratio depend strictly on $\alpha$, in graphs with maximum degree $\Delta$ and arboricity $\alpha$. For (deterministic) $\Delta(1+\epsilon)$-approximation, the current state-of-the-art is due to a recent breakthrough by Faour et al.\ [SODA 2023] that showed an $O(\log^{2} (\Delta W)\cdot \log (1/\epsilon)+\log ^{*}n)$-round algorithm, where $W$ is the largest node-weight (this bound translates to $O(\log^{2} n\cdot\log (1/\epsilon))$ under the common assumption that $W=\text{poly}(n)$). As for $\alpha$-dependent approximations, a deterministic CONGEST $(8(1+\epsilon)\cdot\alpha)$-approximation algorithm with runtime $O(\log^{3} n\cdot\log (1/\epsilon))$ can be derived by combining the aforementioned algorithm of Faour et al.\ with a method presented by Kawarabayashi et al.\ [DISC 2020].


title: Holomorphic geometric structures on Oeljeklaus-Toma manifolds

abstract: We prove that any holomorphic geometric structure of algebraic type on an Oeljeklaus- Toma manifold is locally homogeneous. For locally conformal K\"ahler Oeljeklaus-Toma manifolds we prove that all holomorphic geometric structures, and also all holomorphic Cartan geometries, on them are locally homogeneous.


title: Asgard/NOTT: L-band nulling interferometry at the VLTI. II. Warm optical design and injection system

abstract: Asgard/NOTT (previously Hi-5) is a European Research Council (ERC)-funded project hosted at KU Leuven and a new visitor instrument for the Very Large Telescope Interferometer (VLTI). Its primary goal is to image the snow line region around young stars using nulling interferometry in the L-band (3.5 to 4.0)$\mu$m, where the contrast between exoplanets and their host stars is advantageous. The breakthrough is the use of a photonic beam combiner, which only recently allowed the required theoretical raw contrast of $10^{-3}$ in this spectral range. Nulling interferometry observations of exoplanets also require a high degree of balancing between the four pupils of the VLTI in terms of intensity, phase, and polarization. The injection into the beam combiner and the requirements of nulling interferometry are driving the design of the warm optics and the injection system. The optical design up to the beam combiner is presented. It offers a technical solution to efficiently couple the light from the VLTI into the beam combiner. During the coupling, the objective is to limit throughput losses to 5% of the best expected efficiency for the injection. To achieve this, a list of different loss sources is considered with their respective impact on the injection efficiency. Solutions are also proposed to meet the requirements on beam balancing for intensity, phase, and polarization. The different properties of the design are listed, including the optics used, their alignment and tolerances, and their impact on the instrumental performances in terms of throughput and null depth. The performance evaluation gives an expected throughput loss of less than <6.4% of the best efficiency for the injection and a null depth of $\sim2.10^{-3}$, mainly from optical path delay errors outside the scope of this work.


title: Acceleration Exists! Optimization Problems When Oracle Can Only Compare Objective Function Values

abstract: Frequently, the burgeoning field of black-box optimization encounters challenges due to a limited understanding of the mechanisms of the objective function. To address such problems, in this work we focus on the deterministic concept of Order Oracle, which only utilizes order access between function values (possibly with some bounded noise), but without assuming access to their values. As theoretical results, we propose a new approach to create non-accelerated optimization algorithms (obtained by integrating Order Oracle into existing optimization "tools") in non-convex, convex, and strongly convex settings that are as good as both SOTA coordinate algorithms with first-order oracle and SOTA algorithms with Order Oracle up to logarithm factor. Moreover, using the proposed approach, we provide the first accelerated optimization algorithm using the Order Oracle. And also, using an already different approach we provide the asymptotic convergence of the first algorithm with the stochastic Order Oracle concept. Finally, our theoretical results demonstrate effectiveness of proposed algorithms through numerical experiments.


title: Towards better Human-Agent Alignment: Assessing Task Utility in LLM-Powered Applications

abstract: The rapid development in the field of Large Language Models (LLMs) has led to a surge in applications that facilitate collaboration among multiple agents to assist humans in their daily tasks. However, a significant gap remains in assessing whether LLM-powered applications genuinely enhance user experience and task execution efficiency. This highlights the pressing need for methods to verify utility of LLM-powered applications, particularly by ensuring alignment between the application's functionality and end-user needs. We introduce AgentEval provides an implementation for the math problems, a novel framework designed to simplify the utility verification process by automatically proposing a set of criteria tailored to the unique purpose of any given application. This allows for a comprehensive assessment, quantifying the utility of an application against the suggested criteria. We present a comprehensive analysis of the robustness of quantifier's work.


title: Pyramid Attention Network for Medical Image Registration

abstract: The advent of deep-learning-based registration networks has addressed the time-consuming challenge in traditional iterative methods.However, the potential of current registration networks for comprehensively capturing spatial relationships has not been fully explored, leading to inadequate performance in large-deformation image registration.The pure convolutional neural networks (CNNs) neglect feature enhancement, while current Transformer-based networks are susceptible to information redundancy.To alleviate these issues, we propose a pyramid attention network (PAN) for deformable medical image registration.Specifically, the proposed PAN incorporates a dual-stream pyramid encoder with channel-wise attention to boost the feature representation.Moreover, a multi-head local attention Transformer is introduced as decoder to analyze motion patterns and generate deformation fields.Extensive experiments on two public brain magnetic resonance imaging (MRI) datasets and one abdominal MRI dataset demonstrate that our method achieves favorable registration performance, while outperforming several CNN-based and Transformer-based registration networks.Our code is publicly available at https://github.com/JuliusWang-7/PAN.


title: The cohomology of $p$-adic Deligne-Luszitg schemes of Coxeter type

abstract: We determine the cohomology of the closed Drinfeld stratum of $p$-Deligne--Lusztig schemes of Coxeter type attached to arbitrary inner forms of unramified groups over a local non-archimedean field. We prove that the corresponding torus weight spaces are supported in exactly one cohomological degree, and are pairwisely non-isomorphic irreducible representations of the pro-unipotent radical of the corresponding parahoric subgroup. We also prove that all Moy--Prasad quotients of this stratum are maximal varieties, and we investigate the relation between the resulting representations and Kirillov's orbit method.


title: Neural Operators Meet Energy-based Theory: Operator Learning for Hamiltonian and Dissipative PDEs

abstract: The operator learning has received significant attention in recent years, with the aim of learning a mapping between function spaces. Prior works have proposed deep neural networks (DNNs) for learning such a mapping, enabling the learning of solution operators of partial differential equations (PDEs). However, these works still struggle to learn dynamics that obeys the laws of physics. This paper proposes Energy-consistent Neural Operators (ENOs), a general framework for learning solution operators of PDEs that follows the energy conservation or dissipation law from observed solution trajectories. We introduce a novel penalty function inspired by the energy-based theory of physics for training, in which the energy functional is modeled by another DNN, allowing one to bias the outputs of the DNN-based solution operators to ensure energetic consistency without explicit PDEs. Experiments on multiple physical systems show that ENO outperforms existing DNN models in predicting solutions from data, especially in super-resolution settings.


title: NMR contributions to the study of water transfer in proton exchange membranes for fuel cells

abstract: As programs to support efficient and sustainable energy sources are expanding, research into the potential applications of the hydrogen vector is accelerating. Proton exchange membrane fuel cells are electrochemical converters that transform the chemical energy of hydrogen into electrical energy. These devices are used today for low- and medium-power stationary applications and for mobility, in trains, cars, bicycles, etc. Proton exchange membrane fuel cells use a polymer membrane as the electrolyte. The role of the membrane is multiple: it must separate gases, be an electronic insulator and a very good ionic conductor. In addition, it must resist free-radical chemical attack and have good mechanical strength. Nafion-type perfluorinated membranes have all these properties: the fluorinated backbone is naturally hydrophobic, but the hydrophilic ionic groups give the material excellent water sorption properties. The water adsorbed in the structure is extremely mobile, acting as a transport medium for the protons generated at the anode. Although it has been studied for a long time and has been the subject of a large number of papers perfluorinated membranes are still the reference membranes today. This article reviews some contributions of Nuclear Magnetic Resonance methods in liquid state to the study of water properties in the structure of Nafion-type perfluorinated membranes.


title: Bayesian reliability acceptance sampling plan with optional warranty under hybrid censoring

abstract: This work considers design of Bayesian reliability acceptance sampling plan (RASP) under hybrid censored life test for the products sold under optional warranty. The consumer and manufacturer agree on a common lifetime distribution of the product. However, they differ in the assessment of the prior distributions because of the adversarial nature of the consumer and manufacturer. The consumer takes decision based on his/her utility and prior belief without warranty offer by the manufacturer. If the decision is rejection, manufacturer provides warranty offer to the consumer. If the consumer rejects the lot with a warranty, the manufacturer conducts life test under hybrid censoring scheme (HCS) and provide lifetime information to the consumer. The consumer updates his/her belief based on lifetime information provided by the manufacturer. The consumer then takes decision of acceptance or rejection of lot based on updated belief. Task of the manufacturer is to determine the optimal life testing plan.


title: Unified Opinion Dynamic Modeling as Concurrent Set Relations in Rewriting Logic

abstract: Social media platforms have played a key role in weaponizing the polarization of social, political, and democratic processes. This is, mainly, because they are a medium for opinion formation. Opinion dynamic models are a tool for understanding the role of specific social factors on the acceptance/rejection of opinions because they can be used to analyze certain assumptions on human behaviors. This work presents a framework that uses concurrent set relations as the formal basis to specify, simulate, and analyze social interaction systems with dynamic opinion models. Standard models for social learning are obtained as particular instances of the proposed framework. It has been implemented in the Maude system as a fully executable rewrite theory that can be used to better understand how opinions of a system of agents can be shaped. This paper also reports an initial exploration in Maude on the use of reachability analysis, probabilistic simulation, and statistical model checking of important properties related to opinion dynamic models.


title: Assessing AI-Based Code Assistants in Method Generation Tasks

abstract: AI-based code assistants are increasingly popular as a means to enhance productivity and improve code quality. This study compares four AI-based code assistants, GitHub Copilot, Tabnine, ChatGPT, and Google Bard, in method generation tasks, assessing their ability to produce accurate, correct, and efficient code. Results show that code assistants are useful, with complementary capabilities, although they rarely generate ready-to-use correct code.


title: Review-Incorporated Model-Agnostic Profile Injection Attacks on Recommender Systems

abstract: Recent studies have shown that recommender systems (RSs) are highly vulnerable to data poisoning attacks. Understanding attack tactics helps improve the robustness of RSs. We intend to develop efficient attack methods that use limited resources to generate high-quality fake user profiles to achieve 1) transferability among black-box RSs 2) and imperceptibility among detectors. In order to achieve these goals, we introduce textual reviews of products to enhance the generation quality of the profiles. Specifically, we propose a novel attack framework named R-Trojan, which formulates the attack objectives as an optimization problem and adopts a tailored transformer-based generative adversarial network (GAN) to solve it so that high-quality attack profiles can be produced. Comprehensive experiments on real-world datasets demonstrate that R-Trojan greatly outperforms state-of-the-art attack methods on various victim RSs under black-box settings and show its good imperceptibility.


title: From Rewrite Rules to Axioms in the $\lambda$$\Pi$-Calculus Modulo Theory

abstract: The $\lambda$$\Pi$-calculus modulo theory is an extension of simply typed $\lambda$-calculus with dependent types and user-defined rewrite rules. We show that it is possible to replace the rewrite rules of a theory of the $\lambda$$\Pi$-calculus modulo theory by equational axioms, when this theory features the notions of proposition and proof, while maintaining the same expressiveness. To do so, we introduce in the target theory a heterogeneous equality, and we build a translation that replaces each use of the conversion rule by the insertion of a transport. At the end, the theory with rewrite rules is a conservative extension of the theory with axioms.


title: SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks

abstract: Large language models (LLMs) have proven to be highly effective across various natural language processing tasks. However, their large number of parameters poses significant challenges for practical deployment. Pruning, a technique aimed at reducing the size and complexity of LLMs, offers a potential solution by removing redundant components from the network. Despite the promise of pruning, existing methods often struggle to achieve substantial end-to-end LLM inference speedup. In this paper, we introduce SLEB, a novel approach designed to streamline LLMs by eliminating redundant transformer blocks. We choose the transformer block as the fundamental unit for pruning, because LLMs exhibit block-level redundancy with high similarity between the outputs of neighboring blocks. This choice allows us to effectively enhance the processing speed of LLMs. Our experimental results demonstrate that SLEB outperforms previous LLM pruning methods in accelerating LLM inference while also maintaining superior perplexity and accuracy, making SLEB as a promising technique for enhancing the efficiency of LLMs. The code is available at: https://github.com/jiwonsong-dev/SLEB.


title: Doubly heavy dibaryons as seen by string theory

abstract: We propose the stringy description of the system consisting of two heavy and four light quarks in the case of two light flavors of equal mass. As an application, we consider the three low-lying Born-Oppenheimer potentials as a function of the heavy quark separation. Our analysis shows that the ground state potential is described in terms of both hadro-quarkonia and hadronic molecules. A connected string configuration makes the dominant contribution to the potential of an excited state at small separations, and for separations larger than $0.1\,\text{fm}$, it exhibits the diquark-diquark-diquark structure $[Qq][Qq][qq]$. For better understanding the quark organization inside the system, we introduce several critical separations related to the processes of string reconnection, breaking and junction annihilation. We also discuss the simplest string configurations including the five-string junctions and their implications for the system, in particular the emergence of composite quark objects different from diquarks and the process of junction fusion.


title: Using Fricke modular polynomials to compute isogenies

abstract: Let $\mathcal{E}$ be an elliptic curve over a field $\mathbf{K}$ and $\ell$ a prime. There exists an elliptic curve $\mathcal{E}^*$ related to $\mathcal{E}$ by an isogeny of degree $\ell$ only if $\Phi_\ell^t(X, j(\mathcal{E})) = 0$, where $\Phi_\ell^t(X, Y)$ is the traditional modular polynomial. Moreover, $\Phi_\ell^t$ gives the coefficients of $\mathcal{E}^*$, together with parameters needed to build the isogeny explicitly. Since $\Phi_\ell^t$ has very large coefficients, many families with smaller coefficients can be used instead, as described by Elkies, Atkin and others. In this work, we concentrate on the computation of the family of modular polynomials introduced by Fricke and more recently used by Charlap, Coley and Robbins. In some cases, the resulting polynomials are small, which justifies the interest of this study. We review and adapt the known algorithms to perform the computations of these polynomials. After describing the use of series computations, we investigate fast algorithms using floating point numbers based on fast numerical evaluation of Eisenstein series. We also explain how to use isogeny volcanoes as an alternative. The last part is concerned with finding explicit formulas for computing the coefficients of $\mathcal{E}^*$. To this we add tables of numerical examples.


title: Understanding Stress, Burnout, and Behavioral Patterns in Medical Residents Using Large-scale Longitudinal Wearable Recordings

abstract: Medical residency training is often associated with physically intense and emotionally demanding tasks, requiring them to engage in extended working hours providing complex clinical care. Residents are hence susceptible to negative psychological effects, including stress and anxiety, that can lead to decreased well-being, affecting them achieving desired training outcomes. Understanding the daily behavioral patterns of residents can guide the researchers to identify the source of stress in residency training, offering unique opportunities to improve residency programs. In this study, we investigate the workplace behavioral patterns of 43 medical residents across different stages of their training, using longitudinal wearable recordings collected over a 3-week rotation. Specifically, we explore their ambulatory patterns, the computer access, and the interactions with mentors of residents. Our analysis reveals that residents showed distinct working behaviors in walking movement patterns and computer usage compared to different years in the program. Moreover, we identify that interaction patterns with mentoring doctors indicate stress, burnout, and job satisfaction.


title: Random Matrix Theory Approach to Quantum Fisher Information in Quantum Many-Body Systems

abstract: We theoretically investigate parameter quantum estimation in quantum chaotic systems. Our analysis is based on an effective description of non-integrable quantum systems in terms of a random matrix Hamiltonian. Based on this approach we derive an analytical expression for the time evolution of the quantum Fisher information. We test our random matrix theory prediction with the exact diagonalization of a non-integrable spin system, focusing on the estimation of a local magnetic field by measurements of the many-body state. Our numerical calculations agree with the effective random matrix theory approach and show that the information on the local Hamiltonian parameter is distributed throughout the quantum system during the quantum thermalization process. Our analysis shows a first stage in which the initial information spread is quadratic in time which quickly passes into linear increase with slope determine by the decay rate of the measured spin observable. When the information is fully spread among all degrees of freedom a second quadratic time scale determines the long time behaviour of the quantum Fisher information.


title: Awareness in robotics: An early perspective from the viewpoint of the EIC Pathfinder Challenge "Awareness Inside''

abstract: Consciousness has been historically a heavily debated topic in engineering, science, and philosophy. On the contrary, awareness had less success in raising the interest of scholars in the past. However, things are changing as more and more researchers are getting interested in answering questions concerning what awareness is and how it can be artificially generated. The landscape is rapidly evolving, with multiple voices and interpretations of the concept being conceived and techniques being developed. The goal of this paper is to summarize and discuss the ones among these voices connected with projects funded by the EIC Pathfinder Challenge called ``Awareness Inside'', a nonrecurring call for proposals within Horizon Europe designed specifically for fostering research on natural and synthetic awareness. In this perspective, we dedicate special attention to challenges and promises of applying synthetic awareness in robotics, as the development of mature techniques in this new field is expected to have a special impact on generating more capable and trustworthy embodied systems.


title: Inverse design for Casimir-Lifshitz force near heterogeneous gapped metal surface

abstract: The Casimir-Lifshitz force is calculated between a heterogeneous gapped metal surface and a silica sphere attached to an AFM cantilever tip. We demonstrate that heterogeneous surface patches with different off-stoichiometry surface properties lead to changes in the predicted distances for a specific force. This can incorrectly be interpreted as occurrences of surface roughness.


title: Ecient spatial designs for targeted regions or level set detection

abstract: Acquiring information on spatial phenomena can be costly and time-consuming. In this context, to obtain reliable global knowledge, the choice of measurement location is a crucial issue. Space-lling designs are often used to control variability uniformly across the whole space. However, in a monitoring context, it is more relevant to focus on crucial regions, especially when dealing with sensitive areas such as the environment, climate or public health. It is therefore important to choose a relevant optimality criterion to build models adapted to the purpose of the experiment. In this article, we propose two new optimality criteria: the rst aims to focus on areas where the response exceeds a given threshold, while the second is suitable for estimating sets of levels. We introduce several algorithms for constructing optimal designs. We also focus on cost-eective algorithms that produce non-optimal but ecient designs. For both sequential and non-sequential contexts, we compare our designs with existing ones through extensive simulation studies.


title: Cross-Temporal Forecast Reconciliation at Digital Platforms with Machine Learning

abstract: Platform businesses operate on a digital core and their decision making requires high-dimensional accurate forecast streams at different levels of cross-sectional (e.g., geographical regions) and temporal aggregation (e.g., minutes to days). It also necessitates coherent forecasts across all levels of the hierarchy to ensure aligned decision making across different planning units such as pricing, product, controlling and strategy. Given that platform data streams feature complex characteristics and interdependencies, we introduce a non-linear hierarchical forecast reconciliation method that produces cross-temporal reconciled forecasts in a direct and automated way through the use of popular machine learning methods. The method is sufficiently fast to allow forecast-based high-frequency decision making that platforms require. We empirically test our framework on unique, large-scale streaming datasets from a leading on-demand delivery platform in Europe and a bicycle sharing system in New York City.


title: Enhancing Sequential Model Performance with Squared Sigmoid TanH (SST) Activation Under Data Constraints

abstract: Activation functions enable neural networks to learn complex representations by introducing non-linearities. While feedforward models commonly use rectified linear units, sequential models like recurrent neural networks, long short-term memory (LSTMs) and gated recurrent units (GRUs) still rely on Sigmoid and TanH activation functions. However, these classical activation functions often struggle to model sparse patterns when trained on small sequential datasets to effectively capture temporal dependencies. To address this limitation, we propose squared Sigmoid TanH (SST) activation specifically tailored to enhance the learning capability of sequential models under data constraints. SST applies mathematical squaring to amplify differences between strong and weak activations as signals propagate over time, facilitating improved gradient flow and information filtering. We evaluate SST-powered LSTMs and GRUs for diverse applications, such as sign language recognition, regression, and time-series classification tasks, where the dataset is limited. Our experiments demonstrate that SST models consistently outperform RNN-based models with baseline activations, exhibiting improved test accuracy.


title: Using storytelling to foster the teaching and learning of gravitational waves physics at high-school

abstract: Studies in Physics Education Research show that interdisciplinary approaches in education foster students' motivation, creativity, curiosity, and interest in physics. We discuss their features and potential role in bringing contemporary physics topics to high school, and how to use them to integrate formal educational programs. We make an explicit example of the use of storytelling and theatrical techniques to introduce secondary school students to black holes and gravitational waves topics. The activity has been designed by the Educational Division of the Physics Department at the University of Cagliari. Participants were 200 high-school students (17 to 19 years old) from five schools (scientific, humanities) in Sardinia. A measure of the efficacy in the use of artistic tools to communicate and teach the proposed subjects has been done utilizing a research questionnaire. We collected 76 answers. Results show that our methodology is useful to introduce students to contemporary physics themes, fostering their interest and learning of such contents. Students from humanities significantly appreciated more the use of poetry and artistic tools than their scientific peers. Finally, we discuss the potentiality of our approach in orientating students towards a STEAM (STEM and Arts) career.

categories: physics.ed-ph astro-ph.CO gr-qc physics.soc-ph


title: Can Text-to-image Model Assist Multi-modal Learning for Visual Recognition with Visual Modality Missing?

abstract: Multi-modal learning has emerged as an increasingly promising avenue in vision recognition, driving innovations across diverse domains ranging from media and education to healthcare and transportation. Despite its success, the robustness of multi-modal learning for visual recognition is often challenged by the unavailability of a subset of modalities, especially the visual modality. Conventional approaches to mitigate missing modalities in multi-modal learning rely heavily on algorithms and modality fusion schemes. In contrast, this paper explores the use of text-to-image models to assist multi-modal learning. Specifically, we propose a simple but effective multi-modal learning framework GTI-MM to enhance the data efficiency and model robustness against missing visual modality by imputing the missing data with generative transformers. Using multiple multi-modal datasets with visual recognition tasks, we present a comprehensive analysis of diverse conditions involving missing visual modality in data, including model training. Our findings reveal that synthetic images benefit training data efficiency with visual data missing in training and improve model robustness with visual data missing involving training and testing. Moreover, we demonstrate GTI-MM is effective with lower generation quantity and simple prompt techniques.


title: Metasurface of strongly coupled excitons and nanoplasmonic arrays

abstract: Metasurfaces allow to manipulate light at the nanoscale. Integrating metasurfaces with transition metal dichalcogenide monolayers provides additional functionality to ultrathin optics, including tunable optical properties with enhanced light-matter interactions. In this work, we demonstrate the realization of a polaritonic metasurface utilizing the sizable light-matter coupling of excitons in monolayer WSe2 and the collective lattice resonances of nanoplasmonic gold arrays. To this end, we developed a novel fabrication method to integrate gold nanodisk arrays in hexagonal boron nitride and thus simultaneously ensure spectrally narrow exciton transitions and their immediate proximity to the near-field of array surface lattice resonances. In the regime of strong light-matter coupling, the resulting van der Waals metasurface exhibits all key characteristics of lattice polaritons, with a directional and linearly-polarized far-field emission profile dictated by the underlying nanoplasmonic lattice. Our work can be straightforwardly adapted to other lattice geometries, establishing structured van der Waals metasurfaces as means to engineer polaritonic lattices.


title: Tunneling of quantum geometries in spinfoams

abstract: Quantum gravitational tunneling effects are expected to give rise to a number of interesting observable phenomena, including, in particular, the evolution of black holes at the end of their existence or the emergence of the early universe from a quantum phase. Covariant Loop Quantum Gravity provides a framework to study these phenomena, yet a precise identification of tunneling processes is still not known. Motivated by this question, we consider a related, simpler case, that of Ponzano-Regge amplitudes: we find a surprising and detailed analogy of a class of simple transition amplitudes with tunneling processes in non-relativistic quantum mechanics.


title: Morse index stability for Yang-Mills connections

abstract: We prove stability results of the Morse index plus nullity of Yang-Mills connections in dimension 4 under weak convergence. Precisely we establish that the sum of the Morse indices and the nullity of a bounded sequence of Yang-Mills connections is asymptotically bounded above by the sum of the Morse index and the nullity of the weak limit and the bubbles while the Morse indices are asymptotically bounded below by the sum of the Morse index of the weak limit and the bubbles.


title: A new approach in two-dimensional heavy-tailed distributions

abstract: We consider a new approach in the definition of two-dimensional heavy-tailed distributions. Namely, we introduce the classes of two-dimensional long-tailed, of twodimensional dominatedly varying and of two-dimensional consistently varying distributions. Next, we define the closure property with respect to two-dimensional convolution and to joint max-sum equivalence in order to study if they are satisfied by these classes. Further we examine the joint behavior of two random sums, under generalized tail asymptotic independence. Afterward we study the closure property under scalar product and two dimensional product convolution and by these results we extended our main result in the case of jointly randomly weighted sums. Our results contained some applications where we establish the asymptotic expression of the ruin probability in a two-dimensional discrete-time risk model.


title: Closure properties and heavy tails: random vectors in the presence of dependence

abstract: This paper is organized in three parts closely related to closure properties of heavy-tailed distributions and heavy-tailed random vectors. In the first part we consider two random variables X and Y with distributions F and G respectively. We assume that these random variables satisfy one type of a weak dependence structure. Under some mild conditions, we examine whether their product convolution distribution H belongs in the same distribution class of the distribution F. Namely we establish the closure property with respect to the product convolution, under this specific weak dependence structure, in the classes ERV, C, D, M, OS, OL, PD and K. Further in the second part we introduce a new distribution class, which satisfies some closure properties such as convolution, product convolution and mixture. Although the multivariate regular variation is well-established distribution, it does not happen in other heavy tailed random vectors. Therefore in the third part we introduced the class of dominatedly varying vectors and positively decreasing random vectors and we study the closure property of the scalar product under independent and dependent cases. Furthermore we study the closure property of the first class under convolution and mixture, and we study the distribution of stopped sums where the summands are random vectors which belongs to this class. Some of these results holds and for positively decreasing random vectors.


title: Joint Application Admission Control and Network Slicing in Virtual Sensor Networks

abstract: We focus on the problem of managing a shared physical wireless sensor network where a single network infrastructure provider leases the physical resources of the networks to application providers to run/deploy specific applications/services. In this scenario, we solve jointly the problems of Application Admission Control (AAC), that is, whether to admit the application/service to the physical network, and wireless Sensor Network Slicing (SNS), that is, to allocate the required physical resources to the admitted applications in a transparent and effective way. We propose a mathematical programming framework to model the joint AAC-SNS problem which is then leveraged to design effective solution algorithms. The proposed framework is thoroughly evaluated on realistic wireless sensor networks infrastructures.


title: Under manipulations, are some AI models harder to audit?

abstract: Auditors need robust methods to assess the compliance of web platforms with the law. However, since they hardly ever have access to the algorithm, implementation, or training data used by a platform, the problem is harder than a simple metric estimation. Within the recent framework of manipulation-proof auditing, we study in this paper the feasibility of robust audits in realistic settings, in which models exhibit large capacities. We first prove a constraining result: if a web platform uses models that may fit any data, no audit strategy -- whether active or not -- can outperform random sampling when estimating properties such as demographic parity. To better understand the conditions under which state-of-the-art auditing techniques may remain competitive, we then relate the manipulability of audits to the capacity of the targeted models, using the Rademacher complexity. We empirically validate these results on popular models of increasing capacities, thus confirming experimentally that large-capacity models, which are commonly used in practice, are particularly hard to audit robustly. These results refine the limits of the auditing problem, and open up enticing questions on the connection between model capacity and the ability of platforms to manipulate audit attempts.


title: Non-existence of short hairs for static black holes

abstract: The black hole no-short hair theorem establishes a universal lower bound on the extension of hairs outside any 4-dimensional spherically symmetric black hole solutions. We generalise this theorem beyond spherical symmetry, specifically for static, axisymmetric hairy black hole solutions and prove that the ``hairosphere'' must extend beyond the radial extent of the innermost light ring.


title: Giant asymmetric proximity-induced spin-orbit coupling in twisted graphene/SnTe heterostructure

abstract: We analyze the spin-orbit coupling effects in a three-degree twisted bilayer heterostructure made of graphene and an in-plane ferroelectric SnTe, with the goal of transferring the spin-orbit coupling from SnTe to graphene, via the proximity effect. Our results indicate that the point-symmetry breaking due to the incompatible mutual symmetry of the twisted monolayers and a strong hybridization has a massive impact on the spin splitting in graphene close to the Dirac point, with the spin splitting values greater than 20 meV. The band structure and spin expectation values of graphene close to the Dirac point can be described using a symmetry-free model, triggering different types of interaction with respect to the threefold symmetric graphene/transition-metal dichalcogenide heterostructure. We show that the strong hybridization of the Dirac cone's right movers with the SnTe band gives rise to a large asymmetric spin splitting in the momentum space. Furthermore, we discover that the ferroelectricity-induced Rashba spin-orbit coupling in graphene is the dominant contribution to the overall Rashba field, with the effective in-plane electric field that is almost aligned with the (in-plane) ferroelectricity direction of the SnTe monolayer. We also predict an anisotropy of the in-plane spin relaxation rates. Our results demonstrate that the group-IV monochalcogenides MX (M=Sn, Ge; X=S, Se, Te) are a viable alternative to transition-metal dichalcogenides for inducing strong spin-orbit coupling in graphene.


title: Inference of Abstraction for a Unified Account of Reasoning and Learning

abstract: Inspired by Bayesian approaches to brain function in neuroscience, we give a simple theory of probabilistic inference for a unified account of reasoning and learning. We simply model how data cause symbolic knowledge in terms of its satisfiability in formal logic. The underlying idea is that reasoning is a process of deriving symbolic knowledge from data via abstraction, i.e., selective ignorance. The logical consequence relation is discussed for its proof-based theoretical correctness. The MNIST dataset is discussed for its experiment-based empirical correctness.


title: FGeo-TP: A Language Model-Enhanced Solver for Geometry Problems

abstract: The application of contemporary artificial intelligence techniques to address geometric problems and automated deductive proof has always been a grand challenge to the interdiscipline field of mathematics and artificial Intelligence. This is the fourth article in a series of our works, in our previous work, we established of a geometric formalized system known as FormalGeo. Moreover we annotated approximately 7000 geometric problems, forming the FormalGeo7k dataset. Despite the FGPS (Formal Geometry Problem Solver) can achieve interpretable algebraic equation solving and human-like deductive reasoning, it often experiences timeouts due to the complexity of the search strategy. In this paper, we introduced FGeo-TP (Theorem Predictor), which utilizes the language model to predict theorem sequences for solving geometry problems. We compared the effectiveness of various Transformer architectures, such as BART or T5, in theorem prediction, implementing pruning in the search process of FGPS, thereby improving its performance in solving geometry problems. Our results demonstrate a significant increase in the problem-solving rate of the language model-enhanced FGeo-TP on the FormalGeo7k dataset, rising from 39.7% to 80.86%. Furthermore, FGeo-TP exhibits notable reductions in solving time and search steps across problems of varying difficulty levels.


title: Sensing in Bi-Static ISAC Systems with Clock Asynchronism: A Signal Processing Perspective

abstract: Integrated Sensing and Communication (ISAC) has been identified as a pillar usage scenario for the impending 6G era. Bi-static sensing, a major type of sensing in ISAC, is promising to expedite ISAC in the near future, as it requires minimal changes to the existing network infrastructure. However, a critical challenge for bi-static sensing is clock asynchronism due to the use of different clocks at far-separated transmitters and receivers. This causes the received signal to be affected by time-varying random phase offsets, severely degrading, or even failing, direct sensing. Hence, to effectively enable ISAC, considerable research has been directed toward addressing the clock asynchronism issue in bi-static sensing. This paper provides an overview of the issue and existing techniques developed in an ISAC background. Based on the review and comparison, we also draw insights into the future research directions and open problems, aiming to nurture the maturation of bi-static sensing in ISAC.


title: Quantum Theory of Phonon Induced Anomalous Hall Effect in 2D Massive Dirac metals

abstract: The phonon induced anomalous Hall or thermal Hall effects have been observed in various systems in recent experiments. However, the theoretical studies on this subject are very scarce and incomplete. In this work, we present a systematic quantum field theory study on the phonon induced anomalous Hall effect, including both the side jump and skew scattering contributions, in a 2D massive Dirac metal, which is considered as the minimum anomalous Hall system. We reveal significant difference from the anomalous Hall effect induced by the widely studied Gaussian disorder which is known to be insensitive to temperature. While the anomalous Hall effect induced by phonon approaches that by Gaussian disorder at high temperature, it behaves very differently at low temperature. Our work provides a microscopic and quantitative description of the crossover from the low to high temperature regime of the phonon induced anomalous Hall conductivity, which may be observed in 2D Dirac metals with breaking time reversal symmetry.


title: End-to-End Training Induces Information Bottleneck through Layer-Role Differentiation: A Comparative Analysis with Layer-wise Training

abstract: End-to-end (E2E) training, optimizing the entire model through error backpropagation, fundamentally supports the advancements of deep learning. Despite its high performance, E2E training faces the problems of memory consumption, parallel computing, and discrepancy with the functionalities of the actual brain. Various alternative methods have been proposed to overcome these difficulties; however, no one can yet match the performance of E2E training, thereby falling short in practicality. Furthermore, there is no deep understanding regarding differences in the trained model properties beyond the performance gap. In this paper, we reconsider why E2E training demonstrates a superior performance through a comparison with layer-wise training, a non-E2E method that locally sets errors. On the basis of the observation that E2E training has an advantage in propagating input information, we analyze the information plane dynamics of intermediate representations based on the Hilbert-Schmidt independence criterion (HSIC). The results of our normalized HSIC value analysis reveal the E2E training ability to exhibit different information dynamics across layers, in addition to efficient information propagation. Furthermore, we show that this layer-role differentiation leads to the final representation following the information bottleneck principle. It suggests the need to consider the cooperative interactions between layers, not just the final layer when analyzing the information bottleneck of deep learning.


title: FGeo-DRL: Deductive Reasoning for Geometric Problems through Deep Reinforcement Learning

abstract: The human-like automatic deductive reasoning has always been one of the most challenging open problems in the interdiscipline of mathematics and artificial intelligence. This paper is the third in a series of our works. We built a neural-symbolic system, called FGeoDRL, to automatically perform human-like geometric deductive reasoning. The neural part is an AI agent based on reinforcement learning, capable of autonomously learning problem-solving methods from the feedback of a formalized environment, without the need for human supervision. It leverages a pre-trained natural language model to establish a policy network for theorem selection and employ Monte Carlo Tree Search for heuristic exploration. The symbolic part is a reinforcement learning environment based on geometry formalization theory and FormalGeo, which models GPS as a Markov Decision Process. In this formal symbolic system, the known conditions and objectives of the problem form the state space, while the set of theorems forms the action space. Leveraging FGeoDRL, we have achieved readable and verifiable automated solutions to geometric problems. Experiments conducted on the formalgeo7k dataset have achieved a problem-solving success rate of 86.40%. The project is available at https://github.com/PersonNoName/FGeoDRL.


title: L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objects

abstract: Diffusion-based image generation models such as DALL-E 3 and Stable Diffusion-XL demonstrate remarkable capabilities in generating images with realistic and unique compositions. Yet, these models are not robust in precisely reasoning about physical and spatial configurations of objects, especially when instructed with unconventional, thereby out-of-distribution descriptions, such as "a chair with five legs". In this paper, we propose a language agent with chain-of-3D-thoughts (L3GO), an inference-time approach that can reason about part-based 3D mesh generation of unconventional objects that current data-driven diffusion models struggle with. More concretely, we use large language models as agents to compose a desired object via trial-and-error within the 3D simulation environment. To facilitate our investigation, we develop a new benchmark, Unconventionally Feasible Objects (UFO), as well as SimpleBlenv, a wrapper environment built on top of Blender where language agents can build and compose atomic building blocks via API calls. Human and automatic GPT-4V evaluations show that our approach surpasses the standard GPT-4 and other language agents (e.g., ReAct and Reflexion) for 3D mesh generation on ShapeNet. Moreover, when tested on our UFO benchmark, our approach outperforms other state-of-the-art text-to-2D image and text-to-3D models based on human evaluation.


title: Cartesian products of two $CR$ sets

abstract: The notions of CR set is intimately related with the generalized van der Waerden's theorem. In this article, we prove the product of two CR sets is again a CR set. This answers [Question 4.2., N. Hindman, H. Hosseini, D. Strauss, and M. Tootkaboni: Combinatorially rich sets in arbitrary semigroups, Semigroup Forum, 107 (2023), 127-143.] . We use combinatorial arguments to prove our result.


title: The weak (1,1) boundedness of Fourier integral operators with complex phases

abstract: Let $T$ be a Fourier integral operator of order $-(n-1)/2$ associated with a canonical relation locally parametrised by a real-phase function. A fundamental result due to Seeger, Sogge, and Stein proved in the 90's, gives the boundedness of $T$ from the Hardy space $H^1$ into $L^1.$ Additionally, it was shown by T. Tao the weak (1,1) type of $T$. In this work, we establish the weak (1,1) boundedness of a Fourier integral operator $T$ of order $-(n-1)/2$ when it has associated a canonical relation parametrised by a complex phase function.


title: Comment-aided Video-Language Alignment via Contrastive Pre-training for Short-form Video Humor Detection

abstract: The growing importance of multi-modal humor detection within affective computing correlates with the expanding influence of short-form video sharing on social media platforms. In this paper, we propose a novel two-branch hierarchical model for short-form video humor detection (SVHD), named Comment-aided Video-Language Alignment (CVLA) via data-augmented multi-modal contrastive pre-training. Notably, our CVLA not only operates on raw signals across various modal channels but also yields an appropriate multi-modal representation by aligning the video and language components within a consistent semantic space. The experimental results on two humor detection datasets, including DY11k and UR-FUNNY, demonstrate that CVLA dramatically outperforms state-of-the-art and several competitive baseline approaches. Our dataset, code and model release at https://github.com/yliu-cs/CVLA.


title: Is Epistemic Uncertainty Faithfully Represented by Evidential Deep Learning Methods?

abstract: Trustworthy ML systems should not only return accurate predictions, but also a reliable representation of their uncertainty. Bayesian methods are commonly used to quantify both aleatoric and epistemic uncertainty, but alternative approaches, such as evidential deep learning methods, have become popular in recent years. The latter group of methods in essence extends empirical risk minimization (ERM) for predicting second-order probability distributions over outcomes, from which measures of epistemic (and aleatoric) uncertainty can be extracted. This paper presents novel theoretical insights of evidential deep learning, highlighting the difficulties in optimizing second-order loss functions and interpreting the resulting epistemic uncertainty measures. With a systematic setup that covers a wide range of approaches for classification, regression and counts, it provides novel insights into issues of identifiability and convergence in second-order loss minimization, and the relative (rather than absolute) nature of epistemic uncertainty measures.


title: Distributed Sensing Along Fibres for Smart Clothing

abstract: Textile sensors transform our everyday clothing into a means to track movement and bio-signals in a completely unobtrusive way. One major hindrance to the adoption of "smart" clothing is the difficulty encountered with connections and space when scaling up the number of sensors. There is a lack of research addressing a key limitation in wearable electronics: connections between rigid and textile elements are often unreliable and they require interfacing sensors in a way incompatible with textile mass production methods. We introduce a prototype garment, compact readout circuit, and algorithm to measure localized strain along multiple regions of a fibre. We employ a helical auxetic yarn sensor with tunable sensitivity along its length to selectively respond to strain signals. We demonstrate distributed sensing in clothing, monitoring arm joint angles from a single continuous fibre. Compared to optical motion capture, we achieve around 5{\deg} error in reconstructing shoulder, elbow, and wrist joint angles.